2023-10-05T19:49:47.359 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-05T19:49:47.359 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7411776 --verbose --description rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated supported-random-distro$/{centos_8}} --name yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7411776/orig.config.yaml 2023-10-05T19:49:47.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T19:49:47.465 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7411776 branch: wip-yuri2-testing-2023-10-04-1333-quincy description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated supported-random-distro$/{centos_8}} email: yweinste@redhat.com first_in_suite: false job_id: '7411776' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-yuri2-testing-2023-10-04-1333-quincy ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 osd objectstore: filestore osd sloppy crc: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) sha1: 487ffcb5ddb60d29c5688d1a457e812b1b697b90 wait-for-scrub: false ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: osd objectstore: filestore osd sloppy crc: true filestore: true fs: xfs install: ceph: flavor: default sha1: 487ffcb5ddb60d29c5688d1a457e812b1b697b90 rgw: ec-data-pool: false frontend: beast selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: wip-yuri2-testing-2023-10-04-1333-quincy sha1: 487ffcb5ddb60d29c5688d1a457e812b1b697b90 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 880 sha1: 487ffcb5ddb60d29c5688d1a457e812b1b697b90 sleep_before_teardown: 0 subset: 111/12000 suite: rgw suite_branch: wip-yuri2-testing-2023-10-04-1333-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_487ffcb5ddb60d29c5688d1a457e812b1b697b90/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 487ffcb5ddb60d29c5688d1a457e812b1b697b90 targets: smithi111.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFSIcFshv4j1ZisScgQRwmHjhU0nXdvB6X/4EWZBJ63wYe5v1IAyIirqOYDuvoklUas+azYMSnGMNJJHRWBKnM0= smithi153.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD0BPipO53WEzGHk5IOIh6A0KYrYFA87fnCNiqydHlHlKJmqH0xF8tus8gyFVv36MetERZX/Y4OIJm5+milrRSg= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-05_14:30:58 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-05T19:49:47.465 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_487ffcb5ddb60d29c5688d1a457e812b1b697b90/qa; will attempt to use it 2023-10-05T19:49:47.466 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_487ffcb5ddb60d29c5688d1a457e812b1b697b90/qa/tasks 2023-10-05T19:49:47.466 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-05T19:49:47.468 INFO:teuthology.task.internal:Checking packages... 2023-10-05T19:49:47.489 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '487ffcb5ddb60d29c5688d1a457e812b1b697b90' 2023-10-05T19:49:47.489 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-05T19:49:47.489 INFO:teuthology.packaging:ref: None 2023-10-05T19:49:47.489 INFO:teuthology.packaging:tag: None 2023-10-05T19:49:47.489 INFO:teuthology.packaging:branch: wip-yuri2-testing-2023-10-04-1333-quincy 2023-10-05T19:49:47.490 INFO:teuthology.packaging:sha1: 487ffcb5ddb60d29c5688d1a457e812b1b697b90 2023-10-05T19:49:47.490 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri2-testing-2023-10-04-1333-quincy 2023-10-05T19:49:47.633 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1278.g487ffcb5 2023-10-05T19:49:47.634 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-05T19:49:47.640 INFO:teuthology.task.internal:no buildpackages task found 2023-10-05T19:49:47.640 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-05T19:49:47.649 INFO:teuthology.task.internal:Saving configuration 2023-10-05T19:49:47.661 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-05T19:49:47.669 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-05T19:49:47.695 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7411776', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 19:44:18.903128', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFSIcFshv4j1ZisScgQRwmHjhU0nXdvB6X/4EWZBJ63wYe5v1IAyIirqOYDuvoklUas+azYMSnGMNJJHRWBKnM0='} 2023-10-05T19:49:47.716 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7411776', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 19:44:18.901177', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD0BPipO53WEzGHk5IOIh6A0KYrYFA87fnCNiqydHlHlKJmqH0xF8tus8gyFVv36MetERZX/Y4OIJm5+milrRSg='} 2023-10-05T19:49:47.716 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-05T19:49:47.723 INFO:teuthology.task.internal:roles: ubuntu@smithi111.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2023-10-05T19:49:47.723 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2023-10-05T19:49:47.723 INFO:teuthology.run_tasks:Running task console_log... 2023-10-05T19:49:47.794 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f88da72eee0>, signals=[15]) 2023-10-05T19:49:47.794 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-05T19:49:47.802 INFO:teuthology.task.internal:Opening connections... 2023-10-05T19:49:47.802 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi111.front.sepia.ceph.com 2023-10-05T19:49:47.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T19:49:47.870 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi153.front.sepia.ceph.com 2023-10-05T19:49:47.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T19:49:47.937 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-05T19:49:47.944 DEBUG:teuthology.orchestra.run.smithi111:> uname -m 2023-10-05T19:49:47.966 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2023-10-05T19:49:47.966 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2023-10-05T19:49:48.027 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream" 2023-10-05T19:49:48.028 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8" 2023-10-05T19:49:48.028 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos" 2023-10-05T19:49:48.028 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora" 2023-10-05T19:49:48.028 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8" 2023-10-05T19:49:48.028 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8" 2023-10-05T19:49:48.028 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-05T19:49:48.028 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31" 2023-10-05T19:49:48.028 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-05T19:49:48.028 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/" 2023-10-05T19:49:48.028 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-05T19:49:48.029 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-05T19:49:48.029 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-05T19:49:48.029 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2023-10-05T19:49:48.053 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2023-10-05T19:49:48.076 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2023-10-05T19:49:48.077 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2023-10-05T19:49:48.137 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream" 2023-10-05T19:49:48.137 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8" 2023-10-05T19:49:48.137 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos" 2023-10-05T19:49:48.137 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora" 2023-10-05T19:49:48.137 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8" 2023-10-05T19:49:48.137 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8" 2023-10-05T19:49:48.138 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-05T19:49:48.138 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2023-10-05T19:49:48.138 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-05T19:49:48.138 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/" 2023-10-05T19:49:48.138 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-05T19:49:48.138 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-05T19:49:48.138 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-05T19:49:48.138 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-10-05T19:49:48.162 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-05T19:49:48.172 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-05T19:49:48.180 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-05T19:49:48.180 DEBUG:teuthology.orchestra.run.smithi111:> test '!' -e /home/ubuntu/cephtest 2023-10-05T19:49:48.183 DEBUG:teuthology.orchestra.run.smithi153:> test '!' -e /home/ubuntu/cephtest 2023-10-05T19:49:48.202 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-05T19:49:48.208 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-05T19:49:48.208 DEBUG:teuthology.orchestra.run.smithi111:> test -z $(ls -A /var/lib/ceph) 2023-10-05T19:49:48.244 DEBUG:teuthology.orchestra.run.smithi153:> test -z $(ls -A /var/lib/ceph) 2023-10-05T19:49:48.272 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-05T19:49:48.332 INFO:teuthology.run_tasks:Running task kernel... 2023-10-05T19:49:48.348 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-05T19:49:48.348 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-05T19:49:48.348 DEBUG:teuthology.orchestra.run.smithi111:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-05T19:49:48.349 DEBUG:teuthology.orchestra.run.smithi153:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-05T19:49:48.367 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T19:49:48.368 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2023-10-05T19:49:48.370 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T19:49:48.370 DEBUG:teuthology.orchestra.run.smithi111:> uname -r 2023-10-05T19:49:48.427 INFO:teuthology.orchestra.run.smithi153.stdout:4.18.0-489.el8.x86_64 2023-10-05T19:49:48.427 INFO:teuthology.task.kernel:Running kernel on smithi153: 4.18.0-489.el8.x86_64 2023-10-05T19:49:48.428 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum install -y kernel 2023-10-05T19:49:48.432 INFO:teuthology.orchestra.run.smithi111.stdout:4.18.0-489.el8.x86_64 2023-10-05T19:49:48.433 INFO:teuthology.task.kernel:Running kernel on smithi111: 4.18.0-489.el8.x86_64 2023-10-05T19:49:48.433 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum install -y kernel 2023-10-05T19:58:59.942 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - AppStream 62 kB/s | 33 MB 09:08 2023-10-05T19:59:07.075 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - BaseOS 46 MB/s | 48 MB 00:01 2023-10-05T19:59:14.250 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - Extras 57 kB/s | 18 kB 00:00 2023-10-05T19:59:14.567 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - Extras common packages 49 kB/s | 6.9 kB 00:00 2023-10-05T19:59:14.844 INFO:teuthology.orchestra.run.smithi111.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-10-05T19:59:15.936 INFO:teuthology.orchestra.run.smithi111.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2023-10-05T19:59:19.736 INFO:teuthology.orchestra.run.smithi111.stdout:lab-extras 458 kB/s | 24 kB 00:00 2023-10-05T19:59:23.202 INFO:teuthology.orchestra.run.smithi111.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-10-05T19:59:23.202 INFO:teuthology.orchestra.run.smithi111.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-10-05T19:59:23.460 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-10-05T19:59:23.460 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T19:59:23.461 INFO:teuthology.orchestra.run.smithi111.stdout: Package Architecture Version Repository Size 2023-10-05T19:59:23.461 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T19:59:23.461 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-10-05T19:59:23.461 INFO:teuthology.orchestra.run.smithi111.stdout: kernel x86_64 4.18.0-514.el8 baseos 10 M 2023-10-05T19:59:23.461 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2023-10-05T19:59:23.461 INFO:teuthology.orchestra.run.smithi111.stdout: kernel-core x86_64 4.18.0-514.el8 baseos 43 M 2023-10-05T19:59:23.461 INFO:teuthology.orchestra.run.smithi111.stdout: kernel-modules x86_64 4.18.0-514.el8 baseos 35 M 2023-10-05T19:59:23.461 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T19:59:23.461 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-10-05T19:59:23.461 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T19:59:23.462 INFO:teuthology.orchestra.run.smithi111.stdout:Install 3 Packages 2023-10-05T19:59:23.462 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T19:59:23.462 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 88 M 2023-10-05T19:59:23.462 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 96 M 2023-10-05T19:59:23.463 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-10-05T19:59:23.879 INFO:teuthology.orchestra.run.smithi111.stdout:(1/3): kernel-4.18.0-514.el8.x86_64.rpm 43 MB/s | 10 MB 00:00 2023-10-05T19:59:24.296 INFO:teuthology.orchestra.run.smithi111.stdout:(2/3): kernel-modules-4.18.0-514.el8.x86_64.rpm 55 MB/s | 35 MB 00:00 2023-10-05T19:59:24.679 INFO:teuthology.orchestra.run.smithi111.stdout:(3/3): kernel-core-4.18.0-514.el8.x86_64.rpm 41 MB/s | 43 MB 00:01 2023-10-05T19:59:24.679 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-10-05T19:59:24.680 INFO:teuthology.orchestra.run.smithi111.stdout:Total 72 MB/s | 88 MB 00:01 2023-10-05T19:59:25.349 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-10-05T19:59:25.749 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-10-05T19:59:25.749 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-10-05T19:59:26.959 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-10-05T19:59:26.980 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-10-05T19:59:29.722 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-10-05T19:59:30.272 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-05T19:59:33.799 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-05T19:59:34.179 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-05T19:59:37.553 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-05T19:59:37.925 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : kernel-4.18.0-514.el8.x86_64 3/3 2023-10-05T19:59:59.609 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 3/3 2023-10-05T19:59:59.633 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-05T19:59:59.979 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: kernel-4.18.0-514.el8.x86_64 3/3 2023-10-05T19:59:59.979 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : kernel-4.18.0-514.el8.x86_64 1/3 2023-10-05T19:59:59.979 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : kernel-core-4.18.0-514.el8.x86_64 2/3 2023-10-05T20:00:00.704 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-05T20:00:00.704 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T20:00:00.704 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-10-05T20:00:00.704 INFO:teuthology.orchestra.run.smithi111.stdout: kernel-4.18.0-514.el8.x86_64 kernel-core-4.18.0-514.el8.x86_64 2023-10-05T20:00:00.704 INFO:teuthology.orchestra.run.smithi111.stdout: kernel-modules-4.18.0-514.el8.x86_64 2023-10-05T20:00:00.704 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T20:00:00.704 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-10-05T20:00:00.829 DEBUG:teuthology.orchestra.run.smithi111:> rpm -q kernel | sort -rV | head -n 1 2023-10-05T20:00:01.044 INFO:teuthology.orchestra.run.smithi111.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-05T20:00:01.045 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-05T20:00:01.045 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-514.el8.x86_64 2023-10-05T20:00:01.045 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-05T20:00:01.045 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-05T20:00:01.045 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-05T20:00:01.045 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi111.front.sepia.ceph.com, path=None, version=distro) 2023-10-05T20:00:01.045 DEBUG:teuthology.orchestra.run.smithi111:> rpm -q kernel | sort -rV | head -n 1 2023-10-05T20:00:01.253 INFO:teuthology.orchestra.run.smithi111.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-05T20:00:01.254 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-05T20:00:01.254 DEBUG:teuthology.orchestra.run.smithi111:> sudo rpm -qi grub2-tools 2023-10-05T20:00:01.288 INFO:teuthology.orchestra.run.smithi111.stdout:Name : grub2-tools 2023-10-05T20:00:01.288 INFO:teuthology.orchestra.run.smithi111.stdout:Epoch : 1 2023-10-05T20:00:01.289 INFO:teuthology.orchestra.run.smithi111.stdout:Version : 2.02 2023-10-05T20:00:01.289 INFO:teuthology.orchestra.run.smithi111.stdout:Release : 129.el8 2023-10-05T20:00:01.289 INFO:teuthology.orchestra.run.smithi111.stdout:Architecture: x86_64 2023-10-05T20:00:01.289 INFO:teuthology.orchestra.run.smithi111.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-10-05T20:00:01.289 INFO:teuthology.orchestra.run.smithi111.stdout:Group : System Environment/Base 2023-10-05T20:00:01.289 INFO:teuthology.orchestra.run.smithi111.stdout:Size : 9265586 2023-10-05T20:00:01.289 INFO:teuthology.orchestra.run.smithi111.stdout:License : GPLv3+ 2023-10-05T20:00:01.290 INFO:teuthology.orchestra.run.smithi111.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-10-05T20:00:01.290 INFO:teuthology.orchestra.run.smithi111.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-10-05T20:00:01.290 INFO:teuthology.orchestra.run.smithi111.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-10-05T20:00:01.290 INFO:teuthology.orchestra.run.smithi111.stdout:Build Host : kbuilder.bsys.centos.org 2023-10-05T20:00:01.290 INFO:teuthology.orchestra.run.smithi111.stdout:Relocations : (not relocatable) 2023-10-05T20:00:01.290 INFO:teuthology.orchestra.run.smithi111.stdout:Packager : CentOS BuildSystem 2023-10-05T20:00:01.290 INFO:teuthology.orchestra.run.smithi111.stdout:Vendor : CentOS 2023-10-05T20:00:01.291 INFO:teuthology.orchestra.run.smithi111.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-05T20:00:01.291 INFO:teuthology.orchestra.run.smithi111.stdout:Summary : Support tools for GRUB. 2023-10-05T20:00:01.291 INFO:teuthology.orchestra.run.smithi111.stdout:Description : 2023-10-05T20:00:01.291 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T20:00:01.291 INFO:teuthology.orchestra.run.smithi111.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-05T20:00:01.291 INFO:teuthology.orchestra.run.smithi111.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-05T20:00:01.291 INFO:teuthology.orchestra.run.smithi111.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-05T20:00:01.292 INFO:teuthology.orchestra.run.smithi111.stdout:hardware devices. 2023-10-05T20:00:01.292 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T20:00:01.292 INFO:teuthology.orchestra.run.smithi111.stdout:This subpackage provides tools for support of all platforms. 2023-10-05T20:00:01.293 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-05T20:00:01.293 INFO:teuthology.task.kernel:Updating grub on smithi111 to boot 4.18.0-514.el8.x86_64 2023-10-05T20:00:01.293 DEBUG:teuthology.orchestra.run.smithi111:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-05T20:00:02.893 INFO:teuthology.orchestra.run.smithi111.stderr:Generating grub configuration file ... 2023-10-05T20:00:05.063 INFO:teuthology.orchestra.run.smithi111.stderr:done 2023-10-05T20:00:05.065 DEBUG:teuthology.orchestra.run.smithi111:> mktemp 2023-10-05T20:00:05.094 INFO:teuthology.orchestra.run.smithi111.stdout:/tmp/tmp.UR7e4ipvPB 2023-10-05T20:00:05.095 DEBUG:teuthology.orchestra.run.smithi111:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.UR7e4ipvPB 2023-10-05T20:00:05.169 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0666 /tmp/tmp.UR7e4ipvPB 2023-10-05T20:00:05.326 DEBUG:teuthology.orchestra.remote:smithi111:/tmp/tmp.UR7e4ipvPB is 6KB 2023-10-05T20:00:05.375 DEBUG:teuthology.orchestra.run.smithi111:> rm -fr /tmp/tmp.UR7e4ipvPB 2023-10-05T20:00:05.392 DEBUG:teuthology.orchestra.run.smithi111:> sudo /bin/ls /boot/loader/entries || true 2023-10-05T20:00:05.473 INFO:teuthology.orchestra.run.smithi111.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-10-05T20:00:05.473 INFO:teuthology.orchestra.run.smithi111.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-10-05T20:00:05.473 INFO:teuthology.orchestra.run.smithi111.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-10-05T20:00:05.473 INFO:teuthology.orchestra.run.smithi111.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64.conf 2023-10-05T20:00:05.474 DEBUG:teuthology.orchestra.run.smithi111:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64 2023-10-05T20:00:05.650 DEBUG:teuthology.orchestra.run.smithi111:> sudo shutdown -r now 2023-10-05T20:00:35.653 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-05T20:00:35.653 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-10-05T20:00:35.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T20:00:54.143 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-10-05T20:01:03.144 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-10-05T20:01:03.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T20:01:06.202 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-10-05T20:01:18.203 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-10-05T20:01:18.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T20:01:21.274 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-10-05T20:01:36.276 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-10-05T20:01:36.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T20:01:54.810 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-10-05T20:02:12.811 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-10-05T20:02:12.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T20:02:13.111 DEBUG:teuthology.orchestra.run.smithi111:> true 2023-10-05T20:02:13.402 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-10-05T20:02:13.402 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-514.el8.x86_64"... 2023-10-05T20:02:13.402 DEBUG:teuthology.orchestra.run.smithi111:> uname -r 2023-10-05T20:02:13.423 INFO:teuthology.orchestra.run.smithi111.stdout:4.18.0-514.el8.x86_64 2023-10-05T20:02:13.424 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-514.el8.x86_64 vs 4.18.0-514.el8.x86_64 2023-10-05T20:02:13.424 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-05T20:02:13.424 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-05T20:02:14.424 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-05T20:02:14.425 DEBUG:teuthology.orchestra.run.smithi111:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-05T20:02:14.493 INFO:teuthology.orchestra.run.smithi111.stdout:ttyS1 2023-10-05T20:02:14.508 DEBUG:teuthology.parallel:result is None 2023-10-05T20:02:32.531 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - AppStream 45 kB/s | 33 MB 12:41 2023-10-05T20:02:39.573 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - BaseOS 68 MB/s | 48 MB 00:00 2023-10-05T20:02:47.139 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - Extras 39 kB/s | 18 kB 00:00 2023-10-05T20:02:47.457 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - Extras common packages 51 kB/s | 6.9 kB 00:00 2023-10-05T20:02:47.808 INFO:teuthology.orchestra.run.smithi153.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-10-05T20:02:49.401 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-10-05T20:02:53.386 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 234 kB/s | 24 kB 00:00 2023-10-05T20:02:56.883 INFO:teuthology.orchestra.run.smithi153.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-10-05T20:02:56.883 INFO:teuthology.orchestra.run.smithi153.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-10-05T20:02:57.145 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-10-05T20:02:57.146 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T20:02:57.146 INFO:teuthology.orchestra.run.smithi153.stdout: Package Architecture Version Repository Size 2023-10-05T20:02:57.146 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T20:02:57.146 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-10-05T20:02:57.146 INFO:teuthology.orchestra.run.smithi153.stdout: kernel x86_64 4.18.0-514.el8 baseos 10 M 2023-10-05T20:02:57.147 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2023-10-05T20:02:57.147 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-core x86_64 4.18.0-514.el8 baseos 43 M 2023-10-05T20:02:57.147 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-modules x86_64 4.18.0-514.el8 baseos 35 M 2023-10-05T20:02:57.147 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T20:02:57.147 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-10-05T20:02:57.147 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T20:02:57.147 INFO:teuthology.orchestra.run.smithi153.stdout:Install 3 Packages 2023-10-05T20:02:57.147 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T20:02:57.148 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 88 M 2023-10-05T20:02:57.148 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 96 M 2023-10-05T20:02:57.148 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-10-05T20:02:57.443 INFO:teuthology.orchestra.run.smithi153.stdout:(1/3): kernel-4.18.0-514.el8.x86_64.rpm 41 MB/s | 10 MB 00:00 2023-10-05T20:02:57.869 INFO:teuthology.orchestra.run.smithi153.stdout:(2/3): kernel-modules-4.18.0-514.el8.x86_64.rpm 53 MB/s | 35 MB 00:00 2023-10-05T20:02:58.252 INFO:teuthology.orchestra.run.smithi153.stdout:(3/3): kernel-core-4.18.0-514.el8.x86_64.rpm 40 MB/s | 43 MB 00:01 2023-10-05T20:02:58.253 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-10-05T20:02:58.253 INFO:teuthology.orchestra.run.smithi153.stdout:Total 80 MB/s | 88 MB 00:01 2023-10-05T20:02:58.929 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-10-05T20:02:59.360 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-10-05T20:02:59.360 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-10-05T20:03:00.581 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-10-05T20:03:00.608 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-10-05T20:03:03.377 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-10-05T20:03:03.908 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-05T20:03:07.526 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-05T20:03:07.933 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-05T20:03:11.315 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-05T20:03:11.612 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : kernel-4.18.0-514.el8.x86_64 3/3 2023-10-05T20:03:33.254 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 3/3 2023-10-05T20:03:33.277 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-05T20:03:33.634 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-4.18.0-514.el8.x86_64 3/3 2023-10-05T20:03:33.634 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : kernel-4.18.0-514.el8.x86_64 1/3 2023-10-05T20:03:33.634 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : kernel-core-4.18.0-514.el8.x86_64 2/3 2023-10-05T20:03:34.375 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-05T20:03:34.375 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T20:03:34.375 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-10-05T20:03:34.375 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-4.18.0-514.el8.x86_64 kernel-core-4.18.0-514.el8.x86_64 2023-10-05T20:03:34.376 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-modules-4.18.0-514.el8.x86_64 2023-10-05T20:03:34.376 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T20:03:34.376 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-10-05T20:03:35.242 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q kernel | sort -rV | head -n 1 2023-10-05T20:03:35.464 INFO:teuthology.orchestra.run.smithi153.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-05T20:03:35.464 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-05T20:03:35.464 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-514.el8.x86_64 2023-10-05T20:03:35.464 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-05T20:03:35.464 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-05T20:03:35.464 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2023-10-05T20:03:35.464 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi153.front.sepia.ceph.com, path=None, version=distro) 2023-10-05T20:03:35.465 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q kernel | sort -rV | head -n 1 2023-10-05T20:03:35.674 INFO:teuthology.orchestra.run.smithi153.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-05T20:03:35.674 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-05T20:03:35.674 DEBUG:teuthology.orchestra.run.smithi153:> sudo rpm -qi grub2-tools 2023-10-05T20:03:35.708 INFO:teuthology.orchestra.run.smithi153.stdout:Name : grub2-tools 2023-10-05T20:03:35.708 INFO:teuthology.orchestra.run.smithi153.stdout:Epoch : 1 2023-10-05T20:03:35.708 INFO:teuthology.orchestra.run.smithi153.stdout:Version : 2.02 2023-10-05T20:03:35.708 INFO:teuthology.orchestra.run.smithi153.stdout:Release : 129.el8 2023-10-05T20:03:35.709 INFO:teuthology.orchestra.run.smithi153.stdout:Architecture: x86_64 2023-10-05T20:03:35.709 INFO:teuthology.orchestra.run.smithi153.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-10-05T20:03:35.709 INFO:teuthology.orchestra.run.smithi153.stdout:Group : System Environment/Base 2023-10-05T20:03:35.709 INFO:teuthology.orchestra.run.smithi153.stdout:Size : 9265586 2023-10-05T20:03:35.709 INFO:teuthology.orchestra.run.smithi153.stdout:License : GPLv3+ 2023-10-05T20:03:35.709 INFO:teuthology.orchestra.run.smithi153.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-10-05T20:03:35.709 INFO:teuthology.orchestra.run.smithi153.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-10-05T20:03:35.709 INFO:teuthology.orchestra.run.smithi153.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-10-05T20:03:35.709 INFO:teuthology.orchestra.run.smithi153.stdout:Build Host : kbuilder.bsys.centos.org 2023-10-05T20:03:35.709 INFO:teuthology.orchestra.run.smithi153.stdout:Relocations : (not relocatable) 2023-10-05T20:03:35.709 INFO:teuthology.orchestra.run.smithi153.stdout:Packager : CentOS BuildSystem 2023-10-05T20:03:35.710 INFO:teuthology.orchestra.run.smithi153.stdout:Vendor : CentOS 2023-10-05T20:03:35.710 INFO:teuthology.orchestra.run.smithi153.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-05T20:03:35.710 INFO:teuthology.orchestra.run.smithi153.stdout:Summary : Support tools for GRUB. 2023-10-05T20:03:35.710 INFO:teuthology.orchestra.run.smithi153.stdout:Description : 2023-10-05T20:03:35.710 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T20:03:35.710 INFO:teuthology.orchestra.run.smithi153.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-05T20:03:35.710 INFO:teuthology.orchestra.run.smithi153.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-05T20:03:35.710 INFO:teuthology.orchestra.run.smithi153.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-05T20:03:35.710 INFO:teuthology.orchestra.run.smithi153.stdout:hardware devices. 2023-10-05T20:03:35.710 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T20:03:35.710 INFO:teuthology.orchestra.run.smithi153.stdout:This subpackage provides tools for support of all platforms. 2023-10-05T20:03:35.711 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-05T20:03:35.711 INFO:teuthology.task.kernel:Updating grub on smithi153 to boot 4.18.0-514.el8.x86_64 2023-10-05T20:03:35.712 DEBUG:teuthology.orchestra.run.smithi153:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-05T20:03:36.951 INFO:teuthology.orchestra.run.smithi153.stderr:Generating grub configuration file ... 2023-10-05T20:03:39.064 INFO:teuthology.orchestra.run.smithi153.stderr:done 2023-10-05T20:03:39.066 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2023-10-05T20:03:39.089 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.iMGmkgINGv 2023-10-05T20:03:39.089 DEBUG:teuthology.orchestra.run.smithi153:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.iMGmkgINGv 2023-10-05T20:03:39.162 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.iMGmkgINGv 2023-10-05T20:03:39.357 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.iMGmkgINGv is 6KB 2023-10-05T20:03:39.407 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.iMGmkgINGv 2023-10-05T20:03:39.424 DEBUG:teuthology.orchestra.run.smithi153:> sudo /bin/ls /boot/loader/entries || true 2023-10-05T20:03:39.495 INFO:teuthology.orchestra.run.smithi153.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-10-05T20:03:39.495 INFO:teuthology.orchestra.run.smithi153.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-10-05T20:03:39.495 INFO:teuthology.orchestra.run.smithi153.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-10-05T20:03:39.495 INFO:teuthology.orchestra.run.smithi153.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64.conf 2023-10-05T20:03:39.497 DEBUG:teuthology.orchestra.run.smithi153:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64 2023-10-05T20:03:39.677 DEBUG:teuthology.orchestra.run.smithi153:> sudo shutdown -r now 2023-10-05T20:04:09.680 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2023-10-05T20:04:09.680 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-10-05T20:04:09.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T20:04:28.158 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-10-05T20:04:37.159 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-10-05T20:04:37.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T20:04:40.218 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-10-05T20:04:52.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-10-05T20:04:52.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T20:05:10.650 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-10-05T20:05:25.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-10-05T20:05:25.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T20:05:26.052 DEBUG:teuthology.orchestra.run.smithi153:> true 2023-10-05T20:05:26.303 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-10-05T20:05:26.304 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "4.18.0-514.el8.x86_64"... 2023-10-05T20:05:26.304 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2023-10-05T20:05:26.321 INFO:teuthology.orchestra.run.smithi153.stdout:4.18.0-514.el8.x86_64 2023-10-05T20:05:26.321 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-514.el8.x86_64 vs 4.18.0-514.el8.x86_64 2023-10-05T20:05:26.321 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-05T20:05:26.321 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-05T20:05:27.323 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2023-10-05T20:05:27.323 DEBUG:teuthology.orchestra.run.smithi153:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-05T20:05:27.436 INFO:teuthology.orchestra.run.smithi153.stdout:ttyS1 2023-10-05T20:05:27.450 DEBUG:teuthology.parallel:result is None 2023-10-05T20:05:27.450 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-05T20:05:27.458 INFO:teuthology.task.internal:Creating test directory... 2023-10-05T20:05:27.458 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-05T20:05:27.461 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-05T20:05:27.481 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-05T20:05:27.488 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-05T20:05:27.494 INFO:teuthology.task.internal:Creating archive directory... 2023-10-05T20:05:27.494 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-05T20:05:27.523 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-05T20:05:27.556 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-05T20:05:27.562 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-05T20:05:27.563 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-05T20:05:27.590 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-05T20:05:27.631 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-05T20:05:27.632 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-05T20:05:27.642 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-05T20:05:27.643 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-05T20:05:27.644 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-05T20:05:27.651 INFO:teuthology.task.internal:Configuring sudo... 2023-10-05T20:05:27.651 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-05T20:05:27.653 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-05T20:05:27.715 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-05T20:05:27.723 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-05T20:05:27.724 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-05T20:05:27.726 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-05T20:05:27.776 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-05T20:05:27.830 DEBUG:teuthology.orchestra.run.smithi111:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-05T20:05:27.880 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-05T20:05:27.965 DEBUG:teuthology.orchestra.run.smithi111:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-05T20:05:28.007 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2023-10-05T20:05:28.007 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-05T20:05:28.075 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-05T20:05:28.120 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-05T20:05:28.191 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-05T20:05:28.234 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-05T20:05:28.281 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-05T20:05:28.281 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-05T20:05:28.351 DEBUG:teuthology.orchestra.run.smithi111:> sudo service rsyslog restart 2023-10-05T20:05:28.353 DEBUG:teuthology.orchestra.run.smithi153:> sudo service rsyslog restart 2023-10-05T20:05:28.426 INFO:teuthology.orchestra.run.smithi111.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-05T20:05:28.475 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-05T20:05:28.667 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-05T20:05:28.676 INFO:teuthology.task.internal:Starting timer... 2023-10-05T20:05:28.677 INFO:teuthology.run_tasks:Running task pcp... 2023-10-05T20:05:28.706 INFO:teuthology.run_tasks:Running task selinux... 2023-10-05T20:05:28.715 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-05T20:05:28.715 DEBUG:teuthology.orchestra.run.smithi111:> sudo service auditd rotate 2023-10-05T20:05:28.821 INFO:teuthology.orchestra.run.smithi111.stdout:Rotating logs: 2023-10-05T20:05:28.823 DEBUG:teuthology.orchestra.run.smithi153:> sudo service auditd rotate 2023-10-05T20:05:29.039 INFO:teuthology.orchestra.run.smithi153.stdout:Rotating logs: 2023-10-05T20:05:29.054 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-05T20:05:29.055 DEBUG:teuthology.orchestra.run.smithi111:> /usr/sbin/getenforce 2023-10-05T20:05:29.075 INFO:teuthology.orchestra.run.smithi111.stdout:Permissive 2023-10-05T20:05:29.075 DEBUG:teuthology.orchestra.run.smithi153:> /usr/sbin/getenforce 2023-10-05T20:05:29.560 INFO:teuthology.orchestra.run.smithi153.stdout:Permissive 2023-10-05T20:05:29.560 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi111.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi153.front.sepia.ceph.com': 'permissive'} 2023-10-05T20:05:29.561 DEBUG:teuthology.orchestra.run.smithi111:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-05T20:05:29.587 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T20:05:29.588 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-05T20:05:30.162 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T20:05:30.162 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-05T20:05:30.163 DEBUG:teuthology.orchestra.run.smithi111:> sudo /usr/sbin/setenforce permissive 2023-10-05T20:05:30.202 DEBUG:teuthology.orchestra.run.smithi153:> sudo /usr/sbin/setenforce permissive 2023-10-05T20:05:30.456 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-05T20:05:30.466 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-05T20:05:30.471 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-05T20:05:30.588 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-05T20:05:30.604 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-05T20:05:30.605 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi111.front.sepia.ceph.com,smithi153.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-05T20:30:50.874 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi111.front.sepia.ceph.com'), Remote(name='ubuntu@smithi153.front.sepia.ceph.com')] 2023-10-05T20:30:50.876 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-10-05T20:30:50.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T20:30:50.948 DEBUG:teuthology.orchestra.run.smithi111:> true 2023-10-05T20:30:51.016 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-10-05T20:30:51.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-10-05T20:30:51.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T20:30:51.083 DEBUG:teuthology.orchestra.run.smithi153:> true 2023-10-05T20:30:51.153 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-10-05T20:30:51.153 INFO:teuthology.run_tasks:Running task clock... 2023-10-05T20:30:51.163 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-05T20:30:51.163 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-05T20:30:51.164 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-05T20:30:51.166 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-05T20:30:51.166 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-05T20:30:51.197 INFO:teuthology.orchestra.run.smithi111.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-05T20:30:51.211 INFO:teuthology.orchestra.run.smithi111.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-05T20:30:51.225 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-05T20:30:51.239 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-05T20:30:51.285 INFO:teuthology.orchestra.run.smithi111.stderr:sudo: ntpd: command not found 2023-10-05T20:30:51.297 INFO:teuthology.orchestra.run.smithi111.stdout:506 Cannot talk to daemon 2023-10-05T20:30:51.306 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: ntpd: command not found 2023-10-05T20:30:51.311 INFO:teuthology.orchestra.run.smithi111.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-05T20:30:51.317 INFO:teuthology.orchestra.run.smithi153.stdout:506 Cannot talk to daemon 2023-10-05T20:30:51.324 INFO:teuthology.orchestra.run.smithi111.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-05T20:30:51.331 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-05T20:30:51.345 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-05T20:30:51.384 INFO:teuthology.orchestra.run.smithi111.stderr:bash: ntpq: command not found 2023-10-05T20:30:51.388 INFO:teuthology.orchestra.run.smithi111.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-05T20:30:51.388 INFO:teuthology.orchestra.run.smithi111.stdout:=============================================================================== 2023-10-05T20:30:51.388 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T20:30:51.388 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T20:30:51.388 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T20:30:51.388 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T20:30:51.417 INFO:teuthology.orchestra.run.smithi153.stderr:bash: ntpq: command not found 2023-10-05T20:30:51.421 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-05T20:30:51.421 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2023-10-05T20:30:51.421 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T20:30:51.421 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T20:30:51.421 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T20:30:51.422 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T20:30:51.423 INFO:teuthology.run_tasks:Running task install... 2023-10-05T20:30:51.431 DEBUG:teuthology.task.install:project ceph 2023-10-05T20:30:51.431 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '487ffcb5ddb60d29c5688d1a457e812b1b697b90'}} 2023-10-05T20:30:51.431 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '487ffcb5ddb60d29c5688d1a457e812b1b697b90'} 2023-10-05T20:30:51.431 INFO:teuthology.task.install:Using flavor: default 2023-10-05T20:30:51.436 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-05T20:30:51.437 INFO:teuthology.task.install:extra packages: [] 2023-10-05T20:30:51.437 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '487ffcb5ddb60d29c5688d1a457e812b1b697b90', 'tag': None, 'wait_for_package': False} 2023-10-05T20:30:51.437 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=487ffcb5ddb60d29c5688d1a457e812b1b697b90 2023-10-05T20:30:51.439 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '487ffcb5ddb60d29c5688d1a457e812b1b697b90', 'tag': None, 'wait_for_package': False} 2023-10-05T20:30:51.439 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=487ffcb5ddb60d29c5688d1a457e812b1b697b90 2023-10-05T20:30:51.583 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/centos/8/flavors/default/ 2023-10-05T20:30:51.583 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1278.g487ffcb5 2023-10-05T20:30:51.589 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/centos/8/flavors/default/ 2023-10-05T20:30:51.589 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1278.g487ffcb5 2023-10-05T20:30:51.688 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-05T20:30:51.689 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2023-10-05T20:30:51.689 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-05T20:30:51.718 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-10-05T20:30:51.718 DEBUG:teuthology.orchestra.run.smithi111:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/487ffcb5ddb60d29c5688d1a457e812b1b697b90/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-05T20:30:51.753 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-05T20:30:51.753 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-05T20:30:51.753 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-05T20:30:51.786 DEBUG:teuthology.orchestra.run.smithi111:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-05T20:30:51.788 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-10-05T20:30:51.788 DEBUG:teuthology.orchestra.run.smithi153:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/487ffcb5ddb60d29c5688d1a457e812b1b697b90/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-05T20:30:51.858 DEBUG:teuthology.orchestra.run.smithi153:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-05T20:30:51.866 DEBUG:teuthology.orchestra.run.smithi111:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-05T20:30:51.932 INFO:teuthology.orchestra.run.smithi111.stdout:check_obsoletes = 1 2023-10-05T20:30:51.934 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum clean all 2023-10-05T20:30:51.936 DEBUG:teuthology.orchestra.run.smithi153:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-05T20:30:52.003 INFO:teuthology.orchestra.run.smithi153.stdout:check_obsoletes = 1 2023-10-05T20:30:52.004 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum clean all 2023-10-05T20:30:52.210 INFO:teuthology.orchestra.run.smithi111.stdout:76 files removed 2023-10-05T20:30:52.238 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-radosgw 2023-10-05T20:30:52.283 INFO:teuthology.orchestra.run.smithi153.stdout:76 files removed 2023-10-05T20:30:52.314 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-radosgw 2023-10-05T20:30:53.036 INFO:teuthology.orchestra.run.smithi153.stdout:ceph packages for x86_64 247 kB/s | 78 kB 00:00 2023-10-05T20:30:53.066 INFO:teuthology.orchestra.run.smithi111.stdout:ceph packages for x86_64 184 kB/s | 78 kB 00:00 2023-10-05T20:30:53.403 INFO:teuthology.orchestra.run.smithi153.stdout:ceph noarch packages 28 kB/s | 9.2 kB 00:00 2023-10-05T20:30:53.467 INFO:teuthology.orchestra.run.smithi111.stdout:ceph noarch packages 25 kB/s | 9.2 kB 00:00 2023-10-05T20:30:53.720 INFO:teuthology.orchestra.run.smithi153.stdout:ceph source packages 5.0 kB/s | 1.4 kB 00:00 2023-10-05T20:30:53.784 INFO:teuthology.orchestra.run.smithi111.stdout:ceph source packages 5.0 kB/s | 1.4 kB 00:00 2023-10-05T20:40:58.896 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - AppStream 56 kB/s | 33 MB 10:05 2023-10-05T20:41:05.737 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - BaseOS 71 MB/s | 48 MB 00:00 2023-10-05T20:41:13.262 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - Extras 38 kB/s | 18 kB 00:00 2023-10-05T20:41:13.587 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - Extras common packages 46 kB/s | 6.9 kB 00:00 2023-10-05T20:41:14.939 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - PowerTools 5.4 MB/s | 6.5 MB 00:01 2023-10-05T20:41:16.398 INFO:teuthology.orchestra.run.smithi153.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-10-05T20:41:17.241 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 23 MB/s | 16 MB 00:00 2023-10-05T20:41:21.049 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 579 kB/s | 24 kB 00:00 2023-10-05T20:41:25.463 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-10-05T20:41:25.466 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T20:41:25.466 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2023-10-05T20:41:25.466 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T20:41:25.466 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-10-05T20:41:25.466 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 17 M 2023-10-05T20:41:25.466 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrading: 2023-10-05T20:41:25.466 INFO:teuthology.orchestra.run.smithi153.stdout: librados2 x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 3.5 M 2023-10-05T20:41:25.466 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1 x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 3.6 M 2023-10-05T20:41:25.467 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2023-10-05T20:41:25.467 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 5.2 M 2023-10-05T20:41:25.467 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 23 M 2023-10-05T20:41:25.467 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 24 k 2023-10-05T20:41:25.467 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-05T20:41:25.467 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2 x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 797 k 2023-10-05T20:41:25.467 INFO:teuthology.orchestra.run.smithi153.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-05T20:41:25.467 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-10-05T20:41:25.467 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1 x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 506 k 2023-10-05T20:41:25.467 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-10-05T20:41:25.468 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2 x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 5.6 M 2023-10-05T20:41:25.468 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-05T20:41:25.468 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-10-05T20:41:25.468 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 45 k 2023-10-05T20:41:25.468 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 115 k 2023-10-05T20:41:25.468 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 191 k 2023-10-05T20:41:25.468 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-10-05T20:41:25.468 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 370 k 2023-10-05T20:41:25.468 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 359 k 2023-10-05T20:41:25.468 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 106 k 2023-10-05T20:41:25.468 INFO:teuthology.orchestra.run.smithi153.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-05T20:41:25.468 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T20:41:25.469 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-10-05T20:41:25.469 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T20:41:25.469 INFO:teuthology.orchestra.run.smithi153.stdout:Install 21 Packages 2023-10-05T20:41:25.469 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrade 2 Packages 2023-10-05T20:41:25.469 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T20:41:25.469 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 63 M 2023-10-05T20:41:25.469 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-10-05T20:41:26.308 INFO:teuthology.orchestra.run.smithi153.stdout:(1/23): ceph-base-17.2.6-1278.g487ffcb5.el8.x86 8.9 MB/s | 5.2 MB 00:00 2023-10-05T20:41:26.367 INFO:teuthology.orchestra.run.smithi153.stdout:(2/23): ceph-selinux-17.2.6-1278.g487ffcb5.el8. 418 kB/s | 24 kB 00:00 2023-10-05T20:41:26.467 INFO:teuthology.orchestra.run.smithi153.stdout:(3/23): libcephfs2-17.2.6-1278.g487ffcb5.el8.x8 7.8 MB/s | 797 kB 00:00 2023-10-05T20:41:26.542 INFO:teuthology.orchestra.run.smithi153.stdout:(4/23): libradosstriper1-17.2.6-1278.g487ffcb5. 6.6 MB/s | 506 kB 00:00 2023-10-05T20:41:27.118 INFO:teuthology.orchestra.run.smithi153.stdout:(5/23): ceph-radosgw-17.2.6-1278.g487ffcb5.el8. 12 MB/s | 17 MB 00:01 2023-10-05T20:41:27.193 INFO:teuthology.orchestra.run.smithi153.stdout:(6/23): librgw2-17.2.6-1278.g487ffcb5.el8.x86_6 8.6 MB/s | 5.6 MB 00:00 2023-10-05T20:41:27.218 INFO:teuthology.orchestra.run.smithi153.stdout:(7/23): python3-ceph-argparse-17.2.6-1278.g487f 446 kB/s | 45 kB 00:00 2023-10-05T20:41:27.243 INFO:teuthology.orchestra.run.smithi153.stdout:(8/23): python3-ceph-common-17.2.6-1278.g487ffc 2.2 MB/s | 115 kB 00:00 2023-10-05T20:41:27.269 INFO:teuthology.orchestra.run.smithi153.stdout:(9/23): python3-cephfs-17.2.6-1278.g487ffcb5.el 3.7 MB/s | 191 kB 00:00 2023-10-05T20:41:27.302 INFO:teuthology.orchestra.run.smithi153.stdout:(10/23): python3-rados-17.2.6-1278.g487ffcb5.el 6.2 MB/s | 370 kB 00:00 2023-10-05T20:41:27.327 INFO:teuthology.orchestra.run.smithi153.stdout:(11/23): python3-rbd-17.2.6-1278.g487ffcb5.el8. 6.0 MB/s | 359 kB 00:00 2023-10-05T20:41:27.353 INFO:teuthology.orchestra.run.smithi153.stdout:(12/23): python3-rgw-17.2.6-1278.g487ffcb5.el8. 2.1 MB/s | 106 kB 00:00 2023-10-05T20:41:31.571 INFO:teuthology.orchestra.run.smithi153.stdout:(13/23): ceph-common-17.2.6-1278.g487ffcb5.el8. 4.0 MB/s | 23 MB 00:05 2023-10-05T20:43:29.755 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - AppStream 45 kB/s | 33 MB 12:35 2023-10-05T20:43:36.896 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - BaseOS 44 MB/s | 48 MB 00:01 2023-10-05T20:43:44.296 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - Extras 34 kB/s | 18 kB 00:00 2023-10-05T20:43:44.605 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - Extras common packages 52 kB/s | 6.9 kB 00:00 2023-10-05T20:43:46.031 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - PowerTools 5.1 MB/s | 6.5 MB 00:01 2023-10-05T20:43:47.516 INFO:teuthology.orchestra.run.smithi111.stdout:Copr repo for python3-asyncssh owned by ceph 16 kB/s | 3.5 kB 00:00 2023-10-05T20:43:51.252 INFO:teuthology.orchestra.run.smithi111.stdout:Extra Packages for Enterprise Linux 4.4 MB/s | 16 MB 00:03 2023-10-05T20:43:55.182 INFO:teuthology.orchestra.run.smithi111.stdout:lab-extras 173 kB/s | 24 kB 00:00 2023-10-05T20:43:59.548 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-10-05T20:43:59.551 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T20:43:59.551 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2023-10-05T20:43:59.551 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T20:43:59.551 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-10-05T20:43:59.551 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-radosgw x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 17 M 2023-10-05T20:43:59.551 INFO:teuthology.orchestra.run.smithi111.stdout:Upgrading: 2023-10-05T20:43:59.551 INFO:teuthology.orchestra.run.smithi111.stdout: librados2 x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 3.5 M 2023-10-05T20:43:59.551 INFO:teuthology.orchestra.run.smithi111.stdout: librbd1 x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 3.6 M 2023-10-05T20:43:59.551 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2023-10-05T20:43:59.552 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-base x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 5.2 M 2023-10-05T20:43:59.552 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-common x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 23 M 2023-10-05T20:43:59.552 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-selinux x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 24 k 2023-10-05T20:43:59.552 INFO:teuthology.orchestra.run.smithi111.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-05T20:43:59.552 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs2 x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 797 k 2023-10-05T20:43:59.552 INFO:teuthology.orchestra.run.smithi111.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-05T20:43:59.552 INFO:teuthology.orchestra.run.smithi111.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-10-05T20:43:59.552 INFO:teuthology.orchestra.run.smithi111.stdout: libradosstriper1 x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 506 k 2023-10-05T20:43:59.552 INFO:teuthology.orchestra.run.smithi111.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-10-05T20:43:59.552 INFO:teuthology.orchestra.run.smithi111.stdout: librgw2 x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 5.6 M 2023-10-05T20:43:59.552 INFO:teuthology.orchestra.run.smithi111.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-05T20:43:59.552 INFO:teuthology.orchestra.run.smithi111.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-10-05T20:43:59.553 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-argparse x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 45 k 2023-10-05T20:43:59.553 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-common x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 115 k 2023-10-05T20:43:59.553 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cephfs x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 191 k 2023-10-05T20:43:59.553 INFO:teuthology.orchestra.run.smithi111.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-10-05T20:43:59.553 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rados x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 370 k 2023-10-05T20:43:59.553 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rbd x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 359 k 2023-10-05T20:43:59.553 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rgw x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 106 k 2023-10-05T20:43:59.553 INFO:teuthology.orchestra.run.smithi111.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-05T20:43:59.553 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T20:43:59.554 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-10-05T20:43:59.554 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T20:43:59.554 INFO:teuthology.orchestra.run.smithi111.stdout:Install 21 Packages 2023-10-05T20:43:59.554 INFO:teuthology.orchestra.run.smithi111.stdout:Upgrade 2 Packages 2023-10-05T20:43:59.554 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T20:43:59.555 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 63 M 2023-10-05T20:43:59.555 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-10-05T20:44:00.792 INFO:teuthology.orchestra.run.smithi111.stdout:(1/23): ceph-base-17.2.6-1278.g487ffcb5.el8.x86 6.5 MB/s | 5.2 MB 00:00 2023-10-05T20:44:00.834 INFO:teuthology.orchestra.run.smithi111.stdout:(2/23): ceph-selinux-17.2.6-1278.g487ffcb5.el8. 587 kB/s | 24 kB 00:00 2023-10-05T20:44:00.900 INFO:teuthology.orchestra.run.smithi111.stdout:(3/23): libcephfs2-17.2.6-1278.g487ffcb5.el8.x8 12 MB/s | 797 kB 00:00 2023-10-05T20:44:00.959 INFO:teuthology.orchestra.run.smithi111.stdout:(4/23): libradosstriper1-17.2.6-1278.g487ffcb5. 8.5 MB/s | 506 kB 00:00 2023-10-05T20:44:01.268 INFO:teuthology.orchestra.run.smithi111.stdout:(5/23): librgw2-17.2.6-1278.g487ffcb5.el8.x86_6 18 MB/s | 5.6 MB 00:00 2023-10-05T20:44:01.310 INFO:teuthology.orchestra.run.smithi111.stdout:(6/23): python3-ceph-argparse-17.2.6-1278.g487f 1.0 MB/s | 45 kB 00:00 2023-10-05T20:44:01.360 INFO:teuthology.orchestra.run.smithi111.stdout:(7/23): python3-ceph-common-17.2.6-1278.g487ffc 2.3 MB/s | 115 kB 00:00 2023-10-05T20:44:01.411 INFO:teuthology.orchestra.run.smithi111.stdout:(8/23): python3-cephfs-17.2.6-1278.g487ffcb5.el 3.7 MB/s | 191 kB 00:00 2023-10-05T20:44:01.461 INFO:teuthology.orchestra.run.smithi111.stdout:(9/23): python3-rados-17.2.6-1278.g487ffcb5.el8 7.3 MB/s | 370 kB 00:00 2023-10-05T20:44:01.511 INFO:teuthology.orchestra.run.smithi111.stdout:(10/23): python3-rbd-17.2.6-1278.g487ffcb5.el8. 7.0 MB/s | 359 kB 00:00 2023-10-05T20:44:01.562 INFO:teuthology.orchestra.run.smithi111.stdout:(11/23): python3-rgw-17.2.6-1278.g487ffcb5.el8. 2.1 MB/s | 106 kB 00:00 2023-10-05T20:44:03.620 INFO:teuthology.orchestra.run.smithi111.stdout:(12/23): ceph-radosgw-17.2.6-1278.g487ffcb5.el8 4.6 MB/s | 17 MB 00:03 2023-10-05T20:44:06.637 INFO:teuthology.orchestra.run.smithi111.stdout:(13/23): ceph-common-17.2.6-1278.g487ffcb5.el8. 3.5 MB/s | 23 MB 00:06 2023-10-05T20:45:34.752 INFO:teuthology.orchestra.run.smithi153.stdout:[MIRROR] librdkafka-0.11.4-3.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/librdkafka-0.11.4-3.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-10-05T20:45:34.752 INFO:teuthology.orchestra.run.smithi153.stdout:[MIRROR] lttng-ust-2.8.1-11.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/lttng-ust-2.8.1-11.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-10-05T20:45:34.991 INFO:teuthology.orchestra.run.smithi153.stdout:(14/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.0 kB/s | 259 kB 04:07 2023-10-05T20:45:35.016 INFO:teuthology.orchestra.run.smithi153.stdout:(15/23): librdkafka-0.11.4-3.el8.x86_64.rpm 1.4 kB/s | 354 kB 04:07 2023-10-05T20:45:35.075 INFO:teuthology.orchestra.run.smithi153.stdout:(16/23): librabbitmq-0.9.0-4.el8.x86_64.rpm 562 kB/s | 47 kB 00:00 2023-10-05T20:45:35.392 INFO:teuthology.orchestra.run.smithi153.stdout:(17/23): liboath-2.6.2-3.el8.x86_64.rpm 188 kB/s | 59 kB 00:00 2023-10-05T20:45:35.450 INFO:teuthology.orchestra.run.smithi153.stdout:(18/23): gperftools-libs-2.7-9.el8.x86_64.rpm 706 kB/s | 306 kB 00:00 2023-10-05T20:45:35.517 INFO:teuthology.orchestra.run.smithi153.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 600 kB/s | 75 kB 00:00 2023-10-05T20:45:35.734 INFO:teuthology.orchestra.run.smithi153.stdout:(20/23): thrift-0.13.0-2.el8.x86_64.rpm 6.1 MB/s | 1.7 MB 00:00 2023-10-05T20:45:35.876 INFO:teuthology.orchestra.run.smithi153.stdout:(21/23): librados2-17.2.6-1278.g487ffcb5.el8.x8 9.7 MB/s | 3.5 MB 00:00 2023-10-05T20:45:36.310 INFO:teuthology.orchestra.run.smithi153.stdout:(22/23): librbd1-17.2.6-1278.g487ffcb5.el8.x86_ 6.2 MB/s | 3.6 MB 00:00 2023-10-05T20:45:59.108 INFO:teuthology.orchestra.run.smithi153.stdout:[MIRROR] python3-prettytable-0.7.2-14.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/python3-prettytable-0.7.2-14.el8.noarch.rpm [Recv failure: Connection reset by peer] 2023-10-05T20:45:59.256 INFO:teuthology.orchestra.run.smithi153.stdout:(23/23): python3-prettytable-0.7.2-14.el8.noarc 168 B/s | 44 kB 04:27 2023-10-05T20:45:59.259 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-10-05T20:45:59.259 INFO:teuthology.orchestra.run.smithi153.stdout:Total 237 kB/s | 63 MB 04:33 2023-10-05T20:45:59.298 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-10-05T20:45:59.345 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-10-05T20:45:59.345 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-10-05T20:45:59.718 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-10-05T20:45:59.721 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-10-05T20:46:00.783 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-10-05T20:46:00.968 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2023-10-05T20:46:01.130 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-10-05T20:46:01.521 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-10-05T20:46:01.713 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librados2-2:17.2.6-1278.g487ffcb5.el8.x86_64 3/25 2023-10-05T20:46:01.798 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-2:17.2.6-1278.g487ffcb5.el8.x86_64 3/25 2023-10-05T20:46:02.063 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rados-2:17.2.6-1278.g487ffcb5.el8.x86_64 4/25 2023-10-05T20:46:02.255 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs2-2:17.2.6-1278.g487ffcb5.el8.x86_64 5/25 2023-10-05T20:46:02.677 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephfs2-2:17.2.6-1278.g487ffcb5.el8.x86_64 5/25 2023-10-05T20:46:02.863 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librbd1-2:17.2.6-1278.g487ffcb5.el8.x86_64 6/25 2023-10-05T20:46:03.071 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-2:17.2.6-1278.g487ffcb5.el8.x86_64 6/25 2023-10-05T20:46:03.243 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : thrift-0.13.0-2.el8.x86_64 7/25 2023-10-05T20:46:03.419 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 8/25 2023-10-05T20:46:03.579 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2023-10-05T20:46:04.131 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2023-10-05T20:46:04.284 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librgw2-2:17.2.6-1278.g487ffcb5.el8.x86_64 10/25 2023-10-05T20:46:04.350 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librgw2-2:17.2.6-1278.g487ffcb5.el8.x86_64 10/25 2023-10-05T20:46:04.532 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-argparse-2:17.2.6-1278.g487ffcb5.el8. 11/25 2023-10-05T20:46:04.700 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cephfs-2:17.2.6-1278.g487ffcb5.el8.x86_64 12/25 2023-10-05T20:46:04.906 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rgw-2:17.2.6-1278.g487ffcb5.el8.x86_64 13/25 2023-10-05T20:46:05.116 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rbd-2:17.2.6-1278.g487ffcb5.el8.x86_64 14/25 2023-10-05T20:46:05.237 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libradosstriper1-2:17.2.6-1278.g487ffcb5.el8.x86_6 15/25 2023-10-05T20:46:05.305 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1278.g487ffcb5.el8.x86_6 15/25 2023-10-05T20:46:05.569 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2023-10-05T20:46:05.762 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2023-10-05T20:46:05.946 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-10-05T20:46:06.113 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-common-2:17.2.6-1278.g487ffcb5.el8.x8 19/25 2023-10-05T20:46:08.751 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:17.2.6-1278.g487ffcb5.el8.x86_64 20/25 2023-10-05T20:46:08.954 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-common-2:17.2.6-1278.g487ffcb5.el8.x86_64 20/25 2023-10-05T20:46:09.535 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:17.2.6-1278.g487ffcb5.el8.x86_64 20/25 2023-10-05T20:46:09.774 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-base-2:17.2.6-1278.g487ffcb5.el8.x86_64 21/25 2023-10-05T20:46:09.859 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-base-2:17.2.6-1278.g487ffcb5.el8.x86_64 21/25 2023-10-05T20:46:10.037 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-selinux-2:17.2.6-1278.g487ffcb5.el8.x86_64 22/25 2023-10-05T20:46:28.151 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1278.g487ffcb5.el8.x86_64 22/25 2023-10-05T20:46:28.151 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /sys 2023-10-05T20:46:28.151 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /proc 2023-10-05T20:46:28.151 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /dev 2023-10-05T20:46:28.151 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /run 2023-10-05T20:46:28.151 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /mnt 2023-10-05T20:46:28.151 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /var/tmp 2023-10-05T20:46:28.152 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /home 2023-10-05T20:46:28.152 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /tmp 2023-10-05T20:46:28.152 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /dev 2023-10-05T20:46:28.152 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T20:46:29.838 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-radosgw-2:17.2.6-1278.g487ffcb5.el8.x86_64 23/25 2023-10-05T20:46:29.918 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1278.g487ffcb5.el8.x86_64 23/25 2023-10-05T20:46:29.918 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-10-05T20:46:30.178 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-10-05T20:46:30.178 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-10-05T20:46:30.824 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-10-05T20:46:30.824 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-base-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/25 2023-10-05T20:46:30.824 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-common-2:17.2.6-1278.g487ffcb5.el8.x86_64 2/25 2023-10-05T20:46:30.824 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-radosgw-2:17.2.6-1278.g487ffcb5.el8.x86_64 3/25 2023-10-05T20:46:30.824 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-selinux-2:17.2.6-1278.g487ffcb5.el8.x86_64 4/25 2023-10-05T20:46:30.824 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs2-2:17.2.6-1278.g487ffcb5.el8.x86_64 5/25 2023-10-05T20:46:30.824 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libradosstriper1-2:17.2.6-1278.g487ffcb5.el8.x86_6 6/25 2023-10-05T20:46:30.824 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librgw2-2:17.2.6-1278.g487ffcb5.el8.x86_64 7/25 2023-10-05T20:46:30.824 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1278.g487ffcb5.el8. 8/25 2023-10-05T20:46:30.825 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-common-2:17.2.6-1278.g487ffcb5.el8.x8 9/25 2023-10-05T20:46:30.825 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cephfs-2:17.2.6-1278.g487ffcb5.el8.x86_64 10/25 2023-10-05T20:46:30.825 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rados-2:17.2.6-1278.g487ffcb5.el8.x86_64 11/25 2023-10-05T20:46:30.825 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rbd-2:17.2.6-1278.g487ffcb5.el8.x86_64 12/25 2023-10-05T20:46:30.825 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rgw-2:17.2.6-1278.g487ffcb5.el8.x86_64 13/25 2023-10-05T20:46:30.825 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2023-10-05T20:46:30.825 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-10-05T20:46:30.825 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-10-05T20:46:30.825 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 17/25 2023-10-05T20:46:30.825 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-10-05T20:46:30.825 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-10-05T20:46:30.825 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-10-05T20:46:30.826 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-10-05T20:46:30.826 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-2:17.2.6-1278.g487ffcb5.el8.x86_64 22/25 2023-10-05T20:46:30.826 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-10-05T20:46:30.826 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-2:17.2.6-1278.g487ffcb5.el8.x86_64 24/25 2023-10-05T20:46:31.927 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-10-05T20:46:31.927 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T20:46:31.927 INFO:teuthology.orchestra.run.smithi153.stdout:Upgraded: 2023-10-05T20:46:31.927 INFO:teuthology.orchestra.run.smithi153.stdout: librados2-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T20:46:31.927 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T20:46:31.927 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-10-05T20:46:31.927 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T20:46:31.927 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T20:46:31.927 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T20:46:31.927 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T20:46:31.928 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-05T20:46:31.928 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T20:46:31.928 INFO:teuthology.orchestra.run.smithi153.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-05T20:46:31.928 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-10-05T20:46:31.928 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T20:46:31.928 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-05T20:46:31.928 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T20:46:31.928 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-05T20:46:31.928 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-05T20:46:31.928 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T20:46:31.928 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T20:46:31.929 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T20:46:31.929 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-05T20:46:31.929 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T20:46:31.929 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T20:46:31.929 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T20:46:31.929 INFO:teuthology.orchestra.run.smithi153.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-05T20:46:31.929 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T20:46:31.929 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-10-05T20:46:32.140 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-test 2023-10-05T20:46:32.994 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:05:11 ago on Thu 05 Oct 2023 08:41:21 PM UTC. 2023-10-05T20:46:34.582 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-10-05T20:46:34.583 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T20:46:34.584 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2023-10-05T20:46:34.584 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T20:46:34.584 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-10-05T20:46:34.584 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 52 M 2023-10-05T20:46:34.584 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2023-10-05T20:46:34.584 INFO:teuthology.orchestra.run.smithi153.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-10-05T20:46:34.584 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 174 k 2023-10-05T20:46:34.584 INFO:teuthology.orchestra.run.smithi153.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-10-05T20:46:34.584 INFO:teuthology.orchestra.run.smithi153.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-10-05T20:46:34.584 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-10-05T20:46:34.585 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T20:46:34.585 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-10-05T20:46:34.585 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T20:46:34.585 INFO:teuthology.orchestra.run.smithi153.stdout:Install 6 Packages 2023-10-05T20:46:34.585 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T20:46:34.585 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 53 M 2023-10-05T20:46:34.586 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 234 M 2023-10-05T20:46:34.586 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-10-05T20:46:34.825 INFO:teuthology.orchestra.run.smithi153.stdout:(1/6): libcephsqlite-17.2.6-1278.g487ffcb5.el8. 880 kB/s | 174 kB 00:00 2023-10-05T20:46:37.066 INFO:teuthology.orchestra.run.smithi153.stdout:(2/6): ceph-test-17.2.6-1278.g487ffcb5.el8.x86_ 21 MB/s | 52 MB 00:02 2023-10-05T20:48:24.234 INFO:teuthology.orchestra.run.smithi111.stdout:[MIRROR] librdkafka-0.11.4-3.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/librdkafka-0.11.4-3.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-10-05T20:48:24.237 INFO:teuthology.orchestra.run.smithi111.stdout:[MIRROR] lttng-ust-2.8.1-11.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/lttng-ust-2.8.1-11.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-10-05T20:48:24.514 INFO:teuthology.orchestra.run.smithi111.stdout:(14/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.0 kB/s | 259 kB 04:20 2023-10-05T20:48:24.540 INFO:teuthology.orchestra.run.smithi111.stdout:(15/23): librdkafka-0.11.4-3.el8.x86_64.rpm 1.3 kB/s | 354 kB 04:22 2023-10-05T20:48:24.598 INFO:teuthology.orchestra.run.smithi111.stdout:(16/23): librabbitmq-0.9.0-4.el8.x86_64.rpm 562 kB/s | 47 kB 00:00 2023-10-05T20:48:24.915 INFO:teuthology.orchestra.run.smithi111.stdout:(17/23): liboath-2.6.2-3.el8.x86_64.rpm 186 kB/s | 59 kB 00:00 2023-10-05T20:48:25.090 INFO:teuthology.orchestra.run.smithi111.stdout:(18/23): libunwind-1.3.1-3.el8.x86_64.rpm 429 kB/s | 75 kB 00:00 2023-10-05T20:48:25.532 INFO:teuthology.orchestra.run.smithi111.stdout:(19/23): thrift-0.13.0-2.el8.x86_64.rpm 3.9 MB/s | 1.7 MB 00:00 2023-10-05T20:48:26.049 INFO:teuthology.orchestra.run.smithi111.stdout:(20/23): librados2-17.2.6-1278.g487ffcb5.el8.x8 6.7 MB/s | 3.5 MB 00:00 2023-10-05T20:48:26.249 INFO:teuthology.orchestra.run.smithi111.stdout:(21/23): librbd1-17.2.6-1278.g487ffcb5.el8.x86_ 18 MB/s | 3.6 MB 00:00 2023-10-05T20:48:28.331 INFO:teuthology.orchestra.run.smithi111.stdout:[MIRROR] python3-prettytable-0.7.2-14.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/python3-prettytable-0.7.2-14.el8.noarch.rpm [Recv failure: Connection reset by peer] 2023-10-05T20:48:28.508 INFO:teuthology.orchestra.run.smithi111.stdout:(22/23): python3-prettytable-0.7.2-14.el8.noarc 172 B/s | 44 kB 04:21 2023-10-05T20:50:58.240 INFO:teuthology.orchestra.run.smithi153.stdout:[MIRROR] jq-1.6-7.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/jq-1.6-7.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-10-05T20:50:58.651 INFO:teuthology.orchestra.run.smithi153.stdout:(3/6): jq-1.6-7.el8.x86_64.rpm 785 B/s | 202 kB 04:24 2023-10-05T20:51:35.249 INFO:teuthology.orchestra.run.smithi153.stdout:[MIRROR] oniguruma-6.8.2-2.el8.x86_64.rpm: Curl error (28): Timeout was reached for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/oniguruma-6.8.2-2.el8.x86_64.rpm [Operation too slow. Less than 1000 bytes/sec transferred the last 300 seconds] 2023-10-05T20:51:35.937 INFO:teuthology.orchestra.run.smithi153.stdout:(4/6): oniguruma-6.8.2-2.el8.x86_64.rpm 637 B/s | 187 kB 05:01 2023-10-05T20:51:37.250 INFO:teuthology.orchestra.run.smithi153.stdout:[MIRROR] socat-1.7.4.1-1.el8.x86_64.rpm: Curl error (28): Timeout was reached for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/socat-1.7.4.1-1.el8.x86_64.rpm [Operation too slow. Less than 1000 bytes/sec transferred the last 300 seconds] 2023-10-05T20:51:37.637 INFO:teuthology.orchestra.run.smithi153.stdout:(5/6): socat-1.7.4.1-1.el8.x86_64.rpm 1.1 kB/s | 323 kB 05:00 2023-10-05T20:54:45.599 INFO:teuthology.orchestra.run.smithi111.stdout:[MIRROR] gperftools-libs-2.7-9.el8.x86_64.rpm: Curl error (28): Timeout was reached for http://mirror.tornadovps.com/pub/epel/8/Everything/x86_64/Packages/g/gperftools-libs-2.7-9.el8.x86_64.rpm [Operation too slow. Less than 1000 bytes/sec transferred the last 300 seconds] 2023-10-05T20:55:36.644 INFO:teuthology.orchestra.run.smithi153.stdout:[MIRROR] xmlstarlet-1.6.1-20.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/xmlstarlet-1.6.1-20.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-10-05T20:55:37.121 INFO:teuthology.orchestra.run.smithi153.stdout:(6/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 260 B/s | 71 kB 04:38 2023-10-05T20:55:37.121 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-10-05T20:55:37.122 INFO:teuthology.orchestra.run.smithi153.stdout:Total 99 kB/s | 53 MB 09:02 2023-10-05T20:55:37.161 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-10-05T20:55:37.183 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-10-05T20:55:37.183 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-10-05T20:55:37.502 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-10-05T20:55:37.505 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-10-05T20:55:38.028 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-10-05T20:55:38.243 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-10-05T20:55:38.428 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-10-05T20:55:38.559 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-10-05T20:55:38.622 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-10-05T20:55:38.807 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : jq-1.6-7.el8.x86_64 4/6 2023-10-05T20:55:38.934 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephsqlite-2:17.2.6-1278.g487ffcb5.el8.x86_64 5/6 2023-10-05T20:55:43.930 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1278.g487ffcb5.el8.x86_64 5/6 2023-10-05T20:55:44.140 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-test-2:17.2.6-1278.g487ffcb5.el8.x86_64 6/6 2023-10-05T20:55:44.418 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-test-2:17.2.6-1278.g487ffcb5.el8.x86_64 6/6 2023-10-05T20:55:44.418 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-test-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/6 2023-10-05T20:55:44.418 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephsqlite-2:17.2.6-1278.g487ffcb5.el8.x86_64 2/6 2023-10-05T20:55:44.418 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : jq-1.6-7.el8.x86_64 3/6 2023-10-05T20:55:44.418 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-10-05T20:55:44.419 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-10-05T20:55:45.084 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-10-05T20:55:45.084 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T20:55:45.084 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-10-05T20:55:45.084 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T20:55:45.085 INFO:teuthology.orchestra.run.smithi153.stdout: jq-1.6-7.el8.x86_64 2023-10-05T20:55:45.085 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T20:55:45.085 INFO:teuthology.orchestra.run.smithi153.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-05T20:55:45.085 INFO:teuthology.orchestra.run.smithi153.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-05T20:55:45.085 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-05T20:55:45.085 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T20:55:45.085 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-10-05T20:55:45.308 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph 2023-10-05T20:55:46.172 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:14:25 ago on Thu 05 Oct 2023 08:41:21 PM UTC. 2023-10-05T20:55:47.764 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-10-05T20:55:47.768 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T20:55:47.768 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2023-10-05T20:55:47.768 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T20:55:47.768 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-10-05T20:55:47.768 INFO:teuthology.orchestra.run.smithi153.stdout: ceph x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 6.4 k 2023-10-05T20:55:47.768 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2023-10-05T20:55:47.768 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 2.3 M 2023-10-05T20:55:47.768 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 1.6 M 2023-10-05T20:55:47.768 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1278.g487ffcb5.el8 ceph-noarch 238 k 2023-10-05T20:55:47.768 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 3.9 M 2023-10-05T20:55:47.768 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 17 M 2023-10-05T20:55:47.769 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-05T20:55:47.769 INFO:teuthology.orchestra.run.smithi153.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-05T20:55:47.769 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-10-05T20:55:47.769 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-05T20:55:47.769 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-05T20:55:47.769 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-10-05T20:55:47.769 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-05T20:55:47.769 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-05T20:55:47.769 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-05T20:55:47.769 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-10-05T20:55:47.769 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-10-05T20:55:47.770 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-05T20:55:47.770 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-05T20:55:47.770 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-05T20:55:47.770 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-10-05T20:55:47.770 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-10-05T20:55:47.770 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-10-05T20:55:47.770 INFO:teuthology.orchestra.run.smithi153.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-05T20:55:47.770 INFO:teuthology.orchestra.run.smithi153.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-05T20:55:47.770 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-05T20:55:47.770 INFO:teuthology.orchestra.run.smithi153.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-05T20:55:47.770 INFO:teuthology.orchestra.run.smithi153.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-05T20:55:47.770 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-05T20:55:47.770 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-05T20:55:47.771 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-10-05T20:55:47.771 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-05T20:55:47.771 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T20:55:47.771 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-10-05T20:55:47.771 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T20:55:47.771 INFO:teuthology.orchestra.run.smithi153.stdout:Install 32 Packages 2023-10-05T20:55:47.771 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T20:55:47.772 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 28 M 2023-10-05T20:55:47.772 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 110 M 2023-10-05T20:55:47.772 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-10-05T20:55:48.401 INFO:teuthology.orchestra.run.smithi153.stdout:(1/32): ceph-17.2.6-1278.g487ffcb5.el8.x86_64.r 35 kB/s | 6.4 kB 00:00 2023-10-05T20:55:48.585 INFO:teuthology.orchestra.run.smithi153.stdout:(2/32): ceph-mgr-17.2.6-1278.g487ffcb5.el8.x86_ 4.3 MB/s | 1.6 MB 00:00 2023-10-05T20:55:48.669 INFO:teuthology.orchestra.run.smithi153.stdout:(3/32): ceph-mds-17.2.6-1278.g487ffcb5.el8.x86_ 5.1 MB/s | 2.3 MB 00:00 2023-10-05T20:55:48.719 INFO:teuthology.orchestra.run.smithi153.stdout:(4/32): ceph-mgr-modules-core-17.2.6-1278.g487f 4.7 MB/s | 238 kB 00:00 2023-10-05T20:55:49.127 INFO:teuthology.orchestra.run.smithi153.stdout:(5/32): ceph-mon-17.2.6-1278.g487ffcb5.el8.x86_ 5.4 MB/s | 3.9 MB 00:00 2023-10-05T20:55:49.586 INFO:teuthology.orchestra.run.smithi153.stdout:(6/32): ceph-osd-17.2.6-1278.g487ffcb5.el8.x86_ 17 MB/s | 17 MB 00:01 2023-10-05T21:00:11.076 INFO:teuthology.orchestra.run.smithi153.stdout:[MIRROR] python3-mako-1.0.6-14.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/python3-mako-1.0.6-14.el8.noarch.rpm [Recv failure: Connection reset by peer] 2023-10-05T21:00:11.272 INFO:teuthology.orchestra.run.smithi153.stdout:(7/32): python3-mako-1.0.6-14.el8.noarch.rpm 612 B/s | 157 kB 04:22 2023-10-05T21:00:49.500 INFO:teuthology.orchestra.run.smithi153.stdout:[MIRROR] python3-markupsafe-0.23-19.el8.x86_64.rpm: Curl error (28): Timeout was reached for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/python3-markupsafe-0.23-19.el8.x86_64.rpm [Operation too slow. Less than 1000 bytes/sec transferred the last 300 seconds] 2023-10-05T21:00:49.702 INFO:teuthology.orchestra.run.smithi153.stdout:[MIRROR] python3-pyOpenSSL-19.0.0-1.el8.noarch.rpm: Curl error (28): Timeout was reached for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/python3-pyOpenSSL-19.0.0-1.el8.noarch.rpm [Operation too slow. Less than 1000 bytes/sec transferred the last 300 seconds] 2023-10-05T21:00:49.866 INFO:teuthology.orchestra.run.smithi153.stdout:(8/32): python3-markupsafe-0.23-19.el8.x86_64.r 132 B/s | 39 kB 05:00 2023-10-05T21:00:50.191 INFO:teuthology.orchestra.run.smithi153.stdout:(9/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 352 B/s | 103 kB 05:00 2023-10-05T21:00:50.275 INFO:teuthology.orchestra.run.smithi153.stdout:(10/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.9 MB/s | 249 kB 00:00 2023-10-05T21:00:50.334 INFO:teuthology.orchestra.run.smithi153.stdout:(11/32): python3-cryptography-3.2.1-6.el8.x86_6 11 MB/s | 641 kB 00:00 2023-10-05T21:00:50.359 INFO:teuthology.orchestra.run.smithi153.stdout:(12/32): python3-werkzeug-0.12.2-4.el8.noarch.r 929 kB/s | 457 kB 00:00 2023-10-05T21:00:50.384 INFO:teuthology.orchestra.run.smithi153.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 2.1 MB/s | 109 kB 00:00 2023-10-05T21:00:50.776 INFO:teuthology.orchestra.run.smithi153.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 105 kB/s | 44 kB 00:00 2023-10-05T21:00:50.885 INFO:teuthology.orchestra.run.smithi153.stdout:(15/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 370 kB/s | 185 kB 00:00 2023-10-05T21:00:51.068 INFO:teuthology.orchestra.run.smithi153.stdout:(16/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 592 kB/s | 173 kB 00:00 2023-10-05T21:00:51.094 INFO:teuthology.orchestra.run.smithi153.stdout:(17/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.8 MB/s | 384 kB 00:00 2023-10-05T21:00:51.186 INFO:teuthology.orchestra.run.smithi153.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 95 kB/s | 11 kB 00:00 2023-10-05T21:00:51.211 INFO:teuthology.orchestra.run.smithi153.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 150 kB/s | 18 kB 00:00 2023-10-05T21:00:51.294 INFO:teuthology.orchestra.run.smithi153.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 450 kB/s | 49 kB 00:00 2023-10-05T21:00:51.320 INFO:teuthology.orchestra.run.smithi153.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 541 kB/s | 59 kB 00:00 2023-10-05T21:00:51.420 INFO:teuthology.orchestra.run.smithi153.stdout:(22/32): python3-portend-2.6-1.el8.noarch.rpm 156 kB/s | 16 kB 00:00 2023-10-05T21:00:51.479 INFO:teuthology.orchestra.run.smithi153.stdout:(23/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.5 MB/s | 283 kB 00:00 2023-10-05T21:00:51.521 INFO:teuthology.orchestra.run.smithi153.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 187 kB/s | 19 kB 00:00 2023-10-05T21:00:51.579 INFO:teuthology.orchestra.run.smithi153.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 239 kB/s | 24 kB 00:00 2023-10-05T21:00:51.621 INFO:teuthology.orchestra.run.smithi153.stdout:(26/32): python3-tempora-1.14.1-5.el8.noarch.rp 292 kB/s | 29 kB 00:00 2023-10-05T21:00:51.688 INFO:teuthology.orchestra.run.smithi153.stdout:(27/32): python3-trustme-0.6.0-4.el8.noarch.rpm 253 kB/s | 27 kB 00:00 2023-10-05T21:00:51.729 INFO:teuthology.orchestra.run.smithi153.stdout:(28/32): python3-waitress-1.4.3-1.el8.noarch.rp 2.3 MB/s | 255 kB 00:00 2023-10-05T21:00:51.797 INFO:teuthology.orchestra.run.smithi153.stdout:(29/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.3 MB/s | 251 kB 00:00 2023-10-05T21:00:51.839 INFO:teuthology.orchestra.run.smithi153.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 786 kB/s | 85 kB 00:00 2023-10-05T21:00:51.897 INFO:teuthology.orchestra.run.smithi153.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 229 kB/s | 23 kB 00:00 2023-10-05T21:01:50.676 INFO:teuthology.orchestra.run.smithi111.stdout:[MIRROR] gperftools-libs-2.7-9.el8.x86_64.rpm: Curl error (28): Timeout was reached for http://mirrors.sonic.net/epel/8/Everything/x86_64/Packages/g/gperftools-libs-2.7-9.el8.x86_64.rpm [Operation too slow. Less than 1000 bytes/sec transferred the last 300 seconds] 2023-10-05T21:01:52.836 INFO:teuthology.orchestra.run.smithi111.stdout:(23/23): gperftools-libs-2.7-9.el8.x86_64.rpm 388 B/s | 306 kB 13:28 2023-10-05T21:01:52.836 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-10-05T21:01:52.836 INFO:teuthology.orchestra.run.smithi111.stdout:Total 60 kB/s | 63 MB 17:53 2023-10-05T21:01:52.876 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-10-05T21:01:52.921 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-10-05T21:01:52.921 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-10-05T21:01:53.301 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-10-05T21:01:53.304 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-10-05T21:01:54.364 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-10-05T21:01:54.565 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2023-10-05T21:01:54.748 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-10-05T21:01:55.125 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-10-05T21:01:55.332 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : librados2-2:17.2.6-1278.g487ffcb5.el8.x86_64 3/25 2023-10-05T21:01:55.410 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librados2-2:17.2.6-1278.g487ffcb5.el8.x86_64 3/25 2023-10-05T21:01:55.697 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-rados-2:17.2.6-1278.g487ffcb5.el8.x86_64 4/25 2023-10-05T21:01:55.881 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libcephfs2-2:17.2.6-1278.g487ffcb5.el8.x86_64 5/25 2023-10-05T21:01:56.286 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libcephfs2-2:17.2.6-1278.g487ffcb5.el8.x86_64 5/25 2023-10-05T21:01:56.464 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : librbd1-2:17.2.6-1278.g487ffcb5.el8.x86_64 6/25 2023-10-05T21:01:56.694 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librbd1-2:17.2.6-1278.g487ffcb5.el8.x86_64 6/25 2023-10-05T21:01:56.886 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : thrift-0.13.0-2.el8.x86_64 7/25 2023-10-05T21:01:57.079 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 8/25 2023-10-05T21:01:57.264 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2023-10-05T21:01:57.815 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2023-10-05T21:01:58.004 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : librgw2-2:17.2.6-1278.g487ffcb5.el8.x86_64 10/25 2023-10-05T21:01:58.070 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librgw2-2:17.2.6-1278.g487ffcb5.el8.x86_64 10/25 2023-10-05T21:01:58.239 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-ceph-argparse-2:17.2.6-1278.g487ffcb5.el8. 11/25 2023-10-05T21:01:58.418 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cephfs-2:17.2.6-1278.g487ffcb5.el8.x86_64 12/25 2023-10-05T21:01:58.657 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-rgw-2:17.2.6-1278.g487ffcb5.el8.x86_64 13/25 2023-10-05T21:01:58.868 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-rbd-2:17.2.6-1278.g487ffcb5.el8.x86_64 14/25 2023-10-05T21:01:59.031 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libradosstriper1-2:17.2.6-1278.g487ffcb5.el8.x86_6 15/25 2023-10-05T21:01:59.100 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1278.g487ffcb5.el8.x86_6 15/25 2023-10-05T21:01:59.315 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2023-10-05T21:01:59.514 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2023-10-05T21:01:59.715 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-10-05T21:01:59.890 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-ceph-common-2:17.2.6-1278.g487ffcb5.el8.x8 19/25 2023-10-05T21:02:02.533 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-common-2:17.2.6-1278.g487ffcb5.el8.x86_64 20/25 2023-10-05T21:02:02.739 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-common-2:17.2.6-1278.g487ffcb5.el8.x86_64 20/25 2023-10-05T21:02:03.327 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-common-2:17.2.6-1278.g487ffcb5.el8.x86_64 20/25 2023-10-05T21:02:03.587 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-base-2:17.2.6-1278.g487ffcb5.el8.x86_64 21/25 2023-10-05T21:02:03.688 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-base-2:17.2.6-1278.g487ffcb5.el8.x86_64 21/25 2023-10-05T21:02:03.847 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-selinux-2:17.2.6-1278.g487ffcb5.el8.x86_64 22/25 2023-10-05T21:02:22.020 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1278.g487ffcb5.el8.x86_64 22/25 2023-10-05T21:02:22.020 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /sys 2023-10-05T21:02:22.020 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /proc 2023-10-05T21:02:22.020 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /dev 2023-10-05T21:02:22.020 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /run 2023-10-05T21:02:22.020 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /mnt 2023-10-05T21:02:22.021 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /var/tmp 2023-10-05T21:02:22.021 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /home 2023-10-05T21:02:22.021 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /tmp 2023-10-05T21:02:22.021 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /dev 2023-10-05T21:02:22.021 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:02:23.717 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-radosgw-2:17.2.6-1278.g487ffcb5.el8.x86_64 23/25 2023-10-05T21:02:23.797 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1278.g487ffcb5.el8.x86_64 23/25 2023-10-05T21:02:23.797 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-10-05T21:02:24.029 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-10-05T21:02:24.029 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-10-05T21:02:24.725 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-10-05T21:02:24.726 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-base-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/25 2023-10-05T21:02:24.726 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-common-2:17.2.6-1278.g487ffcb5.el8.x86_64 2/25 2023-10-05T21:02:24.726 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-radosgw-2:17.2.6-1278.g487ffcb5.el8.x86_64 3/25 2023-10-05T21:02:24.726 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-selinux-2:17.2.6-1278.g487ffcb5.el8.x86_64 4/25 2023-10-05T21:02:24.726 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libcephfs2-2:17.2.6-1278.g487ffcb5.el8.x86_64 5/25 2023-10-05T21:02:24.726 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libradosstriper1-2:17.2.6-1278.g487ffcb5.el8.x86_6 6/25 2023-10-05T21:02:24.726 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librgw2-2:17.2.6-1278.g487ffcb5.el8.x86_64 7/25 2023-10-05T21:02:24.726 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1278.g487ffcb5.el8. 8/25 2023-10-05T21:02:24.726 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-ceph-common-2:17.2.6-1278.g487ffcb5.el8.x8 9/25 2023-10-05T21:02:24.726 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cephfs-2:17.2.6-1278.g487ffcb5.el8.x86_64 10/25 2023-10-05T21:02:24.727 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rados-2:17.2.6-1278.g487ffcb5.el8.x86_64 11/25 2023-10-05T21:02:24.727 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rbd-2:17.2.6-1278.g487ffcb5.el8.x86_64 12/25 2023-10-05T21:02:24.727 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rgw-2:17.2.6-1278.g487ffcb5.el8.x86_64 13/25 2023-10-05T21:02:24.727 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2023-10-05T21:02:24.727 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-10-05T21:02:24.727 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-10-05T21:02:24.727 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 17/25 2023-10-05T21:02:24.727 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-10-05T21:02:24.727 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-10-05T21:02:24.727 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-10-05T21:02:24.727 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-10-05T21:02:24.728 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librados2-2:17.2.6-1278.g487ffcb5.el8.x86_64 22/25 2023-10-05T21:02:24.728 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-10-05T21:02:24.728 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librbd1-2:17.2.6-1278.g487ffcb5.el8.x86_64 24/25 2023-10-05T21:02:25.790 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-10-05T21:02:25.791 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:02:25.791 INFO:teuthology.orchestra.run.smithi111.stdout:Upgraded: 2023-10-05T21:02:25.791 INFO:teuthology.orchestra.run.smithi111.stdout: librados2-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:02:25.791 INFO:teuthology.orchestra.run.smithi111.stdout: librbd1-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:02:25.791 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-10-05T21:02:25.791 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-base-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:02:25.791 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-common-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:02:25.791 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-radosgw-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:02:25.791 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-selinux-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:02:25.792 INFO:teuthology.orchestra.run.smithi111.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-05T21:02:25.792 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs2-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:02:25.792 INFO:teuthology.orchestra.run.smithi111.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-05T21:02:25.792 INFO:teuthology.orchestra.run.smithi111.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-10-05T21:02:25.792 INFO:teuthology.orchestra.run.smithi111.stdout: libradosstriper1-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:02:25.792 INFO:teuthology.orchestra.run.smithi111.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-05T21:02:25.792 INFO:teuthology.orchestra.run.smithi111.stdout: librgw2-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:02:25.792 INFO:teuthology.orchestra.run.smithi111.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-05T21:02:25.792 INFO:teuthology.orchestra.run.smithi111.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-05T21:02:25.792 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-argparse-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:02:25.792 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-common-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:02:25.792 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cephfs-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:02:25.793 INFO:teuthology.orchestra.run.smithi111.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-05T21:02:25.793 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rados-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:02:25.793 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rbd-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:02:25.793 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rgw-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:02:25.793 INFO:teuthology.orchestra.run.smithi111.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-05T21:02:25.793 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:02:25.793 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-10-05T21:02:26.041 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-test 2023-10-05T21:02:26.889 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:18:31 ago on Thu 05 Oct 2023 08:43:55 PM UTC. 2023-10-05T21:02:28.486 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-10-05T21:02:28.487 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:02:28.487 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2023-10-05T21:02:28.487 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:02:28.487 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-10-05T21:02:28.488 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-test x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 52 M 2023-10-05T21:02:28.488 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2023-10-05T21:02:28.488 INFO:teuthology.orchestra.run.smithi111.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-10-05T21:02:28.488 INFO:teuthology.orchestra.run.smithi111.stdout: libcephsqlite x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 174 k 2023-10-05T21:02:28.488 INFO:teuthology.orchestra.run.smithi111.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-10-05T21:02:28.488 INFO:teuthology.orchestra.run.smithi111.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-10-05T21:02:28.488 INFO:teuthology.orchestra.run.smithi111.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-10-05T21:02:28.488 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:02:28.488 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-10-05T21:02:28.488 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:02:28.488 INFO:teuthology.orchestra.run.smithi111.stdout:Install 6 Packages 2023-10-05T21:02:28.488 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:02:28.489 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 53 M 2023-10-05T21:02:28.489 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 234 M 2023-10-05T21:02:28.489 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-10-05T21:02:28.754 INFO:teuthology.orchestra.run.smithi111.stdout:(1/6): libcephsqlite-17.2.6-1278.g487ffcb5.el8. 910 kB/s | 174 kB 00:00 2023-10-05T21:02:31.280 INFO:teuthology.orchestra.run.smithi111.stdout:(2/6): ceph-test-17.2.6-1278.g487ffcb5.el8.x86_ 19 MB/s | 52 MB 00:02 2023-10-05T21:04:20.933 INFO:teuthology.orchestra.run.smithi153.stdout:[MIRROR] python3-pytz-2017.2-11.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/python3-pytz-2017.2-11.el8.noarch.rpm [Recv failure: Connection reset by peer] 2023-10-05T21:04:21.332 INFO:teuthology.orchestra.run.smithi153.stdout:(32/32): python3-pytz-2017.2-11.el8.noarch.rpm 233 B/s | 57 kB 04:10 2023-10-05T21:04:21.332 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-10-05T21:04:21.333 INFO:teuthology.orchestra.run.smithi153.stdout:Total 57 kB/s | 28 MB 08:33 2023-10-05T21:04:21.411 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-10-05T21:04:21.448 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-10-05T21:04:21.449 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-10-05T21:04:21.785 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-10-05T21:04:21.788 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-10-05T21:04:22.868 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-10-05T21:04:23.077 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-10-05T21:04:23.296 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-10-05T21:04:23.513 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-10-05T21:04:23.737 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2023-10-05T21:04:23.935 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-10-05T21:04:24.164 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-10-05T21:04:24.333 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-10-05T21:04:24.544 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-10-05T21:04:24.804 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-10-05T21:04:24.991 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-10-05T21:04:25.204 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-10-05T21:04:25.412 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-10-05T21:04:25.830 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2023-10-05T21:04:26.083 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/32 2023-10-05T21:04:26.268 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-10-05T21:04:26.504 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-10-05T21:04:26.706 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-10-05T21:04:26.997 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-10-05T21:04:27.344 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-10-05T21:04:27.524 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2023-10-05T21:04:27.710 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-10-05T21:04:27.972 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-10-05T21:04:28.228 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-10-05T21:04:28.440 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-10-05T21:04:28.842 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2023-10-05T21:04:29.127 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-10-05T21:04:29.472 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1278.g487ffcb5.el8. 27/32 2023-10-05T21:04:29.675 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-2:17.2.6-1278.g487ffcb5.el8.x86_64 28/32 2023-10-05T21:04:31.163 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1278.g487ffcb5.el8.x86_64 28/32 2023-10-05T21:04:31.341 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-osd-2:17.2.6-1278.g487ffcb5.el8.x86_64 29/32 2023-10-05T21:04:31.744 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-osd-2:17.2.6-1278.g487ffcb5.el8.x86_64 29/32 2023-10-05T21:04:31.921 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mon-2:17.2.6-1278.g487ffcb5.el8.x86_64 30/32 2023-10-05T21:04:32.138 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mon-2:17.2.6-1278.g487ffcb5.el8.x86_64 30/32 2023-10-05T21:04:32.304 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mds-2:17.2.6-1278.g487ffcb5.el8.x86_64 31/32 2023-10-05T21:04:32.322 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mds-2:17.2.6-1278.g487ffcb5.el8.x86_64 31/32 2023-10-05T21:04:32.454 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-2:17.2.6-1278.g487ffcb5.el8.x86_64 32/32 2023-10-05T21:04:32.856 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-2:17.2.6-1278.g487ffcb5.el8.x86_64 32/32 2023-10-05T21:04:32.856 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/32 2023-10-05T21:04:32.856 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mds-2:17.2.6-1278.g487ffcb5.el8.x86_64 2/32 2023-10-05T21:04:32.857 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-2:17.2.6-1278.g487ffcb5.el8.x86_64 3/32 2023-10-05T21:04:32.857 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mon-2:17.2.6-1278.g487ffcb5.el8.x86_64 4/32 2023-10-05T21:04:32.857 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-osd-2:17.2.6-1278.g487ffcb5.el8.x86_64 5/32 2023-10-05T21:04:32.857 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1278.g487ffcb5.el8. 6/32 2023-10-05T21:04:32.857 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2023-10-05T21:04:32.857 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-10-05T21:04:32.857 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-10-05T21:04:32.857 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2023-10-05T21:04:32.857 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-10-05T21:04:32.857 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2023-10-05T21:04:32.857 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 13/32 2023-10-05T21:04:32.858 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-10-05T21:04:32.858 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-10-05T21:04:32.858 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-10-05T21:04:32.858 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-10-05T21:04:32.858 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-10-05T21:04:32.858 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-10-05T21:04:32.858 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-10-05T21:04:32.858 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-10-05T21:04:32.858 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-10-05T21:04:32.858 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-10-05T21:04:32.859 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-10-05T21:04:32.859 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-10-05T21:04:32.859 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-10-05T21:04:32.859 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-10-05T21:04:32.859 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-10-05T21:04:32.859 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2023-10-05T21:04:32.859 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-10-05T21:04:32.859 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-10-05T21:04:34.025 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-10-05T21:04:34.025 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:04:34.025 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-10-05T21:04:34.026 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:04:34.026 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:04:34.026 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:04:34.026 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core-2:17.2.6-1278.g487ffcb5.el8.noarch 2023-10-05T21:04:34.026 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:04:34.026 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:04:34.026 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-05T21:04:34.026 INFO:teuthology.orchestra.run.smithi153.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-05T21:04:34.026 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-10-05T21:04:34.026 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-05T21:04:34.026 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-05T21:04:34.026 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-10-05T21:04:34.027 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-05T21:04:34.027 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-05T21:04:34.027 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-05T21:04:34.027 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako-1.0.6-14.el8.noarch 2023-10-05T21:04:34.027 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-05T21:04:34.027 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-05T21:04:34.027 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-05T21:04:34.027 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend-2.6-1.el8.noarch 2023-10-05T21:04:34.027 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-05T21:04:34.027 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-05T21:04:34.027 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz-2017.2-11.el8.noarch 2023-10-05T21:04:34.027 INFO:teuthology.orchestra.run.smithi153.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-05T21:04:34.028 INFO:teuthology.orchestra.run.smithi153.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-05T21:04:34.028 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-05T21:04:34.028 INFO:teuthology.orchestra.run.smithi153.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-05T21:04:34.028 INFO:teuthology.orchestra.run.smithi153.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-05T21:04:34.028 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-05T21:04:34.028 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-05T21:04:34.028 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-05T21:04:34.028 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-05T21:04:34.028 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:04:34.028 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-10-05T21:04:34.172 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-base 2023-10-05T21:04:35.034 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:23:14 ago on Thu 05 Oct 2023 08:41:21 PM UTC. 2023-10-05T21:04:36.443 INFO:teuthology.orchestra.run.smithi153.stdout:Package ceph-base-2:17.2.6-1278.g487ffcb5.el8.x86_64 is already installed. 2023-10-05T21:04:36.634 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-10-05T21:04:36.635 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2023-10-05T21:04:36.635 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-10-05T21:04:36.742 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install cephadm 2023-10-05T21:04:37.600 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:23:16 ago on Thu 05 Oct 2023 08:41:21 PM UTC. 2023-10-05T21:04:39.178 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-10-05T21:04:39.180 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:04:39.180 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2023-10-05T21:04:39.180 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:04:39.180 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-10-05T21:04:39.180 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm noarch 2:17.2.6-1278.g487ffcb5.el8 ceph-noarch 80 k 2023-10-05T21:04:39.180 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:04:39.180 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-10-05T21:04:39.180 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:04:39.180 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-10-05T21:04:39.181 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:04:39.181 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 80 k 2023-10-05T21:04:39.181 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 364 k 2023-10-05T21:04:39.181 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-10-05T21:04:39.366 INFO:teuthology.orchestra.run.smithi153.stdout:cephadm-17.2.6-1278.g487ffcb5.el8.noarch.rpm 433 kB/s | 80 kB 00:00 2023-10-05T21:04:39.367 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-10-05T21:04:39.367 INFO:teuthology.orchestra.run.smithi153.stdout:Total 430 kB/s | 80 kB 00:00 2023-10-05T21:04:39.367 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-10-05T21:04:39.375 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-10-05T21:04:39.375 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-10-05T21:04:39.377 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-10-05T21:04:39.380 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-10-05T21:04:39.428 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-10-05T21:04:39.867 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephadm-2:17.2.6-1278.g487ffcb5.el8.noarch 1/1 2023-10-05T21:04:40.036 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephadm-2:17.2.6-1278.g487ffcb5.el8.noarch 1/1 2023-10-05T21:04:40.258 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephadm-2:17.2.6-1278.g487ffcb5.el8.noarch 1/1 2023-10-05T21:04:40.853 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephadm-2:17.2.6-1278.g487ffcb5.el8.noarch 1/1 2023-10-05T21:04:40.853 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:04:40.853 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-10-05T21:04:40.853 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm-2:17.2.6-1278.g487ffcb5.el8.noarch 2023-10-05T21:04:40.854 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:04:40.854 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-10-05T21:04:41.076 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-immutable-object-cache 2023-10-05T21:04:41.937 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:23:20 ago on Thu 05 Oct 2023 08:41:21 PM UTC. 2023-10-05T21:04:43.515 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-10-05T21:04:43.516 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:04:43.516 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2023-10-05T21:04:43.516 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:04:43.516 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-10-05T21:04:43.516 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 162 k 2023-10-05T21:04:43.516 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:04:43.516 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-10-05T21:04:43.517 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:04:43.517 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-10-05T21:04:43.517 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:04:43.517 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 162 k 2023-10-05T21:04:43.517 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 490 k 2023-10-05T21:04:43.518 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-10-05T21:04:43.700 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-immutable-object-cache-17.2.6-1278.g487ffc 883 kB/s | 162 kB 00:00 2023-10-05T21:04:43.701 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-10-05T21:04:43.701 INFO:teuthology.orchestra.run.smithi153.stdout:Total 877 kB/s | 162 kB 00:00 2023-10-05T21:04:43.701 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-10-05T21:04:43.712 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-10-05T21:04:43.712 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-10-05T21:04:43.759 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-10-05T21:04:43.763 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-10-05T21:04:43.868 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-10-05T21:04:44.077 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1278.g487ffcb5. 1/1 2023-10-05T21:04:44.500 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1278.g487ffcb5. 1/1 2023-10-05T21:04:45.095 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1278.g487ffcb5. 1/1 2023-10-05T21:04:45.096 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:04:45.096 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-10-05T21:04:45.096 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:04:45.096 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:04:45.096 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-10-05T21:04:45.298 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-mgr 2023-10-05T21:04:46.164 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:23:25 ago on Thu 05 Oct 2023 08:41:21 PM UTC. 2023-10-05T21:04:47.558 INFO:teuthology.orchestra.run.smithi153.stdout:Package ceph-mgr-2:17.2.6-1278.g487ffcb5.el8.x86_64 is already installed. 2023-10-05T21:04:47.748 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-10-05T21:04:47.749 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2023-10-05T21:04:47.749 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-10-05T21:04:47.850 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-mgr-dashboard 2023-10-05T21:04:48.706 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:23:27 ago on Thu 05 Oct 2023 08:41:21 PM UTC. 2023-10-05T21:04:50.271 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-10-05T21:04:50.273 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:04:50.273 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2023-10-05T21:04:50.273 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:04:50.273 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-10-05T21:04:50.273 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1278.g487ffcb5.el8 ceph-noarch 1.7 M 2023-10-05T21:04:50.274 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2023-10-05T21:04:50.274 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1278.g487ffcb5.el8 ceph-noarch 23 k 2023-10-05T21:04:50.274 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1278.g487ffcb5.el8 ceph-noarch 14 k 2023-10-05T21:04:50.274 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-10-05T21:04:50.274 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-05T21:04:50.274 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-05T21:04:50.274 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:04:50.274 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-10-05T21:04:50.274 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:04:50.274 INFO:teuthology.orchestra.run.smithi153.stdout:Install 6 Packages 2023-10-05T21:04:50.274 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:04:50.275 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 2.0 M 2023-10-05T21:04:50.275 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 8.0 M 2023-10-05T21:04:50.275 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-10-05T21:04:50.553 INFO:teuthology.orchestra.run.smithi153.stdout:(1/6): ceph-prometheus-alerts-17.2.6-1278.g487f 92 kB/s | 14 kB 00:00 2023-10-05T21:04:50.612 INFO:teuthology.orchestra.run.smithi153.stdout:(2/6): python3-jwt-1.6.1-2.el8.noarch.rpm 734 kB/s | 43 kB 00:00 2023-10-05T21:04:50.645 INFO:teuthology.orchestra.run.smithi153.stdout:(3/6): ceph-grafana-dashboards-17.2.6-1278.g487 92 kB/s | 23 kB 00:00 2023-10-05T21:04:50.879 INFO:teuthology.orchestra.run.smithi153.stdout:(4/6): ceph-mgr-dashboard-17.2.6-1278.g487ffcb5 3.5 MB/s | 1.7 MB 00:00 2023-10-05T21:04:59.705 INFO:teuthology.orchestra.run.smithi153.stdout:(5/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 3.7 kB/s | 34 kB 00:09 2023-10-05T21:06:05.080 INFO:teuthology.orchestra.run.smithi153.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 2.6 kB/s | 196 kB 01:14 2023-10-05T21:06:05.084 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-10-05T21:06:05.084 INFO:teuthology.orchestra.run.smithi153.stdout:Total 27 kB/s | 2.0 MB 01:14 2023-10-05T21:06:05.096 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-10-05T21:06:05.106 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-10-05T21:06:05.107 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-10-05T21:06:05.194 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-10-05T21:06:05.198 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-10-05T21:06:05.449 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-10-05T21:06:05.644 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-10-05T21:06:05.848 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-10-05T21:06:06.041 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-10-05T21:06:06.161 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1278.g487ffcb5.el8.n 4/6 2023-10-05T21:06:06.491 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1278.g487ffcb5.el8. 5/6 2023-10-05T21:06:06.717 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1278.g487ffcb5.el8.noarc 6/6 2023-10-05T21:06:07.005 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1278.g487ffcb5.el8.noarc 6/6 2023-10-05T21:06:07.005 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1278.g487ffcb5.el8. 1/6 2023-10-05T21:06:07.005 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1278.g487ffcb5.el8.noarc 2/6 2023-10-05T21:06:07.005 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1278.g487ffcb5.el8.n 3/6 2023-10-05T21:06:07.005 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-10-05T21:06:07.006 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-10-05T21:06:07.656 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-10-05T21:06:07.656 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:06:07.656 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-10-05T21:06:07.656 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards-2:17.2.6-1278.g487ffcb5.el8.noarch 2023-10-05T21:06:07.656 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard-2:17.2.6-1278.g487ffcb5.el8.noarch 2023-10-05T21:06:07.656 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts-2:17.2.6-1278.g487ffcb5.el8.noarch 2023-10-05T21:06:07.656 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-05T21:06:07.656 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-05T21:06:07.656 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-05T21:06:07.656 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:06:07.657 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-10-05T21:06:07.779 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-mgr-diskprediction-local 2023-10-05T21:06:08.632 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:24:47 ago on Thu 05 Oct 2023 08:41:21 PM UTC. 2023-10-05T21:06:10.210 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-10-05T21:06:10.212 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================================ 2023-10-05T21:06:10.212 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2023-10-05T21:06:10.212 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================================ 2023-10-05T21:06:10.212 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-10-05T21:06:10.212 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1278.g487ffcb5.el8 ceph-noarch 7.4 M 2023-10-05T21:06:10.212 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2023-10-05T21:06:10.212 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-10-05T21:06:10.212 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-10-05T21:06:10.212 INFO:teuthology.orchestra.run.smithi153.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-10-05T21:06:10.213 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-10-05T21:06:10.213 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-10-05T21:06:10.213 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-10-05T21:06:10.213 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-10-05T21:06:10.213 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:06:10.213 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-10-05T21:06:10.213 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================================ 2023-10-05T21:06:10.213 INFO:teuthology.orchestra.run.smithi153.stdout:Install 8 Packages 2023-10-05T21:06:10.213 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:06:10.214 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 35 M 2023-10-05T21:06:10.214 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 210 M 2023-10-05T21:06:10.214 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-10-05T21:06:14.562 INFO:teuthology.orchestra.run.smithi153.stdout:(1/8): ceph-mgr-diskprediction-local-17.2.6-127 2.8 MB/s | 7.4 MB 00:02 2023-10-05T21:06:16.251 INFO:teuthology.orchestra.run.smithi153.stdout:(2/8): openblas-0.3.15-4.el8.x86_64.rpm 1.1 MB/s | 4.7 MB 00:04 2023-10-05T21:06:16.493 INFO:teuthology.orchestra.run.smithi153.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 932 kB/s | 225 kB 00:00 2023-10-05T21:06:18.560 INFO:teuthology.orchestra.run.smithi153.stdout:(4/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 956 kB/s | 3.7 MB 00:03 2023-10-05T21:06:18.660 INFO:teuthology.orchestra.run.smithi153.stdout:(5/8): libgfortran-8.5.0-20.el8.x86_64.rpm 6.3 MB/s | 645 kB 00:00 2023-10-05T21:06:18.727 INFO:teuthology.orchestra.run.smithi153.stdout:(6/8): libquadmath-8.5.0-20.el8.x86_64.rpm 2.5 MB/s | 172 kB 00:00 2023-10-05T21:06:18.802 INFO:teuthology.orchestra.run.smithi153.stdout:(7/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 725 kB/s | 4.9 MB 00:06 2023-10-05T21:06:21.244 INFO:teuthology.orchestra.run.smithi153.stdout:(8/8): python3-scipy-1.0.0-21.module_el8.5.0+77 2.9 MB/s | 14 MB 00:04 2023-10-05T21:06:21.245 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-10-05T21:06:21.245 INFO:teuthology.orchestra.run.smithi153.stdout:Total 3.2 MB/s | 35 MB 00:11 2023-10-05T21:06:21.480 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-10-05T21:06:21.498 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-10-05T21:06:21.498 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-10-05T21:06:21.900 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-10-05T21:06:21.903 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-10-05T21:06:22.454 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-10-05T21:06:22.577 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 1/8 2023-10-05T21:06:22.685 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 1/8 2023-10-05T21:06:22.836 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 2/8 2023-10-05T21:06:23.436 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 2/8 2023-10-05T21:06:23.636 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-10-05T21:06:24.235 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-10-05T21:06:24.377 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-10-05T21:06:25.082 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-10-05T21:06:25.381 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-10-05T21:06:25.594 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-10-05T21:06:27.358 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-10-05T21:06:28.572 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-10-05T21:06:28.802 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1278.g487ffcb 8/8 2023-10-05T21:06:29.119 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1278.g487ffcb 8/8 2023-10-05T21:06:29.119 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1278.g487ffcb 1/8 2023-10-05T21:06:29.119 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-10-05T21:06:29.119 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-10-05T21:06:29.119 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-10-05T21:06:29.119 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-10-05T21:06:29.119 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-10-05T21:06:29.120 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 7/8 2023-10-05T21:06:29.809 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 8/8 2023-10-05T21:06:29.809 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:06:29.809 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-10-05T21:06:29.809 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1278.g487ffcb5.el8.noarch 2023-10-05T21:06:29.809 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-10-05T21:06:29.809 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-10-05T21:06:29.810 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-0.3.15-4.el8.x86_64 2023-10-05T21:06:29.810 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-10-05T21:06:29.810 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-05T21:06:29.810 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-05T21:06:29.810 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-10-05T21:06:29.810 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:06:29.810 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-10-05T21:06:29.931 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-mgr-rook 2023-10-05T21:06:30.784 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:25:09 ago on Thu 05 Oct 2023 08:41:21 PM UTC. 2023-10-05T21:06:32.367 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-10-05T21:06:32.369 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:06:32.369 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2023-10-05T21:06:32.369 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:06:32.369 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-10-05T21:06:32.369 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook noarch 2:17.2.6-1278.g487ffcb5.el8 ceph-noarch 47 k 2023-10-05T21:06:32.369 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2023-10-05T21:06:32.370 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-05T21:06:32.370 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-05T21:06:32.370 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-05T21:06:32.370 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-10-05T21:06:32.370 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-10-05T21:06:32.370 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-05T21:06:32.370 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-10-05T21:06:32.370 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-10-05T21:06:32.370 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-10-05T21:06:32.370 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-10-05T21:06:32.370 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-05T21:06:32.371 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-05T21:06:32.371 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:06:32.371 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-10-05T21:06:32.371 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:06:32.371 INFO:teuthology.orchestra.run.smithi153.stdout:Install 13 Packages 2023-10-05T21:06:32.371 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:06:32.371 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 1.9 M 2023-10-05T21:06:32.372 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 25 M 2023-10-05T21:06:32.372 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-10-05T21:06:32.857 INFO:teuthology.orchestra.run.smithi153.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 354 kB/s | 27 kB 00:00 2023-10-05T21:06:32.882 INFO:teuthology.orchestra.run.smithi153.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 199 kB/s | 20 kB 00:00 2023-10-05T21:06:33.024 INFO:teuthology.orchestra.run.smithi153.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 778 kB/s | 126 kB 00:00 2023-10-05T21:06:33.049 INFO:teuthology.orchestra.run.smithi153.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 659 kB/s | 110 kB 00:00 2023-10-05T21:06:33.108 INFO:teuthology.orchestra.run.smithi153.stdout:(5/13): python3-requests-oauthlib-1.0.0-1.el8.n 730 kB/s | 43 kB 00:00 2023-10-05T21:06:33.133 INFO:teuthology.orchestra.run.smithi153.stdout:(6/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 1.4 MB/s | 155 kB 00:00 2023-10-05T21:06:33.159 INFO:teuthology.orchestra.run.smithi153.stdout:(7/13): ceph-mgr-rook-17.2.6-1278.g487ffcb5.el8 126 kB/s | 47 kB 00:00 2023-10-05T21:06:33.384 INFO:teuthology.orchestra.run.smithi153.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 65 kB/s | 16 kB 00:00 2023-10-05T21:06:33.409 INFO:teuthology.orchestra.run.smithi153.stdout:(9/13): python3-cachetools-3.1.1-4.el8.noarch.r 110 kB/s | 33 kB 00:00 2023-10-05T21:06:33.543 INFO:teuthology.orchestra.run.smithi153.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 212 kB/s | 81 kB 00:00 2023-10-05T21:06:33.618 INFO:teuthology.orchestra.run.smithi153.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 308 kB/s | 64 kB 00:00 2023-10-05T21:06:33.685 INFO:teuthology.orchestra.run.smithi153.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 432 kB/s | 61 kB 00:00 2023-10-05T21:06:33.918 INFO:teuthology.orchestra.run.smithi153.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 2.2 MB/s | 1.2 MB 00:00 2023-10-05T21:06:33.919 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-10-05T21:06:33.919 INFO:teuthology.orchestra.run.smithi153.stdout:Total 1.2 MB/s | 1.9 MB 00:01 2023-10-05T21:06:33.978 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-10-05T21:06:33.994 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-10-05T21:06:33.994 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-10-05T21:06:34.081 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-10-05T21:06:34.084 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-10-05T21:06:34.560 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-10-05T21:06:34.811 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-10-05T21:06:35.009 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-10-05T21:06:35.228 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2023-10-05T21:06:35.465 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-10-05T21:06:35.690 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-10-05T21:06:35.907 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-10-05T21:06:36.193 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-10-05T21:06:36.431 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-10-05T21:06:37.479 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-10-05T21:06:37.740 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-10-05T21:06:37.948 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-10-05T21:06:38.158 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-10-05T21:06:38.325 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-rook-2:17.2.6-1278.g487ffcb5.el8.noarch 13/13 2023-10-05T21:06:38.612 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1278.g487ffcb5.el8.noarch 13/13 2023-10-05T21:06:38.612 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1278.g487ffcb5.el8.noarch 1/13 2023-10-05T21:06:38.612 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-10-05T21:06:38.612 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-10-05T21:06:38.613 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-10-05T21:06:38.613 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-10-05T21:06:38.613 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-10-05T21:06:38.613 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-10-05T21:06:38.613 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-10-05T21:06:38.613 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-10-05T21:06:38.613 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-10-05T21:06:38.613 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-10-05T21:06:38.613 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2023-10-05T21:06:39.348 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-10-05T21:06:39.349 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:06:39.349 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-10-05T21:06:39.349 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook-2:17.2.6-1278.g487ffcb5.el8.noarch 2023-10-05T21:06:39.349 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-05T21:06:39.349 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-05T21:06:39.349 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-05T21:06:39.349 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-05T21:06:39.349 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-05T21:06:39.349 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-05T21:06:39.349 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-05T21:06:39.350 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-05T21:06:39.350 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-05T21:06:39.350 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-05T21:06:39.350 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-05T21:06:39.350 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-05T21:06:39.350 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:06:39.350 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-10-05T21:06:39.470 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-mgr-cephadm 2023-10-05T21:06:40.327 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:25:19 ago on Thu 05 Oct 2023 08:41:21 PM UTC. 2023-10-05T21:06:41.928 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-10-05T21:06:41.929 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:06:41.929 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2023-10-05T21:06:41.930 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:06:41.930 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-10-05T21:06:41.930 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1278.g487ffcb5.el8 ceph-noarch 121 k 2023-10-05T21:06:41.930 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2023-10-05T21:06:41.930 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-05T21:06:41.930 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-10-05T21:06:41.930 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-10-05T21:06:41.930 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-05T21:06:41.930 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:06:41.930 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-10-05T21:06:41.930 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:06:41.931 INFO:teuthology.orchestra.run.smithi153.stdout:Install 5 Packages 2023-10-05T21:06:41.931 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:06:41.931 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 6.0 M 2023-10-05T21:06:41.931 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 26 M 2023-10-05T21:06:41.931 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-10-05T21:06:41.962 INFO:teuthology.orchestra.run.smithi111.stdout:[MIRROR] oniguruma-6.8.2-2.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/oniguruma-6.8.2-2.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-10-05T21:06:42.250 INFO:teuthology.orchestra.run.smithi111.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 757 B/s | 187 kB 04:13 2023-10-05T21:06:42.517 INFO:teuthology.orchestra.run.smithi153.stdout:(1/5): ceph-mgr-cephadm-17.2.6-1278.g487ffcb5.e 519 kB/s | 121 kB 00:00 2023-10-05T21:06:42.650 INFO:teuthology.orchestra.run.smithi153.stdout:(2/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 1.4 MB/s | 538 kB 00:00 2023-10-05T21:06:43.109 INFO:teuthology.orchestra.run.smithi153.stdout:(3/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 804 kB/s | 476 kB 00:00 2023-10-05T21:06:43.376 INFO:teuthology.orchestra.run.smithi153.stdout:(4/5): python3-babel-2.5.1-7.el8.noarch.rpm 4.4 MB/s | 4.8 MB 00:01 2023-10-05T21:06:50.154 INFO:teuthology.orchestra.run.smithi111.stdout:[MIRROR] jq-1.6-7.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/jq-1.6-7.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-10-05T21:06:50.391 INFO:teuthology.orchestra.run.smithi111.stdout:(4/6): jq-1.6-7.el8.x86_64.rpm 792 B/s | 202 kB 04:21 2023-10-05T21:07:09.280 INFO:teuthology.orchestra.run.smithi153.stdout:(5/5): python3-natsort-7.1.1-2.el8.noarch.rpm 2.3 kB/s | 60 kB 00:26 2023-10-05T21:07:09.281 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-10-05T21:07:09.282 INFO:teuthology.orchestra.run.smithi153.stdout:Total 223 kB/s | 6.0 MB 00:27 2023-10-05T21:07:09.336 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-10-05T21:07:09.347 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-10-05T21:07:09.348 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-10-05T21:07:09.463 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-10-05T21:07:09.466 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-10-05T21:07:09.800 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-10-05T21:07:10.126 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-10-05T21:07:11.067 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-10-05T21:07:11.449 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-10-05T21:07:11.680 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-10-05T21:07:11.878 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1278.g487ffcb5.el8.noarch 5/5 2023-10-05T21:07:12.165 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1278.g487ffcb5.el8.noarch 5/5 2023-10-05T21:07:12.165 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1278.g487ffcb5.el8.noarch 1/5 2023-10-05T21:07:12.166 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-10-05T21:07:12.166 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-10-05T21:07:12.166 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-10-05T21:07:12.786 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-10-05T21:07:12.786 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:07:12.786 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-10-05T21:07:12.786 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm-2:17.2.6-1278.g487ffcb5.el8.noarch 2023-10-05T21:07:12.786 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-05T21:07:12.787 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-05T21:07:12.787 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-05T21:07:12.787 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-05T21:07:12.787 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:07:12.787 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-10-05T21:07:12.902 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-fuse 2023-10-05T21:07:13.763 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:25:52 ago on Thu 05 Oct 2023 08:41:21 PM UTC. 2023-10-05T21:07:15.342 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-10-05T21:07:15.342 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:07:15.342 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2023-10-05T21:07:15.343 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:07:15.343 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-10-05T21:07:15.343 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 876 k 2023-10-05T21:07:15.343 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2023-10-05T21:07:15.343 INFO:teuthology.orchestra.run.smithi153.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-10-05T21:07:15.343 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:07:15.343 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-10-05T21:07:15.343 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:07:15.343 INFO:teuthology.orchestra.run.smithi153.stdout:Install 2 Packages 2023-10-05T21:07:15.343 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:07:15.344 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 959 k 2023-10-05T21:07:15.344 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 3.0 M 2023-10-05T21:07:15.344 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-10-05T21:07:15.728 INFO:teuthology.orchestra.run.smithi153.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 433 kB/s | 83 kB 00:00 2023-10-05T21:07:16.037 INFO:teuthology.orchestra.run.smithi153.stdout:(2/2): ceph-fuse-17.2.6-1278.g487ffcb5.el8.x86_ 1.7 MB/s | 876 kB 00:00 2023-10-05T21:07:16.038 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-10-05T21:07:16.039 INFO:teuthology.orchestra.run.smithi153.stdout:Total 1.3 MB/s | 959 kB 00:00 2023-10-05T21:07:16.048 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-10-05T21:07:16.069 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-10-05T21:07:16.069 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-10-05T21:07:16.156 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-10-05T21:07:16.159 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-10-05T21:07:16.332 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-10-05T21:07:16.603 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-10-05T21:07:16.818 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-fuse-2:17.2.6-1278.g487ffcb5.el8.x86_64 2/2 2023-10-05T21:07:17.218 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-fuse-2:17.2.6-1278.g487ffcb5.el8.x86_64 2/2 2023-10-05T21:07:17.219 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-fuse-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/2 2023-10-05T21:07:17.900 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-10-05T21:07:17.900 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:07:17.901 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-10-05T21:07:17.901 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse-2:17.2.6-1278.g487ffcb5.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-10-05T21:07:17.901 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:07:17.901 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-10-05T21:07:18.108 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-volume 2023-10-05T21:07:18.973 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:25:57 ago on Thu 05 Oct 2023 08:41:21 PM UTC. 2023-10-05T21:07:20.549 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-10-05T21:07:20.549 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:07:20.550 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2023-10-05T21:07:20.550 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:07:20.550 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-10-05T21:07:20.550 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume noarch 2:17.2.6-1278.g487ffcb5.el8 ceph-noarch 267 k 2023-10-05T21:07:20.550 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:07:20.550 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-10-05T21:07:20.550 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:07:20.551 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-10-05T21:07:20.551 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:07:20.551 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 267 k 2023-10-05T21:07:20.551 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 1.3 M 2023-10-05T21:07:20.551 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-10-05T21:07:20.982 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-volume-17.2.6-1278.g487ffcb5.el8.noarch.rp 619 kB/s | 267 kB 00:00 2023-10-05T21:07:20.983 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-10-05T21:07:20.983 INFO:teuthology.orchestra.run.smithi153.stdout:Total 617 kB/s | 267 kB 00:00 2023-10-05T21:07:20.984 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-10-05T21:07:20.994 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-10-05T21:07:20.994 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-10-05T21:07:21.025 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-10-05T21:07:21.028 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-10-05T21:07:21.212 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-10-05T21:07:21.418 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-volume-2:17.2.6-1278.g487ffcb5.el8.noarch 1/1 2023-10-05T21:07:21.827 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-volume-2:17.2.6-1278.g487ffcb5.el8.noarch 1/1 2023-10-05T21:07:22.478 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-volume-2:17.2.6-1278.g487ffcb5.el8.noarch 1/1 2023-10-05T21:07:22.479 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:07:22.479 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-10-05T21:07:22.479 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume-2:17.2.6-1278.g487ffcb5.el8.noarch 2023-10-05T21:07:22.479 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:07:22.479 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-10-05T21:07:22.679 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install librados-devel 2023-10-05T21:07:23.545 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:26:02 ago on Thu 05 Oct 2023 08:41:21 PM UTC. 2023-10-05T21:07:25.122 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-10-05T21:07:25.122 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:07:25.122 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2023-10-05T21:07:25.123 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:07:25.123 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-10-05T21:07:25.123 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 130 k 2023-10-05T21:07:25.123 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:07:25.123 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-10-05T21:07:25.123 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:07:25.123 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-10-05T21:07:25.123 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:07:25.124 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 130 k 2023-10-05T21:07:25.124 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 464 k 2023-10-05T21:07:25.124 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-10-05T21:07:25.794 INFO:teuthology.orchestra.run.smithi153.stdout:librados-devel-17.2.6-1278.g487ffcb5.el8.x86_64 193 kB/s | 130 kB 00:00 2023-10-05T21:07:25.795 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-10-05T21:07:25.795 INFO:teuthology.orchestra.run.smithi153.stdout:Total 193 kB/s | 130 kB 00:00 2023-10-05T21:07:25.795 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-10-05T21:07:25.801 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-10-05T21:07:25.801 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-10-05T21:07:25.851 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-10-05T21:07:25.854 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-10-05T21:07:25.962 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-10-05T21:07:26.182 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librados-devel-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/1 2023-10-05T21:07:26.463 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados-devel-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/1 2023-10-05T21:07:27.133 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados-devel-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/1 2023-10-05T21:07:27.306 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:07:27.307 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-10-05T21:07:27.307 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:07:27.307 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:07:27.307 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-10-05T21:07:27.347 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install libcephfs2 2023-10-05T21:07:28.217 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:26:07 ago on Thu 05 Oct 2023 08:41:21 PM UTC. 2023-10-05T21:07:29.619 INFO:teuthology.orchestra.run.smithi153.stdout:Package libcephfs2-2:17.2.6-1278.g487ffcb5.el8.x86_64 is already installed. 2023-10-05T21:07:29.810 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-10-05T21:07:29.812 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2023-10-05T21:07:29.812 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-10-05T21:07:29.908 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install libcephfs-devel 2023-10-05T21:07:30.775 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:26:09 ago on Thu 05 Oct 2023 08:41:21 PM UTC. 2023-10-05T21:07:31.480 INFO:teuthology.orchestra.run.smithi111.stdout:[MIRROR] socat-1.7.4.1-1.el8.x86_64.rpm: Curl error (28): Timeout was reached for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/socat-1.7.4.1-1.el8.x86_64.rpm [Operation too slow. Less than 1000 bytes/sec transferred the last 300 seconds] 2023-10-05T21:07:32.176 INFO:teuthology.orchestra.run.smithi111.stdout:(5/6): socat-1.7.4.1-1.el8.x86_64.rpm 1.1 kB/s | 323 kB 05:00 2023-10-05T21:07:32.362 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-10-05T21:07:32.362 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:07:32.362 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2023-10-05T21:07:32.363 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:07:32.363 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-10-05T21:07:32.363 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 25 k 2023-10-05T21:07:32.363 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:07:32.363 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-10-05T21:07:32.363 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:07:32.363 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-10-05T21:07:32.363 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:07:32.364 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 25 k 2023-10-05T21:07:32.364 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 109 k 2023-10-05T21:07:32.364 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-10-05T21:07:32.638 INFO:teuthology.orchestra.run.smithi153.stdout:libcephfs-devel-17.2.6-1278.g487ffcb5.el8.x86_6 90 kB/s | 25 kB 00:00 2023-10-05T21:07:32.639 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-10-05T21:07:32.639 INFO:teuthology.orchestra.run.smithi153.stdout:Total 90 kB/s | 25 kB 00:00 2023-10-05T21:07:32.639 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-10-05T21:07:32.642 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-10-05T21:07:32.643 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-10-05T21:07:32.644 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-10-05T21:07:32.647 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-10-05T21:07:32.694 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-10-05T21:07:32.922 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs-devel-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/1 2023-10-05T21:07:33.185 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephfs-devel-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/1 2023-10-05T21:07:33.781 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs-devel-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/1 2023-10-05T21:07:33.781 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:07:33.782 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-10-05T21:07:33.782 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:07:33.782 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:07:33.782 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-10-05T21:07:33.892 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install librados2 2023-10-05T21:07:34.756 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:26:13 ago on Thu 05 Oct 2023 08:41:21 PM UTC. 2023-10-05T21:07:36.134 INFO:teuthology.orchestra.run.smithi153.stdout:Package librados2-2:17.2.6-1278.g487ffcb5.el8.x86_64 is already installed. 2023-10-05T21:07:36.322 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-10-05T21:07:36.323 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2023-10-05T21:07:36.323 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-10-05T21:07:36.422 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install librbd1 2023-10-05T21:07:37.282 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:26:16 ago on Thu 05 Oct 2023 08:41:21 PM UTC. 2023-10-05T21:07:38.687 INFO:teuthology.orchestra.run.smithi153.stdout:Package librbd1-2:17.2.6-1278.g487ffcb5.el8.x86_64 is already installed. 2023-10-05T21:07:38.875 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-10-05T21:07:38.877 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2023-10-05T21:07:38.877 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-10-05T21:07:38.987 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install python3-rados 2023-10-05T21:07:39.845 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:26:18 ago on Thu 05 Oct 2023 08:41:21 PM UTC. 2023-10-05T21:07:41.237 INFO:teuthology.orchestra.run.smithi153.stdout:Package python3-rados-2:17.2.6-1278.g487ffcb5.el8.x86_64 is already installed. 2023-10-05T21:07:41.431 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-10-05T21:07:41.432 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2023-10-05T21:07:41.432 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-10-05T21:07:41.539 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install python3-rgw 2023-10-05T21:07:42.395 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:26:21 ago on Thu 05 Oct 2023 08:41:21 PM UTC. 2023-10-05T21:07:43.866 INFO:teuthology.orchestra.run.smithi153.stdout:Package python3-rgw-2:17.2.6-1278.g487ffcb5.el8.x86_64 is already installed. 2023-10-05T21:07:44.054 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-10-05T21:07:44.055 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2023-10-05T21:07:44.055 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-10-05T21:07:44.155 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install python3-cephfs 2023-10-05T21:07:45.019 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:26:24 ago on Thu 05 Oct 2023 08:41:21 PM UTC. 2023-10-05T21:07:46.445 INFO:teuthology.orchestra.run.smithi153.stdout:Package python3-cephfs-2:17.2.6-1278.g487ffcb5.el8.x86_64 is already installed. 2023-10-05T21:07:46.634 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-10-05T21:07:46.635 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2023-10-05T21:07:46.635 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-10-05T21:07:46.738 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install python3-rbd 2023-10-05T21:07:47.596 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:26:26 ago on Thu 05 Oct 2023 08:41:21 PM UTC. 2023-10-05T21:07:48.987 INFO:teuthology.orchestra.run.smithi153.stdout:Package python3-rbd-2:17.2.6-1278.g487ffcb5.el8.x86_64 is already installed. 2023-10-05T21:07:49.179 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-10-05T21:07:49.181 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2023-10-05T21:07:49.181 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-10-05T21:07:49.288 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install rbd-fuse 2023-10-05T21:07:50.146 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:26:29 ago on Thu 05 Oct 2023 08:41:21 PM UTC. 2023-10-05T21:07:51.743 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-10-05T21:07:51.743 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:07:51.744 INFO:teuthology.orchestra.run.smithi153.stdout: Package Architecture Version Repository Size 2023-10-05T21:07:51.744 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:07:51.744 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-10-05T21:07:51.744 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 90 k 2023-10-05T21:07:51.744 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:07:51.744 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-10-05T21:07:51.744 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:07:51.744 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-10-05T21:07:51.744 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:07:51.745 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 90 k 2023-10-05T21:07:51.745 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 264 k 2023-10-05T21:07:51.745 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-10-05T21:07:52.216 INFO:teuthology.orchestra.run.smithi153.stdout:rbd-fuse-17.2.6-1278.g487ffcb5.el8.x86_64.rpm 192 kB/s | 90 kB 00:00 2023-10-05T21:07:52.217 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-10-05T21:07:52.217 INFO:teuthology.orchestra.run.smithi153.stdout:Total 191 kB/s | 90 kB 00:00 2023-10-05T21:07:52.217 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-10-05T21:07:52.227 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-10-05T21:07:52.227 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-10-05T21:07:52.278 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-10-05T21:07:52.281 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-10-05T21:07:52.387 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-10-05T21:07:52.628 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-fuse-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/1 2023-10-05T21:07:52.920 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-fuse-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/1 2023-10-05T21:07:53.524 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-fuse-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/1 2023-10-05T21:07:53.524 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:07:53.524 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-10-05T21:07:53.524 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:07:53.524 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:07:53.524 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-10-05T21:07:53.749 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install rbd-mirror 2023-10-05T21:07:54.606 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:26:33 ago on Thu 05 Oct 2023 08:41:21 PM UTC. 2023-10-05T21:07:56.190 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-10-05T21:07:56.191 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:07:56.191 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2023-10-05T21:07:56.192 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:07:56.192 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-10-05T21:07:56.192 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 3.5 M 2023-10-05T21:07:56.192 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:07:56.192 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-10-05T21:07:56.192 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:07:56.192 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-10-05T21:07:56.193 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:07:56.193 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 3.5 M 2023-10-05T21:07:56.193 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 16 M 2023-10-05T21:07:56.193 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-10-05T21:07:57.219 INFO:teuthology.orchestra.run.smithi153.stdout:rbd-mirror-17.2.6-1278.g487ffcb5.el8.x86_64.rpm 3.4 MB/s | 3.5 MB 00:01 2023-10-05T21:07:57.220 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-10-05T21:07:57.220 INFO:teuthology.orchestra.run.smithi153.stdout:Total 3.4 MB/s | 3.5 MB 00:01 2023-10-05T21:07:57.221 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-10-05T21:07:57.233 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-10-05T21:07:57.233 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-10-05T21:07:57.299 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-10-05T21:07:57.303 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-10-05T21:07:57.743 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-10-05T21:07:57.920 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-mirror-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/1 2023-10-05T21:07:58.339 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/1 2023-10-05T21:07:58.966 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-mirror-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/1 2023-10-05T21:07:58.967 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:07:58.967 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-10-05T21:07:58.967 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:07:58.967 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:07:58.967 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-10-05T21:07:59.152 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install rbd-nbd 2023-10-05T21:08:00.020 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:26:39 ago on Thu 05 Oct 2023 08:41:21 PM UTC. 2023-10-05T21:08:01.613 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-10-05T21:08:01.614 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:08:01.614 INFO:teuthology.orchestra.run.smithi153.stdout: Package Architecture Version Repository Size 2023-10-05T21:08:01.615 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:08:01.615 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-10-05T21:08:01.615 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 173 k 2023-10-05T21:08:01.615 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:08:01.615 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-10-05T21:08:01.615 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-05T21:08:01.615 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2023-10-05T21:08:01.615 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:08:01.615 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 173 k 2023-10-05T21:08:01.615 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 552 k 2023-10-05T21:08:01.615 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-10-05T21:08:01.905 INFO:teuthology.orchestra.run.smithi153.stdout:rbd-nbd-17.2.6-1278.g487ffcb5.el8.x86_64.rpm 598 kB/s | 173 kB 00:00 2023-10-05T21:08:01.905 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-10-05T21:08:01.906 INFO:teuthology.orchestra.run.smithi153.stdout:Total 595 kB/s | 173 kB 00:00 2023-10-05T21:08:01.906 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-10-05T21:08:01.916 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-10-05T21:08:01.917 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-10-05T21:08:01.966 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-10-05T21:08:01.969 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-10-05T21:08:02.085 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-10-05T21:08:02.276 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-nbd-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/1 2023-10-05T21:08:02.572 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-nbd-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/1 2023-10-05T21:08:03.201 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-nbd-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/1 2023-10-05T21:08:03.201 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:08:03.201 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-10-05T21:08:03.201 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:08:03.201 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:08:03.202 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-10-05T21:08:03.427 DEBUG:teuthology.parallel:result is None 2023-10-05T21:11:43.251 INFO:teuthology.orchestra.run.smithi111.stdout:[MIRROR] xmlstarlet-1.6.1-20.el8.x86_64.rpm: Curl error (28): Timeout was reached for http://mirrors.cmich.edu/centos/8-stream/AppStream/x86_64/os/Packages/xmlstarlet-1.6.1-20.el8.x86_64.rpm [Operation too slow. Less than 1000 bytes/sec transferred the last 300 seconds] 2023-10-05T21:11:43.771 INFO:teuthology.orchestra.run.smithi111.stdout:(6/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 240 B/s | 71 kB 05:01 2023-10-05T21:11:43.771 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-10-05T21:11:43.771 INFO:teuthology.orchestra.run.smithi111.stdout:Total 97 kB/s | 53 MB 09:15 2023-10-05T21:11:43.810 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-10-05T21:11:43.832 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-10-05T21:11:43.833 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-10-05T21:11:44.145 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-10-05T21:11:44.148 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-10-05T21:11:44.619 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-10-05T21:11:44.877 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-10-05T21:11:45.108 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-10-05T21:11:45.264 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-10-05T21:11:45.334 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-10-05T21:11:45.529 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : jq-1.6-7.el8.x86_64 4/6 2023-10-05T21:11:45.689 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libcephsqlite-2:17.2.6-1278.g487ffcb5.el8.x86_64 5/6 2023-10-05T21:11:50.720 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1278.g487ffcb5.el8.x86_64 5/6 2023-10-05T21:11:50.962 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-test-2:17.2.6-1278.g487ffcb5.el8.x86_64 6/6 2023-10-05T21:11:51.242 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-test-2:17.2.6-1278.g487ffcb5.el8.x86_64 6/6 2023-10-05T21:11:51.242 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-test-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/6 2023-10-05T21:11:51.242 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libcephsqlite-2:17.2.6-1278.g487ffcb5.el8.x86_64 2/6 2023-10-05T21:11:51.242 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : jq-1.6-7.el8.x86_64 3/6 2023-10-05T21:11:51.242 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-10-05T21:11:51.242 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-10-05T21:11:51.917 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-10-05T21:11:51.917 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:11:51.917 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-10-05T21:11:51.917 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-test-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:11:51.918 INFO:teuthology.orchestra.run.smithi111.stdout: jq-1.6-7.el8.x86_64 2023-10-05T21:11:51.918 INFO:teuthology.orchestra.run.smithi111.stdout: libcephsqlite-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:11:51.918 INFO:teuthology.orchestra.run.smithi111.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-05T21:11:51.918 INFO:teuthology.orchestra.run.smithi111.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-05T21:11:51.918 INFO:teuthology.orchestra.run.smithi111.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-05T21:11:51.918 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:11:51.918 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-10-05T21:11:52.119 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph 2023-10-05T21:11:52.974 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:27:57 ago on Thu 05 Oct 2023 08:43:55 PM UTC. 2023-10-05T21:11:54.554 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-10-05T21:11:54.558 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:11:54.558 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2023-10-05T21:11:54.558 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:11:54.558 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-10-05T21:11:54.558 INFO:teuthology.orchestra.run.smithi111.stdout: ceph x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 6.4 k 2023-10-05T21:11:54.558 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2023-10-05T21:11:54.558 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mds x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 2.3 M 2023-10-05T21:11:54.558 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 1.6 M 2023-10-05T21:11:54.558 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1278.g487ffcb5.el8 ceph-noarch 238 k 2023-10-05T21:11:54.559 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mon x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 3.9 M 2023-10-05T21:11:54.559 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-osd x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 17 M 2023-10-05T21:11:54.559 INFO:teuthology.orchestra.run.smithi111.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-05T21:11:54.559 INFO:teuthology.orchestra.run.smithi111.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-05T21:11:54.559 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-10-05T21:11:54.559 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-05T21:11:54.559 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-05T21:11:54.559 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-10-05T21:11:54.559 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-05T21:11:54.559 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-05T21:11:54.559 INFO:teuthology.orchestra.run.smithi111.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-05T21:11:54.559 INFO:teuthology.orchestra.run.smithi111.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-10-05T21:11:54.560 INFO:teuthology.orchestra.run.smithi111.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-10-05T21:11:54.560 INFO:teuthology.orchestra.run.smithi111.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-05T21:11:54.560 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-05T21:11:54.560 INFO:teuthology.orchestra.run.smithi111.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-05T21:11:54.560 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-10-05T21:11:54.560 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-10-05T21:11:54.560 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-10-05T21:11:54.560 INFO:teuthology.orchestra.run.smithi111.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-05T21:11:54.560 INFO:teuthology.orchestra.run.smithi111.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-05T21:11:54.560 INFO:teuthology.orchestra.run.smithi111.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-05T21:11:54.560 INFO:teuthology.orchestra.run.smithi111.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-05T21:11:54.561 INFO:teuthology.orchestra.run.smithi111.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-05T21:11:54.561 INFO:teuthology.orchestra.run.smithi111.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-05T21:11:54.561 INFO:teuthology.orchestra.run.smithi111.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-05T21:11:54.561 INFO:teuthology.orchestra.run.smithi111.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-10-05T21:11:54.561 INFO:teuthology.orchestra.run.smithi111.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-05T21:11:54.561 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:11:54.561 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-10-05T21:11:54.561 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:11:54.561 INFO:teuthology.orchestra.run.smithi111.stdout:Install 32 Packages 2023-10-05T21:11:54.561 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:11:54.562 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 28 M 2023-10-05T21:11:54.562 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 110 M 2023-10-05T21:11:54.562 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-10-05T21:11:55.155 INFO:teuthology.orchestra.run.smithi111.stdout:(1/32): ceph-17.2.6-1278.g487ffcb5.el8.x86_64.r 27 kB/s | 6.4 kB 00:00 2023-10-05T21:11:55.597 INFO:teuthology.orchestra.run.smithi111.stdout:(2/32): ceph-mon-17.2.6-1278.g487ffcb5.el8.x86_ 8.9 MB/s | 3.9 MB 00:00 2023-10-05T21:11:55.997 INFO:teuthology.orchestra.run.smithi111.stdout:(3/32): ceph-mgr-17.2.6-1278.g487ffcb5.el8.x86_ 1.5 MB/s | 1.6 MB 00:01 2023-10-05T21:11:56.181 INFO:teuthology.orchestra.run.smithi111.stdout:(4/32): ceph-mgr-modules-core-17.2.6-1278.g487f 1.3 MB/s | 238 kB 00:00 2023-10-05T21:11:56.406 INFO:teuthology.orchestra.run.smithi111.stdout:(5/32): ceph-mds-17.2.6-1278.g487ffcb5.el8.x86_ 1.6 MB/s | 2.3 MB 00:01 2023-10-05T21:11:56.582 INFO:teuthology.orchestra.run.smithi111.stdout:(6/32): ceph-osd-17.2.6-1278.g487ffcb5.el8.x86_ 17 MB/s | 17 MB 00:00 2023-10-05T21:11:56.690 INFO:teuthology.orchestra.run.smithi111.stdout:(7/32): python3-markupsafe-0.23-19.el8.x86_64.r 137 kB/s | 39 kB 00:00 2023-10-05T21:11:56.899 INFO:teuthology.orchestra.run.smithi111.stdout:(8/32): python3-mako-1.0.6-14.el8.noarch.rpm 219 kB/s | 157 kB 00:00 2023-10-05T21:11:57.216 INFO:teuthology.orchestra.run.smithi111.stdout:(9/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 163 kB/s | 103 kB 00:00 2023-10-05T21:11:57.291 INFO:teuthology.orchestra.run.smithi111.stdout:(10/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 3.2 MB/s | 249 kB 00:00 2023-10-05T21:11:57.341 INFO:teuthology.orchestra.run.smithi111.stdout:(11/32): python3-cryptography-3.2.1-6.el8.x86_6 13 MB/s | 641 kB 00:00 2023-10-05T21:11:57.366 INFO:teuthology.orchestra.run.smithi111.stdout:(12/32): python3-pytz-2017.2-11.el8.noarch.rpm 84 kB/s | 57 kB 00:00 2023-10-05T21:11:57.392 INFO:teuthology.orchestra.run.smithi111.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 2.1 MB/s | 109 kB 00:00 2023-10-05T21:11:57.784 INFO:teuthology.orchestra.run.smithi111.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 105 kB/s | 44 kB 00:00 2023-10-05T21:11:57.867 INFO:teuthology.orchestra.run.smithi111.stdout:(15/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 389 kB/s | 185 kB 00:00 2023-10-05T21:11:57.926 INFO:teuthology.orchestra.run.smithi111.stdout:(16/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.2 MB/s | 173 kB 00:00 2023-10-05T21:11:58.010 INFO:teuthology.orchestra.run.smithi111.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 133 kB/s | 11 kB 00:00 2023-10-05T21:11:58.043 INFO:teuthology.orchestra.run.smithi111.stdout:(18/32): python3-cherrypy-18.4.0-1.el8.noarch.r 2.1 MB/s | 384 kB 00:00 2023-10-05T21:11:58.094 INFO:teuthology.orchestra.run.smithi111.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 210 kB/s | 18 kB 00:00 2023-10-05T21:11:58.119 INFO:teuthology.orchestra.run.smithi111.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 648 kB/s | 49 kB 00:00 2023-10-05T21:11:58.186 INFO:teuthology.orchestra.run.smithi111.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 639 kB/s | 59 kB 00:00 2023-10-05T21:11:58.681 INFO:teuthology.orchestra.run.smithi111.stdout:(22/32): python3-pecan-1.3.2-9.el8.noarch.rpm 3.0 MB/s | 283 kB 00:00 2023-10-05T21:11:58.681 INFO:teuthology.orchestra.run.smithi111.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 233 kB/s | 16 kB 00:00 2023-10-05T21:11:58.681 INFO:teuthology.orchestra.run.smithi111.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 249 kB/s | 19 kB 00:00 2023-10-05T21:11:58.682 INFO:teuthology.orchestra.run.smithi111.stdout:(25/32): python3-werkzeug-0.12.2-4.el8.noarch.r 318 kB/s | 457 kB 00:01 2023-10-05T21:11:58.682 INFO:teuthology.orchestra.run.smithi111.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 237 kB/s | 24 kB 00:00 2023-10-05T21:11:58.682 INFO:teuthology.orchestra.run.smithi111.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 348 kB/s | 29 kB 00:00 2023-10-05T21:11:58.682 INFO:teuthology.orchestra.run.smithi111.stdout:(28/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.5 MB/s | 251 kB 00:00 2023-10-05T21:11:58.682 INFO:teuthology.orchestra.run.smithi111.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 1.8 MB/s | 255 kB 00:00 2023-10-05T21:11:58.682 INFO:teuthology.orchestra.run.smithi111.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.0 MB/s | 85 kB 00:00 2023-10-05T21:11:58.682 INFO:teuthology.orchestra.run.smithi111.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 306 kB/s | 23 kB 00:00 2023-10-05T21:11:58.682 INFO:teuthology.orchestra.run.smithi111.stdout:(32/32): python3-trustme-0.6.0-4.el8.noarch.rpm 100 kB/s | 27 kB 00:00 2023-10-05T21:11:58.682 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-10-05T21:11:58.682 INFO:teuthology.orchestra.run.smithi111.stdout:Total 7.0 MB/s | 28 MB 00:04 2023-10-05T21:11:58.699 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-10-05T21:11:58.735 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-10-05T21:11:58.735 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-10-05T21:11:59.030 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-10-05T21:11:59.033 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-10-05T21:12:00.100 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-10-05T21:12:00.300 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-10-05T21:12:00.503 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-10-05T21:12:00.702 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-10-05T21:12:00.935 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2023-10-05T21:12:01.149 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-10-05T21:12:01.355 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-10-05T21:12:01.532 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-10-05T21:12:01.776 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-10-05T21:12:01.985 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-10-05T21:12:02.197 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-10-05T21:12:02.402 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-10-05T21:12:02.625 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-10-05T21:12:02.992 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2023-10-05T21:12:03.231 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/32 2023-10-05T21:12:03.616 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-10-05T21:12:03.678 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-10-05T21:12:03.887 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-10-05T21:12:04.230 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-10-05T21:12:04.442 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-10-05T21:12:04.647 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2023-10-05T21:12:04.824 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-10-05T21:12:05.059 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-10-05T21:12:05.306 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-10-05T21:12:05.522 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-10-05T21:12:05.826 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2023-10-05T21:12:06.126 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-10-05T21:12:06.464 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1278.g487ffcb5.el8. 27/32 2023-10-05T21:12:06.651 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-2:17.2.6-1278.g487ffcb5.el8.x86_64 28/32 2023-10-05T21:12:08.122 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1278.g487ffcb5.el8.x86_64 28/32 2023-10-05T21:12:08.284 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-osd-2:17.2.6-1278.g487ffcb5.el8.x86_64 29/32 2023-10-05T21:12:08.676 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-osd-2:17.2.6-1278.g487ffcb5.el8.x86_64 29/32 2023-10-05T21:12:08.869 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mon-2:17.2.6-1278.g487ffcb5.el8.x86_64 30/32 2023-10-05T21:12:09.086 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mon-2:17.2.6-1278.g487ffcb5.el8.x86_64 30/32 2023-10-05T21:12:09.236 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mds-2:17.2.6-1278.g487ffcb5.el8.x86_64 31/32 2023-10-05T21:12:09.253 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mds-2:17.2.6-1278.g487ffcb5.el8.x86_64 31/32 2023-10-05T21:12:09.377 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-2:17.2.6-1278.g487ffcb5.el8.x86_64 32/32 2023-10-05T21:12:09.788 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-2:17.2.6-1278.g487ffcb5.el8.x86_64 32/32 2023-10-05T21:12:09.788 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/32 2023-10-05T21:12:09.788 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mds-2:17.2.6-1278.g487ffcb5.el8.x86_64 2/32 2023-10-05T21:12:09.789 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-2:17.2.6-1278.g487ffcb5.el8.x86_64 3/32 2023-10-05T21:12:09.789 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mon-2:17.2.6-1278.g487ffcb5.el8.x86_64 4/32 2023-10-05T21:12:09.789 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-osd-2:17.2.6-1278.g487ffcb5.el8.x86_64 5/32 2023-10-05T21:12:09.789 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1278.g487ffcb5.el8. 6/32 2023-10-05T21:12:09.789 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2023-10-05T21:12:09.789 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-10-05T21:12:09.789 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-10-05T21:12:09.789 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2023-10-05T21:12:09.789 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-10-05T21:12:09.789 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2023-10-05T21:12:09.789 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 13/32 2023-10-05T21:12:09.789 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-10-05T21:12:09.789 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-10-05T21:12:09.790 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-10-05T21:12:09.790 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-10-05T21:12:09.790 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-10-05T21:12:09.790 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-10-05T21:12:09.790 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-10-05T21:12:09.790 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-10-05T21:12:09.790 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-10-05T21:12:09.790 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-10-05T21:12:09.790 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-10-05T21:12:09.790 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-10-05T21:12:09.790 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-10-05T21:12:09.791 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-10-05T21:12:09.791 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-10-05T21:12:09.791 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2023-10-05T21:12:09.791 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-10-05T21:12:09.791 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-10-05T21:12:10.879 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-10-05T21:12:10.879 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:12:10.879 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-10-05T21:12:10.879 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:12:10.880 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mds-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:12:10.880 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:12:10.880 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-modules-core-2:17.2.6-1278.g487ffcb5.el8.noarch 2023-10-05T21:12:10.880 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mon-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:12:10.880 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-osd-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:12:10.880 INFO:teuthology.orchestra.run.smithi111.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-05T21:12:10.880 INFO:teuthology.orchestra.run.smithi111.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-05T21:12:10.880 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-10-05T21:12:10.880 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-05T21:12:10.880 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-05T21:12:10.881 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-10-05T21:12:10.881 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-05T21:12:10.881 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-05T21:12:10.881 INFO:teuthology.orchestra.run.smithi111.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-05T21:12:10.881 INFO:teuthology.orchestra.run.smithi111.stdout: python3-mako-1.0.6-14.el8.noarch 2023-10-05T21:12:10.881 INFO:teuthology.orchestra.run.smithi111.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-05T21:12:10.881 INFO:teuthology.orchestra.run.smithi111.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-05T21:12:10.881 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-05T21:12:10.881 INFO:teuthology.orchestra.run.smithi111.stdout: python3-portend-2.6-1.el8.noarch 2023-10-05T21:12:10.881 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-05T21:12:10.881 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-05T21:12:10.882 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pytz-2017.2-11.el8.noarch 2023-10-05T21:12:10.882 INFO:teuthology.orchestra.run.smithi111.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-05T21:12:10.882 INFO:teuthology.orchestra.run.smithi111.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-05T21:12:10.882 INFO:teuthology.orchestra.run.smithi111.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-05T21:12:10.882 INFO:teuthology.orchestra.run.smithi111.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-05T21:12:10.882 INFO:teuthology.orchestra.run.smithi111.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-05T21:12:10.882 INFO:teuthology.orchestra.run.smithi111.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-05T21:12:10.882 INFO:teuthology.orchestra.run.smithi111.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-05T21:12:10.882 INFO:teuthology.orchestra.run.smithi111.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-05T21:12:10.882 INFO:teuthology.orchestra.run.smithi111.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-05T21:12:10.883 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:12:10.883 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-10-05T21:12:11.083 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-base 2023-10-05T21:12:11.941 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:28:16 ago on Thu 05 Oct 2023 08:43:55 PM UTC. 2023-10-05T21:12:13.329 INFO:teuthology.orchestra.run.smithi111.stdout:Package ceph-base-2:17.2.6-1278.g487ffcb5.el8.x86_64 is already installed. 2023-10-05T21:12:13.515 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-10-05T21:12:13.516 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2023-10-05T21:12:13.516 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-10-05T21:12:13.613 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install cephadm 2023-10-05T21:12:14.467 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:28:19 ago on Thu 05 Oct 2023 08:43:55 PM UTC. 2023-10-05T21:12:16.036 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-10-05T21:12:16.037 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:12:16.037 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2023-10-05T21:12:16.037 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:12:16.037 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-10-05T21:12:16.037 INFO:teuthology.orchestra.run.smithi111.stdout: cephadm noarch 2:17.2.6-1278.g487ffcb5.el8 ceph-noarch 80 k 2023-10-05T21:12:16.037 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:12:16.037 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-10-05T21:12:16.037 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:12:16.037 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2023-10-05T21:12:16.037 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:12:16.037 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 80 k 2023-10-05T21:12:16.038 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 364 k 2023-10-05T21:12:16.038 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-10-05T21:12:16.436 INFO:teuthology.orchestra.run.smithi111.stdout:cephadm-17.2.6-1278.g487ffcb5.el8.noarch.rpm 202 kB/s | 80 kB 00:00 2023-10-05T21:12:16.436 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-10-05T21:12:16.436 INFO:teuthology.orchestra.run.smithi111.stdout:Total 201 kB/s | 80 kB 00:00 2023-10-05T21:12:16.436 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-10-05T21:12:16.444 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-10-05T21:12:16.444 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-10-05T21:12:16.446 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-10-05T21:12:16.449 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-10-05T21:12:16.491 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-10-05T21:12:16.948 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: cephadm-2:17.2.6-1278.g487ffcb5.el8.noarch 1/1 2023-10-05T21:12:17.129 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : cephadm-2:17.2.6-1278.g487ffcb5.el8.noarch 1/1 2023-10-05T21:12:17.358 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: cephadm-2:17.2.6-1278.g487ffcb5.el8.noarch 1/1 2023-10-05T21:12:17.963 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : cephadm-2:17.2.6-1278.g487ffcb5.el8.noarch 1/1 2023-10-05T21:12:17.963 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:12:17.963 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-10-05T21:12:17.963 INFO:teuthology.orchestra.run.smithi111.stdout: cephadm-2:17.2.6-1278.g487ffcb5.el8.noarch 2023-10-05T21:12:17.964 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:12:17.964 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-10-05T21:12:18.178 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-immutable-object-cache 2023-10-05T21:12:19.037 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:28:24 ago on Thu 05 Oct 2023 08:43:55 PM UTC. 2023-10-05T21:12:20.608 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-10-05T21:12:20.609 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:12:20.609 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repo Size 2023-10-05T21:12:20.609 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:12:20.609 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-10-05T21:12:20.609 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 162 k 2023-10-05T21:12:20.609 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:12:20.609 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-10-05T21:12:20.609 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:12:20.609 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2023-10-05T21:12:20.609 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:12:20.609 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 162 k 2023-10-05T21:12:20.610 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 490 k 2023-10-05T21:12:20.610 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-10-05T21:12:21.324 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-immutable-object-cache-17.2.6-1278.g487ffc 226 kB/s | 162 kB 00:00 2023-10-05T21:12:21.324 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-10-05T21:12:21.325 INFO:teuthology.orchestra.run.smithi111.stdout:Total 226 kB/s | 162 kB 00:00 2023-10-05T21:12:21.325 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-10-05T21:12:21.337 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-10-05T21:12:21.337 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-10-05T21:12:21.388 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-10-05T21:12:21.392 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-10-05T21:12:21.508 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-10-05T21:12:21.684 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1278.g487ffcb5. 1/1 2023-10-05T21:12:22.101 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1278.g487ffcb5. 1/1 2023-10-05T21:12:22.711 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1278.g487ffcb5. 1/1 2023-10-05T21:12:22.777 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:12:22.777 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-10-05T21:12:22.777 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-immutable-object-cache-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:12:22.778 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:12:22.778 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-10-05T21:12:22.912 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-mgr 2023-10-05T21:12:23.773 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:28:28 ago on Thu 05 Oct 2023 08:43:55 PM UTC. 2023-10-05T21:12:25.167 INFO:teuthology.orchestra.run.smithi111.stdout:Package ceph-mgr-2:17.2.6-1278.g487ffcb5.el8.x86_64 is already installed. 2023-10-05T21:12:25.353 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-10-05T21:12:25.354 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2023-10-05T21:12:25.354 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-10-05T21:12:25.448 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-mgr-dashboard 2023-10-05T21:12:26.299 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:28:31 ago on Thu 05 Oct 2023 08:43:55 PM UTC. 2023-10-05T21:12:27.866 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-10-05T21:12:27.866 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:12:27.866 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2023-10-05T21:12:27.866 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:12:27.867 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-10-05T21:12:27.867 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1278.g487ffcb5.el8 ceph-noarch 1.7 M 2023-10-05T21:12:27.867 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2023-10-05T21:12:27.867 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1278.g487ffcb5.el8 ceph-noarch 23 k 2023-10-05T21:12:27.867 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1278.g487ffcb5.el8 ceph-noarch 14 k 2023-10-05T21:12:27.867 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-10-05T21:12:27.867 INFO:teuthology.orchestra.run.smithi111.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-05T21:12:27.867 INFO:teuthology.orchestra.run.smithi111.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-05T21:12:27.867 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:12:27.867 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-10-05T21:12:27.867 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:12:27.868 INFO:teuthology.orchestra.run.smithi111.stdout:Install 6 Packages 2023-10-05T21:12:27.868 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:12:27.868 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 2.0 M 2023-10-05T21:12:27.868 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 8.0 M 2023-10-05T21:12:27.868 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-10-05T21:12:28.234 INFO:teuthology.orchestra.run.smithi111.stdout:(1/6): ceph-prometheus-alerts-17.2.6-1278.g487f 102 kB/s | 14 kB 00:00 2023-10-05T21:12:28.259 INFO:teuthology.orchestra.run.smithi111.stdout:(2/6): ceph-grafana-dashboards-17.2.6-1278.g487 138 kB/s | 23 kB 00:00 2023-10-05T21:12:28.318 INFO:teuthology.orchestra.run.smithi111.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 510 kB/s | 43 kB 00:00 2023-10-05T21:12:28.427 INFO:teuthology.orchestra.run.smithi111.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 201 kB/s | 34 kB 00:00 2023-10-05T21:12:28.535 INFO:teuthology.orchestra.run.smithi111.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 906 kB/s | 196 kB 00:00 2023-10-05T21:12:28.769 INFO:teuthology.orchestra.run.smithi111.stdout:(6/6): ceph-mgr-dashboard-17.2.6-1278.g487ffcb5 2.5 MB/s | 1.7 MB 00:00 2023-10-05T21:12:28.773 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-10-05T21:12:28.773 INFO:teuthology.orchestra.run.smithi111.stdout:Total 2.2 MB/s | 2.0 MB 00:00 2023-10-05T21:12:28.781 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-10-05T21:12:28.790 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-10-05T21:12:28.790 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-10-05T21:12:28.865 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-10-05T21:12:28.868 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-10-05T21:12:29.128 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-10-05T21:12:29.313 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-10-05T21:12:29.541 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-10-05T21:12:29.710 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-10-05T21:12:29.847 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1278.g487ffcb5.el8.n 4/6 2023-10-05T21:12:30.176 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1278.g487ffcb5.el8. 5/6 2023-10-05T21:12:30.372 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1278.g487ffcb5.el8.noarc 6/6 2023-10-05T21:12:30.657 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1278.g487ffcb5.el8.noarc 6/6 2023-10-05T21:12:30.657 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1278.g487ffcb5.el8. 1/6 2023-10-05T21:12:30.657 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1278.g487ffcb5.el8.noarc 2/6 2023-10-05T21:12:30.657 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1278.g487ffcb5.el8.n 3/6 2023-10-05T21:12:30.658 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-10-05T21:12:30.658 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-10-05T21:12:31.287 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-10-05T21:12:31.287 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:12:31.288 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-10-05T21:12:31.288 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-grafana-dashboards-2:17.2.6-1278.g487ffcb5.el8.noarch 2023-10-05T21:12:31.288 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-dashboard-2:17.2.6-1278.g487ffcb5.el8.noarch 2023-10-05T21:12:31.288 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-prometheus-alerts-2:17.2.6-1278.g487ffcb5.el8.noarch 2023-10-05T21:12:31.288 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-05T21:12:31.288 INFO:teuthology.orchestra.run.smithi111.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-05T21:12:31.288 INFO:teuthology.orchestra.run.smithi111.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-05T21:12:31.288 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:12:31.288 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-10-05T21:12:31.397 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-mgr-diskprediction-local 2023-10-05T21:12:32.242 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:28:37 ago on Thu 05 Oct 2023 08:43:55 PM UTC. 2023-10-05T21:12:33.825 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-10-05T21:12:33.826 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================================ 2023-10-05T21:12:33.826 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2023-10-05T21:12:33.827 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================================ 2023-10-05T21:12:33.827 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-10-05T21:12:33.827 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1278.g487ffcb5.el8 ceph-noarch 7.4 M 2023-10-05T21:12:33.827 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2023-10-05T21:12:33.827 INFO:teuthology.orchestra.run.smithi111.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-10-05T21:12:33.827 INFO:teuthology.orchestra.run.smithi111.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-10-05T21:12:33.827 INFO:teuthology.orchestra.run.smithi111.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-10-05T21:12:33.827 INFO:teuthology.orchestra.run.smithi111.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-10-05T21:12:33.827 INFO:teuthology.orchestra.run.smithi111.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-10-05T21:12:33.828 INFO:teuthology.orchestra.run.smithi111.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-10-05T21:12:33.828 INFO:teuthology.orchestra.run.smithi111.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-10-05T21:12:33.828 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:12:33.828 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-10-05T21:12:33.828 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================================ 2023-10-05T21:12:33.828 INFO:teuthology.orchestra.run.smithi111.stdout:Install 8 Packages 2023-10-05T21:12:33.828 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:12:33.829 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 35 M 2023-10-05T21:12:33.829 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 210 M 2023-10-05T21:12:33.829 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-10-05T21:12:34.892 INFO:teuthology.orchestra.run.smithi111.stdout:(1/8): ceph-mgr-diskprediction-local-17.2.6-127 7.5 MB/s | 7.4 MB 00:00 2023-10-05T21:12:40.302 INFO:teuthology.orchestra.run.smithi111.stdout:(2/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 706 kB/s | 3.7 MB 00:05 2023-10-05T21:12:40.502 INFO:teuthology.orchestra.run.smithi111.stdout:(3/8): openblas-0.3.15-4.el8.x86_64.rpm 734 kB/s | 4.7 MB 00:06 2023-10-05T21:12:40.652 INFO:teuthology.orchestra.run.smithi111.stdout:(4/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 643 kB/s | 225 kB 00:00 2023-10-05T21:12:40.744 INFO:teuthology.orchestra.run.smithi111.stdout:(5/8): libgfortran-8.5.0-20.el8.x86_64.rpm 6.9 MB/s | 645 kB 00:00 2023-10-05T21:12:40.778 INFO:teuthology.orchestra.run.smithi111.stdout:(6/8): libquadmath-8.5.0-20.el8.x86_64.rpm 5.1 MB/s | 172 kB 00:00 2023-10-05T21:12:41.319 INFO:teuthology.orchestra.run.smithi111.stdout:(7/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 671 kB/s | 4.9 MB 00:07 2023-10-05T21:12:50.044 INFO:teuthology.orchestra.run.smithi111.stdout:(8/8): python3-scipy-1.0.0-21.module_el8.5.0+77 1.4 MB/s | 14 MB 00:09 2023-10-05T21:12:50.045 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-10-05T21:12:50.045 INFO:teuthology.orchestra.run.smithi111.stdout:Total 2.2 MB/s | 35 MB 00:16 2023-10-05T21:12:50.281 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-10-05T21:12:50.299 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-10-05T21:12:50.299 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-10-05T21:12:50.691 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-10-05T21:12:50.694 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-10-05T21:12:51.238 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-10-05T21:12:51.404 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 1/8 2023-10-05T21:12:51.542 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 1/8 2023-10-05T21:12:51.695 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 2/8 2023-10-05T21:12:52.292 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 2/8 2023-10-05T21:12:52.496 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-10-05T21:12:53.111 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-10-05T21:12:53.286 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-10-05T21:12:53.996 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-10-05T21:12:54.341 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-10-05T21:12:54.578 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-10-05T21:12:56.358 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-10-05T21:12:58.847 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-10-05T21:12:58.847 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1278.g487ffcb 8/8 2023-10-05T21:12:58.847 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1278.g487ffcb 8/8 2023-10-05T21:12:58.847 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1278.g487ffcb 1/8 2023-10-05T21:12:58.848 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-10-05T21:12:58.848 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-10-05T21:12:58.848 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-10-05T21:12:58.848 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-10-05T21:12:58.848 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-10-05T21:12:58.848 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 7/8 2023-10-05T21:12:58.849 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 8/8 2023-10-05T21:12:58.849 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:12:58.849 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-10-05T21:12:58.849 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1278.g487ffcb5.el8.noarch 2023-10-05T21:12:58.849 INFO:teuthology.orchestra.run.smithi111.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-10-05T21:12:58.850 INFO:teuthology.orchestra.run.smithi111.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-10-05T21:12:58.850 INFO:teuthology.orchestra.run.smithi111.stdout: openblas-0.3.15-4.el8.x86_64 2023-10-05T21:12:58.850 INFO:teuthology.orchestra.run.smithi111.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-10-05T21:12:58.850 INFO:teuthology.orchestra.run.smithi111.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-05T21:12:58.850 INFO:teuthology.orchestra.run.smithi111.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-05T21:12:58.851 INFO:teuthology.orchestra.run.smithi111.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-10-05T21:12:58.851 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:12:58.851 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-10-05T21:12:58.853 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-mgr-rook 2023-10-05T21:12:59.704 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:29:04 ago on Thu 05 Oct 2023 08:43:55 PM UTC. 2023-10-05T21:13:01.293 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-10-05T21:13:01.295 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:13:01.295 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2023-10-05T21:13:01.295 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:13:01.295 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-10-05T21:13:01.295 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-rook noarch 2:17.2.6-1278.g487ffcb5.el8 ceph-noarch 47 k 2023-10-05T21:13:01.295 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2023-10-05T21:13:01.295 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-05T21:13:01.296 INFO:teuthology.orchestra.run.smithi111.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-05T21:13:01.296 INFO:teuthology.orchestra.run.smithi111.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-05T21:13:01.296 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-10-05T21:13:01.296 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-10-05T21:13:01.296 INFO:teuthology.orchestra.run.smithi111.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-05T21:13:01.296 INFO:teuthology.orchestra.run.smithi111.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-10-05T21:13:01.296 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-10-05T21:13:01.296 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-10-05T21:13:01.296 INFO:teuthology.orchestra.run.smithi111.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-10-05T21:13:01.296 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-05T21:13:01.296 INFO:teuthology.orchestra.run.smithi111.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-05T21:13:01.297 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:13:01.297 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-10-05T21:13:01.297 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:13:01.297 INFO:teuthology.orchestra.run.smithi111.stdout:Install 13 Packages 2023-10-05T21:13:01.297 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:13:01.297 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 1.9 M 2023-10-05T21:13:01.297 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 25 M 2023-10-05T21:13:01.298 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-10-05T21:13:02.040 INFO:teuthology.orchestra.run.smithi111.stdout:(1/13): ceph-mgr-rook-17.2.6-1278.g487ffcb5.el8 297 kB/s | 47 kB 00:00 2023-10-05T21:13:02.099 INFO:teuthology.orchestra.run.smithi111.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 92 kB/s | 20 kB 00:00 2023-10-05T21:13:02.124 INFO:teuthology.orchestra.run.smithi111.stdout:(3/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 109 kB/s | 27 kB 00:00 2023-10-05T21:13:02.191 INFO:teuthology.orchestra.run.smithi111.stdout:(4/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 2.3 MB/s | 155 kB 00:00 2023-10-05T21:13:02.225 INFO:teuthology.orchestra.run.smithi111.stdout:(5/13): python3-requests-oauthlib-1.0.0-1.el8.n 1.2 MB/s | 43 kB 00:00 2023-10-05T21:13:02.283 INFO:teuthology.orchestra.run.smithi111.stdout:(6/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 521 kB/s | 126 kB 00:00 2023-10-05T21:13:02.325 INFO:teuthology.orchestra.run.smithi111.stdout:(7/13): python3-pyasn1-modules-0.3.7-6.el8.noar 486 kB/s | 110 kB 00:00 2023-10-05T21:13:02.392 INFO:teuthology.orchestra.run.smithi111.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 197 kB/s | 33 kB 00:00 2023-10-05T21:13:02.418 INFO:teuthology.orchestra.run.smithi111.stdout:(9/13): python3-certifi-2018.10.15-7.el8.noarch 122 kB/s | 16 kB 00:00 2023-10-05T21:13:02.518 INFO:teuthology.orchestra.run.smithi111.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 423 kB/s | 81 kB 00:00 2023-10-05T21:13:02.543 INFO:teuthology.orchestra.run.smithi111.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 513 kB/s | 64 kB 00:00 2023-10-05T21:13:02.602 INFO:teuthology.orchestra.run.smithi111.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 735 kB/s | 61 kB 00:00 2023-10-05T21:13:02.669 INFO:teuthology.orchestra.run.smithi111.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 4.2 MB/s | 1.2 MB 00:00 2023-10-05T21:13:02.669 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-10-05T21:13:02.669 INFO:teuthology.orchestra.run.smithi111.stdout:Total 1.4 MB/s | 1.9 MB 00:01 2023-10-05T21:13:02.730 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-10-05T21:13:02.746 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-10-05T21:13:02.746 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-10-05T21:13:02.831 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-10-05T21:13:02.834 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-10-05T21:13:03.316 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-10-05T21:13:03.732 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-10-05T21:13:03.919 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-10-05T21:13:04.137 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2023-10-05T21:13:04.359 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-10-05T21:13:04.533 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-10-05T21:13:04.772 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-10-05T21:13:05.057 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-10-05T21:13:05.298 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-10-05T21:13:06.516 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-10-05T21:13:06.583 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-10-05T21:13:06.774 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-10-05T21:13:06.968 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-10-05T21:13:07.134 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-rook-2:17.2.6-1278.g487ffcb5.el8.noarch 13/13 2023-10-05T21:13:07.422 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1278.g487ffcb5.el8.noarch 13/13 2023-10-05T21:13:07.422 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1278.g487ffcb5.el8.noarch 1/13 2023-10-05T21:13:07.423 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-10-05T21:13:07.423 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-10-05T21:13:07.423 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-10-05T21:13:07.423 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-10-05T21:13:07.423 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-10-05T21:13:07.423 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-10-05T21:13:07.423 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-10-05T21:13:07.423 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-10-05T21:13:07.423 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-10-05T21:13:07.423 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-10-05T21:13:07.423 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2023-10-05T21:13:08.109 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-10-05T21:13:08.110 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:13:08.110 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-10-05T21:13:08.110 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-rook-2:17.2.6-1278.g487ffcb5.el8.noarch 2023-10-05T21:13:08.110 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-05T21:13:08.110 INFO:teuthology.orchestra.run.smithi111.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-05T21:13:08.110 INFO:teuthology.orchestra.run.smithi111.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-05T21:13:08.110 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-05T21:13:08.110 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-05T21:13:08.110 INFO:teuthology.orchestra.run.smithi111.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-05T21:13:08.110 INFO:teuthology.orchestra.run.smithi111.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-05T21:13:08.111 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-05T21:13:08.111 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-05T21:13:08.111 INFO:teuthology.orchestra.run.smithi111.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-05T21:13:08.111 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-05T21:13:08.111 INFO:teuthology.orchestra.run.smithi111.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-05T21:13:08.111 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:13:08.111 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-10-05T21:13:08.223 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-mgr-cephadm 2023-10-05T21:13:09.078 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:29:14 ago on Thu 05 Oct 2023 08:43:55 PM UTC. 2023-10-05T21:13:10.661 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-10-05T21:13:10.662 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:13:10.662 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2023-10-05T21:13:10.662 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:13:10.662 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-10-05T21:13:10.663 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1278.g487ffcb5.el8 ceph-noarch 121 k 2023-10-05T21:13:10.663 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2023-10-05T21:13:10.663 INFO:teuthology.orchestra.run.smithi111.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-05T21:13:10.663 INFO:teuthology.orchestra.run.smithi111.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-10-05T21:13:10.663 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-10-05T21:13:10.663 INFO:teuthology.orchestra.run.smithi111.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-05T21:13:10.663 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:13:10.663 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-10-05T21:13:10.663 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:13:10.663 INFO:teuthology.orchestra.run.smithi111.stdout:Install 5 Packages 2023-10-05T21:13:10.663 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:13:10.664 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 6.0 M 2023-10-05T21:13:10.664 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 26 M 2023-10-05T21:13:10.664 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-10-05T21:13:12.551 INFO:teuthology.orchestra.run.smithi111.stdout:(1/5): ceph-mgr-cephadm-17.2.6-1278.g487ffcb5.e 585 kB/s | 121 kB 00:00 2023-10-05T21:13:13.001 INFO:teuthology.orchestra.run.smithi111.stdout:(2/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 1.0 MB/s | 476 kB 00:00 2023-10-05T21:13:13.078 INFO:teuthology.orchestra.run.smithi111.stdout:(3/5): python3-natsort-7.1.1-2.el8.noarch.rpm 783 kB/s | 60 kB 00:00 2023-10-05T21:13:14.503 INFO:teuthology.orchestra.run.smithi111.stdout:(4/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 249 kB/s | 538 kB 00:02 2023-10-05T21:13:27.238 INFO:teuthology.orchestra.run.smithi111.stdout:(5/5): python3-babel-2.5.1-7.el8.noarch.rpm 329 kB/s | 4.8 MB 00:14 2023-10-05T21:13:27.324 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-10-05T21:13:27.324 INFO:teuthology.orchestra.run.smithi111.stdout:Total 368 kB/s | 6.0 MB 00:16 2023-10-05T21:13:27.324 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-10-05T21:13:27.324 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-10-05T21:13:27.324 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-10-05T21:13:27.406 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-10-05T21:13:27.409 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-10-05T21:13:27.706 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-10-05T21:13:28.012 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-10-05T21:13:28.962 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-10-05T21:13:29.310 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-10-05T21:13:29.566 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-10-05T21:13:29.740 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1278.g487ffcb5.el8.noarch 5/5 2023-10-05T21:13:30.007 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1278.g487ffcb5.el8.noarch 5/5 2023-10-05T21:13:30.008 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1278.g487ffcb5.el8.noarch 1/5 2023-10-05T21:13:30.008 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-10-05T21:13:30.008 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-10-05T21:13:30.008 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-10-05T21:13:30.632 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-10-05T21:13:30.633 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:13:30.633 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-10-05T21:13:30.633 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-cephadm-2:17.2.6-1278.g487ffcb5.el8.noarch 2023-10-05T21:13:30.633 INFO:teuthology.orchestra.run.smithi111.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-05T21:13:30.633 INFO:teuthology.orchestra.run.smithi111.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-05T21:13:30.633 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-05T21:13:30.633 INFO:teuthology.orchestra.run.smithi111.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-05T21:13:30.633 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:13:30.633 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-10-05T21:13:31.399 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-fuse 2023-10-05T21:13:32.250 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:29:37 ago on Thu 05 Oct 2023 08:43:55 PM UTC. 2023-10-05T21:13:33.841 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-10-05T21:13:33.842 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:13:33.842 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2023-10-05T21:13:33.842 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:13:33.842 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-10-05T21:13:33.842 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-fuse x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 876 k 2023-10-05T21:13:33.842 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2023-10-05T21:13:33.843 INFO:teuthology.orchestra.run.smithi111.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-10-05T21:13:33.843 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:13:33.843 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-10-05T21:13:33.843 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:13:33.843 INFO:teuthology.orchestra.run.smithi111.stdout:Install 2 Packages 2023-10-05T21:13:33.843 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:13:33.844 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 959 k 2023-10-05T21:13:33.844 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 3.0 M 2023-10-05T21:13:33.844 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-10-05T21:13:34.121 INFO:teuthology.orchestra.run.smithi111.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2023-10-05T21:13:34.588 INFO:teuthology.orchestra.run.smithi111.stdout:(2/2): ceph-fuse-17.2.6-1278.g487ffcb5.el8.x86_ 1.6 MB/s | 876 kB 00:00 2023-10-05T21:13:34.588 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-10-05T21:13:34.589 INFO:teuthology.orchestra.run.smithi111.stdout:Total 1.3 MB/s | 959 kB 00:00 2023-10-05T21:13:34.600 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-10-05T21:13:34.621 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-10-05T21:13:34.622 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-10-05T21:13:34.709 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-10-05T21:13:34.712 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-10-05T21:13:34.882 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-10-05T21:13:35.131 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-10-05T21:13:35.330 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-fuse-2:17.2.6-1278.g487ffcb5.el8.x86_64 2/2 2023-10-05T21:13:35.722 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-fuse-2:17.2.6-1278.g487ffcb5.el8.x86_64 2/2 2023-10-05T21:13:35.722 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-fuse-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/2 2023-10-05T21:13:36.326 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-10-05T21:13:36.326 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:13:36.326 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-10-05T21:13:36.327 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-fuse-2:17.2.6-1278.g487ffcb5.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-10-05T21:13:36.327 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:13:36.327 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-10-05T21:13:36.529 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-volume 2023-10-05T21:13:37.394 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:29:42 ago on Thu 05 Oct 2023 08:43:55 PM UTC. 2023-10-05T21:13:38.975 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-10-05T21:13:38.975 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:13:38.975 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2023-10-05T21:13:38.975 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:13:38.975 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-10-05T21:13:38.975 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-volume noarch 2:17.2.6-1278.g487ffcb5.el8 ceph-noarch 267 k 2023-10-05T21:13:38.976 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:13:38.976 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-10-05T21:13:38.976 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:13:38.976 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2023-10-05T21:13:38.976 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:13:38.976 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 267 k 2023-10-05T21:13:38.976 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 1.3 M 2023-10-05T21:13:38.977 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-10-05T21:13:39.553 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-volume-17.2.6-1278.g487ffcb5.el8.noarch.rp 463 kB/s | 267 kB 00:00 2023-10-05T21:13:39.554 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-10-05T21:13:39.554 INFO:teuthology.orchestra.run.smithi111.stdout:Total 462 kB/s | 267 kB 00:00 2023-10-05T21:13:39.555 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-10-05T21:13:39.565 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-10-05T21:13:39.565 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-10-05T21:13:39.606 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-10-05T21:13:39.609 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-10-05T21:13:39.795 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-10-05T21:13:40.038 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-volume-2:17.2.6-1278.g487ffcb5.el8.noarch 1/1 2023-10-05T21:13:40.428 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-volume-2:17.2.6-1278.g487ffcb5.el8.noarch 1/1 2023-10-05T21:13:41.049 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-volume-2:17.2.6-1278.g487ffcb5.el8.noarch 1/1 2023-10-05T21:13:41.049 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:13:41.049 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-10-05T21:13:41.049 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-volume-2:17.2.6-1278.g487ffcb5.el8.noarch 2023-10-05T21:13:41.049 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:13:41.049 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-10-05T21:13:41.259 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install librados-devel 2023-10-05T21:13:42.117 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:29:47 ago on Thu 05 Oct 2023 08:43:55 PM UTC. 2023-10-05T21:13:43.698 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-10-05T21:13:43.699 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:13:43.699 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repo Size 2023-10-05T21:13:43.699 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:13:43.699 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-10-05T21:13:43.699 INFO:teuthology.orchestra.run.smithi111.stdout: librados-devel x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 130 k 2023-10-05T21:13:43.699 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:13:43.699 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-10-05T21:13:43.700 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:13:43.700 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2023-10-05T21:13:43.700 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:13:43.700 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 130 k 2023-10-05T21:13:43.700 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 464 k 2023-10-05T21:13:43.700 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-10-05T21:13:43.890 INFO:teuthology.orchestra.run.smithi111.stdout:librados-devel-17.2.6-1278.g487ffcb5.el8.x86_64 682 kB/s | 130 kB 00:00 2023-10-05T21:13:43.891 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-10-05T21:13:43.891 INFO:teuthology.orchestra.run.smithi111.stdout:Total 678 kB/s | 130 kB 00:00 2023-10-05T21:13:43.891 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-10-05T21:13:43.897 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-10-05T21:13:43.897 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-10-05T21:13:43.946 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-10-05T21:13:43.949 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-10-05T21:13:44.055 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-10-05T21:13:44.303 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : librados-devel-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/1 2023-10-05T21:13:44.593 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librados-devel-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/1 2023-10-05T21:13:45.222 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librados-devel-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/1 2023-10-05T21:13:45.222 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:13:45.222 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-10-05T21:13:45.222 INFO:teuthology.orchestra.run.smithi111.stdout: librados-devel-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:13:45.222 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:13:45.223 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-10-05T21:13:45.435 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install libcephfs2 2023-10-05T21:13:46.298 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:29:51 ago on Thu 05 Oct 2023 08:43:55 PM UTC. 2023-10-05T21:13:47.688 INFO:teuthology.orchestra.run.smithi111.stdout:Package libcephfs2-2:17.2.6-1278.g487ffcb5.el8.x86_64 is already installed. 2023-10-05T21:13:47.876 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-10-05T21:13:47.877 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2023-10-05T21:13:47.877 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-10-05T21:13:47.969 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install libcephfs-devel 2023-10-05T21:13:48.824 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:29:53 ago on Thu 05 Oct 2023 08:43:55 PM UTC. 2023-10-05T21:13:50.408 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-10-05T21:13:50.409 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:13:50.409 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repo Size 2023-10-05T21:13:50.409 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:13:50.410 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-10-05T21:13:50.410 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs-devel x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 25 k 2023-10-05T21:13:50.410 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:13:50.410 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-10-05T21:13:50.410 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:13:50.410 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2023-10-05T21:13:50.410 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:13:50.410 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 25 k 2023-10-05T21:13:50.410 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 109 k 2023-10-05T21:13:50.410 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-10-05T21:13:50.560 INFO:teuthology.orchestra.run.smithi111.stdout:libcephfs-devel-17.2.6-1278.g487ffcb5.el8.x86_6 166 kB/s | 25 kB 00:00 2023-10-05T21:13:50.561 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-10-05T21:13:50.561 INFO:teuthology.orchestra.run.smithi111.stdout:Total 164 kB/s | 25 kB 00:00 2023-10-05T21:13:50.561 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-10-05T21:13:50.565 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-10-05T21:13:50.565 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-10-05T21:13:50.566 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-10-05T21:13:50.569 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-10-05T21:13:50.622 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-10-05T21:13:50.878 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libcephfs-devel-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/1 2023-10-05T21:13:51.137 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libcephfs-devel-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/1 2023-10-05T21:13:51.715 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libcephfs-devel-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/1 2023-10-05T21:13:51.716 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:13:51.716 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-10-05T21:13:51.716 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs-devel-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:13:51.716 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:13:51.716 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-10-05T21:13:51.822 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install librados2 2023-10-05T21:13:52.675 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:29:57 ago on Thu 05 Oct 2023 08:43:55 PM UTC. 2023-10-05T21:13:54.080 INFO:teuthology.orchestra.run.smithi111.stdout:Package librados2-2:17.2.6-1278.g487ffcb5.el8.x86_64 is already installed. 2023-10-05T21:13:54.267 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-10-05T21:13:54.268 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2023-10-05T21:13:54.269 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-10-05T21:13:54.364 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install librbd1 2023-10-05T21:13:55.222 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:30:00 ago on Thu 05 Oct 2023 08:43:55 PM UTC. 2023-10-05T21:13:56.594 INFO:teuthology.orchestra.run.smithi111.stdout:Package librbd1-2:17.2.6-1278.g487ffcb5.el8.x86_64 is already installed. 2023-10-05T21:13:56.782 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-10-05T21:13:56.783 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2023-10-05T21:13:56.783 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-10-05T21:13:56.876 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install python3-rados 2023-10-05T21:13:57.735 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:30:02 ago on Thu 05 Oct 2023 08:43:55 PM UTC. 2023-10-05T21:13:59.124 INFO:teuthology.orchestra.run.smithi111.stdout:Package python3-rados-2:17.2.6-1278.g487ffcb5.el8.x86_64 is already installed. 2023-10-05T21:13:59.313 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-10-05T21:13:59.314 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2023-10-05T21:13:59.314 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-10-05T21:13:59.415 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install python3-rgw 2023-10-05T21:14:00.271 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:30:05 ago on Thu 05 Oct 2023 08:43:55 PM UTC. 2023-10-05T21:14:01.644 INFO:teuthology.orchestra.run.smithi111.stdout:Package python3-rgw-2:17.2.6-1278.g487ffcb5.el8.x86_64 is already installed. 2023-10-05T21:14:06.020 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-10-05T21:14:06.024 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2023-10-05T21:14:06.024 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-10-05T21:14:06.024 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install python3-cephfs 2023-10-05T21:14:06.893 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:30:11 ago on Thu 05 Oct 2023 08:43:55 PM UTC. 2023-10-05T21:14:08.290 INFO:teuthology.orchestra.run.smithi111.stdout:Package python3-cephfs-2:17.2.6-1278.g487ffcb5.el8.x86_64 is already installed. 2023-10-05T21:14:08.477 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-10-05T21:14:08.478 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2023-10-05T21:14:08.478 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-10-05T21:14:08.564 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install python3-rbd 2023-10-05T21:14:09.421 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:30:14 ago on Thu 05 Oct 2023 08:43:55 PM UTC. 2023-10-05T21:14:10.825 INFO:teuthology.orchestra.run.smithi111.stdout:Package python3-rbd-2:17.2.6-1278.g487ffcb5.el8.x86_64 is already installed. 2023-10-05T21:14:11.014 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-10-05T21:14:11.015 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2023-10-05T21:14:11.015 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-10-05T21:14:11.114 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install rbd-fuse 2023-10-05T21:14:11.971 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:30:16 ago on Thu 05 Oct 2023 08:43:55 PM UTC. 2023-10-05T21:14:13.555 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-10-05T21:14:13.556 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:14:13.556 INFO:teuthology.orchestra.run.smithi111.stdout: Package Architecture Version Repository Size 2023-10-05T21:14:13.556 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:14:13.556 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-10-05T21:14:13.556 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-fuse x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 90 k 2023-10-05T21:14:13.556 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:13.556 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-10-05T21:14:13.556 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:14:13.556 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2023-10-05T21:14:13.557 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:13.557 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 90 k 2023-10-05T21:14:13.557 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 264 k 2023-10-05T21:14:13.557 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-10-05T21:14:13.947 INFO:teuthology.orchestra.run.smithi111.stdout:rbd-fuse-17.2.6-1278.g487ffcb5.el8.x86_64.rpm 232 kB/s | 90 kB 00:00 2023-10-05T21:14:13.947 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-10-05T21:14:13.947 INFO:teuthology.orchestra.run.smithi111.stdout:Total 231 kB/s | 90 kB 00:00 2023-10-05T21:14:13.948 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-10-05T21:14:13.957 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-10-05T21:14:13.957 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-10-05T21:14:14.005 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-10-05T21:14:14.008 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-10-05T21:14:14.112 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-10-05T21:14:14.323 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : rbd-fuse-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/1 2023-10-05T21:14:14.612 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: rbd-fuse-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/1 2023-10-05T21:14:15.215 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : rbd-fuse-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/1 2023-10-05T21:14:15.215 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:15.215 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-10-05T21:14:15.215 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-fuse-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:14:15.215 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:15.215 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-10-05T21:14:15.446 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install rbd-mirror 2023-10-05T21:14:16.300 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:30:21 ago on Thu 05 Oct 2023 08:43:55 PM UTC. 2023-10-05T21:14:17.881 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-10-05T21:14:17.882 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:14:17.882 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repo Size 2023-10-05T21:14:17.882 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:14:17.882 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-10-05T21:14:17.882 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-mirror x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 3.5 M 2023-10-05T21:14:17.882 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:17.882 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-10-05T21:14:17.882 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:14:17.882 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2023-10-05T21:14:17.883 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:17.883 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 3.5 M 2023-10-05T21:14:17.883 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 16 M 2023-10-05T21:14:17.883 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-10-05T21:14:18.249 INFO:teuthology.orchestra.run.smithi111.stdout:rbd-mirror-17.2.6-1278.g487ffcb5.el8.x86_64.rpm 9.4 MB/s | 3.5 MB 00:00 2023-10-05T21:14:18.250 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-10-05T21:14:18.250 INFO:teuthology.orchestra.run.smithi111.stdout:Total 9.4 MB/s | 3.5 MB 00:00 2023-10-05T21:14:18.251 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-10-05T21:14:18.262 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-10-05T21:14:18.262 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-10-05T21:14:18.325 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-10-05T21:14:18.328 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-10-05T21:14:18.761 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-10-05T21:14:18.957 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : rbd-mirror-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/1 2023-10-05T21:14:19.361 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/1 2023-10-05T21:14:19.960 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : rbd-mirror-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/1 2023-10-05T21:14:19.960 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:19.960 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-10-05T21:14:19.960 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-mirror-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:14:19.960 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:19.960 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-10-05T21:14:20.137 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install rbd-nbd 2023-10-05T21:14:20.998 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:30:25 ago on Thu 05 Oct 2023 08:43:55 PM UTC. 2023-10-05T21:14:22.588 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-10-05T21:14:22.589 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:14:22.589 INFO:teuthology.orchestra.run.smithi111.stdout: Package Architecture Version Repository Size 2023-10-05T21:14:22.589 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:14:22.589 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-10-05T21:14:22.590 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-nbd x86_64 2:17.2.6-1278.g487ffcb5.el8 ceph 173 k 2023-10-05T21:14:22.590 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:22.590 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-10-05T21:14:22.590 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-10-05T21:14:22.590 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2023-10-05T21:14:22.590 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:22.591 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 173 k 2023-10-05T21:14:22.591 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 552 k 2023-10-05T21:14:22.591 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-10-05T21:14:23.110 INFO:teuthology.orchestra.run.smithi111.stdout:rbd-nbd-17.2.6-1278.g487ffcb5.el8.x86_64.rpm 333 kB/s | 173 kB 00:00 2023-10-05T21:14:23.111 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-10-05T21:14:23.111 INFO:teuthology.orchestra.run.smithi111.stdout:Total 332 kB/s | 173 kB 00:00 2023-10-05T21:14:23.111 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-10-05T21:14:23.122 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-10-05T21:14:23.122 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-10-05T21:14:23.175 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-10-05T21:14:23.178 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-10-05T21:14:23.294 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-10-05T21:14:23.480 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : rbd-nbd-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/1 2023-10-05T21:14:23.772 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: rbd-nbd-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/1 2023-10-05T21:14:24.388 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : rbd-nbd-2:17.2.6-1278.g487ffcb5.el8.x86_64 1/1 2023-10-05T21:14:24.388 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:24.388 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-10-05T21:14:24.388 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-nbd-2:17.2.6-1278.g487ffcb5.el8.x86_64 2023-10-05T21:14:24.389 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:24.389 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-10-05T21:14:24.578 DEBUG:teuthology.parallel:result is None 2023-10-05T21:14:25.407 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=487ffcb5ddb60d29c5688d1a457e812b1b697b90 2023-10-05T21:14:25.550 DEBUG:teuthology.orchestra.run.smithi111:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-05T21:14:25.592 INFO:teuthology.orchestra.run.smithi111.stdout:17.2.6-1278.g487ffcb5.el8 2023-10-05T21:14:25.593 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1278.g487ffcb5.el8 2023-10-05T21:14:25.593 INFO:teuthology.task.install:The correct ceph version 17.2.6-1278.g487ffcb5 is installed. 2023-10-05T21:14:25.593 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=487ffcb5ddb60d29c5688d1a457e812b1b697b90 2023-10-05T21:14:25.847 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-05T21:14:25.929 INFO:teuthology.orchestra.run.smithi153.stdout:17.2.6-1278.g487ffcb5.el8 2023-10-05T21:14:25.929 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1278.g487ffcb5.el8 2023-10-05T21:14:25.929 INFO:teuthology.task.install:The correct ceph version 17.2.6-1278.g487ffcb5 is installed. 2023-10-05T21:14:25.930 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-05T21:14:25.930 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2023-10-05T21:14:25.930 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-05T21:14:25.966 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-05T21:14:25.966 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-05T21:14:26.004 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-05T21:14:26.004 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2023-10-05T21:14:26.004 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/daemon-helper 2023-10-05T21:14:26.040 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-05T21:14:26.112 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-05T21:14:26.112 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/daemon-helper 2023-10-05T21:14:26.144 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-05T21:14:26.215 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-05T21:14:26.215 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2023-10-05T21:14:26.215 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-05T21:14:26.248 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-05T21:14:26.321 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-05T21:14:26.321 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-05T21:14:26.351 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-05T21:14:26.420 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-05T21:14:26.420 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2023-10-05T21:14:26.420 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/stdin-killer 2023-10-05T21:14:26.453 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-05T21:14:26.527 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-05T21:14:26.527 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/stdin-killer 2023-10-05T21:14:26.556 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-05T21:14:26.624 INFO:teuthology.run_tasks:Running task ceph... 2023-10-05T21:14:26.686 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-05T21:14:26.686 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 777 /var/log/ceph 2023-10-05T21:14:26.688 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 777 /var/log/ceph 2023-10-05T21:14:26.720 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-05T21:14:26.720 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-05T21:14:26.763 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-05T21:14:26.794 INFO:tasks.ceph:Creating extra log directories... 2023-10-05T21:14:26.795 DEBUG:teuthology.orchestra.run.smithi111:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-05T21:14:26.837 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-05T21:14:26.876 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-05T21:14:26.876 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'osd objectstore': 'filestore', 'osd sloppy crc': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-05T21:14:26.877 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7411776', 'branch': 'wip-yuri2-testing-2023-10-04-1333-quincy', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated supported-random-distro$/{centos_8}}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7411776', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri2-testing-2023-10-04-1333-quincy'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd objectstore': 'filestore', 'osd sloppy crc': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '487ffcb5ddb60d29c5688d1a457e812b1b697b90', 'wait-for-scrub': False}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'osd objectstore': 'filestore', 'osd sloppy crc': True}}, 'filestore': True, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '487ffcb5ddb60d29c5688d1a457e812b1b697b90'}}, 'rgw': {'ec-data-pool': False, 'frontend': 'beast'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'workunit': {'branch': 'wip-yuri2-testing-2023-10-04-1333-quincy', 'sha1': '487ffcb5ddb60d29c5688d1a457e812b1b697b90'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 880, 'sha1': '487ffcb5ddb60d29c5688d1a457e812b1b697b90', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'rgw', 'suite_branch': 'wip-yuri2-testing-2023-10-04-1333-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_487ffcb5ddb60d29c5688d1a457e812b1b697b90/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '487ffcb5ddb60d29c5688d1a457e812b1b697b90', 'targets': {'smithi111.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFSIcFshv4j1ZisScgQRwmHjhU0nXdvB6X/4EWZBJ63wYe5v1IAyIirqOYDuvoklUas+azYMSnGMNJJHRWBKnM0=', 'smithi153.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD0BPipO53WEzGHk5IOIh6A0KYrYFA87fnCNiqydHlHlKJmqH0xF8tus8gyFVv36MetERZX/Y4OIJm5+milrRSg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'osd objectstore': 'filestore', 'osd sloppy crc': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '487ffcb5ddb60d29c5688d1a457e812b1b697b90', 'wait-for-scrub': False, 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-05_14:30:58', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-05T21:14:26.877 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-05T21:14:26.911 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-05T21:14:26.930 DEBUG:teuthology.orchestra.run.smithi111:> sudo install -d -m0777 -- /var/run/ceph 2023-10-05T21:14:26.973 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/run/ceph 2023-10-05T21:14:27.004 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2023-10-05T21:14:27.004 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/scratch_devs of=/dev/stdout 2023-10-05T21:14:27.066 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-05T21:14:27.066 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_1 2023-10-05T21:14:27.127 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-05T21:14:27.127 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T21:14:27.128 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 6h/6d Inode: 394223 Links: 1 2023-10-05T21:14:27.128 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T21:14:27.128 INFO:teuthology.orchestra.run.smithi111.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T21:14:27.128 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2023-10-05 21:14:19.111383884 +0000 2023-10-05T21:14:27.128 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2023-10-05 20:16:17.300729676 +0000 2023-10-05T21:14:27.128 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2023-10-05 20:16:17.300729676 +0000 2023-10-05T21:14:27.128 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2023-10-05T21:14:27.128 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-05T21:14:27.199 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2023-10-05T21:14:27.199 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2023-10-05T21:14:27.199 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000247064 s, 2.1 MB/s 2023-10-05T21:14:27.200 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-05T21:14:27.263 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_2 2023-10-05T21:14:27.322 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-05T21:14:27.322 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T21:14:27.323 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 6h/6d Inode: 391657 Links: 1 2023-10-05T21:14:27.323 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T21:14:27.323 INFO:teuthology.orchestra.run.smithi111.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T21:14:27.323 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2023-10-05 21:14:19.111383884 +0000 2023-10-05T21:14:27.323 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2023-10-05 20:16:17.808720977 +0000 2023-10-05T21:14:27.323 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2023-10-05 20:16:17.808720977 +0000 2023-10-05T21:14:27.323 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2023-10-05T21:14:27.324 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-05T21:14:27.390 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2023-10-05T21:14:27.390 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2023-10-05T21:14:27.391 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000224558 s, 2.3 MB/s 2023-10-05T21:14:27.391 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-05T21:14:27.451 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_3 2023-10-05T21:14:27.509 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-05T21:14:27.510 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T21:14:27.510 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 6h/6d Inode: 394552 Links: 1 2023-10-05T21:14:27.510 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T21:14:27.510 INFO:teuthology.orchestra.run.smithi111.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T21:14:27.510 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2023-10-05 21:14:19.111383884 +0000 2023-10-05T21:14:27.510 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2023-10-05 20:16:18.302712518 +0000 2023-10-05T21:14:27.510 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2023-10-05 20:16:18.302712518 +0000 2023-10-05T21:14:27.510 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2023-10-05T21:14:27.510 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-05T21:14:27.576 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2023-10-05T21:14:27.576 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2023-10-05T21:14:27.576 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000232988 s, 2.2 MB/s 2023-10-05T21:14:27.577 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-05T21:14:27.636 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_4 2023-10-05T21:14:27.695 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-05T21:14:27.695 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T21:14:27.695 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 6h/6d Inode: 392601 Links: 1 2023-10-05T21:14:27.695 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T21:14:27.695 INFO:teuthology.orchestra.run.smithi111.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T21:14:27.695 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2023-10-05 21:14:19.111383884 +0000 2023-10-05T21:14:27.695 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2023-10-05 20:16:18.815703733 +0000 2023-10-05T21:14:27.695 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2023-10-05 20:16:18.815703733 +0000 2023-10-05T21:14:27.696 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2023-10-05T21:14:27.696 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-05T21:14:27.760 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2023-10-05T21:14:27.760 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2023-10-05T21:14:27.761 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000219029 s, 2.3 MB/s 2023-10-05T21:14:27.762 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-05T21:14:27.820 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2023-10-05T21:14:27.820 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-05T21:14:27.820 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/scratch_devs of=/dev/stdout 2023-10-05T21:14:27.840 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-05T21:14:27.841 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_1 2023-10-05T21:14:27.900 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-05T21:14:27.900 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T21:14:27.900 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 421450 Links: 1 2023-10-05T21:14:27.901 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T21:14:27.901 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T21:14:27.901 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2023-10-05 21:07:58.092830633 +0000 2023-10-05T21:14:27.901 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2023-10-05 20:21:08.670708213 +0000 2023-10-05T21:14:27.901 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2023-10-05 20:21:08.670708213 +0000 2023-10-05T21:14:27.901 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2023-10-05T21:14:27.903 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-05T21:14:27.968 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-10-05T21:14:27.968 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-10-05T21:14:27.968 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000237024 s, 2.2 MB/s 2023-10-05T21:14:27.970 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-05T21:14:28.030 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_2 2023-10-05T21:14:28.088 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-05T21:14:28.088 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T21:14:28.088 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 417491 Links: 1 2023-10-05T21:14:28.088 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T21:14:28.089 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T21:14:28.089 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2023-10-05 21:07:58.092830633 +0000 2023-10-05T21:14:28.089 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2023-10-05 20:21:09.178699325 +0000 2023-10-05T21:14:28.089 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2023-10-05 20:21:09.178699325 +0000 2023-10-05T21:14:28.089 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2023-10-05T21:14:28.089 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-05T21:14:28.154 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-10-05T21:14:28.155 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-10-05T21:14:28.155 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000215493 s, 2.4 MB/s 2023-10-05T21:14:28.156 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-05T21:14:28.215 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_3 2023-10-05T21:14:28.273 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-05T21:14:28.274 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T21:14:28.274 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 417641 Links: 1 2023-10-05T21:14:28.274 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T21:14:28.274 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T21:14:28.274 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2023-10-05 21:07:58.092830633 +0000 2023-10-05T21:14:28.274 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2023-10-05 20:21:09.690690367 +0000 2023-10-05T21:14:28.274 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2023-10-05 20:21:09.690690367 +0000 2023-10-05T21:14:28.274 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2023-10-05T21:14:28.275 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-05T21:14:28.340 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-10-05T21:14:28.340 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-10-05T21:14:28.340 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000260573 s, 2.0 MB/s 2023-10-05T21:14:28.341 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-05T21:14:28.400 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_4 2023-10-05T21:14:28.458 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-05T21:14:28.458 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T21:14:28.458 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 426325 Links: 1 2023-10-05T21:14:28.459 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T21:14:28.459 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T21:14:28.459 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2023-10-05 21:07:58.093830615 +0000 2023-10-05T21:14:28.459 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2023-10-05 20:21:10.199681462 +0000 2023-10-05T21:14:28.459 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2023-10-05 20:21:10.199681462 +0000 2023-10-05T21:14:28.459 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2023-10-05T21:14:28.459 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-05T21:14:28.524 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-10-05T21:14:28.525 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-10-05T21:14:28.525 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000207479 s, 2.5 MB/s 2023-10-05T21:14:28.526 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-05T21:14:28.585 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2023-10-05T21:14:28.585 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi111.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2023-10-05T21:14:28.585 INFO:tasks.ceph:Generating config... 2023-10-05T21:14:28.586 INFO:tasks.ceph:[client] debug ms = 1 2023-10-05T21:14:28.587 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2023-10-05T21:14:28.587 INFO:tasks.ceph:[client] debug rgw = 20 2023-10-05T21:14:28.587 INFO:tasks.ceph:[client] setgroup = ceph 2023-10-05T21:14:28.587 INFO:tasks.ceph:[client] setuser = ceph 2023-10-05T21:14:28.587 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-05T21:14:28.587 INFO:tasks.ceph:[osd] debug objclass = 20 2023-10-05T21:14:28.587 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-05T21:14:28.587 INFO:tasks.ceph:[osd] osd objectstore = filestore 2023-10-05T21:14:28.588 INFO:tasks.ceph:[osd] osd sloppy crc = True 2023-10-05T21:14:28.588 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-05T21:14:28.588 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-05T21:14:28.588 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-05T21:14:28.588 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-05T21:14:28.588 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-05T21:14:28.589 INFO:tasks.ceph:Setting up mon.a... 2023-10-05T21:14:28.589 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-05T21:14:28.643 INFO:teuthology.orchestra.run.smithi111.stdout:creating /etc/ceph/ceph.keyring 2023-10-05T21:14:28.645 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-05T21:14:28.687 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-05T21:14:28.754 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.111')] 2023-10-05T21:14:28.755 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.111'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'osd objectstore': 'filestore', 'osd sloppy crc': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2023-10-05T21:14:28.756 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2023-10-05T21:14:28.756 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-05T21:14:28.813 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.111 --print /home/ubuntu/cephtest/ceph.monmap 2023-10-05T21:14:28.892 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:14:28.892 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:14:28.893 INFO:teuthology.orchestra.run.smithi111.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-05T21:14:28.893 INFO:teuthology.orchestra.run.smithi111.stdout:monmaptool: generated fsid eafdd85a-3bd2-413c-acb4-cdb3a151d4a9 2023-10-05T21:14:28.893 INFO:teuthology.orchestra.run.smithi111.stdout:setting min_mon_release = octopus 2023-10-05T21:14:28.893 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 0 2023-10-05T21:14:28.893 INFO:teuthology.orchestra.run.smithi111.stdout:fsid eafdd85a-3bd2-413c-acb4-cdb3a151d4a9 2023-10-05T21:14:28.894 INFO:teuthology.orchestra.run.smithi111.stdout:last_changed 2023-10-05T21:14:28.892699+0000 2023-10-05T21:14:28.894 INFO:teuthology.orchestra.run.smithi111.stdout:created 2023-10-05T21:14:28.892699+0000 2023-10-05T21:14:28.894 INFO:teuthology.orchestra.run.smithi111.stdout:min_mon_release 15 (octopus) 2023-10-05T21:14:28.894 INFO:teuthology.orchestra.run.smithi111.stdout:election_strategy: 1 2023-10-05T21:14:28.894 INFO:teuthology.orchestra.run.smithi111.stdout:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2023-10-05T21:14:28.894 INFO:teuthology.orchestra.run.smithi111.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2023-10-05T21:14:28.895 DEBUG:teuthology.orchestra.run.smithi111:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-05T21:14:28.953 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID eafdd85a-3bd2-413c-acb4-cdb3a151d4a9... 2023-10-05T21:14:28.955 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-05T21:14:28.996 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-05T21:14:29.038 INFO:teuthology.orchestra.run.smithi111.stdout:[global] 2023-10-05T21:14:29.039 INFO:teuthology.orchestra.run.smithi111.stdout: chdir = "" 2023-10-05T21:14:29.039 INFO:teuthology.orchestra.run.smithi111.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-05T21:14:29.039 INFO:teuthology.orchestra.run.smithi111.stdout: auth supported = cephx 2023-10-05T21:14:29.039 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:29.039 INFO:teuthology.orchestra.run.smithi111.stdout: filestore xattr use omap = true 2023-10-05T21:14:29.039 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:29.039 INFO:teuthology.orchestra.run.smithi111.stdout: mon clock drift allowed = 1.000 2023-10-05T21:14:29.039 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:29.039 INFO:teuthology.orchestra.run.smithi111.stdout: osd crush chooseleaf type = 0 2023-10-05T21:14:29.039 INFO:teuthology.orchestra.run.smithi111.stdout: auth debug = true 2023-10-05T21:14:29.039 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:29.040 INFO:teuthology.orchestra.run.smithi111.stdout: ms die on old message = true 2023-10-05T21:14:29.040 INFO:teuthology.orchestra.run.smithi111.stdout: ms die on bug = true 2023-10-05T21:14:29.040 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:29.040 INFO:teuthology.orchestra.run.smithi111.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-05T21:14:29.040 INFO:teuthology.orchestra.run.smithi111.stdout: mon pg warn max object skew = 0 2023-10-05T21:14:29.040 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:29.040 INFO:teuthology.orchestra.run.smithi111.stdout: # disable pg_autoscaler by default for new pools 2023-10-05T21:14:29.040 INFO:teuthology.orchestra.run.smithi111.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-05T21:14:29.040 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:29.040 INFO:teuthology.orchestra.run.smithi111.stdout: osd pool default size = 2 2023-10-05T21:14:29.040 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:29.040 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd allow primary affinity = true 2023-10-05T21:14:29.041 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd allow pg remap = true 2023-10-05T21:14:29.041 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on legacy crush tunables = false 2023-10-05T21:14:29.041 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on crush straw calc version zero = false 2023-10-05T21:14:29.041 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on no sortbitwise = false 2023-10-05T21:14:29.041 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on osd down out interval zero = false 2023-10-05T21:14:29.041 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on too few osds = false 2023-10-05T21:14:29.041 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-05T21:14:29.041 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-05T21:14:29.041 INFO:teuthology.orchestra.run.smithi111.stdout: mon_allow_pool_size_one = true 2023-10-05T21:14:29.041 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:29.041 INFO:teuthology.orchestra.run.smithi111.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-05T21:14:29.041 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:29.041 INFO:teuthology.orchestra.run.smithi111.stdout: osd default data pool replay window = 5 2023-10-05T21:14:29.042 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:29.042 INFO:teuthology.orchestra.run.smithi111.stdout: mon allow pool delete = true 2023-10-05T21:14:29.042 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:29.042 INFO:teuthology.orchestra.run.smithi111.stdout: mon cluster log file level = debug 2023-10-05T21:14:29.042 INFO:teuthology.orchestra.run.smithi111.stdout: debug asserts on shutdown = true 2023-10-05T21:14:29.042 INFO:teuthology.orchestra.run.smithi111.stdout: mon health detail to clog = false 2023-10-05T21:14:29.042 INFO:teuthology.orchestra.run.smithi111.stdout: mon host = 172.21.15.111 2023-10-05T21:14:29.042 INFO:teuthology.orchestra.run.smithi111.stdout: fsid = eafdd85a-3bd2-413c-acb4-cdb3a151d4a9 2023-10-05T21:14:29.042 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:29.042 INFO:teuthology.orchestra.run.smithi111.stdout:[osd] 2023-10-05T21:14:29.042 INFO:teuthology.orchestra.run.smithi111.stdout: osd journal size = 100 2023-10-05T21:14:29.043 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:29.043 INFO:teuthology.orchestra.run.smithi111.stdout: osd scrub load threshold = 5.0 2023-10-05T21:14:29.043 INFO:teuthology.orchestra.run.smithi111.stdout: osd scrub max interval = 600 2023-10-05T21:14:29.043 INFO:teuthology.orchestra.run.smithi111.stdout: osd mclock profile = high_recovery_ops 2023-10-05T21:14:29.043 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:29.043 INFO:teuthology.orchestra.run.smithi111.stdout: osd recover clone overlap = true 2023-10-05T21:14:29.043 INFO:teuthology.orchestra.run.smithi111.stdout: osd recovery max chunk = 1048576 2023-10-05T21:14:29.043 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:29.043 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug shutdown = true 2023-10-05T21:14:29.043 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug op order = true 2023-10-05T21:14:29.045 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug verify stray on activate = true 2023-10-05T21:14:29.045 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:29.045 INFO:teuthology.orchestra.run.smithi111.stdout: osd open classes on start = true 2023-10-05T21:14:29.045 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug pg log writeout = true 2023-10-05T21:14:29.045 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:29.045 INFO:teuthology.orchestra.run.smithi111.stdout: osd deep scrub update digest min age = 30 2023-10-05T21:14:29.045 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:29.045 INFO:teuthology.orchestra.run.smithi111.stdout: osd map max advance = 10 2023-10-05T21:14:29.046 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:29.046 INFO:teuthology.orchestra.run.smithi111.stdout: journal zero on create = true 2023-10-05T21:14:29.046 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:29.046 INFO:teuthology.orchestra.run.smithi111.stdout: filestore ondisk finisher threads = 3 2023-10-05T21:14:29.046 INFO:teuthology.orchestra.run.smithi111.stdout: filestore apply finisher threads = 3 2023-10-05T21:14:29.046 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:29.046 INFO:teuthology.orchestra.run.smithi111.stdout: bdev debug aio = true 2023-10-05T21:14:29.046 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug misdirected ops = true 2023-10-05T21:14:29.046 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2023-10-05T21:14:29.046 INFO:teuthology.orchestra.run.smithi111.stdout: debug objclass = 20 2023-10-05T21:14:29.046 INFO:teuthology.orchestra.run.smithi111.stdout: debug osd = 20 2023-10-05T21:14:29.046 INFO:teuthology.orchestra.run.smithi111.stdout: osd objectstore = filestore 2023-10-05T21:14:29.047 INFO:teuthology.orchestra.run.smithi111.stdout: osd sloppy crc = True 2023-10-05T21:14:29.047 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:29.047 INFO:teuthology.orchestra.run.smithi111.stdout:[mgr] 2023-10-05T21:14:29.047 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2023-10-05T21:14:29.047 INFO:teuthology.orchestra.run.smithi111.stdout: debug mgr = 20 2023-10-05T21:14:29.047 INFO:teuthology.orchestra.run.smithi111.stdout: debug mon = 20 2023-10-05T21:14:29.047 INFO:teuthology.orchestra.run.smithi111.stdout: debug auth = 20 2023-10-05T21:14:29.047 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min pgs per osd = 4 2023-10-05T21:14:29.047 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min bytes per osd = 10 2023-10-05T21:14:29.047 INFO:teuthology.orchestra.run.smithi111.stdout: mgr/telemetry/nag = false 2023-10-05T21:14:29.047 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:29.047 INFO:teuthology.orchestra.run.smithi111.stdout:[mon] 2023-10-05T21:14:29.047 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2023-10-05T21:14:29.048 INFO:teuthology.orchestra.run.smithi111.stdout: debug mon = 20 2023-10-05T21:14:29.048 INFO:teuthology.orchestra.run.smithi111.stdout: debug paxos = 20 2023-10-05T21:14:29.048 INFO:teuthology.orchestra.run.smithi111.stdout: debug auth = 20 2023-10-05T21:14:29.048 INFO:teuthology.orchestra.run.smithi111.stdout: mon data avail warn = 5 2023-10-05T21:14:29.048 INFO:teuthology.orchestra.run.smithi111.stdout: mon mgr mkfs grace = 240 2023-10-05T21:14:29.048 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min pgs per osd = 4 2023-10-05T21:14:29.048 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd reporter subtree level = osd 2023-10-05T21:14:29.048 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd prime pg temp = true 2023-10-05T21:14:29.048 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min bytes per osd = 10 2023-10-05T21:14:29.048 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:29.048 INFO:teuthology.orchestra.run.smithi111.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-05T21:14:29.048 INFO:teuthology.orchestra.run.smithi111.stdout: auth mon ticket ttl = 660 # 11m 2023-10-05T21:14:29.048 INFO:teuthology.orchestra.run.smithi111.stdout: auth service ticket ttl = 240 # 4m 2023-10-05T21:14:29.049 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:29.049 INFO:teuthology.orchestra.run.smithi111.stdout: # don't complain about insecure global_id in the test suite 2023-10-05T21:14:29.049 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-05T21:14:29.049 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-05T21:14:29.049 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:29.049 INFO:teuthology.orchestra.run.smithi111.stdout: # 1m isn't quite enough 2023-10-05T21:14:29.049 INFO:teuthology.orchestra.run.smithi111.stdout: mon_down_mkfs_grace = 2m 2023-10-05T21:14:29.049 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:29.049 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_filestore_osds = false 2023-10-05T21:14:29.049 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:29.049 INFO:teuthology.orchestra.run.smithi111.stdout:[client] 2023-10-05T21:14:29.049 INFO:teuthology.orchestra.run.smithi111.stdout: rgw cache enabled = true 2023-10-05T21:14:29.050 INFO:teuthology.orchestra.run.smithi111.stdout: rgw enable ops log = true 2023-10-05T21:14:29.050 INFO:teuthology.orchestra.run.smithi111.stdout: rgw enable usage log = true 2023-10-05T21:14:29.050 INFO:teuthology.orchestra.run.smithi111.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-05T21:14:29.050 INFO:teuthology.orchestra.run.smithi111.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-05T21:14:29.050 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2023-10-05T21:14:29.050 INFO:teuthology.orchestra.run.smithi111.stdout: rgw gc obj min wait = 15 2023-10-05T21:14:29.050 INFO:teuthology.orchestra.run.smithi111.stdout: debug rgw = 20 2023-10-05T21:14:29.050 INFO:teuthology.orchestra.run.smithi111.stdout: setgroup = ceph 2023-10-05T21:14:29.050 INFO:teuthology.orchestra.run.smithi111.stdout: setuser = ceph 2023-10-05T21:14:29.050 INFO:teuthology.orchestra.run.smithi111.stdout:[mon.a] 2023-10-05T21:14:29.051 INFO:teuthology.orchestra.run.smithi153.stdout:[global] 2023-10-05T21:14:29.051 INFO:teuthology.orchestra.run.smithi153.stdout: chdir = "" 2023-10-05T21:14:29.051 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-05T21:14:29.051 INFO:teuthology.orchestra.run.smithi153.stdout: auth supported = cephx 2023-10-05T21:14:29.051 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:14:29.051 INFO:teuthology.orchestra.run.smithi153.stdout: filestore xattr use omap = true 2023-10-05T21:14:29.051 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:14:29.051 INFO:teuthology.orchestra.run.smithi153.stdout: mon clock drift allowed = 1.000 2023-10-05T21:14:29.052 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:14:29.052 INFO:teuthology.orchestra.run.smithi153.stdout: osd crush chooseleaf type = 0 2023-10-05T21:14:29.052 INFO:teuthology.orchestra.run.smithi153.stdout: auth debug = true 2023-10-05T21:14:29.052 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:14:29.052 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on old message = true 2023-10-05T21:14:29.052 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on bug = true 2023-10-05T21:14:29.052 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:14:29.052 INFO:teuthology.orchestra.run.smithi153.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-05T21:14:29.052 INFO:teuthology.orchestra.run.smithi153.stdout: mon pg warn max object skew = 0 2023-10-05T21:14:29.052 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:14:29.052 INFO:teuthology.orchestra.run.smithi153.stdout: # disable pg_autoscaler by default for new pools 2023-10-05T21:14:29.052 INFO:teuthology.orchestra.run.smithi153.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-05T21:14:29.053 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:14:29.053 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default size = 2 2023-10-05T21:14:29.053 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:14:29.053 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow primary affinity = true 2023-10-05T21:14:29.053 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow pg remap = true 2023-10-05T21:14:29.053 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on legacy crush tunables = false 2023-10-05T21:14:29.053 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on crush straw calc version zero = false 2023-10-05T21:14:29.053 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on no sortbitwise = false 2023-10-05T21:14:29.053 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on osd down out interval zero = false 2023-10-05T21:14:29.053 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on too few osds = false 2023-10-05T21:14:29.053 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-05T21:14:29.053 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-05T21:14:29.054 INFO:teuthology.orchestra.run.smithi153.stdout: mon_allow_pool_size_one = true 2023-10-05T21:14:29.054 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:14:29.054 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-05T21:14:29.054 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:14:29.054 INFO:teuthology.orchestra.run.smithi153.stdout: osd default data pool replay window = 5 2023-10-05T21:14:29.054 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:14:29.054 INFO:teuthology.orchestra.run.smithi153.stdout: mon allow pool delete = true 2023-10-05T21:14:29.054 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:14:29.054 INFO:teuthology.orchestra.run.smithi153.stdout: mon cluster log file level = debug 2023-10-05T21:14:29.054 INFO:teuthology.orchestra.run.smithi153.stdout: debug asserts on shutdown = true 2023-10-05T21:14:29.054 INFO:teuthology.orchestra.run.smithi153.stdout: mon health detail to clog = false 2023-10-05T21:14:29.054 INFO:teuthology.orchestra.run.smithi153.stdout: mon host = 172.21.15.111 2023-10-05T21:14:29.055 INFO:teuthology.orchestra.run.smithi153.stdout: fsid = eafdd85a-3bd2-413c-acb4-cdb3a151d4a9 2023-10-05T21:14:29.055 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:14:29.055 INFO:teuthology.orchestra.run.smithi153.stdout:[osd] 2023-10-05T21:14:29.055 INFO:teuthology.orchestra.run.smithi153.stdout: osd journal size = 100 2023-10-05T21:14:29.055 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:14:29.055 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub load threshold = 5.0 2023-10-05T21:14:29.055 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub max interval = 600 2023-10-05T21:14:29.055 INFO:teuthology.orchestra.run.smithi153.stdout: osd mclock profile = high_recovery_ops 2023-10-05T21:14:29.055 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:14:29.055 INFO:teuthology.orchestra.run.smithi153.stdout: osd recover clone overlap = true 2023-10-05T21:14:29.055 INFO:teuthology.orchestra.run.smithi153.stdout: osd recovery max chunk = 1048576 2023-10-05T21:14:29.055 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:14:29.056 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug shutdown = true 2023-10-05T21:14:29.056 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug op order = true 2023-10-05T21:14:29.056 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify stray on activate = true 2023-10-05T21:14:29.056 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:14:29.056 INFO:teuthology.orchestra.run.smithi153.stdout: osd open classes on start = true 2023-10-05T21:14:29.056 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug pg log writeout = true 2023-10-05T21:14:29.056 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:14:29.056 INFO:teuthology.orchestra.run.smithi153.stdout: osd deep scrub update digest min age = 30 2023-10-05T21:14:29.056 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:14:29.056 INFO:teuthology.orchestra.run.smithi153.stdout: osd map max advance = 10 2023-10-05T21:14:29.056 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:14:29.056 INFO:teuthology.orchestra.run.smithi153.stdout: journal zero on create = true 2023-10-05T21:14:29.057 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:14:29.057 INFO:teuthology.orchestra.run.smithi153.stdout: filestore ondisk finisher threads = 3 2023-10-05T21:14:29.057 INFO:teuthology.orchestra.run.smithi153.stdout: filestore apply finisher threads = 3 2023-10-05T21:14:29.057 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:14:29.057 INFO:teuthology.orchestra.run.smithi153.stdout: bdev debug aio = true 2023-10-05T21:14:29.057 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug misdirected ops = true 2023-10-05T21:14:29.057 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-10-05T21:14:29.057 INFO:teuthology.orchestra.run.smithi153.stdout: debug objclass = 20 2023-10-05T21:14:29.057 INFO:teuthology.orchestra.run.smithi153.stdout: debug osd = 20 2023-10-05T21:14:29.057 INFO:teuthology.orchestra.run.smithi153.stdout: osd objectstore = filestore 2023-10-05T21:14:29.057 INFO:teuthology.orchestra.run.smithi153.stdout: osd sloppy crc = True 2023-10-05T21:14:29.057 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:14:29.057 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr] 2023-10-05T21:14:29.058 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-10-05T21:14:29.058 INFO:teuthology.orchestra.run.smithi153.stdout: debug mgr = 20 2023-10-05T21:14:29.058 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2023-10-05T21:14:29.058 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2023-10-05T21:14:29.058 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2023-10-05T21:14:29.058 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2023-10-05T21:14:29.058 INFO:teuthology.orchestra.run.smithi153.stdout: mgr/telemetry/nag = false 2023-10-05T21:14:29.058 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:14:29.058 INFO:teuthology.orchestra.run.smithi153.stdout:[mon] 2023-10-05T21:14:29.058 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-10-05T21:14:29.058 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2023-10-05T21:14:29.059 INFO:teuthology.orchestra.run.smithi153.stdout: debug paxos = 20 2023-10-05T21:14:29.059 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2023-10-05T21:14:29.059 INFO:teuthology.orchestra.run.smithi153.stdout: mon data avail warn = 5 2023-10-05T21:14:29.059 INFO:teuthology.orchestra.run.smithi153.stdout: mon mgr mkfs grace = 240 2023-10-05T21:14:29.059 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2023-10-05T21:14:29.059 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd reporter subtree level = osd 2023-10-05T21:14:29.059 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd prime pg temp = true 2023-10-05T21:14:29.059 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2023-10-05T21:14:29.059 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:14:29.059 INFO:teuthology.orchestra.run.smithi153.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-05T21:14:29.059 INFO:teuthology.orchestra.run.smithi153.stdout: auth mon ticket ttl = 660 # 11m 2023-10-05T21:14:29.059 INFO:teuthology.orchestra.run.smithi153.stdout: auth service ticket ttl = 240 # 4m 2023-10-05T21:14:29.059 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:14:29.060 INFO:teuthology.orchestra.run.smithi153.stdout: # don't complain about insecure global_id in the test suite 2023-10-05T21:14:29.060 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-05T21:14:29.060 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-05T21:14:29.060 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:14:29.060 INFO:teuthology.orchestra.run.smithi153.stdout: # 1m isn't quite enough 2023-10-05T21:14:29.060 INFO:teuthology.orchestra.run.smithi153.stdout: mon_down_mkfs_grace = 2m 2023-10-05T21:14:29.060 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:14:29.060 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_filestore_osds = false 2023-10-05T21:14:29.060 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:14:29.060 INFO:teuthology.orchestra.run.smithi153.stdout:[client] 2023-10-05T21:14:29.060 INFO:teuthology.orchestra.run.smithi153.stdout: rgw cache enabled = true 2023-10-05T21:14:29.060 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable ops log = true 2023-10-05T21:14:29.060 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable usage log = true 2023-10-05T21:14:29.061 INFO:teuthology.orchestra.run.smithi153.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-05T21:14:29.061 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-05T21:14:29.061 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-10-05T21:14:29.061 INFO:teuthology.orchestra.run.smithi153.stdout: rgw gc obj min wait = 15 2023-10-05T21:14:29.061 INFO:teuthology.orchestra.run.smithi153.stdout: debug rgw = 20 2023-10-05T21:14:29.061 INFO:teuthology.orchestra.run.smithi153.stdout: setgroup = ceph 2023-10-05T21:14:29.061 INFO:teuthology.orchestra.run.smithi153.stdout: setuser = ceph 2023-10-05T21:14:29.061 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.a] 2023-10-05T21:14:29.063 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-05T21:14:29.063 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-05T21:14:29.156 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-05T21:14:29.156 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2023-10-05T21:14:29.156 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-05T21:14:29.174 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2023-10-05T21:14:29.174 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-05T21:14:29.231 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi111.front.sepia.ceph.com 2023-10-05T21:14:29.231 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2023-10-05T21:14:29.231 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-05T21:14:29.232 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-05T21:14:29.308 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2023-10-05T21:14:29.899 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-05T21:14:29.919 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi153.front.sepia.ceph.com 2023-10-05T21:14:29.973 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-05T21:14:29.974 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-05T21:14:29.974 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-05T21:14:30.018 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-05T21:14:30.019 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-05T21:14:30.080 INFO:tasks.ceph:Setting up mon nodes... 2023-10-05T21:14:30.080 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-05T21:14:30.080 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-05T21:14:30.207 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-05T21:14:30.209 INFO:tasks.ceph:Setting up mds nodes... 2023-10-05T21:14:30.209 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-05T21:14:30.210 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-05T21:14:30.253 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-05T21:14:30.265 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-05T21:14:30.265 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi111.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2023-10-05T21:14:30.266 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-05T21:14:30.298 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2023-10-05T21:14:30.298 INFO:tasks.ceph:role: osd.0 2023-10-05T21:14:30.299 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi111.front.sepia.ceph.com 2023-10-05T21:14:30.299 DEBUG:teuthology.orchestra.run.smithi111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-05T21:14:30.377 INFO:teuthology.orchestra.run.smithi111.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-05T21:14:30.377 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-05T21:14:30.377 INFO:teuthology.orchestra.run.smithi111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-05T21:14:30.377 INFO:teuthology.orchestra.run.smithi111.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-05T21:14:30.378 INFO:teuthology.orchestra.run.smithi111.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-05T21:14:30.378 INFO:teuthology.orchestra.run.smithi111.stdout: = sunit=0 swidth=0 blks 2023-10-05T21:14:30.378 INFO:teuthology.orchestra.run.smithi111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-05T21:14:30.378 INFO:teuthology.orchestra.run.smithi111.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-05T21:14:30.378 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-05T21:14:30.378 INFO:teuthology.orchestra.run.smithi111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-05T21:14:30.807 INFO:teuthology.orchestra.run.smithi111.stdout:Discarding blocks...Done. 2023-10-05T21:14:31.074 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi111.front.sepia.ceph.com -o noatime 2023-10-05T21:14:31.074 DEBUG:teuthology.orchestra.run.smithi111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-05T21:14:31.192 DEBUG:teuthology.orchestra.run.smithi111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-05T21:14:31.228 DEBUG:teuthology.orchestra.run.smithi111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-05T21:14:31.318 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:31.316+0000 7efc3d7f8540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-05T21:14:31.319 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:31.317+0000 7efc3d7f8540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-05T21:14:31.327 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:31.326+0000 7efc3d7f8540 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-05T21:14:31.327 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:31.326+0000 7efc3d7f8540 -1 journal FileJournal::_open_file : zeroing journal 2023-10-05T21:14:31.461 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:31.459+0000 7efc3d7f8540 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-05T21:14:31.461 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:31.459+0000 7efc3d7f8540 -1 journal do_read_entry(4096): bad header magic 2023-10-05T21:14:31.461 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:31.459+0000 7efc3d7f8540 -1 journal do_read_entry(4096): bad header magic 2023-10-05T21:14:31.469 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-05T21:14:31.497 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-05T21:14:31.530 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2023-10-05T21:14:31.530 INFO:tasks.ceph:role: osd.1 2023-10-05T21:14:31.531 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com 2023-10-05T21:14:31.531 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-05T21:14:31.611 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-05T21:14:31.611 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-05T21:14:31.611 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-05T21:14:31.611 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-05T21:14:31.611 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-05T21:14:31.611 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2023-10-05T21:14:31.611 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-05T21:14:31.611 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-05T21:14:31.611 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-05T21:14:31.612 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-05T21:14:32.041 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2023-10-05T21:14:32.044 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2023-10-05T21:14:32.044 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2023-10-05T21:14:32.208 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-05T21:14:32.247 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-05T21:14:32.316 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2023-10-05T21:14:32.317 INFO:tasks.ceph:role: osd.2 2023-10-05T21:14:32.317 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com 2023-10-05T21:14:32.317 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-05T21:14:32.393 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-05T21:14:32.394 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-05T21:14:32.394 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-05T21:14:32.394 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-05T21:14:32.394 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-05T21:14:32.394 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2023-10-05T21:14:32.394 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-05T21:14:32.394 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-05T21:14:32.394 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-05T21:14:32.394 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-05T21:14:32.833 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2023-10-05T21:14:32.834 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2023-10-05T21:14:32.835 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2023-10-05T21:14:32.950 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-05T21:14:32.983 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-05T21:14:33.053 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2023-10-05T21:14:33.053 INFO:tasks.ceph:role: osd.3 2023-10-05T21:14:33.053 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com 2023-10-05T21:14:33.053 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-05T21:14:33.128 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-05T21:14:33.129 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-05T21:14:33.129 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-05T21:14:33.129 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-05T21:14:33.129 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-05T21:14:33.129 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2023-10-05T21:14:33.129 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-05T21:14:33.129 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-05T21:14:33.129 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-05T21:14:33.129 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-05T21:14:33.581 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2023-10-05T21:14:33.583 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2023-10-05T21:14:33.583 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2023-10-05T21:14:33.735 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-05T21:14:33.769 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-05T21:14:33.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:33.882+0000 7f74d29b3540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-05T21:14:33.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:33.886+0000 7f74d29b3540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-05T21:14:33.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:33.916+0000 7f74d29b3540 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-05T21:14:33.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:33.918+0000 7f74d29b3540 -1 journal FileJournal::_open_file : zeroing journal 2023-10-05T21:14:34.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:34.185+0000 7f74d29b3540 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-05T21:14:34.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:34.186+0000 7f74d29b3540 -1 journal do_read_entry(4096): bad header magic 2023-10-05T21:14:34.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:34.186+0000 7f74d29b3540 -1 journal do_read_entry(4096): bad header magic 2023-10-05T21:14:34.213 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-05T21:14:34.242 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-05T21:14:34.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:34.324+0000 7fca2fdb6540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-05T21:14:34.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:34.324+0000 7fca2fdb6540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-05T21:14:34.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:34.332+0000 7fca2fdb6540 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-05T21:14:34.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:34.339+0000 7fca2fdb6540 -1 journal FileJournal::_open_file : zeroing journal 2023-10-05T21:14:34.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:34.551+0000 7fca2fdb6540 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-05T21:14:34.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:34.551+0000 7fca2fdb6540 -1 journal do_read_entry(4096): bad header magic 2023-10-05T21:14:34.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:34.551+0000 7fca2fdb6540 -1 journal do_read_entry(4096): bad header magic 2023-10-05T21:14:34.580 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-05T21:14:34.649 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-05T21:14:34.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:34.730+0000 7f655e97c540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-05T21:14:34.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:34.730+0000 7f655e97c540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-05T21:14:34.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:34.737+0000 7f655e97c540 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-05T21:14:34.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:34.737+0000 7f655e97c540 -1 journal FileJournal::_open_file : zeroing journal 2023-10-05T21:14:34.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:34.911+0000 7f655e97c540 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-05T21:14:34.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:34.912+0000 7f655e97c540 -1 journal do_read_entry(4096): bad header magic 2023-10-05T21:14:34.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:34.912+0000 7f655e97c540 -1 journal do_read_entry(4096): bad header magic 2023-10-05T21:14:34.920 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-05T21:14:34.987 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-05T21:14:34.987 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2023-10-05T21:14:34.988 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-05T21:14:35.021 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-05T21:14:35.021 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-05T21:14:35.054 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-05T21:14:35.054 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-05T21:14:35.121 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-05T21:14:35.121 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-05T21:14:35.188 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-05T21:14:35.188 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-05T21:14:35.255 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-05T21:14:35.255 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-05T21:14:35.313 INFO:tasks.ceph:Adding keys to all mons... 2023-10-05T21:14:35.313 DEBUG:teuthology.orchestra.run.smithi111:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-05T21:14:35.344 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.0] 2023-10-05T21:14:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQA3Jx9lwZX2EhAAUXyqVOKu/YpDz0rVAjmPIA== 2023-10-05T21:14:35.345 INFO:teuthology.orchestra.run.smithi111.stdout:[mgr.x] 2023-10-05T21:14:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQA2Jx9lcsNSDBAA9Xn7MhH97MD5SGJ44o3U5A== 2023-10-05T21:14:35.345 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.1] 2023-10-05T21:14:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQA5Jx9lZnOjNBAAOzPzazc9vSqsRJGmSC3HKg== 2023-10-05T21:14:35.345 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.2] 2023-10-05T21:14:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQA6Jx9lLaBmExAAHuZowxUf2doJiuiSyR7ELQ== 2023-10-05T21:14:35.345 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.3] 2023-10-05T21:14:35.345 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQA6Jx9lzzaaKxAARLFEgCXxNpspvP16s3JrdA== 2023-10-05T21:14:35.346 INFO:teuthology.orchestra.run.smithi111.stdout:[client.0] 2023-10-05T21:14:35.346 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQA2Jx9lT60RDxAAgkkuiXij3dYVx7BITBrmiQ== 2023-10-05T21:14:35.346 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-05T21:14:35.442 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-05T21:14:35.495 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-05T21:14:35.545 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-05T21:14:35.595 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-05T21:14:35.644 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-05T21:14:35.697 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-05T21:14:35.698 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-05T21:14:35.724 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-05T21:14:35.820 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-05T21:14:35.848 DEBUG:teuthology.orchestra.run.smithi111:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-05T21:14:35.906 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-05T21:14:35.906 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-05T21:14:35.906 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-05T21:14:35.949 INFO:tasks.ceph.mon.a:Started 2023-10-05T21:14:35.949 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-05T21:14:35.949 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-05T21:14:35.949 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-05T21:14:35.951 INFO:tasks.ceph.mgr.x:Started 2023-10-05T21:14:35.952 INFO:tasks.ceph:Setting crush tunables to default 2023-10-05T21:14:35.952 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph osd crush tunables default 2023-10-05T21:14:36.071 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.069+0000 7f50475e7700 1 Processor -- start 2023-10-05T21:14:36.072 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.069+0000 7f50475e7700 1 -- start start 2023-10-05T21:14:36.072 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.069+0000 7f50475e7700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f5040067620 0x7f504006afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:36.072 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.069+0000 7f50475e7700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f504006c880 con 0x7f504006b4e0 2023-10-05T21:14:36.072 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.069+0000 7f50475e7700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5040097f20 con 0x7f5040067620 2023-10-05T21:14:36.072 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.069+0000 7f5045383700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f5040067620 0x7f504006afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:36.072 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.069+0000 7f5044b82700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f504006b4e0 0x7f504006b910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:58410/0 (socket says 172.21.15.111:58410) 2023-10-05T21:14:36.072 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.069+0000 7f5044b82700 1 -- 172.21.15.111:0/1806656740 learned_addr learned my addr 172.21.15.111:0/1806656740 (peer_addr_for_me v1:172.21.15.111:0/0) 2023-10-05T21:14:36.072 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.070+0000 7f5045383700 1 -- 172.21.15.111:0/1806656740 >> v1:172.21.15.111:6789/0 conn(0x7f504006b4e0 legacy=0x7f504006b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:36.072 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.070+0000 7f5045383700 1 -- 172.21.15.111:0/1806656740 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5040092d80 con 0x7f5040067620 2023-10-05T21:14:36.072 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.070+0000 7f5037fff700 1 -- 172.21.15.111:0/1806656740 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 55133205 0 0) 0x7f504006c880 con 0x7f504006b4e0 2023-10-05T21:14:36.072 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.070+0000 7f5045383700 1 --2- 172.21.15.111:0/1806656740 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5040067620 0x7f504006afa0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f503c009850 tx=0x7f503c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d7120210624de73 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:36.073 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.070+0000 7f5037fff700 1 -- 172.21.15.111:0/1806656740 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f503c005d50 con 0x7f5040067620 2023-10-05T21:14:36.073 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.070+0000 7f5037fff700 1 -- 172.21.15.111:0/1806656740 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503c006030 con 0x7f5040067620 2023-10-05T21:14:36.073 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.070+0000 7f5037fff700 1 -- 172.21.15.111:0/1806656740 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f503c006300 con 0x7f5040067620 2023-10-05T21:14:36.073 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.070+0000 7f50475e7700 1 -- 172.21.15.111:0/1806656740 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5040067620 msgr2=0x7f504006afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:36.073 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.070+0000 7f50475e7700 1 --2- 172.21.15.111:0/1806656740 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5040067620 0x7f504006afa0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f503c009850 tx=0x7f503c009120 comp rx=0 tx=0).stop 2023-10-05T21:14:36.073 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.070+0000 7f50475e7700 1 -- 172.21.15.111:0/1806656740 shutdown_connections 2023-10-05T21:14:36.073 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.070+0000 7f50475e7700 1 --2- 172.21.15.111:0/1806656740 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5040067620 0x7f504006afa0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:36.073 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.070+0000 7f50475e7700 1 -- 172.21.15.111:0/1806656740 >> 172.21.15.111:0/1806656740 conn(0x7f5040098930 msgr2=0x7f5040098d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:36.073 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.071+0000 7f50475e7700 1 -- 172.21.15.111:0/1806656740 shutdown_connections 2023-10-05T21:14:36.073 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.071+0000 7f50475e7700 1 -- 172.21.15.111:0/1806656740 wait complete. 2023-10-05T21:14:36.075 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.071+0000 7f50475e7700 1 Processor -- start 2023-10-05T21:14:36.075 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.071+0000 7f50475e7700 1 -- start start 2023-10-05T21:14:36.075 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.072+0000 7f50475e7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5040067620 0x7f50401384f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:36.075 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.072+0000 7f50475e7700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5040138170 con 0x7f5040067620 2023-10-05T21:14:36.075 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.072+0000 7f5045383700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5040067620 0x7f50401384f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:36.076 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.072+0000 7f5045383700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5040067620 0x7f50401384f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:41826/0 (socket says 172.21.15.111:41826) 2023-10-05T21:14:36.076 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.072+0000 7f5045383700 1 -- 172.21.15.111:0/3462425962 learned_addr learned my addr 172.21.15.111:0/3462425962 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-10-05T21:14:36.076 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.072+0000 7f5045383700 1 -- 172.21.15.111:0/3462425962 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f503c0093c0 con 0x7f5040067620 2023-10-05T21:14:36.076 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.072+0000 7f5045383700 1 --2- 172.21.15.111:0/3462425962 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5040067620 0x7f50401384f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f503c009390 tx=0x7f503c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:36.076 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.072+0000 7f50357fa700 1 -- 172.21.15.111:0/3462425962 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f503c00bb20 con 0x7f5040067620 2023-10-05T21:14:36.076 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.072+0000 7f50357fa700 1 -- 172.21.15.111:0/3462425962 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503c00bc80 con 0x7f5040067620 2023-10-05T21:14:36.076 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.072+0000 7f50357fa700 1 -- 172.21.15.111:0/3462425962 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f503c01c450 con 0x7f5040067620 2023-10-05T21:14:36.076 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.072+0000 7f50475e7700 1 -- 172.21.15.111:0/3462425962 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5040091c50 con 0x7f5040067620 2023-10-05T21:14:36.077 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.072+0000 7f50475e7700 1 -- 172.21.15.111:0/3462425962 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50401202a0 con 0x7f5040067620 2023-10-05T21:14:36.077 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.073+0000 7f50357fa700 1 -- 172.21.15.111:0/3462425962 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f503c023030 con 0x7f5040067620 2023-10-05T21:14:36.077 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.073+0000 7f50357fa700 1 -- 172.21.15.111:0/3462425962 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f503c026470 con 0x7f5040067620 2023-10-05T21:14:36.077 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.073+0000 7f50475e7700 1 -- 172.21.15.111:0/3462425962 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50401204f0 con 0x7f5040067620 2023-10-05T21:14:36.077 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.076+0000 7f50357fa700 1 -- 172.21.15.111:0/3462425962 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f503c02b060 con 0x7f5040067620 2023-10-05T21:14:36.148 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.148+0000 7f50475e7700 1 -- 172.21.15.111:0/3462425962 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f50400647e0 con 0x7f5040067620 2023-10-05T21:14:36.150 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.150+0000 7f50357fa700 1 -- 172.21.15.111:0/3462425962 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f503c035090 con 0x7f5040067620 2023-10-05T21:14:36.152 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.150+0000 7f50475e7700 1 -- 172.21.15.111:0/3462425962 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5040067620 msgr2=0x7f50401384f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:36.152 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.150+0000 7f50475e7700 1 --2- 172.21.15.111:0/3462425962 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5040067620 0x7f50401384f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f503c009390 tx=0x7f503c015000 comp rx=0 tx=0).stop 2023-10-05T21:14:36.152 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.151+0000 7f50475e7700 1 -- 172.21.15.111:0/3462425962 shutdown_connections 2023-10-05T21:14:36.152 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.151+0000 7f50475e7700 1 --2- 172.21.15.111:0/3462425962 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5040067620 0x7f50401384f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:36.152 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.151+0000 7f50475e7700 1 -- 172.21.15.111:0/3462425962 >> 172.21.15.111:0/3462425962 conn(0x7f5040098930 msgr2=0x7f504008b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:36.152 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.151+0000 7f50475e7700 1 -- 172.21.15.111:0/3462425962 shutdown_connections 2023-10-05T21:14:36.152 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:36.151+0000 7f50475e7700 1 -- 172.21.15.111:0/3462425962 wait complete. 2023-10-05T21:14:36.152 INFO:teuthology.orchestra.run.smithi111.stderr:adjusted tunables profile to default 2023-10-05T21:14:36.163 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-05T21:14:36.163 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2023-10-05T21:14:36.163 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-05T21:14:36.187 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-10-05T21:14:36.186+0000 7f0d4fc851c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-05T21:14:36.190 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-05T21:14:36.190 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-05T21:14:36.217 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-05T21:14:36.217 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-05T21:14:36.289 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-05T21:14:36.289 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-05T21:14:36.356 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-10-05T21:14:36.355+0000 7f0d4fc851c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-05T21:14:36.373 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 5f41de27-2f93-4f50-94db-3104799b246b 0 2023-10-05T21:14:36.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.530+0000 7fe37a661700 1 Processor -- start 2023-10-05T21:14:36.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.530+0000 7fe37a661700 1 -- start start 2023-10-05T21:14:36.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.531+0000 7fe37a661700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe374112530 0x7fe374114910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:36.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.531+0000 7fe37a661700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe374114ee0 con 0x7fe37410f890 2023-10-05T21:14:36.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.531+0000 7fe37a661700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37404bb40 con 0x7fe374112530 2023-10-05T21:14:36.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.531+0000 7fe3737fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe374112530 0x7fe374114910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:36.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.531+0000 7fe373fff700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fe37410f890 0x7fe37410fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:33518/0 (socket says 172.21.15.153:33518) 2023-10-05T21:14:36.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.531+0000 7fe373fff700 1 -- 172.21.15.153:0/35267240 learned_addr learned my addr 172.21.15.153:0/35267240 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:14:36.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.531+0000 7fe3737fe700 1 -- 172.21.15.153:0/35267240 >> v1:172.21.15.111:6789/0 conn(0x7fe37410f890 legacy=0x7fe37410fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:36.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.531+0000 7fe3737fe700 1 -- 172.21.15.153:0/35267240 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe374116080 con 0x7fe374112530 2023-10-05T21:14:36.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.531+0000 7fe3737fe700 1 --2- 172.21.15.153:0/35267240 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe374112530 0x7fe374114910 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe36400bb10 tx=0x7fe36400b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84c207fdaa2f5b7f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:36.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.532+0000 7fe372ffd700 1 -- 172.21.15.153:0/35267240 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe36400db20 con 0x7fe374112530 2023-10-05T21:14:36.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.532+0000 7fe372ffd700 1 -- 172.21.15.153:0/35267240 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36400dc80 con 0x7fe374112530 2023-10-05T21:14:36.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.532+0000 7fe372ffd700 1 -- 172.21.15.153:0/35267240 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe364010470 con 0x7fe374112530 2023-10-05T21:14:36.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.532+0000 7fe37a661700 1 -- 172.21.15.153:0/35267240 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe374112530 msgr2=0x7fe374114910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:36.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.532+0000 7fe37a661700 1 --2- 172.21.15.153:0/35267240 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe374112530 0x7fe374114910 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe36400bb10 tx=0x7fe36400b430 comp rx=0 tx=0).stop 2023-10-05T21:14:36.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.532+0000 7fe37a661700 1 -- 172.21.15.153:0/35267240 shutdown_connections 2023-10-05T21:14:36.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.532+0000 7fe37a661700 1 --2- 172.21.15.153:0/35267240 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe374112530 0x7fe374114910 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:36.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.532+0000 7fe37a661700 1 -- 172.21.15.153:0/35267240 >> 172.21.15.153:0/35267240 conn(0x7fe37406c500 msgr2=0x7fe37406e910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:36.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.532+0000 7fe37a661700 1 -- 172.21.15.153:0/35267240 shutdown_connections 2023-10-05T21:14:36.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.532+0000 7fe37a661700 1 -- 172.21.15.153:0/35267240 wait complete. 2023-10-05T21:14:36.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.533+0000 7fe37a661700 1 Processor -- start 2023-10-05T21:14:36.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.533+0000 7fe37a661700 1 -- start start 2023-10-05T21:14:36.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.533+0000 7fe37a661700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe37410f890 0x7fe374117a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:36.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.533+0000 7fe37a661700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37410a6d0 con 0x7fe37410f890 2023-10-05T21:14:36.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.533+0000 7fe373fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe37410f890 0x7fe374117a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:36.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.533+0000 7fe373fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe37410f890 0x7fe374117a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:39734/0 (socket says 172.21.15.153:39734) 2023-10-05T21:14:36.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.533+0000 7fe373fff700 1 -- 172.21.15.153:0/3719267568 learned_addr learned my addr 172.21.15.153:0/3719267568 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:14:36.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.534+0000 7fe373fff700 1 -- 172.21.15.153:0/3719267568 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36400b6d0 con 0x7fe37410f890 2023-10-05T21:14:36.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.534+0000 7fe373fff700 1 --2- 172.21.15.153:0/3719267568 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe37410f890 0x7fe374117a10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe36800c690 tx=0x7fe368007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:36.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.534+0000 7fe35bfff700 1 -- 172.21.15.153:0/3719267568 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe368005c50 con 0x7fe37410f890 2023-10-05T21:14:36.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.534+0000 7fe35bfff700 1 -- 172.21.15.153:0/3719267568 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe368005db0 con 0x7fe37410f890 2023-10-05T21:14:36.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.534+0000 7fe35bfff700 1 -- 172.21.15.153:0/3719267568 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe368004990 con 0x7fe37410f890 2023-10-05T21:14:36.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.534+0000 7fe37a661700 1 -- 172.21.15.153:0/3719267568 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe374117f50 con 0x7fe37410f890 2023-10-05T21:14:36.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.534+0000 7fe37a661700 1 -- 172.21.15.153:0/3719267568 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3741183c0 con 0x7fe37410f890 2023-10-05T21:14:36.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.534+0000 7fe35bfff700 1 -- 172.21.15.153:0/3719267568 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fe3680070d0 con 0x7fe37410f890 2023-10-05T21:14:36.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.534+0000 7fe35bfff700 1 -- 172.21.15.153:0/3719267568 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe3680054a0 con 0x7fe37410f890 2023-10-05T21:14:36.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.535+0000 7fe37a661700 1 -- 172.21.15.153:0/3719267568 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3741175c0 con 0x7fe37410f890 2023-10-05T21:14:36.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.537+0000 7fe35bfff700 1 -- 172.21.15.153:0/3719267568 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7fe368005660 con 0x7fe37410f890 2023-10-05T21:14:36.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.621+0000 7fe37a661700 1 -- 172.21.15.153:0/3719267568 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5f41de27-2f93-4f50-94db-3104799b246b", "id": 0} v 0) v1 -- 0x7fe374118e80 con 0x7fe37410f890 2023-10-05T21:14:36.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.623+0000 7fe35bfff700 1 -- 172.21.15.153:0/3719267568 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5f41de27-2f93-4f50-94db-3104799b246b", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe368007510 con 0x7fe37410f890 2023-10-05T21:14:36.625 INFO:teuthology.orchestra.run.smithi153.stdout:0 2023-10-05T21:14:36.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.624+0000 7fe37a661700 1 -- 172.21.15.153:0/3719267568 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe37410f890 msgr2=0x7fe374117a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:36.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.624+0000 7fe37a661700 1 --2- 172.21.15.153:0/3719267568 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe37410f890 0x7fe374117a10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe36800c690 tx=0x7fe368007f40 comp rx=0 tx=0).stop 2023-10-05T21:14:36.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.624+0000 7fe37a661700 1 -- 172.21.15.153:0/3719267568 shutdown_connections 2023-10-05T21:14:36.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.624+0000 7fe37a661700 1 --2- 172.21.15.153:0/3719267568 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe37410f890 0x7fe374117a10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:36.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.624+0000 7fe37a661700 1 -- 172.21.15.153:0/3719267568 >> 172.21.15.153:0/3719267568 conn(0x7fe37406c500 msgr2=0x7fe374110500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:36.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.625+0000 7fe37a661700 1 -- 172.21.15.153:0/3719267568 shutdown_connections 2023-10-05T21:14:36.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.625+0000 7fe37a661700 1 -- 172.21.15.153:0/3719267568 wait complete. 2023-10-05T21:14:36.642 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 96502bac-f68a-4b39-8f59-057a68c166c8 1 2023-10-05T21:14:36.709 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-10-05T21:14:36.708+0000 7f0d4fc851c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-05T21:14:36.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.761+0000 7f6d991e0700 1 Processor -- start 2023-10-05T21:14:36.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.761+0000 7f6d991e0700 1 -- start start 2023-10-05T21:14:36.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.761+0000 7f6d991e0700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f6d9410cdc0 0x7f6d9410d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:36.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.761+0000 7f6d991e0700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d9410d760 con 0x7f6d941116c0 2023-10-05T21:14:36.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.761+0000 7f6d991e0700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d9404bb40 con 0x7f6d9410cdc0 2023-10-05T21:14:36.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.761+0000 7f6d92d9d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f6d9410cdc0 0x7f6d9410d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:36.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.761+0000 7f6d9259c700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f6d941116c0 0x7f6d94111b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:33522/0 (socket says 172.21.15.153:33522) 2023-10-05T21:14:36.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.761+0000 7f6d9259c700 1 -- 172.21.15.153:0/1144468600 learned_addr learned my addr 172.21.15.153:0/1144468600 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:14:36.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.762+0000 7f6d92d9d700 1 -- 172.21.15.153:0/1144468600 >> v1:172.21.15.111:6789/0 conn(0x7f6d941116c0 legacy=0x7f6d94111b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:36.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.762+0000 7f6d92d9d700 1 -- 172.21.15.153:0/1144468600 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d94112240 con 0x7f6d9410cdc0 2023-10-05T21:14:36.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.762+0000 7f6d91d9b700 1 -- 172.21.15.153:0/1144468600 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609274413 0 0) 0x7f6d9410d760 con 0x7f6d941116c0 2023-10-05T21:14:36.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.762+0000 7f6d92d9d700 1 --2- 172.21.15.153:0/1144468600 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6d9410cdc0 0x7f6d9410d190 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6d84009860 tx=0x7f6d840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=233f264100d4f93e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:36.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.762+0000 7f6d91d9b700 1 -- 172.21.15.153:0/1144468600 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d8400b680 con 0x7f6d9410cdc0 2023-10-05T21:14:36.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.762+0000 7f6d91d9b700 1 -- 172.21.15.153:0/1144468600 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8400b7e0 con 0x7f6d9410cdc0 2023-10-05T21:14:36.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.762+0000 7f6d91d9b700 1 -- 172.21.15.153:0/1144468600 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d8400b990 con 0x7f6d9410cdc0 2023-10-05T21:14:36.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.762+0000 7f6d991e0700 1 -- 172.21.15.153:0/1144468600 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6d9410cdc0 msgr2=0x7f6d9410d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:36.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.762+0000 7f6d991e0700 1 --2- 172.21.15.153:0/1144468600 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6d9410cdc0 0x7f6d9410d190 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6d84009860 tx=0x7f6d840091a0 comp rx=0 tx=0).stop 2023-10-05T21:14:36.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.762+0000 7f6d991e0700 1 -- 172.21.15.153:0/1144468600 shutdown_connections 2023-10-05T21:14:36.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.762+0000 7f6d991e0700 1 --2- 172.21.15.153:0/1144468600 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6d9410cdc0 0x7f6d9410d190 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:36.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.762+0000 7f6d991e0700 1 -- 172.21.15.153:0/1144468600 >> 172.21.15.153:0/1144468600 conn(0x7f6d9406b490 msgr2=0x7f6d9410adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:36.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.762+0000 7f6d991e0700 1 -- 172.21.15.153:0/1144468600 shutdown_connections 2023-10-05T21:14:36.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.762+0000 7f6d991e0700 1 -- 172.21.15.153:0/1144468600 wait complete. 2023-10-05T21:14:36.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.763+0000 7f6d991e0700 1 Processor -- start 2023-10-05T21:14:36.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.763+0000 7f6d991e0700 1 -- start start 2023-10-05T21:14:36.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.764+0000 7f6d991e0700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6d9410cdc0 0x7f6d9411bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:36.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.764+0000 7f6d991e0700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d94111380 con 0x7f6d9410cdc0 2023-10-05T21:14:36.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.764+0000 7f6d92d9d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6d9410cdc0 0x7f6d9411bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:36.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.764+0000 7f6d92d9d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6d9410cdc0 0x7f6d9411bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:39752/0 (socket says 172.21.15.153:39752) 2023-10-05T21:14:36.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.764+0000 7f6d92d9d700 1 -- 172.21.15.153:0/906730776 learned_addr learned my addr 172.21.15.153:0/906730776 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:14:36.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.764+0000 7f6d92d9d700 1 -- 172.21.15.153:0/906730776 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d84009420 con 0x7f6d9410cdc0 2023-10-05T21:14:36.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.764+0000 7f6d92d9d700 1 --2- 172.21.15.153:0/906730776 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6d9410cdc0 0x7f6d9411bd30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6d84000c00 tx=0x7f6d84016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:36.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.764+0000 7f6d7affd700 1 -- 172.21.15.153:0/906730776 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d84011d30 con 0x7f6d9410cdc0 2023-10-05T21:14:36.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.765+0000 7f6d7affd700 1 -- 172.21.15.153:0/906730776 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d84020070 con 0x7f6d9410cdc0 2023-10-05T21:14:36.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.765+0000 7f6d7affd700 1 -- 172.21.15.153:0/906730776 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d8401b450 con 0x7f6d9410cdc0 2023-10-05T21:14:36.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.765+0000 7f6d991e0700 1 -- 172.21.15.153:0/906730776 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d9411c270 con 0x7f6d9410cdc0 2023-10-05T21:14:36.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.765+0000 7f6d991e0700 1 -- 172.21.15.153:0/906730776 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d9411c6e0 con 0x7f6d9410cdc0 2023-10-05T21:14:36.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.765+0000 7f6d7affd700 1 -- 172.21.15.153:0/906730776 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f6d84022030 con 0x7f6d9410cdc0 2023-10-05T21:14:36.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.765+0000 7f6d7affd700 1 -- 172.21.15.153:0/906730776 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f6d8401c810 con 0x7f6d9410cdc0 2023-10-05T21:14:36.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.765+0000 7f6d991e0700 1 -- 172.21.15.153:0/906730776 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d9405f230 con 0x7f6d9410cdc0 2023-10-05T21:14:36.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.768+0000 7f6d7affd700 1 -- 172.21.15.153:0/906730776 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f6d84006cb0 con 0x7f6d9410cdc0 2023-10-05T21:14:36.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.850+0000 7f6d991e0700 1 -- 172.21.15.153:0/906730776 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd new", "uuid": "96502bac-f68a-4b39-8f59-057a68c166c8", "id": 1} v 0) v1 -- 0x7f6d94118850 con 0x7f6d9410cdc0 2023-10-05T21:14:36.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.852+0000 7f6d7affd700 1 -- 172.21.15.153:0/906730776 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "96502bac-f68a-4b39-8f59-057a68c166c8", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6d8401bad0 con 0x7f6d9410cdc0 2023-10-05T21:14:36.853 INFO:teuthology.orchestra.run.smithi153.stdout:1 2023-10-05T21:14:36.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.853+0000 7f6d991e0700 1 -- 172.21.15.153:0/906730776 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6d9410cdc0 msgr2=0x7f6d9411bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:36.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.853+0000 7f6d991e0700 1 --2- 172.21.15.153:0/906730776 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6d9410cdc0 0x7f6d9411bd30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6d84000c00 tx=0x7f6d84016000 comp rx=0 tx=0).stop 2023-10-05T21:14:36.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.853+0000 7f6d991e0700 1 -- 172.21.15.153:0/906730776 shutdown_connections 2023-10-05T21:14:36.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.853+0000 7f6d991e0700 1 --2- 172.21.15.153:0/906730776 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6d9410cdc0 0x7f6d9411bd30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:36.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.853+0000 7f6d991e0700 1 -- 172.21.15.153:0/906730776 >> 172.21.15.153:0/906730776 conn(0x7f6d9406b490 msgr2=0x7f6d94112670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:36.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.853+0000 7f6d991e0700 1 -- 172.21.15.153:0/906730776 shutdown_connections 2023-10-05T21:14:36.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.853+0000 7f6d991e0700 1 -- 172.21.15.153:0/906730776 wait complete. 2023-10-05T21:14:36.865 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new cde70c28-f914-4707-aa7d-08e49fcf599c 2 2023-10-05T21:14:36.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.983+0000 7f35364f7700 1 Processor -- start 2023-10-05T21:14:36.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.984+0000 7f35364f7700 1 -- start start 2023-10-05T21:14:36.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.984+0000 7f35364f7700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f353010cdc0 0x7f353010d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:36.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.984+0000 7f35364f7700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f353010d760 con 0x7f35301116c0 2023-10-05T21:14:36.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.984+0000 7f35364f7700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f353004bb40 con 0x7f353010cdc0 2023-10-05T21:14:36.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.984+0000 7f352ffff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f353010cdc0 0x7f353010d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:36.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.984+0000 7f352f7fe700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f35301116c0 0x7f3530111b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:33528/0 (socket says 172.21.15.153:33528) 2023-10-05T21:14:36.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.984+0000 7f352f7fe700 1 -- 172.21.15.153:0/1701590458 learned_addr learned my addr 172.21.15.153:0/1701590458 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:14:36.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.984+0000 7f352ffff700 1 -- 172.21.15.153:0/1701590458 >> v1:172.21.15.111:6789/0 conn(0x7f35301116c0 legacy=0x7f3530111b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:36.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.984+0000 7f352ffff700 1 -- 172.21.15.153:0/1701590458 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3530112240 con 0x7f353010cdc0 2023-10-05T21:14:36.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.985+0000 7f352ffff700 1 --2- 172.21.15.153:0/1701590458 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f353010cdc0 0x7f353010d190 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3520009860 tx=0x7f35200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c6209b43f60af2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:36.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.985+0000 7f352effd700 1 -- 172.21.15.153:0/1701590458 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f352000b680 con 0x7f353010cdc0 2023-10-05T21:14:36.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.985+0000 7f352effd700 1 -- 172.21.15.153:0/1701590458 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352000b7e0 con 0x7f353010cdc0 2023-10-05T21:14:36.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.985+0000 7f352effd700 1 -- 172.21.15.153:0/1701590458 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f352000b990 con 0x7f353010cdc0 2023-10-05T21:14:36.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.985+0000 7f35364f7700 1 -- 172.21.15.153:0/1701590458 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f353010cdc0 msgr2=0x7f353010d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:36.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.985+0000 7f35364f7700 1 --2- 172.21.15.153:0/1701590458 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f353010cdc0 0x7f353010d190 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3520009860 tx=0x7f35200091a0 comp rx=0 tx=0).stop 2023-10-05T21:14:36.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.985+0000 7f35364f7700 1 -- 172.21.15.153:0/1701590458 shutdown_connections 2023-10-05T21:14:36.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.985+0000 7f35364f7700 1 --2- 172.21.15.153:0/1701590458 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f353010cdc0 0x7f353010d190 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:36.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.985+0000 7f35364f7700 1 -- 172.21.15.153:0/1701590458 >> 172.21.15.153:0/1701590458 conn(0x7f353006b490 msgr2=0x7f353010adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:36.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.985+0000 7f35364f7700 1 -- 172.21.15.153:0/1701590458 shutdown_connections 2023-10-05T21:14:36.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.985+0000 7f35364f7700 1 -- 172.21.15.153:0/1701590458 wait complete. 2023-10-05T21:14:36.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.986+0000 7f35364f7700 1 Processor -- start 2023-10-05T21:14:36.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.986+0000 7f35364f7700 1 -- start start 2023-10-05T21:14:36.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.986+0000 7f35364f7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f353010cdc0 0x7f353011bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:36.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.986+0000 7f35364f7700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3530111520 con 0x7f353010cdc0 2023-10-05T21:14:36.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.987+0000 7f352ffff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f353010cdc0 0x7f353011bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:36.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.987+0000 7f352ffff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f353010cdc0 0x7f353011bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:39772/0 (socket says 172.21.15.153:39772) 2023-10-05T21:14:36.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.987+0000 7f352ffff700 1 -- 172.21.15.153:0/1085507532 learned_addr learned my addr 172.21.15.153:0/1085507532 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:14:36.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.987+0000 7f352ffff700 1 -- 172.21.15.153:0/1085507532 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3520009420 con 0x7f353010cdc0 2023-10-05T21:14:36.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.987+0000 7f352ffff700 1 --2- 172.21.15.153:0/1085507532 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f353010cdc0 0x7f353011bdf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3520000c00 tx=0x7f3520016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:36.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.987+0000 7f3517fff700 1 -- 172.21.15.153:0/1085507532 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3520025470 con 0x7f353010cdc0 2023-10-05T21:14:36.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.988+0000 7f3517fff700 1 -- 172.21.15.153:0/1085507532 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35200255d0 con 0x7f353010cdc0 2023-10-05T21:14:36.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.988+0000 7f35364f7700 1 -- 172.21.15.153:0/1085507532 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f353011c330 con 0x7f353010cdc0 2023-10-05T21:14:36.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.988+0000 7f3517fff700 1 -- 172.21.15.153:0/1085507532 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3520025880 con 0x7f353010cdc0 2023-10-05T21:14:36.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.988+0000 7f35364f7700 1 -- 172.21.15.153:0/1085507532 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f353011c7a0 con 0x7f353010cdc0 2023-10-05T21:14:36.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.988+0000 7f3517fff700 1 -- 172.21.15.153:0/1085507532 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f3520022070 con 0x7f353010cdc0 2023-10-05T21:14:36.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.988+0000 7f3517fff700 1 -- 172.21.15.153:0/1085507532 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f3520025c60 con 0x7f353010cdc0 2023-10-05T21:14:36.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.988+0000 7f35364f7700 1 -- 172.21.15.153:0/1085507532 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f353011b9a0 con 0x7f353010cdc0 2023-10-05T21:14:36.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:36.991+0000 7f3517fff700 1 -- 172.21.15.153:0/1085507532 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f3520025e20 con 0x7f353010cdc0 2023-10-05T21:14:37.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.073+0000 7f35364f7700 1 -- 172.21.15.153:0/1085507532 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cde70c28-f914-4707-aa7d-08e49fcf599c", "id": 2} v 0) v1 -- 0x7f353005f230 con 0x7f353010cdc0 2023-10-05T21:14:37.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.076+0000 7f3517fff700 1 -- 172.21.15.153:0/1085507532 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cde70c28-f914-4707-aa7d-08e49fcf599c", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3520005ae0 con 0x7f353010cdc0 2023-10-05T21:14:37.078 INFO:teuthology.orchestra.run.smithi153.stdout:2 2023-10-05T21:14:37.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.077+0000 7f35364f7700 1 -- 172.21.15.153:0/1085507532 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f353010cdc0 msgr2=0x7f353011bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:37.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.077+0000 7f35364f7700 1 --2- 172.21.15.153:0/1085507532 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f353010cdc0 0x7f353011bdf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3520000c00 tx=0x7f3520016000 comp rx=0 tx=0).stop 2023-10-05T21:14:37.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.077+0000 7f35364f7700 1 -- 172.21.15.153:0/1085507532 shutdown_connections 2023-10-05T21:14:37.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.077+0000 7f35364f7700 1 --2- 172.21.15.153:0/1085507532 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f353010cdc0 0x7f353011bdf0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:37.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.077+0000 7f35364f7700 1 -- 172.21.15.153:0/1085507532 >> 172.21.15.153:0/1085507532 conn(0x7f353006b490 msgr2=0x7f3530114700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:37.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.077+0000 7f35364f7700 1 -- 172.21.15.153:0/1085507532 shutdown_connections 2023-10-05T21:14:37.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.077+0000 7f35364f7700 1 -- 172.21.15.153:0/1085507532 wait complete. 2023-10-05T21:14:37.090 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 9095f398-15a3-40b2-9d98-d156bc343bda 3 2023-10-05T21:14:37.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.206+0000 7fd8891b7700 1 Processor -- start 2023-10-05T21:14:37.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.206+0000 7fd8891b7700 1 -- start start 2023-10-05T21:14:37.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.206+0000 7fd8891b7700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd884110a10 0x7fd884110e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:37.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.206+0000 7fd8891b7700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8841113d0 con 0x7fd884068740 2023-10-05T21:14:37.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.206+0000 7fd8891b7700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd88404bb40 con 0x7fd884110a10 2023-10-05T21:14:37.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.207+0000 7fd882d9d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd884110a10 0x7fd884110e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:37.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.207+0000 7fd88259c700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fd884068740 0x7fd884068be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:33532/0 (socket says 172.21.15.153:33532) 2023-10-05T21:14:37.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.207+0000 7fd882d9d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd884110a10 0x7fd884110e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:39778/0 (socket says 172.21.15.153:39778) 2023-10-05T21:14:37.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.207+0000 7fd88259c700 1 -- 172.21.15.153:0/120897195 learned_addr learned my addr 172.21.15.153:0/120897195 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:14:37.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.207+0000 7fd882d9d700 1 -- 172.21.15.153:0/120897195 >> v1:172.21.15.111:6789/0 conn(0x7fd884068740 legacy=0x7fd884068be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:37.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.207+0000 7fd882d9d700 1 -- 172.21.15.153:0/120897195 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8840692f0 con 0x7fd884110a10 2023-10-05T21:14:37.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.207+0000 7fd882d9d700 1 --2- 172.21.15.153:0/120897195 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd884110a10 0x7fd884110e00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd874009860 tx=0x7fd8740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1840ccd22d0859 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:37.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.207+0000 7fd881d9b700 1 -- 172.21.15.153:0/120897195 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd87400b680 con 0x7fd884110a10 2023-10-05T21:14:37.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.207+0000 7fd881d9b700 1 -- 172.21.15.153:0/120897195 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87400b7e0 con 0x7fd884110a10 2023-10-05T21:14:37.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.207+0000 7fd881d9b700 1 -- 172.21.15.153:0/120897195 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd87400b990 con 0x7fd884110a10 2023-10-05T21:14:37.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.208+0000 7fd8891b7700 1 -- 172.21.15.153:0/120897195 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd884110a10 msgr2=0x7fd884110e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:37.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.208+0000 7fd8891b7700 1 --2- 172.21.15.153:0/120897195 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd884110a10 0x7fd884110e00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd874009860 tx=0x7fd8740091a0 comp rx=0 tx=0).stop 2023-10-05T21:14:37.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.208+0000 7fd8891b7700 1 -- 172.21.15.153:0/120897195 shutdown_connections 2023-10-05T21:14:37.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.208+0000 7fd8891b7700 1 --2- 172.21.15.153:0/120897195 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd884110a10 0x7fd884110e00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:37.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.208+0000 7fd8891b7700 1 -- 172.21.15.153:0/120897195 >> 172.21.15.153:0/120897195 conn(0x7fd88406c500 msgr2=0x7fd88406e910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:37.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.208+0000 7fd8891b7700 1 -- 172.21.15.153:0/120897195 shutdown_connections 2023-10-05T21:14:37.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.208+0000 7fd8891b7700 1 -- 172.21.15.153:0/120897195 wait complete. 2023-10-05T21:14:37.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.209+0000 7fd8891b7700 1 Processor -- start 2023-10-05T21:14:37.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.209+0000 7fd8891b7700 1 -- start start 2023-10-05T21:14:37.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.209+0000 7fd8891b7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd884068740 0x7fd884119b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:37.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.209+0000 7fd8891b7700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88406e690 con 0x7fd884068740 2023-10-05T21:14:37.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.209+0000 7fd882d9d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd884068740 0x7fd884119b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:37.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.209+0000 7fd882d9d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd884068740 0x7fd884119b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:39790/0 (socket says 172.21.15.153:39790) 2023-10-05T21:14:37.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.209+0000 7fd882d9d700 1 -- 172.21.15.153:0/3155169137 learned_addr learned my addr 172.21.15.153:0/3155169137 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:14:37.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.209+0000 7fd882d9d700 1 -- 172.21.15.153:0/3155169137 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd874009420 con 0x7fd884068740 2023-10-05T21:14:37.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.209+0000 7fd882d9d700 1 --2- 172.21.15.153:0/3155169137 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd884068740 0x7fd884119b90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd874006eb0 tx=0x7fd874016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:37.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.210+0000 7fd86affd700 1 -- 172.21.15.153:0/3155169137 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd874025470 con 0x7fd884068740 2023-10-05T21:14:37.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.210+0000 7fd86affd700 1 -- 172.21.15.153:0/3155169137 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8740255d0 con 0x7fd884068740 2023-10-05T21:14:37.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.210+0000 7fd8891b7700 1 -- 172.21.15.153:0/3155169137 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd88411a0d0 con 0x7fd884068740 2023-10-05T21:14:37.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.210+0000 7fd86affd700 1 -- 172.21.15.153:0/3155169137 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd874025880 con 0x7fd884068740 2023-10-05T21:14:37.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.210+0000 7fd8891b7700 1 -- 172.21.15.153:0/3155169137 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd88411a5c0 con 0x7fd884068740 2023-10-05T21:14:37.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.210+0000 7fd86affd700 1 -- 172.21.15.153:0/3155169137 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fd874022070 con 0x7fd884068740 2023-10-05T21:14:37.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.210+0000 7fd86affd700 1 -- 172.21.15.153:0/3155169137 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7fd87401bad0 con 0x7fd884068740 2023-10-05T21:14:37.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.210+0000 7fd8891b7700 1 -- 172.21.15.153:0/3155169137 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd88405f230 con 0x7fd884068740 2023-10-05T21:14:37.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.213+0000 7fd86affd700 1 -- 172.21.15.153:0/3155169137 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7fd874025df0 con 0x7fd884068740 2023-10-05T21:14:37.235 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-10-05T21:14:37.234+0000 7f0d4fc851c0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-05T21:14:37.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.293+0000 7fd8891b7700 1 -- 172.21.15.153:0/3155169137 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9095f398-15a3-40b2-9d98-d156bc343bda", "id": 3} v 0) v1 -- 0x7fd884110a10 con 0x7fd884068740 2023-10-05T21:14:37.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.297+0000 7fd86affd700 1 -- 172.21.15.153:0/3155169137 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9095f398-15a3-40b2-9d98-d156bc343bda", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd87401bd30 con 0x7fd884068740 2023-10-05T21:14:37.298 INFO:teuthology.orchestra.run.smithi153.stdout:3 2023-10-05T21:14:37.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.298+0000 7fd8891b7700 1 -- 172.21.15.153:0/3155169137 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd884068740 msgr2=0x7fd884119b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:37.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.298+0000 7fd8891b7700 1 --2- 172.21.15.153:0/3155169137 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd884068740 0x7fd884119b90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd874006eb0 tx=0x7fd874016000 comp rx=0 tx=0).stop 2023-10-05T21:14:37.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.298+0000 7fd8891b7700 1 -- 172.21.15.153:0/3155169137 shutdown_connections 2023-10-05T21:14:37.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.298+0000 7fd8891b7700 1 --2- 172.21.15.153:0/3155169137 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd884068740 0x7fd884119b90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:37.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.298+0000 7fd8891b7700 1 -- 172.21.15.153:0/3155169137 >> 172.21.15.153:0/3155169137 conn(0x7fd88406c500 msgr2=0x7fd88410f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:37.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.298+0000 7fd8891b7700 1 -- 172.21.15.153:0/3155169137 shutdown_connections 2023-10-05T21:14:37.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:37.298+0000 7fd8891b7700 1 -- 172.21.15.153:0/3155169137 wait complete. 2023-10-05T21:14:37.310 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-05T21:14:37.310 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-05T21:14:37.313 INFO:tasks.ceph.osd.0:Started 2023-10-05T21:14:37.313 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-05T21:14:37.313 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-05T21:14:37.315 INFO:tasks.ceph.osd.1:Started 2023-10-05T21:14:37.315 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-05T21:14:37.316 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-05T21:14:37.318 INFO:tasks.ceph.osd.2:Started 2023-10-05T21:14:37.318 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-05T21:14:37.318 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-05T21:14:37.320 INFO:tasks.ceph.osd.3:Started 2023-10-05T21:14:37.320 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T21:14:37.395 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-10-05T21:14:37.393+0000 7f0d4fc851c0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-05T21:14:37.395 INFO:tasks.ceph.osd.3.smithi153.stderr:2023-10-05T21:14:37.394+0000 7f25816c3540 -1 Falling back to public interface 2023-10-05T21:14:37.396 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-10-05T21:14:37.395+0000 7f90bbc12540 -1 Falling back to public interface 2023-10-05T21:14:37.397 INFO:tasks.ceph.osd.0.smithi111.stderr:2023-10-05T21:14:37.396+0000 7fd245aa3540 -1 Falling back to public interface 2023-10-05T21:14:37.401 INFO:tasks.ceph.osd.1.smithi153.stderr:2023-10-05T21:14:37.399+0000 7efcbd2b2540 -1 Falling back to public interface 2023-10-05T21:14:37.409 INFO:tasks.ceph.osd.0.smithi111.stderr:2023-10-05T21:14:37.408+0000 7fd245aa3540 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-05T21:14:37.409 INFO:tasks.ceph.osd.0.smithi111.stderr:2023-10-05T21:14:37.408+0000 7fd245aa3540 -1 journal do_read_entry(8192): bad header magic 2023-10-05T21:14:37.409 INFO:tasks.ceph.osd.0.smithi111.stderr:2023-10-05T21:14:37.408+0000 7fd245aa3540 -1 journal do_read_entry(8192): bad header magic 2023-10-05T21:14:37.409 INFO:tasks.ceph.osd.3.smithi153.stderr:2023-10-05T21:14:37.408+0000 7f25816c3540 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-05T21:14:37.410 INFO:tasks.ceph.osd.3.smithi153.stderr:2023-10-05T21:14:37.408+0000 7f25816c3540 -1 journal do_read_entry(8192): bad header magic 2023-10-05T21:14:37.410 INFO:tasks.ceph.osd.3.smithi153.stderr:2023-10-05T21:14:37.408+0000 7f25816c3540 -1 journal do_read_entry(8192): bad header magic 2023-10-05T21:14:37.411 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-10-05T21:14:37.410+0000 7f90bbc12540 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-05T21:14:37.413 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-10-05T21:14:37.410+0000 7f90bbc12540 -1 journal do_read_entry(8192): bad header magic 2023-10-05T21:14:37.413 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-10-05T21:14:37.410+0000 7f90bbc12540 -1 journal do_read_entry(8192): bad header magic 2023-10-05T21:14:37.415 INFO:tasks.ceph.osd.0.smithi111.stderr:2023-10-05T21:14:37.414+0000 7fd245aa3540 -1 osd.0 0 log_to_monitors true 2023-10-05T21:14:37.417 INFO:tasks.ceph.osd.3.smithi153.stderr:2023-10-05T21:14:37.416+0000 7f25816c3540 -1 osd.3 0 log_to_monitors true 2023-10-05T21:14:37.419 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-10-05T21:14:37.418+0000 7f90bbc12540 -1 osd.2 0 log_to_monitors true 2023-10-05T21:14:37.422 INFO:tasks.ceph.osd.1.smithi153.stderr:2023-10-05T21:14:37.421+0000 7efcbd2b2540 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-05T21:14:37.423 INFO:tasks.ceph.osd.1.smithi153.stderr:2023-10-05T21:14:37.421+0000 7efcbd2b2540 -1 journal do_read_entry(8192): bad header magic 2023-10-05T21:14:37.423 INFO:tasks.ceph.osd.1.smithi153.stderr:2023-10-05T21:14:37.421+0000 7efcbd2b2540 -1 journal do_read_entry(8192): bad header magic 2023-10-05T21:14:37.429 INFO:tasks.ceph.osd.1.smithi153.stderr:2023-10-05T21:14:37.427+0000 7efcbd2b2540 -1 osd.1 0 log_to_monitors true 2023-10-05T21:14:37.454 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.452+0000 7fde2af09700 1 Processor -- start 2023-10-05T21:14:37.454 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.452+0000 7fde2af09700 1 -- start start 2023-10-05T21:14:37.454 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.452+0000 7fde2af09700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fde24092550 0x7fde2412e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:37.454 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.452+0000 7fde2af09700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde240931b0 con 0x7fde24096ec0 2023-10-05T21:14:37.454 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.452+0000 7fde2af09700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde24090810 con 0x7fde24092550 2023-10-05T21:14:37.454 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.452+0000 7fde23fff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fde24092550 0x7fde2412e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:37.454 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.452+0000 7fde28ca5700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fde24096ec0 0x7fde24097290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:58434/0 (socket says 172.21.15.111:58434) 2023-10-05T21:14:37.454 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.452+0000 7fde28ca5700 1 -- 172.21.15.111:0/2701030431 learned_addr learned my addr 172.21.15.111:0/2701030431 (peer_addr_for_me v1:172.21.15.111:0/0) 2023-10-05T21:14:37.455 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.453+0000 7fde23fff700 1 -- 172.21.15.111:0/2701030431 >> v1:172.21.15.111:6789/0 conn(0x7fde24096ec0 legacy=0x7fde24097290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:37.455 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.453+0000 7fde23fff700 1 -- 172.21.15.111:0/2701030431 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde240909d0 con 0x7fde24092550 2023-10-05T21:14:37.455 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.453+0000 7fde23fff700 1 --2- 172.21.15.111:0/2701030431 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde24092550 0x7fde2412e6f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fde10009860 tx=0x7fde100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a71eebf524664 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:37.455 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.453+0000 7fde237fe700 1 -- 172.21.15.111:0/2701030431 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde1000b680 con 0x7fde24092550 2023-10-05T21:14:37.455 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.453+0000 7fde237fe700 1 -- 172.21.15.111:0/2701030431 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1000b7e0 con 0x7fde24092550 2023-10-05T21:14:37.455 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.453+0000 7fde237fe700 1 -- 172.21.15.111:0/2701030431 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde1000bad0 con 0x7fde24092550 2023-10-05T21:14:37.457 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.454+0000 7fde2af09700 1 -- 172.21.15.111:0/2701030431 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde24092550 msgr2=0x7fde2412e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:37.457 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.454+0000 7fde2af09700 1 --2- 172.21.15.111:0/2701030431 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde24092550 0x7fde2412e6f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fde10009860 tx=0x7fde100091a0 comp rx=0 tx=0).stop 2023-10-05T21:14:37.458 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.454+0000 7fde2af09700 1 -- 172.21.15.111:0/2701030431 shutdown_connections 2023-10-05T21:14:37.458 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.454+0000 7fde2af09700 1 --2- 172.21.15.111:0/2701030431 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde24092550 0x7fde2412e6f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:37.458 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.454+0000 7fde2af09700 1 -- 172.21.15.111:0/2701030431 >> 172.21.15.111:0/2701030431 conn(0x7fde24098d70 msgr2=0x7fde24099170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:37.458 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.454+0000 7fde2af09700 1 -- 172.21.15.111:0/2701030431 shutdown_connections 2023-10-05T21:14:37.458 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.454+0000 7fde2af09700 1 -- 172.21.15.111:0/2701030431 wait complete. 2023-10-05T21:14:37.458 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.454+0000 7fde2af09700 1 Processor -- start 2023-10-05T21:14:37.458 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.455+0000 7fde2af09700 1 -- start start 2023-10-05T21:14:37.458 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.455+0000 7fde2af09700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde24092550 0x7fde241385a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:37.458 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.455+0000 7fde2af09700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2408d880 con 0x7fde24092550 2023-10-05T21:14:37.458 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.455+0000 7fde28ca5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde24092550 0x7fde241385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:37.459 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.455+0000 7fde28ca5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde24092550 0x7fde241385a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:41874/0 (socket says 172.21.15.111:41874) 2023-10-05T21:14:37.459 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.455+0000 7fde28ca5700 1 -- 172.21.15.111:0/2210838479 learned_addr learned my addr 172.21.15.111:0/2210838479 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-10-05T21:14:37.459 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.455+0000 7fde28ca5700 1 -- 172.21.15.111:0/2210838479 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde10009420 con 0x7fde24092550 2023-10-05T21:14:37.459 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.455+0000 7fde28ca5700 1 --2- 172.21.15.111:0/2210838479 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde24092550 0x7fde241385a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fde1800c6c0 tx=0x7fde18007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:37.459 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.456+0000 7fde20ff9700 1 -- 172.21.15.111:0/2210838479 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde18007440 con 0x7fde24092550 2023-10-05T21:14:37.459 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.456+0000 7fde20ff9700 1 -- 172.21.15.111:0/2210838479 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde180075a0 con 0x7fde24092550 2023-10-05T21:14:37.459 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.456+0000 7fde2af09700 1 -- 172.21.15.111:0/2210838479 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde2408f950 con 0x7fde24092550 2023-10-05T21:14:37.459 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.456+0000 7fde20ff9700 1 -- 172.21.15.111:0/2210838479 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde18005970 con 0x7fde24092550 2023-10-05T21:14:37.459 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.456+0000 7fde2af09700 1 -- 172.21.15.111:0/2210838479 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde2408ea90 con 0x7fde24092550 2023-10-05T21:14:37.459 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.456+0000 7fde2af09700 1 -- 172.21.15.111:0/2210838479 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde240647e0 con 0x7fde24092550 2023-10-05T21:14:37.460 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.456+0000 7fde20ff9700 1 -- 172.21.15.111:0/2210838479 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fde1801e440 con 0x7fde24092550 2023-10-05T21:14:37.460 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.456+0000 7fde20ff9700 1 -- 172.21.15.111:0/2210838479 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fde18005e20 con 0x7fde24092550 2023-10-05T21:14:37.460 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.458+0000 7fde20ff9700 1 -- 172.21.15.111:0/2210838479 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7fde1801e6f0 con 0x7fde24092550 2023-10-05T21:14:37.525 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.524+0000 7fde2af09700 1 -- 172.21.15.111:0/2210838479 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde2404bb40 con 0x7fde24092550 2023-10-05T21:14:37.525 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.525+0000 7fde20ff9700 1 -- 172.21.15.111:0/2210838479 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4108 (secure 0 0 0) 0x7fde1801e890 con 0x7fde24092550 2023-10-05T21:14:37.526 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:37.526 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":6,"fsid":"eafdd85a-3bd2-413c-acb4-cdb3a151d4a9","created":"2023-10-05T21:14:36.058348+0000","modified":"2023-10-05T21:14:37.295251+0000","last_up_change":"0.000000","last_in_change":"2023-10-05T21:14:37.295251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"5f41de27-2f93-4f50-94db-3104799b246b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"96502bac-f68a-4b39-8f59-057a68c166c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cde70c28-f914-4707-aa7d-08e49fcf599c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9095f398-15a3-40b2-9d98-d156bc343bda","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T21:14:37.527 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.525+0000 7fde2af09700 1 -- 172.21.15.111:0/2210838479 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde24092550 msgr2=0x7fde241385a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:37.527 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.525+0000 7fde2af09700 1 --2- 172.21.15.111:0/2210838479 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde24092550 0x7fde241385a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fde1800c6c0 tx=0x7fde18007de0 comp rx=0 tx=0).stop 2023-10-05T21:14:37.527 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.525+0000 7fde2af09700 1 -- 172.21.15.111:0/2210838479 shutdown_connections 2023-10-05T21:14:37.527 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.525+0000 7fde2af09700 1 --2- 172.21.15.111:0/2210838479 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde24092550 0x7fde241385a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:37.527 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.525+0000 7fde2af09700 1 -- 172.21.15.111:0/2210838479 >> 172.21.15.111:0/2210838479 conn(0x7fde24098d70 msgr2=0x7fde24084ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:37.527 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.526+0000 7fde2af09700 1 -- 172.21.15.111:0/2210838479 shutdown_connections 2023-10-05T21:14:37.527 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:37.526+0000 7fde2af09700 1 -- 172.21.15.111:0/2210838479 wait complete. 2023-10-05T21:14:37.538 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-05T21:14:37.538 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-05T21:14:37.737 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-10-05T21:14:37.736+0000 7f0d4fc851c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-05T21:14:37.940 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-05T21:14:38.050 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.047+0000 7fa9333d1700 1 Processor -- start 2023-10-05T21:14:38.050 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.047+0000 7fa9333d1700 1 -- start start 2023-10-05T21:14:38.050 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.048+0000 7fa9333d1700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fa92c068990 0x7fa92c12e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:38.050 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.048+0000 7fa9333d1700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa92c090cb0 con 0x7fa92c067eb0 2023-10-05T21:14:38.050 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.048+0000 7fa9333d1700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa92c095870 con 0x7fa92c068990 2023-10-05T21:14:38.051 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.048+0000 7fa93096c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fa92c068990 0x7fa92c12e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:38.051 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.048+0000 7fa93116d700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fa92c067eb0 0x7fa92c068280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:58440/0 (socket says 172.21.15.111:58440) 2023-10-05T21:14:38.051 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.048+0000 7fa93116d700 1 -- 172.21.15.111:0/1527579346 learned_addr learned my addr 172.21.15.111:0/1527579346 (peer_addr_for_me v1:172.21.15.111:0/0) 2023-10-05T21:14:38.051 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.048+0000 7fa93096c700 1 -- 172.21.15.111:0/1527579346 >> v1:172.21.15.111:6789/0 conn(0x7fa92c067eb0 legacy=0x7fa92c068280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:38.051 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.048+0000 7fa93096c700 1 -- 172.21.15.111:0/1527579346 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92c091820 con 0x7fa92c068990 2023-10-05T21:14:38.051 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.048+0000 7fa93096c700 1 --2- 172.21.15.111:0/1527579346 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa92c068990 0x7fa92c12e660 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa928009860 tx=0x7fa9280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=612896675ab3daad server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:38.051 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.048+0000 7fa91ffff700 1 -- 172.21.15.111:0/1527579346 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa92800b680 con 0x7fa92c068990 2023-10-05T21:14:38.051 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.048+0000 7fa91ffff700 1 -- 172.21.15.111:0/1527579346 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92800b7e0 con 0x7fa92c068990 2023-10-05T21:14:38.051 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.048+0000 7fa91ffff700 1 -- 172.21.15.111:0/1527579346 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa92800bad0 con 0x7fa92c068990 2023-10-05T21:14:38.051 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.049+0000 7fa9333d1700 1 -- 172.21.15.111:0/1527579346 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa92c068990 msgr2=0x7fa92c12e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:38.052 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.049+0000 7fa9333d1700 1 --2- 172.21.15.111:0/1527579346 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa92c068990 0x7fa92c12e660 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa928009860 tx=0x7fa9280091a0 comp rx=0 tx=0).stop 2023-10-05T21:14:38.052 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.049+0000 7fa9333d1700 1 -- 172.21.15.111:0/1527579346 shutdown_connections 2023-10-05T21:14:38.052 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.049+0000 7fa9333d1700 1 --2- 172.21.15.111:0/1527579346 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa92c068990 0x7fa92c12e660 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:38.052 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.049+0000 7fa9333d1700 1 -- 172.21.15.111:0/1527579346 >> 172.21.15.111:0/1527579346 conn(0x7fa92c095df0 msgr2=0x7fa92c0961f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:38.052 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.049+0000 7fa9333d1700 1 -- 172.21.15.111:0/1527579346 shutdown_connections 2023-10-05T21:14:38.052 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.049+0000 7fa9333d1700 1 -- 172.21.15.111:0/1527579346 wait complete. 2023-10-05T21:14:38.054 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.050+0000 7fa9333d1700 1 Processor -- start 2023-10-05T21:14:38.054 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.050+0000 7fa9333d1700 1 -- start start 2023-10-05T21:14:38.054 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.051+0000 7fa9333d1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa92c067eb0 0x7fa92c138720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:38.054 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.051+0000 7fa9333d1700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c11f320 con 0x7fa92c067eb0 2023-10-05T21:14:38.054 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.051+0000 7fa93116d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa92c067eb0 0x7fa92c138720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:38.054 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.051+0000 7fa93116d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa92c067eb0 0x7fa92c138720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:41894/0 (socket says 172.21.15.111:41894) 2023-10-05T21:14:38.055 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.051+0000 7fa93116d700 1 -- 172.21.15.111:0/717976007 learned_addr learned my addr 172.21.15.111:0/717976007 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-10-05T21:14:38.055 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.051+0000 7fa93116d700 1 -- 172.21.15.111:0/717976007 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa928009420 con 0x7fa92c067eb0 2023-10-05T21:14:38.055 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.051+0000 7fa93116d700 1 --2- 172.21.15.111:0/717976007 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa92c067eb0 0x7fa92c138720 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa92000c6c0 tx=0x7fa920007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:38.055 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.051+0000 7fa91d7fa700 1 -- 172.21.15.111:0/717976007 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa920007440 con 0x7fa92c067eb0 2023-10-05T21:14:38.055 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.052+0000 7fa91d7fa700 1 -- 172.21.15.111:0/717976007 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9200075a0 con 0x7fa92c067eb0 2023-10-05T21:14:38.055 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.052+0000 7fa9333d1700 1 -- 172.21.15.111:0/717976007 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa92c08e880 con 0x7fa92c067eb0 2023-10-05T21:14:38.055 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.052+0000 7fa91d7fa700 1 -- 172.21.15.111:0/717976007 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa920005970 con 0x7fa92c067eb0 2023-10-05T21:14:38.055 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.052+0000 7fa9333d1700 1 -- 172.21.15.111:0/717976007 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa92c120600 con 0x7fa92c067eb0 2023-10-05T21:14:38.055 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.052+0000 7fa91d7fa700 1 -- 172.21.15.111:0/717976007 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fa92001e440 con 0x7fa92c067eb0 2023-10-05T21:14:38.055 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.052+0000 7fa91d7fa700 1 -- 172.21.15.111:0/717976007 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fa920005e20 con 0x7fa92c067eb0 2023-10-05T21:14:38.056 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.052+0000 7fa9333d1700 1 -- 172.21.15.111:0/717976007 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa92c0647e0 con 0x7fa92c067eb0 2023-10-05T21:14:38.056 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.054+0000 7fa91d7fa700 1 -- 172.21.15.111:0/717976007 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7fa92001e920 con 0x7fa92c067eb0 2023-10-05T21:14:38.122 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.121+0000 7fa9333d1700 1 -- 172.21.15.111:0/717976007 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa92c095210 con 0x7fa92c067eb0 2023-10-05T21:14:38.123 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.122+0000 7fa91d7fa700 1 -- 172.21.15.111:0/717976007 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4108 (secure 0 0 0) 0x7fa92001eac0 con 0x7fa92c067eb0 2023-10-05T21:14:38.123 INFO:teuthology.misc.health.smithi111.stdout: 2023-10-05T21:14:38.123 INFO:teuthology.misc.health.smithi111.stdout:{"epoch":6,"fsid":"eafdd85a-3bd2-413c-acb4-cdb3a151d4a9","created":"2023-10-05T21:14:36.058348+0000","modified":"2023-10-05T21:14:37.295251+0000","last_up_change":"0.000000","last_in_change":"2023-10-05T21:14:37.295251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"5f41de27-2f93-4f50-94db-3104799b246b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"96502bac-f68a-4b39-8f59-057a68c166c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cde70c28-f914-4707-aa7d-08e49fcf599c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9095f398-15a3-40b2-9d98-d156bc343bda","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T21:14:38.124 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.123+0000 7fa9333d1700 1 -- 172.21.15.111:0/717976007 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa92c067eb0 msgr2=0x7fa92c138720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:38.124 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.123+0000 7fa9333d1700 1 --2- 172.21.15.111:0/717976007 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa92c067eb0 0x7fa92c138720 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa92000c6c0 tx=0x7fa920007db0 comp rx=0 tx=0).stop 2023-10-05T21:14:38.124 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.123+0000 7fa9333d1700 1 -- 172.21.15.111:0/717976007 shutdown_connections 2023-10-05T21:14:38.124 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.123+0000 7fa9333d1700 1 --2- 172.21.15.111:0/717976007 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa92c067eb0 0x7fa92c138720 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:38.124 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.123+0000 7fa9333d1700 1 -- 172.21.15.111:0/717976007 >> 172.21.15.111:0/717976007 conn(0x7fa92c095df0 msgr2=0x7fa92c087870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:38.124 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.123+0000 7fa9333d1700 1 -- 172.21.15.111:0/717976007 shutdown_connections 2023-10-05T21:14:38.125 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:38.123+0000 7fa9333d1700 1 -- 172.21.15.111:0/717976007 wait complete. 2023-10-05T21:14:38.134 DEBUG:teuthology.misc:0 of 4 OSDs are up 2023-10-05T21:14:38.449 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-10-05T21:14:38.447+0000 7f0d4fc851c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-05T21:14:38.520 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-10-05T21:14:38.518+0000 7f0d4fc851c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-05T21:14:38.649 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-10-05T21:14:38.648+0000 7f0d4fc851c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-05T21:14:38.717 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-10-05T21:14:38.715+0000 7f0d4fc851c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-05T21:14:38.896 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-10-05T21:14:38.895+0000 7f0d4fc851c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-05T21:14:38.973 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-10-05T21:14:38.972+0000 7f0d4fc851c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-05T21:14:39.050 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-10-05T21:14:39.048+0000 7f0d4fc851c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-05T21:14:39.128 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-10-05T21:14:39.127+0000 7f0d4fc851c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-05T21:14:39.302 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-10-05T21:14:39.301+0000 7f90b3018700 -1 osd.2 0 waiting for initial osdmap 2023-10-05T21:14:39.303 INFO:tasks.ceph.osd.0.smithi111.stderr:2023-10-05T21:14:39.301+0000 7fd23cea9700 -1 osd.0 0 waiting for initial osdmap 2023-10-05T21:14:39.303 INFO:tasks.ceph.osd.1.smithi153.stderr:2023-10-05T21:14:39.301+0000 7efcb46b8700 -1 osd.1 0 waiting for initial osdmap 2023-10-05T21:14:39.303 INFO:tasks.ceph.osd.3.smithi153.stderr:2023-10-05T21:14:39.301+0000 7f2578ac9700 -1 osd.3 0 waiting for initial osdmap 2023-10-05T21:14:39.303 INFO:tasks.ceph.osd.0.smithi111.stderr:2023-10-05T21:14:39.303+0000 7fd2394a7700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T21:14:39.304 INFO:tasks.ceph.osd.3.smithi153.stderr:2023-10-05T21:14:39.302+0000 7f25750c7700 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T21:14:39.306 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-10-05T21:14:39.305+0000 7f0d4fc851c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-05T21:14:39.312 INFO:tasks.ceph.osd.1.smithi153.stderr:2023-10-05T21:14:39.311+0000 7efcb0cb6700 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T21:14:39.312 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-10-05T21:14:39.311+0000 7f90af616700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T21:14:39.387 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-10-05T21:14:39.386+0000 7f0d4fc851c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-05T21:14:39.674 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-10-05T21:14:39.672+0000 7f0d4fc851c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-05T21:14:39.743 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-10-05T21:14:39.741+0000 7f0d4fc851c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-05T21:14:40.246 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-10-05T21:14:40.245+0000 7f0d4fc851c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-05T21:14:40.564 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-10-05T21:14:40.563+0000 7f0d4fc851c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-05T21:14:40.702 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-10-05T21:14:40.701+0000 7f0d4fc851c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-05T21:14:41.054 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-10-05T21:14:41.052+0000 7f0d4fc851c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-05T21:14:41.199 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-10-05T21:14:41.197+0000 7f0d4fc851c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-05T21:14:41.348 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-10-05T21:14:41.346+0000 7f0d4fc851c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-05T21:14:41.447 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-10-05T21:14:41.446+0000 7f0d4fc851c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-05T21:14:42.469 INFO:tasks.ceph.mgr.x.smithi153.stderr:2023-10-05T21:14:42.468+0000 7f0d14366700 -1 mgr.server handle_report got status from non-daemon mon.a 2023-10-05T21:14:44.537 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-05T21:14:44.649 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.646+0000 7f06a2625700 1 Processor -- start 2023-10-05T21:14:44.649 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.646+0000 7f06a2625700 1 -- start start 2023-10-05T21:14:44.649 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.646+0000 7f06a2625700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f069c0913c0 0x7f069c12aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:44.650 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.646+0000 7f06a2625700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069c091130 con 0x7f069c125520 2023-10-05T21:14:44.650 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.646+0000 7f06a2625700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f069c090e90 con 0x7f069c0913c0 2023-10-05T21:14:44.650 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.646+0000 7f069b7fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f069c0913c0 0x7f069c12aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:44.650 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.646+0000 7f069bfff700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f069c125520 0x7f069c1258f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:47498/0 (socket says 172.21.15.111:47498) 2023-10-05T21:14:44.650 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.646+0000 7f069bfff700 1 -- 172.21.15.111:0/914531701 learned_addr learned my addr 172.21.15.111:0/914531701 (peer_addr_for_me v1:172.21.15.111:0/0) 2023-10-05T21:14:44.650 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.647+0000 7f069b7fe700 1 -- 172.21.15.111:0/914531701 >> v1:172.21.15.111:6789/0 conn(0x7f069c125520 legacy=0x7f069c1258f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:44.650 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.647+0000 7f069b7fe700 1 -- 172.21.15.111:0/914531701 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069c0945c0 con 0x7f069c0913c0 2023-10-05T21:14:44.650 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.647+0000 7f069b7fe700 1 --2- 172.21.15.111:0/914531701 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f069c0913c0 0x7f069c12aa00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0690009860 tx=0x7f06900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e9b9d62fa8588aa server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:44.650 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.647+0000 7f069affd700 1 -- 172.21.15.111:0/914531701 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f069000b680 con 0x7f069c0913c0 2023-10-05T21:14:44.650 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.647+0000 7f069affd700 1 -- 172.21.15.111:0/914531701 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069000b7e0 con 0x7f069c0913c0 2023-10-05T21:14:44.650 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.647+0000 7f069affd700 1 -- 172.21.15.111:0/914531701 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f069000b990 con 0x7f069c0913c0 2023-10-05T21:14:44.651 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.647+0000 7f06a2625700 1 -- 172.21.15.111:0/914531701 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f069c0913c0 msgr2=0x7f069c12aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:44.651 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.647+0000 7f06a2625700 1 --2- 172.21.15.111:0/914531701 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f069c0913c0 0x7f069c12aa00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0690009860 tx=0x7f06900091a0 comp rx=0 tx=0).stop 2023-10-05T21:14:44.651 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.647+0000 7f06a2625700 1 -- 172.21.15.111:0/914531701 shutdown_connections 2023-10-05T21:14:44.651 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.647+0000 7f06a2625700 1 --2- 172.21.15.111:0/914531701 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f069c0913c0 0x7f069c12aa00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:44.651 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.647+0000 7f06a2625700 1 -- 172.21.15.111:0/914531701 >> 172.21.15.111:0/914531701 conn(0x7f069c0949b0 msgr2=0x7f069c094db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:44.651 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.647+0000 7f06a2625700 1 -- 172.21.15.111:0/914531701 shutdown_connections 2023-10-05T21:14:44.651 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.648+0000 7f06a2625700 1 -- 172.21.15.111:0/914531701 wait complete. 2023-10-05T21:14:44.653 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.648+0000 7f06a2625700 1 Processor -- start 2023-10-05T21:14:44.653 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.648+0000 7f06a2625700 1 -- start start 2023-10-05T21:14:44.653 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.649+0000 7f06a2625700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f069c0913c0 0x7f069c136230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:44.653 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.649+0000 7f06a2625700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c121f40 con 0x7f069c0913c0 2023-10-05T21:14:44.653 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.649+0000 7f069bfff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f069c0913c0 0x7f069c136230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:44.653 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.649+0000 7f069bfff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f069c0913c0 0x7f069c136230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49332/0 (socket says 172.21.15.111:49332) 2023-10-05T21:14:44.653 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.649+0000 7f069bfff700 1 -- 172.21.15.111:0/3894784111 learned_addr learned my addr 172.21.15.111:0/3894784111 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-10-05T21:14:44.654 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.649+0000 7f069bfff700 1 -- 172.21.15.111:0/3894784111 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0690009420 con 0x7f069c0913c0 2023-10-05T21:14:44.654 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.649+0000 7f069bfff700 1 --2- 172.21.15.111:0/3894784111 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f069c0913c0 0x7f069c136230 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f068c00c6c0 tx=0x7f068c007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:44.654 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.649+0000 7f0683fff700 1 -- 172.21.15.111:0/3894784111 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f068c007580 con 0x7f069c0913c0 2023-10-05T21:14:44.654 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.649+0000 7f0683fff700 1 -- 172.21.15.111:0/3894784111 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068c0057f0 con 0x7f069c0913c0 2023-10-05T21:14:44.654 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.649+0000 7f06a2625700 1 -- 172.21.15.111:0/3894784111 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f069c11f940 con 0x7f069c0913c0 2023-10-05T21:14:44.654 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.650+0000 7f0683fff700 1 -- 172.21.15.111:0/3894784111 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f068c005ae0 con 0x7f069c0913c0 2023-10-05T21:14:44.654 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.650+0000 7f06a2625700 1 -- 172.21.15.111:0/3894784111 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f069c06e920 con 0x7f069c0913c0 2023-10-05T21:14:44.654 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.650+0000 7f0683fff700 1 -- 172.21.15.111:0/3894784111 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 4) v1 ==== 42635+0+0 (secure 0 0 0) 0x7f068c005d10 con 0x7f069c0913c0 2023-10-05T21:14:44.654 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.651+0000 7f0683fff700 1 --2- 172.21.15.111:0/3894784111 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0688035840 0x7f0688037cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:44.654 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.651+0000 7f06a2625700 1 -- 172.21.15.111:0/3894784111 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f069c06f0e0 con 0x7f069c0913c0 2023-10-05T21:14:44.654 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.651+0000 7f0683fff700 1 -- 172.21.15.111:0/3894784111 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3125+0+0 (secure 0 0 0) 0x7f068c0476a0 con 0x7f069c0913c0 2023-10-05T21:14:44.655 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.651+0000 7f069b7fe700 1 --2- 172.21.15.111:0/3894784111 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0688035840 0x7f0688037cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:44.655 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.651+0000 7f069b7fe700 1 --2- 172.21.15.111:0/3894784111 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0688035840 0x7f0688037cf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f06900091e0 tx=0x7f0690016000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:44.657 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.656+0000 7f0683fff700 1 -- 172.21.15.111:0/3894784111 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f068c0133c0 con 0x7f069c0913c0 2023-10-05T21:14:44.842 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.840+0000 7f06a2625700 1 -- 172.21.15.111:0/3894784111 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f069c0647e0 con 0x7f069c0913c0 2023-10-05T21:14:44.847 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.845+0000 7f0683fff700 1 -- 172.21.15.111:0/3894784111 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+7519 (secure 0 0 0) 0x7f068c0102c0 con 0x7f069c0913c0 2023-10-05T21:14:44.847 INFO:teuthology.misc.health.smithi111.stdout: 2023-10-05T21:14:44.847 INFO:teuthology.misc.health.smithi111.stdout:{"epoch":13,"fsid":"eafdd85a-3bd2-413c-acb4-cdb3a151d4a9","created":"2023-10-05T21:14:36.058348+0000","modified":"2023-10-05T21:14:44.471223+0000","last_up_change":"2023-10-05T21:14:40.299737+0000","last_in_change":"2023-10-05T21:14:37.295251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T21:14:41.505527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"5f41de27-2f93-4f50-94db-3104799b246b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":111394},{"type":"v1","addr":"172.21.15.111:6801","nonce":111394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":111394},{"type":"v1","addr":"172.21.15.111:6803","nonce":111394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":111394},{"type":"v1","addr":"172.21.15.111:6807","nonce":111394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":111394},{"type":"v1","addr":"172.21.15.111:6805","nonce":111394}]},"public_addr":"172.21.15.111:6801/111394","cluster_addr":"172.21.15.111:6803/111394","heartbeat_back_addr":"172.21.15.111:6807/111394","heartbeat_front_addr":"172.21.15.111:6805/111394","state":["exists","up"]},{"osd":1,"uuid":"96502bac-f68a-4b39-8f59-057a68c166c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":140456},{"type":"v1","addr":"172.21.15.153:6817","nonce":140456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":140456},{"type":"v1","addr":"172.21.15.153:6819","nonce":140456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":140456},{"type":"v1","addr":"172.21.15.153:6823","nonce":140456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":140456},{"type":"v1","addr":"172.21.15.153:6821","nonce":140456}]},"public_addr":"172.21.15.153:6817/140456","cluster_addr":"172.21.15.153:6819/140456","heartbeat_back_addr":"172.21.15.153:6823/140456","heartbeat_front_addr":"172.21.15.153:6821/140456","state":["exists","up"]},{"osd":2,"uuid":"cde70c28-f914-4707-aa7d-08e49fcf599c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":140454},{"type":"v1","addr":"172.21.15.153:6809","nonce":140454}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":140454},{"type":"v1","addr":"172.21.15.153:6811","nonce":140454}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":140454},{"type":"v1","addr":"172.21.15.153:6815","nonce":140454}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":140454},{"type":"v1","addr":"172.21.15.153:6813","nonce":140454}]},"public_addr":"172.21.15.153:6809/140454","cluster_addr":"172.21.15.153:6811/140454","heartbeat_back_addr":"172.21.15.153:6815/140454","heartbeat_front_addr":"172.21.15.153:6813/140454","state":["exists","up"]},{"osd":3,"uuid":"9095f398-15a3-40b2-9d98-d156bc343bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":140455},{"type":"v1","addr":"172.21.15.153:6801","nonce":140455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":140455},{"type":"v1","addr":"172.21.15.153:6803","nonce":140455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":140455},{"type":"v1","addr":"172.21.15.153:6808","nonce":140455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":140455},{"type":"v1","addr":"172.21.15.153:6805","nonce":140455}]},"public_addr":"172.21.15.153:6801/140455","cluster_addr":"172.21.15.153:6803/140455","heartbeat_back_addr":"172.21.15.153:6808/140455","heartbeat_front_addr":"172.21.15.153:6805/140455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T21:14:38.443329+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T21:14:38.471353+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T21:14:38.436233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T21:14:38.415988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T21:14:44.849 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.847+0000 7f06a2625700 1 -- 172.21.15.111:0/3894784111 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0688035840 msgr2=0x7f0688037cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:44.849 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.847+0000 7f06a2625700 1 --2- 172.21.15.111:0/3894784111 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0688035840 0x7f0688037cf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f06900091e0 tx=0x7f0690016000 comp rx=0 tx=0).stop 2023-10-05T21:14:44.849 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.847+0000 7f06a2625700 1 -- 172.21.15.111:0/3894784111 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f069c0913c0 msgr2=0x7f069c136230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:44.850 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.847+0000 7f06a2625700 1 --2- 172.21.15.111:0/3894784111 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f069c0913c0 0x7f069c136230 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f068c00c6c0 tx=0x7f068c007de0 comp rx=0 tx=0).stop 2023-10-05T21:14:44.850 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.847+0000 7f06a2625700 1 -- 172.21.15.111:0/3894784111 shutdown_connections 2023-10-05T21:14:44.850 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.847+0000 7f06a2625700 1 --2- 172.21.15.111:0/3894784111 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0688035840 0x7f0688037cf0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:44.850 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.847+0000 7f06a2625700 1 --2- 172.21.15.111:0/3894784111 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f069c0913c0 0x7f069c136230 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:44.850 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.847+0000 7f06a2625700 1 -- 172.21.15.111:0/3894784111 >> 172.21.15.111:0/3894784111 conn(0x7f069c0949b0 msgr2=0x7f069c08f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:44.850 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.847+0000 7f06a2625700 1 -- 172.21.15.111:0/3894784111 shutdown_connections 2023-10-05T21:14:44.850 INFO:teuthology.misc.health.smithi111.stderr:2023-10-05T21:14:44.847+0000 7f06a2625700 1 -- 172.21.15.111:0/3894784111 wait complete. 2023-10-05T21:14:44.860 DEBUG:teuthology.misc:4 of 4 OSDs are up 2023-10-05T21:14:44.861 INFO:tasks.ceph:Creating RBD pool 2023-10-05T21:14:44.861 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-05T21:14:44.977 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.976+0000 7f79cc008700 1 Processor -- start 2023-10-05T21:14:44.978 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.976+0000 7f79cc008700 1 -- start start 2023-10-05T21:14:44.980 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.976+0000 7f79cc008700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f79c4090430 0x7f79c4090800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:44.980 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.976+0000 7f79cc008700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c4069e30 con 0x7f79c4090d40 2023-10-05T21:14:44.980 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.976+0000 7f79cc008700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c4091850 con 0x7f79c4090430 2023-10-05T21:14:44.980 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.977+0000 7f79c9da4700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f79c4090430 0x7f79c4090800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:44.980 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.977+0000 7f79c95a3700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f79c4090d40 0x7f79c408f090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:47514/0 (socket says 172.21.15.111:47514) 2023-10-05T21:14:44.980 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.977+0000 7f79c95a3700 1 -- 172.21.15.111:0/1474319110 learned_addr learned my addr 172.21.15.111:0/1474319110 (peer_addr_for_me v1:172.21.15.111:0/0) 2023-10-05T21:14:44.980 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.977+0000 7f79c9da4700 1 -- 172.21.15.111:0/1474319110 >> v1:172.21.15.111:6789/0 conn(0x7f79c4090d40 legacy=0x7f79c408f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:44.980 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.977+0000 7f79c9da4700 1 -- 172.21.15.111:0/1474319110 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c4095340 con 0x7f79c4090430 2023-10-05T21:14:44.980 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.977+0000 7f79c8da2700 1 -- 172.21.15.111:0/1474319110 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3912353695 0 0) 0x7f79c0001110 con 0x7f79c4090d40 2023-10-05T21:14:44.981 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.977+0000 7f79c9da4700 1 --2- 172.21.15.111:0/1474319110 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79c4090430 0x7f79c4090800 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f79b4009850 tx=0x7f79b4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62cee2696daadaf2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:44.981 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.977+0000 7f79c8da2700 1 -- 172.21.15.111:0/1474319110 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79b4005c10 con 0x7f79c4090430 2023-10-05T21:14:44.981 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.977+0000 7f79c8da2700 1 -- 172.21.15.111:0/1474319110 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b4005d70 con 0x7f79c4090430 2023-10-05T21:14:44.981 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.977+0000 7f79c8da2700 1 -- 172.21.15.111:0/1474319110 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79b4006190 con 0x7f79c4090430 2023-10-05T21:14:44.981 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.978+0000 7f79cc008700 1 -- 172.21.15.111:0/1474319110 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79c4090430 msgr2=0x7f79c4090800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:44.981 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.978+0000 7f79cc008700 1 --2- 172.21.15.111:0/1474319110 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79c4090430 0x7f79c4090800 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f79b4009850 tx=0x7f79b4009120 comp rx=0 tx=0).stop 2023-10-05T21:14:44.981 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.978+0000 7f79cc008700 1 -- 172.21.15.111:0/1474319110 shutdown_connections 2023-10-05T21:14:44.981 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.978+0000 7f79cc008700 1 --2- 172.21.15.111:0/1474319110 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79c4090430 0x7f79c4090800 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:44.981 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.978+0000 7f79cc008700 1 -- 172.21.15.111:0/1474319110 >> 172.21.15.111:0/1474319110 conn(0x7f79c4095e30 msgr2=0x7f79c4096230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:44.981 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.978+0000 7f79cc008700 1 -- 172.21.15.111:0/1474319110 shutdown_connections 2023-10-05T21:14:44.981 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.978+0000 7f79cc008700 1 -- 172.21.15.111:0/1474319110 wait complete. 2023-10-05T21:14:44.984 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.979+0000 7f79cc008700 1 Processor -- start 2023-10-05T21:14:44.984 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.979+0000 7f79cc008700 1 -- start start 2023-10-05T21:14:44.984 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.979+0000 7f79cc008700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79c4090430 0x7f79c4136220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:44.984 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.979+0000 7f79cc008700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c408f300 con 0x7f79c4090430 2023-10-05T21:14:44.984 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.980+0000 7f79c9da4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79c4090430 0x7f79c4136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:44.984 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.980+0000 7f79c9da4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79c4090430 0x7f79c4136220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49364/0 (socket says 172.21.15.111:49364) 2023-10-05T21:14:44.984 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.980+0000 7f79c9da4700 1 -- 172.21.15.111:0/4000823600 learned_addr learned my addr 172.21.15.111:0/4000823600 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-10-05T21:14:44.984 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.980+0000 7f79c9da4700 1 -- 172.21.15.111:0/4000823600 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b40093c0 con 0x7f79c4090430 2023-10-05T21:14:44.985 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.980+0000 7f79c9da4700 1 --2- 172.21.15.111:0/4000823600 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79c4090430 0x7f79c4136220 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f79b4009390 tx=0x7f79b4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:44.985 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.980+0000 7f79b9ffb700 1 -- 172.21.15.111:0/4000823600 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79b400bb00 con 0x7f79c4090430 2023-10-05T21:14:44.985 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.980+0000 7f79b9ffb700 1 -- 172.21.15.111:0/4000823600 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b400bc60 con 0x7f79c4090430 2023-10-05T21:14:44.985 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.980+0000 7f79cc008700 1 -- 172.21.15.111:0/4000823600 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c408fc30 con 0x7f79c4090430 2023-10-05T21:14:44.985 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.980+0000 7f79b9ffb700 1 -- 172.21.15.111:0/4000823600 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79b401c450 con 0x7f79c4090430 2023-10-05T21:14:44.985 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.980+0000 7f79cc008700 1 -- 172.21.15.111:0/4000823600 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c40681d0 con 0x7f79c4090430 2023-10-05T21:14:44.985 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.981+0000 7f79cc008700 1 -- 172.21.15.111:0/4000823600 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c406ce60 con 0x7f79c4090430 2023-10-05T21:14:44.985 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.981+0000 7f79b9ffb700 1 -- 172.21.15.111:0/4000823600 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 4) v1 ==== 42635+0+0 (secure 0 0 0) 0x7f79b4023030 con 0x7f79c4090430 2023-10-05T21:14:44.985 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.981+0000 7f79b9ffb700 1 --2- 172.21.15.111:0/4000823600 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f79a8035840 0x7f79a8037cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:44.985 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.981+0000 7f79b9ffb700 1 -- 172.21.15.111:0/4000823600 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3125+0+0 (secure 0 0 0) 0x7f79b40497d0 con 0x7f79c4090430 2023-10-05T21:14:44.985 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.982+0000 7f79c95a3700 1 --2- 172.21.15.111:0/4000823600 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f79a8035840 0x7f79a8037cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:44.985 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.982+0000 7f79c95a3700 1 --2- 172.21.15.111:0/4000823600 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f79a8035840 0x7f79a8037cf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f79c0007fd0 tx=0x7f79c0001250 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:44.988 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:44.986+0000 7f79b9ffb700 1 -- 172.21.15.111:0/4000823600 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f79b4024970 con 0x7f79c4090430 2023-10-05T21:14:45.167 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.165+0000 7f79cc008700 1 -- 172.21.15.111:0/4000823600 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f79c411e8b0 con 0x7f79c4090430 2023-10-05T21:14:45.643 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.642+0000 7f79b9ffb700 1 -- 172.21.15.111:0/4000823600 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7f79b4011420 con 0x7f79c4090430 2023-10-05T21:14:45.646 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.644+0000 7f79cc008700 1 -- 172.21.15.111:0/4000823600 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f79a8035840 msgr2=0x7f79a8037cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:45.647 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.644+0000 7f79cc008700 1 --2- 172.21.15.111:0/4000823600 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f79a8035840 0x7f79a8037cf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f79c0007fd0 tx=0x7f79c0001250 comp rx=0 tx=0).stop 2023-10-05T21:14:45.647 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.644+0000 7f79cc008700 1 -- 172.21.15.111:0/4000823600 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79c4090430 msgr2=0x7f79c4136220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:45.647 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.644+0000 7f79cc008700 1 --2- 172.21.15.111:0/4000823600 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79c4090430 0x7f79c4136220 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f79b4009390 tx=0x7f79b4015000 comp rx=0 tx=0).stop 2023-10-05T21:14:45.647 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.644+0000 7f79cc008700 1 -- 172.21.15.111:0/4000823600 shutdown_connections 2023-10-05T21:14:45.647 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.644+0000 7f79cc008700 1 --2- 172.21.15.111:0/4000823600 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f79a8035840 0x7f79a8037cf0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:45.647 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.644+0000 7f79cc008700 1 --2- 172.21.15.111:0/4000823600 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79c4090430 0x7f79c4136220 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:45.647 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.644+0000 7f79cc008700 1 -- 172.21.15.111:0/4000823600 >> 172.21.15.111:0/4000823600 conn(0x7f79c4095e30 msgr2=0x7f79c4084ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:45.647 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.645+0000 7f79cc008700 1 -- 172.21.15.111:0/4000823600 shutdown_connections 2023-10-05T21:14:45.647 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.645+0000 7f79cc008700 1 -- 172.21.15.111:0/4000823600 wait complete. 2023-10-05T21:14:45.648 INFO:teuthology.orchestra.run.smithi111.stderr:pool 'rbd' created 2023-10-05T21:14:45.659 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-05T21:14:45.779 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.776+0000 7f78f5a44700 1 Processor -- start 2023-10-05T21:14:45.779 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.776+0000 7f78f5a44700 1 -- start start 2023-10-05T21:14:45.779 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.776+0000 7f78f5a44700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f78f0129540 0x7f78f0129910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:45.779 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.776+0000 7f78f5a44700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78f0091850 con 0x7f78f0067eb0 2023-10-05T21:14:45.779 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.776+0000 7f78f5a44700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78f0091a80 con 0x7f78f0129540 2023-10-05T21:14:45.779 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.776+0000 7f78eeffd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f78f0129540 0x7f78f0129910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:45.779 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.776+0000 7f78ee7fc700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f78f0067eb0 0x7f78f00682b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:47524/0 (socket says 172.21.15.111:47524) 2023-10-05T21:14:45.779 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.776+0000 7f78ee7fc700 1 -- 172.21.15.111:0/3098752645 learned_addr learned my addr 172.21.15.111:0/3098752645 (peer_addr_for_me v1:172.21.15.111:0/0) 2023-10-05T21:14:45.779 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.777+0000 7f78eeffd700 1 -- 172.21.15.111:0/3098752645 >> v1:172.21.15.111:6789/0 conn(0x7f78f0067eb0 legacy=0x7f78f00682b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:45.779 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.777+0000 7f78eeffd700 1 -- 172.21.15.111:0/3098752645 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f00909b0 con 0x7f78f0129540 2023-10-05T21:14:45.780 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.777+0000 7f78edffb700 1 -- 172.21.15.111:0/3098752645 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2599839650 0 0) 0x7f78f0091850 con 0x7f78f0067eb0 2023-10-05T21:14:45.780 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.777+0000 7f78eeffd700 1 --2- 172.21.15.111:0/3098752645 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78f0129540 0x7f78f0129910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f78e0009860 tx=0x7f78e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=817dd47ad21c6b47 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:45.780 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.777+0000 7f78edffb700 1 -- 172.21.15.111:0/3098752645 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f78e000b680 con 0x7f78f0129540 2023-10-05T21:14:45.780 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.777+0000 7f78edffb700 1 -- 172.21.15.111:0/3098752645 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e000b7e0 con 0x7f78f0129540 2023-10-05T21:14:45.780 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.777+0000 7f78edffb700 1 -- 172.21.15.111:0/3098752645 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f78e000b990 con 0x7f78f0129540 2023-10-05T21:14:45.782 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.778+0000 7f78f5a44700 1 -- 172.21.15.111:0/3098752645 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78f0129540 msgr2=0x7f78f0129910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:45.782 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.778+0000 7f78f5a44700 1 --2- 172.21.15.111:0/3098752645 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78f0129540 0x7f78f0129910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f78e0009860 tx=0x7f78e00091a0 comp rx=0 tx=0).stop 2023-10-05T21:14:45.783 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.778+0000 7f78f5a44700 1 -- 172.21.15.111:0/3098752645 shutdown_connections 2023-10-05T21:14:45.783 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.778+0000 7f78f5a44700 1 --2- 172.21.15.111:0/3098752645 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78f0129540 0x7f78f0129910 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:45.783 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.778+0000 7f78f5a44700 1 -- 172.21.15.111:0/3098752645 >> 172.21.15.111:0/3098752645 conn(0x7f78f00991e0 msgr2=0x7f78f00995b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:45.783 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.778+0000 7f78f5a44700 1 -- 172.21.15.111:0/3098752645 shutdown_connections 2023-10-05T21:14:45.783 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.778+0000 7f78f5a44700 1 -- 172.21.15.111:0/3098752645 wait complete. 2023-10-05T21:14:45.783 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.778+0000 7f78f5a44700 1 Processor -- start 2023-10-05T21:14:45.783 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.779+0000 7f78f5a44700 1 -- start start 2023-10-05T21:14:45.783 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.779+0000 7f78f5a44700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78f0067eb0 0x7f78f0127250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:45.783 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.779+0000 7f78f5a44700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f0126b00 con 0x7f78f0067eb0 2023-10-05T21:14:45.783 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.779+0000 7f78eeffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78f0067eb0 0x7f78f0127250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:45.784 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.779+0000 7f78eeffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78f0067eb0 0x7f78f0127250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49390/0 (socket says 172.21.15.111:49390) 2023-10-05T21:14:45.784 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.779+0000 7f78eeffd700 1 -- 172.21.15.111:0/3137732284 learned_addr learned my addr 172.21.15.111:0/3137732284 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-10-05T21:14:45.784 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.779+0000 7f78eeffd700 1 -- 172.21.15.111:0/3137732284 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e0009420 con 0x7f78f0067eb0 2023-10-05T21:14:45.784 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.779+0000 7f78eeffd700 1 --2- 172.21.15.111:0/3137732284 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78f0067eb0 0x7f78f0127250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f78e00091e0 tx=0x7f78e0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:45.784 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.779+0000 7f78d6ffd700 1 -- 172.21.15.111:0/3137732284 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f78e0011d30 con 0x7f78f0067eb0 2023-10-05T21:14:45.784 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.779+0000 7f78d6ffd700 1 -- 172.21.15.111:0/3137732284 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e0020070 con 0x7f78f0067eb0 2023-10-05T21:14:45.784 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.780+0000 7f78d6ffd700 1 -- 172.21.15.111:0/3137732284 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f78e001b450 con 0x7f78f0067eb0 2023-10-05T21:14:45.784 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.780+0000 7f78f5a44700 1 -- 172.21.15.111:0/3137732284 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78f0126d10 con 0x7f78f0067eb0 2023-10-05T21:14:45.784 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.780+0000 7f78f5a44700 1 -- 172.21.15.111:0/3137732284 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78f0124940 con 0x7f78f0067eb0 2023-10-05T21:14:45.784 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.780+0000 7f78d6ffd700 1 -- 172.21.15.111:0/3137732284 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 4) v1 ==== 42635+0+0 (secure 0 0 0) 0x7f78e0022030 con 0x7f78f0067eb0 2023-10-05T21:14:45.784 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.781+0000 7f78f5a44700 1 -- 172.21.15.111:0/3137732284 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78f0128690 con 0x7f78f0067eb0 2023-10-05T21:14:45.785 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.781+0000 7f78d6ffd700 1 --2- 172.21.15.111:0/3137732284 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f78dc035840 0x7f78dc037cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:45.785 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.781+0000 7f78d6ffd700 1 -- 172.21.15.111:0/3137732284 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3467+0+0 (secure 0 0 0) 0x7f78e0049550 con 0x7f78f0067eb0 2023-10-05T21:14:45.785 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.781+0000 7f78ee7fc700 1 --2- 172.21.15.111:0/3137732284 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f78dc035840 0x7f78dc037cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:45.785 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.781+0000 7f78ee7fc700 1 --2- 172.21.15.111:0/3137732284 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f78dc035840 0x7f78dc037cf0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f78e40011e0 tx=0x7f78e40079d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:45.787 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.785+0000 7f78d6ffd700 1 -- 172.21.15.111:0/3137732284 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f78e00247e0 con 0x7f78f0067eb0 2023-10-05T21:14:45.969 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:45.967+0000 7f78f5a44700 1 -- 172.21.15.111:0/3137732284 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f78f00647e0 con 0x7f78f0067eb0 2023-10-05T21:14:46.484 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.482+0000 7f78d6ffd700 1 -- 172.21.15.111:0/3137732284 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f78e002f020 con 0x7f78f0067eb0 2023-10-05T21:14:46.649 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.647+0000 7f78d6ffd700 1 -- 172.21.15.111:0/3137732284 <== mon.0 v2:172.21.15.111:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7f78e002e5e0 con 0x7f78f0067eb0 2023-10-05T21:14:46.653 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.651+0000 7f78f5a44700 1 -- 172.21.15.111:0/3137732284 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f78dc035840 msgr2=0x7f78dc037cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:46.653 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.651+0000 7f78f5a44700 1 --2- 172.21.15.111:0/3137732284 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f78dc035840 0x7f78dc037cf0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f78e40011e0 tx=0x7f78e40079d0 comp rx=0 tx=0).stop 2023-10-05T21:14:46.653 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.651+0000 7f78f5a44700 1 -- 172.21.15.111:0/3137732284 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78f0067eb0 msgr2=0x7f78f0127250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:46.654 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.651+0000 7f78f5a44700 1 --2- 172.21.15.111:0/3137732284 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78f0067eb0 0x7f78f0127250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f78e00091e0 tx=0x7f78e0016000 comp rx=0 tx=0).stop 2023-10-05T21:14:46.654 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.651+0000 7f78f5a44700 1 -- 172.21.15.111:0/3137732284 shutdown_connections 2023-10-05T21:14:46.654 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.651+0000 7f78f5a44700 1 --2- 172.21.15.111:0/3137732284 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f78dc035840 0x7f78dc037cf0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:46.654 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.651+0000 7f78f5a44700 1 --2- 172.21.15.111:0/3137732284 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78f0067eb0 0x7f78f0127250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:46.654 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.651+0000 7f78f5a44700 1 -- 172.21.15.111:0/3137732284 >> 172.21.15.111:0/3137732284 conn(0x7f78f00991e0 msgr2=0x7f78f0096f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:46.654 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.651+0000 7f78f5a44700 1 -- 172.21.15.111:0/3137732284 shutdown_connections 2023-10-05T21:14:46.654 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.651+0000 7f78f5a44700 1 -- 172.21.15.111:0/3137732284 wait complete. 2023-10-05T21:14:46.654 INFO:teuthology.orchestra.run.smithi111.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-05T21:14:46.667 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-05T21:14:46.668 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-05T21:14:46.668 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-05T21:14:46.668 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-05T21:14:46.668 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-05T21:14:46.792 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.788+0000 7f1f2dc9d700 1 Processor -- start 2023-10-05T21:14:46.792 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.788+0000 7f1f2dc9d700 1 -- start start 2023-10-05T21:14:46.792 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.788+0000 7f1f2dc9d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f1f28090f10 0x7f1f2812b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:46.792 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.788+0000 7f1f2dc9d700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f28091ac0 con 0x7f1f28090430 2023-10-05T21:14:46.792 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.788+0000 7f1f2dc9d700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f280914d0 con 0x7f1f28090f10 2023-10-05T21:14:46.792 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.789+0000 7f1f26ffd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f1f28090f10 0x7f1f2812b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:46.792 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.789+0000 7f1f277fe700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f1f28090430 0x7f1f28090800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:47536/0 (socket says 172.21.15.111:47536) 2023-10-05T21:14:46.792 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.789+0000 7f1f277fe700 1 -- 172.21.15.111:0/3620266976 learned_addr learned my addr 172.21.15.111:0/3620266976 (peer_addr_for_me v1:172.21.15.111:0/0) 2023-10-05T21:14:46.793 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.789+0000 7f1f26ffd700 1 -- 172.21.15.111:0/3620266976 >> v1:172.21.15.111:6789/0 conn(0x7f1f28090430 legacy=0x7f1f28090800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:46.793 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.789+0000 7f1f26ffd700 1 -- 172.21.15.111:0/3620266976 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f28092980 con 0x7f1f28090f10 2023-10-05T21:14:46.793 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.789+0000 7f1f26ffd700 1 --2- 172.21.15.111:0/3620266976 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1f28090f10 0x7f1f2812b3a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1f10009860 tx=0x7f1f100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d58f07cdeed486 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:46.793 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.789+0000 7f1f267fc700 1 -- 172.21.15.111:0/3620266976 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f1000b680 con 0x7f1f28090f10 2023-10-05T21:14:46.793 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.789+0000 7f1f267fc700 1 -- 172.21.15.111:0/3620266976 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f1000b7e0 con 0x7f1f28090f10 2023-10-05T21:14:46.793 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.789+0000 7f1f267fc700 1 -- 172.21.15.111:0/3620266976 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f1000bad0 con 0x7f1f28090f10 2023-10-05T21:14:46.793 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.790+0000 7f1f2dc9d700 1 -- 172.21.15.111:0/3620266976 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1f28090f10 msgr2=0x7f1f2812b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:46.793 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.790+0000 7f1f2dc9d700 1 --2- 172.21.15.111:0/3620266976 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1f28090f10 0x7f1f2812b3a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1f10009860 tx=0x7f1f100091a0 comp rx=0 tx=0).stop 2023-10-05T21:14:46.793 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.790+0000 7f1f2dc9d700 1 -- 172.21.15.111:0/3620266976 shutdown_connections 2023-10-05T21:14:46.793 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.790+0000 7f1f2dc9d700 1 --2- 172.21.15.111:0/3620266976 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1f28090f10 0x7f1f2812b3a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:46.793 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.790+0000 7f1f2dc9d700 1 -- 172.21.15.111:0/3620266976 >> 172.21.15.111:0/3620266976 conn(0x7f1f28099170 msgr2=0x7f1f28099570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:46.794 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.790+0000 7f1f2dc9d700 1 -- 172.21.15.111:0/3620266976 shutdown_connections 2023-10-05T21:14:46.794 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.790+0000 7f1f2dc9d700 1 -- 172.21.15.111:0/3620266976 wait complete. 2023-10-05T21:14:46.796 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.791+0000 7f1f2dc9d700 1 Processor -- start 2023-10-05T21:14:46.796 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.791+0000 7f1f2dc9d700 1 -- start start 2023-10-05T21:14:46.796 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.791+0000 7f1f2dc9d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1f28090430 0x7f1f2808fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:46.796 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.791+0000 7f1f2dc9d700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2808f670 con 0x7f1f28090430 2023-10-05T21:14:46.796 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.791+0000 7f1f277fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1f28090430 0x7f1f2808fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:46.796 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.791+0000 7f1f277fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1f28090430 0x7f1f2808fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49400/0 (socket says 172.21.15.111:49400) 2023-10-05T21:14:46.796 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.791+0000 7f1f277fe700 1 -- 172.21.15.111:0/1643372088 learned_addr learned my addr 172.21.15.111:0/1643372088 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-10-05T21:14:46.796 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.791+0000 7f1f277fe700 1 -- 172.21.15.111:0/1643372088 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f10009420 con 0x7f1f28090430 2023-10-05T21:14:46.797 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.791+0000 7f1f277fe700 1 --2- 172.21.15.111:0/1643372088 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1f28090430 0x7f1f2808fa30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1f2000cc30 tx=0x7f1f20001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:46.797 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.792+0000 7f1f1f7fe700 1 -- 172.21.15.111:0/1643372088 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f20004c10 con 0x7f1f28090430 2023-10-05T21:14:46.797 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.792+0000 7f1f1f7fe700 1 -- 172.21.15.111:0/1643372088 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f20004d70 con 0x7f1f28090430 2023-10-05T21:14:46.797 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.792+0000 7f1f2dc9d700 1 -- 172.21.15.111:0/1643372088 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f28068100 con 0x7f1f28090430 2023-10-05T21:14:46.797 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.792+0000 7f1f1f7fe700 1 -- 172.21.15.111:0/1643372088 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f2000aaa0 con 0x7f1f28090430 2023-10-05T21:14:46.797 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.792+0000 7f1f2dc9d700 1 -- 172.21.15.111:0/1643372088 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f280688f0 con 0x7f1f28090430 2023-10-05T21:14:46.797 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.792+0000 7f1f1f7fe700 1 -- 172.21.15.111:0/1643372088 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f1f2000ac00 con 0x7f1f28090430 2023-10-05T21:14:46.797 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.792+0000 7f1f2dc9d700 1 -- 172.21.15.111:0/1643372088 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f280647e0 con 0x7f1f28090430 2023-10-05T21:14:46.797 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.793+0000 7f1f1f7fe700 1 --2- 172.21.15.111:0/1643372088 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1f0c0358d0 0x7f1f0c037d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:46.797 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.793+0000 7f1f1f7fe700 1 -- 172.21.15.111:0/1643372088 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f1f200476e0 con 0x7f1f28090430 2023-10-05T21:14:46.797 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.793+0000 7f1f26ffd700 1 --2- 172.21.15.111:0/1643372088 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1f0c0358d0 0x7f1f0c037d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:46.798 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.793+0000 7f1f26ffd700 1 --2- 172.21.15.111:0/1643372088 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1f0c0358d0 0x7f1f0c037d80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1f100091e0 tx=0x7f1f10016000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:46.799 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:46.797+0000 7f1f1f7fe700 1 -- 172.21.15.111:0/1643372088 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1f20010300 con 0x7f1f28090430 2023-10-05T21:14:47.032 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.030+0000 7f1f2dc9d700 1 -- 172.21.15.111:0/1643372088 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f1f2804bb40 con 0x7f1f28090430 2023-10-05T21:14:47.033 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.032+0000 7f1f1f7fe700 1 -- 172.21.15.111:0/1643372088 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+82707 (secure 0 0 0) 0x7f1f20018030 con 0x7f1f28090430 2023-10-05T21:14:47.035 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:47.036 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.034+0000 7f1f2dc9d700 1 -- 172.21.15.111:0/1643372088 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1f0c0358d0 msgr2=0x7f1f0c037d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:47.036 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.034+0000 7f1f2dc9d700 1 --2- 172.21.15.111:0/1643372088 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1f0c0358d0 0x7f1f0c037d80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1f100091e0 tx=0x7f1f10016000 comp rx=0 tx=0).stop 2023-10-05T21:14:47.036 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.034+0000 7f1f2dc9d700 1 -- 172.21.15.111:0/1643372088 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1f28090430 msgr2=0x7f1f2808fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:47.036 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.034+0000 7f1f2dc9d700 1 --2- 172.21.15.111:0/1643372088 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1f28090430 0x7f1f2808fa30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1f2000cc30 tx=0x7f1f20001ad0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.036 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.034+0000 7f1f2dc9d700 1 -- 172.21.15.111:0/1643372088 shutdown_connections 2023-10-05T21:14:47.037 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.034+0000 7f1f2dc9d700 1 --2- 172.21.15.111:0/1643372088 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1f0c0358d0 0x7f1f0c037d80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.037 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.034+0000 7f1f2dc9d700 1 --2- 172.21.15.111:0/1643372088 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1f28090430 0x7f1f2808fa30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.037 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.034+0000 7f1f2dc9d700 1 -- 172.21.15.111:0/1643372088 >> 172.21.15.111:0/1643372088 conn(0x7f1f28099170 msgr2=0x7f1f2811e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:47.037 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.034+0000 7f1f2dc9d700 1 -- 172.21.15.111:0/1643372088 shutdown_connections 2023-10-05T21:14:47.037 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.034+0000 7f1f2dc9d700 1 -- 172.21.15.111:0/1643372088 wait complete. 2023-10-05T21:14:47.047 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":5,"active_gid":4098,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":140077},{"type":"v1","addr":"172.21.15.153:6825","nonce":140077}]},"active_addr":"172.21.15.153:6825/140077","active_change":"2023-10-05T21:14:41.459772+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.153:0","nonce":3278219778}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.153:0","nonce":1789645757}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.153:0","nonce":1979485754}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.153:0","nonce":1001949239}]}]} 2023-10-05T21:14:47.050 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-05T21:14:47.050 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-05T21:14:47.050 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T21:14:47.168 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.164+0000 7f2096cd9700 1 Processor -- start 2023-10-05T21:14:47.168 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.164+0000 7f2096cd9700 1 -- start start 2023-10-05T21:14:47.168 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.164+0000 7f2096cd9700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f20901295c0 0x7f2090129990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:47.168 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.164+0000 7f2096cd9700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20900918d0 con 0x7f2090067eb0 2023-10-05T21:14:47.168 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.164+0000 7f2096cd9700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2090091b00 con 0x7f20901295c0 2023-10-05T21:14:47.168 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.164+0000 7f2094a75700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f20901295c0 0x7f2090129990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:47.168 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.164+0000 7f208ffff700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f2090067eb0 0x7f2090068350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:47540/0 (socket says 172.21.15.111:47540) 2023-10-05T21:14:47.169 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.164+0000 7f208ffff700 1 -- 172.21.15.111:0/3247890941 learned_addr learned my addr 172.21.15.111:0/3247890941 (peer_addr_for_me v1:172.21.15.111:0/0) 2023-10-05T21:14:47.169 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.164+0000 7f2094a75700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f20901295c0 0x7f2090129990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49402/0 (socket says 172.21.15.111:49402) 2023-10-05T21:14:47.169 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.165+0000 7f2094a75700 1 -- 172.21.15.111:0/3247890941 >> v1:172.21.15.111:6789/0 conn(0x7f2090067eb0 legacy=0x7f2090068350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:47.169 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.165+0000 7f208f7fe700 1 -- 172.21.15.111:0/3247890941 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1345447570 0 0) 0x7f20900918d0 con 0x7f2090067eb0 2023-10-05T21:14:47.169 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.165+0000 7f2094a75700 1 -- 172.21.15.111:0/3247890941 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2090094eb0 con 0x7f20901295c0 2023-10-05T21:14:47.169 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.165+0000 7f2094a75700 1 --2- 172.21.15.111:0/3247890941 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20901295c0 0x7f2090129990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2084009860 tx=0x7f20840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67f4e0925bf9cc server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:47.169 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.165+0000 7f208f7fe700 1 -- 172.21.15.111:0/3247890941 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f208400b680 con 0x7f20901295c0 2023-10-05T21:14:47.169 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.165+0000 7f208f7fe700 1 -- 172.21.15.111:0/3247890941 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208400b7e0 con 0x7f20901295c0 2023-10-05T21:14:47.169 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.165+0000 7f208f7fe700 1 -- 172.21.15.111:0/3247890941 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f208400b990 con 0x7f20901295c0 2023-10-05T21:14:47.169 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.165+0000 7f2096cd9700 1 -- 172.21.15.111:0/3247890941 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20901295c0 msgr2=0x7f2090129990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:47.169 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.165+0000 7f2096cd9700 1 --2- 172.21.15.111:0/3247890941 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20901295c0 0x7f2090129990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2084009860 tx=0x7f20840091a0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.170 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.165+0000 7f2096cd9700 1 -- 172.21.15.111:0/3247890941 shutdown_connections 2023-10-05T21:14:47.170 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.165+0000 7f2096cd9700 1 --2- 172.21.15.111:0/3247890941 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20901295c0 0x7f2090129990 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.170 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.165+0000 7f2096cd9700 1 -- 172.21.15.111:0/3247890941 >> 172.21.15.111:0/3247890941 conn(0x7f20900991c0 msgr2=0x7f20900995c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:47.170 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.165+0000 7f2096cd9700 1 -- 172.21.15.111:0/3247890941 shutdown_connections 2023-10-05T21:14:47.170 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.165+0000 7f2096cd9700 1 -- 172.21.15.111:0/3247890941 wait complete. 2023-10-05T21:14:47.170 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.166+0000 7f2096cd9700 1 Processor -- start 2023-10-05T21:14:47.170 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.166+0000 7f2096cd9700 1 -- start start 2023-10-05T21:14:47.172 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.167+0000 7f2096cd9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2090067eb0 0x7f2090127150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:47.172 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.167+0000 7f2096cd9700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2090125930 con 0x7f2090067eb0 2023-10-05T21:14:47.172 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.167+0000 7f2094a75700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2090067eb0 0x7f2090127150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:47.172 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.167+0000 7f2094a75700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2090067eb0 0x7f2090127150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49412/0 (socket says 172.21.15.111:49412) 2023-10-05T21:14:47.172 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.167+0000 7f2094a75700 1 -- 172.21.15.111:0/1801630332 learned_addr learned my addr 172.21.15.111:0/1801630332 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-10-05T21:14:47.172 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.167+0000 7f2094a75700 1 -- 172.21.15.111:0/1801630332 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2084009420 con 0x7f2090067eb0 2023-10-05T21:14:47.172 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.167+0000 7f2094a75700 1 --2- 172.21.15.111:0/1801630332 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2090067eb0 0x7f2090127150 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f20840091e0 tx=0x7f2084016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:47.173 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.167+0000 7f208cff9700 1 -- 172.21.15.111:0/1801630332 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2084011e30 con 0x7f2090067eb0 2023-10-05T21:14:47.173 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.167+0000 7f208cff9700 1 -- 172.21.15.111:0/1801630332 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2084020070 con 0x7f2090067eb0 2023-10-05T21:14:47.173 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.167+0000 7f208cff9700 1 -- 172.21.15.111:0/1801630332 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f208401b5d0 con 0x7f2090067eb0 2023-10-05T21:14:47.173 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.167+0000 7f2096cd9700 1 -- 172.21.15.111:0/1801630332 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2090125af0 con 0x7f2090067eb0 2023-10-05T21:14:47.173 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.167+0000 7f2096cd9700 1 -- 172.21.15.111:0/1801630332 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20901250f0 con 0x7f2090067eb0 2023-10-05T21:14:47.173 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.168+0000 7f208cff9700 1 -- 172.21.15.111:0/1801630332 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f2084022030 con 0x7f2090067eb0 2023-10-05T21:14:47.173 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.168+0000 7f208cff9700 1 --2- 172.21.15.111:0/1801630332 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f20740358d0 0x7f2074037d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:47.173 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.168+0000 7f2096cd9700 1 -- 172.21.15.111:0/1801630332 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2090126fb0 con 0x7f2090067eb0 2023-10-05T21:14:47.173 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.168+0000 7f208cff9700 1 -- 172.21.15.111:0/1801630332 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f2084049890 con 0x7f2090067eb0 2023-10-05T21:14:47.173 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.169+0000 7f208ffff700 1 --2- 172.21.15.111:0/1801630332 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f20740358d0 0x7f2074037d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:47.173 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.169+0000 7f208ffff700 1 --2- 172.21.15.111:0/1801630332 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f20740358d0 0x7f2074037d80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f207c0011e0 tx=0x7f207c0079d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:47.175 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.173+0000 7f208cff9700 1 -- 172.21.15.111:0/1801630332 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2090126fb0 con 0x7f2090067eb0 2023-10-05T21:14:47.359 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.357+0000 7f2096cd9700 1 -- 172.21.15.111:0/1801630332 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2090097e80 con 0x7f2090067eb0 2023-10-05T21:14:47.359 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.358+0000 7f208cff9700 1 -- 172.21.15.111:0/1801630332 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+9051 (secure 0 0 0) 0x7f208401a9c0 con 0x7f2090067eb0 2023-10-05T21:14:47.360 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:47.360 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":15,"fsid":"eafdd85a-3bd2-413c-acb4-cdb3a151d4a9","created":"2023-10-05T21:14:36.058348+0000","modified":"2023-10-05T21:14:46.642017+0000","last_up_change":"2023-10-05T21:14:40.299737+0000","last_in_change":"2023-10-05T21:14:37.295251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T21:14:41.505527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-05T21:14:45.184009+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"5f41de27-2f93-4f50-94db-3104799b246b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":111394},{"type":"v1","addr":"172.21.15.111:6801","nonce":111394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":111394},{"type":"v1","addr":"172.21.15.111:6803","nonce":111394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":111394},{"type":"v1","addr":"172.21.15.111:6807","nonce":111394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":111394},{"type":"v1","addr":"172.21.15.111:6805","nonce":111394}]},"public_addr":"172.21.15.111:6801/111394","cluster_addr":"172.21.15.111:6803/111394","heartbeat_back_addr":"172.21.15.111:6807/111394","heartbeat_front_addr":"172.21.15.111:6805/111394","state":["exists","up"]},{"osd":1,"uuid":"96502bac-f68a-4b39-8f59-057a68c166c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":140456},{"type":"v1","addr":"172.21.15.153:6817","nonce":140456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":140456},{"type":"v1","addr":"172.21.15.153:6819","nonce":140456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":140456},{"type":"v1","addr":"172.21.15.153:6823","nonce":140456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":140456},{"type":"v1","addr":"172.21.15.153:6821","nonce":140456}]},"public_addr":"172.21.15.153:6817/140456","cluster_addr":"172.21.15.153:6819/140456","heartbeat_back_addr":"172.21.15.153:6823/140456","heartbeat_front_addr":"172.21.15.153:6821/140456","state":["exists","up"]},{"osd":2,"uuid":"cde70c28-f914-4707-aa7d-08e49fcf599c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":140454},{"type":"v1","addr":"172.21.15.153:6809","nonce":140454}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":140454},{"type":"v1","addr":"172.21.15.153:6811","nonce":140454}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":140454},{"type":"v1","addr":"172.21.15.153:6815","nonce":140454}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":140454},{"type":"v1","addr":"172.21.15.153:6813","nonce":140454}]},"public_addr":"172.21.15.153:6809/140454","cluster_addr":"172.21.15.153:6811/140454","heartbeat_back_addr":"172.21.15.153:6815/140454","heartbeat_front_addr":"172.21.15.153:6813/140454","state":["exists","up"]},{"osd":3,"uuid":"9095f398-15a3-40b2-9d98-d156bc343bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":140455},{"type":"v1","addr":"172.21.15.153:6801","nonce":140455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":140455},{"type":"v1","addr":"172.21.15.153:6803","nonce":140455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":140455},{"type":"v1","addr":"172.21.15.153:6808","nonce":140455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":140455},{"type":"v1","addr":"172.21.15.153:6805","nonce":140455}]},"public_addr":"172.21.15.153:6801/140455","cluster_addr":"172.21.15.153:6803/140455","heartbeat_back_addr":"172.21.15.153:6808/140455","heartbeat_front_addr":"172.21.15.153:6805/140455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T21:14:38.443329+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T21:14:38.471353+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T21:14:38.436233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T21:14:38.415988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T21:14:47.362 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.360+0000 7f2096cd9700 1 -- 172.21.15.111:0/1801630332 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f20740358d0 msgr2=0x7f2074037d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:47.362 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.360+0000 7f2096cd9700 1 --2- 172.21.15.111:0/1801630332 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f20740358d0 0x7f2074037d80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f207c0011e0 tx=0x7f207c0079d0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.362 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.360+0000 7f2096cd9700 1 -- 172.21.15.111:0/1801630332 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2090067eb0 msgr2=0x7f2090127150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:47.362 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.360+0000 7f2096cd9700 1 --2- 172.21.15.111:0/1801630332 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2090067eb0 0x7f2090127150 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f20840091e0 tx=0x7f2084016000 comp rx=0 tx=0).stop 2023-10-05T21:14:47.363 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.360+0000 7f2096cd9700 1 -- 172.21.15.111:0/1801630332 shutdown_connections 2023-10-05T21:14:47.363 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.360+0000 7f2096cd9700 1 --2- 172.21.15.111:0/1801630332 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f20740358d0 0x7f2074037d80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.363 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.360+0000 7f2096cd9700 1 --2- 172.21.15.111:0/1801630332 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2090067eb0 0x7f2090127150 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.363 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.360+0000 7f2096cd9700 1 -- 172.21.15.111:0/1801630332 >> 172.21.15.111:0/1801630332 conn(0x7f20900991c0 msgr2=0x7f209012bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:47.363 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.360+0000 7f2096cd9700 1 -- 172.21.15.111:0/1801630332 shutdown_connections 2023-10-05T21:14:47.363 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.360+0000 7f2096cd9700 1 -- 172.21.15.111:0/1801630332 wait complete. 2023-10-05T21:14:47.373 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-05T21:14:47.373 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T21:14:47.491 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.488+0000 7f023d0ac700 1 Processor -- start 2023-10-05T21:14:47.491 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.488+0000 7f023d0ac700 1 -- start start 2023-10-05T21:14:47.492 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.488+0000 7f023d0ac700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f023806b130 0x7f023806b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:47.492 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.488+0000 7f023d0ac700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02380961c0 con 0x7f023806ba40 2023-10-05T21:14:47.492 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.488+0000 7f023d0ac700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f023806c6e0 con 0x7f023806b130 2023-10-05T21:14:47.492 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.488+0000 7f0236d9d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f023806b130 0x7f023806b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:47.492 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.488+0000 7f023659c700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f023806ba40 0x7f023812d990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:47548/0 (socket says 172.21.15.111:47548) 2023-10-05T21:14:47.492 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.488+0000 7f023659c700 1 -- 172.21.15.111:0/591877826 learned_addr learned my addr 172.21.15.111:0/591877826 (peer_addr_for_me v1:172.21.15.111:0/0) 2023-10-05T21:14:47.492 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.488+0000 7f0236d9d700 1 -- 172.21.15.111:0/591877826 >> v1:172.21.15.111:6789/0 conn(0x7f023806ba40 legacy=0x7f023812d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:47.492 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.488+0000 7f0236d9d700 1 -- 172.21.15.111:0/591877826 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023806cab0 con 0x7f023806b130 2023-10-05T21:14:47.492 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.489+0000 7f0236d9d700 1 --2- 172.21.15.111:0/591877826 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f023806b130 0x7f023806b500 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0228009860 tx=0x7f02280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca24477eff4f78d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:47.492 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.489+0000 7f0235d9b700 1 -- 172.21.15.111:0/591877826 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f022800b680 con 0x7f023806b130 2023-10-05T21:14:47.492 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.489+0000 7f0235d9b700 1 -- 172.21.15.111:0/591877826 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022800b7e0 con 0x7f023806b130 2023-10-05T21:14:47.493 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.489+0000 7f0235d9b700 1 -- 172.21.15.111:0/591877826 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f022800b990 con 0x7f023806b130 2023-10-05T21:14:47.493 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.489+0000 7f023d0ac700 1 -- 172.21.15.111:0/591877826 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f023806b130 msgr2=0x7f023806b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:47.493 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.489+0000 7f023d0ac700 1 --2- 172.21.15.111:0/591877826 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f023806b130 0x7f023806b500 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0228009860 tx=0x7f02280091a0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.493 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.489+0000 7f023d0ac700 1 -- 172.21.15.111:0/591877826 shutdown_connections 2023-10-05T21:14:47.493 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.489+0000 7f023d0ac700 1 --2- 172.21.15.111:0/591877826 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f023806b130 0x7f023806b500 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.493 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.489+0000 7f023d0ac700 1 -- 172.21.15.111:0/591877826 >> 172.21.15.111:0/591877826 conn(0x7f02380956b0 msgr2=0x7f0238095ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:47.493 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.489+0000 7f023d0ac700 1 -- 172.21.15.111:0/591877826 shutdown_connections 2023-10-05T21:14:47.493 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.489+0000 7f023d0ac700 1 -- 172.21.15.111:0/591877826 wait complete. 2023-10-05T21:14:47.495 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.490+0000 7f023d0ac700 1 Processor -- start 2023-10-05T21:14:47.496 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.490+0000 7f023d0ac700 1 -- start start 2023-10-05T21:14:47.496 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.491+0000 7f023d0ac700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f023806b130 0x7f023811d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:47.496 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.491+0000 7f023d0ac700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0238120950 con 0x7f023806b130 2023-10-05T21:14:47.496 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.491+0000 7f0236d9d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f023806b130 0x7f023811d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:47.496 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.491+0000 7f0236d9d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f023806b130 0x7f023811d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49442/0 (socket says 172.21.15.111:49442) 2023-10-05T21:14:47.496 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.491+0000 7f0236d9d700 1 -- 172.21.15.111:0/963437288 learned_addr learned my addr 172.21.15.111:0/963437288 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-10-05T21:14:47.496 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.491+0000 7f0236d9d700 1 -- 172.21.15.111:0/963437288 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0228009420 con 0x7f023806b130 2023-10-05T21:14:47.496 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.491+0000 7f0236d9d700 1 --2- 172.21.15.111:0/963437288 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f023806b130 0x7f023811d8b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0228000c00 tx=0x7f0228016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:47.496 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.491+0000 7f021effd700 1 -- 172.21.15.111:0/963437288 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0228024470 con 0x7f023806b130 2023-10-05T21:14:47.496 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.491+0000 7f021effd700 1 -- 172.21.15.111:0/963437288 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02280245d0 con 0x7f023806b130 2023-10-05T21:14:47.497 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.491+0000 7f023d0ac700 1 -- 172.21.15.111:0/963437288 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f023811ec00 con 0x7f023806b130 2023-10-05T21:14:47.497 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.491+0000 7f021effd700 1 -- 172.21.15.111:0/963437288 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0228024740 con 0x7f023806b130 2023-10-05T21:14:47.497 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.491+0000 7f023d0ac700 1 -- 172.21.15.111:0/963437288 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0238091f20 con 0x7f023806b130 2023-10-05T21:14:47.497 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.492+0000 7f021effd700 1 -- 172.21.15.111:0/963437288 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f0228021070 con 0x7f023806b130 2023-10-05T21:14:47.497 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.492+0000 7f021effd700 1 --2- 172.21.15.111:0/963437288 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f02240358d0 0x7f0224037d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:47.497 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.492+0000 7f021effd700 1 -- 172.21.15.111:0/963437288 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f02280495c0 con 0x7f023806b130 2023-10-05T21:14:47.498 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.492+0000 7f023d0ac700 1 -- 172.21.15.111:0/963437288 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0238120750 con 0x7f023806b130 2023-10-05T21:14:47.498 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.492+0000 7f023659c700 1 --2- 172.21.15.111:0/963437288 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f02240358d0 0x7f0224037d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:47.498 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.493+0000 7f023659c700 1 --2- 172.21.15.111:0/963437288 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f02240358d0 0x7f0224037d80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f022c0016a0 tx=0x7f022c007b30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:47.498 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.497+0000 7f021effd700 1 -- 172.21.15.111:0/963437288 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f022801a460 con 0x7f023806b130 2023-10-05T21:14:47.680 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.679+0000 7f023d0ac700 1 -- 172.21.15.111:0/963437288 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02380647e0 con 0x7f023806b130 2023-10-05T21:14:47.681 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.679+0000 7f021effd700 1 -- 172.21.15.111:0/963437288 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+9038 (secure 0 0 0) 0x7f022802c3a0 con 0x7f023806b130 2023-10-05T21:14:47.682 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:47.682 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":16,"fsid":"eafdd85a-3bd2-413c-acb4-cdb3a151d4a9","created":"2023-10-05T21:14:36.058348+0000","modified":"2023-10-05T21:14:47.645543+0000","last_up_change":"2023-10-05T21:14:40.299737+0000","last_in_change":"2023-10-05T21:14:37.295251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T21:14:41.505527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-05T21:14:45.184009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"5f41de27-2f93-4f50-94db-3104799b246b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":111394},{"type":"v1","addr":"172.21.15.111:6801","nonce":111394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":111394},{"type":"v1","addr":"172.21.15.111:6803","nonce":111394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":111394},{"type":"v1","addr":"172.21.15.111:6807","nonce":111394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":111394},{"type":"v1","addr":"172.21.15.111:6805","nonce":111394}]},"public_addr":"172.21.15.111:6801/111394","cluster_addr":"172.21.15.111:6803/111394","heartbeat_back_addr":"172.21.15.111:6807/111394","heartbeat_front_addr":"172.21.15.111:6805/111394","state":["exists","up"]},{"osd":1,"uuid":"96502bac-f68a-4b39-8f59-057a68c166c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":140456},{"type":"v1","addr":"172.21.15.153:6817","nonce":140456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":140456},{"type":"v1","addr":"172.21.15.153:6819","nonce":140456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":140456},{"type":"v1","addr":"172.21.15.153:6823","nonce":140456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":140456},{"type":"v1","addr":"172.21.15.153:6821","nonce":140456}]},"public_addr":"172.21.15.153:6817/140456","cluster_addr":"172.21.15.153:6819/140456","heartbeat_back_addr":"172.21.15.153:6823/140456","heartbeat_front_addr":"172.21.15.153:6821/140456","state":["exists","up"]},{"osd":2,"uuid":"cde70c28-f914-4707-aa7d-08e49fcf599c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":140454},{"type":"v1","addr":"172.21.15.153:6809","nonce":140454}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":140454},{"type":"v1","addr":"172.21.15.153:6811","nonce":140454}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":140454},{"type":"v1","addr":"172.21.15.153:6815","nonce":140454}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":140454},{"type":"v1","addr":"172.21.15.153:6813","nonce":140454}]},"public_addr":"172.21.15.153:6809/140454","cluster_addr":"172.21.15.153:6811/140454","heartbeat_back_addr":"172.21.15.153:6815/140454","heartbeat_front_addr":"172.21.15.153:6813/140454","state":["exists","up"]},{"osd":3,"uuid":"9095f398-15a3-40b2-9d98-d156bc343bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":140455},{"type":"v1","addr":"172.21.15.153:6801","nonce":140455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":140455},{"type":"v1","addr":"172.21.15.153:6803","nonce":140455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":140455},{"type":"v1","addr":"172.21.15.153:6808","nonce":140455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":140455},{"type":"v1","addr":"172.21.15.153:6805","nonce":140455}]},"public_addr":"172.21.15.153:6801/140455","cluster_addr":"172.21.15.153:6803/140455","heartbeat_back_addr":"172.21.15.153:6808/140455","heartbeat_front_addr":"172.21.15.153:6805/140455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T21:14:38.443329+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T21:14:38.471353+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T21:14:38.436233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T21:14:38.415988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T21:14:47.683 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.681+0000 7f023d0ac700 1 -- 172.21.15.111:0/963437288 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f02240358d0 msgr2=0x7f0224037d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:47.683 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.681+0000 7f023d0ac700 1 --2- 172.21.15.111:0/963437288 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f02240358d0 0x7f0224037d80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f022c0016a0 tx=0x7f022c007b30 comp rx=0 tx=0).stop 2023-10-05T21:14:47.684 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.681+0000 7f023d0ac700 1 -- 172.21.15.111:0/963437288 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f023806b130 msgr2=0x7f023811d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:47.684 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.681+0000 7f023d0ac700 1 --2- 172.21.15.111:0/963437288 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f023806b130 0x7f023811d8b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0228000c00 tx=0x7f0228016000 comp rx=0 tx=0).stop 2023-10-05T21:14:47.684 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.681+0000 7f023d0ac700 1 -- 172.21.15.111:0/963437288 shutdown_connections 2023-10-05T21:14:47.684 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.681+0000 7f023d0ac700 1 --2- 172.21.15.111:0/963437288 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f02240358d0 0x7f0224037d80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.684 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.681+0000 7f023d0ac700 1 --2- 172.21.15.111:0/963437288 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f023806b130 0x7f023811d8b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.684 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.681+0000 7f023d0ac700 1 -- 172.21.15.111:0/963437288 >> 172.21.15.111:0/963437288 conn(0x7f02380956b0 msgr2=0x7f023808b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:47.684 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.681+0000 7f023d0ac700 1 -- 172.21.15.111:0/963437288 shutdown_connections 2023-10-05T21:14:47.684 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.681+0000 7f023d0ac700 1 -- 172.21.15.111:0/963437288 wait complete. 2023-10-05T21:14:47.695 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-05T21:14:47.695 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-05T21:14:47.696 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-05T21:14:47.696 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-05T21:14:47.822 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.820+0000 7fbed236a700 1 Processor -- start 2023-10-05T21:14:47.822 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.820+0000 7fbed236a700 1 -- start start 2023-10-05T21:14:47.822 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.820+0000 7fb32b123700 1 Processor -- start 2023-10-05T21:14:47.823 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.820+0000 7fbed236a700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fbecc090430 0x7fbecc090800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:47.823 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.820+0000 7fbed236a700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbecc091ac0 con 0x7fbecc090d40 2023-10-05T21:14:47.823 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.820+0000 7fbed236a700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbecc0914d0 con 0x7fbecc090430 2023-10-05T21:14:47.823 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.820+0000 7fb32b123700 1 -- start start 2023-10-05T21:14:47.824 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.821+0000 7fbecbfff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fbecc090430 0x7fbecc090800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:47.824 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.821+0000 7fbecbfff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fbecc090430 0x7fbecc090800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49452/0 (socket says 172.21.15.111:49452) 2023-10-05T21:14:47.824 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.821+0000 7fbecbfff700 1 -- 172.21.15.111:0/155203134 learned_addr learned my addr 172.21.15.111:0/155203134 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-10-05T21:14:47.824 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.821+0000 7fbecbfff700 1 -- 172.21.15.111:0/155203134 >> v1:172.21.15.111:6789/0 conn(0x7fbecc090d40 legacy=0x7fbecc08f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:47.824 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.821+0000 7fbecbfff700 1 -- 172.21.15.111:0/155203134 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc092980 con 0x7fbecc090430 2023-10-05T21:14:47.824 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.821+0000 7fbecbfff700 1 --2- 172.21.15.111:0/155203134 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbecc090430 0x7fbecc090800 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbebc009930 tx=0x7fbebc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc42aa2bc867ec6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:47.825 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.821+0000 7fb32b123700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fb324068990 0x7fb324132990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:47.825 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.821+0000 7fb32b123700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3240911c0 con 0x7fb324067eb0 2023-10-05T21:14:47.825 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.821+0000 7fb32b123700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb32406fcf0 con 0x7fb324068990 2023-10-05T21:14:47.825 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.821+0000 7fb328ebf700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fb324067eb0 0x7fb324068280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:47574/0 (socket says 172.21.15.111:47574) 2023-10-05T21:14:47.825 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.821+0000 7fb328ebf700 1 -- 172.21.15.111:0/39223545 learned_addr learned my addr 172.21.15.111:0/39223545 (peer_addr_for_me v1:172.21.15.111:0/0) 2023-10-05T21:14:47.825 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.822+0000 7fb323fff700 1 --2- 172.21.15.111:0/39223545 >> v2:172.21.15.111:3300/0 conn(0x7fb324068990 0x7fb324132990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:47.826 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.822+0000 7fbecaffd700 1 -- 172.21.15.111:0/155203134 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbebc00b9a0 con 0x7fbecc090430 2023-10-05T21:14:47.826 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.822+0000 7fbecaffd700 1 -- 172.21.15.111:0/155203134 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbebc00bb00 con 0x7fbecc090430 2023-10-05T21:14:47.826 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.822+0000 7fbecaffd700 1 -- 172.21.15.111:0/155203134 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbebc00bdd0 con 0x7fbecc090430 2023-10-05T21:14:47.827 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.822+0000 7fb3237fe700 1 -- 172.21.15.111:0/39223545 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328636379 0 0) 0x7fb3240911c0 con 0x7fb324067eb0 2023-10-05T21:14:47.827 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.822+0000 7fb3237fe700 1 -- 172.21.15.111:0/39223545 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb30c003570 con 0x7fb324067eb0 2023-10-05T21:14:47.827 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.822+0000 7fb323fff700 1 -- 172.21.15.111:0/39223545 >> v1:172.21.15.111:6789/0 conn(0x7fb324067eb0 legacy=0x7fb324068280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:47.827 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.822+0000 7fb323fff700 1 -- 172.21.15.111:0/39223545 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb324095820 con 0x7fb324068990 2023-10-05T21:14:47.827 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.822+0000 7fb323fff700 1 --2- 172.21.15.111:0/39223545 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb324068990 0x7fb324132990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb318009860 tx=0x7fb3180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61250ef80b60e794 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:47.827 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.822+0000 7fb3237fe700 1 -- 172.21.15.111:0/39223545 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb318011630 con 0x7fb324068990 2023-10-05T21:14:47.828 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.822+0000 7fb3237fe700 1 -- 172.21.15.111:0/39223545 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb318011790 con 0x7fb324068990 2023-10-05T21:14:47.828 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.822+0000 7fb3237fe700 1 -- 172.21.15.111:0/39223545 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb318011a40 con 0x7fb324068990 2023-10-05T21:14:47.828 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.823+0000 7fbed236a700 1 -- 172.21.15.111:0/155203134 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbecc090430 msgr2=0x7fbecc090800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:47.828 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.823+0000 7fbed236a700 1 --2- 172.21.15.111:0/155203134 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbecc090430 0x7fbecc090800 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbebc009930 tx=0x7fbebc009250 comp rx=0 tx=0).stop 2023-10-05T21:14:47.828 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.823+0000 7fbed236a700 1 -- 172.21.15.111:0/155203134 shutdown_connections 2023-10-05T21:14:47.829 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.823+0000 7fbed236a700 1 --2- 172.21.15.111:0/155203134 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbecc090430 0x7fbecc090800 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.829 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.823+0000 7fbed236a700 1 -- 172.21.15.111:0/155203134 >> 172.21.15.111:0/155203134 conn(0x7fbecc099170 msgr2=0x7fbecc099570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:47.829 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.823+0000 7fbed236a700 1 -- 172.21.15.111:0/155203134 shutdown_connections 2023-10-05T21:14:47.829 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.823+0000 7fbed236a700 1 -- 172.21.15.111:0/155203134 wait complete. 2023-10-05T21:14:47.829 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.823+0000 7fbed236a700 1 Processor -- start 2023-10-05T21:14:47.830 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.823+0000 7fb32b123700 1 -- 172.21.15.111:0/39223545 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb324068990 msgr2=0x7fb324132990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:47.830 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.823+0000 7fb32b123700 1 --2- 172.21.15.111:0/39223545 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb324068990 0x7fb324132990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb318009860 tx=0x7fb3180091a0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.830 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.823+0000 7fb32b123700 1 -- 172.21.15.111:0/39223545 shutdown_connections 2023-10-05T21:14:47.830 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.823+0000 7fb32b123700 1 --2- 172.21.15.111:0/39223545 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb324068990 0x7fb324132990 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.830 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.823+0000 7fb32b123700 1 -- 172.21.15.111:0/39223545 >> 172.21.15.111:0/39223545 conn(0x7fb324099170 msgr2=0x7fb324099570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:47.830 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.824+0000 7fb32b123700 1 -- 172.21.15.111:0/39223545 shutdown_connections 2023-10-05T21:14:47.831 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.824+0000 7fb32b123700 1 -- 172.21.15.111:0/39223545 wait complete. 2023-10-05T21:14:47.831 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.824+0000 7fbed236a700 1 -- start start 2023-10-05T21:14:47.831 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.824+0000 7fbed236a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbecc090430 0x7fbecc08e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:47.832 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.824+0000 7fbed236a700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc08ca40 con 0x7fbecc090430 2023-10-05T21:14:47.832 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.824+0000 7fbecbfff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbecc090430 0x7fbecc08e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:47.832 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.824+0000 7fbecbfff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbecc090430 0x7fbecc08e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49466/0 (socket says 172.21.15.111:49466) 2023-10-05T21:14:47.832 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.824+0000 7fbecbfff700 1 -- 172.21.15.111:0/2681948800 learned_addr learned my addr 172.21.15.111:0/2681948800 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-10-05T21:14:47.833 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.825+0000 7fb32b123700 1 Processor -- start 2023-10-05T21:14:47.833 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.825+0000 7fbecbfff700 1 -- 172.21.15.111:0/2681948800 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbebc0094f0 con 0x7fbecc090430 2023-10-05T21:14:47.834 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.825+0000 7fbecbfff700 1 --2- 172.21.15.111:0/2681948800 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbecc090430 0x7fbecc08e990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0090b0 tx=0x7fbebc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:47.834 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.825+0000 7fb32b123700 1 -- start start 2023-10-05T21:14:47.835 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.825+0000 7fbeb3fff700 1 -- 172.21.15.111:0/2681948800 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbebc018420 con 0x7fbecc090430 2023-10-05T21:14:47.835 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.825+0000 7fbeb3fff700 1 -- 172.21.15.111:0/2681948800 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbebc018580 con 0x7fbecc090430 2023-10-05T21:14:47.835 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.825+0000 7fbeb3fff700 1 -- 172.21.15.111:0/2681948800 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbebc018730 con 0x7fbecc090430 2023-10-05T21:14:47.836 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.825+0000 7fbed236a700 1 -- 172.21.15.111:0/2681948800 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbecc08fa10 con 0x7fbecc090430 2023-10-05T21:14:47.836 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.825+0000 7fb32b123700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb324067eb0 0x7fb32408ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:47.836 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.825+0000 7fb32b123700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32406f4a0 con 0x7fb324067eb0 2023-10-05T21:14:47.837 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.825+0000 7fbed236a700 1 -- 172.21.15.111:0/2681948800 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbecc08e680 con 0x7fbecc090430 2023-10-05T21:14:47.837 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.826+0000 7fb328ebf700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb324067eb0 0x7fb32408ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:47.838 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.826+0000 7fbed236a700 1 -- 172.21.15.111:0/2681948800 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbecc08e240 con 0x7fbecc090430 2023-10-05T21:14:47.839 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.826+0000 7fb328ebf700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb324067eb0 0x7fb32408ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49476/0 (socket says 172.21.15.111:49476) 2023-10-05T21:14:47.839 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.826+0000 7fb328ebf700 1 -- 172.21.15.111:0/1672636094 learned_addr learned my addr 172.21.15.111:0/1672636094 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-10-05T21:14:47.839 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.826+0000 7fb328ebf700 1 -- 172.21.15.111:0/1672636094 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb318009420 con 0x7fb324067eb0 2023-10-05T21:14:47.839 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.826+0000 7fb328ebf700 1 --2- 172.21.15.111:0/1672636094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb324067eb0 0x7fb32408ab30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb3140011e0 tx=0x7fb314007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:47.839 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.827+0000 7fb320ff9700 1 -- 172.21.15.111:0/1672636094 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb314005b30 con 0x7fb324067eb0 2023-10-05T21:14:47.840 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.827+0000 7fb320ff9700 1 -- 172.21.15.111:0/1672636094 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb314005c90 con 0x7fb324067eb0 2023-10-05T21:14:47.840 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.827+0000 7fb320ff9700 1 -- 172.21.15.111:0/1672636094 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb3140070d0 con 0x7fb324067eb0 2023-10-05T21:14:47.840 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.827+0000 7fb32b123700 1 -- 172.21.15.111:0/1672636094 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb32408e0f0 con 0x7fb324067eb0 2023-10-05T21:14:47.840 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.827+0000 7fbeb3fff700 1 -- 172.21.15.111:0/2681948800 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fbebc018890 con 0x7fbecc090430 2023-10-05T21:14:47.840 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.827+0000 7fbeb3fff700 1 --2- 172.21.15.111:0/2681948800 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbeb8035880 0x7fbeb8037d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:47.840 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.827+0000 7fb32b123700 1 -- 172.21.15.111:0/1672636094 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb32408c640 con 0x7fb324067eb0 2023-10-05T21:14:47.841 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.827+0000 7fbeb3fff700 1 -- 172.21.15.111:0/2681948800 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3478+0+0 (secure 0 0 0) 0x7fbebc014070 con 0x7fbecc090430 2023-10-05T21:14:47.841 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.827+0000 7fbeb3fff700 1 --2- 172.21.15.111:0/2681948800 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x7fbeb803af90 0x7fbeb803d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:47.841 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.827+0000 7fbeb3fff700 1 -- 172.21.15.111:0/2681948800 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbeb803da90 con 0x7fbeb803af90 2023-10-05T21:14:47.841 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.827+0000 7fbeb3fff700 1 -- 172.21.15.111:0/2681948800 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbebc0496b0 con 0x7fbecc090430 2023-10-05T21:14:47.841 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.827+0000 7fb320ff9700 1 -- 172.21.15.111:0/1672636094 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fb314007230 con 0x7fb324067eb0 2023-10-05T21:14:47.842 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.827+0000 7fbecb7fe700 1 --2- 172.21.15.111:0/2681948800 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbeb8035880 0x7fbeb8037d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:47.842 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.828+0000 7fbed0907700 1 --2- 172.21.15.111:0/2681948800 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x7fbeb803af90 0x7fbeb803d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:47.842 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.828+0000 7fb320ff9700 1 --2- 172.21.15.111:0/1672636094 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fb3100358d0 0x7fb310037d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:47.843 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.828+0000 7fb320ff9700 1 -- 172.21.15.111:0/1672636094 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3478+0+0 (secure 0 0 0) 0x7fb314046c20 con 0x7fb324067eb0 2023-10-05T21:14:47.843 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.828+0000 7fbecb7fe700 1 --2- 172.21.15.111:0/2681948800 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbeb8035880 0x7fbeb8037d30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbec0001730 tx=0x7fbec0007b40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:47.843 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.828+0000 7fbed0907700 1 --2- 172.21.15.111:0/2681948800 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x7fbeb803af90 0x7fbeb803d3c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:47.844 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.828+0000 7fb32b123700 1 --2- 172.21.15.111:0/1672636094 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x7fb324068990 0x7fb32408b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:47.844 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.828+0000 7fb32b123700 1 -- 172.21.15.111:0/1672636094 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb3240927f0 con 0x7fb324068990 2023-10-05T21:14:47.844 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.828+0000 7fb3296c0700 1 --2- 172.21.15.111:0/1672636094 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x7fb324068990 0x7fb32408b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:47.844 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.829+0000 7fbeb3fff700 1 -- 172.21.15.111:0/2681948800 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fbeb803da90 con 0x7fbeb803af90 2023-10-05T21:14:47.846 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.829+0000 7fb323fff700 1 --2- 172.21.15.111:0/1672636094 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fb3100358d0 0x7fb310037d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:47.846 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.829+0000 7fb3296c0700 1 --2- 172.21.15.111:0/1672636094 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x7fb324068990 0x7fb32408b070 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:47.846 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.829+0000 7fb323fff700 1 --2- 172.21.15.111:0/1672636094 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fb3100358d0 0x7fb310037d80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb318009fd0 tx=0x7fb318016000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:47.846 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.830+0000 7fb320ff9700 1 -- 172.21.15.111:0/1672636094 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fb3240927f0 con 0x7fb324068990 2023-10-05T21:14:47.848 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.830+0000 7f2b55b4a700 1 Processor -- start 2023-10-05T21:14:47.848 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.830+0000 7f2b55b4a700 1 -- start start 2023-10-05T21:14:47.848 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.831+0000 7f2b55b4a700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f2b50092ba0 0x7f2b5012b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:47.848 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.831+0000 7f2b55b4a700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b5006de90 con 0x7f2b500920c0 2023-10-05T21:14:47.848 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.831+0000 7f2b55b4a700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b50067cc0 con 0x7f2b50092ba0 2023-10-05T21:14:47.848 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.831+0000 7f2b4effd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f2b50092ba0 0x7f2b5012b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:47.849 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.831+0000 7f2b4f7fe700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f2b500920c0 0x7f2b50092490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:47588/0 (socket says 172.21.15.111:47588) 2023-10-05T21:14:47.849 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.831+0000 7f2b4effd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f2b50092ba0 0x7f2b5012b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49486/0 (socket says 172.21.15.111:49486) 2023-10-05T21:14:47.849 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.831+0000 7f2b4f7fe700 1 -- 172.21.15.111:0/2501354886 learned_addr learned my addr 172.21.15.111:0/2501354886 (peer_addr_for_me v1:172.21.15.111:0/0) 2023-10-05T21:14:47.849 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.831+0000 7f2b4effd700 1 -- 172.21.15.111:0/2501354886 >> v1:172.21.15.111:6789/0 conn(0x7f2b500920c0 legacy=0x7f2b50092490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:47.849 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.831+0000 7f2b4effd700 1 -- 172.21.15.111:0/2501354886 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5006d360 con 0x7f2b50092ba0 2023-10-05T21:14:47.849 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.831+0000 7f2b4e7fc700 1 -- 172.21.15.111:0/2501354886 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2552643088 0 0) 0x7f2b5006de90 con 0x7f2b500920c0 2023-10-05T21:14:47.849 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.831+0000 7f2b4effd700 1 --2- 172.21.15.111:0/2501354886 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b50092ba0 0x7f2b5012b3b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2b44009860 tx=0x7f2b440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d28c612cb3e7ba server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:47.849 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.832+0000 7f2b4e7fc700 1 -- 172.21.15.111:0/2501354886 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b4400b680 con 0x7f2b50092ba0 2023-10-05T21:14:47.849 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.832+0000 7f2b4e7fc700 1 -- 172.21.15.111:0/2501354886 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4400b7e0 con 0x7f2b50092ba0 2023-10-05T21:14:47.849 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.832+0000 7f2b4e7fc700 1 -- 172.21.15.111:0/2501354886 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b4400b990 con 0x7f2b50092ba0 2023-10-05T21:14:47.849 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.832+0000 7f2b55b4a700 1 -- 172.21.15.111:0/2501354886 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b50092ba0 msgr2=0x7f2b5012b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:47.850 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.832+0000 7f2b55b4a700 1 --2- 172.21.15.111:0/2501354886 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b50092ba0 0x7f2b5012b3b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2b44009860 tx=0x7f2b440091a0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.850 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.832+0000 7f2b55b4a700 1 -- 172.21.15.111:0/2501354886 shutdown_connections 2023-10-05T21:14:47.850 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.832+0000 7f2b55b4a700 1 --2- 172.21.15.111:0/2501354886 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b50092ba0 0x7f2b5012b3b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.850 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.832+0000 7f2b55b4a700 1 -- 172.21.15.111:0/2501354886 >> 172.21.15.111:0/2501354886 conn(0x7f2b500956b0 msgr2=0x7f2b50095ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:47.850 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.832+0000 7f2b55b4a700 1 -- 172.21.15.111:0/2501354886 shutdown_connections 2023-10-05T21:14:47.850 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.832+0000 7f2b55b4a700 1 -- 172.21.15.111:0/2501354886 wait complete. 2023-10-05T21:14:47.850 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.833+0000 7f2b55b4a700 1 Processor -- start 2023-10-05T21:14:47.851 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.833+0000 7f41d3426700 1 Processor -- start 2023-10-05T21:14:47.851 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.833+0000 7f41d3426700 1 -- start start 2023-10-05T21:14:47.851 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.833+0000 7f41d3426700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f41cc06d4c0 0x7f41cc12c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:47.851 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.833+0000 7f41d3426700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41cc0966c0 con 0x7f41cc06c9e0 2023-10-05T21:14:47.852 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.833+0000 7f41d3426700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41cc06ed70 con 0x7f41cc06d4c0 2023-10-05T21:14:47.852 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.833+0000 7f2b55b4a700 1 -- start start 2023-10-05T21:14:47.852 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.833+0000 7f41d09c1700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f41cc06d4c0 0x7f41cc12c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:47.853 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.833+0000 7f41d09c1700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f41cc06d4c0 0x7f41cc12c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49496/0 (socket says 172.21.15.111:49496) 2023-10-05T21:14:47.853 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.833+0000 7f41d09c1700 1 -- 172.21.15.111:0/3767142636 learned_addr learned my addr 172.21.15.111:0/3767142636 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-10-05T21:14:47.853 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.834+0000 7f41c3fff700 1 -- 172.21.15.111:0/3767142636 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819581928 0 0) 0x7f41cc0966c0 con 0x7f41cc06c9e0 2023-10-05T21:14:47.853 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.834+0000 7f41c3fff700 1 -- 172.21.15.111:0/3767142636 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41b8003570 con 0x7f41cc06c9e0 2023-10-05T21:14:47.853 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.834+0000 7f41d09c1700 1 -- 172.21.15.111:0/3767142636 >> v1:172.21.15.111:6789/0 conn(0x7f41cc06c9e0 legacy=0x7f41cc06cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:47.854 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.834+0000 7f41d09c1700 1 -- 172.21.15.111:0/3767142636 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41cc095c90 con 0x7f41cc06d4c0 2023-10-05T21:14:47.854 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.834+0000 7f2b55b4a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b500920c0 0x7f2b5006b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:47.854 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.834+0000 7f2b55b4a700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b50086bd0 con 0x7f2b500920c0 2023-10-05T21:14:47.855 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.834+0000 7f41d09c1700 1 --2- 172.21.15.111:0/3767142636 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f41cc06d4c0 0x7f41cc12c490 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f41bc00fa50 tx=0x7f41bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c600b7079d98c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:47.855 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.834+0000 7f41c3fff700 1 -- 172.21.15.111:0/3767142636 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41bc00f3b0 con 0x7f41cc06d4c0 2023-10-05T21:14:47.855 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.834+0000 7f41c3fff700 1 -- 172.21.15.111:0/3767142636 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41bc009940 con 0x7f41cc06d4c0 2023-10-05T21:14:47.855 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.834+0000 7f41c3fff700 1 -- 172.21.15.111:0/3767142636 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41bc009bf0 con 0x7f41cc06d4c0 2023-10-05T21:14:47.856 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.835+0000 7f2b4f7fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b500920c0 0x7f2b5006b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:47.856 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.835+0000 7f2b4f7fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b500920c0 0x7f2b5006b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49504/0 (socket says 172.21.15.111:49504) 2023-10-05T21:14:47.856 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.835+0000 7f2b4f7fe700 1 -- 172.21.15.111:0/2252581429 learned_addr learned my addr 172.21.15.111:0/2252581429 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-10-05T21:14:47.857 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.835+0000 7f41d3426700 1 -- 172.21.15.111:0/3767142636 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f41cc06d4c0 msgr2=0x7f41cc12c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:47.857 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.835+0000 7f41d3426700 1 --2- 172.21.15.111:0/3767142636 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f41cc06d4c0 0x7f41cc12c490 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f41bc00fa50 tx=0x7f41bc009250 comp rx=0 tx=0).stop 2023-10-05T21:14:47.857 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.835+0000 7f2b4f7fe700 1 -- 172.21.15.111:0/2252581429 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b44009420 con 0x7f2b500920c0 2023-10-05T21:14:47.857 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.835+0000 7f41d3426700 1 -- 172.21.15.111:0/3767142636 shutdown_connections 2023-10-05T21:14:47.858 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.835+0000 7f41d3426700 1 --2- 172.21.15.111:0/3767142636 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f41cc06d4c0 0x7f41cc12c490 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.858 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.835+0000 7f41d3426700 1 -- 172.21.15.111:0/3767142636 >> 172.21.15.111:0/3767142636 conn(0x7f41cc09a0a0 msgr2=0x7f41cc09a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:47.858 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.835+0000 7f41d3426700 1 -- 172.21.15.111:0/3767142636 shutdown_connections 2023-10-05T21:14:47.858 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.835+0000 7f41d3426700 1 -- 172.21.15.111:0/3767142636 wait complete. 2023-10-05T21:14:47.859 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.835+0000 7f2b4f7fe700 1 --2- 172.21.15.111:0/2252581429 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b500920c0 0x7f2b5006b130 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000c460 tx=0x7f2b40000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:47.859 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.835+0000 7f2b377fe700 1 -- 172.21.15.111:0/2252581429 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b40005b30 con 0x7f2b500920c0 2023-10-05T21:14:47.859 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.836+0000 7f2b377fe700 1 -- 172.21.15.111:0/2252581429 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b40005c90 con 0x7f2b500920c0 2023-10-05T21:14:47.859 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.836+0000 7f2b377fe700 1 -- 172.21.15.111:0/2252581429 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b400070d0 con 0x7f2b500920c0 2023-10-05T21:14:47.860 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.836+0000 7f2b55b4a700 1 -- 172.21.15.111:0/2252581429 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b50085120 con 0x7f2b500920c0 2023-10-05T21:14:47.860 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.836+0000 7f2b55b4a700 1 -- 172.21.15.111:0/2252581429 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b5008b610 con 0x7f2b500920c0 2023-10-05T21:14:47.860 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.836+0000 7f41d3426700 1 Processor -- start 2023-10-05T21:14:47.860 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.836+0000 7f41d3426700 1 -- start start 2023-10-05T21:14:47.860 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.837+0000 7f41d3426700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f41cc06c9e0 0x7f41cc124910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:47.860 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.837+0000 7f41d3426700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc085060 con 0x7f41cc06c9e0 2023-10-05T21:14:47.861 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.837+0000 7f2b55b4a700 1 -- 172.21.15.111:0/2252581429 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2b500647e0 con 0x7f2b500920c0 2023-10-05T21:14:47.861 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.837+0000 7f41d11c2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f41cc06c9e0 0x7f41cc124910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:47.861 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.837+0000 7f41d11c2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f41cc06c9e0 0x7f41cc124910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49514/0 (socket says 172.21.15.111:49514) 2023-10-05T21:14:47.861 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.837+0000 7f41d11c2700 1 -- 172.21.15.111:0/2543875205 learned_addr learned my addr 172.21.15.111:0/2543875205 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-10-05T21:14:47.862 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.837+0000 7f2b377fe700 1 -- 172.21.15.111:0/2252581429 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f2b40007230 con 0x7f2b500920c0 2023-10-05T21:14:47.862 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.837+0000 7f2b377fe700 1 --2- 172.21.15.111:0/2252581429 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2b3c0358c0 0x7f2b3c037d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:47.862 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.837+0000 7f2b377fe700 1 -- 172.21.15.111:0/2252581429 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f2b40046df0 con 0x7f2b500920c0 2023-10-05T21:14:47.862 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.837+0000 7f2b377fe700 1 --2- 172.21.15.111:0/2252581429 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f2b3c03afd0 0x7f2b3c03d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:47.862 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.837+0000 7f2b377fe700 1 -- 172.21.15.111:0/2252581429 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b3c03dad0 con 0x7f2b3c03afd0 2023-10-05T21:14:47.862 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.837+0000 7f2b377fe700 1 -- 172.21.15.111:0/2252581429 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b40007530 con 0x7f2b500920c0 2023-10-05T21:14:47.863 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.837+0000 7f41d11c2700 1 -- 172.21.15.111:0/2543875205 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41bc00f610 con 0x7f41cc06c9e0 2023-10-05T21:14:47.863 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.837+0000 7f41d11c2700 1 --2- 172.21.15.111:0/2543875205 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f41cc06c9e0 0x7f41cc124910 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f41c800c690 tx=0x7f41c8007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:47.863 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.838+0000 7f41c17fa700 1 -- 172.21.15.111:0/2543875205 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41c8010510 con 0x7f41cc06c9e0 2023-10-05T21:14:47.863 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.838+0000 7f41c17fa700 1 -- 172.21.15.111:0/2543875205 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c8010670 con 0x7f41cc06c9e0 2023-10-05T21:14:47.863 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.838+0000 7f41c17fa700 1 -- 172.21.15.111:0/2543875205 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41c8010920 con 0x7f41cc06c9e0 2023-10-05T21:14:47.863 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.838+0000 7f2b4effd700 1 --2- 172.21.15.111:0/2252581429 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2b3c0358c0 0x7f2b3c037d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:47.864 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.838+0000 7f41d3426700 1 -- 172.21.15.111:0/2543875205 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41cc090f00 con 0x7f41cc06c9e0 2023-10-05T21:14:47.864 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.838+0000 7f41d3426700 1 -- 172.21.15.111:0/2543875205 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41cc127ed0 con 0x7f41cc06c9e0 2023-10-05T21:14:47.864 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.839+0000 7f41c17fa700 1 -- 172.21.15.111:0/2543875205 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f41c8010a80 con 0x7f41cc06c9e0 2023-10-05T21:14:47.865 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.839+0000 7f41c17fa700 1 --2- 172.21.15.111:0/2543875205 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f41b00358d0 0x7f41b0037d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:47.865 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.839+0000 7f41c17fa700 1 -- 172.21.15.111:0/2543875205 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f41c8047130 con 0x7f41cc06c9e0 2023-10-05T21:14:47.865 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.839+0000 7f2b4effd700 1 --2- 172.21.15.111:0/2252581429 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2b3c0358c0 0x7f2b3c037d70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2b440091e0 tx=0x7f2b44016000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:47.865 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.839+0000 7f41d3426700 1 --2- 172.21.15.111:0/2543875205 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f41cc06d4c0 0x7f41cc125360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:47.865 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.839+0000 7f41d3426700 1 -- 172.21.15.111:0/2543875205 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f41cc06d8d0 con 0x7f41cc06d4c0 2023-10-05T21:14:47.866 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.840+0000 7f2b4ffff700 1 --2- 172.21.15.111:0/2252581429 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f2b3c03afd0 0x7f2b3c03d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:47.866 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.840+0000 7f41d19c3700 1 --2- 172.21.15.111:0/2543875205 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f41cc06d4c0 0x7f41cc125360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:47.866 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.840+0000 7f2b4ffff700 1 --2- 172.21.15.111:0/2252581429 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f2b3c03afd0 0x7f2b3c03d400 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:47.867 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.840+0000 7f41d19c3700 1 --2- 172.21.15.111:0/2543875205 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f41cc06d4c0 0x7f41cc125360 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:47.867 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.841+0000 7f41d09c1700 1 --2- 172.21.15.111:0/2543875205 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f41b00358d0 0x7f41b0037d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:47.867 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.841+0000 7f41c17fa700 1 -- 172.21.15.111:0/2543875205 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f41cc06d8d0 con 0x7f41cc06d4c0 2023-10-05T21:14:47.867 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.841+0000 7f2b377fe700 1 -- 172.21.15.111:0/2252581429 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f2b3c03dad0 con 0x7f2b3c03afd0 2023-10-05T21:14:47.868 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.843+0000 7f41d09c1700 1 --2- 172.21.15.111:0/2543875205 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f41b00358d0 0x7f41b0037d80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f41bc00fa50 tx=0x7f41bc016000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:47.868 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.846+0000 7fbed236a700 1 -- 172.21.15.111:0/2681948800 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbecc08c8c0 con 0x7fbeb803af90 2023-10-05T21:14:47.868 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.853+0000 7fbeb3fff700 1 -- 172.21.15.111:0/2681948800 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbec400a8f0 con 0x7fbeb803af90 2023-10-05T21:14:47.869 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.853+0000 7fbed236a700 1 -- 172.21.15.111:0/2681948800 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x7fbeb803af90 msgr2=0x7fbeb803d3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:47.869 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.853+0000 7fbed236a700 1 --2- 172.21.15.111:0/2681948800 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x7fbeb803af90 0x7fbeb803d3c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.869 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.854+0000 7fbed236a700 1 -- 172.21.15.111:0/2681948800 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbeb8035880 msgr2=0x7fbeb8037d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:47.869 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.854+0000 7fbed236a700 1 --2- 172.21.15.111:0/2681948800 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbeb8035880 0x7fbeb8037d30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbec0001730 tx=0x7fbec0007b40 comp rx=0 tx=0).stop 2023-10-05T21:14:47.869 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.854+0000 7fbed236a700 1 -- 172.21.15.111:0/2681948800 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbecc090430 msgr2=0x7fbecc08e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:47.869 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.854+0000 7fbed236a700 1 --2- 172.21.15.111:0/2681948800 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbecc090430 0x7fbecc08e990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0090b0 tx=0x7fbebc018000 comp rx=0 tx=0).stop 2023-10-05T21:14:47.870 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.854+0000 7fbed236a700 1 -- 172.21.15.111:0/2681948800 shutdown_connections 2023-10-05T21:14:47.870 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.854+0000 7fbed236a700 1 --2- 172.21.15.111:0/2681948800 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x7fbeb803af90 0x7fbeb803d3c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.870 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.854+0000 7fbed236a700 1 --2- 172.21.15.111:0/2681948800 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbecc090430 0x7fbecc08e990 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.870 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.854+0000 7fbed236a700 1 --2- 172.21.15.111:0/2681948800 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbeb8035880 0x7fbeb8037d30 secure :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbec0001730 tx=0x7fbec0007b40 comp rx=0 tx=0).stop 2023-10-05T21:14:47.870 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.854+0000 7fbed236a700 1 -- 172.21.15.111:0/2681948800 >> 172.21.15.111:0/2681948800 conn(0x7fbecc099170 msgr2=0x7fbecc06e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:47.870 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.854+0000 7fbed236a700 1 -- 172.21.15.111:0/2681948800 shutdown_connections 2023-10-05T21:14:47.870 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.854+0000 7fbed236a700 1 -- 172.21.15.111:0/2681948800 wait complete. 2023-10-05T21:14:47.870 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.856+0000 7fb32b123700 1 -- 172.21.15.111:0/1672636094 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb32404bb40 con 0x7fb324068990 2023-10-05T21:14:47.871 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.856+0000 7f41d3426700 1 -- 172.21.15.111:0/2543875205 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f41cc06a5b0 con 0x7f41cc06d4c0 2023-10-05T21:14:47.871 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.856+0000 7f41c17fa700 1 -- 172.21.15.111:0/2543875205 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f41cc06a5b0 con 0x7f41cc06d4c0 2023-10-05T21:14:47.871 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.856+0000 7fb320ff9700 1 -- 172.21.15.111:0/1672636094 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb32404bb40 con 0x7fb324068990 2023-10-05T21:14:47.872 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.857+0000 7f41d3426700 1 -- 172.21.15.111:0/2543875205 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f41cc06d4c0 msgr2=0x7f41cc125360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:47.872 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.857+0000 7f41d3426700 1 --2- 172.21.15.111:0/2543875205 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f41cc06d4c0 0x7f41cc125360 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.872 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.857+0000 7f41d3426700 1 -- 172.21.15.111:0/2543875205 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f41b00358d0 msgr2=0x7f41b0037d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:47.872 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.857+0000 7f41d3426700 1 --2- 172.21.15.111:0/2543875205 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f41b00358d0 0x7f41b0037d80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f41bc00fa50 tx=0x7f41bc016000 comp rx=0 tx=0).stop 2023-10-05T21:14:47.872 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.857+0000 7f41d3426700 1 -- 172.21.15.111:0/2543875205 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f41cc06c9e0 msgr2=0x7f41cc124910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:47.872 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.857+0000 7f41d3426700 1 --2- 172.21.15.111:0/2543875205 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f41cc06c9e0 0x7f41cc124910 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f41c800c690 tx=0x7f41c8007e10 comp rx=0 tx=0).stop 2023-10-05T21:14:47.873 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.857+0000 7fb32b123700 1 -- 172.21.15.111:0/1672636094 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x7fb324068990 msgr2=0x7fb32408b070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:47.873 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.857+0000 7fb32b123700 1 --2- 172.21.15.111:0/1672636094 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x7fb324068990 0x7fb32408b070 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.873 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.857+0000 7fb32b123700 1 -- 172.21.15.111:0/1672636094 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fb3100358d0 msgr2=0x7fb310037d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:47.873 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.857+0000 7fb32b123700 1 --2- 172.21.15.111:0/1672636094 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fb3100358d0 0x7fb310037d80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb318009fd0 tx=0x7fb318016000 comp rx=0 tx=0).stop 2023-10-05T21:14:47.873 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.857+0000 7fb32b123700 1 -- 172.21.15.111:0/1672636094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb324067eb0 msgr2=0x7fb32408ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:47.873 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.857+0000 7fb32b123700 1 --2- 172.21.15.111:0/1672636094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb324067eb0 0x7fb32408ab30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb3140011e0 tx=0x7fb314007df0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.874 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.857+0000 7f41d3426700 1 -- 172.21.15.111:0/2543875205 shutdown_connections 2023-10-05T21:14:47.874 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.857+0000 7f41d3426700 1 --2- 172.21.15.111:0/2543875205 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f41cc06d4c0 0x7f41cc125360 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.874 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.857+0000 7f41d3426700 1 --2- 172.21.15.111:0/2543875205 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f41cc06c9e0 0x7f41cc124910 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.874 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.857+0000 7f41d3426700 1 --2- 172.21.15.111:0/2543875205 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f41b00358d0 0x7f41b0037d80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.874 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.857+0000 7f41d3426700 1 -- 172.21.15.111:0/2543875205 >> 172.21.15.111:0/2543875205 conn(0x7f41cc09a0a0 msgr2=0x7f41cc06a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:47.875 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.857+0000 7fb32b123700 1 -- 172.21.15.111:0/1672636094 shutdown_connections 2023-10-05T21:14:47.875 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.857+0000 7fb32b123700 1 --2- 172.21.15.111:0/1672636094 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x7fb324068990 0x7fb32408b070 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.875 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.857+0000 7fb32b123700 1 --2- 172.21.15.111:0/1672636094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb324067eb0 0x7fb32408ab30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.875 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.857+0000 7fb32b123700 1 --2- 172.21.15.111:0/1672636094 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fb3100358d0 0x7fb310037d80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.875 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.857+0000 7fb32b123700 1 -- 172.21.15.111:0/1672636094 >> 172.21.15.111:0/1672636094 conn(0x7fb324099170 msgr2=0x7fb32406e140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:47.875 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.857+0000 7f41d3426700 1 -- 172.21.15.111:0/2543875205 shutdown_connections 2023-10-05T21:14:47.875 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.857+0000 7f41d3426700 1 -- 172.21.15.111:0/2543875205 wait complete. 2023-10-05T21:14:47.876 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.857+0000 7fb32b123700 1 -- 172.21.15.111:0/1672636094 shutdown_connections 2023-10-05T21:14:47.876 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.857+0000 7fb32b123700 1 -- 172.21.15.111:0/1672636094 wait complete. 2023-10-05T21:14:47.876 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.863+0000 7f2b55b4a700 1 -- 172.21.15.111:0/2252581429 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2b50068ea0 con 0x7f2b3c03afd0 2023-10-05T21:14:47.876 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.863+0000 7f2b377fe700 1 -- 172.21.15.111:0/2252581429 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2b50068ea0 con 0x7f2b3c03afd0 2023-10-05T21:14:47.877 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.864+0000 7f2b55b4a700 1 -- 172.21.15.111:0/2252581429 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f2b3c03afd0 msgr2=0x7f2b3c03d400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:47.877 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.864+0000 7f2b55b4a700 1 --2- 172.21.15.111:0/2252581429 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f2b3c03afd0 0x7f2b3c03d400 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.877 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.864+0000 7f2b55b4a700 1 -- 172.21.15.111:0/2252581429 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2b3c0358c0 msgr2=0x7f2b3c037d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:47.878 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.864+0000 7f2b55b4a700 1 --2- 172.21.15.111:0/2252581429 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2b3c0358c0 0x7f2b3c037d70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2b440091e0 tx=0x7f2b44016000 comp rx=0 tx=0).stop 2023-10-05T21:14:47.878 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.864+0000 7f2b55b4a700 1 -- 172.21.15.111:0/2252581429 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b500920c0 msgr2=0x7f2b5006b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:47.878 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.864+0000 7f2b55b4a700 1 --2- 172.21.15.111:0/2252581429 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b500920c0 0x7f2b5006b130 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000c460 tx=0x7f2b40000fe0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.878 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.864+0000 7f2b55b4a700 1 -- 172.21.15.111:0/2252581429 shutdown_connections 2023-10-05T21:14:47.878 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.864+0000 7f2b55b4a700 1 --2- 172.21.15.111:0/2252581429 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f2b3c03afd0 0x7f2b3c03d400 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.878 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.864+0000 7f2b55b4a700 1 --2- 172.21.15.111:0/2252581429 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b500920c0 0x7f2b5006b130 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.878 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.864+0000 7f2b55b4a700 1 --2- 172.21.15.111:0/2252581429 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2b3c0358c0 0x7f2b3c037d70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:47.878 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.864+0000 7f2b55b4a700 1 -- 172.21.15.111:0/2252581429 >> 172.21.15.111:0/2252581429 conn(0x7f2b500956b0 msgr2=0x7f2b5011f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:47.878 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.864+0000 7f2b55b4a700 1 -- 172.21.15.111:0/2252581429 shutdown_connections 2023-10-05T21:14:47.878 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:47.864+0000 7f2b55b4a700 1 -- 172.21.15.111:0/2252581429 wait complete. 2023-10-05T21:14:47.879 INFO:teuthology.orchestra.run.smithi111.stdout:38654705667 2023-10-05T21:14:47.879 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-05T21:14:47.881 INFO:teuthology.orchestra.run.smithi111.stdout:38654705667 2023-10-05T21:14:47.881 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-05T21:14:47.882 INFO:teuthology.orchestra.run.smithi111.stdout:38654705667 2023-10-05T21:14:47.882 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-05T21:14:47.883 INFO:teuthology.orchestra.run.smithi111.stdout:38654705667 2023-10-05T21:14:47.884 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-05T21:14:48.046 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.044+0000 7f548aec5700 1 Processor -- start 2023-10-05T21:14:48.046 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.044+0000 7f9b06a13700 1 Processor -- start 2023-10-05T21:14:48.047 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.044+0000 7f548aec5700 1 -- start start 2023-10-05T21:14:48.047 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.044+0000 7f9b06a13700 1 -- start start 2023-10-05T21:14:48.047 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.044+0000 7f9b06a13700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f9b00096ec0 0x7f9b00097290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:48.048 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.045+0000 7f548aec5700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f548408fe80 0x7f548412aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:48.048 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.045+0000 7f548aec5700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5484091360 con 0x7f548408f3a0 2023-10-05T21:14:48.048 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.045+0000 7f548aec5700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5484090c90 con 0x7f548408fe80 2023-10-05T21:14:48.048 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.045+0000 7f9b06a13700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b0008dc50 con 0x7f9b000977d0 2023-10-05T21:14:48.048 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.045+0000 7f9b06a13700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b0008dde0 con 0x7f9b00096ec0 2023-10-05T21:14:48.049 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.047+0000 7f5483fff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f548408fe80 0x7f548412aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:48.049 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.047+0000 7f5488c61700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f548408f3a0 0x7f548408f770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:47600/0 (socket says 172.21.15.111:47600) 2023-10-05T21:14:48.049 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.047+0000 7f5488c61700 1 -- 172.21.15.111:0/3969118025 learned_addr learned my addr 172.21.15.111:0/3969118025 (peer_addr_for_me v1:172.21.15.111:0/0) 2023-10-05T21:14:48.050 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.047+0000 7f9afffff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f9b00096ec0 0x7f9b00097290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:48.050 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.047+0000 7f9afffff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f9b00096ec0 0x7f9b00097290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49546/0 (socket says 172.21.15.111:49546) 2023-10-05T21:14:48.051 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.047+0000 7f9afffff700 1 -- 172.21.15.111:0/2257241167 learned_addr learned my addr 172.21.15.111:0/2257241167 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-10-05T21:14:48.051 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.047+0000 7f5483fff700 1 -- 172.21.15.111:0/3969118025 >> v1:172.21.15.111:6789/0 conn(0x7f548408f3a0 legacy=0x7f548408f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:48.051 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.047+0000 7f5483fff700 1 -- 172.21.15.111:0/3969118025 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5484091f50 con 0x7f548408fe80 2023-10-05T21:14:48.051 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.047+0000 7f9afffff700 1 -- 172.21.15.111:0/2257241167 >> v1:172.21.15.111:6789/0 conn(0x7f9b000977d0 legacy=0x7f9b0008eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:48.051 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.047+0000 7f9afffff700 1 -- 172.21.15.111:0/2257241167 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b0008e3c0 con 0x7f9b00096ec0 2023-10-05T21:14:48.052 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.048+0000 7f5483fff700 1 --2- 172.21.15.111:0/3969118025 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f548408fe80 0x7f548412aa00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5470009890 tx=0x7f54700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87680264dd4c74fc server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:48.052 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.048+0000 7f9afffff700 1 --2- 172.21.15.111:0/2257241167 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b00096ec0 0x7f9b00097290 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9af0009910 tx=0x7f9af0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2200573a00f15e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:48.052 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.048+0000 7f54837fe700 1 -- 172.21.15.111:0/3969118025 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f547000b670 con 0x7f548408fe80 2023-10-05T21:14:48.053 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.048+0000 7f54837fe700 1 -- 172.21.15.111:0/3969118025 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547000b7d0 con 0x7f548408fe80 2023-10-05T21:14:48.053 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.048+0000 7f54837fe700 1 -- 172.21.15.111:0/3969118025 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f547000bac0 con 0x7f548408fe80 2023-10-05T21:14:48.053 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.048+0000 7f9afeffd700 1 -- 172.21.15.111:0/2257241167 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9af0005c10 con 0x7f9b00096ec0 2023-10-05T21:14:48.053 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.048+0000 7f9afeffd700 1 -- 172.21.15.111:0/2257241167 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af0005d70 con 0x7f9b00096ec0 2023-10-05T21:14:48.054 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.048+0000 7f9afeffd700 1 -- 172.21.15.111:0/2257241167 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9af000b7b0 con 0x7f9b00096ec0 2023-10-05T21:14:48.054 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.049+0000 7f548aec5700 1 -- 172.21.15.111:0/3969118025 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f548408fe80 msgr2=0x7f548412aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:48.054 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.049+0000 7f548aec5700 1 --2- 172.21.15.111:0/3969118025 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f548408fe80 0x7f548412aa00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5470009890 tx=0x7f54700091a0 comp rx=0 tx=0).stop 2023-10-05T21:14:48.054 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.049+0000 7f9b06a13700 1 -- 172.21.15.111:0/2257241167 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b00096ec0 msgr2=0x7f9b00097290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:48.055 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.049+0000 7f9b06a13700 1 --2- 172.21.15.111:0/2257241167 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b00096ec0 0x7f9b00097290 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9af0009910 tx=0x7f9af0009220 comp rx=0 tx=0).stop 2023-10-05T21:14:48.055 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.050+0000 7f548aec5700 1 -- 172.21.15.111:0/3969118025 shutdown_connections 2023-10-05T21:14:48.055 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.050+0000 7f548aec5700 1 --2- 172.21.15.111:0/3969118025 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f548408fe80 0x7f548412aa00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:48.055 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.050+0000 7f548aec5700 1 -- 172.21.15.111:0/3969118025 >> 172.21.15.111:0/3969118025 conn(0x7f5484097f00 msgr2=0x7f5484098300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:48.055 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.050+0000 7f548aec5700 1 -- 172.21.15.111:0/3969118025 shutdown_connections 2023-10-05T21:14:48.056 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.050+0000 7f9b06a13700 1 -- 172.21.15.111:0/2257241167 shutdown_connections 2023-10-05T21:14:48.056 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.050+0000 7f9b06a13700 1 --2- 172.21.15.111:0/2257241167 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b00096ec0 0x7f9b00097290 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:48.056 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.050+0000 7f9b06a13700 1 -- 172.21.15.111:0/2257241167 >> 172.21.15.111:0/2257241167 conn(0x7f9b00098d70 msgr2=0x7f9b00099170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:48.056 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.050+0000 7f548aec5700 1 -- 172.21.15.111:0/3969118025 wait complete. 2023-10-05T21:14:48.057 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.050+0000 7f9b06a13700 1 -- 172.21.15.111:0/2257241167 shutdown_connections 2023-10-05T21:14:48.057 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.050+0000 7f9b06a13700 1 -- 172.21.15.111:0/2257241167 wait complete. 2023-10-05T21:14:48.057 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.050+0000 7f9b06a13700 1 Processor -- start 2023-10-05T21:14:48.057 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.051+0000 7f9b06a13700 1 -- start start 2023-10-05T21:14:48.057 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.051+0000 7f548aec5700 1 Processor -- start 2023-10-05T21:14:48.057 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.051+0000 7f548aec5700 1 -- start start 2023-10-05T21:14:48.058 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.051+0000 7f9b06a13700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b00096ec0 0x7f9b001300b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:48.058 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.051+0000 7f9b06a13700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0009be70 con 0x7f9b00096ec0 2023-10-05T21:14:48.058 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.051+0000 7f9afffff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b00096ec0 0x7f9b001300b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:48.058 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.051+0000 7f9afffff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b00096ec0 0x7f9b001300b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49560/0 (socket says 172.21.15.111:49560) 2023-10-05T21:14:48.059 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.051+0000 7f9afffff700 1 -- 172.21.15.111:0/3543512179 learned_addr learned my addr 172.21.15.111:0/3543512179 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-10-05T21:14:48.059 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.051+0000 7f548aec5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f548408f3a0 0x7f54841361d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:48.059 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.051+0000 7f548aec5700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548411f9e0 con 0x7f548408f3a0 2023-10-05T21:14:48.059 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.052+0000 7f9afffff700 1 -- 172.21.15.111:0/3543512179 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af0009480 con 0x7f9b00096ec0 2023-10-05T21:14:48.060 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.052+0000 7f5488c61700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f548408f3a0 0x7f54841361d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:48.060 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.052+0000 7f5488c61700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f548408f3a0 0x7f54841361d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49566/0 (socket says 172.21.15.111:49566) 2023-10-05T21:14:48.060 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.052+0000 7f5488c61700 1 -- 172.21.15.111:0/1167787654 learned_addr learned my addr 172.21.15.111:0/1167787654 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-10-05T21:14:48.060 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.052+0000 7f9afffff700 1 --2- 172.21.15.111:0/3543512179 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b00096ec0 0x7f9b001300b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9af0000c00 tx=0x7f9af0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:48.060 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.052+0000 7f5488c61700 1 -- 172.21.15.111:0/1167787654 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5470009420 con 0x7f548408f3a0 2023-10-05T21:14:48.061 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.052+0000 7f9ae7fff700 1 -- 172.21.15.111:0/3543512179 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9af0006b60 con 0x7f9b00096ec0 2023-10-05T21:14:48.061 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.052+0000 7f9ae7fff700 1 -- 172.21.15.111:0/3543512179 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af0011bc0 con 0x7f9b00096ec0 2023-10-05T21:14:48.061 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.052+0000 7f9ae7fff700 1 -- 172.21.15.111:0/3543512179 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9af001d430 con 0x7f9b00096ec0 2023-10-05T21:14:48.061 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.052+0000 7f9b06a13700 1 -- 172.21.15.111:0/3543512179 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b00124770 con 0x7f9b00096ec0 2023-10-05T21:14:48.062 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.052+0000 7f5488c61700 1 --2- 172.21.15.111:0/1167787654 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f548408f3a0 0x7f54841361d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f547800c6c0 tx=0x7f5478007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:48.062 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.052+0000 7f5480ff9700 1 -- 172.21.15.111:0/1167787654 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5478005c70 con 0x7f548408f3a0 2023-10-05T21:14:48.062 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.052+0000 7f5480ff9700 1 -- 172.21.15.111:0/1167787654 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5478005dd0 con 0x7f548408f3a0 2023-10-05T21:14:48.062 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.052+0000 7f5480ff9700 1 -- 172.21.15.111:0/1167787654 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5478004970 con 0x7f548408f3a0 2023-10-05T21:14:48.062 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.052+0000 7f548aec5700 1 -- 172.21.15.111:0/1167787654 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f548411d030 con 0x7f548408f3a0 2023-10-05T21:14:48.062 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.052+0000 7f548aec5700 1 -- 172.21.15.111:0/1167787654 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548406eb80 con 0x7f548408f3a0 2023-10-05T21:14:48.063 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.053+0000 7f9b06a13700 1 -- 172.21.15.111:0/3543512179 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b00123ed0 con 0x7f9b00096ec0 2023-10-05T21:14:48.063 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.053+0000 7fba0d381700 1 Processor -- start 2023-10-05T21:14:48.063 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.053+0000 7fba0d381700 1 -- start start 2023-10-05T21:14:48.064 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.053+0000 7f548aec5700 1 -- 172.21.15.111:0/1167787654 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54640050b0 con 0x7f548408f3a0 2023-10-05T21:14:48.064 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.054+0000 7f9ae7fff700 1 -- 172.21.15.111:0/3543512179 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f9af001d590 con 0x7f9b00096ec0 2023-10-05T21:14:48.064 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.054+0000 7fba0d381700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fba081295c0 0x7fba08129990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:48.064 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.054+0000 7fba0d381700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba080918d0 con 0x7fba08067eb0 2023-10-05T21:14:48.064 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.054+0000 7fba0d381700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba08091b00 con 0x7fba081295c0 2023-10-05T21:14:48.065 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.054+0000 7f99ea11c700 1 Processor -- start 2023-10-05T21:14:48.065 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.054+0000 7f9ae7fff700 1 --2- 172.21.15.111:0/3543512179 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9aec0358d0 0x7f9aec037d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:48.065 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.054+0000 7f99ea11c700 1 -- start start 2023-10-05T21:14:48.066 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.054+0000 7fba067fc700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fba08067eb0 0x7fba08068350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:47618/0 (socket says 172.21.15.111:47618) 2023-10-05T21:14:48.066 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.054+0000 7fba067fc700 1 -- 172.21.15.111:0/555674971 learned_addr learned my addr 172.21.15.111:0/555674971 (peer_addr_for_me v1:172.21.15.111:0/0) 2023-10-05T21:14:48.066 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.054+0000 7f9ae7fff700 1 -- 172.21.15.111:0/3543512179 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f9af0049ad0 con 0x7f9b00096ec0 2023-10-05T21:14:48.066 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.054+0000 7fba06ffd700 1 --2- 172.21.15.111:0/555674971 >> v2:172.21.15.111:3300/0 conn(0x7fba081295c0 0x7fba08129990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:48.067 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.055+0000 7f5480ff9700 1 -- 172.21.15.111:0/1167787654 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f5478004ad0 con 0x7f548408f3a0 2023-10-05T21:14:48.067 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.055+0000 7f9b06a13700 1 -- 172.21.15.111:0/3543512179 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b001245d0 con 0x7f9b00096ec0 2023-10-05T21:14:48.067 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.055+0000 7f99ea11c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f99e4090d40 0x7f99e4091110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:48.067 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.055+0000 7f99ea11c700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e4092070 con 0x7f99e4094030 2023-10-05T21:14:48.068 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.055+0000 7f99ea11c700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e406a8a0 con 0x7f99e4090d40 2023-10-05T21:14:48.068 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.055+0000 7f5480ff9700 1 --2- 172.21.15.111:0/1167787654 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5468035970 0x7f5468037e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:48.068 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.055+0000 7f5480ff9700 1 -- 172.21.15.111:0/1167787654 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f5478046e50 con 0x7f548408f3a0 2023-10-05T21:14:48.068 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.055+0000 7f9aff7fe700 1 --2- 172.21.15.111:0/3543512179 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9aec0358d0 0x7f9aec037d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:48.069 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.055+0000 7f5483fff700 1 --2- 172.21.15.111:0/1167787654 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5468035970 0x7f5468037e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:48.069 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.055+0000 7fba06ffd700 1 -- 172.21.15.111:0/555674971 >> v1:172.21.15.111:6789/0 conn(0x7fba08067eb0 legacy=0x7fba08068350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:48.069 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.055+0000 7fba06ffd700 1 -- 172.21.15.111:0/555674971 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba08094eb0 con 0x7fba081295c0 2023-10-05T21:14:48.069 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.055+0000 7fba06ffd700 1 --2- 172.21.15.111:0/555674971 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba081295c0 0x7fba08129990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8009860 tx=0x7fb9f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fece2f5b29e41fb server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:48.070 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.056+0000 7f99e2ffd700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f99e4094030 0x7f99e41260c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:47630/0 (socket says 172.21.15.111:47630) 2023-10-05T21:14:48.070 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.056+0000 7f99e37fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f99e4090d40 0x7f99e4091110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:48.070 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.056+0000 7f99e2ffd700 1 -- 172.21.15.111:0/526755468 learned_addr learned my addr 172.21.15.111:0/526755468 (peer_addr_for_me v1:172.21.15.111:0/0) 2023-10-05T21:14:48.070 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.056+0000 7f9aff7fe700 1 --2- 172.21.15.111:0/3543512179 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9aec0358d0 0x7f9aec037d80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9af4001730 tx=0x7f9af4007b40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:48.070 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.056+0000 7f5483fff700 1 --2- 172.21.15.111:0/1167787654 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5468035970 0x7f5468037e20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f54700091e0 tx=0x7f5470016000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:48.071 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.056+0000 7f99e37fe700 1 -- 172.21.15.111:0/526755468 >> v1:172.21.15.111:6789/0 conn(0x7f99e4094030 legacy=0x7f99e41260c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:48.071 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.056+0000 7f99e37fe700 1 -- 172.21.15.111:0/526755468 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e408f5f0 con 0x7f99e4090d40 2023-10-05T21:14:48.071 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.056+0000 7f99e37fe700 1 --2- 172.21.15.111:0/526755468 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99e4090d40 0x7f99e4091110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f99dc009de0 tx=0x7f99dc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee922f3bc485e7c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:48.071 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.059+0000 7f99e27fc700 1 -- 172.21.15.111:0/526755468 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99dc00e070 con 0x7f99e4090d40 2023-10-05T21:14:48.072 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.059+0000 7fba05ffb700 1 -- 172.21.15.111:0/555674971 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9f800b680 con 0x7fba081295c0 2023-10-05T21:14:48.072 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.059+0000 7f5480ff9700 1 -- 172.21.15.111:0/1167787654 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f54780108f0 con 0x7f548408f3a0 2023-10-05T21:14:48.072 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.067+0000 7fba05ffb700 1 -- 172.21.15.111:0/555674971 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f800b7e0 con 0x7fba081295c0 2023-10-05T21:14:48.072 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.067+0000 7fba05ffb700 1 -- 172.21.15.111:0/555674971 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9f800b970 con 0x7fba081295c0 2023-10-05T21:14:48.073 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.067+0000 7f99e27fc700 1 -- 172.21.15.111:0/526755468 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99dc00bc80 con 0x7f99e4090d40 2023-10-05T21:14:48.073 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.067+0000 7f99e27fc700 1 -- 172.21.15.111:0/526755468 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99dc012430 con 0x7f99e4090d40 2023-10-05T21:14:48.073 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.068+0000 7f9ae7fff700 1 -- 172.21.15.111:0/3543512179 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f9b001245d0 con 0x7f9b00096ec0 2023-10-05T21:14:48.073 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.068+0000 7fba0d381700 1 -- 172.21.15.111:0/555674971 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba081295c0 msgr2=0x7fba08129990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:48.073 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.068+0000 7fba0d381700 1 --2- 172.21.15.111:0/555674971 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba081295c0 0x7fba08129990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8009860 tx=0x7fb9f80091a0 comp rx=0 tx=0).stop 2023-10-05T21:14:48.074 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.068+0000 7f99ea11c700 1 -- 172.21.15.111:0/526755468 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99e4090d40 msgr2=0x7f99e4091110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:48.074 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.068+0000 7f99ea11c700 1 --2- 172.21.15.111:0/526755468 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99e4090d40 0x7f99e4091110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f99dc009de0 tx=0x7f99dc009780 comp rx=0 tx=0).stop 2023-10-05T21:14:48.074 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.068+0000 7fba0d381700 1 -- 172.21.15.111:0/555674971 shutdown_connections 2023-10-05T21:14:48.074 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.068+0000 7fba0d381700 1 --2- 172.21.15.111:0/555674971 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba081295c0 0x7fba08129990 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:48.074 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.068+0000 7fba0d381700 1 -- 172.21.15.111:0/555674971 >> 172.21.15.111:0/555674971 conn(0x7fba080991c0 msgr2=0x7fba080995c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:48.075 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.068+0000 7f99ea11c700 1 -- 172.21.15.111:0/526755468 shutdown_connections 2023-10-05T21:14:48.075 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.068+0000 7f99ea11c700 1 --2- 172.21.15.111:0/526755468 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99e4090d40 0x7f99e4091110 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:48.075 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.068+0000 7f99ea11c700 1 -- 172.21.15.111:0/526755468 >> 172.21.15.111:0/526755468 conn(0x7f99e40982e0 msgr2=0x7f99e40986e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:48.075 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.068+0000 7f99ea11c700 1 -- 172.21.15.111:0/526755468 shutdown_connections 2023-10-05T21:14:48.075 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.068+0000 7fba0d381700 1 -- 172.21.15.111:0/555674971 shutdown_connections 2023-10-05T21:14:48.076 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.068+0000 7fba0d381700 1 -- 172.21.15.111:0/555674971 wait complete. 2023-10-05T21:14:48.076 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.068+0000 7f99ea11c700 1 -- 172.21.15.111:0/526755468 wait complete. 2023-10-05T21:14:48.076 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.069+0000 7fba0d381700 1 Processor -- start 2023-10-05T21:14:48.076 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.069+0000 7fba0d381700 1 -- start start 2023-10-05T21:14:48.077 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.070+0000 7f99ea11c700 1 Processor -- start 2023-10-05T21:14:48.077 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.070+0000 7fba0d381700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba08067eb0 0x7fba08125f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:48.077 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.070+0000 7fba0d381700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba08085b60 con 0x7fba08067eb0 2023-10-05T21:14:48.078 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.070+0000 7f99ea11c700 1 -- start start 2023-10-05T21:14:48.078 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.070+0000 7f99ea11c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99e4090d40 0x7f99e413c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:48.078 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.070+0000 7f99ea11c700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e408dc40 con 0x7f99e4090d40 2023-10-05T21:14:48.078 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.070+0000 7fba06ffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba08067eb0 0x7fba08125f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:48.078 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.070+0000 7f99e37fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99e4090d40 0x7f99e413c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:48.079 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.070+0000 7fba06ffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba08067eb0 0x7fba08125f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49600/0 (socket says 172.21.15.111:49600) 2023-10-05T21:14:48.079 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.070+0000 7fba06ffd700 1 -- 172.21.15.111:0/4266964326 learned_addr learned my addr 172.21.15.111:0/4266964326 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-10-05T21:14:48.079 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.070+0000 7f99e37fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99e4090d40 0x7f99e413c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49616/0 (socket says 172.21.15.111:49616) 2023-10-05T21:14:48.079 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.070+0000 7f99e37fe700 1 -- 172.21.15.111:0/2921716355 learned_addr learned my addr 172.21.15.111:0/2921716355 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-10-05T21:14:48.079 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.071+0000 7f99e37fe700 1 -- 172.21.15.111:0/2921716355 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99dc009a20 con 0x7f99e4090d40 2023-10-05T21:14:48.080 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.071+0000 7fba06ffd700 1 -- 172.21.15.111:0/4266964326 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f8009420 con 0x7fba08067eb0 2023-10-05T21:14:48.080 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.071+0000 7f99e37fe700 1 --2- 172.21.15.111:0/2921716355 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99e4090d40 0x7f99e413c880 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f99dc0099f0 tx=0x7f99dc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:48.080 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.071+0000 7f99db7fe700 1 -- 172.21.15.111:0/2921716355 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99dc027470 con 0x7f99e4090d40 2023-10-05T21:14:48.080 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.071+0000 7fba06ffd700 1 --2- 172.21.15.111:0/4266964326 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba08067eb0 0x7fba08125f60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb9f80091e0 tx=0x7fb9f8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:48.081 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.071+0000 7f99db7fe700 1 -- 172.21.15.111:0/2921716355 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99dc0275d0 con 0x7f99e4090d40 2023-10-05T21:14:48.081 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.071+0000 7f99db7fe700 1 -- 172.21.15.111:0/2921716355 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99dc0278c0 con 0x7f99e4090d40 2023-10-05T21:14:48.081 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.071+0000 7f99ea11c700 1 -- 172.21.15.111:0/2921716355 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e411d9a0 con 0x7f99e4090d40 2023-10-05T21:14:48.081 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.071+0000 7f99ea11c700 1 -- 172.21.15.111:0/2921716355 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e413cdc0 con 0x7f99e4090d40 2023-10-05T21:14:48.082 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.072+0000 7fb9eeffd700 1 -- 172.21.15.111:0/4266964326 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9f8011cf0 con 0x7fba08067eb0 2023-10-05T21:14:48.082 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.072+0000 7fba0d381700 1 -- 172.21.15.111:0/4266964326 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba08086b80 con 0x7fba08067eb0 2023-10-05T21:14:48.082 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.072+0000 7fba0d381700 1 -- 172.21.15.111:0/4266964326 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba08085080 con 0x7fba08067eb0 2023-10-05T21:14:48.082 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.072+0000 7fb9eeffd700 1 -- 172.21.15.111:0/4266964326 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f801f070 con 0x7fba08067eb0 2023-10-05T21:14:48.082 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.072+0000 7fb9eeffd700 1 -- 172.21.15.111:0/4266964326 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9f801a440 con 0x7fba08067eb0 2023-10-05T21:14:48.082 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.072+0000 7f99ea11c700 1 -- 172.21.15.111:0/2921716355 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e40647e0 con 0x7f99e4090d40 2023-10-05T21:14:48.083 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.073+0000 7fba0d381700 1 -- 172.21.15.111:0/4266964326 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e80050b0 con 0x7fba08067eb0 2023-10-05T21:14:48.083 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.073+0000 7fb9eeffd700 1 -- 172.21.15.111:0/4266964326 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fb9f8021030 con 0x7fba08067eb0 2023-10-05T21:14:48.083 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.073+0000 7f99db7fe700 1 -- 172.21.15.111:0/2921716355 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f99dc024070 con 0x7f99e4090d40 2023-10-05T21:14:48.083 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.074+0000 7f99db7fe700 1 --2- 172.21.15.111:0/2921716355 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f99c4035880 0x7f99c4037d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:48.084 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.074+0000 7fb9eeffd700 1 --2- 172.21.15.111:0/4266964326 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fb9f4035910 0x7fb9f4037dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:48.084 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.074+0000 7f99db7fe700 1 -- 172.21.15.111:0/2921716355 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f99dc04a220 con 0x7f99e4090d40 2023-10-05T21:14:48.084 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.074+0000 7fb9eeffd700 1 -- 172.21.15.111:0/4266964326 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3478+0+0 (secure 0 0 0) 0x7fb9f80496f0 con 0x7fba08067eb0 2023-10-05T21:14:48.085 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.074+0000 7fba067fc700 1 --2- 172.21.15.111:0/4266964326 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fb9f4035910 0x7fb9f4037dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:48.085 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.074+0000 7f99e2ffd700 1 --2- 172.21.15.111:0/2921716355 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f99c4035880 0x7f99c4037d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:48.085 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.074+0000 7fba067fc700 1 --2- 172.21.15.111:0/4266964326 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fb9f4035910 0x7fb9f4037dc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0016a0 tx=0x7fb9fc007b30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:48.085 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.075+0000 7f99e2ffd700 1 --2- 172.21.15.111:0/2921716355 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f99c4035880 0x7f99c4037d30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f99cc0016a0 tx=0x7f99cc007b30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:48.086 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.078+0000 7fb9eeffd700 1 -- 172.21.15.111:0/4266964326 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb9f8010740 con 0x7fba08067eb0 2023-10-05T21:14:48.086 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.084+0000 7f99db7fe700 1 -- 172.21.15.111:0/2921716355 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f99dc011390 con 0x7f99e4090d40 2023-10-05T21:14:48.259 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.257+0000 7f548aec5700 1 -- 172.21.15.111:0/1167787654 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5464005360 con 0x7f548408f3a0 2023-10-05T21:14:48.259 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.257+0000 7f5480ff9700 1 -- 172.21.15.111:0/1167787654 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5478048030 con 0x7f548408f3a0 2023-10-05T21:14:48.259 INFO:teuthology.orchestra.run.smithi111.stdout:38654705665 2023-10-05T21:14:48.261 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.259+0000 7f548aec5700 1 -- 172.21.15.111:0/1167787654 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5468035970 msgr2=0x7f5468037e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:48.261 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.259+0000 7f548aec5700 1 --2- 172.21.15.111:0/1167787654 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5468035970 0x7f5468037e20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f54700091e0 tx=0x7f5470016000 comp rx=0 tx=0).stop 2023-10-05T21:14:48.261 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.259+0000 7f548aec5700 1 -- 172.21.15.111:0/1167787654 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f548408f3a0 msgr2=0x7f54841361d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:48.261 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.259+0000 7f548aec5700 1 --2- 172.21.15.111:0/1167787654 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f548408f3a0 0x7f54841361d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f547800c6c0 tx=0x7f5478007f70 comp rx=0 tx=0).stop 2023-10-05T21:14:48.262 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.259+0000 7f548aec5700 1 -- 172.21.15.111:0/1167787654 shutdown_connections 2023-10-05T21:14:48.262 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.259+0000 7f548aec5700 1 --2- 172.21.15.111:0/1167787654 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5468035970 0x7f5468037e20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:48.262 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.259+0000 7f548aec5700 1 --2- 172.21.15.111:0/1167787654 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f548408f3a0 0x7f54841361d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:48.262 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.259+0000 7f548aec5700 1 -- 172.21.15.111:0/1167787654 >> 172.21.15.111:0/1167787654 conn(0x7f5484097f00 msgr2=0x7f5484124730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:48.262 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.260+0000 7f548aec5700 1 -- 172.21.15.111:0/1167787654 shutdown_connections 2023-10-05T21:14:48.262 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.260+0000 7f548aec5700 1 -- 172.21.15.111:0/1167787654 wait complete. 2023-10-05T21:14:48.263 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.261+0000 7f9b06a13700 1 -- 172.21.15.111:0/3543512179 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9b001245d0 con 0x7f9b00096ec0 2023-10-05T21:14:48.263 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.261+0000 7f9ae7fff700 1 -- 172.21.15.111:0/3543512179 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9b001245d0 con 0x7f9b00096ec0 2023-10-05T21:14:48.263 INFO:teuthology.orchestra.run.smithi111.stdout:38654705665 2023-10-05T21:14:48.265 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.263+0000 7f9b06a13700 1 -- 172.21.15.111:0/3543512179 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9aec0358d0 msgr2=0x7f9aec037d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:48.265 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.263+0000 7f9b06a13700 1 --2- 172.21.15.111:0/3543512179 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9aec0358d0 0x7f9aec037d80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9af4001730 tx=0x7f9af4007b40 comp rx=0 tx=0).stop 2023-10-05T21:14:48.265 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.263+0000 7f9b06a13700 1 -- 172.21.15.111:0/3543512179 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b00096ec0 msgr2=0x7f9b001300b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:48.265 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.263+0000 7f9b06a13700 1 --2- 172.21.15.111:0/3543512179 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b00096ec0 0x7f9b001300b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9af0000c00 tx=0x7f9af0015000 comp rx=0 tx=0).stop 2023-10-05T21:14:48.265 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.263+0000 7f9b06a13700 1 -- 172.21.15.111:0/3543512179 shutdown_connections 2023-10-05T21:14:48.265 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.263+0000 7f9b06a13700 1 --2- 172.21.15.111:0/3543512179 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9aec0358d0 0x7f9aec037d80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:48.265 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.263+0000 7f9b06a13700 1 --2- 172.21.15.111:0/3543512179 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b00096ec0 0x7f9b001300b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:48.266 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.263+0000 7f9b06a13700 1 -- 172.21.15.111:0/3543512179 >> 172.21.15.111:0/3543512179 conn(0x7f9b00098d70 msgr2=0x7f9b00093740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:48.266 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.263+0000 7f9b06a13700 1 -- 172.21.15.111:0/3543512179 shutdown_connections 2023-10-05T21:14:48.266 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.263+0000 7f9b06a13700 1 -- 172.21.15.111:0/3543512179 wait complete. 2023-10-05T21:14:48.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705665 for osd.3 2023-10-05T21:14:48.277 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705665 for osd.2 2023-10-05T21:14:48.295 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.294+0000 7fba0d381700 1 -- 172.21.15.111:0/4266964326 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb9e8005360 con 0x7fba08067eb0 2023-10-05T21:14:48.296 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.294+0000 7fb9eeffd700 1 -- 172.21.15.111:0/4266964326 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb9f8010380 con 0x7fba08067eb0 2023-10-05T21:14:48.296 INFO:teuthology.orchestra.run.smithi111.stdout:38654705665 2023-10-05T21:14:48.298 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.296+0000 7fba0d381700 1 -- 172.21.15.111:0/4266964326 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fb9f4035910 msgr2=0x7fb9f4037dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:48.298 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.296+0000 7fba0d381700 1 --2- 172.21.15.111:0/4266964326 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fb9f4035910 0x7fb9f4037dc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0016a0 tx=0x7fb9fc007b30 comp rx=0 tx=0).stop 2023-10-05T21:14:48.298 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.296+0000 7fba0d381700 1 -- 172.21.15.111:0/4266964326 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba08067eb0 msgr2=0x7fba08125f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:48.298 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.296+0000 7fba0d381700 1 --2- 172.21.15.111:0/4266964326 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba08067eb0 0x7fba08125f60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb9f80091e0 tx=0x7fb9f8016000 comp rx=0 tx=0).stop 2023-10-05T21:14:48.298 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.296+0000 7fba0d381700 1 -- 172.21.15.111:0/4266964326 shutdown_connections 2023-10-05T21:14:48.298 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.296+0000 7fba0d381700 1 --2- 172.21.15.111:0/4266964326 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fb9f4035910 0x7fb9f4037dc0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:48.299 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.296+0000 7fba0d381700 1 --2- 172.21.15.111:0/4266964326 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba08067eb0 0x7fba08125f60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:48.299 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.296+0000 7fba0d381700 1 -- 172.21.15.111:0/4266964326 >> 172.21.15.111:0/4266964326 conn(0x7fba080991c0 msgr2=0x7fba08128120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:48.299 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.296+0000 7fba0d381700 1 -- 172.21.15.111:0/4266964326 shutdown_connections 2023-10-05T21:14:48.299 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.296+0000 7fba0d381700 1 -- 172.21.15.111:0/4266964326 wait complete. 2023-10-05T21:14:48.299 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.298+0000 7f99ea11c700 1 -- 172.21.15.111:0/2921716355 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f99e406e5d0 con 0x7f99e4090d40 2023-10-05T21:14:48.300 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.298+0000 7f99db7fe700 1 -- 172.21.15.111:0/2921716355 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f99dc01cba0 con 0x7f99e4090d40 2023-10-05T21:14:48.300 INFO:teuthology.orchestra.run.smithi111.stdout:38654705665 2023-10-05T21:14:48.305 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.301+0000 7f99ea11c700 1 -- 172.21.15.111:0/2921716355 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f99c4035880 msgr2=0x7f99c4037d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:48.305 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.301+0000 7f99ea11c700 1 --2- 172.21.15.111:0/2921716355 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f99c4035880 0x7f99c4037d30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f99cc0016a0 tx=0x7f99cc007b30 comp rx=0 tx=0).stop 2023-10-05T21:14:48.305 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.301+0000 7f99ea11c700 1 -- 172.21.15.111:0/2921716355 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99e4090d40 msgr2=0x7f99e413c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:48.305 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.301+0000 7f99ea11c700 1 --2- 172.21.15.111:0/2921716355 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99e4090d40 0x7f99e413c880 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f99dc0099f0 tx=0x7f99dc018000 comp rx=0 tx=0).stop 2023-10-05T21:14:48.305 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.301+0000 7f99ea11c700 1 -- 172.21.15.111:0/2921716355 shutdown_connections 2023-10-05T21:14:48.306 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.301+0000 7f99ea11c700 1 --2- 172.21.15.111:0/2921716355 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f99c4035880 0x7f99c4037d30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:48.306 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.301+0000 7f99ea11c700 1 --2- 172.21.15.111:0/2921716355 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99e4090d40 0x7f99e413c880 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:48.306 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.301+0000 7f99ea11c700 1 -- 172.21.15.111:0/2921716355 >> 172.21.15.111:0/2921716355 conn(0x7f99e40982e0 msgr2=0x7f99e406d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:48.306 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.301+0000 7f99ea11c700 1 -- 172.21.15.111:0/2921716355 shutdown_connections 2023-10-05T21:14:48.306 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:48.301+0000 7f99ea11c700 1 -- 172.21.15.111:0/2921716355 wait complete. 2023-10-05T21:14:48.310 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705665 for osd.1 2023-10-05T21:14:48.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705665 for osd.0 2023-10-05T21:14:49.275 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-05T21:14:49.278 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-05T21:14:49.311 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-05T21:14:49.316 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-05T21:14:49.417 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.415+0000 7f273dea3700 1 Processor -- start 2023-10-05T21:14:49.417 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.415+0000 7f273dea3700 1 -- start start 2023-10-05T21:14:49.418 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.416+0000 7f273dea3700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f2738096ec0 0x7f2738097290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:49.418 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.416+0000 7f273dea3700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27380931b0 con 0x7f27380977d0 2023-10-05T21:14:49.419 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.416+0000 7f273dea3700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2738090810 con 0x7f2738096ec0 2023-10-05T21:14:49.419 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.416+0000 7f27377fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f2738096ec0 0x7f2738097290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:49.419 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.416+0000 7f2736ffd700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f27380977d0 0x7f2738091540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:47640/0 (socket says 172.21.15.111:47640) 2023-10-05T21:14:49.419 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.416+0000 7f2736ffd700 1 -- 172.21.15.111:0/1563247235 learned_addr learned my addr 172.21.15.111:0/1563247235 (peer_addr_for_me v1:172.21.15.111:0/0) 2023-10-05T21:14:49.419 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.416+0000 7f27377fe700 1 -- 172.21.15.111:0/1563247235 >> v1:172.21.15.111:6789/0 conn(0x7f27380977d0 legacy=0x7f2738091540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:49.419 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.416+0000 7f27377fe700 1 -- 172.21.15.111:0/1563247235 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27380909d0 con 0x7f2738096ec0 2023-10-05T21:14:49.419 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.416+0000 7f27377fe700 1 --2- 172.21.15.111:0/1563247235 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2738096ec0 0x7f2738097290 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2728009850 tx=0x7f2728009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e004f103c8c62d6f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:49.419 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.417+0000 7f27367fc700 1 -- 172.21.15.111:0/1563247235 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2728005d50 con 0x7f2738096ec0 2023-10-05T21:14:49.420 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.417+0000 7f27367fc700 1 -- 172.21.15.111:0/1563247235 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2728006030 con 0x7f2738096ec0 2023-10-05T21:14:49.420 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.417+0000 7f27367fc700 1 -- 172.21.15.111:0/1563247235 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2728006300 con 0x7f2738096ec0 2023-10-05T21:14:49.422 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.417+0000 7f273dea3700 1 -- 172.21.15.111:0/1563247235 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2738096ec0 msgr2=0x7f2738097290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:49.422 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.417+0000 7f273dea3700 1 --2- 172.21.15.111:0/1563247235 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2738096ec0 0x7f2738097290 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2728009850 tx=0x7f2728009120 comp rx=0 tx=0).stop 2023-10-05T21:14:49.422 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.417+0000 7f273dea3700 1 -- 172.21.15.111:0/1563247235 shutdown_connections 2023-10-05T21:14:49.422 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.417+0000 7f273dea3700 1 --2- 172.21.15.111:0/1563247235 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2738096ec0 0x7f2738097290 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:49.422 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.417+0000 7f273dea3700 1 -- 172.21.15.111:0/1563247235 >> 172.21.15.111:0/1563247235 conn(0x7f2738098d70 msgr2=0x7f2738099170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:49.423 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.417+0000 7f273dea3700 1 -- 172.21.15.111:0/1563247235 shutdown_connections 2023-10-05T21:14:49.423 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.417+0000 7f273dea3700 1 -- 172.21.15.111:0/1563247235 wait complete. 2023-10-05T21:14:49.423 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.418+0000 7f273dea3700 1 Processor -- start 2023-10-05T21:14:49.423 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.418+0000 7f273dea3700 1 -- start start 2023-10-05T21:14:49.423 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.419+0000 7f273dea3700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2738096ec0 0x7f27381387f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:49.423 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.419+0000 7f273dea3700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2738096370 con 0x7f2738096ec0 2023-10-05T21:14:49.423 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.419+0000 7f27377fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2738096ec0 0x7f27381387f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:49.423 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.419+0000 7f27377fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2738096ec0 0x7f27381387f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49646/0 (socket says 172.21.15.111:49646) 2023-10-05T21:14:49.424 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.419+0000 7f27377fe700 1 -- 172.21.15.111:0/978156717 learned_addr learned my addr 172.21.15.111:0/978156717 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-10-05T21:14:49.424 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.419+0000 7f27377fe700 1 -- 172.21.15.111:0/978156717 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27280093c0 con 0x7f2738096ec0 2023-10-05T21:14:49.424 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.419+0000 7f27377fe700 1 --2- 172.21.15.111:0/978156717 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2738096ec0 0x7f27381387f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2728000c00 tx=0x7f2728015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:49.424 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.420+0000 7f271f7fe700 1 -- 172.21.15.111:0/978156717 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f272800b9e0 con 0x7f2738096ec0 2023-10-05T21:14:49.424 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.420+0000 7f271f7fe700 1 -- 172.21.15.111:0/978156717 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272800bb40 con 0x7f2738096ec0 2023-10-05T21:14:49.424 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.420+0000 7f273dea3700 1 -- 172.21.15.111:0/978156717 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f273808d850 con 0x7f2738096ec0 2023-10-05T21:14:49.424 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.420+0000 7f273dea3700 1 -- 172.21.15.111:0/978156717 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f273808f570 con 0x7f2738096ec0 2023-10-05T21:14:49.424 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.420+0000 7f271f7fe700 1 -- 172.21.15.111:0/978156717 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f272800be10 con 0x7f2738096ec0 2023-10-05T21:14:49.425 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.421+0000 7f271f7fe700 1 -- 172.21.15.111:0/978156717 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f2728023070 con 0x7f2738096ec0 2023-10-05T21:14:49.425 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.421+0000 7f271f7fe700 1 --2- 172.21.15.111:0/978156717 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f27240358c0 0x7f2724037d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:49.425 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.421+0000 7f273dea3700 1 -- 172.21.15.111:0/978156717 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27180050b0 con 0x7f2738096ec0 2023-10-05T21:14:49.425 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.421+0000 7f271f7fe700 1 -- 172.21.15.111:0/978156717 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f2728049700 con 0x7f2738096ec0 2023-10-05T21:14:49.426 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.424+0000 7f2736ffd700 1 --2- 172.21.15.111:0/978156717 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f27240358c0 0x7f2724037d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:49.427 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.426+0000 7f2736ffd700 1 --2- 172.21.15.111:0/978156717 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f27240358c0 0x7f2724037d70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f272c0016c0 tx=0x7f272c007b50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:49.431 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.429+0000 7f271f7fe700 1 -- 172.21.15.111:0/978156717 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f272801d430 con 0x7f2738096ec0 2023-10-05T21:14:49.446 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.444+0000 7f5b8c5d5700 1 Processor -- start 2023-10-05T21:14:49.447 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.444+0000 7f5b8c5d5700 1 -- start start 2023-10-05T21:14:49.450 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.445+0000 7f5b8c5d5700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f5b8412c290 0x7f5b8412e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:49.450 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.445+0000 7f5b8c5d5700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b8409af90 con 0x7f5b8406ee20 2023-10-05T21:14:49.450 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.445+0000 7f5b8c5d5700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b8406a7b0 con 0x7f5b8412c290 2023-10-05T21:14:49.451 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.445+0000 7f5b8a371700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f5b8406ee20 0x7f5b8406f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:47646/0 (socket says 172.21.15.111:47646) 2023-10-05T21:14:49.451 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.445+0000 7f5b8a371700 1 -- 172.21.15.111:0/960067761 learned_addr learned my addr 172.21.15.111:0/960067761 (peer_addr_for_me v1:172.21.15.111:0/0) 2023-10-05T21:14:49.451 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.445+0000 7f5b89b70700 1 --2- 172.21.15.111:0/960067761 >> v2:172.21.15.111:3300/0 conn(0x7f5b8412c290 0x7f5b8412e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:49.451 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.446+0000 7f5b8936f700 1 -- 172.21.15.111:0/960067761 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1533890455 0 0) 0x7f5b8409af90 con 0x7f5b8406ee20 2023-10-05T21:14:49.451 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.446+0000 7f5b8936f700 1 -- 172.21.15.111:0/960067761 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b70003570 con 0x7f5b8406ee20 2023-10-05T21:14:49.451 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.446+0000 7f5b89b70700 1 -- 172.21.15.111:0/960067761 >> v1:172.21.15.111:6789/0 conn(0x7f5b8406ee20 legacy=0x7f5b8406f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:49.452 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.446+0000 7f5b89b70700 1 -- 172.21.15.111:0/960067761 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8406f900 con 0x7f5b8412c290 2023-10-05T21:14:49.452 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.446+0000 7f5b89b70700 1 --2- 172.21.15.111:0/960067761 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b8412c290 0x7f5b8412e670 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5b74009860 tx=0x7f5b740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da0c0d8db26f0533 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:49.452 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.446+0000 7f5b8936f700 1 -- 172.21.15.111:0/960067761 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b74011630 con 0x7f5b8412c290 2023-10-05T21:14:49.452 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.446+0000 7f5b8936f700 1 -- 172.21.15.111:0/960067761 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b74011790 con 0x7f5b8412c290 2023-10-05T21:14:49.452 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.446+0000 7f5b8936f700 1 -- 172.21.15.111:0/960067761 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b74011a60 con 0x7f5b8412c290 2023-10-05T21:14:49.452 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.447+0000 7f5b8c5d5700 1 -- 172.21.15.111:0/960067761 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b8412c290 msgr2=0x7f5b8412e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:49.453 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.447+0000 7f5b8c5d5700 1 --2- 172.21.15.111:0/960067761 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b8412c290 0x7f5b8412e670 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5b74009860 tx=0x7f5b740091a0 comp rx=0 tx=0).stop 2023-10-05T21:14:49.453 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.447+0000 7f5b8c5d5700 1 -- 172.21.15.111:0/960067761 shutdown_connections 2023-10-05T21:14:49.453 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.447+0000 7f5b8c5d5700 1 --2- 172.21.15.111:0/960067761 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b8412c290 0x7f5b8412e670 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:49.453 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.447+0000 7f5b8c5d5700 1 -- 172.21.15.111:0/960067761 >> 172.21.15.111:0/960067761 conn(0x7f5b8409a0a0 msgr2=0x7f5b8409a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:49.453 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.447+0000 7f5b8c5d5700 1 -- 172.21.15.111:0/960067761 shutdown_connections 2023-10-05T21:14:49.453 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.447+0000 7f5b8c5d5700 1 -- 172.21.15.111:0/960067761 wait complete. 2023-10-05T21:14:49.454 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.448+0000 7ff91fcdb700 1 Processor -- start 2023-10-05T21:14:49.454 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.448+0000 7ff91fcdb700 1 -- start start 2023-10-05T21:14:49.454 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.448+0000 7ff91fcdb700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ff918068990 0x7ff91812c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:49.455 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.448+0000 7ff91fcdb700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff91806baa0 con 0x7ff918067eb0 2023-10-05T21:14:49.455 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.448+0000 7ff91fcdb700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff918092d20 con 0x7ff918068990 2023-10-05T21:14:49.455 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.448+0000 7ff91da77700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7ff918067eb0 0x7ff918068280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:47660/0 (socket says 172.21.15.111:47660) 2023-10-05T21:14:49.455 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.448+0000 7ff91da77700 1 -- 172.21.15.111:0/1278964727 learned_addr learned my addr 172.21.15.111:0/1278964727 (peer_addr_for_me v1:172.21.15.111:0/0) 2023-10-05T21:14:49.455 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.448+0000 7ff91d276700 1 --2- 172.21.15.111:0/1278964727 >> v2:172.21.15.111:3300/0 conn(0x7ff918068990 0x7ff91812c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:49.455 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.448+0000 7f5b8c5d5700 1 Processor -- start 2023-10-05T21:14:49.455 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.449+0000 7f5b8c5d5700 1 -- start start 2023-10-05T21:14:49.456 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.449+0000 7ff91d276700 1 -- 172.21.15.111:0/1278964727 >> v1:172.21.15.111:6789/0 conn(0x7ff918067eb0 legacy=0x7ff918068280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:49.456 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.449+0000 7ff91d276700 1 -- 172.21.15.111:0/1278964727 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91806fb20 con 0x7ff918068990 2023-10-05T21:14:49.456 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.449+0000 7ff91d276700 1 --2- 172.21.15.111:0/1278964727 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff918068990 0x7ff91812c610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff90c009860 tx=0x7ff90c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62362b601bdc56bc server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:49.456 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.449+0000 7ff91ca75700 1 -- 172.21.15.111:0/1278964727 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff90c00b680 con 0x7ff918068990 2023-10-05T21:14:49.457 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.449+0000 7f5b8c5d5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b8406ee20 0x7f5b840889f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:49.457 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.449+0000 7f5b8c5d5700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b84090070 con 0x7f5b8406ee20 2023-10-05T21:14:49.457 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.449+0000 7ff91ca75700 1 -- 172.21.15.111:0/1278964727 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90c00b7e0 con 0x7ff918068990 2023-10-05T21:14:49.457 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.449+0000 7ff91ca75700 1 -- 172.21.15.111:0/1278964727 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff90c00b990 con 0x7ff918068990 2023-10-05T21:14:49.458 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.449+0000 7f5b8a371700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b8406ee20 0x7f5b840889f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:49.458 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.449+0000 7f5b8a371700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b8406ee20 0x7f5b840889f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49678/0 (socket says 172.21.15.111:49678) 2023-10-05T21:14:49.458 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.449+0000 7f5b8a371700 1 -- 172.21.15.111:0/1171214662 learned_addr learned my addr 172.21.15.111:0/1171214662 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-10-05T21:14:49.458 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.450+0000 7f5b8a371700 1 -- 172.21.15.111:0/1171214662 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b74009420 con 0x7f5b8406ee20 2023-10-05T21:14:49.458 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.450+0000 7f5b8a371700 1 --2- 172.21.15.111:0/1171214662 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b8406ee20 0x7f5b840889f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5b8000c6c0 tx=0x7f5b80007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:49.459 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.450+0000 7ff91fcdb700 1 -- 172.21.15.111:0/1278964727 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff918068990 msgr2=0x7ff91812c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:49.459 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.450+0000 7ff91fcdb700 1 --2- 172.21.15.111:0/1278964727 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff918068990 0x7ff91812c610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff90c009860 tx=0x7ff90c0091a0 comp rx=0 tx=0).stop 2023-10-05T21:14:49.459 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.450+0000 7f5b7a7fc700 1 -- 172.21.15.111:0/1171214662 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b80005b30 con 0x7f5b8406ee20 2023-10-05T21:14:49.459 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.450+0000 7f5b7a7fc700 1 -- 172.21.15.111:0/1171214662 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b80005c90 con 0x7f5b8406ee20 2023-10-05T21:14:49.459 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.450+0000 7f5b7a7fc700 1 -- 172.21.15.111:0/1171214662 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b800070d0 con 0x7f5b8406ee20 2023-10-05T21:14:49.460 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.450+0000 7ff91fcdb700 1 -- 172.21.15.111:0/1278964727 shutdown_connections 2023-10-05T21:14:49.460 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.450+0000 7ff91fcdb700 1 --2- 172.21.15.111:0/1278964727 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff918068990 0x7ff91812c610 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:49.460 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.450+0000 7ff91fcdb700 1 -- 172.21.15.111:0/1278964727 >> 172.21.15.111:0/1278964727 conn(0x7ff9180991c0 msgr2=0x7ff9180995c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:49.460 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.450+0000 7ff91fcdb700 1 -- 172.21.15.111:0/1278964727 shutdown_connections 2023-10-05T21:14:49.460 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.450+0000 7ff91fcdb700 1 -- 172.21.15.111:0/1278964727 wait complete. 2023-10-05T21:14:49.461 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.450+0000 7f5b8c5d5700 1 -- 172.21.15.111:0/1171214662 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b840855b0 con 0x7f5b8406ee20 2023-10-05T21:14:49.461 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.450+0000 7f5b8c5d5700 1 -- 172.21.15.111:0/1171214662 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b8408f820 con 0x7f5b8406ee20 2023-10-05T21:14:49.461 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.451+0000 7ff91fcdb700 1 Processor -- start 2023-10-05T21:14:49.462 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.451+0000 7f5b7a7fc700 1 -- 172.21.15.111:0/1171214662 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f5b80007230 con 0x7f5b8406ee20 2023-10-05T21:14:49.462 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.451+0000 7f5b8c5d5700 1 -- 172.21.15.111:0/1171214662 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b840647e0 con 0x7f5b8406ee20 2023-10-05T21:14:49.462 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.451+0000 7f5b7a7fc700 1 --2- 172.21.15.111:0/1171214662 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5b680358c0 0x7f5b68037d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:49.462 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.451+0000 7f5b7a7fc700 1 -- 172.21.15.111:0/1171214662 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f5b80046de0 con 0x7f5b8406ee20 2023-10-05T21:14:49.462 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.452+0000 7f5b89b70700 1 --2- 172.21.15.111:0/1171214662 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5b680358c0 0x7f5b68037d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:49.463 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.451+0000 7ff91fcdb700 1 -- start start 2023-10-05T21:14:49.463 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.452+0000 7ff91fcdb700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff918067eb0 0x7ff9180904d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:49.463 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.452+0000 7ff91fcdb700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff918125f40 con 0x7ff918067eb0 2023-10-05T21:14:49.463 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.452+0000 7f5b89b70700 1 --2- 172.21.15.111:0/1171214662 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5b680358c0 0x7f5b68037d70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5b740091e0 tx=0x7f5b74016000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:49.464 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.453+0000 7ff91da77700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff918067eb0 0x7ff9180904d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:49.464 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.453+0000 7ff91da77700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff918067eb0 0x7ff9180904d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49684/0 (socket says 172.21.15.111:49684) 2023-10-05T21:14:49.464 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.453+0000 7ff91da77700 1 -- 172.21.15.111:0/1757998741 learned_addr learned my addr 172.21.15.111:0/1757998741 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-10-05T21:14:49.464 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.453+0000 7ff91da77700 1 -- 172.21.15.111:0/1757998741 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff90c009420 con 0x7ff918067eb0 2023-10-05T21:14:49.464 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.453+0000 7ff91da77700 1 --2- 172.21.15.111:0/1757998741 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff918067eb0 0x7ff9180904d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff91400c6c0 tx=0x7ff914007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:49.465 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.458+0000 7fe014ca9700 1 Processor -- start 2023-10-05T21:14:49.465 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.459+0000 7fe014ca9700 1 -- start start 2023-10-05T21:14:49.465 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.459+0000 7f5b7a7fc700 1 -- 172.21.15.111:0/1171214662 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f5b8000eaf0 con 0x7f5b8406ee20 2023-10-05T21:14:49.466 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.459+0000 7fe014ca9700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe01006bc10 0x7fe01012ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:49.466 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.459+0000 7fe014ca9700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe01006d490 con 0x7fe01006b130 2023-10-05T21:14:49.466 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.459+0000 7fe014ca9700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe01006e990 con 0x7fe01006bc10 2023-10-05T21:14:49.466 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.459+0000 7fe00e59c700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fe01006b130 0x7fe01006b500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:47668/0 (socket says 172.21.15.111:47668) 2023-10-05T21:14:49.467 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.459+0000 7fe00e59c700 1 -- 172.21.15.111:0/3648782973 learned_addr learned my addr 172.21.15.111:0/3648782973 (peer_addr_for_me v1:172.21.15.111:0/0) 2023-10-05T21:14:49.467 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.459+0000 7fe00dd9b700 1 --2- 172.21.15.111:0/3648782973 >> v2:172.21.15.111:3300/0 conn(0x7fe01006bc10 0x7fe01012ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:49.467 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.460+0000 7fe00dd9b700 1 -- 172.21.15.111:0/3648782973 >> v1:172.21.15.111:6789/0 conn(0x7fe01006b130 legacy=0x7fe01006b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:49.467 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.460+0000 7fe00dd9b700 1 -- 172.21.15.111:0/3648782973 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01006c570 con 0x7fe01006bc10 2023-10-05T21:14:49.468 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.459+0000 7ff909ffb700 1 -- 172.21.15.111:0/1757998741 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff914005b30 con 0x7ff918067eb0 2023-10-05T21:14:49.468 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.459+0000 7ff909ffb700 1 -- 172.21.15.111:0/1757998741 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff914005c90 con 0x7ff918067eb0 2023-10-05T21:14:49.468 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.459+0000 7ff909ffb700 1 -- 172.21.15.111:0/1757998741 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff914004830 con 0x7ff918067eb0 2023-10-05T21:14:49.468 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.459+0000 7ff91fcdb700 1 -- 172.21.15.111:0/1757998741 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9181276e0 con 0x7ff918067eb0 2023-10-05T21:14:49.468 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.459+0000 7ff91fcdb700 1 -- 172.21.15.111:0/1757998741 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff918126a70 con 0x7ff918067eb0 2023-10-05T21:14:49.468 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.460+0000 7ff909ffb700 1 -- 172.21.15.111:0/1757998741 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7ff914004990 con 0x7ff918067eb0 2023-10-05T21:14:49.468 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.460+0000 7ff909ffb700 1 --2- 172.21.15.111:0/1757998741 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff8fc035920 0x7ff8fc037dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:49.468 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.460+0000 7ff91fcdb700 1 -- 172.21.15.111:0/1757998741 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff918126f00 con 0x7ff918067eb0 2023-10-05T21:14:49.469 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.460+0000 7fe00dd9b700 1 --2- 172.21.15.111:0/3648782973 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe01006bc10 0x7fe01012ab70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe00400bb10 tx=0x7fe00400b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b451a059e4ba9e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:49.469 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.460+0000 7ff909ffb700 1 -- 172.21.15.111:0/1757998741 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3478+0+0 (secure 0 0 0) 0x7ff91401bc60 con 0x7ff918067eb0 2023-10-05T21:14:49.469 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.461+0000 7ff91d276700 1 --2- 172.21.15.111:0/1757998741 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff8fc035920 0x7ff8fc037dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:49.469 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.461+0000 7ff91d276700 1 --2- 172.21.15.111:0/1757998741 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff8fc035920 0x7ff8fc037dd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff918068d60 tx=0x7ff90c016000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:49.470 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.461+0000 7fe00d59a700 1 -- 172.21.15.111:0/3648782973 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe00400db20 con 0x7fe01006bc10 2023-10-05T21:14:49.470 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.465+0000 7fe00d59a700 1 -- 172.21.15.111:0/3648782973 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00400dc80 con 0x7fe01006bc10 2023-10-05T21:14:49.470 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.465+0000 7fe00d59a700 1 -- 172.21.15.111:0/3648782973 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe004010470 con 0x7fe01006bc10 2023-10-05T21:14:49.471 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.465+0000 7ff909ffb700 1 -- 172.21.15.111:0/1757998741 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff918126f00 con 0x7ff918067eb0 2023-10-05T21:14:49.471 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.466+0000 7fe014ca9700 1 -- 172.21.15.111:0/3648782973 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe01006bc10 msgr2=0x7fe01012ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:49.471 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.466+0000 7fe014ca9700 1 --2- 172.21.15.111:0/3648782973 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe01006bc10 0x7fe01012ab70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe00400bb10 tx=0x7fe00400b430 comp rx=0 tx=0).stop 2023-10-05T21:14:49.472 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.471+0000 7fe014ca9700 1 -- 172.21.15.111:0/3648782973 shutdown_connections 2023-10-05T21:14:49.472 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.471+0000 7fe014ca9700 1 --2- 172.21.15.111:0/3648782973 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe01006bc10 0x7fe01012ab70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:49.472 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.471+0000 7fe014ca9700 1 -- 172.21.15.111:0/3648782973 >> 172.21.15.111:0/3648782973 conn(0x7fe0100956b0 msgr2=0x7fe010095ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:49.473 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.471+0000 7fe014ca9700 1 -- 172.21.15.111:0/3648782973 shutdown_connections 2023-10-05T21:14:49.473 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.471+0000 7fe014ca9700 1 -- 172.21.15.111:0/3648782973 wait complete. 2023-10-05T21:14:49.474 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.471+0000 7fe014ca9700 1 Processor -- start 2023-10-05T21:14:49.474 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.471+0000 7fe014ca9700 1 -- start start 2023-10-05T21:14:49.474 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.472+0000 7fe014ca9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe01006b130 0x7fe010134240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:49.475 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.472+0000 7fe014ca9700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0100878f0 con 0x7fe01006b130 2023-10-05T21:14:49.475 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.472+0000 7fe00e59c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe01006b130 0x7fe010134240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:49.475 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.472+0000 7fe00e59c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe01006b130 0x7fe010134240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49702/0 (socket says 172.21.15.111:49702) 2023-10-05T21:14:49.475 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.472+0000 7fe00e59c700 1 -- 172.21.15.111:0/1383363816 learned_addr learned my addr 172.21.15.111:0/1383363816 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-10-05T21:14:49.475 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.472+0000 7fe00e59c700 1 -- 172.21.15.111:0/1383363816 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00400b6d0 con 0x7fe01006b130 2023-10-05T21:14:49.475 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.472+0000 7fe00e59c700 1 --2- 172.21.15.111:0/1383363816 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe01006b130 0x7fe010134240 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe00000c6c0 tx=0x7fe000007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:49.475 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.473+0000 7fdffe7fc700 1 -- 172.21.15.111:0/1383363816 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe000005b30 con 0x7fe01006b130 2023-10-05T21:14:49.475 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.473+0000 7fdffe7fc700 1 -- 172.21.15.111:0/1383363816 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe000005c90 con 0x7fe01006b130 2023-10-05T21:14:49.476 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.473+0000 7fdffe7fc700 1 -- 172.21.15.111:0/1383363816 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe000004830 con 0x7fe01006b130 2023-10-05T21:14:49.477 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.473+0000 7fe014ca9700 1 -- 172.21.15.111:0/1383363816 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe010086370 con 0x7fe01006b130 2023-10-05T21:14:49.477 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.473+0000 7fe014ca9700 1 -- 172.21.15.111:0/1383363816 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0100874b0 con 0x7fe01006b130 2023-10-05T21:14:49.477 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.474+0000 7fe014ca9700 1 -- 172.21.15.111:0/1383363816 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe010126530 con 0x7fe01006b130 2023-10-05T21:14:49.477 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.474+0000 7fdffe7fc700 1 -- 172.21.15.111:0/1383363816 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fe000004a60 con 0x7fe01006b130 2023-10-05T21:14:49.477 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.475+0000 7fdffe7fc700 1 --2- 172.21.15.111:0/1383363816 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fdff0035880 0x7fdff0037d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:49.477 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.475+0000 7fdffe7fc700 1 -- 172.21.15.111:0/1383363816 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3478+0+0 (secure 0 0 0) 0x7fe000046d80 con 0x7fe01006b130 2023-10-05T21:14:49.478 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.475+0000 7fe00dd9b700 1 --2- 172.21.15.111:0/1383363816 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fdff0035880 0x7fdff0037d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:49.478 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.475+0000 7fe00dd9b700 1 --2- 172.21.15.111:0/1383363816 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fdff0035880 0x7fdff0037d30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe00400b470 tx=0x7fe00401a000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:49.481 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.479+0000 7fdffe7fc700 1 -- 172.21.15.111:0/1383363816 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fe0000108f0 con 0x7fe01006b130 2023-10-05T21:14:49.629 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.627+0000 7f273dea3700 1 -- 172.21.15.111:0/978156717 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2718005360 con 0x7f2738096ec0 2023-10-05T21:14:49.630 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.628+0000 7f271f7fe700 1 -- 172.21.15.111:0/978156717 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2728025420 con 0x7f2738096ec0 2023-10-05T21:14:49.630 INFO:teuthology.orchestra.run.smithi111.stdout:38654705665 2023-10-05T21:14:49.632 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.630+0000 7f273dea3700 1 -- 172.21.15.111:0/978156717 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f27240358c0 msgr2=0x7f2724037d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:49.632 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.630+0000 7f273dea3700 1 --2- 172.21.15.111:0/978156717 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f27240358c0 0x7f2724037d70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f272c0016c0 tx=0x7f272c007b50 comp rx=0 tx=0).stop 2023-10-05T21:14:49.633 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.630+0000 7f273dea3700 1 -- 172.21.15.111:0/978156717 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2738096ec0 msgr2=0x7f27381387f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:49.633 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.630+0000 7f273dea3700 1 --2- 172.21.15.111:0/978156717 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2738096ec0 0x7f27381387f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2728000c00 tx=0x7f2728015000 comp rx=0 tx=0).stop 2023-10-05T21:14:49.633 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.630+0000 7f273dea3700 1 -- 172.21.15.111:0/978156717 shutdown_connections 2023-10-05T21:14:49.633 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.630+0000 7f273dea3700 1 --2- 172.21.15.111:0/978156717 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f27240358c0 0x7f2724037d70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:49.633 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.630+0000 7f273dea3700 1 --2- 172.21.15.111:0/978156717 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2738096ec0 0x7f27381387f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:49.633 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.630+0000 7f273dea3700 1 -- 172.21.15.111:0/978156717 >> 172.21.15.111:0/978156717 conn(0x7f2738098d70 msgr2=0x7f2738084ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:49.634 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.630+0000 7f273dea3700 1 -- 172.21.15.111:0/978156717 shutdown_connections 2023-10-05T21:14:49.634 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.630+0000 7f273dea3700 1 -- 172.21.15.111:0/978156717 wait complete. 2023-10-05T21:14:49.644 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705665 for osd.3 2023-10-05T21:14:49.671 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.669+0000 7fe014ca9700 1 -- 172.21.15.111:0/1383363816 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe0100647e0 con 0x7fe01006b130 2023-10-05T21:14:49.671 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.669+0000 7fdffe7fc700 1 -- 172.21.15.111:0/1383363816 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe000048030 con 0x7fe01006b130 2023-10-05T21:14:49.671 INFO:teuthology.orchestra.run.smithi111.stdout:38654705667 2023-10-05T21:14:49.673 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.671+0000 7fe014ca9700 1 -- 172.21.15.111:0/1383363816 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fdff0035880 msgr2=0x7fdff0037d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:49.673 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.671+0000 7fe014ca9700 1 --2- 172.21.15.111:0/1383363816 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fdff0035880 0x7fdff0037d30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe00400b470 tx=0x7fe00401a000 comp rx=0 tx=0).stop 2023-10-05T21:14:49.673 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.671+0000 7fe014ca9700 1 -- 172.21.15.111:0/1383363816 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe01006b130 msgr2=0x7fe010134240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:49.673 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.671+0000 7fe014ca9700 1 --2- 172.21.15.111:0/1383363816 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe01006b130 0x7fe010134240 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe00000c6c0 tx=0x7fe000007f70 comp rx=0 tx=0).stop 2023-10-05T21:14:49.674 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.671+0000 7fe014ca9700 1 -- 172.21.15.111:0/1383363816 shutdown_connections 2023-10-05T21:14:49.674 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.671+0000 7fe014ca9700 1 --2- 172.21.15.111:0/1383363816 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fdff0035880 0x7fdff0037d30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:49.674 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.671+0000 7fe014ca9700 1 --2- 172.21.15.111:0/1383363816 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe01006b130 0x7fe010134240 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:49.674 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.671+0000 7fe014ca9700 1 -- 172.21.15.111:0/1383363816 >> 172.21.15.111:0/1383363816 conn(0x7fe0100956b0 msgr2=0x7fe010126b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:49.674 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.671+0000 7fe014ca9700 1 -- 172.21.15.111:0/1383363816 shutdown_connections 2023-10-05T21:14:49.674 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.671+0000 7fe014ca9700 1 -- 172.21.15.111:0/1383363816 wait complete. 2023-10-05T21:14:49.679 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.678+0000 7f5b8c5d5700 1 -- 172.21.15.111:0/1171214662 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5b8404bb40 con 0x7f5b8406ee20 2023-10-05T21:14:49.680 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.678+0000 7f5b7a7fc700 1 -- 172.21.15.111:0/1171214662 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5b80017070 con 0x7f5b8406ee20 2023-10-05T21:14:49.680 INFO:teuthology.orchestra.run.smithi111.stdout:38654705667 2023-10-05T21:14:49.680 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.678+0000 7ff91fcdb700 1 -- 172.21.15.111:0/1757998741 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff918126f00 con 0x7ff918067eb0 2023-10-05T21:14:49.681 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.678+0000 7ff909ffb700 1 -- 172.21.15.111:0/1757998741 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff918126f00 con 0x7ff918067eb0 2023-10-05T21:14:49.681 INFO:teuthology.orchestra.run.smithi111.stdout:38654705667 2023-10-05T21:14:49.682 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.680+0000 7f5b8c5d5700 1 -- 172.21.15.111:0/1171214662 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5b680358c0 msgr2=0x7f5b68037d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:49.682 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.680+0000 7f5b8c5d5700 1 --2- 172.21.15.111:0/1171214662 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5b680358c0 0x7f5b68037d70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5b740091e0 tx=0x7f5b74016000 comp rx=0 tx=0).stop 2023-10-05T21:14:49.683 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.680+0000 7f5b8c5d5700 1 -- 172.21.15.111:0/1171214662 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b8406ee20 msgr2=0x7f5b840889f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:49.683 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.680+0000 7f5b8c5d5700 1 --2- 172.21.15.111:0/1171214662 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b8406ee20 0x7f5b840889f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5b8000c6c0 tx=0x7f5b80007e00 comp rx=0 tx=0).stop 2023-10-05T21:14:49.683 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.680+0000 7f5b8c5d5700 1 -- 172.21.15.111:0/1171214662 shutdown_connections 2023-10-05T21:14:49.683 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.680+0000 7f5b8c5d5700 1 --2- 172.21.15.111:0/1171214662 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5b680358c0 0x7f5b68037d70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:49.683 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.680+0000 7f5b8c5d5700 1 --2- 172.21.15.111:0/1171214662 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b8406ee20 0x7f5b840889f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:49.683 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.680+0000 7f5b8c5d5700 1 -- 172.21.15.111:0/1171214662 >> 172.21.15.111:0/1171214662 conn(0x7f5b8409a0a0 msgr2=0x7f5b84093530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:49.683 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.680+0000 7f5b8c5d5700 1 -- 172.21.15.111:0/1171214662 shutdown_connections 2023-10-05T21:14:49.683 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.680+0000 7f5b8c5d5700 1 -- 172.21.15.111:0/1171214662 wait complete. 2023-10-05T21:14:49.684 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.681+0000 7ff91fcdb700 1 -- 172.21.15.111:0/1757998741 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff8fc035920 msgr2=0x7ff8fc037dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:49.684 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.681+0000 7ff91fcdb700 1 --2- 172.21.15.111:0/1757998741 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff8fc035920 0x7ff8fc037dd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff918068d60 tx=0x7ff90c016000 comp rx=0 tx=0).stop 2023-10-05T21:14:49.684 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.681+0000 7ff91fcdb700 1 -- 172.21.15.111:0/1757998741 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff918067eb0 msgr2=0x7ff9180904d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:49.685 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.681+0000 7ff91fcdb700 1 --2- 172.21.15.111:0/1757998741 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff918067eb0 0x7ff9180904d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff91400c6c0 tx=0x7ff914007f70 comp rx=0 tx=0).stop 2023-10-05T21:14:49.685 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.681+0000 7ff91fcdb700 1 -- 172.21.15.111:0/1757998741 shutdown_connections 2023-10-05T21:14:49.685 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.681+0000 7ff91fcdb700 1 --2- 172.21.15.111:0/1757998741 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff8fc035920 0x7ff8fc037dd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:49.685 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.681+0000 7ff91fcdb700 1 --2- 172.21.15.111:0/1757998741 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff918067eb0 0x7ff9180904d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:49.685 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.681+0000 7ff91fcdb700 1 -- 172.21.15.111:0/1757998741 >> 172.21.15.111:0/1757998741 conn(0x7ff9180991c0 msgr2=0x7ff91806d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:49.685 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.681+0000 7ff91fcdb700 1 -- 172.21.15.111:0/1757998741 shutdown_connections 2023-10-05T21:14:49.685 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:49.681+0000 7ff91fcdb700 1 -- 172.21.15.111:0/1757998741 wait complete. 2023-10-05T21:14:49.686 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705667 for osd.2 2023-10-05T21:14:49.686 DEBUG:teuthology.parallel:result is None 2023-10-05T21:14:49.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705667 for osd.1 2023-10-05T21:14:49.696 DEBUG:teuthology.parallel:result is None 2023-10-05T21:14:49.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705667 for osd.0 2023-10-05T21:14:49.697 DEBUG:teuthology.parallel:result is None 2023-10-05T21:14:50.645 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-05T21:14:50.769 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.767+0000 7f80d0e5c700 1 Processor -- start 2023-10-05T21:14:50.769 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.767+0000 7f80d0e5c700 1 -- start start 2023-10-05T21:14:50.772 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.768+0000 7f80d0e5c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f80cc06ee20 0x7f80cc06f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:50.772 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.768+0000 7f80d0e5c700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80cc09af90 con 0x7f80cc068fc0 2023-10-05T21:14:50.772 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.768+0000 7f80d0e5c700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80cc06a7b0 con 0x7f80cc06ee20 2023-10-05T21:14:50.772 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.768+0000 7f80ca59c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f80cc06ee20 0x7f80cc06f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:50.772 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.768+0000 7f80c9d9b700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f80cc068fc0 0x7f80cc0693f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:47672/0 (socket says 172.21.15.111:47672) 2023-10-05T21:14:50.772 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.768+0000 7f80ca59c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f80cc06ee20 0x7f80cc06f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49714/0 (socket says 172.21.15.111:49714) 2023-10-05T21:14:50.772 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.768+0000 7f80c9d9b700 1 -- 172.21.15.111:0/1753322230 learned_addr learned my addr 172.21.15.111:0/1753322230 (peer_addr_for_me v1:172.21.15.111:0/0) 2023-10-05T21:14:50.772 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.768+0000 7f80ca59c700 1 -- 172.21.15.111:0/1753322230 >> v1:172.21.15.111:6789/0 conn(0x7f80cc068fc0 legacy=0x7f80cc0693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:50.773 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.768+0000 7f80ca59c700 1 -- 172.21.15.111:0/1753322230 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80cc06cc00 con 0x7f80cc06ee20 2023-10-05T21:14:50.773 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.768+0000 7f80c959a700 1 -- 172.21.15.111:0/1753322230 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2587236337 0 0) 0x7f80cc09af90 con 0x7f80cc068fc0 2023-10-05T21:14:50.773 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.768+0000 7f80ca59c700 1 --2- 172.21.15.111:0/1753322230 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80cc06ee20 0x7f80cc06f1f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009860 tx=0x7f80c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2588d01f5c0cafc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:50.773 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.768+0000 7f80c959a700 1 -- 172.21.15.111:0/1753322230 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f80c000b680 con 0x7f80cc06ee20 2023-10-05T21:14:50.773 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.769+0000 7f80c959a700 1 -- 172.21.15.111:0/1753322230 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c000b7e0 con 0x7f80cc06ee20 2023-10-05T21:14:50.773 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.769+0000 7f80c959a700 1 -- 172.21.15.111:0/1753322230 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f80c000bad0 con 0x7f80cc06ee20 2023-10-05T21:14:50.773 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.769+0000 7f80d0e5c700 1 -- 172.21.15.111:0/1753322230 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80cc06ee20 msgr2=0x7f80cc06f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:50.773 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.769+0000 7f80d0e5c700 1 --2- 172.21.15.111:0/1753322230 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80cc06ee20 0x7f80cc06f1f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009860 tx=0x7f80c00091a0 comp rx=0 tx=0).stop 2023-10-05T21:14:50.773 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.769+0000 7f80d0e5c700 1 -- 172.21.15.111:0/1753322230 shutdown_connections 2023-10-05T21:14:50.773 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.769+0000 7f80d0e5c700 1 --2- 172.21.15.111:0/1753322230 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80cc06ee20 0x7f80cc06f1f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:50.774 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.769+0000 7f80d0e5c700 1 -- 172.21.15.111:0/1753322230 >> 172.21.15.111:0/1753322230 conn(0x7f80cc09a0a0 msgr2=0x7f80cc09a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:50.774 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.769+0000 7f80d0e5c700 1 -- 172.21.15.111:0/1753322230 shutdown_connections 2023-10-05T21:14:50.774 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.769+0000 7f80d0e5c700 1 -- 172.21.15.111:0/1753322230 wait complete. 2023-10-05T21:14:50.774 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.770+0000 7f80d0e5c700 1 Processor -- start 2023-10-05T21:14:50.774 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.770+0000 7f80d0e5c700 1 -- start start 2023-10-05T21:14:50.776 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.770+0000 7f80d0e5c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80cc068fc0 0x7f80cc12bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:50.776 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.770+0000 7f80d0e5c700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc08fa90 con 0x7f80cc068fc0 2023-10-05T21:14:50.776 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.770+0000 7f80ca59c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80cc068fc0 0x7f80cc12bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:50.776 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.770+0000 7f80ca59c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80cc068fc0 0x7f80cc12bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49724/0 (socket says 172.21.15.111:49724) 2023-10-05T21:14:50.776 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.770+0000 7f80ca59c700 1 -- 172.21.15.111:0/2671573147 learned_addr learned my addr 172.21.15.111:0/2671573147 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-10-05T21:14:50.777 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.771+0000 7f80ca59c700 1 -- 172.21.15.111:0/2671573147 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c0009420 con 0x7f80cc068fc0 2023-10-05T21:14:50.777 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.771+0000 7f80ca59c700 1 --2- 172.21.15.111:0/2671573147 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80cc068fc0 0x7f80cc12bb30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f80c00091e0 tx=0x7f80c0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:50.777 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.771+0000 7f80ba7fc700 1 -- 172.21.15.111:0/2671573147 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f80c0011d30 con 0x7f80cc068fc0 2023-10-05T21:14:50.777 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.771+0000 7f80ba7fc700 1 -- 172.21.15.111:0/2671573147 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c0020070 con 0x7f80cc068fc0 2023-10-05T21:14:50.777 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.771+0000 7f80d0e5c700 1 -- 172.21.15.111:0/2671573147 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80cc120170 con 0x7f80cc068fc0 2023-10-05T21:14:50.777 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.771+0000 7f80ba7fc700 1 -- 172.21.15.111:0/2671573147 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f80c001b5d0 con 0x7f80cc068fc0 2023-10-05T21:14:50.777 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.771+0000 7f80d0e5c700 1 -- 172.21.15.111:0/2671573147 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80cc11fa00 con 0x7f80cc068fc0 2023-10-05T21:14:50.777 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.772+0000 7f80ba7fc700 1 -- 172.21.15.111:0/2671573147 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f80c0022030 con 0x7f80cc068fc0 2023-10-05T21:14:50.777 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.772+0000 7f80ba7fc700 1 --2- 172.21.15.111:0/2671573147 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f80ac0358d0 0x7f80ac037d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:50.777 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.772+0000 7f80abfff700 1 -- 172.21.15.111:0/2671573147 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a40050b0 con 0x7f80cc068fc0 2023-10-05T21:14:50.777 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.772+0000 7f80ba7fc700 1 -- 172.21.15.111:0/2671573147 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f80c00497a0 con 0x7f80cc068fc0 2023-10-05T21:14:50.778 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.772+0000 7f80c9d9b700 1 --2- 172.21.15.111:0/2671573147 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f80ac0358d0 0x7f80ac037d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:50.778 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.773+0000 7f80c9d9b700 1 --2- 172.21.15.111:0/2671573147 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f80ac0358d0 0x7f80ac037d80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f80bc007fd0 tx=0x7f80bc007bb0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:50.778 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.777+0000 7f80ba7fc700 1 -- 172.21.15.111:0/2671573147 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f80c00249c0 con 0x7f80cc068fc0 2023-10-05T21:14:50.960 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.959+0000 7f80abfff700 1 -- 172.21.15.111:0/2671573147 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f80a4005360 con 0x7f80cc068fc0 2023-10-05T21:14:50.961 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.959+0000 7f80ba7fc700 1 -- 172.21.15.111:0/2671573147 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f80c0006cb0 con 0x7f80cc068fc0 2023-10-05T21:14:50.961 INFO:teuthology.orchestra.run.smithi111.stdout:38654705667 2023-10-05T21:14:50.963 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.961+0000 7f80abfff700 1 -- 172.21.15.111:0/2671573147 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f80ac0358d0 msgr2=0x7f80ac037d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:50.963 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.961+0000 7f80abfff700 1 --2- 172.21.15.111:0/2671573147 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f80ac0358d0 0x7f80ac037d80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f80bc007fd0 tx=0x7f80bc007bb0 comp rx=0 tx=0).stop 2023-10-05T21:14:50.963 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.961+0000 7f80abfff700 1 -- 172.21.15.111:0/2671573147 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80cc068fc0 msgr2=0x7f80cc12bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:50.963 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.961+0000 7f80abfff700 1 --2- 172.21.15.111:0/2671573147 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80cc068fc0 0x7f80cc12bb30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f80c00091e0 tx=0x7f80c0016000 comp rx=0 tx=0).stop 2023-10-05T21:14:50.963 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.961+0000 7f80abfff700 1 -- 172.21.15.111:0/2671573147 shutdown_connections 2023-10-05T21:14:50.963 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.961+0000 7f80abfff700 1 --2- 172.21.15.111:0/2671573147 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f80ac0358d0 0x7f80ac037d80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:50.963 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.961+0000 7f80abfff700 1 --2- 172.21.15.111:0/2671573147 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80cc068fc0 0x7f80cc12bb30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:50.964 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.961+0000 7f80abfff700 1 -- 172.21.15.111:0/2671573147 >> 172.21.15.111:0/2671573147 conn(0x7f80cc09a0a0 msgr2=0x7f80cc093530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:50.964 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.961+0000 7f80abfff700 1 -- 172.21.15.111:0/2671573147 shutdown_connections 2023-10-05T21:14:50.964 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:50.961+0000 7f80abfff700 1 -- 172.21.15.111:0/2671573147 wait complete. 2023-10-05T21:14:50.974 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705667 for osd.3 2023-10-05T21:14:50.975 DEBUG:teuthology.parallel:result is None 2023-10-05T21:14:50.975 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-05T21:14:50.975 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-05T21:14:51.091 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.090+0000 7fabed5c3700 1 Processor -- start 2023-10-05T21:14:51.092 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.090+0000 7fabed5c3700 1 -- start start 2023-10-05T21:14:51.094 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.090+0000 7fabed5c3700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fabe8068990 0x7fabe812e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:51.094 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.090+0000 7fabed5c3700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe80906b0 con 0x7fabe8067eb0 2023-10-05T21:14:51.094 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.090+0000 7fabed5c3700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe8090d70 con 0x7fabe8068990 2023-10-05T21:14:51.094 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.090+0000 7fabe67fc700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fabe8068990 0x7fabe812e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:51.095 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.090+0000 7fabe6ffd700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fabe8067eb0 0x7fabe8068280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:47686/0 (socket says 172.21.15.111:47686) 2023-10-05T21:14:51.095 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.090+0000 7fabe6ffd700 1 -- 172.21.15.111:0/1323574835 learned_addr learned my addr 172.21.15.111:0/1323574835 (peer_addr_for_me v1:172.21.15.111:0/0) 2023-10-05T21:14:51.095 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.091+0000 7fabe67fc700 1 -- 172.21.15.111:0/1323574835 >> v1:172.21.15.111:6789/0 conn(0x7fabe8067eb0 legacy=0x7fabe8068280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:51.095 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.091+0000 7fabe67fc700 1 -- 172.21.15.111:0/1323574835 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe80919d0 con 0x7fabe8068990 2023-10-05T21:14:51.095 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.091+0000 7fabe67fc700 1 --2- 172.21.15.111:0/1323574835 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fabe8068990 0x7fabe812e6d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fabdc009860 tx=0x7fabdc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1f4ab45049c860 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:51.095 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.091+0000 7fabe5ffb700 1 -- 172.21.15.111:0/1323574835 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fabdc00b680 con 0x7fabe8068990 2023-10-05T21:14:51.095 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.091+0000 7fabe5ffb700 1 -- 172.21.15.111:0/1323574835 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabdc00b7e0 con 0x7fabe8068990 2023-10-05T21:14:51.095 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.091+0000 7fabe5ffb700 1 -- 172.21.15.111:0/1323574835 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fabdc00b990 con 0x7fabe8068990 2023-10-05T21:14:51.095 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.091+0000 7fabed5c3700 1 -- 172.21.15.111:0/1323574835 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fabe8068990 msgr2=0x7fabe812e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:51.096 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.091+0000 7fabed5c3700 1 --2- 172.21.15.111:0/1323574835 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fabe8068990 0x7fabe812e6d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fabdc009860 tx=0x7fabdc0091a0 comp rx=0 tx=0).stop 2023-10-05T21:14:51.096 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.091+0000 7fabed5c3700 1 -- 172.21.15.111:0/1323574835 shutdown_connections 2023-10-05T21:14:51.096 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.091+0000 7fabed5c3700 1 --2- 172.21.15.111:0/1323574835 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fabe8068990 0x7fabe812e6d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:51.096 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.091+0000 7fabed5c3700 1 -- 172.21.15.111:0/1323574835 >> 172.21.15.111:0/1323574835 conn(0x7fabe80991e0 msgr2=0x7fabe80995e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:51.096 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.091+0000 7fabed5c3700 1 -- 172.21.15.111:0/1323574835 shutdown_connections 2023-10-05T21:14:51.096 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.092+0000 7fabed5c3700 1 -- 172.21.15.111:0/1323574835 wait complete. 2023-10-05T21:14:51.096 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.092+0000 7fabed5c3700 1 Processor -- start 2023-10-05T21:14:51.096 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.092+0000 7fabed5c3700 1 -- start start 2023-10-05T21:14:51.098 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.093+0000 7fabed5c3700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fabe8067eb0 0x7fabe8128e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:51.098 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.093+0000 7fabed5c3700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe808f100 con 0x7fabe8067eb0 2023-10-05T21:14:51.098 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.093+0000 7fabe6ffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fabe8067eb0 0x7fabe8128e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:51.099 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.093+0000 7fabe6ffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fabe8067eb0 0x7fabe8128e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49738/0 (socket says 172.21.15.111:49738) 2023-10-05T21:14:51.099 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.093+0000 7fabe6ffd700 1 -- 172.21.15.111:0/2299822774 learned_addr learned my addr 172.21.15.111:0/2299822774 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-10-05T21:14:51.099 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.093+0000 7fabe6ffd700 1 -- 172.21.15.111:0/2299822774 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabdc009420 con 0x7fabe8067eb0 2023-10-05T21:14:51.099 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.093+0000 7fabe6ffd700 1 --2- 172.21.15.111:0/2299822774 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fabe8067eb0 0x7fabe8128e30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fabd800c6c0 tx=0x7fabd8007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:51.099 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.093+0000 7fabceffd700 1 -- 172.21.15.111:0/2299822774 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fabd8007440 con 0x7fabe8067eb0 2023-10-05T21:14:51.099 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.093+0000 7fabceffd700 1 -- 172.21.15.111:0/2299822774 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd80075a0 con 0x7fabe8067eb0 2023-10-05T21:14:51.099 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.093+0000 7fabed5c3700 1 -- 172.21.15.111:0/2299822774 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe8120560 con 0x7fabe8067eb0 2023-10-05T21:14:51.099 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.093+0000 7fabceffd700 1 -- 172.21.15.111:0/2299822774 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fabd8005970 con 0x7fabe8067eb0 2023-10-05T21:14:51.099 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.093+0000 7fabed5c3700 1 -- 172.21.15.111:0/2299822774 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe8120120 con 0x7fabe8067eb0 2023-10-05T21:14:51.099 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.094+0000 7fabceffd700 1 -- 172.21.15.111:0/2299822774 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fabd8005ba0 con 0x7fabe8067eb0 2023-10-05T21:14:51.099 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.094+0000 7fabceffd700 1 --2- 172.21.15.111:0/2299822774 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fabd40358d0 0x7fabd4037d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:51.100 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.094+0000 7fabed5c3700 1 -- 172.21.15.111:0/2299822774 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe811fc90 con 0x7fabe8067eb0 2023-10-05T21:14:51.100 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.094+0000 7fabceffd700 1 -- 172.21.15.111:0/2299822774 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3478+0+0 (secure 0 0 0) 0x7fabd80476f0 con 0x7fabe8067eb0 2023-10-05T21:14:51.100 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.095+0000 7fabe67fc700 1 --2- 172.21.15.111:0/2299822774 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fabd40358d0 0x7fabd4037d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:51.100 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.095+0000 7fabe67fc700 1 --2- 172.21.15.111:0/2299822774 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fabd40358d0 0x7fabd4037d80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fabdc0091e0 tx=0x7fabdc016000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:51.100 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.099+0000 7fabceffd700 1 -- 172.21.15.111:0/2299822774 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fabd8075570 con 0x7fabe8067eb0 2023-10-05T21:14:51.277 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.276+0000 7fabed5c3700 1 -- 172.21.15.111:0/2299822774 --> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fabe80647e0 con 0x7fabd40358d0 2023-10-05T21:14:51.279 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.278+0000 7fabceffd700 1 -- 172.21.15.111:0/2299822774 <== mgr.4098 v2:172.21.15.153:6824/140077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+33286 (secure 0 0 0) 0x7fabe80647e0 con 0x7fabd40358d0 2023-10-05T21:14:51.280 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:51.281 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.279+0000 7fabed5c3700 1 -- 172.21.15.111:0/2299822774 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fabd40358d0 msgr2=0x7fabd4037d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:51.282 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.279+0000 7fabed5c3700 1 --2- 172.21.15.111:0/2299822774 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fabd40358d0 0x7fabd4037d80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fabdc0091e0 tx=0x7fabdc016000 comp rx=0 tx=0).stop 2023-10-05T21:14:51.282 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.279+0000 7fabed5c3700 1 -- 172.21.15.111:0/2299822774 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fabe8067eb0 msgr2=0x7fabe8128e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:51.282 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.279+0000 7fabed5c3700 1 --2- 172.21.15.111:0/2299822774 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fabe8067eb0 0x7fabe8128e30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fabd800c6c0 tx=0x7fabd8007de0 comp rx=0 tx=0).stop 2023-10-05T21:14:51.282 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.279+0000 7fabed5c3700 1 -- 172.21.15.111:0/2299822774 shutdown_connections 2023-10-05T21:14:51.282 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.279+0000 7fabed5c3700 1 --2- 172.21.15.111:0/2299822774 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fabd40358d0 0x7fabd4037d80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:51.282 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.279+0000 7fabed5c3700 1 --2- 172.21.15.111:0/2299822774 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fabe8067eb0 0x7fabe8128e30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:51.282 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.279+0000 7fabed5c3700 1 -- 172.21.15.111:0/2299822774 >> 172.21.15.111:0/2299822774 conn(0x7fabe80991e0 msgr2=0x7fabe8087920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:51.282 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.279+0000 7fabed5c3700 1 -- 172.21.15.111:0/2299822774 shutdown_connections 2023-10-05T21:14:51.283 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.279+0000 7fabed5c3700 1 -- 172.21.15.111:0/2299822774 wait complete. 2023-10-05T21:14:51.283 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2023-10-05T21:14:51.293 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2023-10-05T21:14:49.465862+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":374797520,"kb_used":3185452,"kb_used_data":371612068,"kb_used_omap":349,"kb_used_meta":0,"kb_avail":371612068,"statfs":{"total":383792660480,"available":380530757632,"internally_reserved":0,"allocated":380530757632,"data_stored":380530757632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":357622,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.811830"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T21:14:47.220995+0000","last_change":"2023-10-05T21:14:47.220860+0000","last_active":"2023-10-05T21:14:47.220995+0000","last_peered":"2023-10-05T21:14:47.220995+0000","last_clean":"2023-10-05T21:14:47.220995+0000","last_became_active":"2023-10-05T21:14:47.220579+0000","last_became_peered":"2023-10-05T21:14:47.220579+0000","last_unstale":"2023-10-05T21:14:47.220995+0000","last_undegraded":"2023-10-05T21:14:47.220995+0000","last_fullsized":"2023-10-05T21:14:47.220995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_clean_scrub_stamp":"2023-10-05T21:14:45.640354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:47.145584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T21:14:46.651788+0000","last_change":"2023-10-05T21:14:46.651539+0000","last_active":"2023-10-05T21:14:46.651788+0000","last_peered":"2023-10-05T21:14:46.651788+0000","last_clean":"2023-10-05T21:14:46.651788+0000","last_became_active":"2023-10-05T21:14:46.651301+0000","last_became_peered":"2023-10-05T21:14:46.651301+0000","last_unstale":"2023-10-05T21:14:46.651788+0000","last_undegraded":"2023-10-05T21:14:46.651788+0000","last_fullsized":"2023-10-05T21:14:46.651788+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_clean_scrub_stamp":"2023-10-05T21:14:45.640354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:00:05.955473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T21:14:46.654253+0000","last_change":"2023-10-05T21:14:46.651714+0000","last_active":"2023-10-05T21:14:46.654253+0000","last_peered":"2023-10-05T21:14:46.654253+0000","last_clean":"2023-10-05T21:14:46.654253+0000","last_became_active":"2023-10-05T21:14:46.651445+0000","last_became_peered":"2023-10-05T21:14:46.651445+0000","last_unstale":"2023-10-05T21:14:46.654253+0000","last_undegraded":"2023-10-05T21:14:46.654253+0000","last_fullsized":"2023-10-05T21:14:46.654253+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_clean_scrub_stamp":"2023-10-05T21:14:45.640354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:08:54.887311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T21:14:46.654238+0000","last_change":"2023-10-05T21:14:46.651281+0000","last_active":"2023-10-05T21:14:46.654238+0000","last_peered":"2023-10-05T21:14:46.654238+0000","last_clean":"2023-10-05T21:14:46.654238+0000","last_became_active":"2023-10-05T21:14:46.651008+0000","last_became_peered":"2023-10-05T21:14:46.651008+0000","last_unstale":"2023-10-05T21:14:46.654238+0000","last_undegraded":"2023-10-05T21:14:46.654238+0000","last_fullsized":"2023-10-05T21:14:46.654238+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_clean_scrub_stamp":"2023-10-05T21:14:45.640354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:30:40.793960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":162,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T21:14:47.219876+0000","last_change":"2023-10-05T21:14:44.400869+0000","last_active":"2023-10-05T21:14:47.219876+0000","last_peered":"2023-10-05T21:14:47.219876+0000","last_clean":"2023-10-05T21:14:47.219876+0000","last_became_active":"2023-10-05T21:14:44.400063+0000","last_became_peered":"2023-10-05T21:14:44.400063+0000","last_unstale":"2023-10-05T21:14:47.219876+0000","last_undegraded":"2023-10-05T21:14:47.219876+0000","last_fullsized":"2023-10-05T21:14:47.219876+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T21:14:42.462442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T21:14:42.462442+0000","last_clean_scrub_stamp":"2023-10-05T21:14:42.462442+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:38.976264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T21:14:46.654282+0000","last_change":"2023-10-05T21:14:46.651846+0000","last_active":"2023-10-05T21:14:46.654282+0000","last_peered":"2023-10-05T21:14:46.654282+0000","last_clean":"2023-10-05T21:14:46.654282+0000","last_became_active":"2023-10-05T21:14:46.651561+0000","last_became_peered":"2023-10-05T21:14:46.651561+0000","last_unstale":"2023-10-05T21:14:46.654282+0000","last_undegraded":"2023-10-05T21:14:46.654282+0000","last_fullsized":"2023-10-05T21:14:46.654282+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_clean_scrub_stamp":"2023-10-05T21:14:45.640354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:05:11.645274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T21:14:46.651177+0000","last_change":"2023-10-05T21:14:46.650854+0000","last_active":"2023-10-05T21:14:46.651177+0000","last_peered":"2023-10-05T21:14:46.651177+0000","last_clean":"2023-10-05T21:14:46.651177+0000","last_became_active":"2023-10-05T21:14:46.650521+0000","last_became_peered":"2023-10-05T21:14:46.650521+0000","last_unstale":"2023-10-05T21:14:46.651177+0000","last_undegraded":"2023-10-05T21:14:46.651177+0000","last_fullsized":"2023-10-05T21:14:46.651177+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_clean_scrub_stamp":"2023-10-05T21:14:45.640354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:06:16.492205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T21:14:46.651248+0000","last_change":"2023-10-05T21:14:46.651130+0000","last_active":"2023-10-05T21:14:46.651248+0000","last_peered":"2023-10-05T21:14:46.651248+0000","last_clean":"2023-10-05T21:14:46.651248+0000","last_became_active":"2023-10-05T21:14:46.650875+0000","last_became_peered":"2023-10-05T21:14:46.650875+0000","last_unstale":"2023-10-05T21:14:46.651248+0000","last_undegraded":"2023-10-05T21:14:46.651248+0000","last_fullsized":"2023-10-05T21:14:46.651248+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_clean_scrub_stamp":"2023-10-05T21:14:45.640354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:34:45.288205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T21:14:46.652455+0000","last_change":"2023-10-05T21:14:46.652317+0000","last_active":"2023-10-05T21:14:46.652455+0000","last_peered":"2023-10-05T21:14:46.652455+0000","last_clean":"2023-10-05T21:14:46.652455+0000","last_became_active":"2023-10-05T21:14:46.651832+0000","last_became_peered":"2023-10-05T21:14:46.651832+0000","last_unstale":"2023-10-05T21:14:46.652455+0000","last_undegraded":"2023-10-05T21:14:46.652455+0000","last_fullsized":"2023-10-05T21:14:46.652455+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_clean_scrub_stamp":"2023-10-05T21:14:45.640354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:06:16.492205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795756,"kb_used_data":92903624,"kb_used_omap":63,"kb_used_meta":0,"kb_avail":92903624,"statfs":{"total":95948165120,"available":95133310976,"internally_reserved":0,"allocated":95133310976,"data_stored":95133310976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":64899,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]},{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795756,"kb_used_data":92903624,"kb_used_omap":63,"kb_used_meta":0,"kb_avail":92903624,"statfs":{"total":95948165120,"available":95133310976,"internally_reserved":0,"allocated":95133310976,"data_stored":95133310976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":65031,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796968,"kb_used_data":92902412,"kb_used_omap":105,"kb_used_meta":0,"kb_avail":92902412,"statfs":{"total":95948165120,"available":95132069888,"internally_reserved":0,"allocated":95132069888,"data_stored":95132069888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":107703,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796972,"kb_used_data":92902408,"kb_used_omap":117,"kb_used_meta":0,"kb_avail":92902408,"statfs":{"total":95948165120,"available":95132065792,"internally_reserved":0,"allocated":95132065792,"data_stored":95132065792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":119989,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]}]}],"pool_statfs":[]}} 2023-10-05T21:14:51.295 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-05T21:14:51.418 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.409+0000 7f52241fd700 1 Processor -- start 2023-10-05T21:14:51.418 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.410+0000 7f52241fd700 1 -- start start 2023-10-05T21:14:51.419 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.410+0000 7f52241fd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f521c06ee20 0x7f521c06f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:51.419 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.410+0000 7f52241fd700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f521c09af90 con 0x7f521c068fc0 2023-10-05T21:14:51.419 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.410+0000 7f52241fd700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f521c06a7b0 con 0x7f521c06ee20 2023-10-05T21:14:51.419 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.410+0000 7f5221f99700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f521c06ee20 0x7f521c06f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:51.419 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.410+0000 7f5221798700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f521c068fc0 0x7f521c0693f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:47698/0 (socket says 172.21.15.111:47698) 2023-10-05T21:14:51.419 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.410+0000 7f5221798700 1 -- 172.21.15.111:0/1952589107 learned_addr learned my addr 172.21.15.111:0/1952589107 (peer_addr_for_me v1:172.21.15.111:0/0) 2023-10-05T21:14:51.420 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.410+0000 7f5221f99700 1 -- 172.21.15.111:0/1952589107 >> v1:172.21.15.111:6789/0 conn(0x7f521c068fc0 legacy=0x7f521c0693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:51.420 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.410+0000 7f5221f99700 1 -- 172.21.15.111:0/1952589107 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521c06cc00 con 0x7f521c06ee20 2023-10-05T21:14:51.420 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.411+0000 7f5221f99700 1 --2- 172.21.15.111:0/1952589107 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f521c06ee20 0x7f521c06f1f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5210009860 tx=0x7f52100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=187f7e3bd2738c20 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:51.420 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.411+0000 7f5220f97700 1 -- 172.21.15.111:0/1952589107 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f521000b680 con 0x7f521c06ee20 2023-10-05T21:14:51.420 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.411+0000 7f5220f97700 1 -- 172.21.15.111:0/1952589107 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521000b7e0 con 0x7f521c06ee20 2023-10-05T21:14:51.420 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.411+0000 7f5220f97700 1 -- 172.21.15.111:0/1952589107 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f521000bad0 con 0x7f521c06ee20 2023-10-05T21:14:51.421 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.411+0000 7f52241fd700 1 -- 172.21.15.111:0/1952589107 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f521c06ee20 msgr2=0x7f521c06f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:51.421 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.411+0000 7f52241fd700 1 --2- 172.21.15.111:0/1952589107 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f521c06ee20 0x7f521c06f1f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5210009860 tx=0x7f52100091a0 comp rx=0 tx=0).stop 2023-10-05T21:14:51.421 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.411+0000 7f52241fd700 1 -- 172.21.15.111:0/1952589107 shutdown_connections 2023-10-05T21:14:51.421 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.411+0000 7f52241fd700 1 --2- 172.21.15.111:0/1952589107 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f521c06ee20 0x7f521c06f1f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:51.421 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.411+0000 7f52241fd700 1 -- 172.21.15.111:0/1952589107 >> 172.21.15.111:0/1952589107 conn(0x7f521c09a0a0 msgr2=0x7f521c09a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:51.422 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.411+0000 7f52241fd700 1 -- 172.21.15.111:0/1952589107 shutdown_connections 2023-10-05T21:14:51.422 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.411+0000 7f52241fd700 1 -- 172.21.15.111:0/1952589107 wait complete. 2023-10-05T21:14:51.422 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.412+0000 7f52241fd700 1 Processor -- start 2023-10-05T21:14:51.422 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.412+0000 7f52241fd700 1 -- start start 2023-10-05T21:14:51.422 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.412+0000 7f52241fd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f521c068fc0 0x7f521c138520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:51.422 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.412+0000 7f52241fd700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521c1209c0 con 0x7f521c068fc0 2023-10-05T21:14:51.423 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.413+0000 7f5221f99700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f521c068fc0 0x7f521c138520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:51.423 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.413+0000 7f5221f99700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f521c068fc0 0x7f521c138520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49756/0 (socket says 172.21.15.111:49756) 2023-10-05T21:14:51.423 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.413+0000 7f5221f99700 1 -- 172.21.15.111:0/42971062 learned_addr learned my addr 172.21.15.111:0/42971062 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-10-05T21:14:51.423 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.413+0000 7f5221f99700 1 -- 172.21.15.111:0/42971062 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5210009420 con 0x7f521c068fc0 2023-10-05T21:14:51.423 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.413+0000 7f5221f99700 1 --2- 172.21.15.111:0/42971062 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f521c068fc0 0x7f521c138520 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f52100093f0 tx=0x7f5210016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:51.424 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.413+0000 7f520dffb700 1 -- 172.21.15.111:0/42971062 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5210011dd0 con 0x7f521c068fc0 2023-10-05T21:14:51.424 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.413+0000 7f520dffb700 1 -- 172.21.15.111:0/42971062 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5210020070 con 0x7f521c068fc0 2023-10-05T21:14:51.424 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.413+0000 7f52241fd700 1 -- 172.21.15.111:0/42971062 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f521c11fbe0 con 0x7f521c068fc0 2023-10-05T21:14:51.424 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.413+0000 7f520dffb700 1 -- 172.21.15.111:0/42971062 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f521001c5d0 con 0x7f521c068fc0 2023-10-05T21:14:51.424 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.413+0000 7f52241fd700 1 -- 172.21.15.111:0/42971062 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f521c1206b0 con 0x7f521c068fc0 2023-10-05T21:14:51.425 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.414+0000 7f520dffb700 1 -- 172.21.15.111:0/42971062 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f5210022030 con 0x7f521c068fc0 2023-10-05T21:14:51.425 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.414+0000 7f52241fd700 1 -- 172.21.15.111:0/42971062 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f521c0647e0 con 0x7f521c068fc0 2023-10-05T21:14:51.425 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.414+0000 7f520dffb700 1 --2- 172.21.15.111:0/42971062 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f52000358d0 0x7f5200037d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:51.425 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.414+0000 7f520dffb700 1 -- 172.21.15.111:0/42971062 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f5210049700 con 0x7f521c068fc0 2023-10-05T21:14:51.425 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.415+0000 7f5221798700 1 --2- 172.21.15.111:0/42971062 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f52000358d0 0x7f5200037d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:51.425 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.415+0000 7f5221798700 1 --2- 172.21.15.111:0/42971062 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f52000358d0 0x7f5200037d80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5218007fd0 tx=0x7f5218007b90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:51.426 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.419+0000 7f520dffb700 1 -- 172.21.15.111:0/42971062 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f521001c800 con 0x7f521c068fc0 2023-10-05T21:14:51.596 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.595+0000 7f52241fd700 1 -- 172.21.15.111:0/42971062 --> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f521c04bb40 con 0x7f52000358d0 2023-10-05T21:14:51.598 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.596+0000 7f520dffb700 1 -- 172.21.15.111:0/42971062 <== mgr.4098 v2:172.21.15.153:6824/140077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+33286 (secure 0 0 0) 0x7f521c04bb40 con 0x7f52000358d0 2023-10-05T21:14:51.599 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:51.600 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.598+0000 7f52241fd700 1 -- 172.21.15.111:0/42971062 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f52000358d0 msgr2=0x7f5200037d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:51.601 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.598+0000 7f52241fd700 1 --2- 172.21.15.111:0/42971062 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f52000358d0 0x7f5200037d80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5218007fd0 tx=0x7f5218007b90 comp rx=0 tx=0).stop 2023-10-05T21:14:51.601 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.598+0000 7f52241fd700 1 -- 172.21.15.111:0/42971062 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f521c068fc0 msgr2=0x7f521c138520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:51.601 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.598+0000 7f52241fd700 1 --2- 172.21.15.111:0/42971062 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f521c068fc0 0x7f521c138520 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f52100093f0 tx=0x7f5210016000 comp rx=0 tx=0).stop 2023-10-05T21:14:51.601 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.598+0000 7f52241fd700 1 -- 172.21.15.111:0/42971062 shutdown_connections 2023-10-05T21:14:51.601 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.598+0000 7f52241fd700 1 --2- 172.21.15.111:0/42971062 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f52000358d0 0x7f5200037d80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:51.601 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.598+0000 7f52241fd700 1 --2- 172.21.15.111:0/42971062 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f521c068fc0 0x7f521c138520 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:51.601 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.598+0000 7f52241fd700 1 -- 172.21.15.111:0/42971062 >> 172.21.15.111:0/42971062 conn(0x7f521c09a0a0 msgr2=0x7f521c098ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:51.601 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.599+0000 7f52241fd700 1 -- 172.21.15.111:0/42971062 shutdown_connections 2023-10-05T21:14:51.602 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.599+0000 7f52241fd700 1 -- 172.21.15.111:0/42971062 wait complete. 2023-10-05T21:14:51.602 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2023-10-05T21:14:51.611 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2023-10-05T21:14:51.466410+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":374797520,"kb_used":3185452,"kb_used_data":371612068,"kb_used_omap":349,"kb_used_meta":0,"kb_avail":371612068,"statfs":{"total":383792660480,"available":380530757632,"internally_reserved":0,"allocated":380530757632,"data_stored":380530757632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":357622,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.812378"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T21:14:47.220995+0000","last_change":"2023-10-05T21:14:47.220860+0000","last_active":"2023-10-05T21:14:47.220995+0000","last_peered":"2023-10-05T21:14:47.220995+0000","last_clean":"2023-10-05T21:14:47.220995+0000","last_became_active":"2023-10-05T21:14:47.220579+0000","last_became_peered":"2023-10-05T21:14:47.220579+0000","last_unstale":"2023-10-05T21:14:47.220995+0000","last_undegraded":"2023-10-05T21:14:47.220995+0000","last_fullsized":"2023-10-05T21:14:47.220995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_clean_scrub_stamp":"2023-10-05T21:14:45.640354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:47.145584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T21:14:46.651788+0000","last_change":"2023-10-05T21:14:46.651539+0000","last_active":"2023-10-05T21:14:46.651788+0000","last_peered":"2023-10-05T21:14:46.651788+0000","last_clean":"2023-10-05T21:14:46.651788+0000","last_became_active":"2023-10-05T21:14:46.651301+0000","last_became_peered":"2023-10-05T21:14:46.651301+0000","last_unstale":"2023-10-05T21:14:46.651788+0000","last_undegraded":"2023-10-05T21:14:46.651788+0000","last_fullsized":"2023-10-05T21:14:46.651788+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_clean_scrub_stamp":"2023-10-05T21:14:45.640354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:00:05.955473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T21:14:46.654253+0000","last_change":"2023-10-05T21:14:46.651714+0000","last_active":"2023-10-05T21:14:46.654253+0000","last_peered":"2023-10-05T21:14:46.654253+0000","last_clean":"2023-10-05T21:14:46.654253+0000","last_became_active":"2023-10-05T21:14:46.651445+0000","last_became_peered":"2023-10-05T21:14:46.651445+0000","last_unstale":"2023-10-05T21:14:46.654253+0000","last_undegraded":"2023-10-05T21:14:46.654253+0000","last_fullsized":"2023-10-05T21:14:46.654253+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_clean_scrub_stamp":"2023-10-05T21:14:45.640354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:08:54.887311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T21:14:46.654238+0000","last_change":"2023-10-05T21:14:46.651281+0000","last_active":"2023-10-05T21:14:46.654238+0000","last_peered":"2023-10-05T21:14:46.654238+0000","last_clean":"2023-10-05T21:14:46.654238+0000","last_became_active":"2023-10-05T21:14:46.651008+0000","last_became_peered":"2023-10-05T21:14:46.651008+0000","last_unstale":"2023-10-05T21:14:46.654238+0000","last_undegraded":"2023-10-05T21:14:46.654238+0000","last_fullsized":"2023-10-05T21:14:46.654238+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_clean_scrub_stamp":"2023-10-05T21:14:45.640354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:30:40.793960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":162,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T21:14:47.219876+0000","last_change":"2023-10-05T21:14:44.400869+0000","last_active":"2023-10-05T21:14:47.219876+0000","last_peered":"2023-10-05T21:14:47.219876+0000","last_clean":"2023-10-05T21:14:47.219876+0000","last_became_active":"2023-10-05T21:14:44.400063+0000","last_became_peered":"2023-10-05T21:14:44.400063+0000","last_unstale":"2023-10-05T21:14:47.219876+0000","last_undegraded":"2023-10-05T21:14:47.219876+0000","last_fullsized":"2023-10-05T21:14:47.219876+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T21:14:42.462442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T21:14:42.462442+0000","last_clean_scrub_stamp":"2023-10-05T21:14:42.462442+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:38.976264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T21:14:46.654282+0000","last_change":"2023-10-05T21:14:46.651846+0000","last_active":"2023-10-05T21:14:46.654282+0000","last_peered":"2023-10-05T21:14:46.654282+0000","last_clean":"2023-10-05T21:14:46.654282+0000","last_became_active":"2023-10-05T21:14:46.651561+0000","last_became_peered":"2023-10-05T21:14:46.651561+0000","last_unstale":"2023-10-05T21:14:46.654282+0000","last_undegraded":"2023-10-05T21:14:46.654282+0000","last_fullsized":"2023-10-05T21:14:46.654282+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_clean_scrub_stamp":"2023-10-05T21:14:45.640354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:05:11.645274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T21:14:46.651177+0000","last_change":"2023-10-05T21:14:46.650854+0000","last_active":"2023-10-05T21:14:46.651177+0000","last_peered":"2023-10-05T21:14:46.651177+0000","last_clean":"2023-10-05T21:14:46.651177+0000","last_became_active":"2023-10-05T21:14:46.650521+0000","last_became_peered":"2023-10-05T21:14:46.650521+0000","last_unstale":"2023-10-05T21:14:46.651177+0000","last_undegraded":"2023-10-05T21:14:46.651177+0000","last_fullsized":"2023-10-05T21:14:46.651177+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_clean_scrub_stamp":"2023-10-05T21:14:45.640354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:06:16.492205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T21:14:46.651248+0000","last_change":"2023-10-05T21:14:46.651130+0000","last_active":"2023-10-05T21:14:46.651248+0000","last_peered":"2023-10-05T21:14:46.651248+0000","last_clean":"2023-10-05T21:14:46.651248+0000","last_became_active":"2023-10-05T21:14:46.650875+0000","last_became_peered":"2023-10-05T21:14:46.650875+0000","last_unstale":"2023-10-05T21:14:46.651248+0000","last_undegraded":"2023-10-05T21:14:46.651248+0000","last_fullsized":"2023-10-05T21:14:46.651248+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_clean_scrub_stamp":"2023-10-05T21:14:45.640354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:34:45.288205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T21:14:46.652455+0000","last_change":"2023-10-05T21:14:46.652317+0000","last_active":"2023-10-05T21:14:46.652455+0000","last_peered":"2023-10-05T21:14:46.652455+0000","last_clean":"2023-10-05T21:14:46.652455+0000","last_became_active":"2023-10-05T21:14:46.651832+0000","last_became_peered":"2023-10-05T21:14:46.651832+0000","last_unstale":"2023-10-05T21:14:46.652455+0000","last_undegraded":"2023-10-05T21:14:46.652455+0000","last_fullsized":"2023-10-05T21:14:46.652455+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T21:14:45.640354+0000","last_clean_scrub_stamp":"2023-10-05T21:14:45.640354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:06:16.492205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795756,"kb_used_data":92903624,"kb_used_omap":63,"kb_used_meta":0,"kb_avail":92903624,"statfs":{"total":95948165120,"available":95133310976,"internally_reserved":0,"allocated":95133310976,"data_stored":95133310976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":64899,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]},{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795756,"kb_used_data":92903624,"kb_used_omap":63,"kb_used_meta":0,"kb_avail":92903624,"statfs":{"total":95948165120,"available":95133310976,"internally_reserved":0,"allocated":95133310976,"data_stored":95133310976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":65031,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796968,"kb_used_data":92902412,"kb_used_omap":105,"kb_used_meta":0,"kb_avail":92902412,"statfs":{"total":95948165120,"available":95132069888,"internally_reserved":0,"allocated":95132069888,"data_stored":95132069888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":107703,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796972,"kb_used_data":92902408,"kb_used_omap":117,"kb_used_meta":0,"kb_avail":92902408,"statfs":{"total":95948165120,"available":95132065792,"internally_reserved":0,"allocated":95132065792,"data_stored":95132065792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":119989,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]}]}],"pool_statfs":[]}} 2023-10-05T21:14:51.613 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-05T21:14:51.613 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-05T21:14:51.613 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-05T21:14:51.613 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-05T21:14:51.736 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.727+0000 7f169a412700 1 Processor -- start 2023-10-05T21:14:51.736 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.727+0000 7f169a412700 1 -- start start 2023-10-05T21:14:51.736 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.728+0000 7f169a412700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f16940903b0 0x7f1694090780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:51.736 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.728+0000 7f169a412700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1694091930 con 0x7f1694090cc0 2023-10-05T21:14:51.737 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.728+0000 7f169a412700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16940955a0 con 0x7f16940903b0 2023-10-05T21:14:51.737 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.728+0000 7f1693fff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f16940903b0 0x7f1694090780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:51.737 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.728+0000 7f16937fe700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f1694090cc0 0x7f169408f090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:47700/0 (socket says 172.21.15.111:47700) 2023-10-05T21:14:51.737 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.728+0000 7f16937fe700 1 -- 172.21.15.111:0/3332921381 learned_addr learned my addr 172.21.15.111:0/3332921381 (peer_addr_for_me v1:172.21.15.111:0/0) 2023-10-05T21:14:51.737 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.728+0000 7f1693fff700 1 -- 172.21.15.111:0/3332921381 >> v1:172.21.15.111:6789/0 conn(0x7f1694090cc0 legacy=0x7f169408f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:51.737 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.728+0000 7f1693fff700 1 -- 172.21.15.111:0/3332921381 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1694091e60 con 0x7f16940903b0 2023-10-05T21:14:51.738 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.728+0000 7f1693fff700 1 --2- 172.21.15.111:0/3332921381 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f16940903b0 0x7f1694090780 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1684009850 tx=0x7f1684009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c81ec4091738a35d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:51.738 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.728+0000 7f1692ffd700 1 -- 172.21.15.111:0/3332921381 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1684005c10 con 0x7f16940903b0 2023-10-05T21:14:51.738 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.728+0000 7f1692ffd700 1 -- 172.21.15.111:0/3332921381 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1684005d70 con 0x7f16940903b0 2023-10-05T21:14:51.738 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.728+0000 7f1692ffd700 1 -- 172.21.15.111:0/3332921381 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1684006190 con 0x7f16940903b0 2023-10-05T21:14:51.739 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.729+0000 7f169a412700 1 -- 172.21.15.111:0/3332921381 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f16940903b0 msgr2=0x7f1694090780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:51.739 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.729+0000 7f169a412700 1 --2- 172.21.15.111:0/3332921381 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f16940903b0 0x7f1694090780 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1684009850 tx=0x7f1684009120 comp rx=0 tx=0).stop 2023-10-05T21:14:51.739 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.729+0000 7f169a412700 1 -- 172.21.15.111:0/3332921381 shutdown_connections 2023-10-05T21:14:51.739 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.729+0000 7f169a412700 1 --2- 172.21.15.111:0/3332921381 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f16940903b0 0x7f1694090780 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:51.739 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.729+0000 7f169a412700 1 -- 172.21.15.111:0/3332921381 >> 172.21.15.111:0/3332921381 conn(0x7f1694095c20 msgr2=0x7f1694096020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:51.739 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.729+0000 7f169a412700 1 -- 172.21.15.111:0/3332921381 shutdown_connections 2023-10-05T21:14:51.739 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.729+0000 7f169a412700 1 -- 172.21.15.111:0/3332921381 wait complete. 2023-10-05T21:14:51.739 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.729+0000 7f169a412700 1 Processor -- start 2023-10-05T21:14:51.739 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.730+0000 7f169a412700 1 -- start start 2023-10-05T21:14:51.739 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.730+0000 7f169a412700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f16940903b0 0x7f1694125dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:51.739 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.730+0000 7f169a412700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16940853e0 con 0x7f16940903b0 2023-10-05T21:14:51.739 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.730+0000 7f1693fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f16940903b0 0x7f1694125dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:51.740 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.730+0000 7f1693fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f16940903b0 0x7f1694125dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49768/0 (socket says 172.21.15.111:49768) 2023-10-05T21:14:51.740 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.730+0000 7f1693fff700 1 -- 172.21.15.111:0/3499456792 learned_addr learned my addr 172.21.15.111:0/3499456792 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-10-05T21:14:51.740 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.730+0000 7f1693fff700 1 -- 172.21.15.111:0/3499456792 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16840093c0 con 0x7f16940903b0 2023-10-05T21:14:51.740 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.731+0000 7f1693fff700 1 --2- 172.21.15.111:0/3499456792 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f16940903b0 0x7f1694125dc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1684009fd0 tx=0x7f1684015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:51.740 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.731+0000 7f168bfff700 1 -- 172.21.15.111:0/3499456792 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1684011990 con 0x7f16940903b0 2023-10-05T21:14:51.740 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.731+0000 7f168bfff700 1 -- 172.21.15.111:0/3499456792 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1684011af0 con 0x7f16940903b0 2023-10-05T21:14:51.740 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.731+0000 7f169a412700 1 -- 172.21.15.111:0/3499456792 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f169406c080 con 0x7f16940903b0 2023-10-05T21:14:51.740 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.731+0000 7f168bfff700 1 -- 172.21.15.111:0/3499456792 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1684011dc0 con 0x7f16940903b0 2023-10-05T21:14:51.740 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.731+0000 7f169a412700 1 -- 172.21.15.111:0/3499456792 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16940865f0 con 0x7f16940903b0 2023-10-05T21:14:51.740 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.732+0000 7f168bfff700 1 -- 172.21.15.111:0/3499456792 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f1684023030 con 0x7f16940903b0 2023-10-05T21:14:51.740 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.732+0000 7f169a412700 1 -- 172.21.15.111:0/3499456792 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16940647e0 con 0x7f16940903b0 2023-10-05T21:14:51.740 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.732+0000 7f168bfff700 1 --2- 172.21.15.111:0/3499456792 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f16740358d0 0x7f1674037d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:51.741 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.732+0000 7f168bfff700 1 -- 172.21.15.111:0/3499456792 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f1684049930 con 0x7f16940903b0 2023-10-05T21:14:51.741 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.732+0000 7f16937fe700 1 --2- 172.21.15.111:0/3499456792 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f16740358d0 0x7f1674037d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:51.741 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.733+0000 7f16937fe700 1 --2- 172.21.15.111:0/3499456792 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f16740358d0 0x7f1674037d80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f167c0016a0 tx=0x7f167c007b30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:51.741 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.736+0000 7f168bfff700 1 -- 172.21.15.111:0/3499456792 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f168401d430 con 0x7f16940903b0 2023-10-05T21:14:51.957 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.956+0000 7f169a412700 1 -- 172.21.15.111:0/3499456792 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f16940925d0 con 0x7f16940903b0 2023-10-05T21:14:51.958 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.956+0000 7f168bfff700 1 -- 172.21.15.111:0/3499456792 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f1684005ee0 con 0x7f16940903b0 2023-10-05T21:14:51.958 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:14:51.958 INFO:teuthology.orchestra.run.smithi111.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-05T21:14:51.960 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.958+0000 7f169a412700 1 -- 172.21.15.111:0/3499456792 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f16740358d0 msgr2=0x7f1674037d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:51.960 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.958+0000 7f169a412700 1 --2- 172.21.15.111:0/3499456792 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f16740358d0 0x7f1674037d80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f167c0016a0 tx=0x7f167c007b30 comp rx=0 tx=0).stop 2023-10-05T21:14:51.960 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.958+0000 7f169a412700 1 -- 172.21.15.111:0/3499456792 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f16940903b0 msgr2=0x7f1694125dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:51.960 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.958+0000 7f169a412700 1 --2- 172.21.15.111:0/3499456792 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f16940903b0 0x7f1694125dc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1684009fd0 tx=0x7f1684015000 comp rx=0 tx=0).stop 2023-10-05T21:14:51.960 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.958+0000 7f169a412700 1 -- 172.21.15.111:0/3499456792 shutdown_connections 2023-10-05T21:14:51.960 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.958+0000 7f169a412700 1 --2- 172.21.15.111:0/3499456792 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f16740358d0 0x7f1674037d80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:51.960 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.958+0000 7f169a412700 1 --2- 172.21.15.111:0/3499456792 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f16940903b0 0x7f1694125dc0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:51.960 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.958+0000 7f169a412700 1 -- 172.21.15.111:0/3499456792 >> 172.21.15.111:0/3499456792 conn(0x7f1694095c20 msgr2=0x7f1694067e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:51.961 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.958+0000 7f169a412700 1 -- 172.21.15.111:0/3499456792 shutdown_connections 2023-10-05T21:14:51.961 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:14:51.958+0000 7f169a412700 1 -- 172.21.15.111:0/3499456792 wait complete. 2023-10-05T21:14:51.971 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-05T21:14:51.972 INFO:teuthology.run_tasks:Running task rgw... 2023-10-05T21:14:51.988 DEBUG:tasks.rgw:config is {'client.0': None} 2023-10-05T21:14:51.988 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2023-10-05T21:14:51.988 INFO:tasks.rgw:Creating data pools 2023-10-05T21:14:51.988 DEBUG:tasks.rgw:Obtaining remote for client client.0 2023-10-05T21:14:51.988 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2023-10-05T21:14:52.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.118+0000 7f87aa020700 1 Processor -- start 2023-10-05T21:14:52.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.118+0000 7f87aa020700 1 -- start start 2023-10-05T21:14:52.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.118+0000 7f87aa020700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f87a4108db0 0x7f87a4109180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:52.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.118+0000 7f87aa020700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a41160e0 con 0x7f87a41097b0 2023-10-05T21:14:52.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.118+0000 7f87aa020700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87a40673d0 con 0x7f87a4108db0 2023-10-05T21:14:52.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.118+0000 7f87a37fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f87a4108db0 0x7f87a4109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:52.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.118+0000 7f87a37fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f87a4108db0 0x7f87a4109180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37278/0 (socket says 172.21.15.153:37278) 2023-10-05T21:14:52.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.118+0000 7f87a37fe700 1 -- 172.21.15.153:0/410014819 learned_addr learned my addr 172.21.15.153:0/410014819 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:14:52.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.119+0000 7f87a37fe700 1 -- 172.21.15.153:0/410014819 >> v1:172.21.15.111:6789/0 conn(0x7f87a41097b0 legacy=0x7f87a41149c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:52.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.119+0000 7f87a37fe700 1 -- 172.21.15.153:0/410014819 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a4117280 con 0x7f87a4108db0 2023-10-05T21:14:52.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.119+0000 7f87a37fe700 1 --2- 172.21.15.153:0/410014819 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87a4108db0 0x7f87a4109180 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8794009930 tx=0x7f8794009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc4eacdf313abc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:52.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.119+0000 7f87a27fc700 1 -- 172.21.15.153:0/410014819 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f879400b860 con 0x7f87a4108db0 2023-10-05T21:14:52.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.119+0000 7f87a27fc700 1 -- 172.21.15.153:0/410014819 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879400b9c0 con 0x7f87a4108db0 2023-10-05T21:14:52.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.119+0000 7f87a27fc700 1 -- 172.21.15.153:0/410014819 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f879400bb50 con 0x7f87a4108db0 2023-10-05T21:14:52.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.120+0000 7f87aa020700 1 -- 172.21.15.153:0/410014819 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87a4108db0 msgr2=0x7f87a4109180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:52.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.120+0000 7f87aa020700 1 --2- 172.21.15.153:0/410014819 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87a4108db0 0x7f87a4109180 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8794009930 tx=0x7f8794009250 comp rx=0 tx=0).stop 2023-10-05T21:14:52.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.120+0000 7f87aa020700 1 -- 172.21.15.153:0/410014819 shutdown_connections 2023-10-05T21:14:52.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.120+0000 7f87aa020700 1 --2- 172.21.15.153:0/410014819 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87a4108db0 0x7f87a4109180 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:52.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.120+0000 7f87aa020700 1 -- 172.21.15.153:0/410014819 >> 172.21.15.153:0/410014819 conn(0x7f87a406b850 msgr2=0x7f87a406dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:52.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.120+0000 7f87aa020700 1 -- 172.21.15.153:0/410014819 shutdown_connections 2023-10-05T21:14:52.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.120+0000 7f87aa020700 1 -- 172.21.15.153:0/410014819 wait complete. 2023-10-05T21:14:52.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.120+0000 7f87aa020700 1 Processor -- start 2023-10-05T21:14:52.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.121+0000 7f87aa020700 1 -- start start 2023-10-05T21:14:52.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.121+0000 7f87aa020700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87a4108db0 0x7f87a410a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:52.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.121+0000 7f87aa020700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a406e6d0 con 0x7f87a4108db0 2023-10-05T21:14:52.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.121+0000 7f87a37fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87a4108db0 0x7f87a410a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:52.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.121+0000 7f87a37fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87a4108db0 0x7f87a410a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37290/0 (socket says 172.21.15.153:37290) 2023-10-05T21:14:52.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.121+0000 7f87a37fe700 1 -- 172.21.15.153:0/1053784206 learned_addr learned my addr 172.21.15.153:0/1053784206 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:14:52.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.121+0000 7f87a37fe700 1 -- 172.21.15.153:0/1053784206 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87940094f0 con 0x7f87a4108db0 2023-10-05T21:14:52.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.121+0000 7f87a37fe700 1 --2- 172.21.15.153:0/1053784206 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87a4108db0 0x7f87a410a820 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f87940094c0 tx=0x7f8794016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:52.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.122+0000 7f878b7fe700 1 -- 172.21.15.153:0/1053784206 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f879400bd40 con 0x7f87a4108db0 2023-10-05T21:14:52.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.122+0000 7f878b7fe700 1 -- 172.21.15.153:0/1053784206 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8794020070 con 0x7f87a4108db0 2023-10-05T21:14:52.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.122+0000 7f878b7fe700 1 -- 172.21.15.153:0/1053784206 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f879401b450 con 0x7f87a4108db0 2023-10-05T21:14:52.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.122+0000 7f87aa020700 1 -- 172.21.15.153:0/1053784206 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87a410ad60 con 0x7f87a4108db0 2023-10-05T21:14:52.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.122+0000 7f87aa020700 1 -- 172.21.15.153:0/1053784206 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87a410b1f0 con 0x7f87a4108db0 2023-10-05T21:14:52.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.123+0000 7f878b7fe700 1 -- 172.21.15.153:0/1053784206 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f8794022030 con 0x7f87a4108db0 2023-10-05T21:14:52.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.123+0000 7f878b7fe700 1 --2- 172.21.15.153:0/1053784206 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8790035880 0x7f8790037d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:52.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.123+0000 7f87aa020700 1 -- 172.21.15.153:0/1053784206 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87a4112260 con 0x7f87a4108db0 2023-10-05T21:14:52.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.123+0000 7f878b7fe700 1 -- 172.21.15.153:0/1053784206 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f87940496d0 con 0x7f87a4108db0 2023-10-05T21:14:52.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.123+0000 7f87a2ffd700 1 --2- 172.21.15.153:0/1053784206 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8790035880 0x7f8790037d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:52.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.123+0000 7f87a2ffd700 1 --2- 172.21.15.153:0/1053784206 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8790035880 0x7f8790037d30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8798001730 tx=0x7f8798007b40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:52.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.128+0000 7f878b7fe700 1 -- 172.21.15.153:0/1053784206 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8794024790 con 0x7f87a4108db0 2023-10-05T21:14:52.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:52.311+0000 7f87aa020700 1 -- 172.21.15.153:0/1053784206 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64} v 0) v1 -- 0x7f87a410bfd0 con 0x7f87a4108db0 2023-10-05T21:14:53.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.036+0000 7f878b7fe700 1 -- 172.21.15.153:0/1053784206 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.data' created v17) v1 ==== 167+0+0 (secure 0 0 0) 0x7f87940243d0 con 0x7f87a4108db0 2023-10-05T21:14:53.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.040+0000 7f87aa020700 1 -- 172.21.15.153:0/1053784206 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8790035880 msgr2=0x7f8790037d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:53.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.040+0000 7f87aa020700 1 --2- 172.21.15.153:0/1053784206 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8790035880 0x7f8790037d30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8798001730 tx=0x7f8798007b40 comp rx=0 tx=0).stop 2023-10-05T21:14:53.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.040+0000 7f87aa020700 1 -- 172.21.15.153:0/1053784206 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87a4108db0 msgr2=0x7f87a410a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:53.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.040+0000 7f87aa020700 1 --2- 172.21.15.153:0/1053784206 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87a4108db0 0x7f87a410a820 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f87940094c0 tx=0x7f8794016000 comp rx=0 tx=0).stop 2023-10-05T21:14:53.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.041+0000 7f87aa020700 1 -- 172.21.15.153:0/1053784206 shutdown_connections 2023-10-05T21:14:53.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.041+0000 7f87aa020700 1 --2- 172.21.15.153:0/1053784206 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8790035880 0x7f8790037d30 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:53.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.041+0000 7f87aa020700 1 --2- 172.21.15.153:0/1053784206 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87a4108db0 0x7f87a410a820 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:53.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.041+0000 7f87aa020700 1 -- 172.21.15.153:0/1053784206 >> 172.21.15.153:0/1053784206 conn(0x7f87a406b850 msgr2=0x7f87a410f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:53.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.042+0000 7f87aa020700 1 -- 172.21.15.153:0/1053784206 shutdown_connections 2023-10-05T21:14:53.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.043+0000 7f87aa020700 1 -- 172.21.15.153:0/1053784206 wait complete. 2023-10-05T21:14:53.047 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'default.rgw.buckets.data' created 2023-10-05T21:14:53.062 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2023-10-05T21:14:53.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.185+0000 7f96c3021700 1 Processor -- start 2023-10-05T21:14:53.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.185+0000 7f96c3021700 1 -- start start 2023-10-05T21:14:53.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.185+0000 7f96c3021700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f96bc110910 0x7f96bc110ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:53.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.185+0000 7f96c3021700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96bc1113a0 con 0x7f96bc108db0 2023-10-05T21:14:53.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.185+0000 7f96c3021700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96bc0673d0 con 0x7f96bc110910 2023-10-05T21:14:53.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.185+0000 7f96c0dbd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f96bc110910 0x7f96bc110ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:53.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.185+0000 7f96bbfff700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f96bc108db0 0x7f96bc109250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:47358/0 (socket says 172.21.15.153:47358) 2023-10-05T21:14:53.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.185+0000 7f96c0dbd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f96bc110910 0x7f96bc110ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37292/0 (socket says 172.21.15.153:37292) 2023-10-05T21:14:53.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.185+0000 7f96bbfff700 1 -- 172.21.15.153:0/139169869 learned_addr learned my addr 172.21.15.153:0/139169869 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:14:53.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.186+0000 7f96bb7fe700 1 -- 172.21.15.153:0/139169869 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1965794442 0 0) 0x7f96bc1113a0 con 0x7f96bc108db0 2023-10-05T21:14:53.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.186+0000 7f96bb7fe700 1 -- 172.21.15.153:0/139169869 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96ac003570 con 0x7f96bc108db0 2023-10-05T21:14:53.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.186+0000 7f96c0dbd700 1 -- 172.21.15.153:0/139169869 >> v1:172.21.15.111:6789/0 conn(0x7f96bc108db0 legacy=0x7f96bc109250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:53.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.186+0000 7f96c0dbd700 1 -- 172.21.15.153:0/139169869 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96bc109960 con 0x7f96bc110910 2023-10-05T21:14:53.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.186+0000 7f96c0dbd700 1 --2- 172.21.15.153:0/139169869 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f96bc110910 0x7f96bc110ce0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f96b0009860 tx=0x7f96b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fee1ce013ab84 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:53.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.186+0000 7f96bb7fe700 1 -- 172.21.15.153:0/139169869 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f96b0011630 con 0x7f96bc110910 2023-10-05T21:14:53.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.186+0000 7f96bb7fe700 1 -- 172.21.15.153:0/139169869 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b0011790 con 0x7f96bc110910 2023-10-05T21:14:53.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.186+0000 7f96bb7fe700 1 -- 172.21.15.153:0/139169869 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f96b0011900 con 0x7f96bc110910 2023-10-05T21:14:53.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.186+0000 7f96c3021700 1 -- 172.21.15.153:0/139169869 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f96bc110910 msgr2=0x7f96bc110ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:53.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.187+0000 7f96c3021700 1 --2- 172.21.15.153:0/139169869 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f96bc110910 0x7f96bc110ce0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f96b0009860 tx=0x7f96b00091a0 comp rx=0 tx=0).stop 2023-10-05T21:14:53.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.187+0000 7f96c3021700 1 -- 172.21.15.153:0/139169869 shutdown_connections 2023-10-05T21:14:53.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.187+0000 7f96c3021700 1 --2- 172.21.15.153:0/139169869 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f96bc110910 0x7f96bc110ce0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:53.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.187+0000 7f96c3021700 1 -- 172.21.15.153:0/139169869 >> 172.21.15.153:0/139169869 conn(0x7f96bc06bd70 msgr2=0x7f96bc06e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:53.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.187+0000 7f96c3021700 1 -- 172.21.15.153:0/139169869 shutdown_connections 2023-10-05T21:14:53.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.187+0000 7f96c3021700 1 -- 172.21.15.153:0/139169869 wait complete. 2023-10-05T21:14:53.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.187+0000 7f96c3021700 1 Processor -- start 2023-10-05T21:14:53.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.187+0000 7f96c3021700 1 -- start start 2023-10-05T21:14:53.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.188+0000 7f96c3021700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f96bc108db0 0x7f96bc119ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:53.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.188+0000 7f96c3021700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc06ee30 con 0x7f96bc108db0 2023-10-05T21:14:53.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.188+0000 7f96c0dbd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f96bc108db0 0x7f96bc119ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:53.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.188+0000 7f96c0dbd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f96bc108db0 0x7f96bc119ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37304/0 (socket says 172.21.15.153:37304) 2023-10-05T21:14:53.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.188+0000 7f96c0dbd700 1 -- 172.21.15.153:0/2468601926 learned_addr learned my addr 172.21.15.153:0/2468601926 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:14:53.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.188+0000 7f96c0dbd700 1 -- 172.21.15.153:0/2468601926 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b0009420 con 0x7f96bc108db0 2023-10-05T21:14:53.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.188+0000 7f96c0dbd700 1 --2- 172.21.15.153:0/2468601926 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f96bc108db0 0x7f96bc119ab0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f96b00093f0 tx=0x7f96b0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:53.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.189+0000 7f96b8ff9700 1 -- 172.21.15.153:0/2468601926 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f96b001be80 con 0x7f96bc108db0 2023-10-05T21:14:53.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.189+0000 7f96b8ff9700 1 -- 172.21.15.153:0/2468601926 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b0020070 con 0x7f96bc108db0 2023-10-05T21:14:53.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.189+0000 7f96c3021700 1 -- 172.21.15.153:0/2468601926 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96bc119ff0 con 0x7f96bc108db0 2023-10-05T21:14:53.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.189+0000 7f96b8ff9700 1 -- 172.21.15.153:0/2468601926 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f96b0027480 con 0x7f96bc108db0 2023-10-05T21:14:53.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.189+0000 7f96c3021700 1 -- 172.21.15.153:0/2468601926 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96bc11a400 con 0x7f96bc108db0 2023-10-05T21:14:53.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.190+0000 7f96b8ff9700 1 -- 172.21.15.153:0/2468601926 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f96b00275e0 con 0x7f96bc108db0 2023-10-05T21:14:53.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.190+0000 7f96c3021700 1 -- 172.21.15.153:0/2468601926 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96bc05f230 con 0x7f96bc108db0 2023-10-05T21:14:53.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.190+0000 7f96b8ff9700 1 --2- 172.21.15.153:0/2468601926 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f96a0035910 0x7f96a0037dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:53.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.190+0000 7f96b8ff9700 1 -- 172.21.15.153:0/2468601926 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3841+0+0 (secure 0 0 0) 0x7f96b0022070 con 0x7f96bc108db0 2023-10-05T21:14:53.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.190+0000 7f96bbfff700 1 --2- 172.21.15.153:0/2468601926 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f96a0035910 0x7f96a0037dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:53.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.190+0000 7f96bbfff700 1 --2- 172.21.15.153:0/2468601926 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f96a0035910 0x7f96a0037dc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f96a80058d0 tx=0x7f96a80079d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:53.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.195+0000 7f96b8ff9700 1 -- 172.21.15.153:0/2468601926 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f96b00263e0 con 0x7f96bc108db0 2023-10-05T21:14:53.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:53.376+0000 7f96c3021700 1 -- 172.21.15.153:0/2468601926 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) v1 -- 0x7f96bc110910 con 0x7f96bc108db0 2023-10-05T21:14:54.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.039+0000 7f96b8ff9700 1 -- 172.21.15.153:0/2468601926 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v18) v1 ==== 185+0+0 (secure 0 0 0) 0x7f96b0010b70 con 0x7f96bc108db0 2023-10-05T21:14:54.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.050+0000 7f96c3021700 1 -- 172.21.15.153:0/2468601926 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f96a0035910 msgr2=0x7f96a0037dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:54.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.050+0000 7f96c3021700 1 --2- 172.21.15.153:0/2468601926 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f96a0035910 0x7f96a0037dc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f96a80058d0 tx=0x7f96a80079d0 comp rx=0 tx=0).stop 2023-10-05T21:14:54.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.050+0000 7f96c3021700 1 -- 172.21.15.153:0/2468601926 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f96bc108db0 msgr2=0x7f96bc119ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:54.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.050+0000 7f96c3021700 1 --2- 172.21.15.153:0/2468601926 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f96bc108db0 0x7f96bc119ab0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f96b00093f0 tx=0x7f96b0016000 comp rx=0 tx=0).stop 2023-10-05T21:14:54.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.052+0000 7f96c3021700 1 -- 172.21.15.153:0/2468601926 shutdown_connections 2023-10-05T21:14:54.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.052+0000 7f96c3021700 1 --2- 172.21.15.153:0/2468601926 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f96a0035910 0x7f96a0037dc0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:54.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.052+0000 7f96c3021700 1 --2- 172.21.15.153:0/2468601926 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f96bc108db0 0x7f96bc119ab0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:54.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.052+0000 7f96c3021700 1 -- 172.21.15.153:0/2468601926 >> 172.21.15.153:0/2468601926 conn(0x7f96bc06bd70 msgr2=0x7f96bc10f060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:54.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.052+0000 7f96c3021700 1 -- 172.21.15.153:0/2468601926 shutdown_connections 2023-10-05T21:14:54.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.053+0000 7f96c3021700 1 -- 172.21.15.153:0/2468601926 wait complete. 2023-10-05T21:14:54.055 INFO:teuthology.orchestra.run.smithi153.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2023-10-05T21:14:54.070 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2023-10-05T21:14:54.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.199+0000 7f46c1525700 1 Processor -- start 2023-10-05T21:14:54.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.199+0000 7f46c1525700 1 -- start start 2023-10-05T21:14:54.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.199+0000 7f46c1525700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f46bc108db0 0x7f46bc109180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:54.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.200+0000 7f46c1525700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46bc1160e0 con 0x7f46bc1097b0 2023-10-05T21:14:54.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.200+0000 7f46c1525700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46bc0673d0 con 0x7f46bc108db0 2023-10-05T21:14:54.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.200+0000 7f46baffd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f46bc108db0 0x7f46bc109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:54.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.200+0000 7f46ba7fc700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f46bc1097b0 0x7f46bc1149c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:47370/0 (socket says 172.21.15.153:47370) 2023-10-05T21:14:54.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.200+0000 7f46ba7fc700 1 -- 172.21.15.153:0/1166560045 learned_addr learned my addr 172.21.15.153:0/1166560045 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:14:54.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.200+0000 7f46baffd700 1 -- 172.21.15.153:0/1166560045 >> v1:172.21.15.111:6789/0 conn(0x7f46bc1097b0 legacy=0x7f46bc1149c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:54.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.200+0000 7f46baffd700 1 -- 172.21.15.153:0/1166560045 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46bc117280 con 0x7f46bc108db0 2023-10-05T21:14:54.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.200+0000 7f46baffd700 1 --2- 172.21.15.153:0/1166560045 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46bc108db0 0x7f46bc109180 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f46b4009860 tx=0x7f46b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d687342532c7afe2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:54.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.201+0000 7f46b9ffb700 1 -- 172.21.15.153:0/1166560045 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46b400b680 con 0x7f46bc108db0 2023-10-05T21:14:54.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.201+0000 7f46b9ffb700 1 -- 172.21.15.153:0/1166560045 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b400b7e0 con 0x7f46bc108db0 2023-10-05T21:14:54.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.201+0000 7f46b9ffb700 1 -- 172.21.15.153:0/1166560045 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46b400b990 con 0x7f46bc108db0 2023-10-05T21:14:54.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.201+0000 7f46c1525700 1 -- 172.21.15.153:0/1166560045 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46bc108db0 msgr2=0x7f46bc109180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:54.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.201+0000 7f46c1525700 1 --2- 172.21.15.153:0/1166560045 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46bc108db0 0x7f46bc109180 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f46b4009860 tx=0x7f46b40091a0 comp rx=0 tx=0).stop 2023-10-05T21:14:54.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.201+0000 7f46c1525700 1 -- 172.21.15.153:0/1166560045 shutdown_connections 2023-10-05T21:14:54.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.201+0000 7f46c1525700 1 --2- 172.21.15.153:0/1166560045 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46bc108db0 0x7f46bc109180 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:54.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.201+0000 7f46c1525700 1 -- 172.21.15.153:0/1166560045 >> 172.21.15.153:0/1166560045 conn(0x7f46bc06b850 msgr2=0x7f46bc06dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:54.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.201+0000 7f46c1525700 1 -- 172.21.15.153:0/1166560045 shutdown_connections 2023-10-05T21:14:54.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.201+0000 7f46c1525700 1 -- 172.21.15.153:0/1166560045 wait complete. 2023-10-05T21:14:54.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.202+0000 7f46c1525700 1 Processor -- start 2023-10-05T21:14:54.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.202+0000 7f46c1525700 1 -- start start 2023-10-05T21:14:54.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.202+0000 7f46c1525700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46bc108db0 0x7f46bc10a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:54.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.202+0000 7f46c1525700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc06e6d0 con 0x7f46bc108db0 2023-10-05T21:14:54.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.202+0000 7f46baffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46bc108db0 0x7f46bc10a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:54.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.202+0000 7f46baffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46bc108db0 0x7f46bc10a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37320/0 (socket says 172.21.15.153:37320) 2023-10-05T21:14:54.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.202+0000 7f46baffd700 1 -- 172.21.15.153:0/1946634102 learned_addr learned my addr 172.21.15.153:0/1946634102 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:14:54.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.203+0000 7f46baffd700 1 -- 172.21.15.153:0/1946634102 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b4009420 con 0x7f46bc108db0 2023-10-05T21:14:54.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.203+0000 7f46baffd700 1 --2- 172.21.15.153:0/1946634102 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46bc108db0 0x7f46bc10a820 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f46b4000c00 tx=0x7f46b4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:54.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.203+0000 7f46a2ffd700 1 -- 172.21.15.153:0/1946634102 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46b4025470 con 0x7f46bc108db0 2023-10-05T21:14:54.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.203+0000 7f46a2ffd700 1 -- 172.21.15.153:0/1946634102 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b40255d0 con 0x7f46bc108db0 2023-10-05T21:14:54.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.203+0000 7f46c1525700 1 -- 172.21.15.153:0/1946634102 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46bc10ad60 con 0x7f46bc108db0 2023-10-05T21:14:54.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.203+0000 7f46a2ffd700 1 -- 172.21.15.153:0/1946634102 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46b40258a0 con 0x7f46bc108db0 2023-10-05T21:14:54.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.203+0000 7f46c1525700 1 -- 172.21.15.153:0/1946634102 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46bc10b1f0 con 0x7f46bc108db0 2023-10-05T21:14:54.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.204+0000 7f46a2ffd700 1 -- 172.21.15.153:0/1946634102 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f46b4022070 con 0x7f46bc108db0 2023-10-05T21:14:54.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.204+0000 7f46c1525700 1 -- 172.21.15.153:0/1946634102 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46bc112260 con 0x7f46bc108db0 2023-10-05T21:14:54.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.204+0000 7f46a2ffd700 1 --2- 172.21.15.153:0/1946634102 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f46a80358d0 0x7f46a8037d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:54.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.204+0000 7f46a2ffd700 1 -- 172.21.15.153:0/1946634102 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3852+0+0 (secure 0 0 0) 0x7f46b4049a50 con 0x7f46bc108db0 2023-10-05T21:14:54.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.204+0000 7f46ba7fc700 1 --2- 172.21.15.153:0/1946634102 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f46a80358d0 0x7f46a8037d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:54.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.204+0000 7f46ba7fc700 1 --2- 172.21.15.153:0/1946634102 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f46a80358d0 0x7f46a8037d80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f46b00016a0 tx=0x7f46b0007b30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:54.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.208+0000 7f46a2ffd700 1 -- 172.21.15.153:0/1946634102 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f46b401c450 con 0x7f46bc108db0 2023-10-05T21:14:54.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:54.388+0000 7f46c1525700 1 -- 172.21.15.153:0/1946634102 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) v1 -- 0x7f46bc10bfd0 con 0x7f46bc108db0 2023-10-05T21:14:55.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.044+0000 7f46a2ffd700 1 -- 172.21.15.153:0/1946634102 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v19) v1 ==== 169+0+0 (secure 0 0 0) 0x7f46b4010380 con 0x7f46bc108db0 2023-10-05T21:14:55.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.048+0000 7f46c1525700 1 -- 172.21.15.153:0/1946634102 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f46a80358d0 msgr2=0x7f46a8037d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:55.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.048+0000 7f46c1525700 1 --2- 172.21.15.153:0/1946634102 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f46a80358d0 0x7f46a8037d80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f46b00016a0 tx=0x7f46b0007b30 comp rx=0 tx=0).stop 2023-10-05T21:14:55.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.048+0000 7f46c1525700 1 -- 172.21.15.153:0/1946634102 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46bc108db0 msgr2=0x7f46bc10a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:55.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.048+0000 7f46c1525700 1 --2- 172.21.15.153:0/1946634102 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46bc108db0 0x7f46bc10a820 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f46b4000c00 tx=0x7f46b4016000 comp rx=0 tx=0).stop 2023-10-05T21:14:55.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.048+0000 7f46c1525700 1 -- 172.21.15.153:0/1946634102 shutdown_connections 2023-10-05T21:14:55.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.048+0000 7f46c1525700 1 --2- 172.21.15.153:0/1946634102 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f46a80358d0 0x7f46a8037d80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:55.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.048+0000 7f46c1525700 1 --2- 172.21.15.153:0/1946634102 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46bc108db0 0x7f46bc10a820 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:55.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.048+0000 7f46c1525700 1 -- 172.21.15.153:0/1946634102 >> 172.21.15.153:0/1946634102 conn(0x7f46bc06b850 msgr2=0x7f46bc10f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:55.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.048+0000 7f46c1525700 1 -- 172.21.15.153:0/1946634102 shutdown_connections 2023-10-05T21:14:55.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.048+0000 7f46c1525700 1 -- 172.21.15.153:0/1946634102 wait complete. 2023-10-05T21:14:55.052 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'default.rgw.buckets.index' created 2023-10-05T21:14:55.069 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2023-10-05T21:14:55.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.195+0000 7f25c1436700 1 Processor -- start 2023-10-05T21:14:55.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.195+0000 7f25c1436700 1 -- start start 2023-10-05T21:14:55.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.195+0000 7f25c1436700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f25bc115850 0x7f25bc117c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:55.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.195+0000 7f25c1436700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25bc118170 con 0x7f25bc10cec0 2023-10-05T21:14:55.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.195+0000 7f25c1436700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25bc0673d0 con 0x7f25bc115850 2023-10-05T21:14:55.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.196+0000 7f25ba7fc700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f25bc115850 0x7f25bc117c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:55.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.196+0000 7f25baffd700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f25bc10cec0 0x7f25bc10d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:47378/0 (socket says 172.21.15.153:47378) 2023-10-05T21:14:55.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.196+0000 7f25baffd700 1 -- 172.21.15.153:0/3370395447 learned_addr learned my addr 172.21.15.153:0/3370395447 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:14:55.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.196+0000 7f25ba7fc700 1 -- 172.21.15.153:0/3370395447 >> v1:172.21.15.111:6789/0 conn(0x7f25bc10cec0 legacy=0x7f25bc10d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:55.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.196+0000 7f25ba7fc700 1 -- 172.21.15.153:0/3370395447 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25bc119310 con 0x7f25bc115850 2023-10-05T21:14:55.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.196+0000 7f25ba7fc700 1 --2- 172.21.15.153:0/3370395447 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25bc115850 0x7f25bc117c30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f25ac009860 tx=0x7f25ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef652212f3af5a30 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:55.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.196+0000 7f25b9ffb700 1 -- 172.21.15.153:0/3370395447 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25ac011630 con 0x7f25bc115850 2023-10-05T21:14:55.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.196+0000 7f25b9ffb700 1 -- 172.21.15.153:0/3370395447 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ac011790 con 0x7f25bc115850 2023-10-05T21:14:55.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.196+0000 7f25b9ffb700 1 -- 172.21.15.153:0/3370395447 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25ac011940 con 0x7f25bc115850 2023-10-05T21:14:55.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.197+0000 7f25c1436700 1 -- 172.21.15.153:0/3370395447 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25bc115850 msgr2=0x7f25bc117c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:55.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.197+0000 7f25c1436700 1 --2- 172.21.15.153:0/3370395447 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25bc115850 0x7f25bc117c30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f25ac009860 tx=0x7f25ac0091a0 comp rx=0 tx=0).stop 2023-10-05T21:14:55.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.197+0000 7f25c1436700 1 -- 172.21.15.153:0/3370395447 shutdown_connections 2023-10-05T21:14:55.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.197+0000 7f25c1436700 1 --2- 172.21.15.153:0/3370395447 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25bc115850 0x7f25bc117c30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:55.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.197+0000 7f25c1436700 1 -- 172.21.15.153:0/3370395447 >> 172.21.15.153:0/3370395447 conn(0x7f25bc06b550 msgr2=0x7f25bc10adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:55.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.197+0000 7f25c1436700 1 -- 172.21.15.153:0/3370395447 shutdown_connections 2023-10-05T21:14:55.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.197+0000 7f25c1436700 1 -- 172.21.15.153:0/3370395447 wait complete. 2023-10-05T21:14:55.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.198+0000 7f25c1436700 1 Processor -- start 2023-10-05T21:14:55.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.198+0000 7f25c1436700 1 -- start start 2023-10-05T21:14:55.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.198+0000 7f25c1436700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25bc10cec0 0x7f25bc11bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:55.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.198+0000 7f25c1436700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25bc10eb10 con 0x7f25bc10cec0 2023-10-05T21:14:55.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.198+0000 7f25baffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25bc10cec0 0x7f25bc11bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:55.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.198+0000 7f25baffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25bc10cec0 0x7f25bc11bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37330/0 (socket says 172.21.15.153:37330) 2023-10-05T21:14:55.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.198+0000 7f25baffd700 1 -- 172.21.15.153:0/2408351604 learned_addr learned my addr 172.21.15.153:0/2408351604 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:14:55.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.198+0000 7f25baffd700 1 -- 172.21.15.153:0/2408351604 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ac009420 con 0x7f25bc10cec0 2023-10-05T21:14:55.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.199+0000 7f25baffd700 1 --2- 172.21.15.153:0/2408351604 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25bc10cec0 0x7f25bc11bdb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f25b000c710 tx=0x7f25b0007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:55.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.199+0000 7f25a2ffd700 1 -- 172.21.15.153:0/2408351604 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25b0005b90 con 0x7f25bc10cec0 2023-10-05T21:14:55.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.199+0000 7f25a2ffd700 1 -- 172.21.15.153:0/2408351604 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b0005cf0 con 0x7f25bc10cec0 2023-10-05T21:14:55.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.199+0000 7f25c1436700 1 -- 172.21.15.153:0/2408351604 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25bc11c2f0 con 0x7f25bc10cec0 2023-10-05T21:14:55.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.199+0000 7f25a2ffd700 1 -- 172.21.15.153:0/2408351604 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25b00070f0 con 0x7f25bc10cec0 2023-10-05T21:14:55.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.199+0000 7f25c1436700 1 -- 172.21.15.153:0/2408351604 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25bc11c760 con 0x7f25bc10cec0 2023-10-05T21:14:55.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.200+0000 7f25a2ffd700 1 -- 172.21.15.153:0/2408351604 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f25b0007270 con 0x7f25bc10cec0 2023-10-05T21:14:55.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.200+0000 7f25c1436700 1 -- 172.21.15.153:0/2408351604 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25bc11d1a0 con 0x7f25bc10cec0 2023-10-05T21:14:55.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.200+0000 7f25a2ffd700 1 --2- 172.21.15.153:0/2408351604 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f25a80358d0 0x7f25a8037d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:14:55.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.200+0000 7f25a2ffd700 1 -- 172.21.15.153:0/2408351604 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4216+0+0 (secure 0 0 0) 0x7f25b00477e0 con 0x7f25bc10cec0 2023-10-05T21:14:55.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.200+0000 7f25ba7fc700 1 --2- 172.21.15.153:0/2408351604 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f25a80358d0 0x7f25a8037d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:14:55.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.200+0000 7f25ba7fc700 1 --2- 172.21.15.153:0/2408351604 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f25a80358d0 0x7f25a8037d80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f25ac009860 tx=0x7f25ac016000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:14:55.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.205+0000 7f25a2ffd700 1 -- 172.21.15.153:0/2408351604 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f25b001ab90 con 0x7f25bc10cec0 2023-10-05T21:14:55.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:55.388+0000 7f25c1436700 1 -- 172.21.15.153:0/2408351604 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) v1 -- 0x7f25bc11b960 con 0x7f25bc10cec0 2023-10-05T21:14:56.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:56.047+0000 7f25a2ffd700 1 -- 172.21.15.153:0/2408351604 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v20) v1 ==== 187+0+0 (secure 0 0 0) 0x7f25b001a360 con 0x7f25bc10cec0 2023-10-05T21:14:56.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:56.057+0000 7f25c1436700 1 -- 172.21.15.153:0/2408351604 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f25a80358d0 msgr2=0x7f25a8037d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:56.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:56.057+0000 7f25c1436700 1 --2- 172.21.15.153:0/2408351604 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f25a80358d0 0x7f25a8037d80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f25ac009860 tx=0x7f25ac016000 comp rx=0 tx=0).stop 2023-10-05T21:14:56.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:56.057+0000 7f25c1436700 1 -- 172.21.15.153:0/2408351604 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25bc10cec0 msgr2=0x7f25bc11bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:14:56.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:56.057+0000 7f25c1436700 1 --2- 172.21.15.153:0/2408351604 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25bc10cec0 0x7f25bc11bdb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f25b000c710 tx=0x7f25b0007f30 comp rx=0 tx=0).stop 2023-10-05T21:14:56.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:56.059+0000 7f25c1436700 1 -- 172.21.15.153:0/2408351604 shutdown_connections 2023-10-05T21:14:56.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:56.059+0000 7f25c1436700 1 --2- 172.21.15.153:0/2408351604 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f25a80358d0 0x7f25a8037d80 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:56.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:56.059+0000 7f25c1436700 1 --2- 172.21.15.153:0/2408351604 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25bc10cec0 0x7f25bc11bdb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:14:56.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:56.059+0000 7f25c1436700 1 -- 172.21.15.153:0/2408351604 >> 172.21.15.153:0/2408351604 conn(0x7f25bc06b550 msgr2=0x7f25bc10ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:14:56.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:56.060+0000 7f25c1436700 1 -- 172.21.15.153:0/2408351604 shutdown_connections 2023-10-05T21:14:56.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:14:56.060+0000 7f25c1436700 1 -- 172.21.15.153:0/2408351604 wait complete. 2023-10-05T21:14:56.065 INFO:teuthology.orchestra.run.smithi153.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2023-10-05T21:14:56.079 DEBUG:tasks.rgw:Pools created 2023-10-05T21:14:56.079 INFO:tasks.rgw:Starting rgw... 2023-10-05T21:14:56.079 INFO:tasks.rgw:rgw client.0 config is {} 2023-10-05T21:14:56.079 INFO:tasks.rgw:Using beast as radosgw frontend 2023-10-05T21:14:56.079 INFO:tasks.rgw.client.0:Restarting daemon 2023-10-05T21:14:56.080 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2023-10-05T21:14:56.082 INFO:tasks.rgw.client.0:Started 2023-10-05T21:14:56.082 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi153.front.sepia.ceph.com:80/ 2023-10-05T21:14:56.082 DEBUG:teuthology.orchestra.run.smithi153:> curl http://smithi153.front.sepia.ceph.com:80/ 2023-10-05T21:14:56.139 INFO:teuthology.orchestra.run.smithi153.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-10-05T21:14:56.139 INFO:teuthology.orchestra.run.smithi153.stderr: Dload Upload Total Spent Left Speed 2023-10-05T21:14:56.140 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-10-05T21:14:56.141 INFO:teuthology.orchestra.run.smithi153.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to smithi153.front.sepia.ceph.com port 80: Connection refused 2023-10-05T21:14:57.142 DEBUG:teuthology.orchestra.run.smithi153:> curl http://smithi153.front.sepia.ceph.com:80/ 2023-10-05T21:14:57.169 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-10-05T21:14:57.169 INFO:teuthology.orchestra.run.smithi153.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-10-05T21:14:57.169 INFO:teuthology.orchestra.run.smithi153.stderr: Dload Upload Total Spent Left Speed 2023-10-05T21:14:57.169 INFO:teuthology.orchestra.run.smithi153.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to smithi153.front.sepia.ceph.com port 80: Connection refused 2023-10-05T21:14:59.170 DEBUG:teuthology.orchestra.run.smithi153:> curl http://smithi153.front.sepia.ceph.com:80/ 2023-10-05T21:14:59.196 INFO:teuthology.orchestra.run.smithi153.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-10-05T21:14:59.196 INFO:teuthology.orchestra.run.smithi153.stderr: Dload Upload Total Spent Left Speed 2023-10-05T21:14:59.198 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-10-05T21:14:59.198 INFO:teuthology.orchestra.run.smithi153.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to smithi153.front.sepia.ceph.com port 80: Connection refused 2023-10-05T21:15:03.199 DEBUG:teuthology.orchestra.run.smithi153:> curl http://smithi153.front.sepia.ceph.com:80/ 2023-10-05T21:15:03.225 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-10-05T21:15:03.225 INFO:teuthology.orchestra.run.smithi153.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-10-05T21:15:03.226 INFO:teuthology.orchestra.run.smithi153.stderr: Dload Upload Total Spent Left Speed 2023-10-05T21:15:03.226 INFO:teuthology.orchestra.run.smithi153.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to smithi153.front.sepia.ceph.com port 80: Connection refused 2023-10-05T21:15:11.227 DEBUG:teuthology.orchestra.run.smithi153:> curl http://smithi153.front.sepia.ceph.com:80/ 2023-10-05T21:15:11.254 INFO:teuthology.orchestra.run.smithi153.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-10-05T21:15:11.254 INFO:teuthology.orchestra.run.smithi153.stderr: Dload Upload Total Spent Left Speed 2023-10-05T21:15:11.255 INFO:teuthology.orchestra.run.smithi153.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 104k 0 --:--:-- --:--:-- --:--:-- 104k 2023-10-05T21:15:11.256 INFO:teuthology.orchestra.run.smithi153.stdout:anonymous 2023-10-05T21:15:11.256 INFO:teuthology.run_tasks:Running task radosgw-admin... 2023-10-05T21:15:11.344 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2023-10-05T21:15:11.344 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2023-10-05T21:15:11.345 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2023-10-05T21:15:11.345 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2023-10-05T21:15:11.394 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:11.394 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:11.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.393+0000 7fab641ca680 1 Processor -- start 2023-10-05T21:15:11.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.393+0000 7fab641ca680 1 -- start start 2023-10-05T21:15:11.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.393+0000 7fab641ca680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55889eca57c0 0x55889eca7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.393+0000 7fab641ca680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55889ebef970 con 0x55889eca1290 2023-10-05T21:15:11.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.393+0000 7fab641ca680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55889ebafdb0 con 0x55889eca57c0 2023-10-05T21:15:11.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.394+0000 7fab56aa1700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55889eca57c0 0x55889eca7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.394+0000 7fab572a2700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55889eca1290 0x55889eca16a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56112/0 (socket says 172.21.15.153:56112) 2023-10-05T21:15:11.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.394+0000 7fab572a2700 1 -- 172.21.15.153:0/1708829639 learned_addr learned my addr 172.21.15.153:0/1708829639 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:11.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.394+0000 7fab562a0700 1 -- 172.21.15.153:0/1708829639 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2225814996 0 0) 0x55889ebef970 con 0x55889eca1290 2023-10-05T21:15:11.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.394+0000 7fab562a0700 1 -- 172.21.15.153:0/1708829639 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab44001e10 con 0x55889eca1290 2023-10-05T21:15:11.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.394+0000 7fab56aa1700 1 -- 172.21.15.153:0/1708829639 >> v1:172.21.15.111:6789/0 conn(0x55889eca1290 legacy=0x55889eca16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.394+0000 7fab56aa1700 1 -- 172.21.15.153:0/1708829639 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55889eca90f0 con 0x55889eca57c0 2023-10-05T21:15:11.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.394+0000 7fab56aa1700 1 --2- 172.21.15.153:0/1708829639 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889eca57c0 0x55889eca7ba0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fab4000a6a0 tx=0x7fab40005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d350fa37857623ca server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.394+0000 7fab562a0700 1 -- 172.21.15.153:0/1708829639 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab4000f070 con 0x55889eca57c0 2023-10-05T21:15:11.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.394+0000 7fab562a0700 1 -- 172.21.15.153:0/1708829639 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4000a2e0 con 0x55889eca57c0 2023-10-05T21:15:11.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.394+0000 7fab562a0700 1 -- 172.21.15.153:0/1708829639 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab400085b0 con 0x55889eca57c0 2023-10-05T21:15:11.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.395+0000 7fab641ca680 1 -- 172.21.15.153:0/1708829639 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889eca57c0 msgr2=0x55889eca7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.395+0000 7fab641ca680 1 --2- 172.21.15.153:0/1708829639 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889eca57c0 0x55889eca7ba0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fab4000a6a0 tx=0x7fab40005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:11.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.395+0000 7fab641ca680 1 -- 172.21.15.153:0/1708829639 shutdown_connections 2023-10-05T21:15:11.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.395+0000 7fab641ca680 1 --2- 172.21.15.153:0/1708829639 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889eca57c0 0x55889eca7ba0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.395+0000 7fab641ca680 1 -- 172.21.15.153:0/1708829639 >> 172.21.15.153:0/1708829639 conn(0x55889ec9cb60 msgr2=0x55889ec9ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:11.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.395+0000 7fab641ca680 1 -- 172.21.15.153:0/1708829639 shutdown_connections 2023-10-05T21:15:11.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.395+0000 7fab641ca680 1 -- 172.21.15.153:0/1708829639 wait complete. 2023-10-05T21:15:11.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.396+0000 7fab641ca680 1 Processor -- start 2023-10-05T21:15:11.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.396+0000 7fab641ca680 1 -- start start 2023-10-05T21:15:11.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.396+0000 7fab641ca680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889eca1290 0x55889ecbf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.396+0000 7fab641ca680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55889eb4fea0 con 0x55889eca1290 2023-10-05T21:15:11.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.396+0000 7fab572a2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889eca1290 0x55889ecbf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.396+0000 7fab572a2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889eca1290 0x55889ecbf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:48970/0 (socket says 172.21.15.153:48970) 2023-10-05T21:15:11.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.396+0000 7fab572a2700 1 -- 172.21.15.153:0/2571422688 learned_addr learned my addr 172.21.15.153:0/2571422688 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:11.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.397+0000 7fab572a2700 1 -- 172.21.15.153:0/2571422688 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab40005cf0 con 0x55889eca1290 2023-10-05T21:15:11.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.397+0000 7fab572a2700 1 --2- 172.21.15.153:0/2571422688 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889eca1290 0x55889ecbf420 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fab48001c70 tx=0x7fab48001820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be967cd49963e542 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.397+0000 7fab5529e700 1 -- 172.21.15.153:0/2571422688 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab4800bbf0 con 0x55889eca1290 2023-10-05T21:15:11.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.397+0000 7fab5529e700 1 -- 172.21.15.153:0/2571422688 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4800bd70 con 0x55889eca1290 2023-10-05T21:15:11.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.397+0000 7fab5529e700 1 -- 172.21.15.153:0/2571422688 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab4800e5f0 con 0x55889eca1290 2023-10-05T21:15:11.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.397+0000 7fab641ca680 1 -- 172.21.15.153:0/2571422688 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889eca1290 msgr2=0x55889ecbf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.397+0000 7fab641ca680 1 --2- 172.21.15.153:0/2571422688 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889eca1290 0x55889ecbf420 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fab48001c70 tx=0x7fab48001820 comp rx=0 tx=0).stop 2023-10-05T21:15:11.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.397+0000 7fab641ca680 1 -- 172.21.15.153:0/2571422688 shutdown_connections 2023-10-05T21:15:11.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.397+0000 7fab641ca680 1 --2- 172.21.15.153:0/2571422688 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889eca1290 0x55889ecbf420 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.397+0000 7fab641ca680 1 -- 172.21.15.153:0/2571422688 >> 172.21.15.153:0/2571422688 conn(0x55889ec9cb60 msgr2=0x55889ecbaef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:11.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.397+0000 7fab641ca680 1 -- 172.21.15.153:0/2571422688 shutdown_connections 2023-10-05T21:15:11.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.397+0000 7fab641ca680 1 -- 172.21.15.153:0/2571422688 wait complete. 2023-10-05T21:15:11.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.398+0000 7fab641ca680 1 Processor -- start 2023-10-05T21:15:11.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.398+0000 7fab641ca680 1 -- start start 2023-10-05T21:15:11.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.398+0000 7fab641ca680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889eca1290 0x55889eccad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.398+0000 7fab641ca680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55889eb46c80 con 0x55889eca1290 2023-10-05T21:15:11.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.398+0000 7fab572a2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889eca1290 0x55889eccad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.398+0000 7fab572a2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889eca1290 0x55889eccad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:48974/0 (socket says 172.21.15.153:48974) 2023-10-05T21:15:11.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.398+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 learned_addr learned my addr 172.21.15.153:0/235804841 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:11.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.398+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab44001e10 con 0x55889eca1290 2023-10-05T21:15:11.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.399+0000 7fab572a2700 1 --2- 172.21.15.153:0/235804841 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889eca1290 0x55889eccad30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fab48010000 tx=0x7fab48016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.399+0000 7fab4f7fe700 1 -- 172.21.15.153:0/235804841 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab4801f070 con 0x55889eca1290 2023-10-05T21:15:11.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.399+0000 7fab4f7fe700 1 -- 172.21.15.153:0/235804841 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab48018640 con 0x55889eca1290 2023-10-05T21:15:11.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.399+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55889eccb270 con 0x55889eca1290 2023-10-05T21:15:11.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.399+0000 7fab4f7fe700 1 -- 172.21.15.153:0/235804841 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab48018910 con 0x55889eca1290 2023-10-05T21:15:11.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.399+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55889eccb6c0 con 0x55889eca1290 2023-10-05T21:15:11.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.400+0000 7fab4f7fe700 1 -- 172.21.15.153:0/235804841 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fab48018a70 con 0x55889eca1290 2023-10-05T21:15:11.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.400+0000 7fab641ca680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.400+0000 7fab4f7fe700 1 --2- 172.21.15.153:0/235804841 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fab38034140 0x7fab380365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.400+0000 7fab4f7fe700 1 -- 172.21.15.153:0/235804841 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fab48048cd0 con 0x55889eca1290 2023-10-05T21:15:11.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.400+0000 7fab56aa1700 1 --2- 172.21.15.153:0/235804841 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fab38034140 0x7fab380365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.400+0000 7fab641ca680 1 --2- 172.21.15.153:0/235804841 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55889eca57c0 0x55889ecd6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.401+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecd71e0 con 0x55889eca57c0 2023-10-05T21:15:11.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.401+0000 7fab57aa3700 1 --2- 172.21.15.153:0/235804841 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55889eca57c0 0x55889ecd6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.401+0000 7fab56aa1700 1 --2- 172.21.15.153:0/235804841 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fab38034140 0x7fab380365f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fab4000a6a0 tx=0x7fab40015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.401+0000 7fab57aa3700 1 --2- 172.21.15.153:0/235804841 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55889eca57c0 0x55889ecd6a50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.401+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.401+0000 7fab641ca680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.401+0000 7fab641ca680 20 realm 2023-10-05T21:15:11.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.401+0000 7fab641ca680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.401+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecd4070 con 0x55889eca57c0 2023-10-05T21:15:11.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.402+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.402+0000 7fab641ca680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.402+0000 7fab641ca680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:11.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.402+0000 7fab641ca680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.402+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecd7ce0 con 0x55889eca57c0 2023-10-05T21:15:11.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.402+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.402+0000 7fab641ca680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.402+0000 7fab641ca680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.402+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecd8600 con 0x55889eca57c0 2023-10-05T21:15:11.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.402+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.402+0000 7fab641ca680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:11.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.402+0000 7fab641ca680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.402+0000 7fab641ca680 1 --2- 172.21.15.153:0/235804841 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55889ecd8ec0 0x55889ecdb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.402+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdb870 con 0x55889ecd8ec0 2023-10-05T21:15:11.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.402+0000 7fab572a2700 1 --2- 172.21.15.153:0/235804841 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55889ecd8ec0 0x55889ecdb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.403+0000 7fab572a2700 1 --2- 172.21.15.153:0/235804841 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55889ecd8ec0 0x55889ecdb2a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.403+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.403+0000 7fab641ca680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:11.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.403+0000 7fab641ca680 20 searching for the correct realm 2023-10-05T21:15:11.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.403+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x55889ecd8ec0 2023-10-05T21:15:11.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.403+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.403+0000 7fab572a2700 1 --2- 172.21.15.153:0/235804841 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fab48048040 0x7fab4802d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.403+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x7fab48048040 2023-10-05T21:15:11.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.403+0000 7fab56aa1700 1 --2- 172.21.15.153:0/235804841 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fab48048040 0x7fab4802d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.404+0000 7fab56aa1700 1 --2- 172.21.15.153:0/235804841 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fab48048040 0x7fab4802d3f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.404+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab40020040 con 0x7fab48048040 2023-10-05T21:15:11.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.404+0000 7fab56aa1700 1 --2- 172.21.15.153:0/235804841 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fab40007040 0x7fab4001f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.404+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x7fab40007040 2023-10-05T21:15:11.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.404+0000 7fab57aa3700 1 --2- 172.21.15.153:0/235804841 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fab40007040 0x7fab4001f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.405+0000 7fab57aa3700 1 --2- 172.21.15.153:0/235804841 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fab40007040 0x7fab4001f980 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.405+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.405+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x55889eca57c0 2023-10-05T21:15:11.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.405+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.405+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x55889eca57c0 2023-10-05T21:15:11.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.406+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.406+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x7fab40007040 2023-10-05T21:15:11.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.406+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.406+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x7fab40007040 2023-10-05T21:15:11.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.406+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.406+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x7fab48048040 2023-10-05T21:15:11.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.406+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab40029040 con 0x7fab48048040 2023-10-05T21:15:11.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.407+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x55889ecd8ec0 2023-10-05T21:15:11.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.407+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.407+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x55889eca57c0 2023-10-05T21:15:11.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.407+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.407+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x7fab40007040 2023-10-05T21:15:11.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.407+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.408+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x55889eca57c0 2023-10-05T21:15:11.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.408+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.408+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x7fab48048040 2023-10-05T21:15:11.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.408+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab40029040 con 0x7fab48048040 2023-10-05T21:15:11.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.408+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x55889ecd8ec0 2023-10-05T21:15:11.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.408+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.408+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x55889ecd8ec0 2023-10-05T21:15:11.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.408+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.408+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x7fab40007040 2023-10-05T21:15:11.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.409+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.409+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x55889ecd8ec0 2023-10-05T21:15:11.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.409+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.409+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x55889ecd8ec0 2023-10-05T21:15:11.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.410+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.410+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x55889eca57c0 2023-10-05T21:15:11.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.410+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.410+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x55889eca57c0 2023-10-05T21:15:11.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.410+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.410+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x7fab40007040 2023-10-05T21:15:11.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.411+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.411+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x55889ecd8ec0 2023-10-05T21:15:11.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.411+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.411+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x7fab48048040 2023-10-05T21:15:11.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.411+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab40029040 con 0x7fab48048040 2023-10-05T21:15:11.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.411+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x55889eca57c0 2023-10-05T21:15:11.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.411+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.411+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x7fab40007040 2023-10-05T21:15:11.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.412+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.412+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x55889ecd8ec0 2023-10-05T21:15:11.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.412+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.412+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x7fab40007040 2023-10-05T21:15:11.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.412+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.413+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x7fab48048040 2023-10-05T21:15:11.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.413+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab40029040 con 0x7fab48048040 2023-10-05T21:15:11.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.413+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x55889ecd8ec0 2023-10-05T21:15:11.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.413+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.413+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x7fab40007040 2023-10-05T21:15:11.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.413+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.413+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x55889eca57c0 2023-10-05T21:15:11.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.414+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.414+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd190 con 0x7fab48048040 2023-10-05T21:15:11.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.414+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab40029040 con 0x7fab48048040 2023-10-05T21:15:11.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.414+0000 7fab641ca680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:11.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.414+0000 7fab641ca680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:11.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.414+0000 7fab641ca680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:11.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.414+0000 7fab641ca680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:11.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.414+0000 7fab641ca680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.414+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdc300 con 0x55889eca57c0 2023-10-05T21:15:11.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.414+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.414+0000 7fab641ca680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.414+0000 7fab641ca680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.414+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdbf00 con 0x55889eca57c0 2023-10-05T21:15:11.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.414+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.414+0000 7fab641ca680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:11.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.414+0000 7fab641ca680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.414+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdcc40 con 0x55889eca57c0 2023-10-05T21:15:11.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.415+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.415+0000 7fab641ca680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:11.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.415+0000 7fab641ca680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.415+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdda30 con 0x55889ecd8ec0 2023-10-05T21:15:11.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.415+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.415+0000 7fab641ca680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.415+0000 7fab641ca680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.415+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x55889eca57c0 2023-10-05T21:15:11.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.415+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.415+0000 7fab641ca680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.415+0000 7fab641ca680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.415+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x55889eca57c0 2023-10-05T21:15:11.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.415+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.415+0000 7fab641ca680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:11.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.415+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdedf0 con 0x55889ecd8ec0 2023-10-05T21:15:11.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.416+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.416+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdedf0 con 0x7fab48048040 2023-10-05T21:15:11.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.416+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab40029040 con 0x7fab48048040 2023-10-05T21:15:11.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.416+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdedf0 con 0x7fab40007040 2023-10-05T21:15:11.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.416+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.416+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdcc40 con 0x55889eca57c0 2023-10-05T21:15:11.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.416+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.416+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdcc40 con 0x55889eca57c0 2023-10-05T21:15:11.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.417+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.417+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdcc40 con 0x7fab40007040 2023-10-05T21:15:11.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.417+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.417+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdcc40 con 0x7fab40007040 2023-10-05T21:15:11.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.417+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.417+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdcc40 con 0x7fab48048040 2023-10-05T21:15:11.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.418+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab40029040 con 0x7fab48048040 2023-10-05T21:15:11.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.418+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdcc40 con 0x55889ecd8ec0 2023-10-05T21:15:11.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.418+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.418+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdcc40 con 0x55889eca57c0 2023-10-05T21:15:11.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.418+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.418+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdcc40 con 0x7fab40007040 2023-10-05T21:15:11.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.418+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.418+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdcc40 con 0x55889eca57c0 2023-10-05T21:15:11.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.419+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.419+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdcc40 con 0x7fab48048040 2023-10-05T21:15:11.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.419+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab40029040 con 0x7fab48048040 2023-10-05T21:15:11.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.419+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdcc40 con 0x55889ecd8ec0 2023-10-05T21:15:11.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.419+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.419+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdcc40 con 0x55889ecd8ec0 2023-10-05T21:15:11.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.419+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.419+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdcc40 con 0x7fab40007040 2023-10-05T21:15:11.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.420+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.420+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdcc40 con 0x55889ecd8ec0 2023-10-05T21:15:11.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.420+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.420+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdcc40 con 0x55889ecd8ec0 2023-10-05T21:15:11.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.420+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.420+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdcc40 con 0x55889eca57c0 2023-10-05T21:15:11.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.421+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.421+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdcc40 con 0x55889eca57c0 2023-10-05T21:15:11.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.421+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.421+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdcc40 con 0x7fab40007040 2023-10-05T21:15:11.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.421+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.421+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdcc40 con 0x55889ecd8ec0 2023-10-05T21:15:11.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.421+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.421+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdcc40 con 0x7fab48048040 2023-10-05T21:15:11.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.422+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab40029040 con 0x7fab48048040 2023-10-05T21:15:11.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.422+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdcc40 con 0x55889eca57c0 2023-10-05T21:15:11.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.422+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.422+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdcc40 con 0x7fab40007040 2023-10-05T21:15:11.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.422+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.422+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdcc40 con 0x55889ecd8ec0 2023-10-05T21:15:11.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.423+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.423+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdcc40 con 0x7fab40007040 2023-10-05T21:15:11.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.423+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.423+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdcc40 con 0x7fab48048040 2023-10-05T21:15:11.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.423+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab40029040 con 0x7fab48048040 2023-10-05T21:15:11.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.423+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdcc40 con 0x55889ecd8ec0 2023-10-05T21:15:11.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.423+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.423+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdcc40 con 0x7fab40007040 2023-10-05T21:15:11.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.424+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.424+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdcc40 con 0x55889eca57c0 2023-10-05T21:15:11.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.424+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.424+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdcc40 con 0x7fab48048040 2023-10-05T21:15:11.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.424+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab40029040 con 0x7fab48048040 2023-10-05T21:15:11.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.424+0000 7fab641ca680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:11.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.424+0000 7fab641ca680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:11.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.424+0000 7fab641ca680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:11.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.424+0000 7fab641ca680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:11.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.424+0000 7fab641ca680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.424+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x55889eca57c0 2023-10-05T21:15:11.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.424+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.424+0000 7fab641ca680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:11.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.424+0000 7fab641ca680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.424+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecde190 con 0x55889ecd8ec0 2023-10-05T21:15:11.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.425+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.425+0000 7fab641ca680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:11.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.425+0000 7fab641ca680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.425+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd5d0 con 0x55889eca57c0 2023-10-05T21:15:11.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.425+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.425+0000 7fab641ca680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:11.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.425+0000 7fab641ca680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.425+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdd5d0 con 0x55889eca57c0 2023-10-05T21:15:11.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.425+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.425+0000 7fab641ca680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:11.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.425+0000 7fab641ca680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.425+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdea30 con 0x7fab40007040 2023-10-05T21:15:11.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.426+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.426+0000 7fab641ca680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.426+0000 7fab641ca680 20 zone default found 2023-10-05T21:15:11.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.426+0000 7fab641ca680 4 Realm: () 2023-10-05T21:15:11.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.426+0000 7fab641ca680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:11.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.426+0000 7fab641ca680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:11.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.426+0000 7fab641ca680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:11.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.426+0000 7fab641ca680 20 zonegroup default 2023-10-05T21:15:11.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.426+0000 7fab641ca680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.426+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdea30 con 0x7fab40007040 2023-10-05T21:15:11.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.426+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.426+0000 7fab641ca680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.426+0000 7fab641ca680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.426+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ece03b0 con 0x55889ecd8ec0 2023-10-05T21:15:11.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.426+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.426+0000 7fab641ca680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.426+0000 7fab641ca680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.426+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ece0760 con 0x55889ecd8ec0 2023-10-05T21:15:11.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.426+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.426+0000 7fab641ca680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.426+0000 7fab641ca680 20 started sync module instance, tier type = 2023-10-05T21:15:11.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.426+0000 7fab641ca680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:11.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.427+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecdfa70 con 0x7fab48048040 2023-10-05T21:15:11.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.427+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab40029040 con 0x7fab48048040 2023-10-05T21:15:11.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.427+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94045268213360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ece1000 con 0x7fab48048040 2023-10-05T21:15:11.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.427+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ece18a0 con 0x55889eca57c0 2023-10-05T21:15:11.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.428+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94045268213360] v29'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab40029040 con 0x7fab48048040 2023-10-05T21:15:11.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.428+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.428+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94045268216592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ece18a0 con 0x55889eca57c0 2023-10-05T21:15:11.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.428+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ece2400 con 0x55889ecd8ec0 2023-10-05T21:15:11.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.429+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.429+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94045268216592] v29'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.429+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94045268218800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ece1800 con 0x55889ecd8ec0 2023-10-05T21:15:11.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.429+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ece31e0 con 0x7fab48048040 2023-10-05T21:15:11.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.430+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94045268218800] v29'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.430+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab40029040 con 0x7fab48048040 2023-10-05T21:15:11.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.430+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94045268224288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ece2df0 con 0x7fab48048040 2023-10-05T21:15:11.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.430+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ece42e0 con 0x55889eca57c0 2023-10-05T21:15:11.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.431+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.431+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94045268224288] v29'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab40029040 con 0x7fab48048040 2023-10-05T21:15:11.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.431+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94045268229552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ece4bd0 con 0x55889eca57c0 2023-10-05T21:15:11.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.431+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ece51a0 con 0x7fab40007040 2023-10-05T21:15:11.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.432+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94045268229552] v29'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.432+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.432+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94045268231776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ece4ab0 con 0x7fab40007040 2023-10-05T21:15:11.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.432+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ece5ba0 con 0x7fab40007040 2023-10-05T21:15:11.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.433+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(96 notify.6 [create] v29'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.433+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(95 notify.5 [watch watch cookie 94045268231776] v29'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.433+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94045268235920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ece5ba0 con 0x7fab40007040 2023-10-05T21:15:11.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.433+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ece5ba0 con 0x7fab40007040 2023-10-05T21:15:11.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.433+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94045268235920] v29'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.433+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.433+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94045268234656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ece6600 con 0x7fab40007040 2023-10-05T21:15:11.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.433+0000 7fab641ca680 20 add_watcher() i=0 2023-10-05T21:15:11.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.433+0000 7fab641ca680 20 add_watcher() i=1 2023-10-05T21:15:11.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.433+0000 7fab641ca680 20 add_watcher() i=2 2023-10-05T21:15:11.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.433+0000 7fab641ca680 20 add_watcher() i=3 2023-10-05T21:15:11.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.433+0000 7fab641ca680 20 add_watcher() i=4 2023-10-05T21:15:11.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.433+0000 7fab641ca680 20 add_watcher() i=5 2023-10-05T21:15:11.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.433+0000 7fab641ca680 20 add_watcher() i=6 2023-10-05T21:15:11.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.434+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94045268234656] v29'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.434+0000 7fab641ca680 20 add_watcher() i=7 2023-10-05T21:15:11.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.434+0000 7fab641ca680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:11.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.434+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ece9a40 con 0x55889eca57c0 2023-10-05T21:15:11.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.435+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.435+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94045268239072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ece6f00 con 0x55889eca57c0 2023-10-05T21:15:11.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.435+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94045268239072] v29'24 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.435+0000 7fab28fe1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:11.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.435+0000 7fab641ca680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:11.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.435+0000 7fab641ca680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:11.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.436+0000 7fab641ca680 1 Processor -- start 2023-10-05T21:15:11.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.436+0000 7fab641ca680 1 -- start start 2023-10-05T21:15:11.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.436+0000 7fab641ca680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889ecf4400 0x55889ecf4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.436+0000 7fab641ca680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55889ecf4de0 con 0x55889ecf4400 2023-10-05T21:15:11.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.436+0000 7fab56aa1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889ecf4400 0x55889ecf4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.436+0000 7fab56aa1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889ecf4400 0x55889ecf4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:48990/0 (socket says 172.21.15.153:48990) 2023-10-05T21:15:11.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.436+0000 7fab56aa1700 1 -- 172.21.15.153:0/602324226 learned_addr learned my addr 172.21.15.153:0/602324226 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:11.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.436+0000 7fab56aa1700 1 -- 172.21.15.153:0/602324226 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55889ecf4f20 con 0x55889ecf4400 2023-10-05T21:15:11.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.437+0000 7fab56aa1700 1 --2- 172.21.15.153:0/602324226 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889ecf4400 0x55889ecf4810 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x55889eca1f60 tx=0x7fab40011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b60b0bf7c654259c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.437+0000 7faaa3fff700 1 -- 172.21.15.153:0/602324226 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab40025040 con 0x55889ecf4400 2023-10-05T21:15:11.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.437+0000 7faaa3fff700 1 -- 172.21.15.153:0/602324226 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab40033040 con 0x55889ecf4400 2023-10-05T21:15:11.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.437+0000 7faaa3fff700 1 -- 172.21.15.153:0/602324226 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab4002d450 con 0x55889ecf4400 2023-10-05T21:15:11.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.437+0000 7fab641ca680 1 -- 172.21.15.153:0/602324226 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889ecf4400 msgr2=0x55889ecf4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.437+0000 7fab641ca680 1 --2- 172.21.15.153:0/602324226 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889ecf4400 0x55889ecf4810 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x55889eca1f60 tx=0x7fab40011000 comp rx=0 tx=0).stop 2023-10-05T21:15:11.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.438+0000 7fab641ca680 1 -- 172.21.15.153:0/602324226 shutdown_connections 2023-10-05T21:15:11.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.438+0000 7fab641ca680 1 --2- 172.21.15.153:0/602324226 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889ecf4400 0x55889ecf4810 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.438+0000 7fab641ca680 1 -- 172.21.15.153:0/602324226 >> 172.21.15.153:0/602324226 conn(0x55889ecef600 msgr2=0x55889eced760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:11.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.438+0000 7fab641ca680 1 -- 172.21.15.153:0/602324226 shutdown_connections 2023-10-05T21:15:11.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.438+0000 7fab641ca680 1 -- 172.21.15.153:0/602324226 wait complete. 2023-10-05T21:15:11.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.438+0000 7fab641ca680 1 Processor -- start 2023-10-05T21:15:11.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.438+0000 7fab641ca680 1 -- start start 2023-10-05T21:15:11.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.438+0000 7fab641ca680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889ecf4400 0x55889ecf9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.438+0000 7fab641ca680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55889ecfa410 con 0x55889ecf4400 2023-10-05T21:15:11.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.439+0000 7fab56aa1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889ecf4400 0x55889ecf9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.439+0000 7fab56aa1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889ecf4400 0x55889ecf9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:48992/0 (socket says 172.21.15.153:48992) 2023-10-05T21:15:11.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.439+0000 7fab56aa1700 1 -- 172.21.15.153:0/2399894444 learned_addr learned my addr 172.21.15.153:0/2399894444 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:11.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.439+0000 7fab56aa1700 1 -- 172.21.15.153:0/2399894444 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55889eca90f0 con 0x55889ecf4400 2023-10-05T21:15:11.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.439+0000 7fab56aa1700 1 --2- 172.21.15.153:0/2399894444 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889ecf4400 0x55889ecf9ed0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fab40039040 tx=0x7fab4002f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.439+0000 7faaa27fc700 1 -- 172.21.15.153:0/2399894444 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab40025040 con 0x55889ecf4400 2023-10-05T21:15:11.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.439+0000 7faaa27fc700 1 -- 172.21.15.153:0/2399894444 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab40008900 con 0x55889ecf4400 2023-10-05T21:15:11.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.439+0000 7faaa27fc700 1 -- 172.21.15.153:0/2399894444 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab40008c10 con 0x55889ecf4400 2023-10-05T21:15:11.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.439+0000 7fab641ca680 1 -- 172.21.15.153:0/2399894444 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55889ecfa610 con 0x55889ecf4400 2023-10-05T21:15:11.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.439+0000 7fab641ca680 1 -- 172.21.15.153:0/2399894444 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55889ecfaac0 con 0x55889ecf4400 2023-10-05T21:15:11.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.440+0000 7faaa27fc700 1 -- 172.21.15.153:0/2399894444 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fab40041400 con 0x55889ecf4400 2023-10-05T21:15:11.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.440+0000 7faaa27fc700 1 --2- 172.21.15.153:0/2399894444 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7faa98034140 0x7faa980365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.440+0000 7faaa27fc700 1 -- 172.21.15.153:0/2399894444 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fab4004cad0 con 0x55889ecf4400 2023-10-05T21:15:11.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.440+0000 7fab57aa3700 1 --2- 172.21.15.153:0/2399894444 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7faa98034140 0x7faa980365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.440+0000 7fab641ca680 5 note: GC not initialized 2023-10-05T21:15:11.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.441+0000 7fab57aa3700 1 --2- 172.21.15.153:0/2399894444 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7faa98034140 0x7faa980365f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x55889ece67a0 tx=0x7fab50036440 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.441+0000 7faa977fe700 20 reqs_thread_entry: start 2023-10-05T21:15:11.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.442+0000 7faa957fa700 20 reqs_thread_entry: start 2023-10-05T21:15:11.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.442+0000 7fab641ca680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:11.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.442+0000 7fab641ca680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:11.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.442+0000 7faa837fe700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:41 2023 2023-10-05T21:15:11.475 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:11.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.442+0000 7faa82ffd700 20 reqs_thread_entry: start 2023-10-05T21:15:11.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.442+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:102 8.0 8:00000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ed5f1f0 con 0x55889ecd8ec0 2023-10-05T21:15:11.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.442+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(102 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.442+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:103 8.10 8:08000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ece1800 con 0x55889ecd8ec0 2023-10-05T21:15:11.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.443+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(103 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.443+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:104 8.8 8:10000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ece1800 con 0x55889eca57c0 2023-10-05T21:15:11.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.443+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(104 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.443+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:105 8.18 8:18000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x55889eca57c0 2023-10-05T21:15:11.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.443+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(105 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.443+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:106 8.4 8:20000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x7fab48048040 2023-10-05T21:15:11.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.444+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(106 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab40048070 con 0x7fab48048040 2023-10-05T21:15:11.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.444+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 8.14 8:28000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x55889ecd8ec0 2023-10-05T21:15:11.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.444+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(107 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.444+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:108 8.c 8:30000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x55889eca57c0 2023-10-05T21:15:11.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.444+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(108 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.444+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:109 8.1c 8:38000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x55889ecd8ec0 2023-10-05T21:15:11.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.444+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== osd_op_reply(109 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.444+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:110 8.2 8:40000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x7fab48048040 2023-10-05T21:15:11.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.445+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(110 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab40048070 con 0x7fab48048040 2023-10-05T21:15:11.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.445+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:111 8.12 8:48000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x55889ecd8ec0 2023-10-05T21:15:11.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.445+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(111 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.445+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:112 8.a 8:50000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x55889eca57c0 2023-10-05T21:15:11.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.445+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(112 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.445+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:113 8.1a 8:58000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x7fab40007040 2023-10-05T21:15:11.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.446+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(113 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.446+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:114 8.6 8:60000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x7fab40007040 2023-10-05T21:15:11.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.446+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(114 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.446+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:115 8.16 8:68000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x55889ecd8ec0 2023-10-05T21:15:11.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.446+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 31 ==== osd_op_reply(115 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.446+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:116 8.e 8:70000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x7fab40007040 2023-10-05T21:15:11.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.446+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(116 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.446+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:117 8.1e 8:78000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x7fab40007040 2023-10-05T21:15:11.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.447+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(117 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.447+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:118 8.1 8:80000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x7fab40007040 2023-10-05T21:15:11.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.447+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 31 ==== osd_op_reply(118 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.447+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:119 8.11 8:88000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x55889ecd8ec0 2023-10-05T21:15:11.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.447+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 32 ==== osd_op_reply(119 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.447+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:120 8.9 8:90000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x7fab48048040 2023-10-05T21:15:11.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.447+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(120 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab40048070 con 0x7fab48048040 2023-10-05T21:15:11.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.447+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:121 8.19 8:98000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x55889eca57c0 2023-10-05T21:15:11.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.448+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(121 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.448+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:122 8.5 8:a0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x55889eca57c0 2023-10-05T21:15:11.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.448+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(122 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.448+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:123 8.15 8:a8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x55889ecd8ec0 2023-10-05T21:15:11.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.448+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 33 ==== osd_op_reply(123 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.448+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:124 8.d 8:b0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x7fab48048040 2023-10-05T21:15:11.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.448+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(124 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab40048070 con 0x7fab48048040 2023-10-05T21:15:11.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.448+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:125 8.1d 8:b8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x7fab40007040 2023-10-05T21:15:11.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.449+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 32 ==== osd_op_reply(125 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.449+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:126 8.3 8:c0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x55889eca57c0 2023-10-05T21:15:11.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.449+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== osd_op_reply(126 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.449+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:127 8.13 8:c8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x7fab40007040 2023-10-05T21:15:11.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.449+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 33 ==== osd_op_reply(127 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.449+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:128 8.b 8:d0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x55889ecd8ec0 2023-10-05T21:15:11.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.449+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 34 ==== osd_op_reply(128 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.449+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:129 8.1b 8:d8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x7fab48048040 2023-10-05T21:15:11.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.450+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== osd_op_reply(129 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab40048070 con 0x7fab48048040 2023-10-05T21:15:11.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.450+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:130 8.7 8:e0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x7fab40007040 2023-10-05T21:15:11.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.450+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 34 ==== osd_op_reply(130 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.450+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:131 8.17 8:e8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x55889eca57c0 2023-10-05T21:15:11.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.450+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 42 ==== osd_op_reply(131 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.450+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:132 8.f 8:f0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x55889ecd8ec0 2023-10-05T21:15:11.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.450+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 35 ==== osd_op_reply(132 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.450+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:133 8.1f 8:f8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ecddde0 con 0x7fab48048040 2023-10-05T21:15:11.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.451+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 <== osd.2 v2:172.21.15.153:6807/140454 22 ==== osd_op_reply(133 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fab40048070 con 0x7fab48048040 2023-10-05T21:15:11.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.451+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:134 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94045268213360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ece1800 con 0x7fab48048040 2023-10-05T21:15:11.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.452+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 <== osd.2 v2:172.21.15.153:6807/140454 23 ==== osd_op_reply(134 notify.0 [watch unwatch cookie 94045268213360] v29'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab40048070 con 0x7fab48048040 2023-10-05T21:15:11.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.452+0000 7fab641ca680 20 remove_watcher() i=0 2023-10-05T21:15:11.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.452+0000 7fab641ca680 2 removed watcher, disabling cache 2023-10-05T21:15:11.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.452+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:135 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94045268216592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ece1800 con 0x55889eca57c0 2023-10-05T21:15:11.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.452+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 43 ==== osd_op_reply(135 notify.1 [watch unwatch cookie 94045268216592] v29'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.452+0000 7fab641ca680 20 remove_watcher() i=1 2023-10-05T21:15:11.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.452+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:136 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94045268218800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ece0b10 con 0x55889ecd8ec0 2023-10-05T21:15:11.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.453+0000 7fab572a2700 1 -- 172.21.15.153:0/235804841 <== osd.3 v2:172.21.15.153:6800/140455 36 ==== osd_op_reply(136 notify.2 [watch unwatch cookie 94045268218800] v29'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab48042db0 con 0x55889ecd8ec0 2023-10-05T21:15:11.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.453+0000 7fab641ca680 20 remove_watcher() i=2 2023-10-05T21:15:11.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.453+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94045268224288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ece13b0 con 0x7fab48048040 2023-10-05T21:15:11.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.454+0000 7fab56aa1700 1 -- 172.21.15.153:0/235804841 <== osd.2 v2:172.21.15.153:6807/140454 24 ==== osd_op_reply(137 notify.3 [watch unwatch cookie 94045268224288] v29'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab40048070 con 0x7fab48048040 2023-10-05T21:15:11.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.454+0000 7fab641ca680 20 remove_watcher() i=3 2023-10-05T21:15:11.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.454+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:138 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94045268229552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ece2920 con 0x55889eca57c0 2023-10-05T21:15:11.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.455+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 44 ==== osd_op_reply(138 notify.4 [watch unwatch cookie 94045268229552] v29'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.455+0000 7fab641ca680 20 remove_watcher() i=4 2023-10-05T21:15:11.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.455+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:139 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94045268231776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ece3db0 con 0x7fab40007040 2023-10-05T21:15:11.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.456+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 35 ==== osd_op_reply(139 notify.5 [watch unwatch cookie 94045268231776] v29'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.456+0000 7fab641ca680 20 remove_watcher() i=5 2023-10-05T21:15:11.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.456+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:140 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94045268235920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ece2920 con 0x7fab40007040 2023-10-05T21:15:11.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.457+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 36 ==== osd_op_reply(140 notify.6 [watch unwatch cookie 94045268235920] v29'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.457+0000 7fab641ca680 20 remove_watcher() i=6 2023-10-05T21:15:11.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.457+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:141 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94045268234656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ece2920 con 0x7fab40007040 2023-10-05T21:15:11.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.457+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.0 v2:172.21.15.111:6800/111394 37 ==== osd_op_reply(141 notify.7 [watch unwatch cookie 94045268234656] v29'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fab5000a570 con 0x7fab40007040 2023-10-05T21:15:11.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.457+0000 7fab641ca680 20 remove_watcher() i=7 2023-10-05T21:15:11.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.458+0000 7fab28fe1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:11.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.458+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:142 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94045268239072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55889ece2920 con 0x55889eca57c0 2023-10-05T21:15:11.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.459+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 <== osd.1 v2:172.21.15.153:6816/140456 45 ==== osd_op_reply(142 data_loggenerations_metadata [watch unwatch cookie 94045268239072] v29'25 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fab5000a570 con 0x55889eca57c0 2023-10-05T21:15:11.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.459+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fab40007040 msgr2=0x7fab4001f980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.459+0000 7fab641ca680 1 --2- 172.21.15.153:0/235804841 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fab40007040 0x7fab4001f980 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.459+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55889eca57c0 msgr2=0x55889ecd6a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.459+0000 7fab641ca680 1 --2- 172.21.15.153:0/235804841 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55889eca57c0 0x55889ecd6a50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.459+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fab48048040 msgr2=0x7fab4802d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.459+0000 7fab641ca680 1 --2- 172.21.15.153:0/235804841 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fab48048040 0x7fab4802d3f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.459+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55889ecd8ec0 msgr2=0x55889ecdb2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.459+0000 7fab641ca680 1 --2- 172.21.15.153:0/235804841 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55889ecd8ec0 0x55889ecdb2a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.459+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fab38034140 msgr2=0x7fab380365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.459+0000 7fab641ca680 1 --2- 172.21.15.153:0/235804841 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fab38034140 0x7fab380365f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fab4000a6a0 tx=0x7fab40015000 comp rx=0 tx=0).stop 2023-10-05T21:15:11.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.459+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889eca1290 msgr2=0x55889eccad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.459+0000 7fab641ca680 1 --2- 172.21.15.153:0/235804841 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889eca1290 0x55889eccad30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fab48010000 tx=0x7fab48016000 comp rx=0 tx=0).stop 2023-10-05T21:15:11.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.459+0000 7fab57aa3700 1 -- 172.21.15.153:0/235804841 reap_dead start 2023-10-05T21:15:11.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.459+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 shutdown_connections 2023-10-05T21:15:11.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.459+0000 7fab641ca680 1 --2- 172.21.15.153:0/235804841 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889eca1290 0x55889eccad30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.459+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 >> 172.21.15.153:0/235804841 conn(0x55889ec9cb60 msgr2=0x55889ecb9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:11.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.459+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 shutdown_connections 2023-10-05T21:15:11.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.459+0000 7fab641ca680 1 -- 172.21.15.153:0/235804841 wait complete. 2023-10-05T21:15:11.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.459+0000 7fab641ca680 1 -- 172.21.15.153:0/2399894444 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7faa98034140 msgr2=0x7faa980365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.460+0000 7fab641ca680 1 --2- 172.21.15.153:0/2399894444 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7faa98034140 0x7faa980365f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x55889ece67a0 tx=0x7fab50036440 comp rx=0 tx=0).stop 2023-10-05T21:15:11.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.460+0000 7fab641ca680 1 -- 172.21.15.153:0/2399894444 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889ecf4400 msgr2=0x55889ecf9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.460+0000 7fab641ca680 1 --2- 172.21.15.153:0/2399894444 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889ecf4400 0x55889ecf9ed0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fab40039040 tx=0x7fab4002f000 comp rx=0 tx=0).stop 2023-10-05T21:15:11.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.460+0000 7fab641ca680 1 -- 172.21.15.153:0/2399894444 shutdown_connections 2023-10-05T21:15:11.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.460+0000 7fab641ca680 1 --2- 172.21.15.153:0/2399894444 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7faa98034140 0x7faa980365f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.460+0000 7fab641ca680 1 --2- 172.21.15.153:0/2399894444 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55889ecf4400 0x55889ecf9ed0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.460+0000 7fab641ca680 1 -- 172.21.15.153:0/2399894444 >> 172.21.15.153:0/2399894444 conn(0x55889ecef600 msgr2=0x55889eced730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:11.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.460+0000 7fab641ca680 1 -- 172.21.15.153:0/2399894444 shutdown_connections 2023-10-05T21:15:11.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.460+0000 7fab641ca680 1 -- 172.21.15.153:0/2399894444 wait complete. 2023-10-05T21:15:11.487 INFO:teuthology.orchestra.run.smithi153.stdout:[] 2023-10-05T21:15:11.488 DEBUG:tasks.util.rgw: json result: [] 2023-10-05T21:15:11.488 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2023-10-05T21:15:11.488 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2023-10-05T21:15:11.488 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2023-10-05T21:15:11.533 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:11.533 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:11.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.532+0000 7fc80cea5680 1 Processor -- start 2023-10-05T21:15:11.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.532+0000 7fc80cea5680 1 -- start start 2023-10-05T21:15:11.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.532+0000 7fc80cea5680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5568eb6220a0 0x5568eb6b3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.532+0000 7fc80cea5680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5568eb5fb990 con 0x5568eb6b39d0 2023-10-05T21:15:11.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.532+0000 7fc80cea5680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x5568eb5bbdb0 con 0x5568eb6220a0 2023-10-05T21:15:11.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.533+0000 7fc7fff7d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5568eb6220a0 0x5568eb6b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.533+0000 7fc7fff7d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5568eb6220a0 0x5568eb6b3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:48998/0 (socket says 172.21.15.153:48998) 2023-10-05T21:15:11.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.533+0000 7fc7ff77c700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x5568eb6b39d0 0x5568eb6b5db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56126/0 (socket says 172.21.15.153:56126) 2023-10-05T21:15:11.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.533+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1476933058 learned_addr learned my addr 172.21.15.153:0/1476933058 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:11.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.533+0000 7fc7fef7b700 1 -- 172.21.15.153:0/1476933058 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3932181543 0 0) 0x5568eb5fb990 con 0x5568eb6b39d0 2023-10-05T21:15:11.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.533+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1476933058 >> v1:172.21.15.111:6789/0 conn(0x5568eb6b39d0 legacy=0x5568eb6b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.533+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1476933058 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568eb6b84e0 con 0x5568eb6220a0 2023-10-05T21:15:11.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.533+0000 7fc7fff7d700 1 --2- 172.21.15.153:0/1476933058 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5568eb6220a0 0x5568eb6b3490 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc7f400a650 tx=0x7fc7f4005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1919b85ceac73d48 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.533+0000 7fc7fef7b700 1 -- 172.21.15.153:0/1476933058 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc7f4008760 con 0x5568eb6220a0 2023-10-05T21:15:11.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.533+0000 7fc7fef7b700 1 -- 172.21.15.153:0/1476933058 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f40088c0 con 0x5568eb6220a0 2023-10-05T21:15:11.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.533+0000 7fc7fef7b700 1 -- 172.21.15.153:0/1476933058 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc7f4008bb0 con 0x5568eb6220a0 2023-10-05T21:15:11.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.534+0000 7fc80cea5680 1 -- 172.21.15.153:0/1476933058 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5568eb6220a0 msgr2=0x5568eb6b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.534+0000 7fc80cea5680 1 --2- 172.21.15.153:0/1476933058 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5568eb6220a0 0x5568eb6b3490 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc7f400a650 tx=0x7fc7f4005b10 comp rx=0 tx=0).stop 2023-10-05T21:15:11.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.534+0000 7fc80cea5680 1 -- 172.21.15.153:0/1476933058 shutdown_connections 2023-10-05T21:15:11.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.534+0000 7fc80cea5680 1 --2- 172.21.15.153:0/1476933058 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5568eb6220a0 0x5568eb6b3490 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.534+0000 7fc80cea5680 1 -- 172.21.15.153:0/1476933058 >> 172.21.15.153:0/1476933058 conn(0x5568eb6a8b80 msgr2=0x5568eb6aaf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:11.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.534+0000 7fc80cea5680 1 -- 172.21.15.153:0/1476933058 shutdown_connections 2023-10-05T21:15:11.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.534+0000 7fc80cea5680 1 -- 172.21.15.153:0/1476933058 wait complete. 2023-10-05T21:15:11.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.534+0000 7fc80cea5680 1 Processor -- start 2023-10-05T21:15:11.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.535+0000 7fc80cea5680 1 -- start start 2023-10-05T21:15:11.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.535+0000 7fc80cea5680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5568eb6220a0 0x5568eb6cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.535+0000 7fc80cea5680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568eb55bea0 con 0x5568eb6220a0 2023-10-05T21:15:11.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.535+0000 7fc7fff7d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5568eb6220a0 0x5568eb6cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.535+0000 7fc7fff7d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5568eb6220a0 0x5568eb6cf940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49012/0 (socket says 172.21.15.153:49012) 2023-10-05T21:15:11.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.535+0000 7fc7fff7d700 1 -- 172.21.15.153:0/3376083078 learned_addr learned my addr 172.21.15.153:0/3376083078 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:11.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.535+0000 7fc7fff7d700 1 -- 172.21.15.153:0/3376083078 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f4005db0 con 0x5568eb6220a0 2023-10-05T21:15:11.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.535+0000 7fc7fff7d700 1 --2- 172.21.15.153:0/3376083078 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5568eb6220a0 0x5568eb6cf940 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc7f400a5a0 tx=0x7fc7f4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c7a079a8d3ed2e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.535+0000 7fc7fdf79700 1 -- 172.21.15.153:0/3376083078 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc7f40055f0 con 0x5568eb6220a0 2023-10-05T21:15:11.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.536+0000 7fc7fdf79700 1 -- 172.21.15.153:0/3376083078 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f4008a30 con 0x5568eb6220a0 2023-10-05T21:15:11.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.536+0000 7fc7fdf79700 1 -- 172.21.15.153:0/3376083078 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc7f4008d00 con 0x5568eb6220a0 2023-10-05T21:15:11.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.536+0000 7fc80cea5680 1 -- 172.21.15.153:0/3376083078 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5568eb6220a0 msgr2=0x5568eb6cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.536+0000 7fc80cea5680 1 --2- 172.21.15.153:0/3376083078 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5568eb6220a0 0x5568eb6cf940 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc7f400a5a0 tx=0x7fc7f4015000 comp rx=0 tx=0).stop 2023-10-05T21:15:11.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.536+0000 7fc80cea5680 1 -- 172.21.15.153:0/3376083078 shutdown_connections 2023-10-05T21:15:11.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.536+0000 7fc80cea5680 1 --2- 172.21.15.153:0/3376083078 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5568eb6220a0 0x5568eb6cf940 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.536+0000 7fc80cea5680 1 -- 172.21.15.153:0/3376083078 >> 172.21.15.153:0/3376083078 conn(0x5568eb6a8b80 msgr2=0x5568eb6cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:11.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.536+0000 7fc80cea5680 1 -- 172.21.15.153:0/3376083078 shutdown_connections 2023-10-05T21:15:11.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.536+0000 7fc80cea5680 1 -- 172.21.15.153:0/3376083078 wait complete. 2023-10-05T21:15:11.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.536+0000 7fc80cea5680 1 Processor -- start 2023-10-05T21:15:11.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.536+0000 7fc80cea5680 1 -- start start 2023-10-05T21:15:11.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.536+0000 7fc80cea5680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5568eb6220a0 0x5568eb6d6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.536+0000 7fc80cea5680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568eb552c80 con 0x5568eb6220a0 2023-10-05T21:15:11.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.537+0000 7fc7fff7d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5568eb6220a0 0x5568eb6d6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.537+0000 7fc7fff7d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5568eb6220a0 0x5568eb6d6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49026/0 (socket says 172.21.15.153:49026) 2023-10-05T21:15:11.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.537+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 learned_addr learned my addr 172.21.15.153:0/1607444043 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:11.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.537+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568eb6b84e0 con 0x5568eb6220a0 2023-10-05T21:15:11.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.537+0000 7fc7fff7d700 1 --2- 172.21.15.153:0/1607444043 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5568eb6220a0 0x5568eb6d6ca0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4020040 tx=0x7fc7f401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.537+0000 7fc7e7fff700 1 -- 172.21.15.153:0/1607444043 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc7f4027850 con 0x5568eb6220a0 2023-10-05T21:15:11.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.537+0000 7fc7e7fff700 1 -- 172.21.15.153:0/1607444043 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f40279d0 con 0x5568eb6220a0 2023-10-05T21:15:11.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.537+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5568eb6d71e0 con 0x5568eb6220a0 2023-10-05T21:15:11.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.537+0000 7fc7e7fff700 1 -- 172.21.15.153:0/1607444043 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc7f4027cc0 con 0x5568eb6220a0 2023-10-05T21:15:11.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.538+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5568eb6d7630 con 0x5568eb6220a0 2023-10-05T21:15:11.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.538+0000 7fc7e7fff700 1 -- 172.21.15.153:0/1607444043 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fc7f402f070 con 0x5568eb6220a0 2023-10-05T21:15:11.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.538+0000 7fc7e7fff700 1 --2- 172.21.15.153:0/1607444043 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc7ec0340f0 0x7fc7ec0365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.538+0000 7fc7e7fff700 1 -- 172.21.15.153:0/1607444043 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fc7f404a200 con 0x5568eb6220a0 2023-10-05T21:15:11.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.538+0000 7fc80cea5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.539+0000 7fc7ff77c700 1 --2- 172.21.15.153:0/1607444043 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc7ec0340f0 0x7fc7ec0365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.539+0000 7fc80cea5680 1 --2- 172.21.15.153:0/1607444043 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5568eb6b39d0 0x5568eb6e2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.539+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e31c0 con 0x5568eb6b39d0 2023-10-05T21:15:11.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.539+0000 7fc80077e700 1 --2- 172.21.15.153:0/1607444043 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5568eb6b39d0 0x5568eb6e2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.539+0000 7fc7ff77c700 1 --2- 172.21.15.153:0/1607444043 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc7ec0340f0 0x7fc7ec0365a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc7f00011e0 tx=0x7fc7f0001460 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.539+0000 7fc80077e700 1 --2- 172.21.15.153:0/1607444043 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5568eb6b39d0 0x5568eb6e2a30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.539+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc7f800a570 con 0x5568eb6b39d0 2023-10-05T21:15:11.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.539+0000 7fc80cea5680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.539+0000 7fc80cea5680 20 realm 2023-10-05T21:15:11.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.539+0000 7fc80cea5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.539+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6dffa0 con 0x5568eb6b39d0 2023-10-05T21:15:11.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.540+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc7f800a570 con 0x5568eb6b39d0 2023-10-05T21:15:11.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.540+0000 7fc80cea5680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.540+0000 7fc80cea5680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:11.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.540+0000 7fc80cea5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.540+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e3cc0 con 0x5568eb6b39d0 2023-10-05T21:15:11.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.540+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc7f800a570 con 0x5568eb6b39d0 2023-10-05T21:15:11.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.540+0000 7fc80cea5680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.540+0000 7fc80cea5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.540+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e45b0 con 0x5568eb6b39d0 2023-10-05T21:15:11.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.540+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc7f800a570 con 0x5568eb6b39d0 2023-10-05T21:15:11.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.540+0000 7fc80cea5680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:11.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.540+0000 7fc80cea5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.540+0000 7fc80cea5680 1 --2- 172.21.15.153:0/1607444043 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5568eb6e4e70 0x5568eb6e7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.540+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e7860 con 0x5568eb6e4e70 2023-10-05T21:15:11.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.540+0000 7fc7fff7d700 1 --2- 172.21.15.153:0/1607444043 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5568eb6e4e70 0x5568eb6e7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.541+0000 7fc7fff7d700 1 --2- 172.21.15.153:0/1607444043 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5568eb6e4e70 0x5568eb6e7250 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.541+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb6e4e70 2023-10-05T21:15:11.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.541+0000 7fc80cea5680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:11.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.541+0000 7fc80cea5680 20 searching for the correct realm 2023-10-05T21:15:11.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.541+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e9340 con 0x5568eb6e4e70 2023-10-05T21:15:11.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.541+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb6e4e70 2023-10-05T21:15:11.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.541+0000 7fc7fff7d700 1 --2- 172.21.15.153:0/1607444043 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc7f403a030 0x7fc7f40395d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.541+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e9340 con 0x7fc7f403a030 2023-10-05T21:15:11.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.541+0000 7fc7ff77c700 1 --2- 172.21.15.153:0/1607444043 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc7f403a030 0x7fc7f40395d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.542+0000 7fc7ff77c700 1 --2- 172.21.15.153:0/1607444043 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc7f403a030 0x7fc7f40395d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.542+0000 7fc7ff77c700 1 -- 172.21.15.153:0/1607444043 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f000f600 con 0x7fc7f403a030 2023-10-05T21:15:11.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.542+0000 7fc7ff77c700 1 --2- 172.21.15.153:0/1607444043 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc7f000e8c0 0x7fc7f000d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.542+0000 7fc7ff77c700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e9340 con 0x7fc7f000e8c0 2023-10-05T21:15:11.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.542+0000 7fc80077e700 1 --2- 172.21.15.153:0/1607444043 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc7f000e8c0 0x7fc7f000d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.542+0000 7fc80077e700 1 --2- 172.21.15.153:0/1607444043 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc7f000e8c0 0x7fc7f000d310 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.543+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f800a570 con 0x7fc7f000e8c0 2023-10-05T21:15:11.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.543+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e9340 con 0x5568eb6b39d0 2023-10-05T21:15:11.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.543+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f800a570 con 0x5568eb6b39d0 2023-10-05T21:15:11.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.543+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e9340 con 0x5568eb6b39d0 2023-10-05T21:15:11.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.543+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f800a570 con 0x5568eb6b39d0 2023-10-05T21:15:11.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.543+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e9340 con 0x7fc7f000e8c0 2023-10-05T21:15:11.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.543+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f800a570 con 0x7fc7f000e8c0 2023-10-05T21:15:11.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.543+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e9340 con 0x7fc7f000e8c0 2023-10-05T21:15:11.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.544+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f800a570 con 0x7fc7f000e8c0 2023-10-05T21:15:11.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.544+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e9340 con 0x7fc7f403a030 2023-10-05T21:15:11.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.544+0000 7fc7ff77c700 1 -- 172.21.15.153:0/1607444043 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f000f600 con 0x7fc7f403a030 2023-10-05T21:15:11.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.544+0000 7fc7ff77c700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e9340 con 0x5568eb6e4e70 2023-10-05T21:15:11.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.544+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb6e4e70 2023-10-05T21:15:11.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.544+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e9340 con 0x5568eb6b39d0 2023-10-05T21:15:11.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.544+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f800a570 con 0x5568eb6b39d0 2023-10-05T21:15:11.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.544+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e9340 con 0x7fc7f000e8c0 2023-10-05T21:15:11.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.545+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f800a570 con 0x7fc7f000e8c0 2023-10-05T21:15:11.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.545+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e9340 con 0x5568eb6b39d0 2023-10-05T21:15:11.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.545+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f800a570 con 0x5568eb6b39d0 2023-10-05T21:15:11.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.545+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e9340 con 0x7fc7f403a030 2023-10-05T21:15:11.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.545+0000 7fc7ff77c700 1 -- 172.21.15.153:0/1607444043 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f000f600 con 0x7fc7f403a030 2023-10-05T21:15:11.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.545+0000 7fc7ff77c700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc7f001f040 con 0x5568eb6e4e70 2023-10-05T21:15:11.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.545+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb6e4e70 2023-10-05T21:15:11.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.545+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc7f001f040 con 0x5568eb6e4e70 2023-10-05T21:15:11.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.546+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb6e4e70 2023-10-05T21:15:11.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.546+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc7f001f040 con 0x7fc7f000e8c0 2023-10-05T21:15:11.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.546+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f800a570 con 0x7fc7f000e8c0 2023-10-05T21:15:11.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.546+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc7f001f040 con 0x5568eb6e4e70 2023-10-05T21:15:11.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.546+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb6e4e70 2023-10-05T21:15:11.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.546+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc7f001f040 con 0x5568eb6e4e70 2023-10-05T21:15:11.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.546+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb6e4e70 2023-10-05T21:15:11.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.546+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc7f001f040 con 0x5568eb6b39d0 2023-10-05T21:15:11.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.547+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f800a570 con 0x5568eb6b39d0 2023-10-05T21:15:11.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.547+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc7f001f040 con 0x5568eb6b39d0 2023-10-05T21:15:11.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.547+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc7f800a570 con 0x5568eb6b39d0 2023-10-05T21:15:11.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.547+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc7f001f040 con 0x7fc7f000e8c0 2023-10-05T21:15:11.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.547+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f800a570 con 0x7fc7f000e8c0 2023-10-05T21:15:11.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.547+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc7f001f040 con 0x5568eb6e4e70 2023-10-05T21:15:11.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.547+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb6e4e70 2023-10-05T21:15:11.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.547+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc7f001f040 con 0x7fc7f403a030 2023-10-05T21:15:11.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.548+0000 7fc7ff77c700 1 -- 172.21.15.153:0/1607444043 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f000f600 con 0x7fc7f403a030 2023-10-05T21:15:11.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.548+0000 7fc7ff77c700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc7f001f040 con 0x5568eb6b39d0 2023-10-05T21:15:11.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.548+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f800a570 con 0x5568eb6b39d0 2023-10-05T21:15:11.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.548+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc7f001f040 con 0x7fc7f000e8c0 2023-10-05T21:15:11.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.548+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f800a570 con 0x7fc7f000e8c0 2023-10-05T21:15:11.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.548+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc7f001f040 con 0x5568eb6e4e70 2023-10-05T21:15:11.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.548+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb6e4e70 2023-10-05T21:15:11.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.548+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc7f001f040 con 0x7fc7f000e8c0 2023-10-05T21:15:11.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.549+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f800a570 con 0x7fc7f000e8c0 2023-10-05T21:15:11.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.549+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc7f001f040 con 0x7fc7f403a030 2023-10-05T21:15:11.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.549+0000 7fc7ff77c700 1 -- 172.21.15.153:0/1607444043 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f000f600 con 0x7fc7f403a030 2023-10-05T21:15:11.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.549+0000 7fc7ff77c700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc7f001f040 con 0x5568eb6e4e70 2023-10-05T21:15:11.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.549+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb6e4e70 2023-10-05T21:15:11.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.549+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc7f001f040 con 0x7fc7f000e8c0 2023-10-05T21:15:11.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.550+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f800a570 con 0x7fc7f000e8c0 2023-10-05T21:15:11.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.550+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc7f001f040 con 0x5568eb6b39d0 2023-10-05T21:15:11.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.550+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc7f800a570 con 0x5568eb6b39d0 2023-10-05T21:15:11.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.550+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc7f001f040 con 0x7fc7f403a030 2023-10-05T21:15:11.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.550+0000 7fc7ff77c700 1 -- 172.21.15.153:0/1607444043 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f000f600 con 0x7fc7f403a030 2023-10-05T21:15:11.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.550+0000 7fc80cea5680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:11.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.550+0000 7fc80cea5680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:11.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.550+0000 7fc80cea5680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:11.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.550+0000 7fc80cea5680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:11.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.550+0000 7fc80cea5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.550+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e8290 con 0x5568eb6b39d0 2023-10-05T21:15:11.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.550+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc7f800a570 con 0x5568eb6b39d0 2023-10-05T21:15:11.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.550+0000 7fc80cea5680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.550+0000 7fc80cea5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.550+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e8690 con 0x5568eb6b39d0 2023-10-05T21:15:11.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.551+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc7f800a570 con 0x5568eb6b39d0 2023-10-05T21:15:11.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.551+0000 7fc80cea5680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:11.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.551+0000 7fc80cea5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.551+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e97d0 con 0x5568eb6b39d0 2023-10-05T21:15:11.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.551+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb6b39d0 2023-10-05T21:15:11.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.551+0000 7fc80cea5680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:11.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.551+0000 7fc80cea5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.551+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e9b80 con 0x5568eb6e4e70 2023-10-05T21:15:11.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.551+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb6e4e70 2023-10-05T21:15:11.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.551+0000 7fc80cea5680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.551+0000 7fc80cea5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.551+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e9f30 con 0x5568eb6b39d0 2023-10-05T21:15:11.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.551+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb6b39d0 2023-10-05T21:15:11.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.551+0000 7fc80cea5680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.551+0000 7fc80cea5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.551+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e9f30 con 0x5568eb6b39d0 2023-10-05T21:15:11.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.552+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb6b39d0 2023-10-05T21:15:11.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.552+0000 7fc80cea5680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:11.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.552+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e9f30 con 0x5568eb6e4e70 2023-10-05T21:15:11.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.552+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb6e4e70 2023-10-05T21:15:11.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.552+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e9f30 con 0x7fc7f403a030 2023-10-05T21:15:11.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.552+0000 7fc7ff77c700 1 -- 172.21.15.153:0/1607444043 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f000f600 con 0x7fc7f403a030 2023-10-05T21:15:11.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.552+0000 7fc7ff77c700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e9f30 con 0x7fc7f000e8c0 2023-10-05T21:15:11.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.552+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f802e180 con 0x7fc7f000e8c0 2023-10-05T21:15:11.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.552+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e97d0 con 0x5568eb6b39d0 2023-10-05T21:15:11.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.552+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb6b39d0 2023-10-05T21:15:11.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.552+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e97d0 con 0x5568eb6b39d0 2023-10-05T21:15:11.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.553+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb6b39d0 2023-10-05T21:15:11.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.553+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e97d0 con 0x7fc7f000e8c0 2023-10-05T21:15:11.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.553+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f802e180 con 0x7fc7f000e8c0 2023-10-05T21:15:11.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.553+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e97d0 con 0x7fc7f000e8c0 2023-10-05T21:15:11.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.553+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f802e180 con 0x7fc7f000e8c0 2023-10-05T21:15:11.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.553+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e97d0 con 0x7fc7f403a030 2023-10-05T21:15:11.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.553+0000 7fc7ff77c700 1 -- 172.21.15.153:0/1607444043 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f000f600 con 0x7fc7f403a030 2023-10-05T21:15:11.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.554+0000 7fc7ff77c700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e97d0 con 0x5568eb6e4e70 2023-10-05T21:15:11.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.554+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb6e4e70 2023-10-05T21:15:11.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.554+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e97d0 con 0x5568eb6b39d0 2023-10-05T21:15:11.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.554+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb6b39d0 2023-10-05T21:15:11.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.554+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e97d0 con 0x7fc7f000e8c0 2023-10-05T21:15:11.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.554+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f802e180 con 0x7fc7f000e8c0 2023-10-05T21:15:11.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.554+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e97d0 con 0x5568eb6b39d0 2023-10-05T21:15:11.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.554+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb6b39d0 2023-10-05T21:15:11.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.554+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e97d0 con 0x7fc7f403a030 2023-10-05T21:15:11.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.555+0000 7fc7ff77c700 1 -- 172.21.15.153:0/1607444043 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f000f600 con 0x7fc7f403a030 2023-10-05T21:15:11.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.555+0000 7fc7ff77c700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e97d0 con 0x5568eb6e4e70 2023-10-05T21:15:11.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.555+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb6e4e70 2023-10-05T21:15:11.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.555+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e97d0 con 0x5568eb6e4e70 2023-10-05T21:15:11.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.555+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb6e4e70 2023-10-05T21:15:11.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.555+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e97d0 con 0x7fc7f000e8c0 2023-10-05T21:15:11.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.555+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f802e180 con 0x7fc7f000e8c0 2023-10-05T21:15:11.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.555+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e97d0 con 0x5568eb6e4e70 2023-10-05T21:15:11.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.555+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb6e4e70 2023-10-05T21:15:11.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.555+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e97d0 con 0x5568eb6e4e70 2023-10-05T21:15:11.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.556+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb6e4e70 2023-10-05T21:15:11.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.556+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e97d0 con 0x5568eb6b39d0 2023-10-05T21:15:11.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.556+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb6b39d0 2023-10-05T21:15:11.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.556+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e97d0 con 0x5568eb6b39d0 2023-10-05T21:15:11.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.556+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb6b39d0 2023-10-05T21:15:11.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.556+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e97d0 con 0x7fc7f000e8c0 2023-10-05T21:15:11.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.556+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f802e180 con 0x7fc7f000e8c0 2023-10-05T21:15:11.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.556+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e97d0 con 0x5568eb6e4e70 2023-10-05T21:15:11.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.557+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb6e4e70 2023-10-05T21:15:11.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.557+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e97d0 con 0x7fc7f403a030 2023-10-05T21:15:11.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.557+0000 7fc7ff77c700 1 -- 172.21.15.153:0/1607444043 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f000f600 con 0x7fc7f403a030 2023-10-05T21:15:11.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.557+0000 7fc7ff77c700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e97d0 con 0x5568eb6b39d0 2023-10-05T21:15:11.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.557+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb6b39d0 2023-10-05T21:15:11.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.557+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e97d0 con 0x7fc7f000e8c0 2023-10-05T21:15:11.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.557+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f802e180 con 0x7fc7f000e8c0 2023-10-05T21:15:11.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.557+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e97d0 con 0x5568eb6e4e70 2023-10-05T21:15:11.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.557+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb6e4e70 2023-10-05T21:15:11.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.557+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e97d0 con 0x7fc7f000e8c0 2023-10-05T21:15:11.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.558+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f802e180 con 0x7fc7f000e8c0 2023-10-05T21:15:11.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.558+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e97d0 con 0x7fc7f403a030 2023-10-05T21:15:11.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.558+0000 7fc7ff77c700 1 -- 172.21.15.153:0/1607444043 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f000f600 con 0x7fc7f403a030 2023-10-05T21:15:11.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.558+0000 7fc7ff77c700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e97d0 con 0x5568eb6e4e70 2023-10-05T21:15:11.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.558+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb6e4e70 2023-10-05T21:15:11.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.558+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e97d0 con 0x7fc7f000e8c0 2023-10-05T21:15:11.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.558+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f802e180 con 0x7fc7f000e8c0 2023-10-05T21:15:11.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.558+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e97d0 con 0x5568eb6b39d0 2023-10-05T21:15:11.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.559+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb6b39d0 2023-10-05T21:15:11.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.559+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e97d0 con 0x7fc7f403a030 2023-10-05T21:15:11.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.559+0000 7fc7ff77c700 1 -- 172.21.15.153:0/1607444043 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7f000f600 con 0x7fc7f403a030 2023-10-05T21:15:11.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.559+0000 7fc80cea5680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:11.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.559+0000 7fc80cea5680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:11.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.559+0000 7fc80cea5680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:11.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.559+0000 7fc80cea5680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:11.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.559+0000 7fc80cea5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.559+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6e9f30 con 0x5568eb6b39d0 2023-10-05T21:15:11.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.559+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb6b39d0 2023-10-05T21:15:11.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.559+0000 7fc80cea5680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:11.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.559+0000 7fc80cea5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.559+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6ea390 con 0x5568eb6e4e70 2023-10-05T21:15:11.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.559+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb6e4e70 2023-10-05T21:15:11.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.559+0000 7fc80cea5680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:11.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.559+0000 7fc80cea5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.559+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6eac80 con 0x5568eb6b39d0 2023-10-05T21:15:11.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.560+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb6b39d0 2023-10-05T21:15:11.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.560+0000 7fc80cea5680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:11.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.560+0000 7fc80cea5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.560+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6eac80 con 0x5568eb6b39d0 2023-10-05T21:15:11.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.560+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb6b39d0 2023-10-05T21:15:11.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.560+0000 7fc80cea5680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:11.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.560+0000 7fc80cea5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.560+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6eac80 con 0x7fc7f000e8c0 2023-10-05T21:15:11.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.560+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x7fc7f000e8c0 2023-10-05T21:15:11.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.560+0000 7fc80cea5680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.560+0000 7fc80cea5680 20 zone default found 2023-10-05T21:15:11.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.560+0000 7fc80cea5680 4 Realm: () 2023-10-05T21:15:11.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.560+0000 7fc80cea5680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:11.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.560+0000 7fc80cea5680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:11.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.560+0000 7fc80cea5680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:11.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.560+0000 7fc80cea5680 20 zonegroup default 2023-10-05T21:15:11.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.560+0000 7fc80cea5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.560+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6eac80 con 0x7fc7f000e8c0 2023-10-05T21:15:11.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.561+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x7fc7f000e8c0 2023-10-05T21:15:11.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.561+0000 7fc80cea5680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.561+0000 7fc80cea5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.561+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6eac80 con 0x5568eb6e4e70 2023-10-05T21:15:11.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.561+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb6e4e70 2023-10-05T21:15:11.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.561+0000 7fc80cea5680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.561+0000 7fc80cea5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.561+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6ecab0 con 0x5568eb6e4e70 2023-10-05T21:15:11.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.561+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb6e4e70 2023-10-05T21:15:11.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.561+0000 7fc80cea5680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.561+0000 7fc80cea5680 20 started sync module instance, tier type = 2023-10-05T21:15:11.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.561+0000 7fc80cea5680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:11.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.561+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6ec170 con 0x7fc7f403a030 2023-10-05T21:15:11.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.562+0000 7fc7ff77c700 1 -- 172.21.15.153:0/1607444043 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7f000f600 con 0x7fc7f403a030 2023-10-05T21:15:11.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.562+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93909114865008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6ed350 con 0x7fc7f403a030 2023-10-05T21:15:11.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.562+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6edbf0 con 0x5568eb6b39d0 2023-10-05T21:15:11.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.563+0000 7fc7ff77c700 1 -- 172.21.15.153:0/1607444043 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 93909114865008] v29'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7f000f600 con 0x7fc7f403a030 2023-10-05T21:15:11.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.563+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb6b39d0 2023-10-05T21:15:11.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.563+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93909114867296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6edbf0 con 0x5568eb6b39d0 2023-10-05T21:15:11.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.563+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6ee790 con 0x5568eb6e4e70 2023-10-05T21:15:11.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.564+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb6e4e70 2023-10-05T21:15:11.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.564+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93909114872448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6ee790 con 0x5568eb6e4e70 2023-10-05T21:15:11.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.564+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 93909114867296] v29'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb6b39d0 2023-10-05T21:15:11.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.564+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6ef1f0 con 0x7fc7f403a030 2023-10-05T21:15:11.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.564+0000 7fc7ff77c700 1 -- 172.21.15.153:0/1607444043 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7f000f600 con 0x7fc7f403a030 2023-10-05T21:15:11.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.564+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 93909114869504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6efa90 con 0x7fc7f403a030 2023-10-05T21:15:11.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.564+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6f04e0 con 0x5568eb6b39d0 2023-10-05T21:15:11.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.564+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 93909114872448] v29'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb6e4e70 2023-10-05T21:15:11.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.565+0000 7fc7ff77c700 1 -- 172.21.15.153:0/1607444043 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 93909114869504] v29'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7f000f600 con 0x7fc7f403a030 2023-10-05T21:15:11.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.565+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb6b39d0 2023-10-05T21:15:11.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.565+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 93909114877344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6effb0 con 0x5568eb6b39d0 2023-10-05T21:15:11.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.565+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6f0dd0 con 0x7fc7f000e8c0 2023-10-05T21:15:11.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.566+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 93909114877344] v29'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb6b39d0 2023-10-05T21:15:11.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.566+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x7fc7f000e8c0 2023-10-05T21:15:11.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.566+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 93909114874768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6f0d80 con 0x7fc7f000e8c0 2023-10-05T21:15:11.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.566+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6f17f0 con 0x7fc7f000e8c0 2023-10-05T21:15:11.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.567+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 93909114874768] v29'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x7fc7f000e8c0 2023-10-05T21:15:11.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.567+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x7fc7f000e8c0 2023-10-05T21:15:11.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.567+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93909114884768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6f0d80 con 0x7fc7f000e8c0 2023-10-05T21:15:11.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.567+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6f0d80 con 0x7fc7f000e8c0 2023-10-05T21:15:11.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.567+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(98 notify.7 [create] v29'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x7fc7f000e8c0 2023-10-05T21:15:11.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.567+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93909114887520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6f2720 con 0x7fc7f000e8c0 2023-10-05T21:15:11.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.567+0000 7fc80cea5680 20 add_watcher() i=0 2023-10-05T21:15:11.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.567+0000 7fc80cea5680 20 add_watcher() i=1 2023-10-05T21:15:11.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.567+0000 7fc80cea5680 20 add_watcher() i=2 2023-10-05T21:15:11.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.567+0000 7fc80cea5680 20 add_watcher() i=3 2023-10-05T21:15:11.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.567+0000 7fc80cea5680 20 add_watcher() i=4 2023-10-05T21:15:11.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.567+0000 7fc80cea5680 20 add_watcher() i=5 2023-10-05T21:15:11.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.567+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(97 notify.6 [watch watch cookie 93909114884768] v29'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x7fc7f000e8c0 2023-10-05T21:15:11.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.567+0000 7fc80cea5680 20 add_watcher() i=6 2023-10-05T21:15:11.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.568+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 93909114887520] v29'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x7fc7f000e8c0 2023-10-05T21:15:11.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.568+0000 7fc80cea5680 20 add_watcher() i=7 2023-10-05T21:15:11.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.568+0000 7fc80cea5680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:11.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.568+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6f0890 con 0x5568eb6b39d0 2023-10-05T21:15:11.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.568+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb6b39d0 2023-10-05T21:15:11.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.568+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93909114888624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6f0890 con 0x5568eb6b39d0 2023-10-05T21:15:11.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.569+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 93909114888624] v29'26 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb6b39d0 2023-10-05T21:15:11.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.569+0000 7fc7d17e2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:11.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.569+0000 7fc80cea5680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:11.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.569+0000 7fc80cea5680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:11.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.569+0000 7fc80cea5680 1 Processor -- start 2023-10-05T21:15:11.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.570+0000 7fc80cea5680 1 -- start start 2023-10-05T21:15:11.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.570+0000 7fc80cea5680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5568eb6ff310 0x5568eb6ff720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.570+0000 7fc80cea5680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568eb6ffd30 con 0x5568eb6ff310 2023-10-05T21:15:11.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.570+0000 7fc7ff77c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5568eb6ff310 0x5568eb6ff720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.570+0000 7fc7ff77c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5568eb6ff310 0x5568eb6ff720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49042/0 (socket says 172.21.15.153:49042) 2023-10-05T21:15:11.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.570+0000 7fc7ff77c700 1 -- 172.21.15.153:0/1476227532 learned_addr learned my addr 172.21.15.153:0/1476227532 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:11.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.570+0000 7fc7ff77c700 1 -- 172.21.15.153:0/1476227532 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568eb700210 con 0x5568eb6ff310 2023-10-05T21:15:11.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.570+0000 7fc7ff77c700 1 --2- 172.21.15.153:0/1476227532 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5568eb6ff310 0x5568eb6ff720 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x5568eb6e0350 tx=0x7fc7f0006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf904d8b37679e83 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.571+0000 7fc7d0fe1700 1 -- 172.21.15.153:0/1476227532 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc7f000dae0 con 0x5568eb6ff310 2023-10-05T21:15:11.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.571+0000 7fc7d0fe1700 1 -- 172.21.15.153:0/1476227532 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f000dc40 con 0x5568eb6ff310 2023-10-05T21:15:11.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.571+0000 7fc7d0fe1700 1 -- 172.21.15.153:0/1476227532 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc7f000ddf0 con 0x5568eb6ff310 2023-10-05T21:15:11.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.571+0000 7fc80cea5680 1 -- 172.21.15.153:0/1476227532 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5568eb6ff310 msgr2=0x5568eb6ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.571+0000 7fc80cea5680 1 --2- 172.21.15.153:0/1476227532 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5568eb6ff310 0x5568eb6ff720 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x5568eb6e0350 tx=0x7fc7f0006000 comp rx=0 tx=0).stop 2023-10-05T21:15:11.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.571+0000 7fc80cea5680 1 -- 172.21.15.153:0/1476227532 shutdown_connections 2023-10-05T21:15:11.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.571+0000 7fc80cea5680 1 --2- 172.21.15.153:0/1476227532 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5568eb6ff310 0x5568eb6ff720 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.571+0000 7fc80cea5680 1 -- 172.21.15.153:0/1476227532 >> 172.21.15.153:0/1476227532 conn(0x5568eb6fb610 msgr2=0x5568eb6f9710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:11.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.571+0000 7fc80cea5680 1 -- 172.21.15.153:0/1476227532 shutdown_connections 2023-10-05T21:15:11.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.571+0000 7fc80cea5680 1 -- 172.21.15.153:0/1476227532 wait complete. 2023-10-05T21:15:11.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.572+0000 7fc80cea5680 1 Processor -- start 2023-10-05T21:15:11.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.572+0000 7fc80cea5680 1 -- start start 2023-10-05T21:15:11.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.572+0000 7fc80cea5680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5568eb6ff310 0x5568eb7060a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.572+0000 7fc80cea5680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568eb7065e0 con 0x5568eb6ff310 2023-10-05T21:15:11.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.572+0000 7fc7ff77c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5568eb6ff310 0x5568eb7060a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.572+0000 7fc7ff77c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5568eb6ff310 0x5568eb7060a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49058/0 (socket says 172.21.15.153:49058) 2023-10-05T21:15:11.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.572+0000 7fc7ff77c700 1 -- 172.21.15.153:0/3089859783 learned_addr learned my addr 172.21.15.153:0/3089859783 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:11.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.572+0000 7fc7ff77c700 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f0006070 con 0x5568eb6ff310 2023-10-05T21:15:11.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.573+0000 7fc7ff77c700 1 --2- 172.21.15.153:0/3089859783 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5568eb6ff310 0x5568eb7060a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x5568eb6fab80 tx=0x7fc7f0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.573+0000 7fc74affd700 1 -- 172.21.15.153:0/3089859783 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc7f003da10 con 0x5568eb6ff310 2023-10-05T21:15:11.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.573+0000 7fc74affd700 1 -- 172.21.15.153:0/3089859783 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f003db70 con 0x5568eb6ff310 2023-10-05T21:15:11.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.573+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5568eb7067e0 con 0x5568eb6ff310 2023-10-05T21:15:11.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.573+0000 7fc74affd700 1 -- 172.21.15.153:0/3089859783 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc7f003dce0 con 0x5568eb6ff310 2023-10-05T21:15:11.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.573+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5568eb706c30 con 0x5568eb6ff310 2023-10-05T21:15:11.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.573+0000 7fc74affd700 1 -- 172.21.15.153:0/3089859783 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fc7f001a040 con 0x5568eb6ff310 2023-10-05T21:15:11.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.574+0000 7fc74affd700 1 --2- 172.21.15.153:0/3089859783 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc7400340f0 0x7fc7400365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.574+0000 7fc74affd700 1 -- 172.21.15.153:0/3089859783 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fc7f0048b30 con 0x5568eb6ff310 2023-10-05T21:15:11.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.574+0000 7fc80077e700 1 --2- 172.21.15.153:0/3089859783 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc7400340f0 0x7fc7400365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.574+0000 7fc80cea5680 1 --2- 172.21.15.153:0/3089859783 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5568eb710ea0 0x5568eb713310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.574+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb7139c0 con 0x5568eb710ea0 2023-10-05T21:15:11.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.574+0000 7fc7fff7d700 1 --2- 172.21.15.153:0/3089859783 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5568eb710ea0 0x5568eb713310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.574+0000 7fc80077e700 1 --2- 172.21.15.153:0/3089859783 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc7400340f0 0x7fc7400365a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x5568eb6f2670 tx=0x7fc7f800afb0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.574+0000 7fc7fff7d700 1 --2- 172.21.15.153:0/3089859783 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5568eb710ea0 0x5568eb713310 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.575+0000 7fc7fff7d700 1 -- 172.21.15.153:0/3089859783 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v29'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb710ea0 2023-10-05T21:15:11.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.575+0000 7fc80cea5680 1 --2- 172.21.15.153:0/3089859783 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x5568eb714740 0x5568eb716b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.575+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb7171e0 con 0x5568eb714740 2023-10-05T21:15:11.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.575+0000 7fc7ff77c700 1 --2- 172.21.15.153:0/3089859783 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x5568eb714740 0x5568eb716b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.576+0000 7fc7ff77c700 1 --2- 172.21.15.153:0/3089859783 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x5568eb714740 0x5568eb716b20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.576+0000 7fc7ff77c700 1 -- 172.21.15.153:0/3089859783 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v29'10 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc7f000f600 con 0x5568eb714740 2023-10-05T21:15:11.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.576+0000 7fc80cea5680 1 --2- 172.21.15.153:0/3089859783 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5568eb717f90 0x5568eb71a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.576+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb71ab70 con 0x5568eb717f90 2023-10-05T21:15:11.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.576+0000 7fc80077e700 1 --2- 172.21.15.153:0/3089859783 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5568eb717f90 0x5568eb71a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.577+0000 7fc80077e700 1 --2- 172.21.15.153:0/3089859783 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5568eb717f90 0x5568eb71a420 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.577+0000 7fc80077e700 1 -- 172.21.15.153:0/3089859783 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v29'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb717f90 2023-10-05T21:15:11.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.577+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb71b2a0 con 0x5568eb710ea0 2023-10-05T21:15:11.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.578+0000 7fc7fff7d700 1 -- 172.21.15.153:0/3089859783 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v29'27 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb710ea0 2023-10-05T21:15:11.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.578+0000 7fc80cea5680 1 --2- 172.21.15.153:0/3089859783 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x5568eb71c020 0x5568eb71e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.578+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb71eab0 con 0x5568eb71c020 2023-10-05T21:15:11.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.578+0000 7fc7fff7d700 1 --2- 172.21.15.153:0/3089859783 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x5568eb71c020 0x5568eb71e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.578+0000 7fc7fff7d700 1 --2- 172.21.15.153:0/3089859783 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x5568eb71c020 0x5568eb71e400 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.579+0000 7fc7fff7d700 1 -- 172.21.15.153:0/3089859783 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v29'20 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb71c020 2023-10-05T21:15:11.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.579+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb71f1e0 con 0x5568eb717f90 2023-10-05T21:15:11.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.580+0000 7fc80077e700 1 -- 172.21.15.153:0/3089859783 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v29'13 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb717f90 2023-10-05T21:15:11.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.580+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb71f840 con 0x5568eb710ea0 2023-10-05T21:15:11.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.581+0000 7fc7fff7d700 1 -- 172.21.15.153:0/3089859783 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v29'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb710ea0 2023-10-05T21:15:11.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.581+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb71fd30 con 0x5568eb714740 2023-10-05T21:15:11.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.581+0000 7fc7ff77c700 1 -- 172.21.15.153:0/3089859783 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v29'13 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc7f000f600 con 0x5568eb714740 2023-10-05T21:15:11.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.581+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb70e700 con 0x5568eb71c020 2023-10-05T21:15:11.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.582+0000 7fc7fff7d700 1 -- 172.21.15.153:0/3089859783 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v29'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb71c020 2023-10-05T21:15:11.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.582+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb70e700 con 0x5568eb717f90 2023-10-05T21:15:11.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.583+0000 7fc80077e700 1 -- 172.21.15.153:0/3089859783 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v29'16 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb717f90 2023-10-05T21:15:11.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.583+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb720850 con 0x5568eb71c020 2023-10-05T21:15:11.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.583+0000 7fc7fff7d700 1 -- 172.21.15.153:0/3089859783 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v29'21 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb71c020 2023-10-05T21:15:11.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.583+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb720850 con 0x5568eb714740 2023-10-05T21:15:11.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.584+0000 7fc7ff77c700 1 -- 172.21.15.153:0/3089859783 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v29'12 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc7f000f600 con 0x5568eb714740 2023-10-05T21:15:11.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.584+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb720e70 con 0x5568eb71c020 2023-10-05T21:15:11.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.585+0000 7fc7fff7d700 1 -- 172.21.15.153:0/3089859783 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v29'10 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb71c020 2023-10-05T21:15:11.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.585+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb720e70 con 0x5568eb714740 2023-10-05T21:15:11.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.586+0000 7fc7ff77c700 1 -- 172.21.15.153:0/3089859783 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v29'19 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc7f000f600 con 0x5568eb714740 2023-10-05T21:15:11.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.586+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb720fb0 con 0x5568eb710ea0 2023-10-05T21:15:11.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.586+0000 7fc7fff7d700 1 -- 172.21.15.153:0/3089859783 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v29'28 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb710ea0 2023-10-05T21:15:11.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.586+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb720fb0 con 0x5568eb717f90 2023-10-05T21:15:11.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.587+0000 7fc80077e700 1 -- 172.21.15.153:0/3089859783 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v29'14 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb717f90 2023-10-05T21:15:11.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.587+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb720fb0 con 0x5568eb71c020 2023-10-05T21:15:11.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.588+0000 7fc7fff7d700 1 -- 172.21.15.153:0/3089859783 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v29'22 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb71c020 2023-10-05T21:15:11.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.588+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb720fb0 con 0x5568eb717f90 2023-10-05T21:15:11.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.589+0000 7fc80077e700 1 -- 172.21.15.153:0/3089859783 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v29'10 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb717f90 2023-10-05T21:15:11.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.589+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb721060 con 0x5568eb710ea0 2023-10-05T21:15:11.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.589+0000 7fc7fff7d700 1 -- 172.21.15.153:0/3089859783 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v29'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb710ea0 2023-10-05T21:15:11.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.589+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb721060 con 0x5568eb710ea0 2023-10-05T21:15:11.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.590+0000 7fc7fff7d700 1 -- 172.21.15.153:0/3089859783 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v29'29 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb710ea0 2023-10-05T21:15:11.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.590+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb721630 con 0x5568eb717f90 2023-10-05T21:15:11.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.591+0000 7fc80077e700 1 -- 172.21.15.153:0/3089859783 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v29'15 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb717f90 2023-10-05T21:15:11.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.591+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb721630 con 0x5568eb71c020 2023-10-05T21:15:11.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.591+0000 7fc7fff7d700 1 -- 172.21.15.153:0/3089859783 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v29'21 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb71c020 2023-10-05T21:15:11.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.591+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb721630 con 0x5568eb717f90 2023-10-05T21:15:11.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.592+0000 7fc80077e700 1 -- 172.21.15.153:0/3089859783 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v29'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb717f90 2023-10-05T21:15:11.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.592+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb721630 con 0x5568eb717f90 2023-10-05T21:15:11.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.593+0000 7fc80077e700 1 -- 172.21.15.153:0/3089859783 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v29'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb717f90 2023-10-05T21:15:11.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.593+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb721630 con 0x5568eb717f90 2023-10-05T21:15:11.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.593+0000 7fc80077e700 1 -- 172.21.15.153:0/3089859783 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v29'6 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb717f90 2023-10-05T21:15:11.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.593+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb721630 con 0x5568eb717f90 2023-10-05T21:15:11.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.594+0000 7fc80077e700 1 -- 172.21.15.153:0/3089859783 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v29'14 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb717f90 2023-10-05T21:15:11.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.594+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb721630 con 0x5568eb714740 2023-10-05T21:15:11.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.595+0000 7fc7ff77c700 1 -- 172.21.15.153:0/3089859783 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v29'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc7f000f600 con 0x5568eb714740 2023-10-05T21:15:11.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.595+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb721630 con 0x5568eb717f90 2023-10-05T21:15:11.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.596+0000 7fc80077e700 1 -- 172.21.15.153:0/3089859783 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v29'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb717f90 2023-10-05T21:15:11.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.596+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb721630 con 0x5568eb714740 2023-10-05T21:15:11.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.596+0000 7fc7ff77c700 1 -- 172.21.15.153:0/3089859783 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v29'14 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc7f000f600 con 0x5568eb714740 2023-10-05T21:15:11.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.596+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb721630 con 0x5568eb717f90 2023-10-05T21:15:11.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.597+0000 7fc80077e700 1 -- 172.21.15.153:0/3089859783 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v29'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb717f90 2023-10-05T21:15:11.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.597+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb721630 con 0x5568eb714740 2023-10-05T21:15:11.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.598+0000 7fc7ff77c700 1 -- 172.21.15.153:0/3089859783 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v29'20 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc7f000f600 con 0x5568eb714740 2023-10-05T21:15:11.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.598+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb721630 con 0x5568eb71c020 2023-10-05T21:15:11.620 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-10-05T21:15:11.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.599+0000 7fc7fff7d700 1 -- 172.21.15.153:0/3089859783 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v29'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb71c020 2023-10-05T21:15:11.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.600+0000 7fc73ffff700 20 reqs_thread_entry: start 2023-10-05T21:15:11.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.600+0000 7fc73dffb700 20 reqs_thread_entry: start 2023-10-05T21:15:11.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.600+0000 7fc80cea5680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:11.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.600+0000 7fc80cea5680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:11.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.600+0000 7fc72bfff700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:41 2023 2023-10-05T21:15:11.621 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:11.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.600+0000 7fc72b7fe700 20 reqs_thread_entry: start 2023-10-05T21:15:11.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.600+0000 7fc80cea5680 20 get_system_obj_state: rctx=0x7ffdeb143ff8 obj=default.rgw.meta:users.uid:bud state=0x5568eb561240 s->prefetch_data=0 2023-10-05T21:15:11.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.600+0000 7fc80cea5680 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2023-10-05T21:15:11.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.600+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:102 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb77c640 con 0x7fc7f403a030 2023-10-05T21:15:11.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.601+0000 7fc7ff77c700 1 -- 172.21.15.153:0/1607444043 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(102 bud [call,getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fc7f000f600 con 0x7fc7f403a030 2023-10-05T21:15:11.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.601+0000 7fc80cea5680 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2023-10-05T21:15:11.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.601+0000 7fc80cea5680 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2023-10-05T21:15:11.621 INFO:teuthology.orchestra.run.smithi153.stderr:could not remove user: unable to remove user, user does not exist 2023-10-05T21:15:11.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.601+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:103 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93909114865008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb73b170 con 0x7fc7f403a030 2023-10-05T21:15:11.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.601+0000 7fc7ff77c700 1 -- 172.21.15.153:0/1607444043 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(103 notify.0 [watch unwatch cookie 93909114865008] v29'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7f000f600 con 0x7fc7f403a030 2023-10-05T21:15:11.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.602+0000 7fc80cea5680 20 remove_watcher() i=0 2023-10-05T21:15:11.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.602+0000 7fc80cea5680 2 removed watcher, disabling cache 2023-10-05T21:15:11.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.602+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:104 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93909114867296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6ec570 con 0x5568eb6b39d0 2023-10-05T21:15:11.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.603+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(104 notify.1 [watch unwatch cookie 93909114867296] v29'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb6b39d0 2023-10-05T21:15:11.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.603+0000 7fc80cea5680 20 remove_watcher() i=1 2023-10-05T21:15:11.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.603+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:105 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93909114872448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6ec570 con 0x5568eb6e4e70 2023-10-05T21:15:11.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.603+0000 7fc7fff7d700 1 -- 172.21.15.153:0/1607444043 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(105 notify.2 [watch unwatch cookie 93909114872448] v29'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7f4037070 con 0x5568eb6e4e70 2023-10-05T21:15:11.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.603+0000 7fc80cea5680 20 remove_watcher() i=2 2023-10-05T21:15:11.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.603+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:106 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93909114869504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6ec570 con 0x7fc7f403a030 2023-10-05T21:15:11.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.604+0000 7fc7ff77c700 1 -- 172.21.15.153:0/1607444043 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(106 notify.3 [watch unwatch cookie 93909114869504] v29'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7f000f600 con 0x7fc7f403a030 2023-10-05T21:15:11.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.604+0000 7fc80cea5680 20 remove_watcher() i=3 2023-10-05T21:15:11.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.604+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93909114877344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6ed700 con 0x5568eb6b39d0 2023-10-05T21:15:11.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.605+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(107 notify.4 [watch unwatch cookie 93909114877344] v29'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb6b39d0 2023-10-05T21:15:11.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.605+0000 7fc80cea5680 20 remove_watcher() i=4 2023-10-05T21:15:11.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.605+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:108 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93909114874768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6ec570 con 0x7fc7f000e8c0 2023-10-05T21:15:11.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.605+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(108 notify.5 [watch unwatch cookie 93909114874768] v29'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x7fc7f000e8c0 2023-10-05T21:15:11.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.605+0000 7fc80cea5680 20 remove_watcher() i=5 2023-10-05T21:15:11.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.606+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93909114884768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6ef5a0 con 0x7fc7f000e8c0 2023-10-05T21:15:11.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.606+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(109 notify.6 [watch unwatch cookie 93909114884768] v29'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x7fc7f000e8c0 2023-10-05T21:15:11.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.606+0000 7fc80cea5680 20 remove_watcher() i=6 2023-10-05T21:15:11.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.606+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93909114887520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6ec570 con 0x7fc7f000e8c0 2023-10-05T21:15:11.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.607+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(110 notify.7 [watch unwatch cookie 93909114887520] v29'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x7fc7f000e8c0 2023-10-05T21:15:11.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.607+0000 7fc80cea5680 20 remove_watcher() i=7 2023-10-05T21:15:11.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.608+0000 7fc7d17e2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:11.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.608+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:111 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93909114888624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5568eb6f12a0 con 0x5568eb6b39d0 2023-10-05T21:15:11.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.608+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(111 data_loggenerations_metadata [watch unwatch cookie 93909114888624] v29'30 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc7f802e180 con 0x5568eb6b39d0 2023-10-05T21:15:11.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.608+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc7f000e8c0 msgr2=0x7fc7f000d310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.608+0000 7fc80cea5680 1 --2- 172.21.15.153:0/1607444043 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc7f000e8c0 0x7fc7f000d310 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.608+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5568eb6b39d0 msgr2=0x5568eb6e2a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.608+0000 7fc80cea5680 1 --2- 172.21.15.153:0/1607444043 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5568eb6b39d0 0x5568eb6e2a30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.608+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc7f403a030 msgr2=0x7fc7f40395d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.608+0000 7fc80cea5680 1 --2- 172.21.15.153:0/1607444043 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc7f403a030 0x7fc7f40395d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.608+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5568eb6e4e70 msgr2=0x5568eb6e7250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.608+0000 7fc80cea5680 1 --2- 172.21.15.153:0/1607444043 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5568eb6e4e70 0x5568eb6e7250 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.609+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc7ec0340f0 msgr2=0x7fc7ec0365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.609+0000 7fc80cea5680 1 --2- 172.21.15.153:0/1607444043 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc7ec0340f0 0x7fc7ec0365a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc7f00011e0 tx=0x7fc7f0001460 comp rx=0 tx=0).stop 2023-10-05T21:15:11.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.609+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5568eb6220a0 msgr2=0x5568eb6d6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.609+0000 7fc80cea5680 1 --2- 172.21.15.153:0/1607444043 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5568eb6220a0 0x5568eb6d6ca0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4020040 tx=0x7fc7f401d000 comp rx=0 tx=0).stop 2023-10-05T21:15:11.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.609+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 reap_dead start 2023-10-05T21:15:11.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.609+0000 7fc80077e700 1 -- 172.21.15.153:0/1607444043 reap_dead start 2023-10-05T21:15:11.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.609+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 shutdown_connections 2023-10-05T21:15:11.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.609+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 >> 172.21.15.153:0/1607444043 conn(0x5568eb6a8b80 msgr2=0x5568eb6c9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:11.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.609+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 shutdown_connections 2023-10-05T21:15:11.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.609+0000 7fc80cea5680 1 -- 172.21.15.153:0/1607444043 wait complete. 2023-10-05T21:15:11.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.609+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x5568eb714740 msgr2=0x5568eb716b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.609+0000 7fc80cea5680 1 --2- 172.21.15.153:0/3089859783 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x5568eb714740 0x5568eb716b20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.609+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5568eb710ea0 msgr2=0x5568eb713310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.609+0000 7fc80cea5680 1 --2- 172.21.15.153:0/3089859783 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5568eb710ea0 0x5568eb713310 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.609+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x5568eb71c020 msgr2=0x5568eb71e400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.609+0000 7fc80cea5680 1 --2- 172.21.15.153:0/3089859783 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x5568eb71c020 0x5568eb71e400 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.609+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5568eb717f90 msgr2=0x5568eb71a420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.609+0000 7fc80cea5680 1 --2- 172.21.15.153:0/3089859783 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5568eb717f90 0x5568eb71a420 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.609+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc7400340f0 msgr2=0x7fc7400365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.609+0000 7fc80cea5680 1 --2- 172.21.15.153:0/3089859783 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc7400340f0 0x7fc7400365a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x5568eb6f2670 tx=0x7fc7f800afb0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.609+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5568eb6ff310 msgr2=0x5568eb7060a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.609+0000 7fc7fff7d700 1 -- 172.21.15.153:0/3089859783 reap_dead start 2023-10-05T21:15:11.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.609+0000 7fc80cea5680 1 --2- 172.21.15.153:0/3089859783 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5568eb6ff310 0x5568eb7060a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x5568eb6fab80 tx=0x7fc7f0032000 comp rx=0 tx=0).stop 2023-10-05T21:15:11.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.609+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 shutdown_connections 2023-10-05T21:15:11.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.609+0000 7fc80cea5680 1 --2- 172.21.15.153:0/3089859783 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5568eb6ff310 0x5568eb7060a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.609+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 >> 172.21.15.153:0/3089859783 conn(0x5568eb6fb610 msgr2=0x5568eb6f96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:11.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.609+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 shutdown_connections 2023-10-05T21:15:11.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.609+0000 7fc80cea5680 1 -- 172.21.15.153:0/3089859783 wait complete. 2023-10-05T21:15:11.627 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2023-10-05T21:15:11.627 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2023-10-05T21:15:11.628 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2023-10-05T21:15:11.672 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:11.672 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:11.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.671+0000 7f183cc31680 1 Processor -- start 2023-10-05T21:15:11.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.671+0000 7f183cc31680 1 -- start start 2023-10-05T21:15:11.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.671+0000 7f183cc31680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5579cc7ae7b0 0x5579cc7aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.671+0000 7f183cc31680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5579cc6fd990 con 0x5579cc7af100 2023-10-05T21:15:11.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.671+0000 7f183cc31680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x5579cc6bddb0 con 0x5579cc7ae7b0 2023-10-05T21:15:11.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.672+0000 7f182f508700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x5579cc7af100 0x5579cc7b19b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56140/0 (socket says 172.21.15.153:56140) 2023-10-05T21:15:11.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.672+0000 7f182f508700 1 -- 172.21.15.153:0/1531322801 learned_addr learned my addr 172.21.15.153:0/1531322801 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:11.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.672+0000 7f182fd09700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5579cc7ae7b0 0x5579cc7aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.672+0000 7f182ed07700 1 -- 172.21.15.153:0/1531322801 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 418883710 0 0) 0x5579cc6fd990 con 0x5579cc7af100 2023-10-05T21:15:11.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.672+0000 7f182ed07700 1 -- 172.21.15.153:0/1531322801 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1818001e10 con 0x5579cc7af100 2023-10-05T21:15:11.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.672+0000 7f182fd09700 1 -- 172.21.15.153:0/1531322801 >> v1:172.21.15.111:6789/0 conn(0x5579cc7af100 legacy=0x5579cc7b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.672+0000 7f182fd09700 1 -- 172.21.15.153:0/1531322801 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5579cc7b21b0 con 0x5579cc7ae7b0 2023-10-05T21:15:11.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.672+0000 7f182fd09700 1 --2- 172.21.15.153:0/1531322801 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5579cc7ae7b0 0x5579cc7aebc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f182400a5d0 tx=0x7f1824005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c8d66817c553b0e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.672+0000 7f182ed07700 1 -- 172.21.15.153:0/1531322801 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1824007610 con 0x5579cc7ae7b0 2023-10-05T21:15:11.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.672+0000 7f182ed07700 1 -- 172.21.15.153:0/1531322801 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1824007770 con 0x5579cc7ae7b0 2023-10-05T21:15:11.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.672+0000 7f182ed07700 1 -- 172.21.15.153:0/1531322801 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1824007a40 con 0x5579cc7ae7b0 2023-10-05T21:15:11.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.673+0000 7f183cc31680 1 -- 172.21.15.153:0/1531322801 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5579cc7ae7b0 msgr2=0x5579cc7aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.673+0000 7f183cc31680 1 --2- 172.21.15.153:0/1531322801 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5579cc7ae7b0 0x5579cc7aebc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f182400a5d0 tx=0x7f1824005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:11.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.673+0000 7f183cc31680 1 -- 172.21.15.153:0/1531322801 shutdown_connections 2023-10-05T21:15:11.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.673+0000 7f183cc31680 1 --2- 172.21.15.153:0/1531322801 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5579cc7ae7b0 0x5579cc7aebc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.673+0000 7f183cc31680 1 -- 172.21.15.153:0/1531322801 >> 172.21.15.153:0/1531322801 conn(0x5579cc7aa300 msgr2=0x5579cc7ac710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:11.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.673+0000 7f183cc31680 1 -- 172.21.15.153:0/1531322801 shutdown_connections 2023-10-05T21:15:11.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.673+0000 7f183cc31680 1 -- 172.21.15.153:0/1531322801 wait complete. 2023-10-05T21:15:11.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.673+0000 7f183cc31680 1 Processor -- start 2023-10-05T21:15:11.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.673+0000 7f183cc31680 1 -- start start 2023-10-05T21:15:11.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.673+0000 7f183cc31680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5579cc7ae7b0 0x5579cc7b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.673+0000 7f183cc31680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579cc65dea0 con 0x5579cc7ae7b0 2023-10-05T21:15:11.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.674+0000 7f182fd09700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5579cc7ae7b0 0x5579cc7b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.674+0000 7f182fd09700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5579cc7ae7b0 0x5579cc7b1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49072/0 (socket says 172.21.15.153:49072) 2023-10-05T21:15:11.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.674+0000 7f182fd09700 1 -- 172.21.15.153:0/4033301848 learned_addr learned my addr 172.21.15.153:0/4033301848 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:11.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.674+0000 7f182fd09700 1 -- 172.21.15.153:0/4033301848 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1824005cf0 con 0x5579cc7ae7b0 2023-10-05T21:15:11.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.674+0000 7f182fd09700 1 --2- 172.21.15.153:0/4033301848 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5579cc7ae7b0 0x5579cc7b1200 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1824005a90 tx=0x7f1824014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d19c199b783d60f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.674+0000 7f182dd05700 1 -- 172.21.15.153:0/4033301848 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18240078e0 con 0x5579cc7ae7b0 2023-10-05T21:15:11.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.674+0000 7f182dd05700 1 -- 172.21.15.153:0/4033301848 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1824007a40 con 0x5579cc7ae7b0 2023-10-05T21:15:11.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.674+0000 7f182dd05700 1 -- 172.21.15.153:0/4033301848 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1824007bb0 con 0x5579cc7ae7b0 2023-10-05T21:15:11.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.675+0000 7f183cc31680 1 -- 172.21.15.153:0/4033301848 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5579cc7ae7b0 msgr2=0x5579cc7b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.675+0000 7f183cc31680 1 --2- 172.21.15.153:0/4033301848 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5579cc7ae7b0 0x5579cc7b1200 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1824005a90 tx=0x7f1824014000 comp rx=0 tx=0).stop 2023-10-05T21:15:11.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.675+0000 7f183cc31680 1 -- 172.21.15.153:0/4033301848 shutdown_connections 2023-10-05T21:15:11.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.675+0000 7f183cc31680 1 --2- 172.21.15.153:0/4033301848 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5579cc7ae7b0 0x5579cc7b1200 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.675+0000 7f183cc31680 1 -- 172.21.15.153:0/4033301848 >> 172.21.15.153:0/4033301848 conn(0x5579cc7aa300 msgr2=0x5579cc7cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:11.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.675+0000 7f183cc31680 1 -- 172.21.15.153:0/4033301848 shutdown_connections 2023-10-05T21:15:11.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.675+0000 7f183cc31680 1 -- 172.21.15.153:0/4033301848 wait complete. 2023-10-05T21:15:11.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.675+0000 7f183cc31680 1 Processor -- start 2023-10-05T21:15:11.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.675+0000 7f183cc31680 1 -- start start 2023-10-05T21:15:11.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.675+0000 7f183cc31680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5579cc7ae7b0 0x5579cc7d8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.675+0000 7f183cc31680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579cc654c80 con 0x5579cc7ae7b0 2023-10-05T21:15:11.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.675+0000 7f182fd09700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5579cc7ae7b0 0x5579cc7d8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.675+0000 7f182fd09700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5579cc7ae7b0 0x5579cc7d8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49084/0 (socket says 172.21.15.153:49084) 2023-10-05T21:15:11.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.675+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 learned_addr learned my addr 172.21.15.153:0/693680929 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:11.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.676+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5579cc7b21b0 con 0x5579cc7ae7b0 2023-10-05T21:15:11.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.676+0000 7f182fd09700 1 --2- 172.21.15.153:0/693680929 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5579cc7ae7b0 0x5579cc7d8f70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1824005a90 tx=0x7f182401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.676+0000 7f1817fff700 1 -- 172.21.15.153:0/693680929 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1824026440 con 0x5579cc7ae7b0 2023-10-05T21:15:11.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.676+0000 7f1817fff700 1 -- 172.21.15.153:0/693680929 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18240265a0 con 0x5579cc7ae7b0 2023-10-05T21:15:11.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.676+0000 7f1817fff700 1 -- 172.21.15.153:0/693680929 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1824026750 con 0x5579cc7ae7b0 2023-10-05T21:15:11.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.676+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5579cc7d94b0 con 0x5579cc7ae7b0 2023-10-05T21:15:11.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.676+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5579cc7d9900 con 0x5579cc7ae7b0 2023-10-05T21:15:11.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.677+0000 7f183cc31680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.677+0000 7f1817fff700 1 -- 172.21.15.153:0/693680929 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f18240269c0 con 0x5579cc7ae7b0 2023-10-05T21:15:11.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.677+0000 7f1817fff700 1 --2- 172.21.15.153:0/693680929 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f181c0340f0 0x7f181c0365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.677+0000 7f1817fff700 1 -- 172.21.15.153:0/693680929 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f182404a500 con 0x5579cc7ae7b0 2023-10-05T21:15:11.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.677+0000 7f182f508700 1 --2- 172.21.15.153:0/693680929 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f181c0340f0 0x7f181c0365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.677+0000 7f183cc31680 1 --2- 172.21.15.153:0/693680929 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5579cc7af100 0x5579cc7e4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.678+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7e5490 con 0x5579cc7af100 2023-10-05T21:15:11.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.678+0000 7f183050a700 1 --2- 172.21.15.153:0/693680929 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5579cc7af100 0x5579cc7e4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.678+0000 7f182f508700 1 --2- 172.21.15.153:0/693680929 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f181c0340f0 0x7f181c0365a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1820004170 tx=0x7f1820001360 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.678+0000 7f183050a700 1 --2- 172.21.15.153:0/693680929 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5579cc7af100 0x5579cc7e4d00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.678+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.678+0000 7f183cc31680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.678+0000 7f183cc31680 20 realm 2023-10-05T21:15:11.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.678+0000 7f183cc31680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.678+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7e22e0 con 0x5579cc7af100 2023-10-05T21:15:11.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.678+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.678+0000 7f183cc31680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.678+0000 7f183cc31680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:11.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.678+0000 7f183cc31680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.678+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7e5f90 con 0x5579cc7af100 2023-10-05T21:15:11.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.679+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.679+0000 7f183cc31680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.679+0000 7f183cc31680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.679+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7e68b0 con 0x5579cc7af100 2023-10-05T21:15:11.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.679+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.679+0000 7f183cc31680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:11.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.679+0000 7f183cc31680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.679+0000 7f183cc31680 1 --2- 172.21.15.153:0/693680929 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5579cc7e7170 0x5579cc7e9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.679+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7e9ba0 con 0x5579cc7e7170 2023-10-05T21:15:11.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.679+0000 7f182fd09700 1 --2- 172.21.15.153:0/693680929 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5579cc7e7170 0x5579cc7e9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.679+0000 7f182fd09700 1 --2- 172.21.15.153:0/693680929 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5579cc7e7170 0x5579cc7e9550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.680+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc7e7170 2023-10-05T21:15:11.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.680+0000 7f183cc31680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:11.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.680+0000 7f183cc31680 20 searching for the correct realm 2023-10-05T21:15:11.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.680+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x5579cc7e7170 2023-10-05T21:15:11.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.680+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc7e7170 2023-10-05T21:15:11.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.680+0000 7f182fd09700 1 --2- 172.21.15.153:0/693680929 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f1824007030 0x7f18240245f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.680+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x7f1824007030 2023-10-05T21:15:11.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.680+0000 7f182f508700 1 --2- 172.21.15.153:0/693680929 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f1824007030 0x7f18240245f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.680+0000 7f182f508700 1 --2- 172.21.15.153:0/693680929 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f1824007030 0x7f18240245f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.681+0000 7f182f508700 1 -- 172.21.15.153:0/693680929 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1820006070 con 0x7f1824007030 2023-10-05T21:15:11.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.681+0000 7f182f508700 1 --2- 172.21.15.153:0/693680929 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f182000ebe0 0x7f182000d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.681+0000 7f182f508700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x7f182000ebe0 2023-10-05T21:15:11.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.681+0000 7f183050a700 1 --2- 172.21.15.153:0/693680929 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f182000ebe0 0x7f182000d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.681+0000 7f183050a700 1 --2- 172.21.15.153:0/693680929 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f182000ebe0 0x7f182000d8e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.681+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a570 con 0x7f182000ebe0 2023-10-05T21:15:11.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.681+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x5579cc7af100 2023-10-05T21:15:11.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.682+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.682+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x5579cc7af100 2023-10-05T21:15:11.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.682+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.682+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x7f182000ebe0 2023-10-05T21:15:11.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.682+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a570 con 0x7f182000ebe0 2023-10-05T21:15:11.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.682+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x7f182000ebe0 2023-10-05T21:15:11.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.682+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a570 con 0x7f182000ebe0 2023-10-05T21:15:11.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.682+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x7f1824007030 2023-10-05T21:15:11.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.683+0000 7f182f508700 1 -- 172.21.15.153:0/693680929 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1820006070 con 0x7f1824007030 2023-10-05T21:15:11.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.683+0000 7f182f508700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x5579cc7e7170 2023-10-05T21:15:11.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.683+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc7e7170 2023-10-05T21:15:11.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.683+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x5579cc7af100 2023-10-05T21:15:11.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.683+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.683+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x7f182000ebe0 2023-10-05T21:15:11.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.683+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a570 con 0x7f182000ebe0 2023-10-05T21:15:11.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.683+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x5579cc7af100 2023-10-05T21:15:11.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.683+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.683+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x7f1824007030 2023-10-05T21:15:11.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.684+0000 7f182f508700 1 -- 172.21.15.153:0/693680929 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1820006070 con 0x7f1824007030 2023-10-05T21:15:11.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.684+0000 7f182f508700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x5579cc7e7170 2023-10-05T21:15:11.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.684+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc7e7170 2023-10-05T21:15:11.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.684+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x5579cc7e7170 2023-10-05T21:15:11.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.684+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc7e7170 2023-10-05T21:15:11.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.684+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x7f182000ebe0 2023-10-05T21:15:11.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.684+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a570 con 0x7f182000ebe0 2023-10-05T21:15:11.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.684+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x5579cc7e7170 2023-10-05T21:15:11.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.685+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc7e7170 2023-10-05T21:15:11.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.685+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x5579cc7e7170 2023-10-05T21:15:11.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.685+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc7e7170 2023-10-05T21:15:11.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.685+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x5579cc7af100 2023-10-05T21:15:11.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.685+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.685+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x5579cc7af100 2023-10-05T21:15:11.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.685+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.685+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x7f182000ebe0 2023-10-05T21:15:11.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.685+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a570 con 0x7f182000ebe0 2023-10-05T21:15:11.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.685+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x5579cc7e7170 2023-10-05T21:15:11.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.686+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc7e7170 2023-10-05T21:15:11.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.686+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x7f1824007030 2023-10-05T21:15:11.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.686+0000 7f182f508700 1 -- 172.21.15.153:0/693680929 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1820006070 con 0x7f1824007030 2023-10-05T21:15:11.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.686+0000 7f182f508700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x5579cc7af100 2023-10-05T21:15:11.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.686+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.686+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x7f182000ebe0 2023-10-05T21:15:11.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.686+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a570 con 0x7f182000ebe0 2023-10-05T21:15:11.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.686+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x5579cc7e7170 2023-10-05T21:15:11.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.687+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc7e7170 2023-10-05T21:15:11.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.687+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x7f182000ebe0 2023-10-05T21:15:11.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.687+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a570 con 0x7f182000ebe0 2023-10-05T21:15:11.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.687+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x7f1824007030 2023-10-05T21:15:11.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.687+0000 7f182f508700 1 -- 172.21.15.153:0/693680929 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1820006070 con 0x7f1824007030 2023-10-05T21:15:11.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.687+0000 7f182f508700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x5579cc7e7170 2023-10-05T21:15:11.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.687+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc7e7170 2023-10-05T21:15:11.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.687+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x7f182000ebe0 2023-10-05T21:15:11.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.688+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a570 con 0x7f182000ebe0 2023-10-05T21:15:11.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.688+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x5579cc7af100 2023-10-05T21:15:11.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.688+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.688+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eb680 con 0x7f1824007030 2023-10-05T21:15:11.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.688+0000 7f182f508700 1 -- 172.21.15.153:0/693680929 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1820006070 con 0x7f1824007030 2023-10-05T21:15:11.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.688+0000 7f183cc31680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:11.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.688+0000 7f183cc31680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:11.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.688+0000 7f183cc31680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:11.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.688+0000 7f183cc31680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:11.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.688+0000 7f183cc31680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.688+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ea5d0 con 0x5579cc7af100 2023-10-05T21:15:11.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.688+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.688+0000 7f183cc31680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.688+0000 7f183cc31680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.688+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ea9d0 con 0x5579cc7af100 2023-10-05T21:15:11.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.689+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.689+0000 7f183cc31680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:11.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.689+0000 7f183cc31680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.689+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ebb10 con 0x5579cc7af100 2023-10-05T21:15:11.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.689+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.689+0000 7f183cc31680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:11.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.689+0000 7f183cc31680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.689+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ebec0 con 0x5579cc7e7170 2023-10-05T21:15:11.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.689+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc7e7170 2023-10-05T21:15:11.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.689+0000 7f183cc31680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.689+0000 7f183cc31680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.689+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ec270 con 0x5579cc7af100 2023-10-05T21:15:11.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.689+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.689+0000 7f183cc31680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.689+0000 7f183cc31680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.689+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ec270 con 0x5579cc7af100 2023-10-05T21:15:11.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.690+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.690+0000 7f183cc31680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:11.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.690+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ec270 con 0x5579cc7e7170 2023-10-05T21:15:11.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.690+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc7e7170 2023-10-05T21:15:11.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.690+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ec270 con 0x7f1824007030 2023-10-05T21:15:11.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.690+0000 7f182f508700 1 -- 172.21.15.153:0/693680929 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1820006070 con 0x7f1824007030 2023-10-05T21:15:11.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.690+0000 7f182f508700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ec270 con 0x7f182000ebe0 2023-10-05T21:15:11.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.691+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a570 con 0x7f182000ebe0 2023-10-05T21:15:11.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.691+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ebb10 con 0x5579cc7af100 2023-10-05T21:15:11.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.691+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.691+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ebb10 con 0x5579cc7af100 2023-10-05T21:15:11.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.691+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.691+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ebb10 con 0x7f182000ebe0 2023-10-05T21:15:11.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.691+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a570 con 0x7f182000ebe0 2023-10-05T21:15:11.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.691+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ebb10 con 0x7f182000ebe0 2023-10-05T21:15:11.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.692+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a570 con 0x7f182000ebe0 2023-10-05T21:15:11.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.692+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ebb10 con 0x7f1824007030 2023-10-05T21:15:11.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.692+0000 7f182f508700 1 -- 172.21.15.153:0/693680929 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1820006070 con 0x7f1824007030 2023-10-05T21:15:11.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.692+0000 7f182f508700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ebb10 con 0x5579cc7e7170 2023-10-05T21:15:11.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.692+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc7e7170 2023-10-05T21:15:11.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.692+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ebb10 con 0x5579cc7af100 2023-10-05T21:15:11.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.692+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.692+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ebb10 con 0x7f182000ebe0 2023-10-05T21:15:11.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.692+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a570 con 0x7f182000ebe0 2023-10-05T21:15:11.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.692+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ebb10 con 0x5579cc7af100 2023-10-05T21:15:11.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.693+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.693+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ebb10 con 0x7f1824007030 2023-10-05T21:15:11.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.693+0000 7f182f508700 1 -- 172.21.15.153:0/693680929 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1820006070 con 0x7f1824007030 2023-10-05T21:15:11.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.693+0000 7f182f508700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ebb10 con 0x5579cc7e7170 2023-10-05T21:15:11.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.693+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc7e7170 2023-10-05T21:15:11.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.693+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ebb10 con 0x5579cc7e7170 2023-10-05T21:15:11.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.693+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc7e7170 2023-10-05T21:15:11.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.693+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ebb10 con 0x7f182000ebe0 2023-10-05T21:15:11.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.694+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a570 con 0x7f182000ebe0 2023-10-05T21:15:11.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.694+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ebb10 con 0x5579cc7e7170 2023-10-05T21:15:11.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.694+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc7e7170 2023-10-05T21:15:11.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.694+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ebb10 con 0x5579cc7e7170 2023-10-05T21:15:11.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.694+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc7e7170 2023-10-05T21:15:11.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.694+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ebb10 con 0x5579cc7af100 2023-10-05T21:15:11.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.694+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.694+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ebb10 con 0x5579cc7af100 2023-10-05T21:15:11.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.694+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.694+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ebb10 con 0x7f182000ebe0 2023-10-05T21:15:11.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.695+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a570 con 0x7f182000ebe0 2023-10-05T21:15:11.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.695+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ebb10 con 0x5579cc7e7170 2023-10-05T21:15:11.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.695+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc7e7170 2023-10-05T21:15:11.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.695+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ebb10 con 0x7f1824007030 2023-10-05T21:15:11.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.695+0000 7f182f508700 1 -- 172.21.15.153:0/693680929 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1820006070 con 0x7f1824007030 2023-10-05T21:15:11.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.695+0000 7f182f508700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ebb10 con 0x5579cc7af100 2023-10-05T21:15:11.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.695+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.695+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ebb10 con 0x7f182000ebe0 2023-10-05T21:15:11.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.695+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a570 con 0x7f182000ebe0 2023-10-05T21:15:11.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.696+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ebb10 con 0x5579cc7e7170 2023-10-05T21:15:11.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.696+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc7e7170 2023-10-05T21:15:11.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.696+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ebb10 con 0x7f182000ebe0 2023-10-05T21:15:11.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.696+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a570 con 0x7f182000ebe0 2023-10-05T21:15:11.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.696+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ebb10 con 0x7f1824007030 2023-10-05T21:15:11.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.696+0000 7f182f508700 1 -- 172.21.15.153:0/693680929 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1820006070 con 0x7f1824007030 2023-10-05T21:15:11.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.696+0000 7f182f508700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ebb10 con 0x5579cc7e7170 2023-10-05T21:15:11.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.696+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc7e7170 2023-10-05T21:15:11.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.696+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ebb10 con 0x7f182000ebe0 2023-10-05T21:15:11.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.697+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182800a570 con 0x7f182000ebe0 2023-10-05T21:15:11.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.697+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ebb10 con 0x5579cc7af100 2023-10-05T21:15:11.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.697+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.697+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ebb10 con 0x7f1824007030 2023-10-05T21:15:11.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.697+0000 7f182f508700 1 -- 172.21.15.153:0/693680929 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1820006070 con 0x7f1824007030 2023-10-05T21:15:11.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.697+0000 7f183cc31680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:11.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.697+0000 7f183cc31680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:11.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.697+0000 7f183cc31680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:11.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.697+0000 7f183cc31680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:11.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.697+0000 7f183cc31680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.697+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ec270 con 0x5579cc7af100 2023-10-05T21:15:11.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.697+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.697+0000 7f183cc31680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:11.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.697+0000 7f183cc31680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.697+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ec6a0 con 0x5579cc7e7170 2023-10-05T21:15:11.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.698+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc7e7170 2023-10-05T21:15:11.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.698+0000 7f183cc31680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:11.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.698+0000 7f183cc31680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.698+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ecf90 con 0x5579cc7af100 2023-10-05T21:15:11.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.698+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.698+0000 7f183cc31680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:11.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.698+0000 7f183cc31680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.698+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ecf90 con 0x5579cc7af100 2023-10-05T21:15:11.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.698+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.698+0000 7f183cc31680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:11.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.698+0000 7f183cc31680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.698+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ed090 con 0x7f182000ebe0 2023-10-05T21:15:11.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.699+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f182800a570 con 0x7f182000ebe0 2023-10-05T21:15:11.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.699+0000 7f183cc31680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.699+0000 7f183cc31680 20 zone default found 2023-10-05T21:15:11.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.699+0000 7f183cc31680 4 Realm: () 2023-10-05T21:15:11.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.699+0000 7f183cc31680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:11.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.699+0000 7f183cc31680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:11.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.699+0000 7f183cc31680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:11.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.699+0000 7f183cc31680 20 zonegroup default 2023-10-05T21:15:11.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.699+0000 7f183cc31680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.699+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ed090 con 0x7f182000ebe0 2023-10-05T21:15:11.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.699+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f182800a570 con 0x7f182000ebe0 2023-10-05T21:15:11.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.699+0000 7f183cc31680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.699+0000 7f183cc31680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.699+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eea10 con 0x5579cc7e7170 2023-10-05T21:15:11.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.699+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc7e7170 2023-10-05T21:15:11.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.699+0000 7f183cc31680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.699+0000 7f183cc31680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.699+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eedc0 con 0x5579cc7e7170 2023-10-05T21:15:11.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.700+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc7e7170 2023-10-05T21:15:11.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.700+0000 7f183cc31680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.700+0000 7f183cc31680 20 started sync module instance, tier type = 2023-10-05T21:15:11.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.700+0000 7f183cc31680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:11.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.700+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ee0d0 con 0x7f1824007030 2023-10-05T21:15:11.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.700+0000 7f182f508700 1 -- 172.21.15.153:0/693680929 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1820006070 con 0x7f1824007030 2023-10-05T21:15:11.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.700+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93981610271872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ef660 con 0x7f1824007030 2023-10-05T21:15:11.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.700+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eff00 con 0x5579cc7af100 2023-10-05T21:15:11.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.701+0000 7f182f508700 1 -- 172.21.15.153:0/693680929 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 93981610271872] v29'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1820006070 con 0x7f1824007030 2023-10-05T21:15:11.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.701+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.701+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93981610277392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ef2b0 con 0x5579cc7af100 2023-10-05T21:15:11.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.701+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7f0b50 con 0x5579cc7e7170 2023-10-05T21:15:11.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.702+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 93981610277392] v29'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.702+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc7e7170 2023-10-05T21:15:11.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.702+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93981610280448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7f0f50 con 0x5579cc7e7170 2023-10-05T21:15:11.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.702+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7f1960 con 0x7f1824007030 2023-10-05T21:15:11.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.703+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 93981610280448] v29'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc7e7170 2023-10-05T21:15:11.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.703+0000 7f182f508700 1 -- 172.21.15.153:0/693680929 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1820006070 con 0x7f1824007030 2023-10-05T21:15:11.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.703+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 93981610278496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7f15b0 con 0x7f1824007030 2023-10-05T21:15:11.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.703+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7f29f0 con 0x5579cc7af100 2023-10-05T21:15:11.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.703+0000 7f182f508700 1 -- 172.21.15.153:0/693680929 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 93981610278496] v29'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1820006070 con 0x7f1824007030 2023-10-05T21:15:11.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.704+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.704+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 93981610288256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7f2df0 con 0x5579cc7af100 2023-10-05T21:15:11.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.704+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7f3880 con 0x7f182000ebe0 2023-10-05T21:15:11.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.704+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 93981610288256] v29'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.704+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182800a570 con 0x7f182000ebe0 2023-10-05T21:15:11.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.704+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 93981610292080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7f3880 con 0x7f182000ebe0 2023-10-05T21:15:11.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.704+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7f4320 con 0x7f182000ebe0 2023-10-05T21:15:11.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.705+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(96 notify.6 [create] v29'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182800a570 con 0x7f182000ebe0 2023-10-05T21:15:11.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.705+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(95 notify.5 [watch watch cookie 93981610292080] v29'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182800a570 con 0x7f182000ebe0 2023-10-05T21:15:11.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.705+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93981610294768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7f4790 con 0x7f182000ebe0 2023-10-05T21:15:11.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.705+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7f1d70 con 0x7f182000ebe0 2023-10-05T21:15:11.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.706+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 93981610294768] v29'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182800a570 con 0x7f182000ebe0 2023-10-05T21:15:11.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.706+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182800a570 con 0x7f182000ebe0 2023-10-05T21:15:11.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.706+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93981610286384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7f4df0 con 0x7f182000ebe0 2023-10-05T21:15:11.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.706+0000 7f183cc31680 20 add_watcher() i=0 2023-10-05T21:15:11.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.706+0000 7f183cc31680 20 add_watcher() i=1 2023-10-05T21:15:11.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.706+0000 7f183cc31680 20 add_watcher() i=2 2023-10-05T21:15:11.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.706+0000 7f183cc31680 20 add_watcher() i=3 2023-10-05T21:15:11.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.706+0000 7f183cc31680 20 add_watcher() i=4 2023-10-05T21:15:11.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.706+0000 7f183cc31680 20 add_watcher() i=5 2023-10-05T21:15:11.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.706+0000 7f183cc31680 20 add_watcher() i=6 2023-10-05T21:15:11.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.706+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 93981610286384] v29'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182800a570 con 0x7f182000ebe0 2023-10-05T21:15:11.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.706+0000 7f183cc31680 20 add_watcher() i=7 2023-10-05T21:15:11.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.706+0000 7f183cc31680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:11.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.706+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7f8310 con 0x5579cc7af100 2023-10-05T21:15:11.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.707+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.707+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93981610298864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7f5730 con 0x5579cc7af100 2023-10-05T21:15:11.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.707+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 93981610298864] v29'31 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.708+0000 7f18017e2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:11.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.708+0000 7f183cc31680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:11.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.708+0000 7f183cc31680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:11.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.708+0000 7f183cc31680 1 Processor -- start 2023-10-05T21:15:11.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.708+0000 7f183cc31680 1 -- start start 2023-10-05T21:15:11.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.708+0000 7f183cc31680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5579cc801dc0 0x5579cc8021d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.708+0000 7f183cc31680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579cc8027e0 con 0x5579cc801dc0 2023-10-05T21:15:11.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.708+0000 7f182f508700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5579cc801dc0 0x5579cc8021d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.708+0000 7f182f508700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5579cc801dc0 0x5579cc8021d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49096/0 (socket says 172.21.15.153:49096) 2023-10-05T21:15:11.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.708+0000 7f182f508700 1 -- 172.21.15.153:0/2366504758 learned_addr learned my addr 172.21.15.153:0/2366504758 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:11.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.709+0000 7f182f508700 1 -- 172.21.15.153:0/2366504758 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5579cc802cc0 con 0x5579cc801dc0 2023-10-05T21:15:11.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.709+0000 7f182f508700 1 --2- 172.21.15.153:0/2366504758 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5579cc801dc0 0x5579cc8021d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f182000c010 tx=0x7f1820006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de4d2cc9c03e484 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.709+0000 7f1800fe1700 1 -- 172.21.15.153:0/2366504758 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1820023040 con 0x5579cc801dc0 2023-10-05T21:15:11.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.709+0000 7f1800fe1700 1 -- 172.21.15.153:0/2366504758 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1820024040 con 0x5579cc801dc0 2023-10-05T21:15:11.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.709+0000 7f1800fe1700 1 -- 172.21.15.153:0/2366504758 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1820013040 con 0x5579cc801dc0 2023-10-05T21:15:11.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.709+0000 7f183cc31680 1 -- 172.21.15.153:0/2366504758 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5579cc801dc0 msgr2=0x5579cc8021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.709+0000 7f183cc31680 1 --2- 172.21.15.153:0/2366504758 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5579cc801dc0 0x5579cc8021d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f182000c010 tx=0x7f1820006000 comp rx=0 tx=0).stop 2023-10-05T21:15:11.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.710+0000 7f183cc31680 1 -- 172.21.15.153:0/2366504758 shutdown_connections 2023-10-05T21:15:11.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.710+0000 7f183cc31680 1 --2- 172.21.15.153:0/2366504758 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5579cc801dc0 0x5579cc8021d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.710+0000 7f183cc31680 1 -- 172.21.15.153:0/2366504758 >> 172.21.15.153:0/2366504758 conn(0x5579cc7fe0c0 msgr2=0x5579cc7fc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:11.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.710+0000 7f183cc31680 1 -- 172.21.15.153:0/2366504758 shutdown_connections 2023-10-05T21:15:11.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.710+0000 7f183cc31680 1 -- 172.21.15.153:0/2366504758 wait complete. 2023-10-05T21:15:11.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.710+0000 7f183cc31680 1 Processor -- start 2023-10-05T21:15:11.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.710+0000 7f183cc31680 1 -- start start 2023-10-05T21:15:11.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.710+0000 7f183cc31680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5579cc801dc0 0x5579cc808b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.710+0000 7f183cc31680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579cc8090b0 con 0x5579cc801dc0 2023-10-05T21:15:11.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.710+0000 7f182f508700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5579cc801dc0 0x5579cc808b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.710+0000 7f182f508700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5579cc801dc0 0x5579cc808b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49110/0 (socket says 172.21.15.153:49110) 2023-10-05T21:15:11.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.710+0000 7f182f508700 1 -- 172.21.15.153:0/1682924416 learned_addr learned my addr 172.21.15.153:0/1682924416 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:11.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.711+0000 7f182f508700 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1818001e10 con 0x5579cc801dc0 2023-10-05T21:15:11.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.711+0000 7f182f508700 1 --2- 172.21.15.153:0/1682924416 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5579cc801dc0 0x5579cc808b70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x5579cc7fd630 tx=0x7f1820030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.711+0000 7f177affd700 1 -- 172.21.15.153:0/1682924416 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1820023070 con 0x5579cc801dc0 2023-10-05T21:15:11.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.711+0000 7f177affd700 1 -- 172.21.15.153:0/1682924416 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182001e780 con 0x5579cc801dc0 2023-10-05T21:15:11.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.711+0000 7f177affd700 1 -- 172.21.15.153:0/1682924416 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f182001e930 con 0x5579cc801dc0 2023-10-05T21:15:11.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.711+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5579cc8092b0 con 0x5579cc801dc0 2023-10-05T21:15:11.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.711+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5579cc809700 con 0x5579cc801dc0 2023-10-05T21:15:11.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.712+0000 7f177affd700 1 -- 172.21.15.153:0/1682924416 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f182003f040 con 0x5579cc801dc0 2023-10-05T21:15:11.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.712+0000 7f177affd700 1 --2- 172.21.15.153:0/1682924416 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1770034140 0x7f17700365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.712+0000 7f177affd700 1 -- 172.21.15.153:0/1682924416 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f1820042ab0 con 0x5579cc801dc0 2023-10-05T21:15:11.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.712+0000 7f183050a700 1 --2- 172.21.15.153:0/1682924416 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1770034140 0x7f17700365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.712+0000 7f183cc31680 1 --2- 172.21.15.153:0/1682924416 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5579cc813970 0x5579cc815e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.712+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc8164d0 con 0x5579cc813970 2023-10-05T21:15:11.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.712+0000 7f182fd09700 1 --2- 172.21.15.153:0/1682924416 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5579cc813970 0x5579cc815e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.712+0000 7f183050a700 1 --2- 172.21.15.153:0/1682924416 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1770034140 0x7f17700365f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x5579cc7f44d0 tx=0x7f1828037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.712+0000 7f182fd09700 1 --2- 172.21.15.153:0/1682924416 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5579cc813970 0x5579cc815e20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.713+0000 7f182fd09700 1 -- 172.21.15.153:0/1682924416 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v29'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc813970 2023-10-05T21:15:11.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.713+0000 7f183cc31680 1 --2- 172.21.15.153:0/1682924416 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x5579cc817170 0x5579cc819570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.713+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc819cc0 con 0x5579cc817170 2023-10-05T21:15:11.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.713+0000 7f182f508700 1 --2- 172.21.15.153:0/1682924416 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x5579cc817170 0x5579cc819570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.714+0000 7f182f508700 1 --2- 172.21.15.153:0/1682924416 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x5579cc817170 0x5579cc819570 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.714+0000 7f182f508700 1 -- 172.21.15.153:0/1682924416 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v29'11 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1820006070 con 0x5579cc817170 2023-10-05T21:15:11.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.715+0000 7f183cc31680 1 --2- 172.21.15.153:0/1682924416 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5579cc81ae30 0x5579cc81d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.715+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc81da00 con 0x5579cc81ae30 2023-10-05T21:15:11.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.715+0000 7f183050a700 1 --2- 172.21.15.153:0/1682924416 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5579cc81ae30 0x5579cc81d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.715+0000 7f183050a700 1 --2- 172.21.15.153:0/1682924416 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5579cc81ae30 0x5579cc81d2b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.716+0000 7f183050a700 1 -- 172.21.15.153:0/1682924416 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v29'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f182800a570 con 0x5579cc81ae30 2023-10-05T21:15:11.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.716+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc81e130 con 0x5579cc813970 2023-10-05T21:15:11.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.716+0000 7f182fd09700 1 -- 172.21.15.153:0/1682924416 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v29'32 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc813970 2023-10-05T21:15:11.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.716+0000 7f183cc31680 1 --2- 172.21.15.153:0/1682924416 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x5579cc81eeb0 0x5579cc821290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.716+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc821990 con 0x5579cc81eeb0 2023-10-05T21:15:11.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.716+0000 7f182fd09700 1 --2- 172.21.15.153:0/1682924416 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x5579cc81eeb0 0x5579cc821290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.717+0000 7f182fd09700 1 --2- 172.21.15.153:0/1682924416 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x5579cc81eeb0 0x5579cc821290 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.717+0000 7f182fd09700 1 -- 172.21.15.153:0/1682924416 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v29'23 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc81eeb0 2023-10-05T21:15:11.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.717+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc8220a0 con 0x5579cc81ae30 2023-10-05T21:15:11.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.718+0000 7f183050a700 1 -- 172.21.15.153:0/1682924416 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v29'15 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f182800a570 con 0x5579cc81ae30 2023-10-05T21:15:11.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.718+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc822740 con 0x5579cc813970 2023-10-05T21:15:11.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.719+0000 7f182fd09700 1 -- 172.21.15.153:0/1682924416 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v29'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc813970 2023-10-05T21:15:11.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.719+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc822740 con 0x5579cc817170 2023-10-05T21:15:11.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.720+0000 7f182f508700 1 -- 172.21.15.153:0/1682924416 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v29'15 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1820006070 con 0x5579cc817170 2023-10-05T21:15:11.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.720+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc822da0 con 0x5579cc81eeb0 2023-10-05T21:15:11.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.720+0000 7f182fd09700 1 -- 172.21.15.153:0/1682924416 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v29'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc81eeb0 2023-10-05T21:15:11.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.720+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc822da0 con 0x5579cc81ae30 2023-10-05T21:15:11.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.721+0000 7f183050a700 1 -- 172.21.15.153:0/1682924416 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v29'17 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f182800a570 con 0x5579cc81ae30 2023-10-05T21:15:11.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.721+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc823290 con 0x5579cc81eeb0 2023-10-05T21:15:11.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.722+0000 7f182fd09700 1 -- 172.21.15.153:0/1682924416 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v29'24 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc81eeb0 2023-10-05T21:15:11.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.722+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc823290 con 0x5579cc817170 2023-10-05T21:15:11.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.723+0000 7f182f508700 1 -- 172.21.15.153:0/1682924416 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v29'13 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1820006070 con 0x5579cc817170 2023-10-05T21:15:11.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.723+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc811120 con 0x5579cc81eeb0 2023-10-05T21:15:11.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.723+0000 7f182fd09700 1 -- 172.21.15.153:0/1682924416 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v29'11 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc81eeb0 2023-10-05T21:15:11.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.723+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc811120 con 0x5579cc817170 2023-10-05T21:15:11.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.724+0000 7f182f508700 1 -- 172.21.15.153:0/1682924416 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v29'21 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1820006070 con 0x5579cc817170 2023-10-05T21:15:11.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.724+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc811120 con 0x5579cc813970 2023-10-05T21:15:11.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.725+0000 7f182fd09700 1 -- 172.21.15.153:0/1682924416 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v29'33 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc813970 2023-10-05T21:15:11.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.725+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc810eb0 con 0x5579cc81ae30 2023-10-05T21:15:11.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.726+0000 7f183050a700 1 -- 172.21.15.153:0/1682924416 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v29'17 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f182800a570 con 0x5579cc81ae30 2023-10-05T21:15:11.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.726+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc811120 con 0x5579cc81eeb0 2023-10-05T21:15:11.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.726+0000 7f182fd09700 1 -- 172.21.15.153:0/1682924416 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v29'25 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc81eeb0 2023-10-05T21:15:11.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.726+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc811120 con 0x5579cc81ae30 2023-10-05T21:15:11.754 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-10-05T21:15:11.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.727+0000 7f183050a700 1 -- 172.21.15.153:0/1682924416 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v29'11 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f182800a570 con 0x5579cc81ae30 2023-10-05T21:15:11.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.727+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc811120 con 0x5579cc813970 2023-10-05T21:15:11.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.728+0000 7f182fd09700 1 -- 172.21.15.153:0/1682924416 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v29'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc813970 2023-10-05T21:15:11.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.728+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc811120 con 0x5579cc813970 2023-10-05T21:15:11.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.729+0000 7f182fd09700 1 -- 172.21.15.153:0/1682924416 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v29'34 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc813970 2023-10-05T21:15:11.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.729+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc811120 con 0x5579cc81ae30 2023-10-05T21:15:11.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.729+0000 7f183050a700 1 -- 172.21.15.153:0/1682924416 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v29'18 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f182800a570 con 0x5579cc81ae30 2023-10-05T21:15:11.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.729+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc811120 con 0x5579cc81eeb0 2023-10-05T21:15:11.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.730+0000 7f182fd09700 1 -- 172.21.15.153:0/1682924416 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v29'22 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc81eeb0 2023-10-05T21:15:11.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.730+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc811120 con 0x5579cc81ae30 2023-10-05T21:15:11.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.731+0000 7f183050a700 1 -- 172.21.15.153:0/1682924416 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v29'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f182800a570 con 0x5579cc81ae30 2023-10-05T21:15:11.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.731+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc811120 con 0x5579cc81ae30 2023-10-05T21:15:11.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.731+0000 7f183050a700 1 -- 172.21.15.153:0/1682924416 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v29'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f182800a570 con 0x5579cc81ae30 2023-10-05T21:15:11.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.731+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc811120 con 0x5579cc81ae30 2023-10-05T21:15:11.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.732+0000 7f183050a700 1 -- 172.21.15.153:0/1682924416 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v29'7 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f182800a570 con 0x5579cc81ae30 2023-10-05T21:15:11.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.732+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc811120 con 0x5579cc81ae30 2023-10-05T21:15:11.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.733+0000 7f183050a700 1 -- 172.21.15.153:0/1682924416 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v29'16 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f182800a570 con 0x5579cc81ae30 2023-10-05T21:15:11.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.733+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc811120 con 0x5579cc817170 2023-10-05T21:15:11.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.734+0000 7f182f508700 1 -- 172.21.15.153:0/1682924416 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v29'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1820006070 con 0x5579cc817170 2023-10-05T21:15:11.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.734+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc811120 con 0x5579cc81ae30 2023-10-05T21:15:11.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.734+0000 7f183050a700 1 -- 172.21.15.153:0/1682924416 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v29'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f182800a570 con 0x5579cc81ae30 2023-10-05T21:15:11.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.734+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc811120 con 0x5579cc817170 2023-10-05T21:15:11.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.735+0000 7f182f508700 1 -- 172.21.15.153:0/1682924416 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v29'16 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1820006070 con 0x5579cc817170 2023-10-05T21:15:11.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.735+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc810eb0 con 0x5579cc81ae30 2023-10-05T21:15:11.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.736+0000 7f183050a700 1 -- 172.21.15.153:0/1682924416 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v29'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f182800a570 con 0x5579cc81ae30 2023-10-05T21:15:11.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.736+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc810eb0 con 0x5579cc817170 2023-10-05T21:15:11.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.737+0000 7f182f508700 1 -- 172.21.15.153:0/1682924416 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v29'22 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1820006070 con 0x5579cc817170 2023-10-05T21:15:11.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.737+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc810eb0 con 0x5579cc81eeb0 2023-10-05T21:15:11.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.738+0000 7f182fd09700 1 -- 172.21.15.153:0/1682924416 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v29'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc81eeb0 2023-10-05T21:15:11.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.739+0000 7f176ffff700 20 reqs_thread_entry: start 2023-10-05T21:15:11.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.739+0000 7f176dffb700 20 reqs_thread_entry: start 2023-10-05T21:15:11.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.739+0000 7f183cc31680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:11.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.739+0000 7f183cc31680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:11.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.739+0000 7f175bfff700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:41 2023 2023-10-05T21:15:11.758 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:11.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.739+0000 7f175b7fe700 20 reqs_thread_entry: start 2023-10-05T21:15:11.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.739+0000 7f183cc31680 20 get_system_obj_state: rctx=0x7ffce8c855b8 obj=default.rgw.meta:users.uid:bar state=0x5579cc723330 s->prefetch_data=0 2023-10-05T21:15:11.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.739+0000 7f183cc31680 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2023-10-05T21:15:11.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.740+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:102 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc87edc0 con 0x7f182000ebe0 2023-10-05T21:15:11.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.740+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(102 bar [call,getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f182800a570 con 0x7f182000ebe0 2023-10-05T21:15:11.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.740+0000 7f183cc31680 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2023-10-05T21:15:11.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.740+0000 7f183cc31680 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2023-10-05T21:15:11.759 INFO:teuthology.orchestra.run.smithi153.stderr:could not remove user: unable to remove user, user does not exist 2023-10-05T21:15:11.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.740+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:103 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93981610271872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc83d920 con 0x7f1824007030 2023-10-05T21:15:11.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.741+0000 7f182f508700 1 -- 172.21.15.153:0/693680929 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(103 notify.0 [watch unwatch cookie 93981610271872] v29'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1820006070 con 0x7f1824007030 2023-10-05T21:15:11.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.741+0000 7f183cc31680 20 remove_watcher() i=0 2023-10-05T21:15:11.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.741+0000 7f183cc31680 2 removed watcher, disabling cache 2023-10-05T21:15:11.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.741+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:104 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93981610277392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ee480 con 0x5579cc7af100 2023-10-05T21:15:11.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.742+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(104 notify.1 [watch unwatch cookie 93981610277392] v29'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.742+0000 7f183cc31680 20 remove_watcher() i=1 2023-10-05T21:15:11.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.742+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:105 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93981610280448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7ee480 con 0x5579cc7e7170 2023-10-05T21:15:11.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.742+0000 7f182fd09700 1 -- 172.21.15.153:0/693680929 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(105 notify.2 [watch unwatch cookie 93981610280448] v29'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1824037c50 con 0x5579cc7e7170 2023-10-05T21:15:11.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.742+0000 7f183cc31680 20 remove_watcher() i=2 2023-10-05T21:15:11.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.742+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:106 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93981610278496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7f0600 con 0x7f1824007030 2023-10-05T21:15:11.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.743+0000 7f182f508700 1 -- 172.21.15.153:0/693680929 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(106 notify.3 [watch unwatch cookie 93981610278496] v29'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1820006070 con 0x7f1824007030 2023-10-05T21:15:11.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.743+0000 7f183cc31680 20 remove_watcher() i=3 2023-10-05T21:15:11.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.743+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93981610288256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eff00 con 0x5579cc7af100 2023-10-05T21:15:11.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.744+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(107 notify.4 [watch unwatch cookie 93981610288256] v29'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.744+0000 7f183cc31680 20 remove_watcher() i=4 2023-10-05T21:15:11.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.744+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:108 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93981610292080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eff00 con 0x7f182000ebe0 2023-10-05T21:15:11.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.745+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(108 notify.5 [watch unwatch cookie 93981610292080] v29'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182800a570 con 0x7f182000ebe0 2023-10-05T21:15:11.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.745+0000 7f183cc31680 20 remove_watcher() i=5 2023-10-05T21:15:11.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.745+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93981610294768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eff00 con 0x7f182000ebe0 2023-10-05T21:15:11.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.745+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(109 notify.6 [watch unwatch cookie 93981610294768] v29'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182800a570 con 0x7f182000ebe0 2023-10-05T21:15:11.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.745+0000 7f183cc31680 20 remove_watcher() i=6 2023-10-05T21:15:11.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.745+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93981610286384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc7eff00 con 0x7f182000ebe0 2023-10-05T21:15:11.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.746+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(110 notify.7 [watch unwatch cookie 93981610286384] v29'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182800a570 con 0x7f182000ebe0 2023-10-05T21:15:11.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.746+0000 7f183cc31680 20 remove_watcher() i=7 2023-10-05T21:15:11.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.747+0000 7f18017e2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:11.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.747+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:111 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93981610298864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5579cc8410c0 con 0x5579cc7af100 2023-10-05T21:15:11.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.747+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(111 data_loggenerations_metadata [watch unwatch cookie 93981610298864] v29'35 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f182800a570 con 0x5579cc7af100 2023-10-05T21:15:11.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.747+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f182000ebe0 msgr2=0x7f182000d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.747+0000 7f183cc31680 1 --2- 172.21.15.153:0/693680929 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f182000ebe0 0x7f182000d8e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.747+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5579cc7af100 msgr2=0x5579cc7e4d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183cc31680 1 --2- 172.21.15.153:0/693680929 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5579cc7af100 0x5579cc7e4d00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f1824007030 msgr2=0x7f18240245f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183cc31680 1 --2- 172.21.15.153:0/693680929 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f1824007030 0x7f18240245f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5579cc7e7170 msgr2=0x5579cc7e9550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183cc31680 1 --2- 172.21.15.153:0/693680929 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5579cc7e7170 0x5579cc7e9550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f181c0340f0 msgr2=0x7f181c0365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183cc31680 1 --2- 172.21.15.153:0/693680929 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f181c0340f0 0x7f181c0365a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1820004170 tx=0x7f1820001360 comp rx=0 tx=0).stop 2023-10-05T21:15:11.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5579cc7ae7b0 msgr2=0x5579cc7d8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183cc31680 1 --2- 172.21.15.153:0/693680929 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5579cc7ae7b0 0x5579cc7d8f70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1824005a90 tx=0x7f182401c000 comp rx=0 tx=0).stop 2023-10-05T21:15:11.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 reap_dead start 2023-10-05T21:15:11.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183050a700 1 -- 172.21.15.153:0/693680929 reap_dead start 2023-10-05T21:15:11.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 shutdown_connections 2023-10-05T21:15:11.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 >> 172.21.15.153:0/693680929 conn(0x5579cc7aa300 msgr2=0x5579cc7afcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:11.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 shutdown_connections 2023-10-05T21:15:11.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183cc31680 1 -- 172.21.15.153:0/693680929 wait complete. 2023-10-05T21:15:11.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x5579cc817170 msgr2=0x5579cc819570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183cc31680 1 --2- 172.21.15.153:0/1682924416 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x5579cc817170 0x5579cc819570 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5579cc813970 msgr2=0x5579cc815e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183cc31680 1 --2- 172.21.15.153:0/1682924416 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5579cc813970 0x5579cc815e20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x5579cc81eeb0 msgr2=0x5579cc821290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183cc31680 1 --2- 172.21.15.153:0/1682924416 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x5579cc81eeb0 0x5579cc821290 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5579cc81ae30 msgr2=0x5579cc81d2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183cc31680 1 --2- 172.21.15.153:0/1682924416 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5579cc81ae30 0x5579cc81d2b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1770034140 msgr2=0x7f17700365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183cc31680 1 --2- 172.21.15.153:0/1682924416 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1770034140 0x7f17700365f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x5579cc7f44d0 tx=0x7f1828037450 comp rx=0 tx=0).stop 2023-10-05T21:15:11.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5579cc801dc0 msgr2=0x5579cc808b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f182fd09700 1 -- 172.21.15.153:0/1682924416 reap_dead start 2023-10-05T21:15:11.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183cc31680 1 --2- 172.21.15.153:0/1682924416 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5579cc801dc0 0x5579cc808b70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x5579cc7fd630 tx=0x7f1820030000 comp rx=0 tx=0).stop 2023-10-05T21:15:11.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 shutdown_connections 2023-10-05T21:15:11.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183cc31680 1 --2- 172.21.15.153:0/1682924416 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5579cc801dc0 0x5579cc808b70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 >> 172.21.15.153:0/1682924416 conn(0x5579cc7fe0c0 msgr2=0x5579cc7fc190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:11.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 shutdown_connections 2023-10-05T21:15:11.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.748+0000 7f183cc31680 1 -- 172.21.15.153:0/1682924416 wait complete. 2023-10-05T21:15:11.765 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2023-10-05T21:15:11.765 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2023-10-05T21:15:11.765 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2023-10-05T21:15:11.839 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:11.839 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:11.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.838+0000 7f0d6c0bd680 1 Processor -- start 2023-10-05T21:15:11.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.838+0000 7f0d6c0bd680 1 -- start start 2023-10-05T21:15:11.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.838+0000 7f0d6c0bd680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55f0f8a24be0 0x55f0f8a26fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.838+0000 7f0d6c0bd680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f0f896d990 con 0x55f0f8a1e7b0 2023-10-05T21:15:11.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.838+0000 7f0d6c0bd680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f0f892ddb0 con 0x55f0f8a24be0 2023-10-05T21:15:11.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.838+0000 7f0d5e994700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55f0f8a24be0 0x55f0f8a26fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.839+0000 7f0d5e994700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55f0f8a24be0 0x55f0f8a26fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49112/0 (socket says 172.21.15.153:49112) 2023-10-05T21:15:11.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.839+0000 7f0d5f195700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55f0f8a1e7b0 0x55f0f8a1ebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56142/0 (socket says 172.21.15.153:56142) 2023-10-05T21:15:11.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.839+0000 7f0d5e994700 1 -- 172.21.15.153:0/2465568038 learned_addr learned my addr 172.21.15.153:0/2465568038 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:11.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.839+0000 7f0d5e994700 1 -- 172.21.15.153:0/2465568038 >> v1:172.21.15.111:6789/0 conn(0x55f0f8a1e7b0 legacy=0x55f0f8a1ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.839+0000 7f0d5e994700 1 -- 172.21.15.153:0/2465568038 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0f8a28510 con 0x55f0f8a24be0 2023-10-05T21:15:11.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.839+0000 7f0d5e994700 1 --2- 172.21.15.153:0/2465568038 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0f8a24be0 0x55f0f8a26fc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0d5000a650 tx=0x7f0d50005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3542ce6194ec469d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.839+0000 7f0d5e193700 1 -- 172.21.15.153:0/2465568038 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d50008760 con 0x55f0f8a24be0 2023-10-05T21:15:11.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.839+0000 7f0d5e193700 1 -- 172.21.15.153:0/2465568038 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d500088c0 con 0x55f0f8a24be0 2023-10-05T21:15:11.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.839+0000 7f0d5e193700 1 -- 172.21.15.153:0/2465568038 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d50008bb0 con 0x55f0f8a24be0 2023-10-05T21:15:11.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.840+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/2465568038 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0f8a24be0 msgr2=0x55f0f8a26fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.840+0000 7f0d6c0bd680 1 --2- 172.21.15.153:0/2465568038 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0f8a24be0 0x55f0f8a26fc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0d5000a650 tx=0x7f0d50005b10 comp rx=0 tx=0).stop 2023-10-05T21:15:11.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.840+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/2465568038 shutdown_connections 2023-10-05T21:15:11.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.840+0000 7f0d6c0bd680 1 --2- 172.21.15.153:0/2465568038 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0f8a24be0 0x55f0f8a26fc0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.840+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/2465568038 >> 172.21.15.153:0/2465568038 conn(0x55f0f8a1a300 msgr2=0x55f0f8a1c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:11.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.840+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/2465568038 shutdown_connections 2023-10-05T21:15:11.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.840+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/2465568038 wait complete. 2023-10-05T21:15:11.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.841+0000 7f0d6c0bd680 1 Processor -- start 2023-10-05T21:15:11.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.841+0000 7f0d6c0bd680 1 -- start start 2023-10-05T21:15:11.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.841+0000 7f0d6c0bd680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0f8a1e7b0 0x55f0f8a3fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.841+0000 7f0d6c0bd680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0f88cdea0 con 0x55f0f8a1e7b0 2023-10-05T21:15:11.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.841+0000 7f0d5f195700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0f8a1e7b0 0x55f0f8a3fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.841+0000 7f0d5f195700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0f8a1e7b0 0x55f0f8a3fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49126/0 (socket says 172.21.15.153:49126) 2023-10-05T21:15:11.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.841+0000 7f0d5f195700 1 -- 172.21.15.153:0/2717627036 learned_addr learned my addr 172.21.15.153:0/2717627036 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:11.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.841+0000 7f0d5f195700 1 -- 172.21.15.153:0/2717627036 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d50005db0 con 0x55f0f8a1e7b0 2023-10-05T21:15:11.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.841+0000 7f0d5f195700 1 --2- 172.21.15.153:0/2717627036 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0f8a1e7b0 0x55f0f8a3fad0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0d54001cf0 tx=0x7f0d540018a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572a6400e36ecb4c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.841+0000 7f0d5d191700 1 -- 172.21.15.153:0/2717627036 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d54014070 con 0x55f0f8a1e7b0 2023-10-05T21:15:11.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.842+0000 7f0d5d191700 1 -- 172.21.15.153:0/2717627036 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5400be10 con 0x55f0f8a1e7b0 2023-10-05T21:15:11.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.842+0000 7f0d5d191700 1 -- 172.21.15.153:0/2717627036 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d5400f590 con 0x55f0f8a1e7b0 2023-10-05T21:15:11.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.842+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/2717627036 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0f8a1e7b0 msgr2=0x55f0f8a3fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.842+0000 7f0d6c0bd680 1 --2- 172.21.15.153:0/2717627036 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0f8a1e7b0 0x55f0f8a3fad0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0d54001cf0 tx=0x7f0d540018a0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.842+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/2717627036 shutdown_connections 2023-10-05T21:15:11.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.842+0000 7f0d6c0bd680 1 --2- 172.21.15.153:0/2717627036 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0f8a1e7b0 0x55f0f8a3fad0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.842+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/2717627036 >> 172.21.15.153:0/2717627036 conn(0x55f0f8a1a300 msgr2=0x55f0f8a3b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:11.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.842+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/2717627036 shutdown_connections 2023-10-05T21:15:11.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.842+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/2717627036 wait complete. 2023-10-05T21:15:11.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.842+0000 7f0d6c0bd680 1 Processor -- start 2023-10-05T21:15:11.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.843+0000 7f0d6c0bd680 1 -- start start 2023-10-05T21:15:11.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.843+0000 7f0d6c0bd680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0f8a1e7b0 0x55f0f8a21260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.843+0000 7f0d6c0bd680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0f88c4c80 con 0x55f0f8a1e7b0 2023-10-05T21:15:11.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.843+0000 7f0d5f195700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0f8a1e7b0 0x55f0f8a21260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.843+0000 7f0d5f195700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0f8a1e7b0 0x55f0f8a21260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49136/0 (socket says 172.21.15.153:49136) 2023-10-05T21:15:11.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.843+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 learned_addr learned my addr 172.21.15.153:0/1832825565 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:11.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.843+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0f896d990 con 0x55f0f8a1e7b0 2023-10-05T21:15:11.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.843+0000 7f0d5f195700 1 --2- 172.21.15.153:0/1832825565 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0f8a1e7b0 0x55f0f8a21260 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0d54000c00 tx=0x7f0d54016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.844+0000 7f0d4f7fe700 1 -- 172.21.15.153:0/1832825565 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d5401c740 con 0x55f0f8a1e7b0 2023-10-05T21:15:11.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.844+0000 7f0d4f7fe700 1 -- 172.21.15.153:0/1832825565 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5401c8c0 con 0x55f0f8a1e7b0 2023-10-05T21:15:11.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.844+0000 7f0d4f7fe700 1 -- 172.21.15.153:0/1832825565 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d5401cbb0 con 0x55f0f8a1e7b0 2023-10-05T21:15:11.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.844+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f0f8a1f880 con 0x55f0f8a1e7b0 2023-10-05T21:15:11.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.844+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f0f8a1fcd0 con 0x55f0f8a1e7b0 2023-10-05T21:15:11.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.844+0000 7f0d4f7fe700 1 -- 172.21.15.153:0/1832825565 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f0d54023020 con 0x55f0f8a1e7b0 2023-10-05T21:15:11.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.844+0000 7f0d6c0bd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.845+0000 7f0d4f7fe700 1 --2- 172.21.15.153:0/1832825565 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0d44034140 0x7f0d440365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.845+0000 7f0d4f7fe700 1 -- 172.21.15.153:0/1832825565 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f0d54008030 con 0x55f0f8a1e7b0 2023-10-05T21:15:11.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.845+0000 7f0d5e994700 1 --2- 172.21.15.153:0/1832825565 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0d44034140 0x7f0d440365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.845+0000 7f0d6c0bd680 1 --2- 172.21.15.153:0/1832825565 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55f0f8a24be0 0x55f0f8a54f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.845+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a556f0 con 0x55f0f8a24be0 2023-10-05T21:15:11.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.845+0000 7f0d5f996700 1 --2- 172.21.15.153:0/1832825565 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55f0f8a24be0 0x55f0f8a54f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.845+0000 7f0d5e994700 1 --2- 172.21.15.153:0/1832825565 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0d44034140 0x7f0d440365f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0d50005b50 tx=0x7f0d50015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.845+0000 7f0d5f996700 1 --2- 172.21.15.153:0/1832825565 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55f0f8a24be0 0x55f0f8a54f60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.846+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.846+0000 7f0d6c0bd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.846+0000 7f0d6c0bd680 20 realm 2023-10-05T21:15:11.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.846+0000 7f0d6c0bd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.846+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a52540 con 0x55f0f8a24be0 2023-10-05T21:15:11.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.846+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.846+0000 7f0d6c0bd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.846+0000 7f0d6c0bd680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:11.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.846+0000 7f0d6c0bd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.846+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a561f0 con 0x55f0f8a24be0 2023-10-05T21:15:11.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.846+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.846+0000 7f0d6c0bd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.846+0000 7f0d6c0bd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.846+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a56b10 con 0x55f0f8a24be0 2023-10-05T21:15:11.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.846+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.846+0000 7f0d6c0bd680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:11.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.846+0000 7f0d6c0bd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.846+0000 7f0d6c0bd680 1 --2- 172.21.15.153:0/1832825565 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55f0f8a573d0 0x55f0f8a597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.846+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a59e00 con 0x55f0f8a573d0 2023-10-05T21:15:11.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.846+0000 7f0d5f195700 1 --2- 172.21.15.153:0/1832825565 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55f0f8a573d0 0x55f0f8a597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.847+0000 7f0d5f195700 1 --2- 172.21.15.153:0/1832825565 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55f0f8a573d0 0x55f0f8a597b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.847+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f0d54016070 con 0x55f0f8a573d0 2023-10-05T21:15:11.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.847+0000 7f0d6c0bd680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:11.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.847+0000 7f0d6c0bd680 20 searching for the correct realm 2023-10-05T21:15:11.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.847+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x55f0f8a573d0 2023-10-05T21:15:11.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.847+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d54016070 con 0x55f0f8a573d0 2023-10-05T21:15:11.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.847+0000 7f0d5f195700 1 --2- 172.21.15.153:0/1832825565 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f0d54030060 0x7f0d540253d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.847+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x7f0d54030060 2023-10-05T21:15:11.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.847+0000 7f0d5e994700 1 --2- 172.21.15.153:0/1832825565 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f0d54030060 0x7f0d540253d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.848+0000 7f0d5e994700 1 --2- 172.21.15.153:0/1832825565 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f0d54030060 0x7f0d540253d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.848+0000 7f0d5e994700 1 -- 172.21.15.153:0/1832825565 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d50012450 con 0x7f0d54030060 2023-10-05T21:15:11.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.848+0000 7f0d5e994700 1 --2- 172.21.15.153:0/1832825565 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f0d50007030 0x7f0d5001c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.848+0000 7f0d5e994700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x7f0d50007030 2023-10-05T21:15:11.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.848+0000 7f0d5f996700 1 --2- 172.21.15.153:0/1832825565 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f0d50007030 0x7f0d5001c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.848+0000 7f0d5f996700 1 --2- 172.21.15.153:0/1832825565 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f0d50007030 0x7f0d5001c920 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.849+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d5800a570 con 0x7f0d50007030 2023-10-05T21:15:11.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.849+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x55f0f8a24be0 2023-10-05T21:15:11.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.849+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.849+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x55f0f8a24be0 2023-10-05T21:15:11.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.849+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.849+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x7f0d50007030 2023-10-05T21:15:11.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.849+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d5800a570 con 0x7f0d50007030 2023-10-05T21:15:11.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.849+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x7f0d50007030 2023-10-05T21:15:11.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.849+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d5800a570 con 0x7f0d50007030 2023-10-05T21:15:11.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.850+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x7f0d54030060 2023-10-05T21:15:11.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.850+0000 7f0d5e994700 1 -- 172.21.15.153:0/1832825565 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d50012450 con 0x7f0d54030060 2023-10-05T21:15:11.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.850+0000 7f0d5e994700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x55f0f8a573d0 2023-10-05T21:15:11.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.850+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0d54016070 con 0x55f0f8a573d0 2023-10-05T21:15:11.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.850+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x55f0f8a24be0 2023-10-05T21:15:11.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.850+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.850+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x7f0d50007030 2023-10-05T21:15:11.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.851+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d5800a570 con 0x7f0d50007030 2023-10-05T21:15:11.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.851+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x55f0f8a24be0 2023-10-05T21:15:11.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.851+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.851+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x7f0d54030060 2023-10-05T21:15:11.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.851+0000 7f0d5e994700 1 -- 172.21.15.153:0/1832825565 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d50012450 con 0x7f0d54030060 2023-10-05T21:15:11.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.851+0000 7f0d5e994700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x55f0f8a573d0 2023-10-05T21:15:11.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.851+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d54016070 con 0x55f0f8a573d0 2023-10-05T21:15:11.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.851+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x55f0f8a573d0 2023-10-05T21:15:11.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.851+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d54016070 con 0x55f0f8a573d0 2023-10-05T21:15:11.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.851+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x7f0d50007030 2023-10-05T21:15:11.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.852+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d5800a570 con 0x7f0d50007030 2023-10-05T21:15:11.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.852+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x55f0f8a573d0 2023-10-05T21:15:11.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.852+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d54016070 con 0x55f0f8a573d0 2023-10-05T21:15:11.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.852+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x55f0f8a573d0 2023-10-05T21:15:11.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.852+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d54016070 con 0x55f0f8a573d0 2023-10-05T21:15:11.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.852+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x55f0f8a24be0 2023-10-05T21:15:11.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.852+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.852+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x55f0f8a24be0 2023-10-05T21:15:11.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.853+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.853+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x7f0d50007030 2023-10-05T21:15:11.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.853+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d5800a570 con 0x7f0d50007030 2023-10-05T21:15:11.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.853+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x55f0f8a573d0 2023-10-05T21:15:11.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.853+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d54016070 con 0x55f0f8a573d0 2023-10-05T21:15:11.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.853+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x7f0d54030060 2023-10-05T21:15:11.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.853+0000 7f0d5e994700 1 -- 172.21.15.153:0/1832825565 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d50012450 con 0x7f0d54030060 2023-10-05T21:15:11.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.853+0000 7f0d5e994700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x55f0f8a24be0 2023-10-05T21:15:11.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.853+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.853+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x7f0d50007030 2023-10-05T21:15:11.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.854+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d5800a570 con 0x7f0d50007030 2023-10-05T21:15:11.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.854+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x55f0f8a573d0 2023-10-05T21:15:11.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.854+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d54016070 con 0x55f0f8a573d0 2023-10-05T21:15:11.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.854+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x7f0d50007030 2023-10-05T21:15:11.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.854+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d5800a570 con 0x7f0d50007030 2023-10-05T21:15:11.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.854+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x7f0d54030060 2023-10-05T21:15:11.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.855+0000 7f0d5e994700 1 -- 172.21.15.153:0/1832825565 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d50012450 con 0x7f0d54030060 2023-10-05T21:15:11.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.855+0000 7f0d5e994700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x55f0f8a573d0 2023-10-05T21:15:11.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.855+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d54016070 con 0x55f0f8a573d0 2023-10-05T21:15:11.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.855+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x7f0d50007030 2023-10-05T21:15:11.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.855+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d5800a570 con 0x7f0d50007030 2023-10-05T21:15:11.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.855+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x55f0f8a24be0 2023-10-05T21:15:11.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.855+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.855+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5b970 con 0x7f0d54030060 2023-10-05T21:15:11.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.856+0000 7f0d5e994700 1 -- 172.21.15.153:0/1832825565 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d50012450 con 0x7f0d54030060 2023-10-05T21:15:11.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.856+0000 7f0d6c0bd680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:11.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.856+0000 7f0d6c0bd680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:11.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.856+0000 7f0d6c0bd680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:11.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.856+0000 7f0d6c0bd680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:11.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.856+0000 7f0d6c0bd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.856+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5a8c0 con 0x55f0f8a24be0 2023-10-05T21:15:11.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.856+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.856+0000 7f0d6c0bd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.856+0000 7f0d6c0bd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.856+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5acc0 con 0x55f0f8a24be0 2023-10-05T21:15:11.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.856+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.856+0000 7f0d6c0bd680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:11.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.856+0000 7f0d6c0bd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.856+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5be00 con 0x55f0f8a24be0 2023-10-05T21:15:11.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.856+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.856+0000 7f0d6c0bd680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:11.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.856+0000 7f0d6c0bd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.856+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5c1b0 con 0x55f0f8a573d0 2023-10-05T21:15:11.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.857+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f0d54016070 con 0x55f0f8a573d0 2023-10-05T21:15:11.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.857+0000 7f0d6c0bd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.857+0000 7f0d6c0bd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.857+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5c560 con 0x55f0f8a24be0 2023-10-05T21:15:11.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.857+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.857+0000 7f0d6c0bd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.857+0000 7f0d6c0bd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.857+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5c560 con 0x55f0f8a24be0 2023-10-05T21:15:11.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.857+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.857+0000 7f0d6c0bd680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:11.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.857+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5d570 con 0x55f0f8a573d0 2023-10-05T21:15:11.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.857+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d54016070 con 0x55f0f8a573d0 2023-10-05T21:15:11.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.857+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5d570 con 0x7f0d54030060 2023-10-05T21:15:11.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.858+0000 7f0d5e994700 1 -- 172.21.15.153:0/1832825565 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d50012450 con 0x7f0d54030060 2023-10-05T21:15:11.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.858+0000 7f0d5e994700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5d570 con 0x7f0d50007030 2023-10-05T21:15:11.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.858+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d5800a570 con 0x7f0d50007030 2023-10-05T21:15:11.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.858+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5be00 con 0x55f0f8a24be0 2023-10-05T21:15:11.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.858+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.858+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5be00 con 0x55f0f8a24be0 2023-10-05T21:15:11.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.858+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.858+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5be00 con 0x7f0d50007030 2023-10-05T21:15:11.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.859+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d5800a570 con 0x7f0d50007030 2023-10-05T21:15:11.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.859+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5be00 con 0x7f0d50007030 2023-10-05T21:15:11.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.859+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d5800a570 con 0x7f0d50007030 2023-10-05T21:15:11.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.859+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5be00 con 0x7f0d54030060 2023-10-05T21:15:11.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.859+0000 7f0d5e994700 1 -- 172.21.15.153:0/1832825565 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d50012450 con 0x7f0d54030060 2023-10-05T21:15:11.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.859+0000 7f0d5e994700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5be00 con 0x55f0f8a573d0 2023-10-05T21:15:11.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.859+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0d54016070 con 0x55f0f8a573d0 2023-10-05T21:15:11.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.859+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5be00 con 0x55f0f8a24be0 2023-10-05T21:15:11.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.859+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.859+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5be00 con 0x7f0d50007030 2023-10-05T21:15:11.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.860+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d5800a570 con 0x7f0d50007030 2023-10-05T21:15:11.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.860+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5be00 con 0x55f0f8a24be0 2023-10-05T21:15:11.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.860+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.860+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5be00 con 0x7f0d54030060 2023-10-05T21:15:11.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.860+0000 7f0d5e994700 1 -- 172.21.15.153:0/1832825565 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d50012450 con 0x7f0d54030060 2023-10-05T21:15:11.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.860+0000 7f0d5e994700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5be00 con 0x55f0f8a573d0 2023-10-05T21:15:11.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.860+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d54016070 con 0x55f0f8a573d0 2023-10-05T21:15:11.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.860+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5be00 con 0x55f0f8a573d0 2023-10-05T21:15:11.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.861+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d54016070 con 0x55f0f8a573d0 2023-10-05T21:15:11.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.861+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5be00 con 0x7f0d50007030 2023-10-05T21:15:11.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.861+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d5800a570 con 0x7f0d50007030 2023-10-05T21:15:11.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.861+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5be00 con 0x55f0f8a573d0 2023-10-05T21:15:11.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.861+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d54016070 con 0x55f0f8a573d0 2023-10-05T21:15:11.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.861+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5be00 con 0x55f0f8a573d0 2023-10-05T21:15:11.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.861+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d54051040 con 0x55f0f8a573d0 2023-10-05T21:15:11.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.861+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5be00 con 0x55f0f8a24be0 2023-10-05T21:15:11.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.862+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.862+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5be00 con 0x55f0f8a24be0 2023-10-05T21:15:11.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.862+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.862+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5be00 con 0x7f0d50007030 2023-10-05T21:15:11.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.862+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d5800a570 con 0x7f0d50007030 2023-10-05T21:15:11.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.862+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5be00 con 0x55f0f8a573d0 2023-10-05T21:15:11.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.862+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d54051040 con 0x55f0f8a573d0 2023-10-05T21:15:11.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.862+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5be00 con 0x7f0d54030060 2023-10-05T21:15:11.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.863+0000 7f0d5e994700 1 -- 172.21.15.153:0/1832825565 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d50012450 con 0x7f0d54030060 2023-10-05T21:15:11.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.863+0000 7f0d5e994700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5be00 con 0x55f0f8a24be0 2023-10-05T21:15:11.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.863+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.863+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5be00 con 0x7f0d50007030 2023-10-05T21:15:11.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.863+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d5800a570 con 0x7f0d50007030 2023-10-05T21:15:11.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.863+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5be00 con 0x55f0f8a573d0 2023-10-05T21:15:11.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.863+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d54051040 con 0x55f0f8a573d0 2023-10-05T21:15:11.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.863+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5be00 con 0x7f0d50007030 2023-10-05T21:15:11.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.864+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d5800a570 con 0x7f0d50007030 2023-10-05T21:15:11.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.864+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5be00 con 0x7f0d54030060 2023-10-05T21:15:11.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.864+0000 7f0d5e994700 1 -- 172.21.15.153:0/1832825565 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d50012450 con 0x7f0d54030060 2023-10-05T21:15:11.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.864+0000 7f0d5e994700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5be00 con 0x55f0f8a573d0 2023-10-05T21:15:11.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.864+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d54051040 con 0x55f0f8a573d0 2023-10-05T21:15:11.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.864+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5be00 con 0x7f0d50007030 2023-10-05T21:15:11.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.864+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d5800a570 con 0x7f0d50007030 2023-10-05T21:15:11.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.864+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5be00 con 0x55f0f8a24be0 2023-10-05T21:15:11.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.864+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.864+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5be00 con 0x7f0d54030060 2023-10-05T21:15:11.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.865+0000 7f0d5e994700 1 -- 172.21.15.153:0/1832825565 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0d50012450 con 0x7f0d54030060 2023-10-05T21:15:11.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.865+0000 7f0d6c0bd680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:11.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.865+0000 7f0d6c0bd680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:11.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.865+0000 7f0d6c0bd680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:11.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.865+0000 7f0d6c0bd680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:11.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.865+0000 7f0d6c0bd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.865+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5c560 con 0x55f0f8a24be0 2023-10-05T21:15:11.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.865+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.865+0000 7f0d6c0bd680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:11.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.865+0000 7f0d6c0bd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.865+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5c960 con 0x55f0f8a573d0 2023-10-05T21:15:11.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.865+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f0d54051040 con 0x55f0f8a573d0 2023-10-05T21:15:11.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.865+0000 7f0d6c0bd680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:11.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.865+0000 7f0d6c0bd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.865+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5a4f0 con 0x55f0f8a24be0 2023-10-05T21:15:11.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.865+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.865+0000 7f0d6c0bd680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:11.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.865+0000 7f0d6c0bd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.865+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5d2d0 con 0x55f0f8a24be0 2023-10-05T21:15:11.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.866+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.866+0000 7f0d6c0bd680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:11.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.866+0000 7f0d6c0bd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.866+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5d2d0 con 0x7f0d50007030 2023-10-05T21:15:11.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.866+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x7f0d50007030 2023-10-05T21:15:11.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.866+0000 7f0d6c0bd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.866+0000 7f0d6c0bd680 20 zone default found 2023-10-05T21:15:11.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.866+0000 7f0d6c0bd680 4 Realm: () 2023-10-05T21:15:11.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.866+0000 7f0d6c0bd680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:11.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.866+0000 7f0d6c0bd680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:11.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.866+0000 7f0d6c0bd680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:11.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.866+0000 7f0d6c0bd680 20 zonegroup default 2023-10-05T21:15:11.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.866+0000 7f0d6c0bd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.866+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5d250 con 0x7f0d50007030 2023-10-05T21:15:11.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.866+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x7f0d50007030 2023-10-05T21:15:11.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.866+0000 7f0d6c0bd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.866+0000 7f0d6c0bd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.866+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5d250 con 0x55f0f8a573d0 2023-10-05T21:15:11.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.867+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0d54051040 con 0x55f0f8a573d0 2023-10-05T21:15:11.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.867+0000 7f0d6c0bd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.867+0000 7f0d6c0bd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:11.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.867+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5efd0 con 0x55f0f8a573d0 2023-10-05T21:15:11.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.867+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0d54051040 con 0x55f0f8a573d0 2023-10-05T21:15:11.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.867+0000 7f0d6c0bd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:11.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.867+0000 7f0d6c0bd680 20 started sync module instance, tier type = 2023-10-05T21:15:11.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.867+0000 7f0d6c0bd680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:11.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.867+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5e690 con 0x7f0d54030060 2023-10-05T21:15:11.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.868+0000 7f0d5e994700 1 -- 172.21.15.153:0/1832825565 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d50012450 con 0x7f0d54030060 2023-10-05T21:15:11.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.868+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94493452135056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5f870 con 0x7f0d54030060 2023-10-05T21:15:11.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.868+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a60110 con 0x55f0f8a24be0 2023-10-05T21:15:11.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.868+0000 7f0d5e994700 1 -- 172.21.15.153:0/1832825565 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94493452135056] v29'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d50012450 con 0x7f0d54030060 2023-10-05T21:15:11.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.868+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.868+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94493452137344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a60170 con 0x55f0f8a24be0 2023-10-05T21:15:11.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.868+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a60d50 con 0x55f0f8a573d0 2023-10-05T21:15:11.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.869+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94493452137344] v29'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.869+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d54051040 con 0x55f0f8a573d0 2023-10-05T21:15:11.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.869+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94493452142592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a61150 con 0x55f0f8a573d0 2023-10-05T21:15:11.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.869+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a61b60 con 0x7f0d54030060 2023-10-05T21:15:11.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.870+0000 7f0d5e994700 1 -- 172.21.15.153:0/1832825565 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d50012450 con 0x7f0d54030060 2023-10-05T21:15:11.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.870+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94493452148496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a62850 con 0x7f0d54030060 2023-10-05T21:15:11.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.870+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a63260 con 0x55f0f8a24be0 2023-10-05T21:15:11.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.870+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94493452142592] v29'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d54051040 con 0x55f0f8a573d0 2023-10-05T21:15:11.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.871+0000 7f0d5e994700 1 -- 172.21.15.153:0/1832825565 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94493452148496] v29'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d50012450 con 0x7f0d54030060 2023-10-05T21:15:11.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.871+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.871+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94493452139552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a63260 con 0x55f0f8a24be0 2023-10-05T21:15:11.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.871+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a63b00 con 0x7f0d50007030 2023-10-05T21:15:11.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.871+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94493452139552] v29'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.871+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x7f0d50007030 2023-10-05T21:15:11.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.872+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94493452152736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a63920 con 0x7f0d50007030 2023-10-05T21:15:11.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.872+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a64480 con 0x7f0d50007030 2023-10-05T21:15:11.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.872+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(96 notify.6 [create] v29'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x7f0d50007030 2023-10-05T21:15:11.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.872+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(95 notify.5 [watch watch cookie 94493452152736] v29'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x7f0d50007030 2023-10-05T21:15:11.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.872+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94493452156720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a64930 con 0x7f0d50007030 2023-10-05T21:15:11.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.872+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a63560 con 0x7f0d50007030 2023-10-05T21:15:11.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.873+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94493452156720] v29'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x7f0d50007030 2023-10-05T21:15:11.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.873+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x7f0d50007030 2023-10-05T21:15:11.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.873+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94493452158576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a65310 con 0x7f0d50007030 2023-10-05T21:15:11.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.873+0000 7f0d6c0bd680 20 add_watcher() i=0 2023-10-05T21:15:11.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.873+0000 7f0d6c0bd680 20 add_watcher() i=1 2023-10-05T21:15:11.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.873+0000 7f0d6c0bd680 20 add_watcher() i=2 2023-10-05T21:15:11.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.873+0000 7f0d6c0bd680 20 add_watcher() i=3 2023-10-05T21:15:11.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.873+0000 7f0d6c0bd680 20 add_watcher() i=4 2023-10-05T21:15:11.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.873+0000 7f0d6c0bd680 20 add_watcher() i=5 2023-10-05T21:15:11.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.873+0000 7f0d6c0bd680 20 add_watcher() i=6 2023-10-05T21:15:11.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.874+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94493452158576] v29'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x7f0d50007030 2023-10-05T21:15:11.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.874+0000 7f0d6c0bd680 20 add_watcher() i=7 2023-10-05T21:15:11.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.874+0000 7f0d6c0bd680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:11.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.874+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a685f0 con 0x55f0f8a24be0 2023-10-05T21:15:11.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.874+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.874+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94493452160912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a658d0 con 0x55f0f8a24be0 2023-10-05T21:15:11.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.875+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94493452160912] v29'36 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.875+0000 7f0cabfff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:11.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.875+0000 7f0d6c0bd680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:11.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.875+0000 7f0d6c0bd680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:11.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.875+0000 7f0d6c0bd680 1 Processor -- start 2023-10-05T21:15:11.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.875+0000 7f0d6c0bd680 1 -- start start 2023-10-05T21:15:11.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.875+0000 7f0d6c0bd680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0f8a72350 0x55f0f8a72760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.875+0000 7f0d6c0bd680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0f8a72d70 con 0x55f0f8a72350 2023-10-05T21:15:11.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.876+0000 7f0d5e994700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0f8a72350 0x55f0f8a72760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.876+0000 7f0d5e994700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0f8a72350 0x55f0f8a72760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49140/0 (socket says 172.21.15.153:49140) 2023-10-05T21:15:11.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.876+0000 7f0d5e994700 1 -- 172.21.15.153:0/1279418836 learned_addr learned my addr 172.21.15.153:0/1279418836 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:11.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.876+0000 7f0d5e994700 1 -- 172.21.15.153:0/1279418836 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0f8a73250 con 0x55f0f8a72350 2023-10-05T21:15:11.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.876+0000 7f0d5e994700 1 --2- 172.21.15.153:0/1279418836 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0f8a72350 0x55f0f8a72760 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x55f0f8a1f480 tx=0x7f0d50011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b3f8e0e0621d69 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.876+0000 7f0cab7fe700 1 -- 172.21.15.153:0/1279418836 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d5002a440 con 0x55f0f8a72350 2023-10-05T21:15:11.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.876+0000 7f0cab7fe700 1 -- 172.21.15.153:0/1279418836 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d50030040 con 0x55f0f8a72350 2023-10-05T21:15:11.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.876+0000 7f0cab7fe700 1 -- 172.21.15.153:0/1279418836 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d5002a740 con 0x55f0f8a72350 2023-10-05T21:15:11.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.877+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1279418836 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0f8a72350 msgr2=0x55f0f8a72760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.877+0000 7f0d6c0bd680 1 --2- 172.21.15.153:0/1279418836 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0f8a72350 0x55f0f8a72760 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x55f0f8a1f480 tx=0x7f0d50011000 comp rx=0 tx=0).stop 2023-10-05T21:15:11.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.877+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1279418836 shutdown_connections 2023-10-05T21:15:11.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.877+0000 7f0d6c0bd680 1 --2- 172.21.15.153:0/1279418836 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0f8a72350 0x55f0f8a72760 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.877+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1279418836 >> 172.21.15.153:0/1279418836 conn(0x55f0f8a6e650 msgr2=0x55f0f8a6c750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:11.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.877+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1279418836 shutdown_connections 2023-10-05T21:15:11.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.877+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1279418836 wait complete. 2023-10-05T21:15:11.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.877+0000 7f0d6c0bd680 1 Processor -- start 2023-10-05T21:15:11.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.877+0000 7f0d6c0bd680 1 -- start start 2023-10-05T21:15:11.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.878+0000 7f0d6c0bd680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0f8a72350 0x55f0f8a78ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.878+0000 7f0d6c0bd680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0f8a79530 con 0x55f0f8a72350 2023-10-05T21:15:11.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.878+0000 7f0d5e994700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0f8a72350 0x55f0f8a78ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.878+0000 7f0d5e994700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0f8a72350 0x55f0f8a78ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49144/0 (socket says 172.21.15.153:49144) 2023-10-05T21:15:11.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.878+0000 7f0d5e994700 1 -- 172.21.15.153:0/3144119097 learned_addr learned my addr 172.21.15.153:0/3144119097 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:11.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.878+0000 7f0d5e994700 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0f8a28510 con 0x55f0f8a72350 2023-10-05T21:15:11.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.878+0000 7f0d5e994700 1 --2- 172.21.15.153:0/3144119097 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0f8a72350 0x55f0f8a78ff0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0d50036040 tx=0x7f0d5002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.878+0000 7f0ca9ffb700 1 -- 172.21.15.153:0/3144119097 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d50009430 con 0x55f0f8a72350 2023-10-05T21:15:11.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.878+0000 7f0ca9ffb700 1 -- 172.21.15.153:0/3144119097 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d50042070 con 0x55f0f8a72350 2023-10-05T21:15:11.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.878+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f0f8a79730 con 0x55f0f8a72350 2023-10-05T21:15:11.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.879+0000 7f0ca9ffb700 1 -- 172.21.15.153:0/3144119097 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d50009730 con 0x55f0f8a72350 2023-10-05T21:15:11.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.879+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f0f8a79be0 con 0x55f0f8a72350 2023-10-05T21:15:11.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.879+0000 7f0ca9ffb700 1 -- 172.21.15.153:0/3144119097 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f0d50009890 con 0x55f0f8a72350 2023-10-05T21:15:11.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.879+0000 7f0ca9ffb700 1 --2- 172.21.15.153:0/3144119097 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0c9c034140 0x7f0c9c0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.879+0000 7f0ca9ffb700 1 -- 172.21.15.153:0/3144119097 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f0d50044070 con 0x55f0f8a72350 2023-10-05T21:15:11.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.879+0000 7f0d5f996700 1 --2- 172.21.15.153:0/3144119097 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0c9c034140 0x7f0c9c0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.880+0000 7f0d6c0bd680 1 --2- 172.21.15.153:0/3144119097 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55f0f8a83de0 0x55f0f8a86290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.880+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a86990 con 0x55f0f8a83de0 2023-10-05T21:15:11.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.880+0000 7f0d5f195700 1 --2- 172.21.15.153:0/3144119097 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55f0f8a83de0 0x55f0f8a86290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.880+0000 7f0d5f996700 1 --2- 172.21.15.153:0/3144119097 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0c9c034140 0x7f0c9c0365f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x55f0f8a627c0 tx=0x7f0d58037470 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.880+0000 7f0d5f195700 1 --2- 172.21.15.153:0/3144119097 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55f0f8a83de0 0x55f0f8a86290 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.881+0000 7f0d5f195700 1 -- 172.21.15.153:0/3144119097 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v29'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0d54051040 con 0x55f0f8a83de0 2023-10-05T21:15:11.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.881+0000 7f0d6c0bd680 1 --2- 172.21.15.153:0/3144119097 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55f0f8a876d0 0x55f0f8a89ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.881+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a8a160 con 0x55f0f8a876d0 2023-10-05T21:15:11.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.881+0000 7f0d5e994700 1 --2- 172.21.15.153:0/3144119097 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55f0f8a876d0 0x55f0f8a89ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.881+0000 7f0d5e994700 1 --2- 172.21.15.153:0/3144119097 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55f0f8a876d0 0x55f0f8a89ab0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.882+0000 7f0d5e994700 1 -- 172.21.15.153:0/3144119097 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v29'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0d5003a020 con 0x55f0f8a876d0 2023-10-05T21:15:11.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.882+0000 7f0d6c0bd680 1 --2- 172.21.15.153:0/3144119097 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55f0f8a8af10 0x55f0f8a8d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.882+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a8daa0 con 0x55f0f8a8af10 2023-10-05T21:15:11.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.882+0000 7f0d5f996700 1 --2- 172.21.15.153:0/3144119097 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55f0f8a8af10 0x55f0f8a8d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.882+0000 7f0d5f996700 1 --2- 172.21.15.153:0/3144119097 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55f0f8a8af10 0x55f0f8a8d350 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.883+0000 7f0d5f996700 1 -- 172.21.15.153:0/3144119097 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v29'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a8af10 2023-10-05T21:15:11.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.883+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a8e1d0 con 0x55f0f8a83de0 2023-10-05T21:15:11.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.884+0000 7f0d5f195700 1 -- 172.21.15.153:0/3144119097 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v29'37 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0d54051040 con 0x55f0f8a83de0 2023-10-05T21:15:11.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.884+0000 7f0d6c0bd680 1 --2- 172.21.15.153:0/3144119097 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55f0f8a8ef30 0x55f0f8a91310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:11.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.884+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a919d0 con 0x55f0f8a8ef30 2023-10-05T21:15:11.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.884+0000 7f0d5f195700 1 --2- 172.21.15.153:0/3144119097 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55f0f8a8ef30 0x55f0f8a91310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:11.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.884+0000 7f0d5f195700 1 --2- 172.21.15.153:0/3144119097 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55f0f8a8ef30 0x55f0f8a91310 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:11.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.885+0000 7f0d5f195700 1 -- 172.21.15.153:0/3144119097 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v29'26 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0d54051040 con 0x55f0f8a8ef30 2023-10-05T21:15:11.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.885+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a92100 con 0x55f0f8a8af10 2023-10-05T21:15:11.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.885+0000 7f0d5f996700 1 -- 172.21.15.153:0/3144119097 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v29'17 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a8af10 2023-10-05T21:15:11.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.885+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a927e0 con 0x55f0f8a83de0 2023-10-05T21:15:11.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.886+0000 7f0d5f195700 1 -- 172.21.15.153:0/3144119097 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v29'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0d54051040 con 0x55f0f8a83de0 2023-10-05T21:15:11.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.886+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a92870 con 0x55f0f8a876d0 2023-10-05T21:15:11.922 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-10-05T21:15:11.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.887+0000 7f0d5e994700 1 -- 172.21.15.153:0/3144119097 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v29'17 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0d5003a020 con 0x55f0f8a876d0 2023-10-05T21:15:11.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.887+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a92eb0 con 0x55f0f8a8ef30 2023-10-05T21:15:11.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.888+0000 7f0d5f195700 1 -- 172.21.15.153:0/3144119097 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v29'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0d54051040 con 0x55f0f8a8ef30 2023-10-05T21:15:11.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.888+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a92eb0 con 0x55f0f8a8af10 2023-10-05T21:15:11.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.888+0000 7f0d5f996700 1 -- 172.21.15.153:0/3144119097 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v29'18 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a8af10 2023-10-05T21:15:11.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.888+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a934f0 con 0x55f0f8a8ef30 2023-10-05T21:15:11.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.889+0000 7f0d5f195700 1 -- 172.21.15.153:0/3144119097 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v29'27 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0d54051040 con 0x55f0f8a8ef30 2023-10-05T21:15:11.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.889+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a934f0 con 0x55f0f8a876d0 2023-10-05T21:15:11.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.890+0000 7f0d5e994700 1 -- 172.21.15.153:0/3144119097 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v29'14 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0d5003a020 con 0x55f0f8a876d0 2023-10-05T21:15:11.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.890+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a93b60 con 0x55f0f8a8ef30 2023-10-05T21:15:11.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.891+0000 7f0d5f195700 1 -- 172.21.15.153:0/3144119097 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v29'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0d54051040 con 0x55f0f8a8ef30 2023-10-05T21:15:11.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.891+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a93b60 con 0x55f0f8a876d0 2023-10-05T21:15:11.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.891+0000 7f0d5e994700 1 -- 172.21.15.153:0/3144119097 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v29'23 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0d5003a020 con 0x55f0f8a876d0 2023-10-05T21:15:11.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.891+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a94050 con 0x55f0f8a83de0 2023-10-05T21:15:11.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.892+0000 7f0d5f195700 1 -- 172.21.15.153:0/3144119097 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v29'38 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0d54051040 con 0x55f0f8a83de0 2023-10-05T21:15:11.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.892+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a94050 con 0x55f0f8a8af10 2023-10-05T21:15:11.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.893+0000 7f0d5f996700 1 -- 172.21.15.153:0/3144119097 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v29'20 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a8af10 2023-10-05T21:15:11.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.893+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a94050 con 0x55f0f8a8ef30 2023-10-05T21:15:11.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.894+0000 7f0d5f195700 1 -- 172.21.15.153:0/3144119097 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v29'28 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0d54051040 con 0x55f0f8a8ef30 2023-10-05T21:15:11.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.894+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a94050 con 0x55f0f8a8af10 2023-10-05T21:15:11.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.894+0000 7f0d5f996700 1 -- 172.21.15.153:0/3144119097 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v29'12 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a8af10 2023-10-05T21:15:11.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.894+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a94050 con 0x55f0f8a83de0 2023-10-05T21:15:11.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.895+0000 7f0d5f195700 1 -- 172.21.15.153:0/3144119097 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v29'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0d54051040 con 0x55f0f8a83de0 2023-10-05T21:15:11.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.895+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a94050 con 0x55f0f8a83de0 2023-10-05T21:15:11.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.896+0000 7f0d5f195700 1 -- 172.21.15.153:0/3144119097 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v29'39 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0d54051040 con 0x55f0f8a83de0 2023-10-05T21:15:11.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.896+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a94050 con 0x55f0f8a8af10 2023-10-05T21:15:11.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.896+0000 7f0d5f996700 1 -- 172.21.15.153:0/3144119097 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v29'21 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a8af10 2023-10-05T21:15:11.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.896+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a94050 con 0x55f0f8a8ef30 2023-10-05T21:15:11.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.897+0000 7f0d5f195700 1 -- 172.21.15.153:0/3144119097 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v29'23 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0d54051040 con 0x55f0f8a8ef30 2023-10-05T21:15:11.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.897+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a94050 con 0x55f0f8a8af10 2023-10-05T21:15:11.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.898+0000 7f0d5f996700 1 -- 172.21.15.153:0/3144119097 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v29'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a8af10 2023-10-05T21:15:11.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.898+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a940e0 con 0x55f0f8a8af10 2023-10-05T21:15:11.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.898+0000 7f0d5f996700 1 -- 172.21.15.153:0/3144119097 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v29'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a8af10 2023-10-05T21:15:11.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.898+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a940e0 con 0x55f0f8a8af10 2023-10-05T21:15:11.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.899+0000 7f0d5f996700 1 -- 172.21.15.153:0/3144119097 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v29'8 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a8af10 2023-10-05T21:15:11.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.899+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a940e0 con 0x55f0f8a8af10 2023-10-05T21:15:11.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.900+0000 7f0d5f996700 1 -- 172.21.15.153:0/3144119097 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v29'18 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a8af10 2023-10-05T21:15:11.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.900+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a940e0 con 0x55f0f8a876d0 2023-10-05T21:15:11.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.901+0000 7f0d5e994700 1 -- 172.21.15.153:0/3144119097 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v29'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0d5003a020 con 0x55f0f8a876d0 2023-10-05T21:15:11.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.901+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a940e0 con 0x55f0f8a8af10 2023-10-05T21:15:11.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.901+0000 7f0d5f996700 1 -- 172.21.15.153:0/3144119097 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v29'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a8af10 2023-10-05T21:15:11.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.901+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a940e0 con 0x55f0f8a876d0 2023-10-05T21:15:11.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.902+0000 7f0d5e994700 1 -- 172.21.15.153:0/3144119097 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v29'18 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0d5003a020 con 0x55f0f8a876d0 2023-10-05T21:15:11.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.902+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a940e0 con 0x55f0f8a8af10 2023-10-05T21:15:11.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.903+0000 7f0d5f996700 1 -- 172.21.15.153:0/3144119097 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v29'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a8af10 2023-10-05T21:15:11.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.903+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a940e0 con 0x55f0f8a876d0 2023-10-05T21:15:11.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.904+0000 7f0d5e994700 1 -- 172.21.15.153:0/3144119097 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v29'24 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0d5003a020 con 0x55f0f8a876d0 2023-10-05T21:15:11.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.904+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a940e0 con 0x55f0f8a8ef30 2023-10-05T21:15:11.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.904+0000 7f0d5f195700 1 -- 172.21.15.153:0/3144119097 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v29'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0d54051040 con 0x55f0f8a8ef30 2023-10-05T21:15:11.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.905+0000 7f0ca2ffd700 20 reqs_thread_entry: start 2023-10-05T21:15:11.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.906+0000 7f0ca0ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:11.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.906+0000 7f0d6c0bd680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:11.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.906+0000 7f0d6c0bd680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:11.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.906+0000 7f0c8effd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:42 2023 2023-10-05T21:15:11.927 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:11.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.906+0000 7f0c8e7fc700 20 reqs_thread_entry: start 2023-10-05T21:15:11.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.906+0000 7f0d6c0bd680 20 get_system_obj_state: rctx=0x7ffede1dabd8 obj=default.rgw.meta:users.uid:fud state=0x55f0f8993330 s->prefetch_data=0 2023-10-05T21:15:11.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.906+0000 7f0d6c0bd680 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2023-10-05T21:15:11.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.906+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8aef480 con 0x7f0d50007030 2023-10-05T21:15:11.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.906+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(102 fud [call,getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x7f0d50007030 2023-10-05T21:15:11.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.906+0000 7f0d6c0bd680 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2023-10-05T21:15:11.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.906+0000 7f0d6c0bd680 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T21:15:11.928 INFO:teuthology.orchestra.run.smithi153.stderr:could not remove user: unable to remove user, user does not exist 2023-10-05T21:15:11.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.907+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:103 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94493452135056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8aadfb0 con 0x7f0d54030060 2023-10-05T21:15:11.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.907+0000 7f0d5e994700 1 -- 172.21.15.153:0/1832825565 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(103 notify.0 [watch unwatch cookie 94493452135056] v29'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d5003a020 con 0x7f0d54030060 2023-10-05T21:15:11.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.907+0000 7f0d6c0bd680 20 remove_watcher() i=0 2023-10-05T21:15:11.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.907+0000 7f0d6c0bd680 2 removed watcher, disabling cache 2023-10-05T21:15:11.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.907+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:104 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94493452137344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5ea90 con 0x55f0f8a24be0 2023-10-05T21:15:11.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.908+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(104 notify.1 [watch unwatch cookie 94493452137344] v29'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.908+0000 7f0d6c0bd680 20 remove_watcher() i=1 2023-10-05T21:15:11.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.908+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:105 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94493452142592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5f380 con 0x55f0f8a573d0 2023-10-05T21:15:11.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.909+0000 7f0d5f195700 1 -- 172.21.15.153:0/1832825565 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(105 notify.2 [watch unwatch cookie 94493452142592] v29'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d54051040 con 0x55f0f8a573d0 2023-10-05T21:15:11.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.909+0000 7f0d6c0bd680 20 remove_watcher() i=2 2023-10-05T21:15:11.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.909+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:106 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94493452148496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a60800 con 0x7f0d54030060 2023-10-05T21:15:11.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.910+0000 7f0d5e994700 1 -- 172.21.15.153:0/1832825565 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(106 notify.3 [watch unwatch cookie 94493452148496] v29'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d5003a020 con 0x7f0d54030060 2023-10-05T21:15:11.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.910+0000 7f0d6c0bd680 20 remove_watcher() i=3 2023-10-05T21:15:11.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.910+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94493452139552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a60800 con 0x55f0f8a24be0 2023-10-05T21:15:11.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.910+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(107 notify.4 [watch unwatch cookie 94493452139552] v29'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.910+0000 7f0d6c0bd680 20 remove_watcher() i=4 2023-10-05T21:15:11.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.910+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:108 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94493452152736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a5fc20 con 0x7f0d50007030 2023-10-05T21:15:11.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.911+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(108 notify.5 [watch unwatch cookie 94493452152736] v29'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x7f0d50007030 2023-10-05T21:15:11.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.911+0000 7f0d6c0bd680 20 remove_watcher() i=5 2023-10-05T21:15:11.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.911+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94493452156720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a60800 con 0x7f0d50007030 2023-10-05T21:15:11.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.912+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(109 notify.6 [watch unwatch cookie 94493452156720] v29'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x7f0d50007030 2023-10-05T21:15:11.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.912+0000 7f0d6c0bd680 20 remove_watcher() i=6 2023-10-05T21:15:11.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.912+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94493452158576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8a62fa0 con 0x7f0d50007030 2023-10-05T21:15:11.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.913+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(110 notify.7 [watch unwatch cookie 94493452158576] v29'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x7f0d50007030 2023-10-05T21:15:11.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.913+0000 7f0d6c0bd680 20 remove_watcher() i=7 2023-10-05T21:15:11.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.914+0000 7f0cabfff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:11.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.914+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:111 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94493452160912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f0f8ab1780 con 0x55f0f8a24be0 2023-10-05T21:15:11.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.914+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(111 data_loggenerations_metadata [watch unwatch cookie 94493452160912] v29'40 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0d5800a570 con 0x55f0f8a24be0 2023-10-05T21:15:11.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.914+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f0d50007030 msgr2=0x7f0d5001c920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 --2- 172.21.15.153:0/1832825565 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f0d50007030 0x7f0d5001c920 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55f0f8a24be0 msgr2=0x55f0f8a54f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 --2- 172.21.15.153:0/1832825565 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55f0f8a24be0 0x55f0f8a54f60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f0d54030060 msgr2=0x7f0d540253d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 --2- 172.21.15.153:0/1832825565 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f0d54030060 0x7f0d540253d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55f0f8a573d0 msgr2=0x55f0f8a597b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 --2- 172.21.15.153:0/1832825565 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55f0f8a573d0 0x55f0f8a597b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0d44034140 msgr2=0x7f0d440365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 --2- 172.21.15.153:0/1832825565 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0d44034140 0x7f0d440365f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0d50005b50 tx=0x7f0d50015000 comp rx=0 tx=0).stop 2023-10-05T21:15:11.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0f8a1e7b0 msgr2=0x55f0f8a21260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d5f996700 1 -- 172.21.15.153:0/1832825565 reap_dead start 2023-10-05T21:15:11.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 --2- 172.21.15.153:0/1832825565 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0f8a1e7b0 0x55f0f8a21260 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0d54000c00 tx=0x7f0d54016000 comp rx=0 tx=0).stop 2023-10-05T21:15:11.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 shutdown_connections 2023-10-05T21:15:11.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 --2- 172.21.15.153:0/1832825565 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0f8a1e7b0 0x55f0f8a21260 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 >> 172.21.15.153:0/1832825565 conn(0x55f0f8a1a300 msgr2=0x55f0f8a39e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:11.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 shutdown_connections 2023-10-05T21:15:11.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/1832825565 wait complete. 2023-10-05T21:15:11.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55f0f8a876d0 msgr2=0x55f0f8a89ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 --2- 172.21.15.153:0/3144119097 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55f0f8a876d0 0x55f0f8a89ab0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55f0f8a83de0 msgr2=0x55f0f8a86290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 --2- 172.21.15.153:0/3144119097 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55f0f8a83de0 0x55f0f8a86290 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55f0f8a8ef30 msgr2=0x55f0f8a91310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 --2- 172.21.15.153:0/3144119097 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55f0f8a8ef30 0x55f0f8a91310 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55f0f8a8af10 msgr2=0x55f0f8a8d350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 --2- 172.21.15.153:0/3144119097 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55f0f8a8af10 0x55f0f8a8d350 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:11.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0c9c034140 msgr2=0x7f0c9c0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 --2- 172.21.15.153:0/3144119097 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0c9c034140 0x7f0c9c0365f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x55f0f8a627c0 tx=0x7f0d58037470 comp rx=0 tx=0).stop 2023-10-05T21:15:11.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0f8a72350 msgr2=0x55f0f8a78ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:11.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 --2- 172.21.15.153:0/3144119097 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f0f8a72350 0x55f0f8a78ff0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0d50036040 tx=0x7f0d5002c000 comp rx=0 tx=0).stop 2023-10-05T21:15:11.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d5f195700 1 -- 172.21.15.153:0/3144119097 reap_dead start 2023-10-05T21:15:11.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d5f195700 1 -- 172.21.15.153:0/3144119097 reap_dead start 2023-10-05T21:15:11.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 shutdown_connections 2023-10-05T21:15:11.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 >> 172.21.15.153:0/3144119097 conn(0x55f0f8a6e650 msgr2=0x55f0f8a6c720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:11.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 shutdown_connections 2023-10-05T21:15:11.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:11.915+0000 7f0d6c0bd680 1 -- 172.21.15.153:0/3144119097 wait complete. 2023-10-05T21:15:11.934 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2023-10-05T21:15:11.934 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2023-10-05T21:15:11.934 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2023-10-05T21:15:12.007 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:12.007 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:12.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.006+0000 7f9e42ff6680 1 Processor -- start 2023-10-05T21:15:12.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.006+0000 7f9e42ff6680 1 -- start start 2023-10-05T21:15:12.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.006+0000 7f9e42ff6680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5632a1ca1be0 0x5632a1ca3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.006+0000 7f9e42ff6680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5632a1bea990 con 0x5632a1c9b7b0 2023-10-05T21:15:12.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.006+0000 7f9e42ff6680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x5632a1baadb0 con 0x5632a1ca1be0 2023-10-05T21:15:12.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.007+0000 7f9e358cd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5632a1ca1be0 0x5632a1ca3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.007+0000 7f9e358cd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5632a1ca1be0 0x5632a1ca3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49154/0 (socket says 172.21.15.153:49154) 2023-10-05T21:15:12.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.007+0000 7f9e360ce700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x5632a1c9b7b0 0x5632a1c9bbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56154/0 (socket says 172.21.15.153:56154) 2023-10-05T21:15:12.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.007+0000 7f9e358cd700 1 -- 172.21.15.153:0/2677196318 learned_addr learned my addr 172.21.15.153:0/2677196318 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.007+0000 7f9e358cd700 1 -- 172.21.15.153:0/2677196318 >> v1:172.21.15.111:6789/0 conn(0x5632a1c9b7b0 legacy=0x5632a1c9bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.007+0000 7f9e350cc700 1 -- 172.21.15.153:0/2677196318 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1226423626 0 0) 0x5632a1bea990 con 0x5632a1c9b7b0 2023-10-05T21:15:12.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.007+0000 7f9e358cd700 1 -- 172.21.15.153:0/2677196318 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5632a1ca5510 con 0x5632a1ca1be0 2023-10-05T21:15:12.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.007+0000 7f9e358cd700 1 --2- 172.21.15.153:0/2677196318 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1ca1be0 0x5632a1ca3fc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c00a650 tx=0x7f9e2c005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2f46110c86580b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.007+0000 7f9e350cc700 1 -- 172.21.15.153:0/2677196318 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e2c008760 con 0x5632a1ca1be0 2023-10-05T21:15:12.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.007+0000 7f9e350cc700 1 -- 172.21.15.153:0/2677196318 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2c0088c0 con 0x5632a1ca1be0 2023-10-05T21:15:12.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.007+0000 7f9e350cc700 1 -- 172.21.15.153:0/2677196318 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e2c008bb0 con 0x5632a1ca1be0 2023-10-05T21:15:12.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.008+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2677196318 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1ca1be0 msgr2=0x5632a1ca3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.008+0000 7f9e42ff6680 1 --2- 172.21.15.153:0/2677196318 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1ca1be0 0x5632a1ca3fc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c00a650 tx=0x7f9e2c005b10 comp rx=0 tx=0).stop 2023-10-05T21:15:12.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.008+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2677196318 shutdown_connections 2023-10-05T21:15:12.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.008+0000 7f9e42ff6680 1 --2- 172.21.15.153:0/2677196318 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1ca1be0 0x5632a1ca3fc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.008+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2677196318 >> 172.21.15.153:0/2677196318 conn(0x5632a1c97300 msgr2=0x5632a1c99710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.008+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2677196318 shutdown_connections 2023-10-05T21:15:12.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.008+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2677196318 wait complete. 2023-10-05T21:15:12.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.009+0000 7f9e42ff6680 1 Processor -- start 2023-10-05T21:15:12.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.009+0000 7f9e42ff6680 1 -- start start 2023-10-05T21:15:12.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.009+0000 7f9e42ff6680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1c9b7b0 0x5632a1cbc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.009+0000 7f9e42ff6680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632a1b4aea0 con 0x5632a1c9b7b0 2023-10-05T21:15:12.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.009+0000 7f9e360ce700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1c9b7b0 0x5632a1cbc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.009+0000 7f9e360ce700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1c9b7b0 0x5632a1cbc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49156/0 (socket says 172.21.15.153:49156) 2023-10-05T21:15:12.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.009+0000 7f9e360ce700 1 -- 172.21.15.153:0/231212695 learned_addr learned my addr 172.21.15.153:0/231212695 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.010+0000 7f9e360ce700 1 -- 172.21.15.153:0/231212695 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e2c005db0 con 0x5632a1c9b7b0 2023-10-05T21:15:12.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.010+0000 7f9e360ce700 1 --2- 172.21.15.153:0/231212695 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1c9b7b0 0x5632a1cbc930 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9e28001e80 tx=0x7f9e28001850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c4f2fcf145c13b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.010+0000 7f9e27fff700 1 -- 172.21.15.153:0/231212695 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e28014070 con 0x5632a1c9b7b0 2023-10-05T21:15:12.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.010+0000 7f9e27fff700 1 -- 172.21.15.153:0/231212695 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2800f450 con 0x5632a1c9b7b0 2023-10-05T21:15:12.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.010+0000 7f9e27fff700 1 -- 172.21.15.153:0/231212695 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e2800f740 con 0x5632a1c9b7b0 2023-10-05T21:15:12.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.010+0000 7f9e42ff6680 1 -- 172.21.15.153:0/231212695 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1c9b7b0 msgr2=0x5632a1cbc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.010+0000 7f9e42ff6680 1 --2- 172.21.15.153:0/231212695 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1c9b7b0 0x5632a1cbc930 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9e28001e80 tx=0x7f9e28001850 comp rx=0 tx=0).stop 2023-10-05T21:15:12.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.010+0000 7f9e42ff6680 1 -- 172.21.15.153:0/231212695 shutdown_connections 2023-10-05T21:15:12.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.010+0000 7f9e42ff6680 1 --2- 172.21.15.153:0/231212695 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1c9b7b0 0x5632a1cbc930 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.010+0000 7f9e42ff6680 1 -- 172.21.15.153:0/231212695 >> 172.21.15.153:0/231212695 conn(0x5632a1c97300 msgr2=0x5632a1cb8400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.010+0000 7f9e42ff6680 1 -- 172.21.15.153:0/231212695 shutdown_connections 2023-10-05T21:15:12.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.010+0000 7f9e42ff6680 1 -- 172.21.15.153:0/231212695 wait complete. 2023-10-05T21:15:12.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.011+0000 7f9e42ff6680 1 Processor -- start 2023-10-05T21:15:12.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.011+0000 7f9e42ff6680 1 -- start start 2023-10-05T21:15:12.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.011+0000 7f9e42ff6680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1c9b7b0 0x5632a1c9e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.011+0000 7f9e42ff6680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632a1b41c80 con 0x5632a1c9b7b0 2023-10-05T21:15:12.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.011+0000 7f9e360ce700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1c9b7b0 0x5632a1c9e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.011+0000 7f9e360ce700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1c9b7b0 0x5632a1c9e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49162/0 (socket says 172.21.15.153:49162) 2023-10-05T21:15:12.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.011+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 learned_addr learned my addr 172.21.15.153:0/312354993 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.012+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e28001b30 con 0x5632a1c9b7b0 2023-10-05T21:15:12.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.012+0000 7f9e360ce700 1 --2- 172.21.15.153:0/312354993 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1c9b7b0 0x5632a1c9e260 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9e280011e0 tx=0x7f9e28016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.012+0000 7f9e267fc700 1 -- 172.21.15.153:0/312354993 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e2800fe50 con 0x5632a1c9b7b0 2023-10-05T21:15:12.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.012+0000 7f9e267fc700 1 -- 172.21.15.153:0/312354993 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2801cb40 con 0x5632a1c9b7b0 2023-10-05T21:15:12.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.012+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5632a1c9c880 con 0x5632a1c9b7b0 2023-10-05T21:15:12.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.012+0000 7f9e267fc700 1 -- 172.21.15.153:0/312354993 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e2801ce30 con 0x5632a1c9b7b0 2023-10-05T21:15:12.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.012+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5632a1c9ccd0 con 0x5632a1c9b7b0 2023-10-05T21:15:12.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.013+0000 7f9e267fc700 1 -- 172.21.15.153:0/312354993 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f9e28023020 con 0x5632a1c9b7b0 2023-10-05T21:15:12.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.013+0000 7f9e267fc700 1 --2- 172.21.15.153:0/312354993 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9e18034140 0x7f9e180365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.013+0000 7f9e267fc700 1 -- 172.21.15.153:0/312354993 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f9e28008030 con 0x5632a1c9b7b0 2023-10-05T21:15:12.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.013+0000 7f9e42ff6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.013+0000 7f9e358cd700 1 --2- 172.21.15.153:0/312354993 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9e18034140 0x7f9e180365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.013+0000 7f9e42ff6680 1 --2- 172.21.15.153:0/312354993 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5632a1ca1be0 0x5632a1cd1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.013+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd2550 con 0x5632a1ca1be0 2023-10-05T21:15:12.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.013+0000 7f9e368cf700 1 --2- 172.21.15.153:0/312354993 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5632a1ca1be0 0x5632a1cd1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.013+0000 7f9e358cd700 1 --2- 172.21.15.153:0/312354993 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9e18034140 0x7f9e180365f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c005b50 tx=0x7f9e2c015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.013+0000 7f9e368cf700 1 --2- 172.21.15.153:0/312354993 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5632a1ca1be0 0x5632a1cd1dc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.014+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.014+0000 7f9e42ff6680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.014+0000 7f9e42ff6680 20 realm 2023-10-05T21:15:12.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.014+0000 7f9e42ff6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.014+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1ccf2a0 con 0x5632a1ca1be0 2023-10-05T21:15:12.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.014+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.014+0000 7f9e42ff6680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.014+0000 7f9e42ff6680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:12.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.014+0000 7f9e42ff6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.014+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd3000 con 0x5632a1ca1be0 2023-10-05T21:15:12.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.014+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.014+0000 7f9e42ff6680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.014+0000 7f9e42ff6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.014+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd2c50 con 0x5632a1ca1be0 2023-10-05T21:15:12.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.014+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.014+0000 7f9e42ff6680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.014+0000 7f9e42ff6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.014+0000 7f9e42ff6680 1 --2- 172.21.15.153:0/312354993 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5632a1cd43c0 0x5632a1cd67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.014+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd6ce0 con 0x5632a1cd43c0 2023-10-05T21:15:12.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.015+0000 7f9e360ce700 1 --2- 172.21.15.153:0/312354993 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5632a1cd43c0 0x5632a1cd67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.015+0000 7f9e360ce700 1 --2- 172.21.15.153:0/312354993 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5632a1cd43c0 0x5632a1cd67a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.015+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1cd43c0 2023-10-05T21:15:12.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.015+0000 7f9e42ff6680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:12.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.015+0000 7f9e42ff6680 20 searching for the correct realm 2023-10-05T21:15:12.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.015+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x5632a1cd43c0 2023-10-05T21:15:12.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.015+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1cd43c0 2023-10-05T21:15:12.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.015+0000 7f9e360ce700 1 --2- 172.21.15.153:0/312354993 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f9e2801a070 0x7f9e2801d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.015+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x7f9e2801a070 2023-10-05T21:15:12.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.016+0000 7f9e358cd700 1 --2- 172.21.15.153:0/312354993 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f9e2801a070 0x7f9e2801d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.016+0000 7f9e358cd700 1 --2- 172.21.15.153:0/312354993 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f9e2801a070 0x7f9e2801d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.016+0000 7f9e358cd700 1 -- 172.21.15.153:0/312354993 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e2c019040 con 0x7f9e2801a070 2023-10-05T21:15:12.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.016+0000 7f9e358cd700 1 --2- 172.21.15.153:0/312354993 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f9e2c007030 0x7f9e2c01d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.016+0000 7f9e358cd700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x7f9e2c007030 2023-10-05T21:15:12.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.016+0000 7f9e368cf700 1 --2- 172.21.15.153:0/312354993 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f9e2c007030 0x7f9e2c01d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.017+0000 7f9e368cf700 1 --2- 172.21.15.153:0/312354993 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f9e2c007030 0x7f9e2c01d420 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.017+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a570 con 0x7f9e2c007030 2023-10-05T21:15:12.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.017+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x5632a1ca1be0 2023-10-05T21:15:12.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.017+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.017+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x5632a1ca1be0 2023-10-05T21:15:12.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.017+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.017+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x7f9e2c007030 2023-10-05T21:15:12.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.017+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a570 con 0x7f9e2c007030 2023-10-05T21:15:12.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.017+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x7f9e2c007030 2023-10-05T21:15:12.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.018+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a570 con 0x7f9e2c007030 2023-10-05T21:15:12.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.018+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x7f9e2801a070 2023-10-05T21:15:12.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.018+0000 7f9e358cd700 1 -- 172.21.15.153:0/312354993 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e2c019040 con 0x7f9e2801a070 2023-10-05T21:15:12.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.018+0000 7f9e358cd700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x5632a1cd43c0 2023-10-05T21:15:12.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.018+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1cd43c0 2023-10-05T21:15:12.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.018+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x5632a1ca1be0 2023-10-05T21:15:12.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.018+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.018+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x7f9e2c007030 2023-10-05T21:15:12.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.019+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a570 con 0x7f9e2c007030 2023-10-05T21:15:12.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.019+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x5632a1ca1be0 2023-10-05T21:15:12.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.019+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.019+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x7f9e2801a070 2023-10-05T21:15:12.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.019+0000 7f9e358cd700 1 -- 172.21.15.153:0/312354993 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e2c019040 con 0x7f9e2801a070 2023-10-05T21:15:12.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.019+0000 7f9e358cd700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x5632a1cd43c0 2023-10-05T21:15:12.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.019+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1cd43c0 2023-10-05T21:15:12.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.019+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x5632a1cd43c0 2023-10-05T21:15:12.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.019+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1cd43c0 2023-10-05T21:15:12.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.019+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x7f9e2c007030 2023-10-05T21:15:12.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.020+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a570 con 0x7f9e2c007030 2023-10-05T21:15:12.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.020+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x5632a1cd43c0 2023-10-05T21:15:12.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.020+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1cd43c0 2023-10-05T21:15:12.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.020+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x5632a1cd43c0 2023-10-05T21:15:12.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.020+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1cd43c0 2023-10-05T21:15:12.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.020+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x5632a1ca1be0 2023-10-05T21:15:12.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.020+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.021+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x5632a1ca1be0 2023-10-05T21:15:12.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.021+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.021+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x7f9e2c007030 2023-10-05T21:15:12.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.021+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a570 con 0x7f9e2c007030 2023-10-05T21:15:12.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.021+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x5632a1cd43c0 2023-10-05T21:15:12.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.021+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1cd43c0 2023-10-05T21:15:12.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.021+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x7f9e2801a070 2023-10-05T21:15:12.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.021+0000 7f9e358cd700 1 -- 172.21.15.153:0/312354993 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e2c019040 con 0x7f9e2801a070 2023-10-05T21:15:12.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.021+0000 7f9e358cd700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x5632a1ca1be0 2023-10-05T21:15:12.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.022+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.022+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x7f9e2c007030 2023-10-05T21:15:12.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.022+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a570 con 0x7f9e2c007030 2023-10-05T21:15:12.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.022+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x5632a1cd43c0 2023-10-05T21:15:12.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.022+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1cd43c0 2023-10-05T21:15:12.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.022+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x7f9e2c007030 2023-10-05T21:15:12.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.023+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a570 con 0x7f9e2c007030 2023-10-05T21:15:12.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.023+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x7f9e2801a070 2023-10-05T21:15:12.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.023+0000 7f9e358cd700 1 -- 172.21.15.153:0/312354993 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e2c019040 con 0x7f9e2801a070 2023-10-05T21:15:12.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.023+0000 7f9e358cd700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x5632a1cd43c0 2023-10-05T21:15:12.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.023+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1cd43c0 2023-10-05T21:15:12.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.023+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x7f9e2c007030 2023-10-05T21:15:12.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.023+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a570 con 0x7f9e2c007030 2023-10-05T21:15:12.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.023+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x5632a1ca1be0 2023-10-05T21:15:12.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.023+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.023+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8750 con 0x7f9e2801a070 2023-10-05T21:15:12.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.024+0000 7f9e358cd700 1 -- 172.21.15.153:0/312354993 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e2c019040 con 0x7f9e2801a070 2023-10-05T21:15:12.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.024+0000 7f9e42ff6680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:12.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.024+0000 7f9e42ff6680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:12.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.024+0000 7f9e42ff6680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:12.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.024+0000 7f9e42ff6680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:12.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.024+0000 7f9e42ff6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.024+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd7670 con 0x5632a1ca1be0 2023-10-05T21:15:12.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.024+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.024+0000 7f9e42ff6680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.024+0000 7f9e42ff6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.024+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd7a70 con 0x5632a1ca1be0 2023-10-05T21:15:12.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.024+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.024+0000 7f9e42ff6680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.024+0000 7f9e42ff6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.024+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8be0 con 0x5632a1ca1be0 2023-10-05T21:15:12.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.024+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.024+0000 7f9e42ff6680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:12.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.024+0000 7f9e42ff6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.025+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8f90 con 0x5632a1cd43c0 2023-10-05T21:15:12.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.025+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1cd43c0 2023-10-05T21:15:12.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.025+0000 7f9e42ff6680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.025+0000 7f9e42ff6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.025+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd9340 con 0x5632a1ca1be0 2023-10-05T21:15:12.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.025+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.025+0000 7f9e42ff6680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.025+0000 7f9e42ff6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.025+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd9340 con 0x5632a1ca1be0 2023-10-05T21:15:12.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.025+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.025+0000 7f9e42ff6680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.025+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd9340 con 0x5632a1cd43c0 2023-10-05T21:15:12.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.025+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1cd43c0 2023-10-05T21:15:12.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.025+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd9340 con 0x7f9e2801a070 2023-10-05T21:15:12.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.026+0000 7f9e358cd700 1 -- 172.21.15.153:0/312354993 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e2c019040 con 0x7f9e2801a070 2023-10-05T21:15:12.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.026+0000 7f9e358cd700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd9340 con 0x7f9e2c007030 2023-10-05T21:15:12.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.026+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a570 con 0x7f9e2c007030 2023-10-05T21:15:12.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.026+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8be0 con 0x5632a1ca1be0 2023-10-05T21:15:12.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.026+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.026+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8be0 con 0x5632a1ca1be0 2023-10-05T21:15:12.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.026+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.026+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8be0 con 0x7f9e2c007030 2023-10-05T21:15:12.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.027+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a570 con 0x7f9e2c007030 2023-10-05T21:15:12.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.027+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8be0 con 0x7f9e2c007030 2023-10-05T21:15:12.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.027+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a570 con 0x7f9e2c007030 2023-10-05T21:15:12.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.027+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8be0 con 0x7f9e2801a070 2023-10-05T21:15:12.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.027+0000 7f9e358cd700 1 -- 172.21.15.153:0/312354993 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e2c019040 con 0x7f9e2801a070 2023-10-05T21:15:12.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.027+0000 7f9e358cd700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8be0 con 0x5632a1cd43c0 2023-10-05T21:15:12.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.027+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1cd43c0 2023-10-05T21:15:12.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.028+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8be0 con 0x5632a1ca1be0 2023-10-05T21:15:12.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.028+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.028+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8be0 con 0x7f9e2c007030 2023-10-05T21:15:12.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.028+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a570 con 0x7f9e2c007030 2023-10-05T21:15:12.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.028+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8be0 con 0x5632a1ca1be0 2023-10-05T21:15:12.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.028+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.028+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8be0 con 0x7f9e2801a070 2023-10-05T21:15:12.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.028+0000 7f9e358cd700 1 -- 172.21.15.153:0/312354993 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e2c019040 con 0x7f9e2801a070 2023-10-05T21:15:12.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.028+0000 7f9e358cd700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8be0 con 0x5632a1cd43c0 2023-10-05T21:15:12.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.029+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1cd43c0 2023-10-05T21:15:12.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.029+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8be0 con 0x5632a1cd43c0 2023-10-05T21:15:12.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.029+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1cd43c0 2023-10-05T21:15:12.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.029+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8be0 con 0x7f9e2c007030 2023-10-05T21:15:12.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.029+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a570 con 0x7f9e2c007030 2023-10-05T21:15:12.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.029+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8be0 con 0x5632a1cd43c0 2023-10-05T21:15:12.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.029+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1cd43c0 2023-10-05T21:15:12.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.029+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8be0 con 0x5632a1cd43c0 2023-10-05T21:15:12.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.029+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1cd43c0 2023-10-05T21:15:12.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.030+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8be0 con 0x5632a1ca1be0 2023-10-05T21:15:12.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.030+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.030+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8be0 con 0x5632a1ca1be0 2023-10-05T21:15:12.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.030+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.030+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8be0 con 0x7f9e2c007030 2023-10-05T21:15:12.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.030+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a570 con 0x7f9e2c007030 2023-10-05T21:15:12.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.030+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8be0 con 0x5632a1cd43c0 2023-10-05T21:15:12.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.031+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1cd43c0 2023-10-05T21:15:12.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.031+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8be0 con 0x7f9e2801a070 2023-10-05T21:15:12.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.031+0000 7f9e358cd700 1 -- 172.21.15.153:0/312354993 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e2c019040 con 0x7f9e2801a070 2023-10-05T21:15:12.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.031+0000 7f9e358cd700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8be0 con 0x5632a1ca1be0 2023-10-05T21:15:12.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.031+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.031+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8be0 con 0x7f9e2c007030 2023-10-05T21:15:12.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.031+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a570 con 0x7f9e2c007030 2023-10-05T21:15:12.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.031+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8be0 con 0x5632a1cd43c0 2023-10-05T21:15:12.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.032+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1cd43c0 2023-10-05T21:15:12.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.032+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8be0 con 0x7f9e2c007030 2023-10-05T21:15:12.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.032+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a570 con 0x7f9e2c007030 2023-10-05T21:15:12.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.032+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8be0 con 0x7f9e2801a070 2023-10-05T21:15:12.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.032+0000 7f9e358cd700 1 -- 172.21.15.153:0/312354993 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e2c019040 con 0x7f9e2801a070 2023-10-05T21:15:12.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.032+0000 7f9e358cd700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8be0 con 0x5632a1cd43c0 2023-10-05T21:15:12.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.032+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1cd43c0 2023-10-05T21:15:12.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.032+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8be0 con 0x7f9e2c007030 2023-10-05T21:15:12.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.033+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e3000a570 con 0x7f9e2c007030 2023-10-05T21:15:12.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.033+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8be0 con 0x5632a1ca1be0 2023-10-05T21:15:12.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.033+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.033+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd8be0 con 0x7f9e2801a070 2023-10-05T21:15:12.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.033+0000 7f9e358cd700 1 -- 172.21.15.153:0/312354993 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9e2c019040 con 0x7f9e2801a070 2023-10-05T21:15:12.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.033+0000 7f9e42ff6680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:12.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.033+0000 7f9e42ff6680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:12.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.033+0000 7f9e42ff6680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:12.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.033+0000 7f9e42ff6680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:12.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.033+0000 7f9e42ff6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.033+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd9340 con 0x5632a1ca1be0 2023-10-05T21:15:12.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.033+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.033+0000 7f9e42ff6680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.033+0000 7f9e42ff6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.033+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd9740 con 0x5632a1cd43c0 2023-10-05T21:15:12.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.034+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1cd43c0 2023-10-05T21:15:12.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.034+0000 7f9e42ff6680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:12.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.034+0000 7f9e42ff6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.034+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd9fe0 con 0x5632a1ca1be0 2023-10-05T21:15:12.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.034+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.034+0000 7f9e42ff6680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.034+0000 7f9e42ff6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.034+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd9fe0 con 0x5632a1ca1be0 2023-10-05T21:15:12.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.034+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.034+0000 7f9e42ff6680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:12.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.034+0000 7f9e42ff6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.034+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd9fe0 con 0x7f9e2c007030 2023-10-05T21:15:12.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.034+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x7f9e2c007030 2023-10-05T21:15:12.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.034+0000 7f9e42ff6680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.034+0000 7f9e42ff6680 20 zone default found 2023-10-05T21:15:12.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.034+0000 7f9e42ff6680 4 Realm: () 2023-10-05T21:15:12.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.034+0000 7f9e42ff6680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:12.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.034+0000 7f9e42ff6680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:12.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.034+0000 7f9e42ff6680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:12.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.034+0000 7f9e42ff6680 20 zonegroup default 2023-10-05T21:15:12.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.034+0000 7f9e42ff6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.034+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cd9fe0 con 0x7f9e2c007030 2023-10-05T21:15:12.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.035+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x7f9e2c007030 2023-10-05T21:15:12.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.035+0000 7f9e42ff6680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.035+0000 7f9e42ff6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.035+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cdb960 con 0x5632a1cd43c0 2023-10-05T21:15:12.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.035+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1cd43c0 2023-10-05T21:15:12.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.035+0000 7f9e42ff6680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.035+0000 7f9e42ff6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.035+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cdbd10 con 0x5632a1cd43c0 2023-10-05T21:15:12.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.035+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1cd43c0 2023-10-05T21:15:12.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.035+0000 7f9e42ff6680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.035+0000 7f9e42ff6680 20 started sync module instance, tier type = 2023-10-05T21:15:12.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.035+0000 7f9e42ff6680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:12.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.035+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cdb070 con 0x7f9e2801a070 2023-10-05T21:15:12.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.036+0000 7f9e358cd700 1 -- 172.21.15.153:0/312354993 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e2c019040 con 0x7f9e2801a070 2023-10-05T21:15:12.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.036+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94775462966384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cdc650 con 0x7f9e2801a070 2023-10-05T21:15:12.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.036+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cdcef0 con 0x5632a1ca1be0 2023-10-05T21:15:12.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.037+0000 7f9e358cd700 1 -- 172.21.15.153:0/312354993 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94775462966384] v29'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e2c019040 con 0x7f9e2801a070 2023-10-05T21:15:12.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.037+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.037+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94775462971904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cdd340 con 0x5632a1ca1be0 2023-10-05T21:15:12.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.037+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cddbe0 con 0x5632a1cd43c0 2023-10-05T21:15:12.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.037+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94775462971904] v29'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.037+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1cd43c0 2023-10-05T21:15:12.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.037+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94775462973296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cddfe0 con 0x5632a1cd43c0 2023-10-05T21:15:12.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.037+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cde900 con 0x7f9e2801a070 2023-10-05T21:15:12.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.038+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94775462973296] v29'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1cd43c0 2023-10-05T21:15:12.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.038+0000 7f9e358cd700 1 -- 172.21.15.153:0/312354993 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e2c019040 con 0x7f9e2801a070 2023-10-05T21:15:12.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.038+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94775462977504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cde430 con 0x7f9e2801a070 2023-10-05T21:15:12.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.038+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cdf6e0 con 0x5632a1ca1be0 2023-10-05T21:15:12.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.039+0000 7f9e358cd700 1 -- 172.21.15.153:0/312354993 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94775462977504] v29'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e2c019040 con 0x7f9e2801a070 2023-10-05T21:15:12.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.039+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.039+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94775462981152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cdf820 con 0x5632a1ca1be0 2023-10-05T21:15:12.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.039+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1ce03d0 con 0x7f9e2c007030 2023-10-05T21:15:12.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.040+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94775462981152] v29'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.040+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x7f9e2c007030 2023-10-05T21:15:12.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.040+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94775462985312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1ce0390 con 0x7f9e2c007030 2023-10-05T21:15:12.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.040+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1ce0e30 con 0x7f9e2c007030 2023-10-05T21:15:12.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.040+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94775462985312] v29'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x7f9e2c007030 2023-10-05T21:15:12.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.040+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x7f9e2c007030 2023-10-05T21:15:12.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.040+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94775462982256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1ce0e30 con 0x7f9e2c007030 2023-10-05T21:15:12.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.041+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1ce18c0 con 0x7f9e2c007030 2023-10-05T21:15:12.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.041+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94775462982256] v29'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x7f9e2c007030 2023-10-05T21:15:12.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.041+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x7f9e2c007030 2023-10-05T21:15:12.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.041+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94775462990672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1ce1af0 con 0x7f9e2c007030 2023-10-05T21:15:12.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.041+0000 7f9e42ff6680 20 add_watcher() i=0 2023-10-05T21:15:12.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.041+0000 7f9e42ff6680 20 add_watcher() i=1 2023-10-05T21:15:12.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.041+0000 7f9e42ff6680 20 add_watcher() i=2 2023-10-05T21:15:12.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.041+0000 7f9e42ff6680 20 add_watcher() i=3 2023-10-05T21:15:12.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.041+0000 7f9e42ff6680 20 add_watcher() i=4 2023-10-05T21:15:12.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.041+0000 7f9e42ff6680 20 add_watcher() i=5 2023-10-05T21:15:12.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.041+0000 7f9e42ff6680 20 add_watcher() i=6 2023-10-05T21:15:12.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.042+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94775462990672] v29'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x7f9e2c007030 2023-10-05T21:15:12.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.042+0000 7f9e42ff6680 20 add_watcher() i=7 2023-10-05T21:15:12.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.042+0000 7f9e42ff6680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:12.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.042+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1ce4f00 con 0x5632a1ca1be0 2023-10-05T21:15:12.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.042+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.042+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94775462992352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1ce2320 con 0x5632a1ca1be0 2023-10-05T21:15:12.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.043+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94775462992352] v29'41 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.043+0000 7f9e07fdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:12.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.043+0000 7f9e42ff6680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:12.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.043+0000 7f9e42ff6680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:12.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.044+0000 7f9e42ff6680 1 Processor -- start 2023-10-05T21:15:12.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.044+0000 7f9e42ff6680 1 -- start start 2023-10-05T21:15:12.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.044+0000 7f9e42ff6680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1ceea50 0x5632a1ceee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.044+0000 7f9e42ff6680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632a1cef470 con 0x5632a1ceea50 2023-10-05T21:15:12.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.044+0000 7f9e358cd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1ceea50 0x5632a1ceee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.044+0000 7f9e358cd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1ceea50 0x5632a1ceee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49178/0 (socket says 172.21.15.153:49178) 2023-10-05T21:15:12.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.044+0000 7f9e358cd700 1 -- 172.21.15.153:0/2892586902 learned_addr learned my addr 172.21.15.153:0/2892586902 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.044+0000 7f9e358cd700 1 -- 172.21.15.153:0/2892586902 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5632a1cef950 con 0x5632a1ceea50 2023-10-05T21:15:12.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.044+0000 7f9e358cd700 1 --2- 172.21.15.153:0/2892586902 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1ceea50 0x5632a1ceee60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x5632a1c9c480 tx=0x7f9e2c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b72a779fb17ff2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.045+0000 7f9e077de700 1 -- 172.21.15.153:0/2892586902 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e2c01de90 con 0x5632a1ceea50 2023-10-05T21:15:12.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.045+0000 7f9e077de700 1 -- 172.21.15.153:0/2892586902 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2c02b440 con 0x5632a1ceea50 2023-10-05T21:15:12.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.045+0000 7f9e077de700 1 -- 172.21.15.153:0/2892586902 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e2c02b650 con 0x5632a1ceea50 2023-10-05T21:15:12.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.045+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2892586902 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1ceea50 msgr2=0x5632a1ceee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.045+0000 7f9e42ff6680 1 --2- 172.21.15.153:0/2892586902 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1ceea50 0x5632a1ceee60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x5632a1c9c480 tx=0x7f9e2c012000 comp rx=0 tx=0).stop 2023-10-05T21:15:12.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.045+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2892586902 shutdown_connections 2023-10-05T21:15:12.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.045+0000 7f9e42ff6680 1 --2- 172.21.15.153:0/2892586902 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1ceea50 0x5632a1ceee60 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.045+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2892586902 >> 172.21.15.153:0/2892586902 conn(0x5632a1cead50 msgr2=0x5632a1ce8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.045+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2892586902 shutdown_connections 2023-10-05T21:15:12.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.045+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2892586902 wait complete. 2023-10-05T21:15:12.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.046+0000 7f9e42ff6680 1 Processor -- start 2023-10-05T21:15:12.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.046+0000 7f9e42ff6680 1 -- start start 2023-10-05T21:15:12.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.046+0000 7f9e42ff6680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1ceea50 0x5632a1cf5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.046+0000 7f9e42ff6680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632a1cf5c90 con 0x5632a1ceea50 2023-10-05T21:15:12.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.046+0000 7f9e358cd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1ceea50 0x5632a1cf5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.046+0000 7f9e358cd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1ceea50 0x5632a1cf5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49186/0 (socket says 172.21.15.153:49186) 2023-10-05T21:15:12.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.046+0000 7f9e358cd700 1 -- 172.21.15.153:0/2186139267 learned_addr learned my addr 172.21.15.153:0/2186139267 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.046+0000 7f9e358cd700 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5632a1ca5510 con 0x5632a1ceea50 2023-10-05T21:15:12.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.046+0000 7f9e358cd700 1 --2- 172.21.15.153:0/2186139267 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1ceea50 0x5632a1cf5750 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x5632a1cea2c0 tx=0x7f9e2c030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.047+0000 7f9e05fdb700 1 -- 172.21.15.153:0/2186139267 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e2c009640 con 0x5632a1ceea50 2023-10-05T21:15:12.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.047+0000 7f9e05fdb700 1 -- 172.21.15.153:0/2186139267 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2c0097a0 con 0x5632a1ceea50 2023-10-05T21:15:12.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.047+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5632a1cf5e90 con 0x5632a1ceea50 2023-10-05T21:15:12.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.047+0000 7f9e05fdb700 1 -- 172.21.15.153:0/2186139267 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e2c009930 con 0x5632a1ceea50 2023-10-05T21:15:12.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.047+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5632a1cf6340 con 0x5632a1ceea50 2023-10-05T21:15:12.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.047+0000 7f9e05fdb700 1 -- 172.21.15.153:0/2186139267 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f9e2c009a90 con 0x5632a1ceea50 2023-10-05T21:15:12.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.048+0000 7f9e05fdb700 1 --2- 172.21.15.153:0/2186139267 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9d7c034140 0x7f9d7c0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.048+0000 7f9e05fdb700 1 -- 172.21.15.153:0/2186139267 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f9e2c02be40 con 0x5632a1ceea50 2023-10-05T21:15:12.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.048+0000 7f9e368cf700 1 --2- 172.21.15.153:0/2186139267 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9d7c034140 0x7f9d7c0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.048+0000 7f9e42ff6680 1 --2- 172.21.15.153:0/2186139267 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5632a1d00520 0x5632a1d029b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.048+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d030b0 con 0x5632a1d00520 2023-10-05T21:15:12.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.048+0000 7f9e360ce700 1 --2- 172.21.15.153:0/2186139267 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5632a1d00520 0x5632a1d029b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.048+0000 7f9e368cf700 1 --2- 172.21.15.153:0/2186139267 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9d7c034140 0x7f9d7c0365f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x5632a1ce0c50 tx=0x7f9e30037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.048+0000 7f9e360ce700 1 --2- 172.21.15.153:0/2186139267 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5632a1d00520 0x5632a1d029b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.049+0000 7f9e360ce700 1 -- 172.21.15.153:0/2186139267 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v29'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1d00520 2023-10-05T21:15:12.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.049+0000 7f9e42ff6680 1 --2- 172.21.15.153:0/2186139267 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x5632a1d03e30 0x5632a1d06210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.049+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d06910 con 0x5632a1d03e30 2023-10-05T21:15:12.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.049+0000 7f9e358cd700 1 --2- 172.21.15.153:0/2186139267 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x5632a1d03e30 0x5632a1d06210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.050+0000 7f9e358cd700 1 --2- 172.21.15.153:0/2186139267 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x5632a1d03e30 0x5632a1d06210 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.050+0000 7f9e358cd700 1 -- 172.21.15.153:0/2186139267 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v29'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9e2c033040 con 0x5632a1d03e30 2023-10-05T21:15:12.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.050+0000 7f9e42ff6680 1 --2- 172.21.15.153:0/2186139267 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5632a1d076a0 0x5632a1d09b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.050+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d0a280 con 0x5632a1d076a0 2023-10-05T21:15:12.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.051+0000 7f9e368cf700 1 --2- 172.21.15.153:0/2186139267 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5632a1d076a0 0x5632a1d09b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.051+0000 7f9e368cf700 1 --2- 172.21.15.153:0/2186139267 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5632a1d076a0 0x5632a1d09b30 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.051+0000 7f9e368cf700 1 -- 172.21.15.153:0/2186139267 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v29'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1d076a0 2023-10-05T21:15:12.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.051+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d0aa30 con 0x5632a1d00520 2023-10-05T21:15:12.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.052+0000 7f9e360ce700 1 -- 172.21.15.153:0/2186139267 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v29'42 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1d00520 2023-10-05T21:15:12.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.052+0000 7f9e42ff6680 1 --2- 172.21.15.153:0/2186139267 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x5632a1d0b640 0x5632a1d0daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.052+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d0e1a0 con 0x5632a1d0b640 2023-10-05T21:15:12.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.052+0000 7f9e360ce700 1 --2- 172.21.15.153:0/2186139267 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x5632a1d0b640 0x5632a1d0daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.053+0000 7f9e360ce700 1 --2- 172.21.15.153:0/2186139267 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x5632a1d0b640 0x5632a1d0daf0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.053+0000 7f9e360ce700 1 -- 172.21.15.153:0/2186139267 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v29'29 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1d0b640 2023-10-05T21:15:12.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.053+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d0e8d0 con 0x5632a1d076a0 2023-10-05T21:15:12.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.054+0000 7f9e368cf700 1 -- 172.21.15.153:0/2186139267 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v29'19 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1d076a0 2023-10-05T21:15:12.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.054+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d0ef70 con 0x5632a1d00520 2023-10-05T21:15:12.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.055+0000 7f9e360ce700 1 -- 172.21.15.153:0/2186139267 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v29'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1d00520 2023-10-05T21:15:12.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.055+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d0f000 con 0x5632a1d03e30 2023-10-05T21:15:12.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.056+0000 7f9e358cd700 1 -- 172.21.15.153:0/2186139267 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v29'19 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9e2c033040 con 0x5632a1d03e30 2023-10-05T21:15:12.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.056+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d0f620 con 0x5632a1d0b640 2023-10-05T21:15:12.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.056+0000 7f9e360ce700 1 -- 172.21.15.153:0/2186139267 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v29'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1d0b640 2023-10-05T21:15:12.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.056+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d0f620 con 0x5632a1d076a0 2023-10-05T21:15:12.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.057+0000 7f9e368cf700 1 -- 172.21.15.153:0/2186139267 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v29'19 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1d076a0 2023-10-05T21:15:12.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.057+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d0fc80 con 0x5632a1d0b640 2023-10-05T21:15:12.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.058+0000 7f9e360ce700 1 -- 172.21.15.153:0/2186139267 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v29'30 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1d0b640 2023-10-05T21:15:12.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.058+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d0fc40 con 0x5632a1d03e30 2023-10-05T21:15:12.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.059+0000 7f9e358cd700 1 -- 172.21.15.153:0/2186139267 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v29'15 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9e2c033040 con 0x5632a1d03e30 2023-10-05T21:15:12.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.059+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d10260 con 0x5632a1d0b640 2023-10-05T21:15:12.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.059+0000 7f9e360ce700 1 -- 172.21.15.153:0/2186139267 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v29'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1d0b640 2023-10-05T21:15:12.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.059+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d10260 con 0x5632a1d03e30 2023-10-05T21:15:12.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.060+0000 7f9e358cd700 1 -- 172.21.15.153:0/2186139267 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v29'25 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9e2c033040 con 0x5632a1d03e30 2023-10-05T21:15:12.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.060+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d10750 con 0x5632a1d00520 2023-10-05T21:15:12.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.061+0000 7f9e360ce700 1 -- 172.21.15.153:0/2186139267 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v29'43 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1d00520 2023-10-05T21:15:12.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.061+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d10750 con 0x5632a1d076a0 2023-10-05T21:15:12.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.062+0000 7f9e368cf700 1 -- 172.21.15.153:0/2186139267 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v29'23 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1d076a0 2023-10-05T21:15:12.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.062+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d10750 con 0x5632a1d0b640 2023-10-05T21:15:12.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.062+0000 7f9e360ce700 1 -- 172.21.15.153:0/2186139267 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v29'31 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1d0b640 2023-10-05T21:15:12.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.062+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d10750 con 0x5632a1d076a0 2023-10-05T21:15:12.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.063+0000 7f9e368cf700 1 -- 172.21.15.153:0/2186139267 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v29'13 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1d076a0 2023-10-05T21:15:12.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.063+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d10750 con 0x5632a1d00520 2023-10-05T21:15:12.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.064+0000 7f9e360ce700 1 -- 172.21.15.153:0/2186139267 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v29'21 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1d00520 2023-10-05T21:15:12.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.064+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d10750 con 0x5632a1d00520 2023-10-05T21:15:12.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.065+0000 7f9e360ce700 1 -- 172.21.15.153:0/2186139267 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v29'44 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1d00520 2023-10-05T21:15:12.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.065+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d10750 con 0x5632a1d076a0 2023-10-05T21:15:12.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.065+0000 7f9e368cf700 1 -- 172.21.15.153:0/2186139267 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v29'24 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1d076a0 2023-10-05T21:15:12.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.065+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d10750 con 0x5632a1d0b640 2023-10-05T21:15:12.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.066+0000 7f9e360ce700 1 -- 172.21.15.153:0/2186139267 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v29'24 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1d0b640 2023-10-05T21:15:12.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.066+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d10750 con 0x5632a1d076a0 2023-10-05T21:15:12.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.067+0000 7f9e368cf700 1 -- 172.21.15.153:0/2186139267 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v29'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1d076a0 2023-10-05T21:15:12.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.067+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d107e0 con 0x5632a1d076a0 2023-10-05T21:15:12.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.067+0000 7f9e368cf700 1 -- 172.21.15.153:0/2186139267 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v29'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1d076a0 2023-10-05T21:15:12.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.067+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d107e0 con 0x5632a1d076a0 2023-10-05T21:15:12.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.068+0000 7f9e368cf700 1 -- 172.21.15.153:0/2186139267 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v29'9 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1d076a0 2023-10-05T21:15:12.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.068+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d107e0 con 0x5632a1d076a0 2023-10-05T21:15:12.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.069+0000 7f9e368cf700 1 -- 172.21.15.153:0/2186139267 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v29'20 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1d076a0 2023-10-05T21:15:12.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.069+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d107e0 con 0x5632a1d03e30 2023-10-05T21:15:12.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.070+0000 7f9e358cd700 1 -- 172.21.15.153:0/2186139267 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v29'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9e2c033040 con 0x5632a1d03e30 2023-10-05T21:15:12.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.070+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d107e0 con 0x5632a1d076a0 2023-10-05T21:15:12.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.070+0000 7f9e368cf700 1 -- 172.21.15.153:0/2186139267 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v29'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1d076a0 2023-10-05T21:15:12.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.070+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d107e0 con 0x5632a1d03e30 2023-10-05T21:15:12.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.071+0000 7f9e358cd700 1 -- 172.21.15.153:0/2186139267 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v29'20 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9e2c033040 con 0x5632a1d03e30 2023-10-05T21:15:12.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.071+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d107e0 con 0x5632a1d076a0 2023-10-05T21:15:12.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.072+0000 7f9e368cf700 1 -- 172.21.15.153:0/2186139267 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v29'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1d076a0 2023-10-05T21:15:12.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.072+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d107e0 con 0x5632a1d03e30 2023-10-05T21:15:12.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.073+0000 7f9e358cd700 1 -- 172.21.15.153:0/2186139267 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v29'26 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9e2c033040 con 0x5632a1d03e30 2023-10-05T21:15:12.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.073+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d107e0 con 0x5632a1d0b640 2023-10-05T21:15:12.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.074+0000 7f9e360ce700 1 -- 172.21.15.153:0/2186139267 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v29'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1d0b640 2023-10-05T21:15:12.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.075+0000 7f9d76ffd700 20 reqs_thread_entry: start 2023-10-05T21:15:12.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.075+0000 7f9d74ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:12.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.075+0000 7f9e42ff6680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:12.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.075+0000 7f9e42ff6680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:12.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.075+0000 7f9d66ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:42 2023 2023-10-05T21:15:12.094 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:12.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.075+0000 7f9d667fc700 20 reqs_thread_entry: start 2023-10-05T21:15:12.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.075+0000 7f9e42ff6680 20 get_system_obj_state: rctx=0x7fffb33eac38 obj=default.rgw.meta:users.uid:foo state=0x5632a1c10330 s->prefetch_data=0 2023-10-05T21:15:12.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.075+0000 7f9e42ff6680 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T21:15:12.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.075+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d6bb20 con 0x5632a1ca1be0 2023-10-05T21:15:12.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.075+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call,getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.076+0000 7f9e42ff6680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2023-10-05T21:15:12.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.076+0000 7f9e42ff6680 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:12.095 INFO:teuthology.orchestra.run.smithi153.stderr:could not remove user: unable to remove user, user does not exist 2023-10-05T21:15:12.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.076+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:103 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94775462966384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d2a680 con 0x7f9e2801a070 2023-10-05T21:15:12.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.076+0000 7f9e358cd700 1 -- 172.21.15.153:0/312354993 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(103 notify.0 [watch unwatch cookie 94775462966384] v29'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e2c033040 con 0x7f9e2801a070 2023-10-05T21:15:12.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.076+0000 7f9e42ff6680 20 remove_watcher() i=0 2023-10-05T21:15:12.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.076+0000 7f9e42ff6680 2 removed watcher, disabling cache 2023-10-05T21:15:12.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.076+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:104 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94775462971904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cdb470 con 0x5632a1ca1be0 2023-10-05T21:15:12.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.078+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(104 notify.1 [watch unwatch cookie 94775462971904] v29'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.078+0000 7f9e42ff6680 20 remove_watcher() i=1 2023-10-05T21:15:12.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.078+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:105 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94775462973296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cdca00 con 0x5632a1cd43c0 2023-10-05T21:15:12.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.078+0000 7f9e360ce700 1 -- 172.21.15.153:0/312354993 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(105 notify.2 [watch unwatch cookie 94775462973296] v29'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e28016070 con 0x5632a1cd43c0 2023-10-05T21:15:12.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.078+0000 7f9e42ff6680 20 remove_watcher() i=2 2023-10-05T21:15:12.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.078+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:106 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94775462977504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cdca00 con 0x7f9e2801a070 2023-10-05T21:15:12.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.079+0000 7f9e358cd700 1 -- 172.21.15.153:0/312354993 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(106 notify.3 [watch unwatch cookie 94775462977504] v29'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e2c033040 con 0x7f9e2801a070 2023-10-05T21:15:12.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.079+0000 7f9e42ff6680 20 remove_watcher() i=3 2023-10-05T21:15:12.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.079+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94775462981152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cdca00 con 0x5632a1ca1be0 2023-10-05T21:15:12.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.080+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(107 notify.4 [watch unwatch cookie 94775462981152] v29'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.080+0000 7f9e42ff6680 20 remove_watcher() i=4 2023-10-05T21:15:12.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.080+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:108 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94775462985312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cdee20 con 0x7f9e2c007030 2023-10-05T21:15:12.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.081+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(108 notify.5 [watch unwatch cookie 94775462985312] v29'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x7f9e2c007030 2023-10-05T21:15:12.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.081+0000 7f9e42ff6680 20 remove_watcher() i=5 2023-10-05T21:15:12.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.081+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94775462982256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cdca00 con 0x7f9e2c007030 2023-10-05T21:15:12.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.081+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(109 notify.6 [watch unwatch cookie 94775462982256] v29'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x7f9e2c007030 2023-10-05T21:15:12.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.081+0000 7f9e42ff6680 20 remove_watcher() i=6 2023-10-05T21:15:12.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.081+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94775462990672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1cdf310 con 0x7f9e2c007030 2023-10-05T21:15:12.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.082+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(110 notify.7 [watch unwatch cookie 94775462990672] v29'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x7f9e2c007030 2023-10-05T21:15:12.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.082+0000 7f9e42ff6680 20 remove_watcher() i=7 2023-10-05T21:15:12.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.083+0000 7f9e07fdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:12.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.083+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:111 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94775462992352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5632a1d2de20 con 0x5632a1ca1be0 2023-10-05T21:15:12.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(111 data_loggenerations_metadata [watch unwatch cookie 94775462992352] v29'45 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9e3000a570 con 0x5632a1ca1be0 2023-10-05T21:15:12.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f9e2c007030 msgr2=0x7f9e2c01d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e42ff6680 1 --2- 172.21.15.153:0/312354993 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f9e2c007030 0x7f9e2c01d420 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5632a1ca1be0 msgr2=0x5632a1cd1dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e42ff6680 1 --2- 172.21.15.153:0/312354993 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5632a1ca1be0 0x5632a1cd1dc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f9e2801a070 msgr2=0x7f9e2801d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e42ff6680 1 --2- 172.21.15.153:0/312354993 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f9e2801a070 0x7f9e2801d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5632a1cd43c0 msgr2=0x5632a1cd67a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e42ff6680 1 --2- 172.21.15.153:0/312354993 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5632a1cd43c0 0x5632a1cd67a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9e18034140 msgr2=0x7f9e180365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e42ff6680 1 --2- 172.21.15.153:0/312354993 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9e18034140 0x7f9e180365f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c005b50 tx=0x7f9e2c015000 comp rx=0 tx=0).stop 2023-10-05T21:15:12.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1c9b7b0 msgr2=0x5632a1c9e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e368cf700 1 -- 172.21.15.153:0/312354993 reap_dead start 2023-10-05T21:15:12.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e42ff6680 1 --2- 172.21.15.153:0/312354993 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1c9b7b0 0x5632a1c9e260 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9e280011e0 tx=0x7f9e28016000 comp rx=0 tx=0).stop 2023-10-05T21:15:12.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 shutdown_connections 2023-10-05T21:15:12.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e42ff6680 1 --2- 172.21.15.153:0/312354993 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1c9b7b0 0x5632a1c9e260 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 >> 172.21.15.153:0/312354993 conn(0x5632a1c97300 msgr2=0x5632a1cb6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 shutdown_connections 2023-10-05T21:15:12.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e42ff6680 1 -- 172.21.15.153:0/312354993 wait complete. 2023-10-05T21:15:12.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x5632a1d03e30 msgr2=0x5632a1d06210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e42ff6680 1 --2- 172.21.15.153:0/2186139267 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x5632a1d03e30 0x5632a1d06210 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5632a1d00520 msgr2=0x5632a1d029b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e42ff6680 1 --2- 172.21.15.153:0/2186139267 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5632a1d00520 0x5632a1d029b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x5632a1d0b640 msgr2=0x5632a1d0daf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e42ff6680 1 --2- 172.21.15.153:0/2186139267 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x5632a1d0b640 0x5632a1d0daf0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5632a1d076a0 msgr2=0x5632a1d09b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e42ff6680 1 --2- 172.21.15.153:0/2186139267 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5632a1d076a0 0x5632a1d09b30 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9d7c034140 msgr2=0x7f9d7c0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e42ff6680 1 --2- 172.21.15.153:0/2186139267 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9d7c034140 0x7f9d7c0365f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x5632a1ce0c50 tx=0x7f9e30037450 comp rx=0 tx=0).stop 2023-10-05T21:15:12.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1ceea50 msgr2=0x5632a1cf5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e42ff6680 1 --2- 172.21.15.153:0/2186139267 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1ceea50 0x5632a1cf5750 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x5632a1cea2c0 tx=0x7f9e2c030000 comp rx=0 tx=0).stop 2023-10-05T21:15:12.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.084+0000 7f9e360ce700 1 -- 172.21.15.153:0/2186139267 reap_dead start 2023-10-05T21:15:12.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.085+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 shutdown_connections 2023-10-05T21:15:12.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.085+0000 7f9e42ff6680 1 --2- 172.21.15.153:0/2186139267 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5632a1ceea50 0x5632a1cf5750 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.085+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 >> 172.21.15.153:0/2186139267 conn(0x5632a1cead50 msgr2=0x5632a1ce8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.085+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 shutdown_connections 2023-10-05T21:15:12.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.085+0000 7f9e42ff6680 1 -- 172.21.15.153:0/2186139267 wait complete. 2023-10-05T21:15:12.101 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-10-05T21:15:12.102 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2023-10-05T21:15:12.102 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2023-10-05T21:15:12.102 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2023-10-05T21:15:12.148 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:12.148 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:12.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.147+0000 7f693d905680 1 Processor -- start 2023-10-05T21:15:12.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.147+0000 7f693d905680 1 -- start start 2023-10-05T21:15:12.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.148+0000 7f693d905680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x559737d0c830 0x559737d0ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.148+0000 7f693d905680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559737c55930 con 0x559737c7c020 2023-10-05T21:15:12.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.148+0000 7f693d905680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x559737c15db0 con 0x559737d0c830 2023-10-05T21:15:12.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.148+0000 7f692bfff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x559737d0c830 0x559737d0ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.148+0000 7f69309dd700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x559737c7c020 0x559737d0b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56164/0 (socket says 172.21.15.153:56164) 2023-10-05T21:15:12.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.148+0000 7f69309dd700 1 -- 172.21.15.153:0/550985277 learned_addr learned my addr 172.21.15.153:0/550985277 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:12.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.148+0000 7f692b7fe700 1 -- 172.21.15.153:0/550985277 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262880927 0 0) 0x559737c55930 con 0x559737c7c020 2023-10-05T21:15:12.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.148+0000 7f692b7fe700 1 -- 172.21.15.153:0/550985277 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6920001e10 con 0x559737c7c020 2023-10-05T21:15:12.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.148+0000 7f692bfff700 1 -- 172.21.15.153:0/550985277 >> v1:172.21.15.111:6789/0 conn(0x559737c7c020 legacy=0x559737d0b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.148+0000 7f692bfff700 1 -- 172.21.15.153:0/550985277 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559737d10240 con 0x559737d0c830 2023-10-05T21:15:12.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.148+0000 7f692bfff700 1 --2- 172.21.15.153:0/550985277 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559737d0c830 0x559737d0ec10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f691c00a5d0 tx=0x7f691c005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4ab0fd2a28f070a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.148+0000 7f692b7fe700 1 -- 172.21.15.153:0/550985277 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f691c007610 con 0x559737d0c830 2023-10-05T21:15:12.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.148+0000 7f692b7fe700 1 -- 172.21.15.153:0/550985277 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691c007770 con 0x559737d0c830 2023-10-05T21:15:12.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.148+0000 7f692b7fe700 1 -- 172.21.15.153:0/550985277 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f691c007a40 con 0x559737d0c830 2023-10-05T21:15:12.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.149+0000 7f693d905680 1 -- 172.21.15.153:0/550985277 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559737d0c830 msgr2=0x559737d0ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.149+0000 7f693d905680 1 --2- 172.21.15.153:0/550985277 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559737d0c830 0x559737d0ec10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f691c00a5d0 tx=0x7f691c005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:12.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.149+0000 7f693d905680 1 -- 172.21.15.153:0/550985277 shutdown_connections 2023-10-05T21:15:12.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.149+0000 7f693d905680 1 --2- 172.21.15.153:0/550985277 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559737d0c830 0x559737d0ec10 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.149+0000 7f693d905680 1 -- 172.21.15.153:0/550985277 >> 172.21.15.153:0/550985277 conn(0x559737d02c00 msgr2=0x559737d05010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.149+0000 7f693d905680 1 -- 172.21.15.153:0/550985277 shutdown_connections 2023-10-05T21:15:12.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.149+0000 7f693d905680 1 -- 172.21.15.153:0/550985277 wait complete. 2023-10-05T21:15:12.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.150+0000 7f693d905680 1 Processor -- start 2023-10-05T21:15:12.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.150+0000 7f693d905680 1 -- start start 2023-10-05T21:15:12.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.150+0000 7f693d905680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559737c7c020 0x559737d27700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.150+0000 7f693d905680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x559737bb5ea0 con 0x559737c7c020 2023-10-05T21:15:12.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.150+0000 7f69309dd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559737c7c020 0x559737d27700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.150+0000 7f69309dd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559737c7c020 0x559737d27700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49212/0 (socket says 172.21.15.153:49212) 2023-10-05T21:15:12.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.150+0000 7f69309dd700 1 -- 172.21.15.153:0/4191580427 learned_addr learned my addr 172.21.15.153:0/4191580427 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.150+0000 7f69309dd700 1 -- 172.21.15.153:0/4191580427 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691c005cf0 con 0x559737c7c020 2023-10-05T21:15:12.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.150+0000 7f69309dd700 1 --2- 172.21.15.153:0/4191580427 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559737c7c020 0x559737d27700 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6924001c40 tx=0x7f69240017f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5e536cf7f75072 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.150+0000 7f692a7fc700 1 -- 172.21.15.153:0/4191580427 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f692400bbf0 con 0x559737c7c020 2023-10-05T21:15:12.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.150+0000 7f692a7fc700 1 -- 172.21.15.153:0/4191580427 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692400bd70 con 0x559737c7c020 2023-10-05T21:15:12.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.150+0000 7f692a7fc700 1 -- 172.21.15.153:0/4191580427 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f692400e5f0 con 0x559737c7c020 2023-10-05T21:15:12.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.151+0000 7f693d905680 1 -- 172.21.15.153:0/4191580427 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559737c7c020 msgr2=0x559737d27700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.151+0000 7f693d905680 1 --2- 172.21.15.153:0/4191580427 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559737c7c020 0x559737d27700 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6924001c40 tx=0x7f69240017f0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.151+0000 7f693d905680 1 -- 172.21.15.153:0/4191580427 shutdown_connections 2023-10-05T21:15:12.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.151+0000 7f693d905680 1 --2- 172.21.15.153:0/4191580427 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559737c7c020 0x559737d27700 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.151+0000 7f693d905680 1 -- 172.21.15.153:0/4191580427 >> 172.21.15.153:0/4191580427 conn(0x559737d02c00 msgr2=0x559737d231d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.151+0000 7f693d905680 1 -- 172.21.15.153:0/4191580427 shutdown_connections 2023-10-05T21:15:12.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.151+0000 7f693d905680 1 -- 172.21.15.153:0/4191580427 wait complete. 2023-10-05T21:15:12.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.151+0000 7f693d905680 1 Processor -- start 2023-10-05T21:15:12.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.151+0000 7f693d905680 1 -- start start 2023-10-05T21:15:12.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.151+0000 7f693d905680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559737c7c020 0x559737d2ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.151+0000 7f693d905680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x559737bacc80 con 0x559737c7c020 2023-10-05T21:15:12.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.152+0000 7f69309dd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559737c7c020 0x559737d2ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.152+0000 7f69309dd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559737c7c020 0x559737d2ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49218/0 (socket says 172.21.15.153:49218) 2023-10-05T21:15:12.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.152+0000 7f69309dd700 1 -- 172.21.15.153:0/2061680511 learned_addr learned my addr 172.21.15.153:0/2061680511 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.152+0000 7f69309dd700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6920001e10 con 0x559737c7c020 2023-10-05T21:15:12.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.152+0000 7f69309dd700 1 --2- 172.21.15.153:0/2061680511 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559737c7c020 0x559737d2ebc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x559737d284a0 tx=0x7f6924016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.152+0000 7f6928ff9700 1 -- 172.21.15.153:0/2061680511 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f692401f070 con 0x559737c7c020 2023-10-05T21:15:12.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.152+0000 7f6928ff9700 1 -- 172.21.15.153:0/2061680511 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6924018640 con 0x559737c7c020 2023-10-05T21:15:12.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.152+0000 7f693d905680 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559737d2f100 con 0x559737c7c020 2023-10-05T21:15:12.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.152+0000 7f6928ff9700 1 -- 172.21.15.153:0/2061680511 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6924018910 con 0x559737c7c020 2023-10-05T21:15:12.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.152+0000 7f693d905680 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559737d2f5d0 con 0x559737c7c020 2023-10-05T21:15:12.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.153+0000 7f6928ff9700 1 -- 172.21.15.153:0/2061680511 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f6924018a70 con 0x559737c7c020 2023-10-05T21:15:12.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.153+0000 7f693d905680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:12.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.153+0000 7f693d905680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:12.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.153+0000 7f693d905680 1 Processor -- start 2023-10-05T21:15:12.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.153+0000 7f6928ff9700 1 --2- 172.21.15.153:0/2061680511 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f6914034140 0x7f69140365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.153+0000 7f693d905680 1 -- start start 2023-10-05T21:15:12.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.153+0000 7f6928ff9700 1 -- 172.21.15.153:0/2061680511 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f6924048d00 con 0x559737c7c020 2023-10-05T21:15:12.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.153+0000 7f69311de700 1 --2- 172.21.15.153:0/2061680511 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f6914034140 0x7f69140365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.154+0000 7f693d905680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559737d08990 0x559737d07000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.154+0000 7f693d905680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x559737d08da0 con 0x559737d08990 2023-10-05T21:15:12.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.154+0000 7f69309dd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559737d08990 0x559737d07000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.154+0000 7f69309dd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559737d08990 0x559737d07000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49234/0 (socket says 172.21.15.153:49234) 2023-10-05T21:15:12.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.154+0000 7f69309dd700 1 -- 172.21.15.153:0/4175367461 learned_addr learned my addr 172.21.15.153:0/4175367461 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.154+0000 7f69311de700 1 --2- 172.21.15.153:0/2061680511 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f6914034140 0x7f69140365f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x559737d24120 tx=0x7f692c005880 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.154+0000 7f69309dd700 1 -- 172.21.15.153:0/4175367461 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559737d08ee0 con 0x559737d08990 2023-10-05T21:15:12.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.154+0000 7f69309dd700 1 --2- 172.21.15.153:0/4175367461 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559737d08990 0x559737d07000 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f69240472c0 tx=0x7f6924047220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=670372cd8ac009d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.154+0000 7f6901fe3700 1 -- 172.21.15.153:0/4175367461 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6924017df0 con 0x559737d08990 2023-10-05T21:15:12.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.154+0000 7f6901fe3700 1 -- 172.21.15.153:0/4175367461 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692402dbf0 con 0x559737d08990 2023-10-05T21:15:12.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.154+0000 7f6901fe3700 1 -- 172.21.15.153:0/4175367461 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6924024980 con 0x559737d08990 2023-10-05T21:15:12.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.155+0000 7f693d905680 1 -- 172.21.15.153:0/4175367461 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559737d08990 msgr2=0x559737d07000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.155+0000 7f693d905680 1 --2- 172.21.15.153:0/4175367461 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559737d08990 0x559737d07000 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f69240472c0 tx=0x7f6924047220 comp rx=0 tx=0).stop 2023-10-05T21:15:12.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.155+0000 7f693d905680 1 -- 172.21.15.153:0/4175367461 shutdown_connections 2023-10-05T21:15:12.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.155+0000 7f693d905680 1 --2- 172.21.15.153:0/4175367461 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559737d08990 0x559737d07000 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.155+0000 7f693d905680 1 -- 172.21.15.153:0/4175367461 >> 172.21.15.153:0/4175367461 conn(0x559737d0c830 msgr2=0x559737d3d740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.155+0000 7f693d905680 1 -- 172.21.15.153:0/4175367461 shutdown_connections 2023-10-05T21:15:12.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.155+0000 7f693d905680 1 -- 172.21.15.153:0/4175367461 wait complete. 2023-10-05T21:15:12.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.155+0000 7f693d905680 1 Processor -- start 2023-10-05T21:15:12.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.155+0000 7f693d905680 1 -- start start 2023-10-05T21:15:12.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.155+0000 7f693d905680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559737d08990 0x559737d49e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.155+0000 7f693d905680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x559737d4a3d0 con 0x559737d08990 2023-10-05T21:15:12.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.155+0000 7f69309dd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559737d08990 0x559737d49e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.155+0000 7f69309dd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559737d08990 0x559737d49e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49242/0 (socket says 172.21.15.153:49242) 2023-10-05T21:15:12.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.155+0000 7f69309dd700 1 -- 172.21.15.153:0/1254772488 learned_addr learned my addr 172.21.15.153:0/1254772488 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.156+0000 7f69309dd700 1 -- 172.21.15.153:0/1254772488 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559737d2f5d0 con 0x559737d08990 2023-10-05T21:15:12.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.156+0000 7f69309dd700 1 --2- 172.21.15.153:0/1254772488 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559737d08990 0x559737d49e90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f692400e7e0 tx=0x7f6924032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.156+0000 7f687bfff700 1 -- 172.21.15.153:0/1254772488 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6924017e70 con 0x559737d08990 2023-10-05T21:15:12.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.156+0000 7f687bfff700 1 -- 172.21.15.153:0/1254772488 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69240165c0 con 0x559737d08990 2023-10-05T21:15:12.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.156+0000 7f693d905680 1 -- 172.21.15.153:0/1254772488 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559737d4a630 con 0x559737d08990 2023-10-05T21:15:12.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.156+0000 7f687bfff700 1 -- 172.21.15.153:0/1254772488 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6924016750 con 0x559737d08990 2023-10-05T21:15:12.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.156+0000 7f693d905680 1 -- 172.21.15.153:0/1254772488 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559737d4a630 con 0x559737d08990 2023-10-05T21:15:12.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.157+0000 7f687bfff700 1 -- 172.21.15.153:0/1254772488 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f6924022560 con 0x559737d08990 2023-10-05T21:15:12.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.157+0000 7f687bfff700 1 --2- 172.21.15.153:0/1254772488 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f6880034140 0x7f68800365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.157+0000 7f687bfff700 1 -- 172.21.15.153:0/1254772488 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f6924053ac0 con 0x559737d08990 2023-10-05T21:15:12.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.157+0000 7f692bfff700 1 --2- 172.21.15.153:0/1254772488 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f6880034140 0x7f68800365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.157+0000 7f6879ffb700 20 reqs_thread_entry: start 2023-10-05T21:15:12.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.157+0000 7f693d905680 20 try_to_resolve_local_entities(): before: realm_id= realm_name= zonegroup_id= zonegroup_name= zone_id= zone_name=default 2023-10-05T21:15:12.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.157+0000 7f693d905680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.157+0000 7f693d905680 1 --2- 172.21.15.153:0/2061680511 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x559737d6a570 0x559737d79c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.157+0000 7f693d905680 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d6a9a0 con 0x559737d6a570 2023-10-05T21:15:12.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.157+0000 7f69311de700 1 --2- 172.21.15.153:0/2061680511 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x559737d6a570 0x559737d79c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.157+0000 7f692bfff700 1 --2- 172.21.15.153:0/1254772488 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f6880034140 0x7f68800365f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f691c00a5d0 tx=0x7f691c014000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.158+0000 7f69311de700 1 --2- 172.21.15.153:0/2061680511 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x559737d6a570 0x559737d79c90 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.158+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f692c012040 con 0x559737d6a570 2023-10-05T21:15:12.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.158+0000 7f693d905680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.158+0000 7f693d905680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.158+0000 7f693d905680 1 --2- 172.21.15.153:0/2061680511 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x559737d7a6e0 0x559737d7cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.158+0000 7f693d905680 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:2 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7d000 con 0x559737d7a6e0 2023-10-05T21:15:12.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.158+0000 7f69309dd700 1 --2- 172.21.15.153:0/2061680511 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x559737d7a6e0 0x559737d7cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.158+0000 7f69309dd700 1 --2- 172.21.15.153:0/2061680511 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x559737d7a6e0 0x559737d7cac0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.159+0000 7f69309dd700 1 -- 172.21.15.153:0/2061680511 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(2 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f6924014070 con 0x559737d7a6e0 2023-10-05T21:15:12.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.159+0000 7f693d905680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:12.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.159+0000 7f693d905680 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:3 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x559737d7a6e0 2023-10-05T21:15:12.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.159+0000 7f69309dd700 1 -- 172.21.15.153:0/2061680511 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(3 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6924014070 con 0x559737d7a6e0 2023-10-05T21:15:12.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.159+0000 7f69309dd700 1 --2- 172.21.15.153:0/2061680511 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f692405b040 0x7f69240561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.159+0000 7f69309dd700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:4 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x7f692405b040 2023-10-05T21:15:12.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.159+0000 7f692bfff700 1 --2- 172.21.15.153:0/2061680511 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f692405b040 0x7f69240561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.159+0000 7f692bfff700 1 --2- 172.21.15.153:0/2061680511 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f692405b040 0x7f69240561b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.159+0000 7f692bfff700 1 -- 172.21.15.153:0/2061680511 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(4 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f691c007c10 con 0x7f692405b040 2023-10-05T21:15:12.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.159+0000 7f692bfff700 1 --2- 172.21.15.153:0/2061680511 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f691c007030 0x7f691c01d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.159+0000 7f692bfff700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:5 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x7f691c007030 2023-10-05T21:15:12.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.160+0000 7f69311de700 1 --2- 172.21.15.153:0/2061680511 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f691c007030 0x7f691c01d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.160+0000 7f69311de700 1 --2- 172.21.15.153:0/2061680511 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f691c007030 0x7f691c01d430 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.160+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(5 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f692c012040 con 0x7f691c007030 2023-10-05T21:15:12.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.160+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:6 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x559737d6a570 2023-10-05T21:15:12.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.160+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f692c012040 con 0x559737d6a570 2023-10-05T21:15:12.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.161+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:7 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x559737d6a570 2023-10-05T21:15:12.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.161+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f692c012040 con 0x559737d6a570 2023-10-05T21:15:12.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.161+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x7f691c007030 2023-10-05T21:15:12.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.161+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f692c012040 con 0x7f691c007030 2023-10-05T21:15:12.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.161+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:9 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x7f691c007030 2023-10-05T21:15:12.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.161+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f692c012040 con 0x7f691c007030 2023-10-05T21:15:12.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.161+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:10 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x7f692405b040 2023-10-05T21:15:12.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.161+0000 7f692bfff700 1 -- 172.21.15.153:0/2061680511 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f691c029040 con 0x7f692405b040 2023-10-05T21:15:12.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.161+0000 7f692bfff700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:11 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x559737d7a6e0 2023-10-05T21:15:12.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.162+0000 7f69309dd700 1 -- 172.21.15.153:0/2061680511 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f6924014070 con 0x559737d7a6e0 2023-10-05T21:15:12.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.162+0000 7f69309dd700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:12 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x559737d6a570 2023-10-05T21:15:12.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.162+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f692c012040 con 0x559737d6a570 2023-10-05T21:15:12.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.162+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:13 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x7f691c007030 2023-10-05T21:15:12.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.162+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f692c012040 con 0x7f691c007030 2023-10-05T21:15:12.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.162+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:14 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x559737d6a570 2023-10-05T21:15:12.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.162+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f692c012040 con 0x559737d6a570 2023-10-05T21:15:12.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.162+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:15 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x7f692405b040 2023-10-05T21:15:12.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.162+0000 7f692bfff700 1 -- 172.21.15.153:0/2061680511 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f691c029040 con 0x7f692405b040 2023-10-05T21:15:12.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.162+0000 7f692bfff700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:16 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x559737d7a6e0 2023-10-05T21:15:12.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.163+0000 7f69309dd700 1 -- 172.21.15.153:0/2061680511 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6924014070 con 0x559737d7a6e0 2023-10-05T21:15:12.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.163+0000 7f69309dd700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:17 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x559737d7a6e0 2023-10-05T21:15:12.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.163+0000 7f69309dd700 1 -- 172.21.15.153:0/2061680511 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6924014070 con 0x559737d7a6e0 2023-10-05T21:15:12.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.163+0000 7f69309dd700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:18 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x7f691c007030 2023-10-05T21:15:12.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.163+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f692c012040 con 0x7f691c007030 2023-10-05T21:15:12.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.163+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x559737d7a6e0 2023-10-05T21:15:12.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.163+0000 7f69309dd700 1 -- 172.21.15.153:0/2061680511 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6924014070 con 0x559737d7a6e0 2023-10-05T21:15:12.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.163+0000 7f69309dd700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x559737d7a6e0 2023-10-05T21:15:12.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.164+0000 7f69309dd700 1 -- 172.21.15.153:0/2061680511 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6924014070 con 0x559737d7a6e0 2023-10-05T21:15:12.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.164+0000 7f69309dd700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:21 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x559737d6a570 2023-10-05T21:15:12.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.164+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f692c012040 con 0x559737d6a570 2023-10-05T21:15:12.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.164+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:22 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x559737d6a570 2023-10-05T21:15:12.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.164+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(22 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f692c012040 con 0x559737d6a570 2023-10-05T21:15:12.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.164+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:23 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x7f691c007030 2023-10-05T21:15:12.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.164+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f692c012040 con 0x7f691c007030 2023-10-05T21:15:12.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.164+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:24 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x559737d7a6e0 2023-10-05T21:15:12.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.164+0000 7f69309dd700 1 -- 172.21.15.153:0/2061680511 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6924014070 con 0x559737d7a6e0 2023-10-05T21:15:12.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.164+0000 7f69309dd700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:25 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x7f692405b040 2023-10-05T21:15:12.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.165+0000 7f692bfff700 1 -- 172.21.15.153:0/2061680511 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(25 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f691c029040 con 0x7f692405b040 2023-10-05T21:15:12.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.165+0000 7f692bfff700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:26 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x559737d6a570 2023-10-05T21:15:12.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.165+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f692c012040 con 0x559737d6a570 2023-10-05T21:15:12.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.165+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:27 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x7f691c007030 2023-10-05T21:15:12.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.165+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f692c012040 con 0x7f691c007030 2023-10-05T21:15:12.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.165+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:28 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x559737d7a6e0 2023-10-05T21:15:12.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.165+0000 7f69309dd700 1 -- 172.21.15.153:0/2061680511 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6924014070 con 0x559737d7a6e0 2023-10-05T21:15:12.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.165+0000 7f69309dd700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:29 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x7f691c007030 2023-10-05T21:15:12.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.165+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f692c012040 con 0x7f691c007030 2023-10-05T21:15:12.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.166+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:30 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x7f692405b040 2023-10-05T21:15:12.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.166+0000 7f692bfff700 1 -- 172.21.15.153:0/2061680511 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f691c029040 con 0x7f692405b040 2023-10-05T21:15:12.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.166+0000 7f692bfff700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x559737d7a6e0 2023-10-05T21:15:12.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.166+0000 7f69309dd700 1 -- 172.21.15.153:0/2061680511 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6924014070 con 0x559737d7a6e0 2023-10-05T21:15:12.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.166+0000 7f69309dd700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x7f691c007030 2023-10-05T21:15:12.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.166+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f692c012040 con 0x7f691c007030 2023-10-05T21:15:12.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.166+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:33 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x559737d6a570 2023-10-05T21:15:12.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.166+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(33 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f692c03b080 con 0x559737d6a570 2023-10-05T21:15:12.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.166+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:34 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7e3c0 con 0x7f692405b040 2023-10-05T21:15:12.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.167+0000 7f692bfff700 1 -- 172.21.15.153:0/2061680511 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f691c029040 con 0x7f692405b040 2023-10-05T21:15:12.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.167+0000 7f693d905680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:12.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.167+0000 7f693d905680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:12.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.167+0000 7f693d905680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:12.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.167+0000 7f693d905680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:12.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.167+0000 7f693d905680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.167+0000 7f693d905680 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:35 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7d3b0 con 0x559737d7a6e0 2023-10-05T21:15:12.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.167+0000 7f69309dd700 1 -- 172.21.15.153:0/2061680511 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(35 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f6924014070 con 0x559737d7a6e0 2023-10-05T21:15:12.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.167+0000 7f693d905680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:12.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.167+0000 7f693d905680 1 -- 172.21.15.153:0/2061680511 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:36 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [delete,create,writefull 0~874 in=874b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559737d7dca0 con 0x559737d7a6e0 2023-10-05T21:15:12.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.168+0000 7f69309dd700 1 -- 172.21.15.153:0/2061680511 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(36 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [delete,create,writefull 0~874] v29'2 uv2 ondisk = 0) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6924014070 con 0x559737d7a6e0 2023-10-05T21:15:12.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.169+0000 7f693d905680 1 -- 172.21.15.153:0/2061680511 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f691c007030 msgr2=0x7f691c01d430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.169+0000 7f693d905680 1 --2- 172.21.15.153:0/2061680511 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f691c007030 0x7f691c01d430 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.169+0000 7f693d905680 1 -- 172.21.15.153:0/2061680511 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x559737d6a570 msgr2=0x559737d79c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.169+0000 7f693d905680 1 --2- 172.21.15.153:0/2061680511 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x559737d6a570 0x559737d79c90 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.169+0000 7f693d905680 1 -- 172.21.15.153:0/2061680511 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f692405b040 msgr2=0x7f69240561b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.169+0000 7f693d905680 1 --2- 172.21.15.153:0/2061680511 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f692405b040 0x7f69240561b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.169+0000 7f693d905680 1 -- 172.21.15.153:0/2061680511 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x559737d7a6e0 msgr2=0x559737d7cac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.169+0000 7f693d905680 1 --2- 172.21.15.153:0/2061680511 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x559737d7a6e0 0x559737d7cac0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.169+0000 7f693d905680 1 -- 172.21.15.153:0/2061680511 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f6914034140 msgr2=0x7f69140365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.169+0000 7f693d905680 1 --2- 172.21.15.153:0/2061680511 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f6914034140 0x7f69140365f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x559737d24120 tx=0x7f692c005880 comp rx=0 tx=0).stop 2023-10-05T21:15:12.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.169+0000 7f693d905680 1 -- 172.21.15.153:0/2061680511 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559737c7c020 msgr2=0x559737d2ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.169+0000 7f693d905680 1 --2- 172.21.15.153:0/2061680511 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559737c7c020 0x559737d2ebc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x559737d284a0 tx=0x7f6924016000 comp rx=0 tx=0).stop 2023-10-05T21:15:12.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.169+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 reap_dead start 2023-10-05T21:15:12.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.169+0000 7f69311de700 1 -- 172.21.15.153:0/2061680511 reap_dead start 2023-10-05T21:15:12.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.169+0000 7f693d905680 1 -- 172.21.15.153:0/2061680511 shutdown_connections 2023-10-05T21:15:12.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.169+0000 7f693d905680 1 -- 172.21.15.153:0/2061680511 >> 172.21.15.153:0/2061680511 conn(0x559737d02c00 msgr2=0x559737d21ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.169+0000 7f693d905680 1 -- 172.21.15.153:0/2061680511 shutdown_connections 2023-10-05T21:15:12.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.169+0000 7f693d905680 1 -- 172.21.15.153:0/2061680511 wait complete. 2023-10-05T21:15:12.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.169+0000 7f693d905680 1 -- 172.21.15.153:0/1254772488 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f6880034140 msgr2=0x7f68800365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.169+0000 7f693d905680 1 --2- 172.21.15.153:0/1254772488 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f6880034140 0x7f68800365f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f691c00a5d0 tx=0x7f691c014000 comp rx=0 tx=0).stop 2023-10-05T21:15:12.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.169+0000 7f693d905680 1 -- 172.21.15.153:0/1254772488 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559737d08990 msgr2=0x559737d49e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.169+0000 7f693d905680 1 --2- 172.21.15.153:0/1254772488 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559737d08990 0x559737d49e90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f692400e7e0 tx=0x7f6924032000 comp rx=0 tx=0).stop 2023-10-05T21:15:12.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.169+0000 7f693d905680 1 -- 172.21.15.153:0/1254772488 shutdown_connections 2023-10-05T21:15:12.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.169+0000 7f693d905680 1 --2- 172.21.15.153:0/1254772488 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f6880034140 0x7f68800365f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.169+0000 7f693d905680 1 --2- 172.21.15.153:0/1254772488 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559737d08990 0x559737d49e90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.169+0000 7f693d905680 1 -- 172.21.15.153:0/1254772488 >> 172.21.15.153:0/1254772488 conn(0x559737d0c830 msgr2=0x559737d3d310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.169+0000 7f693d905680 1 -- 172.21.15.153:0/1254772488 shutdown_connections 2023-10-05T21:15:12.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.169+0000 7f693d905680 1 -- 172.21.15.153:0/1254772488 wait complete. 2023-10-05T21:15:12.190 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:12.190 INFO:teuthology.orchestra.run.smithi153.stdout: "id": "193cdd3f-16f8-4551-b3a7-d103e6acfa54", 2023-10-05T21:15:12.190 INFO:teuthology.orchestra.run.smithi153.stdout: "name": "default", 2023-10-05T21:15:12.190 INFO:teuthology.orchestra.run.smithi153.stdout: "domain_root": "default.rgw.meta:root", 2023-10-05T21:15:12.190 INFO:teuthology.orchestra.run.smithi153.stdout: "control_pool": "default.rgw.control", 2023-10-05T21:15:12.190 INFO:teuthology.orchestra.run.smithi153.stdout: "gc_pool": "default.rgw.log:gc", 2023-10-05T21:15:12.190 INFO:teuthology.orchestra.run.smithi153.stdout: "lc_pool": "default.rgw.log:lc", 2023-10-05T21:15:12.190 INFO:teuthology.orchestra.run.smithi153.stdout: "log_pool": "default.rgw.log", 2023-10-05T21:15:12.190 INFO:teuthology.orchestra.run.smithi153.stdout: "intent_log_pool": "default.rgw.log:intent", 2023-10-05T21:15:12.191 INFO:teuthology.orchestra.run.smithi153.stdout: "usage_log_pool": "default.rgw.log:usage", 2023-10-05T21:15:12.191 INFO:teuthology.orchestra.run.smithi153.stdout: "roles_pool": "default.rgw.meta:roles", 2023-10-05T21:15:12.191 INFO:teuthology.orchestra.run.smithi153.stdout: "reshard_pool": "default.rgw.log:reshard", 2023-10-05T21:15:12.191 INFO:teuthology.orchestra.run.smithi153.stdout: "user_keys_pool": "default.rgw.meta:users.keys", 2023-10-05T21:15:12.191 INFO:teuthology.orchestra.run.smithi153.stdout: "user_email_pool": "default.rgw.meta:users.email", 2023-10-05T21:15:12.191 INFO:teuthology.orchestra.run.smithi153.stdout: "user_swift_pool": "default.rgw.meta:users.swift", 2023-10-05T21:15:12.191 INFO:teuthology.orchestra.run.smithi153.stdout: "user_uid_pool": "default.rgw.meta:users.uid", 2023-10-05T21:15:12.191 INFO:teuthology.orchestra.run.smithi153.stdout: "otp_pool": "default.rgw.otp", 2023-10-05T21:15:12.191 INFO:teuthology.orchestra.run.smithi153.stdout: "system_key": { 2023-10-05T21:15:12.191 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "", 2023-10-05T21:15:12.191 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "" 2023-10-05T21:15:12.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:12.192 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_pools": [ 2023-10-05T21:15:12.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:12.192 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "default-placement", 2023-10-05T21:15:12.192 INFO:teuthology.orchestra.run.smithi153.stdout: "val": { 2023-10-05T21:15:12.192 INFO:teuthology.orchestra.run.smithi153.stdout: "index_pool": "default.rgw.buckets.index", 2023-10-05T21:15:12.192 INFO:teuthology.orchestra.run.smithi153.stdout: "storage_classes": { 2023-10-05T21:15:12.192 INFO:teuthology.orchestra.run.smithi153.stdout: "STANDARD": { 2023-10-05T21:15:12.192 INFO:teuthology.orchestra.run.smithi153.stdout: "data_pool": "default.rgw.buckets.data" 2023-10-05T21:15:12.192 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:12.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:12.192 INFO:teuthology.orchestra.run.smithi153.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2023-10-05T21:15:12.193 INFO:teuthology.orchestra.run.smithi153.stdout: "index_type": 0, 2023-10-05T21:15:12.193 INFO:teuthology.orchestra.run.smithi153.stdout: "inline_data": "true" 2023-10-05T21:15:12.193 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:12.193 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:12.193 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:12.193 INFO:teuthology.orchestra.run.smithi153.stdout: "realm_id": "", 2023-10-05T21:15:12.193 INFO:teuthology.orchestra.run.smithi153.stdout: "notif_pool": "default.rgw.log:notif" 2023-10-05T21:15:12.193 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:12.193 DEBUG:tasks.util.rgw: json result: {'id': '193cdd3f-16f8-4551-b3a7-d103e6acfa54', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': 'true'}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-10-05T21:15:12.195 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2023-10-05T21:15:12.195 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2023-10-05T21:15:12.195 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2023-10-05T21:15:12.237 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:12.238 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:12.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.237+0000 7f27c1468680 1 Processor -- start 2023-10-05T21:15:12.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.237+0000 7f27c1468680 1 -- start start 2023-10-05T21:15:12.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.237+0000 7f27c1468680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55d948c32290 0x55d948c326a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.237+0000 7f27c1468680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d948b80970 con 0x55d948c32be0 2023-10-05T21:15:12.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.237+0000 7f27c1468680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d948b40db0 con 0x55d948c32290 2023-10-05T21:15:12.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.237+0000 7f27b4540700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55d948c32290 0x55d948c326a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.237+0000 7f27b4540700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55d948c32290 0x55d948c326a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49244/0 (socket says 172.21.15.153:49244) 2023-10-05T21:15:12.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.237+0000 7f27b3d3f700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55d948c32be0 0x55d948c335d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56176/0 (socket says 172.21.15.153:56176) 2023-10-05T21:15:12.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.237+0000 7f27b4540700 1 -- 172.21.15.153:0/4219676311 learned_addr learned my addr 172.21.15.153:0/4219676311 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.237+0000 7f27b4540700 1 -- 172.21.15.153:0/4219676311 >> v1:172.21.15.111:6789/0 conn(0x55d948c32be0 legacy=0x55d948c335d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.237+0000 7f27b353e700 1 -- 172.21.15.153:0/4219676311 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2168817930 0 0) 0x55d948b80970 con 0x55d948c32be0 2023-10-05T21:15:12.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.237+0000 7f27b4540700 1 -- 172.21.15.153:0/4219676311 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d948c33e80 con 0x55d948c32290 2023-10-05T21:15:12.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.238+0000 7f27b4540700 1 --2- 172.21.15.153:0/4219676311 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c32290 0x55d948c326a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f27a400a650 tx=0x7f27a4005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac227bdbe75c1f5a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.238+0000 7f27b353e700 1 -- 172.21.15.153:0/4219676311 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27a4008760 con 0x55d948c32290 2023-10-05T21:15:12.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.238+0000 7f27b353e700 1 -- 172.21.15.153:0/4219676311 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a40088c0 con 0x55d948c32290 2023-10-05T21:15:12.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.238+0000 7f27b353e700 1 -- 172.21.15.153:0/4219676311 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27a4008bb0 con 0x55d948c32290 2023-10-05T21:15:12.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.238+0000 7f27c1468680 1 -- 172.21.15.153:0/4219676311 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c32290 msgr2=0x55d948c326a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.238+0000 7f27c1468680 1 --2- 172.21.15.153:0/4219676311 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c32290 0x55d948c326a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f27a400a650 tx=0x7f27a4005b10 comp rx=0 tx=0).stop 2023-10-05T21:15:12.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.238+0000 7f27c1468680 1 -- 172.21.15.153:0/4219676311 shutdown_connections 2023-10-05T21:15:12.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.238+0000 7f27c1468680 1 --2- 172.21.15.153:0/4219676311 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c32290 0x55d948c326a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.238+0000 7f27c1468680 1 -- 172.21.15.153:0/4219676311 >> 172.21.15.153:0/4219676311 conn(0x55d948c2db60 msgr2=0x55d948c2ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.238+0000 7f27c1468680 1 -- 172.21.15.153:0/4219676311 shutdown_connections 2023-10-05T21:15:12.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.238+0000 7f27c1468680 1 -- 172.21.15.153:0/4219676311 wait complete. 2023-10-05T21:15:12.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.239+0000 7f27c1468680 1 Processor -- start 2023-10-05T21:15:12.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.239+0000 7f27c1468680 1 -- start start 2023-10-05T21:15:12.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.239+0000 7f27c1468680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c32290 0x55d948ba6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.239+0000 7f27c1468680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d948ae0ea0 con 0x55d948c32290 2023-10-05T21:15:12.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.239+0000 7f27b4540700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c32290 0x55d948ba6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.239+0000 7f27b4540700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c32290 0x55d948ba6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49248/0 (socket says 172.21.15.153:49248) 2023-10-05T21:15:12.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.239+0000 7f27b4540700 1 -- 172.21.15.153:0/3241589936 learned_addr learned my addr 172.21.15.153:0/3241589936 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.240+0000 7f27b4540700 1 -- 172.21.15.153:0/3241589936 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a4005db0 con 0x55d948c32290 2023-10-05T21:15:12.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.240+0000 7f27b4540700 1 --2- 172.21.15.153:0/3241589936 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c32290 0x55d948ba6fc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f27a400a5a0 tx=0x7f27a4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a55e49e98d1690d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.240+0000 7f27b253c700 1 -- 172.21.15.153:0/3241589936 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27a40055f0 con 0x55d948c32290 2023-10-05T21:15:12.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.240+0000 7f27b253c700 1 -- 172.21.15.153:0/3241589936 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a4008a30 con 0x55d948c32290 2023-10-05T21:15:12.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.240+0000 7f27b253c700 1 -- 172.21.15.153:0/3241589936 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27a4008d00 con 0x55d948c32290 2023-10-05T21:15:12.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.240+0000 7f27c1468680 1 -- 172.21.15.153:0/3241589936 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c32290 msgr2=0x55d948ba6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.240+0000 7f27c1468680 1 --2- 172.21.15.153:0/3241589936 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c32290 0x55d948ba6fc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f27a400a5a0 tx=0x7f27a4015000 comp rx=0 tx=0).stop 2023-10-05T21:15:12.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.240+0000 7f27c1468680 1 -- 172.21.15.153:0/3241589936 shutdown_connections 2023-10-05T21:15:12.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.240+0000 7f27c1468680 1 --2- 172.21.15.153:0/3241589936 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c32290 0x55d948ba6fc0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.240+0000 7f27c1468680 1 -- 172.21.15.153:0/3241589936 >> 172.21.15.153:0/3241589936 conn(0x55d948c2db60 msgr2=0x55d948c4d090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.240+0000 7f27c1468680 1 -- 172.21.15.153:0/3241589936 shutdown_connections 2023-10-05T21:15:12.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.240+0000 7f27c1468680 1 -- 172.21.15.153:0/3241589936 wait complete. 2023-10-05T21:15:12.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.241+0000 7f27c1468680 1 Processor -- start 2023-10-05T21:15:12.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.241+0000 7f27c1468680 1 -- start start 2023-10-05T21:15:12.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.241+0000 7f27c1468680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c32290 0x55d948c59a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.241+0000 7f27c1468680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d948ad7c80 con 0x55d948c32290 2023-10-05T21:15:12.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.241+0000 7f27b4540700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c32290 0x55d948c59a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.241+0000 7f27b4540700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c32290 0x55d948c59a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49252/0 (socket says 172.21.15.153:49252) 2023-10-05T21:15:12.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.241+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 learned_addr learned my addr 172.21.15.153:0/3755178324 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.241+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d948c33e80 con 0x55d948c32290 2023-10-05T21:15:12.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.242+0000 7f27b4540700 1 --2- 172.21.15.153:0/3755178324 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c32290 0x55d948c59a80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f27a400a650 tx=0x7f27a401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.242+0000 7f27b0d39700 1 -- 172.21.15.153:0/3755178324 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27a4026a90 con 0x55d948c32290 2023-10-05T21:15:12.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.242+0000 7f27b0d39700 1 -- 172.21.15.153:0/3755178324 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a4026bf0 con 0x55d948c32290 2023-10-05T21:15:12.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.242+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d948c59fc0 con 0x55d948c32290 2023-10-05T21:15:12.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.242+0000 7f27b0d39700 1 -- 172.21.15.153:0/3755178324 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27a4012450 con 0x55d948c32290 2023-10-05T21:15:12.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.242+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d948c5a470 con 0x55d948c32290 2023-10-05T21:15:12.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.242+0000 7f27b0d39700 1 -- 172.21.15.153:0/3755178324 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f27a40125b0 con 0x55d948c32290 2023-10-05T21:15:12.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.243+0000 7f27c1468680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.243+0000 7f27b0d39700 1 --2- 172.21.15.153:0/3755178324 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f27a0034140 0x7f27a00365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.243+0000 7f27b0d39700 1 -- 172.21.15.153:0/3755178324 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f27a404a320 con 0x55d948c32290 2023-10-05T21:15:12.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.243+0000 7f27b3d3f700 1 --2- 172.21.15.153:0/3755178324 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f27a0034140 0x7f27a00365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.243+0000 7f27c1468680 1 --2- 172.21.15.153:0/3755178324 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d948c637b0 0x55d948c65bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.243+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c66340 con 0x55d948c637b0 2023-10-05T21:15:12.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.243+0000 7f27b4d41700 1 --2- 172.21.15.153:0/3755178324 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d948c637b0 0x55d948c65bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.243+0000 7f27b3d3f700 1 --2- 172.21.15.153:0/3755178324 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f27a0034140 0x7f27a00365f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f27a80011e0 tx=0x7f27a80013c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.243+0000 7f27b4d41700 1 --2- 172.21.15.153:0/3755178324 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d948c637b0 0x55d948c65bb0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.244+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.244+0000 7f27c1468680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.244+0000 7f27c1468680 20 realm 2023-10-05T21:15:12.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.244+0000 7f27c1468680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.244+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c62e20 con 0x55d948c637b0 2023-10-05T21:15:12.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.244+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.244+0000 7f27c1468680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.244+0000 7f27c1468680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:12.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.244+0000 7f27c1468680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.244+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c66df0 con 0x55d948c637b0 2023-10-05T21:15:12.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.244+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.244+0000 7f27c1468680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.244+0000 7f27c1468680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.244+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c66a10 con 0x55d948c637b0 2023-10-05T21:15:12.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.244+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.244+0000 7f27c1468680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.244+0000 7f27c1468680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.244+0000 7f27c1468680 1 --2- 172.21.15.153:0/3755178324 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d948c68190 0x55d948c6a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.244+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6aab0 con 0x55d948c68190 2023-10-05T21:15:12.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.245+0000 7f27b4540700 1 --2- 172.21.15.153:0/3755178324 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d948c68190 0x55d948c6a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.245+0000 7f27b4540700 1 --2- 172.21.15.153:0/3755178324 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d948c68190 0x55d948c6a570 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.245+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.245+0000 7f27c1468680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:12.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.245+0000 7f27c1468680 20 searching for the correct realm 2023-10-05T21:15:12.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.245+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6c360 con 0x55d948c68190 2023-10-05T21:15:12.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.245+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.245+0000 7f27b4540700 1 --2- 172.21.15.153:0/3755178324 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f27a4007030 0x7f27a402d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.245+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6c360 con 0x7f27a4007030 2023-10-05T21:15:12.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.245+0000 7f27b3d3f700 1 --2- 172.21.15.153:0/3755178324 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f27a4007030 0x7f27a402d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.246+0000 7f27b3d3f700 1 --2- 172.21.15.153:0/3755178324 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f27a4007030 0x7f27a402d9f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.246+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3755178324 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27a800f620 con 0x7f27a4007030 2023-10-05T21:15:12.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.246+0000 7f27b3d3f700 1 --2- 172.21.15.153:0/3755178324 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f27a800e8c0 0x7f27a800d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.246+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6c360 con 0x7f27a800e8c0 2023-10-05T21:15:12.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.246+0000 7f27b4d41700 1 --2- 172.21.15.153:0/3755178324 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f27a800e8c0 0x7f27a800d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.246+0000 7f27b4d41700 1 --2- 172.21.15.153:0/3755178324 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f27a800e8c0 0x7f27a800d310 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.247+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.247+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6c360 con 0x55d948c637b0 2023-10-05T21:15:12.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.247+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.247+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6c360 con 0x55d948c637b0 2023-10-05T21:15:12.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.247+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.247+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6c360 con 0x7f27a800e8c0 2023-10-05T21:15:12.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.247+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.247+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6c360 con 0x7f27a800e8c0 2023-10-05T21:15:12.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.247+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.247+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6c360 con 0x7f27a4007030 2023-10-05T21:15:12.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.248+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3755178324 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27a800f620 con 0x7f27a4007030 2023-10-05T21:15:12.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.248+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6c360 con 0x55d948c68190 2023-10-05T21:15:12.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.248+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.248+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6c360 con 0x55d948c637b0 2023-10-05T21:15:12.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.248+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.248+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6c360 con 0x7f27a800e8c0 2023-10-05T21:15:12.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.248+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.248+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6c360 con 0x55d948c637b0 2023-10-05T21:15:12.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.248+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.248+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6c360 con 0x7f27a4007030 2023-10-05T21:15:12.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.249+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3755178324 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27a800f620 con 0x7f27a4007030 2023-10-05T21:15:12.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.249+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f27a801f040 con 0x55d948c68190 2023-10-05T21:15:12.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.249+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.249+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f27a801f040 con 0x55d948c68190 2023-10-05T21:15:12.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.249+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.249+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f27a801f040 con 0x7f27a800e8c0 2023-10-05T21:15:12.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.250+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.250+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f27a801f040 con 0x55d948c68190 2023-10-05T21:15:12.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.250+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.250+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f27a801f040 con 0x55d948c68190 2023-10-05T21:15:12.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.250+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.250+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f27a801f040 con 0x55d948c637b0 2023-10-05T21:15:12.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.250+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.250+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f27a801f040 con 0x55d948c637b0 2023-10-05T21:15:12.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.250+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.250+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f27a801f040 con 0x7f27a800e8c0 2023-10-05T21:15:12.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.251+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.251+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f27a801f040 con 0x55d948c68190 2023-10-05T21:15:12.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.251+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.251+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f27a801f040 con 0x7f27a4007030 2023-10-05T21:15:12.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.251+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3755178324 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27a800f620 con 0x7f27a4007030 2023-10-05T21:15:12.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.251+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f27a801f040 con 0x55d948c637b0 2023-10-05T21:15:12.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.251+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.251+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f27a801f040 con 0x7f27a800e8c0 2023-10-05T21:15:12.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.252+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.252+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f27a801f040 con 0x55d948c68190 2023-10-05T21:15:12.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.252+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.252+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f27a801f040 con 0x7f27a800e8c0 2023-10-05T21:15:12.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.252+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.252+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f27a801f040 con 0x7f27a4007030 2023-10-05T21:15:12.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.253+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3755178324 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27a800f620 con 0x7f27a4007030 2023-10-05T21:15:12.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.253+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f27a801f040 con 0x55d948c68190 2023-10-05T21:15:12.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.253+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.253+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f27a801f040 con 0x7f27a800e8c0 2023-10-05T21:15:12.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.253+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.253+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f27a801f040 con 0x55d948c637b0 2023-10-05T21:15:12.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.253+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.253+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f27a801f040 con 0x7f27a4007030 2023-10-05T21:15:12.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.254+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3755178324 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27a800f620 con 0x7f27a4007030 2023-10-05T21:15:12.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.254+0000 7f27c1468680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:12.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.254+0000 7f27c1468680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:12.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.254+0000 7f27c1468680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:12.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.254+0000 7f27c1468680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:12.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.254+0000 7f27c1468680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.254+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6b350 con 0x55d948c637b0 2023-10-05T21:15:12.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.254+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.254+0000 7f27c1468680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.254+0000 7f27c1468680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.254+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6af80 con 0x55d948c637b0 2023-10-05T21:15:12.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.254+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.254+0000 7f27c1468680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.254+0000 7f27c1468680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.254+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6bcc0 con 0x55d948c637b0 2023-10-05T21:15:12.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.254+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.254+0000 7f27c1468680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:12.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.254+0000 7f27c1468680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.254+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6c710 con 0x55d948c68190 2023-10-05T21:15:12.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.255+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.255+0000 7f27c1468680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.255+0000 7f27c1468680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.255+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6cac0 con 0x55d948c637b0 2023-10-05T21:15:12.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.255+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.255+0000 7f27c1468680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.255+0000 7f27c1468680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.255+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6b840 con 0x55d948c637b0 2023-10-05T21:15:12.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.255+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.255+0000 7f27c1468680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.255+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6b810 con 0x55d948c68190 2023-10-05T21:15:12.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.255+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.255+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6b810 con 0x7f27a4007030 2023-10-05T21:15:12.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.256+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3755178324 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27a800f620 con 0x7f27a4007030 2023-10-05T21:15:12.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.256+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6b810 con 0x7f27a800e8c0 2023-10-05T21:15:12.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.256+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.256+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6bcc0 con 0x55d948c637b0 2023-10-05T21:15:12.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.256+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.256+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6bcc0 con 0x55d948c637b0 2023-10-05T21:15:12.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.256+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.256+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6bcc0 con 0x7f27a800e8c0 2023-10-05T21:15:12.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.257+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.257+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6bcc0 con 0x7f27a800e8c0 2023-10-05T21:15:12.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.257+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.257+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6bcc0 con 0x7f27a4007030 2023-10-05T21:15:12.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.257+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3755178324 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27a800f620 con 0x7f27a4007030 2023-10-05T21:15:12.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.257+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6bcc0 con 0x55d948c68190 2023-10-05T21:15:12.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.257+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.257+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6bcc0 con 0x55d948c637b0 2023-10-05T21:15:12.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.257+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.257+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6bcc0 con 0x7f27a800e8c0 2023-10-05T21:15:12.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.258+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.258+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6bcc0 con 0x55d948c637b0 2023-10-05T21:15:12.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.258+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.258+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6bcc0 con 0x7f27a4007030 2023-10-05T21:15:12.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.258+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3755178324 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27a800f620 con 0x7f27a4007030 2023-10-05T21:15:12.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.258+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6bcc0 con 0x55d948c68190 2023-10-05T21:15:12.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.258+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.258+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6bcc0 con 0x55d948c68190 2023-10-05T21:15:12.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.258+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.258+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6bcc0 con 0x7f27a800e8c0 2023-10-05T21:15:12.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.259+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.259+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6bcc0 con 0x55d948c68190 2023-10-05T21:15:12.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.259+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.259+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6bcc0 con 0x55d948c68190 2023-10-05T21:15:12.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.259+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.259+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6bcc0 con 0x55d948c637b0 2023-10-05T21:15:12.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.259+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.259+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6bcc0 con 0x55d948c637b0 2023-10-05T21:15:12.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.260+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.260+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6bcc0 con 0x7f27a800e8c0 2023-10-05T21:15:12.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.260+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.260+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6bcc0 con 0x55d948c68190 2023-10-05T21:15:12.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.260+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.260+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6bcc0 con 0x7f27a4007030 2023-10-05T21:15:12.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.260+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3755178324 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27a800f620 con 0x7f27a4007030 2023-10-05T21:15:12.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.260+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6bcc0 con 0x55d948c637b0 2023-10-05T21:15:12.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.260+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.261+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6bcc0 con 0x7f27a800e8c0 2023-10-05T21:15:12.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.261+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.261+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6bcc0 con 0x55d948c68190 2023-10-05T21:15:12.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.261+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.261+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6bcc0 con 0x7f27a800e8c0 2023-10-05T21:15:12.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.261+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.261+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6bcc0 con 0x7f27a4007030 2023-10-05T21:15:12.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.261+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3755178324 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27a800f620 con 0x7f27a4007030 2023-10-05T21:15:12.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.261+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6bcc0 con 0x55d948c68190 2023-10-05T21:15:12.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.262+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.262+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6bcc0 con 0x7f27a800e8c0 2023-10-05T21:15:12.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.262+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.262+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6bcc0 con 0x55d948c637b0 2023-10-05T21:15:12.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.262+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.262+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6bcc0 con 0x7f27a4007030 2023-10-05T21:15:12.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.262+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3755178324 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f27a800f620 con 0x7f27a4007030 2023-10-05T21:15:12.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.262+0000 7f27c1468680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:12.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.262+0000 7f27c1468680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:12.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.262+0000 7f27c1468680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:12.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.262+0000 7f27c1468680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:12.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.262+0000 7f27c1468680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.262+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6b810 con 0x55d948c637b0 2023-10-05T21:15:12.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.263+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.263+0000 7f27c1468680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.263+0000 7f27c1468680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.263+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6d000 con 0x55d948c68190 2023-10-05T21:15:12.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.263+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.263+0000 7f27c1468680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:12.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.263+0000 7f27c1468680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.263+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6d8a0 con 0x55d948c637b0 2023-10-05T21:15:12.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.263+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.263+0000 7f27c1468680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.263+0000 7f27c1468680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.263+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6d8a0 con 0x55d948c637b0 2023-10-05T21:15:12.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.263+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.263+0000 7f27c1468680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:12.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.264+0000 7f27c1468680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.264+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6d9d0 con 0x7f27a800e8c0 2023-10-05T21:15:12.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.264+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.264+0000 7f27c1468680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.264+0000 7f27c1468680 20 zone default found 2023-10-05T21:15:12.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.264+0000 7f27c1468680 4 Realm: () 2023-10-05T21:15:12.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.264+0000 7f27c1468680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:12.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.264+0000 7f27c1468680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:12.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.264+0000 7f27c1468680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:12.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.264+0000 7f27c1468680 20 zonegroup default 2023-10-05T21:15:12.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.264+0000 7f27c1468680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.264+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6d9d0 con 0x7f27a800e8c0 2023-10-05T21:15:12.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.264+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.264+0000 7f27c1468680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.264+0000 7f27c1468680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.264+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6f350 con 0x55d948c68190 2023-10-05T21:15:12.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.264+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.265+0000 7f27c1468680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.265+0000 7f27c1468680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.265+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6f700 con 0x55d948c68190 2023-10-05T21:15:12.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.265+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.265+0000 7f27c1468680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.265+0000 7f27c1468680 20 started sync module instance, tier type = 2023-10-05T21:15:12.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.265+0000 7f27c1468680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:12.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.265+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6ea10 con 0x7f27a4007030 2023-10-05T21:15:12.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.266+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3755178324 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27a800f620 con 0x7f27a4007030 2023-10-05T21:15:12.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.266+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94391717260816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6ffa0 con 0x7f27a4007030 2023-10-05T21:15:12.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.266+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c70840 con 0x55d948c637b0 2023-10-05T21:15:12.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.266+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3755178324 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94391717260816] v29'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27a800f620 con 0x7f27a4007030 2023-10-05T21:15:12.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.266+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.266+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94391717266256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6fbf0 con 0x55d948c637b0 2023-10-05T21:15:12.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.266+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c71490 con 0x55d948c68190 2023-10-05T21:15:12.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.267+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94391717266256] v29'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.267+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.267+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94391717269312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c71890 con 0x55d948c68190 2023-10-05T21:15:12.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.267+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c722a0 con 0x7f27a4007030 2023-10-05T21:15:12.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.268+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3755178324 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27a800f620 con 0x7f27a4007030 2023-10-05T21:15:12.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.268+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94391717273008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c72b40 con 0x7f27a4007030 2023-10-05T21:15:12.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.268+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94391717269312] v29'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.268+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c733e0 con 0x55d948c637b0 2023-10-05T21:15:12.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.269+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3755178324 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94391717273008] v29'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27a800f620 con 0x7f27a4007030 2023-10-05T21:15:12.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.269+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.269+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94391717275216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c733e0 con 0x55d948c637b0 2023-10-05T21:15:12.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.269+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c73df0 con 0x7f27a800e8c0 2023-10-05T21:15:12.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.269+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94391717275216] v29'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.269+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.269+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94391717278048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c73df0 con 0x7f27a800e8c0 2023-10-05T21:15:12.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.269+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c74840 con 0x7f27a800e8c0 2023-10-05T21:15:12.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.270+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94391717278048] v29'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.270+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.270+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94391717282576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c73df0 con 0x7f27a800e8c0 2023-10-05T21:15:12.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.270+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c752a0 con 0x7f27a800e8c0 2023-10-05T21:15:12.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.271+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(98 notify.7 [create] v29'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.271+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94391717285296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c75790 con 0x7f27a800e8c0 2023-10-05T21:15:12.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.271+0000 7f27c1468680 20 add_watcher() i=0 2023-10-05T21:15:12.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.271+0000 7f27c1468680 20 add_watcher() i=1 2023-10-05T21:15:12.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.271+0000 7f27c1468680 20 add_watcher() i=2 2023-10-05T21:15:12.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.271+0000 7f27c1468680 20 add_watcher() i=3 2023-10-05T21:15:12.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.271+0000 7f27c1468680 20 add_watcher() i=4 2023-10-05T21:15:12.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.271+0000 7f27c1468680 20 add_watcher() i=5 2023-10-05T21:15:12.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.271+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(97 notify.6 [watch watch cookie 94391717282576] v29'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.271+0000 7f27c1468680 20 add_watcher() i=6 2023-10-05T21:15:12.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.272+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94391717285296] v29'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.272+0000 7f27c1468680 20 add_watcher() i=7 2023-10-05T21:15:12.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.272+0000 7f27c1468680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:12.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.272+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c73900 con 0x55d948c637b0 2023-10-05T21:15:12.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.272+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.272+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94391717286400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c73900 con 0x55d948c637b0 2023-10-05T21:15:12.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.273+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94391717286400] v29'46 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.273+0000 7f2785fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:12.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.273+0000 7f27c1468680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:12.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.273+0000 7f27c1468680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:12.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.273+0000 7f27c1468680 1 Processor -- start 2023-10-05T21:15:12.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.273+0000 7f27c1468680 1 -- start start 2023-10-05T21:15:12.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.273+0000 7f27c1468680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c830b0 0x55d948c834c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.273+0000 7f27c1468680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d948c83a90 con 0x55d948c830b0 2023-10-05T21:15:12.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.274+0000 7f27b3d3f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c830b0 0x55d948c834c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.274+0000 7f27b3d3f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c830b0 0x55d948c834c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49266/0 (socket says 172.21.15.153:49266) 2023-10-05T21:15:12.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.274+0000 7f27b3d3f700 1 -- 172.21.15.153:0/298519372 learned_addr learned my addr 172.21.15.153:0/298519372 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.274+0000 7f27b3d3f700 1 -- 172.21.15.153:0/298519372 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d948c83bd0 con 0x55d948c830b0 2023-10-05T21:15:12.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.274+0000 7f27b3d3f700 1 --2- 172.21.15.153:0/298519372 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c830b0 0x55d948c834c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55d948c671a0 tx=0x7f27a8006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9221adb479a1f51d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.275+0000 7f27857e2700 1 -- 172.21.15.153:0/298519372 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27a800db60 con 0x55d948c830b0 2023-10-05T21:15:12.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.275+0000 7f27857e2700 1 -- 172.21.15.153:0/298519372 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a800dce0 con 0x55d948c830b0 2023-10-05T21:15:12.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.275+0000 7f27857e2700 1 -- 172.21.15.153:0/298519372 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27a800de90 con 0x55d948c830b0 2023-10-05T21:15:12.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.275+0000 7f27c1468680 1 -- 172.21.15.153:0/298519372 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c830b0 msgr2=0x55d948c834c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.275+0000 7f27c1468680 1 --2- 172.21.15.153:0/298519372 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c830b0 0x55d948c834c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55d948c671a0 tx=0x7f27a8006000 comp rx=0 tx=0).stop 2023-10-05T21:15:12.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.275+0000 7f27c1468680 1 -- 172.21.15.153:0/298519372 shutdown_connections 2023-10-05T21:15:12.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.275+0000 7f27c1468680 1 --2- 172.21.15.153:0/298519372 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c830b0 0x55d948c834c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.275+0000 7f27c1468680 1 -- 172.21.15.153:0/298519372 >> 172.21.15.153:0/298519372 conn(0x55d948c7e2b0 msgr2=0x55d948c7c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.275+0000 7f27c1468680 1 -- 172.21.15.153:0/298519372 shutdown_connections 2023-10-05T21:15:12.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.275+0000 7f27c1468680 1 -- 172.21.15.153:0/298519372 wait complete. 2023-10-05T21:15:12.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.276+0000 7f27c1468680 1 Processor -- start 2023-10-05T21:15:12.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.276+0000 7f27c1468680 1 -- start start 2023-10-05T21:15:12.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.276+0000 7f27c1468680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c830b0 0x55d948c52d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.276+0000 7f27c1468680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d948c532a0 con 0x55d948c830b0 2023-10-05T21:15:12.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.276+0000 7f27b3d3f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c830b0 0x55d948c52d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.276+0000 7f27b3d3f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c830b0 0x55d948c52d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49282/0 (socket says 172.21.15.153:49282) 2023-10-05T21:15:12.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.276+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3614310491 learned_addr learned my addr 172.21.15.153:0/3614310491 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.276+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3614310491 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a8006070 con 0x55d948c830b0 2023-10-05T21:15:12.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.277+0000 7f27b3d3f700 1 --2- 172.21.15.153:0/3614310491 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c830b0 0x55d948c52d60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f27a8000c00 tx=0x7f27a8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.277+0000 7f26ff7fe700 1 -- 172.21.15.153:0/3614310491 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27a800ee30 con 0x55d948c830b0 2023-10-05T21:15:12.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.277+0000 7f26ff7fe700 1 -- 172.21.15.153:0/3614310491 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a803dcc0 con 0x55d948c830b0 2023-10-05T21:15:12.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.277+0000 7f27c1468680 1 -- 172.21.15.153:0/3614310491 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d948c51380 con 0x55d948c830b0 2023-10-05T21:15:12.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.277+0000 7f26ff7fe700 1 -- 172.21.15.153:0/3614310491 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27a8047470 con 0x55d948c830b0 2023-10-05T21:15:12.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.277+0000 7f27c1468680 1 -- 172.21.15.153:0/3614310491 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d948c517d0 con 0x55d948c830b0 2023-10-05T21:15:12.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.277+0000 7f26ff7fe700 1 -- 172.21.15.153:0/3614310491 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f27a801a040 con 0x55d948c830b0 2023-10-05T21:15:12.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.278+0000 7f26ff7fe700 1 --2- 172.21.15.153:0/3614310491 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f26f4034140 0x7f26f40365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.278+0000 7f26ff7fe700 1 -- 172.21.15.153:0/3614310491 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f27a8052b00 con 0x55d948c830b0 2023-10-05T21:15:12.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.278+0000 7f27b4d41700 1 --2- 172.21.15.153:0/3614310491 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f26f4034140 0x7f26f40365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.278+0000 7f27c1468680 5 note: GC not initialized 2023-10-05T21:15:12.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.278+0000 7f27b4d41700 1 --2- 172.21.15.153:0/3614310491 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f26f4034140 0x7f26f40365f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x55d948c75650 tx=0x7f27ac037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.279+0000 7f26fcff9700 20 reqs_thread_entry: start 2023-10-05T21:15:12.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.279+0000 7f26f27fc700 20 reqs_thread_entry: start 2023-10-05T21:15:12.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.279+0000 7f27c1468680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:12.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.279+0000 7f27c1468680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:12.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.279+0000 7f26f0ff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:42 2023 2023-10-05T21:15:12.318 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:12.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.279+0000 7f26d7fff700 20 reqs_thread_entry: start 2023-10-05T21:15:12.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.279+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x55d948c637b0 2023-10-05T21:15:12.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.279+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.279+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:103 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x7f27a4007030 2023-10-05T21:15:12.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.280+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3755178324 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(103 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f27a800f620 con 0x7f27a4007030 2023-10-05T21:15:12.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.280+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:104 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x55d948c637b0 2023-10-05T21:15:12.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.280+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(104 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.280+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:105 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x55d948c68190 2023-10-05T21:15:12.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.280+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(105 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.280+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:106 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x55d948c68190 2023-10-05T21:15:12.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.280+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(106 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.281+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x55d948c68190 2023-10-05T21:15:12.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.281+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(107 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.281+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:108 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x55d948c637b0 2023-10-05T21:15:12.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.281+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(108 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.281+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:109 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x55d948c637b0 2023-10-05T21:15:12.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.281+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(109 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.281+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:110 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x55d948c68190 2023-10-05T21:15:12.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.281+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== osd_op_reply(110 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.281+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:111 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x55d948c68190 2023-10-05T21:15:12.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.282+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(111 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.282+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x7f27a800e8c0 2023-10-05T21:15:12.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.282+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(112 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.282+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:113 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x55d948c637b0 2023-10-05T21:15:12.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.282+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(113 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.282+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:114 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x7f27a4007030 2023-10-05T21:15:12.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.282+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3755178324 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(114 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27a800f620 con 0x7f27a4007030 2023-10-05T21:15:12.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.282+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:115 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x55d948c68190 2023-10-05T21:15:12.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.283+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 31 ==== osd_op_reply(115 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.283+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:116 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x7f27a800e8c0 2023-10-05T21:15:12.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.283+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(116 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.283+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:117 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x7f27a800e8c0 2023-10-05T21:15:12.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.283+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(117 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.283+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:118 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x55d948c68190 2023-10-05T21:15:12.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.283+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 32 ==== osd_op_reply(118 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.283+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:119 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x7f27a800e8c0 2023-10-05T21:15:12.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.284+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(119 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.284+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:120 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x55d948c637b0 2023-10-05T21:15:12.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.284+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(120 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.284+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:121 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x55d948c68190 2023-10-05T21:15:12.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.284+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 33 ==== osd_op_reply(121 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.284+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:122 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x7f27a800e8c0 2023-10-05T21:15:12.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.284+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 31 ==== osd_op_reply(122 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.284+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:123 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x7f27a4007030 2023-10-05T21:15:12.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.285+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3755178324 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(123 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27a800f620 con 0x7f27a4007030 2023-10-05T21:15:12.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.285+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:124 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x7f27a800e8c0 2023-10-05T21:15:12.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.285+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 32 ==== osd_op_reply(124 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.285+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:125 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x55d948c637b0 2023-10-05T21:15:12.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.285+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== osd_op_reply(125 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.285+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:126 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x55d948c637b0 2023-10-05T21:15:12.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.285+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 42 ==== osd_op_reply(126 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.285+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:127 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x55d948c68190 2023-10-05T21:15:12.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.286+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 34 ==== osd_op_reply(127 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.286+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:128 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x55d948c637b0 2023-10-05T21:15:12.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.286+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 43 ==== osd_op_reply(128 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.286+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:129 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x55d948c637b0 2023-10-05T21:15:12.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.286+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 44 ==== osd_op_reply(129 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.286+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:130 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x55d948c68190 2023-10-05T21:15:12.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.286+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 35 ==== osd_op_reply(130 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.286+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:131 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x55d948c68190 2023-10-05T21:15:12.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.287+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 36 ==== osd_op_reply(131 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.287+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:132 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x55d948c68190 2023-10-05T21:15:12.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.287+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 37 ==== osd_op_reply(132 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.287+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:133 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948cf1100 con 0x7f27a800e8c0 2023-10-05T21:15:12.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.287+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 33 ==== osd_op_reply(133 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.287+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:134 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94391717260816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948caf340 con 0x7f27a4007030 2023-10-05T21:15:12.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.288+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3755178324 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(134 notify.0 [watch unwatch cookie 94391717260816] v29'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27a800f620 con 0x7f27a4007030 2023-10-05T21:15:12.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.288+0000 7f27c1468680 20 remove_watcher() i=0 2023-10-05T21:15:12.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.288+0000 7f27c1468680 2 removed watcher, disabling cache 2023-10-05T21:15:12.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.288+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:135 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94391717266256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6ee10 con 0x55d948c637b0 2023-10-05T21:15:12.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.289+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 45 ==== osd_op_reply(135 notify.1 [watch unwatch cookie 94391717266256] v29'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.289+0000 7f27c1468680 20 remove_watcher() i=1 2023-10-05T21:15:12.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.289+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:136 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94391717269312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6ee10 con 0x55d948c68190 2023-10-05T21:15:12.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.290+0000 7f27b4540700 1 -- 172.21.15.153:0/3755178324 <== osd.3 v2:172.21.15.153:6800/140455 38 ==== osd_op_reply(136 notify.2 [watch unwatch cookie 94391717269312] v29'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27a4019040 con 0x55d948c68190 2023-10-05T21:15:12.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.290+0000 7f27c1468680 20 remove_watcher() i=2 2023-10-05T21:15:12.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.290+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94391717273008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c70f40 con 0x7f27a4007030 2023-10-05T21:15:12.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.290+0000 7f27b3d3f700 1 -- 172.21.15.153:0/3755178324 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== osd_op_reply(137 notify.3 [watch unwatch cookie 94391717273008] v29'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27a800f620 con 0x7f27a4007030 2023-10-05T21:15:12.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.290+0000 7f27c1468680 20 remove_watcher() i=3 2023-10-05T21:15:12.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.290+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:138 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94391717275216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6ee10 con 0x55d948c637b0 2023-10-05T21:15:12.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.291+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 46 ==== osd_op_reply(138 notify.4 [watch unwatch cookie 94391717275216] v29'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.291+0000 7f27c1468680 20 remove_watcher() i=4 2023-10-05T21:15:12.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.291+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:139 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94391717278048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c72650 con 0x7f27a800e8c0 2023-10-05T21:15:12.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.292+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 34 ==== osd_op_reply(139 notify.5 [watch unwatch cookie 94391717278048] v29'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.292+0000 7f27c1468680 20 remove_watcher() i=5 2023-10-05T21:15:12.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.292+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:140 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94391717282576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c6ee10 con 0x7f27a800e8c0 2023-10-05T21:15:12.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.293+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 35 ==== osd_op_reply(140 notify.6 [watch unwatch cookie 94391717282576] v29'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.293+0000 7f27c1468680 20 remove_watcher() i=6 2023-10-05T21:15:12.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.293+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:141 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94391717285296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c73160 con 0x7f27a800e8c0 2023-10-05T21:15:12.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.293+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.0 v2:172.21.15.111:6800/111394 36 ==== osd_op_reply(141 notify.7 [watch unwatch cookie 94391717285296] v29'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x7f27a800e8c0 2023-10-05T21:15:12.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.293+0000 7f27c1468680 20 remove_watcher() i=7 2023-10-05T21:15:12.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.294+0000 7f2785fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:12.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.294+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:142 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94391717286400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d948c72650 con 0x55d948c637b0 2023-10-05T21:15:12.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.295+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 <== osd.1 v2:172.21.15.153:6816/140456 47 ==== osd_op_reply(142 data_loggenerations_metadata [watch unwatch cookie 94391717286400] v29'47 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f27ac00a570 con 0x55d948c637b0 2023-10-05T21:15:12.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.295+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f27a800e8c0 msgr2=0x7f27a800d310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.295+0000 7f27c1468680 1 --2- 172.21.15.153:0/3755178324 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f27a800e8c0 0x7f27a800d310 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.295+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d948c637b0 msgr2=0x55d948c65bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.295+0000 7f27c1468680 1 --2- 172.21.15.153:0/3755178324 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d948c637b0 0x55d948c65bb0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.295+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f27a4007030 msgr2=0x7f27a402d9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.295+0000 7f27c1468680 1 --2- 172.21.15.153:0/3755178324 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f27a4007030 0x7f27a402d9f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.295+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d948c68190 msgr2=0x55d948c6a570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.295+0000 7f27c1468680 1 --2- 172.21.15.153:0/3755178324 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d948c68190 0x55d948c6a570 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.295+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f27a0034140 msgr2=0x7f27a00365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.295+0000 7f27c1468680 1 --2- 172.21.15.153:0/3755178324 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f27a0034140 0x7f27a00365f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f27a80011e0 tx=0x7f27a80013c0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.295+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c32290 msgr2=0x55d948c59a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.295+0000 7f27b4d41700 1 -- 172.21.15.153:0/3755178324 reap_dead start 2023-10-05T21:15:12.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.295+0000 7f27c1468680 1 --2- 172.21.15.153:0/3755178324 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c32290 0x55d948c59a80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f27a400a650 tx=0x7f27a401d000 comp rx=0 tx=0).stop 2023-10-05T21:15:12.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.295+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 shutdown_connections 2023-10-05T21:15:12.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.295+0000 7f27c1468680 1 --2- 172.21.15.153:0/3755178324 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c32290 0x55d948c59a80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.295+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 >> 172.21.15.153:0/3755178324 conn(0x55d948c2db60 msgr2=0x55d948c4b910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.295+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 shutdown_connections 2023-10-05T21:15:12.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.295+0000 7f27c1468680 1 -- 172.21.15.153:0/3755178324 wait complete. 2023-10-05T21:15:12.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.295+0000 7f27c1468680 1 -- 172.21.15.153:0/3614310491 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f26f4034140 msgr2=0x7f26f40365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.295+0000 7f27c1468680 1 --2- 172.21.15.153:0/3614310491 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f26f4034140 0x7f26f40365f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x55d948c75650 tx=0x7f27ac037450 comp rx=0 tx=0).stop 2023-10-05T21:15:12.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.295+0000 7f27c1468680 1 -- 172.21.15.153:0/3614310491 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c830b0 msgr2=0x55d948c52d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.295+0000 7f27c1468680 1 --2- 172.21.15.153:0/3614310491 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c830b0 0x55d948c52d60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f27a8000c00 tx=0x7f27a8032000 comp rx=0 tx=0).stop 2023-10-05T21:15:12.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.295+0000 7f27c1468680 1 -- 172.21.15.153:0/3614310491 shutdown_connections 2023-10-05T21:15:12.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.295+0000 7f27c1468680 1 --2- 172.21.15.153:0/3614310491 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f26f4034140 0x7f26f40365f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.295+0000 7f27c1468680 1 --2- 172.21.15.153:0/3614310491 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d948c830b0 0x55d948c52d60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.295+0000 7f27c1468680 1 -- 172.21.15.153:0/3614310491 >> 172.21.15.153:0/3614310491 conn(0x55d948c7e2b0 msgr2=0x55d948c7c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.295+0000 7f27c1468680 1 -- 172.21.15.153:0/3614310491 shutdown_connections 2023-10-05T21:15:12.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.295+0000 7f27c1468680 1 -- 172.21.15.153:0/3614310491 wait complete. 2023-10-05T21:15:12.330 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:12.330 INFO:teuthology.orchestra.run.smithi153.stdout: "entries": [], 2023-10-05T21:15:12.330 INFO:teuthology.orchestra.run.smithi153.stdout: "summary": [] 2023-10-05T21:15:12.330 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:12.330 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2023-10-05T21:15:12.331 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2023-10-05T21:15:12.331 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2023-10-05T21:15:12.331 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2023-10-05T21:15:12.414 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:12.414 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:12.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.413+0000 7f4b61512680 1 Processor -- start 2023-10-05T21:15:12.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.413+0000 7f4b61512680 1 -- start start 2023-10-05T21:15:12.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.413+0000 7f4b61512680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55fa9a3db7b0 0x55fa9a3dbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.413+0000 7f4b61512680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55fa9a32a990 con 0x55fa9a3dc100 2023-10-05T21:15:12.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.413+0000 7f4b61512680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55fa9a2eadb0 con 0x55fa9a3db7b0 2023-10-05T21:15:12.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.414+0000 7f4b53de9700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55fa9a3dc100 0x55fa9a3de9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56182/0 (socket says 172.21.15.153:56182) 2023-10-05T21:15:12.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.414+0000 7f4b53de9700 1 -- 172.21.15.153:0/1685777911 learned_addr learned my addr 172.21.15.153:0/1685777911 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:12.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.414+0000 7f4b545ea700 1 --2- 172.21.15.153:0/1685777911 >> v2:172.21.15.111:3300/0 conn(0x55fa9a3db7b0 0x55fa9a3dbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.414+0000 7f4b535e8700 1 -- 172.21.15.153:0/1685777911 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1576823018 0 0) 0x55fa9a32a990 con 0x55fa9a3dc100 2023-10-05T21:15:12.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.414+0000 7f4b535e8700 1 -- 172.21.15.153:0/1685777911 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b3c001e10 con 0x55fa9a3dc100 2023-10-05T21:15:12.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.414+0000 7f4b545ea700 1 -- 172.21.15.153:0/1685777911 >> v1:172.21.15.111:6789/0 conn(0x55fa9a3dc100 legacy=0x55fa9a3de9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.414+0000 7f4b545ea700 1 -- 172.21.15.153:0/1685777911 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa9a3df1b0 con 0x55fa9a3db7b0 2023-10-05T21:15:12.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.414+0000 7f4b545ea700 1 --2- 172.21.15.153:0/1685777911 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a3db7b0 0x55fa9a3dbbc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4b4400a5d0 tx=0x7f4b44005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eebefb98be2de9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.414+0000 7f4b535e8700 1 -- 172.21.15.153:0/1685777911 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b44007610 con 0x55fa9a3db7b0 2023-10-05T21:15:12.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.414+0000 7f4b535e8700 1 -- 172.21.15.153:0/1685777911 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b44007770 con 0x55fa9a3db7b0 2023-10-05T21:15:12.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.414+0000 7f4b535e8700 1 -- 172.21.15.153:0/1685777911 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b44007a40 con 0x55fa9a3db7b0 2023-10-05T21:15:12.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.415+0000 7f4b61512680 1 -- 172.21.15.153:0/1685777911 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a3db7b0 msgr2=0x55fa9a3dbbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.415+0000 7f4b61512680 1 --2- 172.21.15.153:0/1685777911 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a3db7b0 0x55fa9a3dbbc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4b4400a5d0 tx=0x7f4b44005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:12.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.415+0000 7f4b61512680 1 -- 172.21.15.153:0/1685777911 shutdown_connections 2023-10-05T21:15:12.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.415+0000 7f4b61512680 1 --2- 172.21.15.153:0/1685777911 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a3db7b0 0x55fa9a3dbbc0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.415+0000 7f4b61512680 1 -- 172.21.15.153:0/1685777911 >> 172.21.15.153:0/1685777911 conn(0x55fa9a3d7300 msgr2=0x55fa9a3d9710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.415+0000 7f4b61512680 1 -- 172.21.15.153:0/1685777911 shutdown_connections 2023-10-05T21:15:12.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.415+0000 7f4b61512680 1 -- 172.21.15.153:0/1685777911 wait complete. 2023-10-05T21:15:12.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.415+0000 7f4b61512680 1 Processor -- start 2023-10-05T21:15:12.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.416+0000 7f4b61512680 1 -- start start 2023-10-05T21:15:12.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.416+0000 7f4b61512680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a3db7b0 0x55fa9a3de200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.416+0000 7f4b61512680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa9a28aea0 con 0x55fa9a3db7b0 2023-10-05T21:15:12.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.416+0000 7f4b545ea700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a3db7b0 0x55fa9a3de200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.416+0000 7f4b545ea700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a3db7b0 0x55fa9a3de200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49292/0 (socket says 172.21.15.153:49292) 2023-10-05T21:15:12.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.416+0000 7f4b545ea700 1 -- 172.21.15.153:0/2590413539 learned_addr learned my addr 172.21.15.153:0/2590413539 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.416+0000 7f4b545ea700 1 -- 172.21.15.153:0/2590413539 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b44005cf0 con 0x55fa9a3db7b0 2023-10-05T21:15:12.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.416+0000 7f4b545ea700 1 --2- 172.21.15.153:0/2590413539 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a3db7b0 0x55fa9a3de200 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4b44005a90 tx=0x7f4b44014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4244a3f247f7fc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.416+0000 7f4b525e6700 1 -- 172.21.15.153:0/2590413539 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b440078e0 con 0x55fa9a3db7b0 2023-10-05T21:15:12.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.416+0000 7f4b525e6700 1 -- 172.21.15.153:0/2590413539 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b44007a40 con 0x55fa9a3db7b0 2023-10-05T21:15:12.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.416+0000 7f4b525e6700 1 -- 172.21.15.153:0/2590413539 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b44007bb0 con 0x55fa9a3db7b0 2023-10-05T21:15:12.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.417+0000 7f4b61512680 1 -- 172.21.15.153:0/2590413539 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a3db7b0 msgr2=0x55fa9a3de200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.417+0000 7f4b61512680 1 --2- 172.21.15.153:0/2590413539 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a3db7b0 0x55fa9a3de200 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4b44005a90 tx=0x7f4b44014000 comp rx=0 tx=0).stop 2023-10-05T21:15:12.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.417+0000 7f4b61512680 1 -- 172.21.15.153:0/2590413539 shutdown_connections 2023-10-05T21:15:12.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.417+0000 7f4b61512680 1 --2- 172.21.15.153:0/2590413539 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a3db7b0 0x55fa9a3de200 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.417+0000 7f4b61512680 1 -- 172.21.15.153:0/2590413539 >> 172.21.15.153:0/2590413539 conn(0x55fa9a3d7300 msgr2=0x55fa9a3f83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.417+0000 7f4b61512680 1 -- 172.21.15.153:0/2590413539 shutdown_connections 2023-10-05T21:15:12.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.417+0000 7f4b61512680 1 -- 172.21.15.153:0/2590413539 wait complete. 2023-10-05T21:15:12.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.417+0000 7f4b61512680 1 Processor -- start 2023-10-05T21:15:12.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.417+0000 7f4b61512680 1 -- start start 2023-10-05T21:15:12.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.417+0000 7f4b61512680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a3db7b0 0x55fa9a405f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.417+0000 7f4b61512680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa9a281c80 con 0x55fa9a3db7b0 2023-10-05T21:15:12.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.418+0000 7f4b545ea700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a3db7b0 0x55fa9a405f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.418+0000 7f4b545ea700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a3db7b0 0x55fa9a405f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49296/0 (socket says 172.21.15.153:49296) 2023-10-05T21:15:12.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.418+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 learned_addr learned my addr 172.21.15.153:0/2574274155 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.418+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa9a3df1b0 con 0x55fa9a3db7b0 2023-10-05T21:15:12.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.418+0000 7f4b545ea700 1 --2- 172.21.15.153:0/2574274155 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a3db7b0 0x55fa9a405f30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4b44005a90 tx=0x7f4b4401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.418+0000 7f4b50de3700 1 -- 172.21.15.153:0/2574274155 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b44026440 con 0x55fa9a3db7b0 2023-10-05T21:15:12.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.418+0000 7f4b50de3700 1 -- 172.21.15.153:0/2574274155 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b440265a0 con 0x55fa9a3db7b0 2023-10-05T21:15:12.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.418+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fa9a406470 con 0x55fa9a3db7b0 2023-10-05T21:15:12.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.418+0000 7f4b50de3700 1 -- 172.21.15.153:0/2574274155 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b44026750 con 0x55fa9a3db7b0 2023-10-05T21:15:12.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.418+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa9a4068c0 con 0x55fa9a3db7b0 2023-10-05T21:15:12.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.419+0000 7f4b50de3700 1 -- 172.21.15.153:0/2574274155 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f4b440268b0 con 0x55fa9a3db7b0 2023-10-05T21:15:12.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.419+0000 7f4b61512680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.419+0000 7f4b50de3700 1 --2- 172.21.15.153:0/2574274155 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4b40034140 0x7f4b400365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.419+0000 7f4b50de3700 1 -- 172.21.15.153:0/2574274155 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f4b4404a420 con 0x55fa9a3db7b0 2023-10-05T21:15:12.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.419+0000 7f4b53de9700 1 --2- 172.21.15.153:0/2574274155 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4b40034140 0x7f4b400365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.419+0000 7f4b61512680 1 --2- 172.21.15.153:0/2574274155 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55fa9a3dc100 0x55fa9a411c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.419+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a4123e0 con 0x55fa9a3dc100 2023-10-05T21:15:12.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.420+0000 7f4b54deb700 1 --2- 172.21.15.153:0/2574274155 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55fa9a3dc100 0x55fa9a411c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.420+0000 7f4b53de9700 1 --2- 172.21.15.153:0/2574274155 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4b40034140 0x7f4b400365f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4b48004170 tx=0x7f4b48001360 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.420+0000 7f4b54deb700 1 --2- 172.21.15.153:0/2574274155 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55fa9a3dc100 0x55fa9a411c50 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.420+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.420+0000 7f4b61512680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.420+0000 7f4b61512680 20 realm 2023-10-05T21:15:12.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.420+0000 7f4b61512680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.420+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a40f270 con 0x55fa9a3dc100 2023-10-05T21:15:12.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.420+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.420+0000 7f4b61512680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.420+0000 7f4b61512680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:12.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.420+0000 7f4b61512680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.420+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a412ee0 con 0x55fa9a3dc100 2023-10-05T21:15:12.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.421+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.421+0000 7f4b61512680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.421+0000 7f4b61512680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.421+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a413800 con 0x55fa9a3dc100 2023-10-05T21:15:12.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.421+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.421+0000 7f4b61512680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.421+0000 7f4b61512680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.421+0000 7f4b61512680 1 --2- 172.21.15.153:0/2574274155 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55fa9a4140c0 0x55fa9a4164a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.421+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a416a70 con 0x55fa9a4140c0 2023-10-05T21:15:12.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.421+0000 7f4b545ea700 1 --2- 172.21.15.153:0/2574274155 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55fa9a4140c0 0x55fa9a4164a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.421+0000 7f4b545ea700 1 --2- 172.21.15.153:0/2574274155 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55fa9a4140c0 0x55fa9a4164a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.422+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f4b44025cd0 con 0x55fa9a4140c0 2023-10-05T21:15:12.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.422+0000 7f4b61512680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:12.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.422+0000 7f4b61512680 20 searching for the correct realm 2023-10-05T21:15:12.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.422+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x55fa9a4140c0 2023-10-05T21:15:12.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.422+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b44025cd0 con 0x55fa9a4140c0 2023-10-05T21:15:12.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.422+0000 7f4b545ea700 1 --2- 172.21.15.153:0/2574274155 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4b44007030 0x7f4b440373f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.422+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x7f4b44007030 2023-10-05T21:15:12.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.422+0000 7f4b53de9700 1 --2- 172.21.15.153:0/2574274155 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4b44007030 0x7f4b440373f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.422+0000 7f4b53de9700 1 --2- 172.21.15.153:0/2574274155 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4b44007030 0x7f4b440373f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.422+0000 7f4b53de9700 1 -- 172.21.15.153:0/2574274155 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b48006070 con 0x7f4b44007030 2023-10-05T21:15:12.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.422+0000 7f4b53de9700 1 --2- 172.21.15.153:0/2574274155 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4b4800ebe0 0x7f4b4800d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.422+0000 7f4b53de9700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x7f4b4800ebe0 2023-10-05T21:15:12.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.423+0000 7f4b54deb700 1 --2- 172.21.15.153:0/2574274155 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4b4800ebe0 0x7f4b4800d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.423+0000 7f4b54deb700 1 --2- 172.21.15.153:0/2574274155 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4b4800ebe0 0x7f4b4800d8e0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.423+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a570 con 0x7f4b4800ebe0 2023-10-05T21:15:12.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.423+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x55fa9a3dc100 2023-10-05T21:15:12.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.423+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.423+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x55fa9a3dc100 2023-10-05T21:15:12.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.424+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.424+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x7f4b4800ebe0 2023-10-05T21:15:12.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.424+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a570 con 0x7f4b4800ebe0 2023-10-05T21:15:12.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.424+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x7f4b4800ebe0 2023-10-05T21:15:12.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.424+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a570 con 0x7f4b4800ebe0 2023-10-05T21:15:12.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.424+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x7f4b44007030 2023-10-05T21:15:12.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.424+0000 7f4b53de9700 1 -- 172.21.15.153:0/2574274155 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b48006070 con 0x7f4b44007030 2023-10-05T21:15:12.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.424+0000 7f4b53de9700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x55fa9a4140c0 2023-10-05T21:15:12.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.424+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4b44025cd0 con 0x55fa9a4140c0 2023-10-05T21:15:12.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.425+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x55fa9a3dc100 2023-10-05T21:15:12.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.425+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.425+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x7f4b4800ebe0 2023-10-05T21:15:12.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.425+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a570 con 0x7f4b4800ebe0 2023-10-05T21:15:12.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.425+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x55fa9a3dc100 2023-10-05T21:15:12.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.425+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.425+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x7f4b44007030 2023-10-05T21:15:12.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.425+0000 7f4b53de9700 1 -- 172.21.15.153:0/2574274155 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b48006070 con 0x7f4b44007030 2023-10-05T21:15:12.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.425+0000 7f4b53de9700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x55fa9a4140c0 2023-10-05T21:15:12.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.426+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b44025cd0 con 0x55fa9a4140c0 2023-10-05T21:15:12.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.426+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x55fa9a4140c0 2023-10-05T21:15:12.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.426+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b44025cd0 con 0x55fa9a4140c0 2023-10-05T21:15:12.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.426+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x7f4b4800ebe0 2023-10-05T21:15:12.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.426+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a570 con 0x7f4b4800ebe0 2023-10-05T21:15:12.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.426+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x55fa9a4140c0 2023-10-05T21:15:12.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.426+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b44025cd0 con 0x55fa9a4140c0 2023-10-05T21:15:12.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.426+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x55fa9a4140c0 2023-10-05T21:15:12.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.426+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b44025cd0 con 0x55fa9a4140c0 2023-10-05T21:15:12.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.426+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x55fa9a3dc100 2023-10-05T21:15:12.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.427+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.427+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x55fa9a3dc100 2023-10-05T21:15:12.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.427+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.427+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x7f4b4800ebe0 2023-10-05T21:15:12.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.427+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a570 con 0x7f4b4800ebe0 2023-10-05T21:15:12.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.427+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x55fa9a4140c0 2023-10-05T21:15:12.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.427+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b44025cd0 con 0x55fa9a4140c0 2023-10-05T21:15:12.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.427+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x7f4b44007030 2023-10-05T21:15:12.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.428+0000 7f4b53de9700 1 -- 172.21.15.153:0/2574274155 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b48006070 con 0x7f4b44007030 2023-10-05T21:15:12.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.428+0000 7f4b53de9700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x55fa9a3dc100 2023-10-05T21:15:12.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.428+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.428+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x7f4b4800ebe0 2023-10-05T21:15:12.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.428+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a570 con 0x7f4b4800ebe0 2023-10-05T21:15:12.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.428+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x55fa9a4140c0 2023-10-05T21:15:12.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.428+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b44025cd0 con 0x55fa9a4140c0 2023-10-05T21:15:12.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.428+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x7f4b4800ebe0 2023-10-05T21:15:12.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.429+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a570 con 0x7f4b4800ebe0 2023-10-05T21:15:12.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.429+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x7f4b44007030 2023-10-05T21:15:12.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.429+0000 7f4b53de9700 1 -- 172.21.15.153:0/2574274155 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b48006070 con 0x7f4b44007030 2023-10-05T21:15:12.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.429+0000 7f4b53de9700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x55fa9a4140c0 2023-10-05T21:15:12.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.429+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b44025cd0 con 0x55fa9a4140c0 2023-10-05T21:15:12.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.429+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x7f4b4800ebe0 2023-10-05T21:15:12.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.429+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a570 con 0x7f4b4800ebe0 2023-10-05T21:15:12.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.429+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x55fa9a3dc100 2023-10-05T21:15:12.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.430+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.430+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418390 con 0x7f4b44007030 2023-10-05T21:15:12.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.430+0000 7f4b53de9700 1 -- 172.21.15.153:0/2574274155 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b48006070 con 0x7f4b44007030 2023-10-05T21:15:12.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.430+0000 7f4b61512680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:12.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.430+0000 7f4b61512680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:12.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.430+0000 7f4b61512680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:12.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.430+0000 7f4b61512680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:12.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.430+0000 7f4b61512680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.430+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a4175b0 con 0x55fa9a3dc100 2023-10-05T21:15:12.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.430+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.430+0000 7f4b61512680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.430+0000 7f4b61512680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.430+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a417a40 con 0x55fa9a3dc100 2023-10-05T21:15:12.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.430+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.430+0000 7f4b61512680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.430+0000 7f4b61512680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.430+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a417e70 con 0x55fa9a3dc100 2023-10-05T21:15:12.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.430+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.430+0000 7f4b61512680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:12.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.430+0000 7f4b61512680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.430+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418c30 con 0x55fa9a4140c0 2023-10-05T21:15:12.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.431+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f4b44025cd0 con 0x55fa9a4140c0 2023-10-05T21:15:12.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.431+0000 7f4b61512680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.431+0000 7f4b61512680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.431+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418fe0 con 0x55fa9a3dc100 2023-10-05T21:15:12.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.431+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.431+0000 7f4b61512680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.431+0000 7f4b61512680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.431+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418fe0 con 0x55fa9a3dc100 2023-10-05T21:15:12.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.431+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.431+0000 7f4b61512680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.431+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a419ff0 con 0x55fa9a4140c0 2023-10-05T21:15:12.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.431+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b44025cd0 con 0x55fa9a4140c0 2023-10-05T21:15:12.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.431+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a419ff0 con 0x7f4b44007030 2023-10-05T21:15:12.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.432+0000 7f4b53de9700 1 -- 172.21.15.153:0/2574274155 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b48006070 con 0x7f4b44007030 2023-10-05T21:15:12.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.432+0000 7f4b53de9700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a419ff0 con 0x7f4b4800ebe0 2023-10-05T21:15:12.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.432+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a570 con 0x7f4b4800ebe0 2023-10-05T21:15:12.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.432+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a417e70 con 0x55fa9a3dc100 2023-10-05T21:15:12.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.432+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.432+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a417e70 con 0x55fa9a3dc100 2023-10-05T21:15:12.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.432+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.432+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a417e70 con 0x7f4b4800ebe0 2023-10-05T21:15:12.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.433+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a570 con 0x7f4b4800ebe0 2023-10-05T21:15:12.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.433+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a417e70 con 0x7f4b4800ebe0 2023-10-05T21:15:12.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.433+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a570 con 0x7f4b4800ebe0 2023-10-05T21:15:12.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.433+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a417e70 con 0x7f4b44007030 2023-10-05T21:15:12.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.433+0000 7f4b53de9700 1 -- 172.21.15.153:0/2574274155 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b48006070 con 0x7f4b44007030 2023-10-05T21:15:12.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.433+0000 7f4b53de9700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a417e70 con 0x55fa9a4140c0 2023-10-05T21:15:12.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.433+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4b44025cd0 con 0x55fa9a4140c0 2023-10-05T21:15:12.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.433+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a417e70 con 0x55fa9a3dc100 2023-10-05T21:15:12.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.433+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.433+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a417e70 con 0x7f4b4800ebe0 2023-10-05T21:15:12.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.434+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a570 con 0x7f4b4800ebe0 2023-10-05T21:15:12.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.434+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a417e70 con 0x55fa9a3dc100 2023-10-05T21:15:12.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.434+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.434+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a417e70 con 0x7f4b44007030 2023-10-05T21:15:12.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.434+0000 7f4b53de9700 1 -- 172.21.15.153:0/2574274155 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b48006070 con 0x7f4b44007030 2023-10-05T21:15:12.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.434+0000 7f4b53de9700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a417e70 con 0x55fa9a4140c0 2023-10-05T21:15:12.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.434+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b44025cd0 con 0x55fa9a4140c0 2023-10-05T21:15:12.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.434+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a417e70 con 0x55fa9a4140c0 2023-10-05T21:15:12.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.434+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b44025cd0 con 0x55fa9a4140c0 2023-10-05T21:15:12.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.434+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a417e70 con 0x7f4b4800ebe0 2023-10-05T21:15:12.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.435+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a570 con 0x7f4b4800ebe0 2023-10-05T21:15:12.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.435+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a417e70 con 0x55fa9a4140c0 2023-10-05T21:15:12.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.435+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b44025cd0 con 0x55fa9a4140c0 2023-10-05T21:15:12.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.435+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a417e70 con 0x55fa9a4140c0 2023-10-05T21:15:12.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.435+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b44025cd0 con 0x55fa9a4140c0 2023-10-05T21:15:12.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.435+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a417e70 con 0x55fa9a3dc100 2023-10-05T21:15:12.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.436+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.436+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a417e70 con 0x55fa9a3dc100 2023-10-05T21:15:12.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.436+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.436+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a417e70 con 0x7f4b4800ebe0 2023-10-05T21:15:12.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.436+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a570 con 0x7f4b4800ebe0 2023-10-05T21:15:12.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.436+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a417e70 con 0x55fa9a4140c0 2023-10-05T21:15:12.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.436+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b44025cd0 con 0x55fa9a4140c0 2023-10-05T21:15:12.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.436+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a417e70 con 0x7f4b44007030 2023-10-05T21:15:12.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.436+0000 7f4b53de9700 1 -- 172.21.15.153:0/2574274155 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b48006070 con 0x7f4b44007030 2023-10-05T21:15:12.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.436+0000 7f4b53de9700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a417e70 con 0x55fa9a3dc100 2023-10-05T21:15:12.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.437+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.437+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a417e70 con 0x7f4b4800ebe0 2023-10-05T21:15:12.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.437+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a570 con 0x7f4b4800ebe0 2023-10-05T21:15:12.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.437+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a417e70 con 0x55fa9a4140c0 2023-10-05T21:15:12.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.437+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b44025cd0 con 0x55fa9a4140c0 2023-10-05T21:15:12.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.437+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a417e70 con 0x7f4b4800ebe0 2023-10-05T21:15:12.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.437+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a570 con 0x7f4b4800ebe0 2023-10-05T21:15:12.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.437+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a417e70 con 0x7f4b44007030 2023-10-05T21:15:12.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.438+0000 7f4b53de9700 1 -- 172.21.15.153:0/2574274155 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b48006070 con 0x7f4b44007030 2023-10-05T21:15:12.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.438+0000 7f4b53de9700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a417e70 con 0x55fa9a4140c0 2023-10-05T21:15:12.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.438+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b44025cd0 con 0x55fa9a4140c0 2023-10-05T21:15:12.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.438+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a417e70 con 0x7f4b4800ebe0 2023-10-05T21:15:12.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.438+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b4c00a570 con 0x7f4b4800ebe0 2023-10-05T21:15:12.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.438+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a417e70 con 0x55fa9a3dc100 2023-10-05T21:15:12.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.438+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.438+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a417e70 con 0x7f4b44007030 2023-10-05T21:15:12.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.438+0000 7f4b53de9700 1 -- 172.21.15.153:0/2574274155 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4b48006070 con 0x7f4b44007030 2023-10-05T21:15:12.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.438+0000 7f4b61512680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:12.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.438+0000 7f4b61512680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:12.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.438+0000 7f4b61512680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:12.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.438+0000 7f4b61512680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:12.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.438+0000 7f4b61512680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.438+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a418fe0 con 0x55fa9a3dc100 2023-10-05T21:15:12.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.439+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.439+0000 7f4b61512680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.439+0000 7f4b61512680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.439+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a419390 con 0x55fa9a4140c0 2023-10-05T21:15:12.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.439+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f4b44025cd0 con 0x55fa9a4140c0 2023-10-05T21:15:12.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.439+0000 7f4b61512680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:12.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.439+0000 7f4b61512680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.439+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a419c30 con 0x55fa9a3dc100 2023-10-05T21:15:12.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.439+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.439+0000 7f4b61512680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.439+0000 7f4b61512680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.439+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a419c30 con 0x55fa9a3dc100 2023-10-05T21:15:12.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.439+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.439+0000 7f4b61512680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:12.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.439+0000 7f4b61512680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.439+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a419c30 con 0x7f4b4800ebe0 2023-10-05T21:15:12.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.440+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f4b4c00a570 con 0x7f4b4800ebe0 2023-10-05T21:15:12.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.440+0000 7f4b61512680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.440+0000 7f4b61512680 20 zone default found 2023-10-05T21:15:12.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.440+0000 7f4b61512680 4 Realm: () 2023-10-05T21:15:12.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.440+0000 7f4b61512680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:12.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.440+0000 7f4b61512680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:12.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.440+0000 7f4b61512680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:12.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.440+0000 7f4b61512680 20 zonegroup default 2023-10-05T21:15:12.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.440+0000 7f4b61512680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.440+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a419c30 con 0x7f4b4800ebe0 2023-10-05T21:15:12.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.440+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4b4c00a570 con 0x7f4b4800ebe0 2023-10-05T21:15:12.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.440+0000 7f4b61512680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.440+0000 7f4b61512680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.440+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a41b5b0 con 0x55fa9a4140c0 2023-10-05T21:15:12.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.440+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4b44025cd0 con 0x55fa9a4140c0 2023-10-05T21:15:12.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.440+0000 7f4b61512680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.440+0000 7f4b61512680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.440+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a41b960 con 0x55fa9a4140c0 2023-10-05T21:15:12.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.440+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4b44025cd0 con 0x55fa9a4140c0 2023-10-05T21:15:12.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.440+0000 7f4b61512680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.440+0000 7f4b61512680 20 started sync module instance, tier type = 2023-10-05T21:15:12.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.440+0000 7f4b61512680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:12.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.440+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a41acc0 con 0x7f4b44007030 2023-10-05T21:15:12.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.441+0000 7f4b53de9700 1 -- 172.21.15.153:0/2574274155 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b48006070 con 0x7f4b44007030 2023-10-05T21:15:12.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.441+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94534818181312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a41c200 con 0x7f4b44007030 2023-10-05T21:15:12.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.441+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a41caa0 con 0x55fa9a3dc100 2023-10-05T21:15:12.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.442+0000 7f4b53de9700 1 -- 172.21.15.153:0/2574274155 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94534818181312] v29'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b48006070 con 0x7f4b44007030 2023-10-05T21:15:12.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.442+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.442+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94534818184464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a41cae0 con 0x55fa9a3dc100 2023-10-05T21:15:12.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.442+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a41d6e0 con 0x55fa9a4140c0 2023-10-05T21:15:12.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.443+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b44025cd0 con 0x55fa9a4140c0 2023-10-05T21:15:12.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.443+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94534818189680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a41dfd0 con 0x55fa9a4140c0 2023-10-05T21:15:12.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.443+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a41ea20 con 0x7f4b44007030 2023-10-05T21:15:12.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.443+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94534818184464] v29'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.444+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94534818189680] v29'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b44025cd0 con 0x55fa9a4140c0 2023-10-05T21:15:12.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.444+0000 7f4b53de9700 1 -- 172.21.15.153:0/2574274155 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b48006070 con 0x7f4b44007030 2023-10-05T21:15:12.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.444+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94534818186672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a41dc20 con 0x7f4b44007030 2023-10-05T21:15:12.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.444+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a41f5a0 con 0x55fa9a3dc100 2023-10-05T21:15:12.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.444+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.444+0000 7f4b53de9700 1 -- 172.21.15.153:0/2574274155 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94534818186672] v29'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b48006070 con 0x7f4b44007030 2023-10-05T21:15:12.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.444+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94534818197584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a41fa50 con 0x55fa9a3dc100 2023-10-05T21:15:12.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.444+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a420460 con 0x7f4b4800ebe0 2023-10-05T21:15:12.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.445+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94534818197584] v29'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.445+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4c00a570 con 0x7f4b4800ebe0 2023-10-05T21:15:12.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.445+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94534818199440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a420460 con 0x7f4b4800ebe0 2023-10-05T21:15:12.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.445+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a420e70 con 0x7f4b4800ebe0 2023-10-05T21:15:12.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.446+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94534818199440] v29'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4c00a570 con 0x7f4b4800ebe0 2023-10-05T21:15:12.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.446+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4c00a570 con 0x7f4b4800ebe0 2023-10-05T21:15:12.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.446+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94534818202016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a420e70 con 0x7f4b4800ebe0 2023-10-05T21:15:12.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.446+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a421880 con 0x7f4b4800ebe0 2023-10-05T21:15:12.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.447+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94534818202016] v29'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4c00a570 con 0x7f4b4800ebe0 2023-10-05T21:15:12.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.447+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4c00a570 con 0x7f4b4800ebe0 2023-10-05T21:15:12.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.447+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94534818204032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a420e30 con 0x7f4b4800ebe0 2023-10-05T21:15:12.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.447+0000 7f4b61512680 20 add_watcher() i=0 2023-10-05T21:15:12.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.447+0000 7f4b61512680 20 add_watcher() i=1 2023-10-05T21:15:12.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.447+0000 7f4b61512680 20 add_watcher() i=2 2023-10-05T21:15:12.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.447+0000 7f4b61512680 20 add_watcher() i=3 2023-10-05T21:15:12.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.447+0000 7f4b61512680 20 add_watcher() i=4 2023-10-05T21:15:12.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.447+0000 7f4b61512680 20 add_watcher() i=5 2023-10-05T21:15:12.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.447+0000 7f4b61512680 20 add_watcher() i=6 2023-10-05T21:15:12.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.447+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94534818204032] v29'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4c00a570 con 0x7f4b4800ebe0 2023-10-05T21:15:12.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.447+0000 7f4b61512680 20 add_watcher() i=7 2023-10-05T21:15:12.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.447+0000 7f4b61512680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:12.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.447+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a424bf0 con 0x55fa9a3dc100 2023-10-05T21:15:12.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.448+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.448+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94534818206896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a4220e0 con 0x55fa9a3dc100 2023-10-05T21:15:12.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.448+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94534818206896] v29'48 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.448+0000 7f4b25fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:12.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.448+0000 7f4b61512680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:12.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.448+0000 7f4b61512680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:12.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.449+0000 7f4b61512680 1 Processor -- start 2023-10-05T21:15:12.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.449+0000 7f4b61512680 1 -- start start 2023-10-05T21:15:12.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.449+0000 7f4b61512680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a42f640 0x55fa9a42fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.449+0000 7f4b61512680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa9a430020 con 0x55fa9a42f640 2023-10-05T21:15:12.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.449+0000 7f4b53de9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a42f640 0x55fa9a42fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.449+0000 7f4b53de9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a42f640 0x55fa9a42fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49304/0 (socket says 172.21.15.153:49304) 2023-10-05T21:15:12.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.449+0000 7f4b53de9700 1 -- 172.21.15.153:0/4237075591 learned_addr learned my addr 172.21.15.153:0/4237075591 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.449+0000 7f4b53de9700 1 -- 172.21.15.153:0/4237075591 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa9a430160 con 0x55fa9a42f640 2023-10-05T21:15:12.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.449+0000 7f4b53de9700 1 --2- 172.21.15.153:0/4237075591 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a42f640 0x55fa9a42fa50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4b4800c010 tx=0x7f4b48006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6221e755372f0a79 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.450+0000 7f4b257e2700 1 -- 172.21.15.153:0/4237075591 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b48023040 con 0x55fa9a42f640 2023-10-05T21:15:12.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.450+0000 7f4b257e2700 1 -- 172.21.15.153:0/4237075591 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b48024040 con 0x55fa9a42f640 2023-10-05T21:15:12.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.450+0000 7f4b257e2700 1 -- 172.21.15.153:0/4237075591 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b48013040 con 0x55fa9a42f640 2023-10-05T21:15:12.480 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-10-05T21:15:12.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.450+0000 7f4b61512680 1 -- 172.21.15.153:0/4237075591 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a42f640 msgr2=0x55fa9a42fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.450+0000 7f4b61512680 1 --2- 172.21.15.153:0/4237075591 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a42f640 0x55fa9a42fa50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4b4800c010 tx=0x7f4b48006000 comp rx=0 tx=0).stop 2023-10-05T21:15:12.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.450+0000 7f4b61512680 1 -- 172.21.15.153:0/4237075591 shutdown_connections 2023-10-05T21:15:12.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.450+0000 7f4b61512680 1 --2- 172.21.15.153:0/4237075591 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a42f640 0x55fa9a42fa50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.450+0000 7f4b61512680 1 -- 172.21.15.153:0/4237075591 >> 172.21.15.153:0/4237075591 conn(0x55fa9a42a840 msgr2=0x55fa9a4289a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.450+0000 7f4b61512680 1 -- 172.21.15.153:0/4237075591 shutdown_connections 2023-10-05T21:15:12.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.450+0000 7f4b61512680 1 -- 172.21.15.153:0/4237075591 wait complete. 2023-10-05T21:15:12.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.451+0000 7f4b61512680 1 Processor -- start 2023-10-05T21:15:12.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.451+0000 7f4b61512680 1 -- start start 2023-10-05T21:15:12.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.451+0000 7f4b61512680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a42f640 0x55fa9a435270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.451+0000 7f4b61512680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa9a4357b0 con 0x55fa9a42f640 2023-10-05T21:15:12.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.451+0000 7f4b53de9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a42f640 0x55fa9a435270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.451+0000 7f4b53de9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a42f640 0x55fa9a435270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49310/0 (socket says 172.21.15.153:49310) 2023-10-05T21:15:12.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.451+0000 7f4b53de9700 1 -- 172.21.15.153:0/171464846 learned_addr learned my addr 172.21.15.153:0/171464846 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.451+0000 7f4b53de9700 1 -- 172.21.15.153:0/171464846 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3c001e10 con 0x55fa9a42f640 2023-10-05T21:15:12.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.452+0000 7f4b53de9700 1 --2- 172.21.15.153:0/171464846 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a42f640 0x55fa9a435270 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4b4803b040 tx=0x7f4b48030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.452+0000 7f4a9f7fe700 1 -- 172.21.15.153:0/171464846 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b48023070 con 0x55fa9a42f640 2023-10-05T21:15:12.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.452+0000 7f4a9f7fe700 1 -- 172.21.15.153:0/171464846 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4801e630 con 0x55fa9a42f640 2023-10-05T21:15:12.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.452+0000 7f4b61512680 1 -- 172.21.15.153:0/171464846 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fa9a4359b0 con 0x55fa9a42f640 2023-10-05T21:15:12.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.452+0000 7f4a9f7fe700 1 -- 172.21.15.153:0/171464846 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b4801e7a0 con 0x55fa9a42f640 2023-10-05T21:15:12.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.452+0000 7f4b61512680 1 -- 172.21.15.153:0/171464846 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa9a435e00 con 0x55fa9a42f640 2023-10-05T21:15:12.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.452+0000 7f4a9f7fe700 1 -- 172.21.15.153:0/171464846 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f4b4801e900 con 0x55fa9a42f640 2023-10-05T21:15:12.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.453+0000 7f4a9f7fe700 1 --2- 172.21.15.153:0/171464846 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4a94034140 0x7f4a940365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.453+0000 7f4a9f7fe700 1 -- 172.21.15.153:0/171464846 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f4b4804db00 con 0x55fa9a42f640 2023-10-05T21:15:12.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.453+0000 7f4b54deb700 1 --2- 172.21.15.153:0/171464846 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4a94034140 0x7f4a940365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.453+0000 7f4b61512680 5 note: GC not initialized 2023-10-05T21:15:12.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.453+0000 7f4b54deb700 1 --2- 172.21.15.153:0/171464846 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4a94034140 0x7f4a940365f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x55fa9a421930 tx=0x7f4b4c036440 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.454+0000 7f4a9cff9700 20 reqs_thread_entry: start 2023-10-05T21:15:12.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.454+0000 7f4a927fc700 20 reqs_thread_entry: start 2023-10-05T21:15:12.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.454+0000 7f4b61512680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:12.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.454+0000 7f4b61512680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:12.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.454+0000 7f4a90ff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:42 2023 2023-10-05T21:15:12.483 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:12.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.454+0000 7f4a77fff700 20 reqs_thread_entry: start 2023-10-05T21:15:12.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.454+0000 7f4b61512680 20 get_system_obj_state: rctx=0x7ffd94ab8fa8 obj=default.rgw.meta:users.uid:foo state=0x55fa9a350330 s->prefetch_data=0 2023-10-05T21:15:12.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.454+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a49ab50 con 0x55fa9a3dc100 2023-10-05T21:15:12.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.455+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call,getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.484 INFO:teuthology.orchestra.run.smithi153.stderr:could not fetch user info: no user info saved 2023-10-05T21:15:12.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.455+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:103 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94534818181312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a459830 con 0x7f4b44007030 2023-10-05T21:15:12.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.456+0000 7f4b53de9700 1 -- 172.21.15.153:0/2574274155 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(103 notify.0 [watch unwatch cookie 94534818181312] v29'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4803f040 con 0x7f4b44007030 2023-10-05T21:15:12.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.456+0000 7f4b61512680 20 remove_watcher() i=0 2023-10-05T21:15:12.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.456+0000 7f4b61512680 2 removed watcher, disabling cache 2023-10-05T21:15:12.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.456+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:104 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94534818184464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a41b0c0 con 0x55fa9a3dc100 2023-10-05T21:15:12.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.456+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(104 notify.1 [watch unwatch cookie 94534818184464] v29'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.456+0000 7f4b61512680 20 remove_watcher() i=1 2023-10-05T21:15:12.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.456+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:105 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94534818189680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a41b0c0 con 0x55fa9a4140c0 2023-10-05T21:15:12.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.457+0000 7f4b545ea700 1 -- 172.21.15.153:0/2574274155 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(105 notify.2 [watch unwatch cookie 94534818189680] v29'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b44025cd0 con 0x55fa9a4140c0 2023-10-05T21:15:12.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.457+0000 7f4b61512680 20 remove_watcher() i=2 2023-10-05T21:15:12.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.457+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:106 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94534818186672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a41d170 con 0x7f4b44007030 2023-10-05T21:15:12.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.458+0000 7f4b53de9700 1 -- 172.21.15.153:0/2574274155 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(106 notify.3 [watch unwatch cookie 94534818186672] v29'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4803f040 con 0x7f4b44007030 2023-10-05T21:15:12.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.458+0000 7f4b61512680 20 remove_watcher() i=3 2023-10-05T21:15:12.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.458+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94534818197584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a41c5b0 con 0x55fa9a3dc100 2023-10-05T21:15:12.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.458+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(107 notify.4 [watch unwatch cookie 94534818197584] v29'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.458+0000 7f4b61512680 20 remove_watcher() i=4 2023-10-05T21:15:12.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.458+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:108 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94534818199440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a41d170 con 0x7f4b4800ebe0 2023-10-05T21:15:12.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.459+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(108 notify.5 [watch unwatch cookie 94534818199440] v29'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4c00a570 con 0x7f4b4800ebe0 2023-10-05T21:15:12.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.459+0000 7f4b61512680 20 remove_watcher() i=5 2023-10-05T21:15:12.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.459+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94534818202016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a41f050 con 0x7f4b4800ebe0 2023-10-05T21:15:12.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.460+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(109 notify.6 [watch unwatch cookie 94534818202016] v29'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4c00a570 con 0x7f4b4800ebe0 2023-10-05T21:15:12.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.460+0000 7f4b61512680 20 remove_watcher() i=6 2023-10-05T21:15:12.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.460+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94534818204032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a41f790 con 0x7f4b4800ebe0 2023-10-05T21:15:12.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.460+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(110 notify.7 [watch unwatch cookie 94534818204032] v29'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4b4c00a570 con 0x7f4b4800ebe0 2023-10-05T21:15:12.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.461+0000 7f4b61512680 20 remove_watcher() i=7 2023-10-05T21:15:12.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.461+0000 7f4b25fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:12.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.461+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:111 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94534818206896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55fa9a41d170 con 0x55fa9a3dc100 2023-10-05T21:15:12.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.462+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(111 data_loggenerations_metadata [watch unwatch cookie 94534818206896] v29'49 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4b4c00a570 con 0x55fa9a3dc100 2023-10-05T21:15:12.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.462+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4b4800ebe0 msgr2=0x7f4b4800d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.462+0000 7f4b61512680 1 --2- 172.21.15.153:0/2574274155 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4b4800ebe0 0x7f4b4800d8e0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.462+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55fa9a3dc100 msgr2=0x55fa9a411c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.462+0000 7f4b61512680 1 --2- 172.21.15.153:0/2574274155 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55fa9a3dc100 0x55fa9a411c50 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.462+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4b44007030 msgr2=0x7f4b440373f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.462+0000 7f4b61512680 1 --2- 172.21.15.153:0/2574274155 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4b44007030 0x7f4b440373f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.462+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55fa9a4140c0 msgr2=0x55fa9a4164a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.462+0000 7f4b61512680 1 --2- 172.21.15.153:0/2574274155 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55fa9a4140c0 0x55fa9a4164a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.462+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4b40034140 msgr2=0x7f4b400365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.462+0000 7f4b61512680 1 --2- 172.21.15.153:0/2574274155 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4b40034140 0x7f4b400365f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4b48004170 tx=0x7f4b48001360 comp rx=0 tx=0).stop 2023-10-05T21:15:12.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.462+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a3db7b0 msgr2=0x55fa9a405f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.462+0000 7f4b54deb700 1 -- 172.21.15.153:0/2574274155 reap_dead start 2023-10-05T21:15:12.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.462+0000 7f4b61512680 1 --2- 172.21.15.153:0/2574274155 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a3db7b0 0x55fa9a405f30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4b44005a90 tx=0x7f4b4401c000 comp rx=0 tx=0).stop 2023-10-05T21:15:12.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.462+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 shutdown_connections 2023-10-05T21:15:12.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.462+0000 7f4b61512680 1 --2- 172.21.15.153:0/2574274155 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a3db7b0 0x55fa9a405f30 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.462+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 >> 172.21.15.153:0/2574274155 conn(0x55fa9a3d7300 msgr2=0x55fa9a3dccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.462+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 shutdown_connections 2023-10-05T21:15:12.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.462+0000 7f4b61512680 1 -- 172.21.15.153:0/2574274155 wait complete. 2023-10-05T21:15:12.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.463+0000 7f4b61512680 1 -- 172.21.15.153:0/171464846 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4a94034140 msgr2=0x7f4a940365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.463+0000 7f4b61512680 1 --2- 172.21.15.153:0/171464846 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4a94034140 0x7f4a940365f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x55fa9a421930 tx=0x7f4b4c036440 comp rx=0 tx=0).stop 2023-10-05T21:15:12.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.463+0000 7f4b61512680 1 -- 172.21.15.153:0/171464846 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a42f640 msgr2=0x55fa9a435270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.463+0000 7f4b61512680 1 --2- 172.21.15.153:0/171464846 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a42f640 0x55fa9a435270 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4b4803b040 tx=0x7f4b48030000 comp rx=0 tx=0).stop 2023-10-05T21:15:12.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.463+0000 7f4b61512680 1 -- 172.21.15.153:0/171464846 shutdown_connections 2023-10-05T21:15:12.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.463+0000 7f4b61512680 1 --2- 172.21.15.153:0/171464846 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4a94034140 0x7f4a940365f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.463+0000 7f4b61512680 1 --2- 172.21.15.153:0/171464846 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fa9a42f640 0x55fa9a435270 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.463+0000 7f4b61512680 1 -- 172.21.15.153:0/171464846 >> 172.21.15.153:0/171464846 conn(0x55fa9a42a840 msgr2=0x55fa9a428970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.463+0000 7f4b61512680 1 -- 172.21.15.153:0/171464846 shutdown_connections 2023-10-05T21:15:12.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.463+0000 7f4b61512680 1 -- 172.21.15.153:0/171464846 wait complete. 2023-10-05T21:15:12.489 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2023-10-05T21:15:12.489 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2023-10-05T21:15:12.489 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2023-10-05T21:15:12.543 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:12.543 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:12.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.542+0000 7f80a2235680 1 Processor -- start 2023-10-05T21:15:12.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.542+0000 7f80a2235680 1 -- start start 2023-10-05T21:15:12.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.542+0000 7f80a2235680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55bd240c3b50 0x55bd240c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.542+0000 7f80a2235680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55bd2400a930 con 0x55bd24031040 2023-10-05T21:15:12.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.542+0000 7f80a2235680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55bd23fcadb0 con 0x55bd240c3b50 2023-10-05T21:15:12.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.543+0000 7f8094b0c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55bd240c3b50 0x55bd240c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.543+0000 7f8094b0c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55bd240c3b50 0x55bd240c5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49318/0 (socket says 172.21.15.153:49318) 2023-10-05T21:15:12.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.543+0000 7f8094b0c700 1 -- 172.21.15.153:0/2092601523 learned_addr learned my addr 172.21.15.153:0/2092601523 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.543+0000 7f8094b0c700 1 -- 172.21.15.153:0/2092601523 >> v1:172.21.15.111:6789/0 conn(0x55bd24031040 legacy=0x55bd240c2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.543+0000 7f8094b0c700 1 -- 172.21.15.153:0/2092601523 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bd240c7480 con 0x55bd240c3b50 2023-10-05T21:15:12.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.543+0000 7f8094b0c700 1 --2- 172.21.15.153:0/2092601523 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55bd240c3b50 0x55bd240c5f30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f808800a650 tx=0x7f8088005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d78308ec5c455e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.543+0000 7f8087fff700 1 -- 172.21.15.153:0/2092601523 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8088008760 con 0x55bd240c3b50 2023-10-05T21:15:12.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.543+0000 7f8087fff700 1 -- 172.21.15.153:0/2092601523 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80880088c0 con 0x55bd240c3b50 2023-10-05T21:15:12.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.543+0000 7f8087fff700 1 -- 172.21.15.153:0/2092601523 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8088008bb0 con 0x55bd240c3b50 2023-10-05T21:15:12.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.544+0000 7f80a2235680 1 -- 172.21.15.153:0/2092601523 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55bd240c3b50 msgr2=0x55bd240c5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.544+0000 7f80a2235680 1 --2- 172.21.15.153:0/2092601523 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55bd240c3b50 0x55bd240c5f30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f808800a650 tx=0x7f8088005b10 comp rx=0 tx=0).stop 2023-10-05T21:15:12.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.544+0000 7f80a2235680 1 -- 172.21.15.153:0/2092601523 shutdown_connections 2023-10-05T21:15:12.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.544+0000 7f80a2235680 1 --2- 172.21.15.153:0/2092601523 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55bd240c3b50 0x55bd240c5f30 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.544+0000 7f80a2235680 1 -- 172.21.15.153:0/2092601523 >> 172.21.15.153:0/2092601523 conn(0x55bd240b7b20 msgr2=0x55bd240b9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.544+0000 7f80a2235680 1 -- 172.21.15.153:0/2092601523 shutdown_connections 2023-10-05T21:15:12.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.544+0000 7f80a2235680 1 -- 172.21.15.153:0/2092601523 wait complete. 2023-10-05T21:15:12.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.544+0000 7f80a2235680 1 Processor -- start 2023-10-05T21:15:12.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.545+0000 7f80a2235680 1 -- start start 2023-10-05T21:15:12.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.545+0000 7f80a2235680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55bd24031040 0x55bd240deb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.545+0000 7f80a2235680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd23f6aea0 con 0x55bd24031040 2023-10-05T21:15:12.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.545+0000 7f809530d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55bd24031040 0x55bd240deb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.545+0000 7f809530d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55bd24031040 0x55bd240deb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49330/0 (socket says 172.21.15.153:49330) 2023-10-05T21:15:12.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.545+0000 7f809530d700 1 -- 172.21.15.153:0/3603804854 learned_addr learned my addr 172.21.15.153:0/3603804854 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.545+0000 7f809530d700 1 -- 172.21.15.153:0/3603804854 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8088005db0 con 0x55bd24031040 2023-10-05T21:15:12.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.545+0000 7f809530d700 1 --2- 172.21.15.153:0/3603804854 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55bd24031040 0x55bd240deb30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f808c001d00 tx=0x7f808c0018d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a361048bdf66ca4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.545+0000 7f8086ffd700 1 -- 172.21.15.153:0/3603804854 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f808c014070 con 0x55bd24031040 2023-10-05T21:15:12.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.545+0000 7f8086ffd700 1 -- 172.21.15.153:0/3603804854 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808c008070 con 0x55bd24031040 2023-10-05T21:15:12.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.545+0000 7f8086ffd700 1 -- 172.21.15.153:0/3603804854 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f808c00bd30 con 0x55bd24031040 2023-10-05T21:15:12.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.546+0000 7f80a2235680 1 -- 172.21.15.153:0/3603804854 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55bd24031040 msgr2=0x55bd240deb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.546+0000 7f80a2235680 1 --2- 172.21.15.153:0/3603804854 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55bd24031040 0x55bd240deb30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f808c001d00 tx=0x7f808c0018d0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.546+0000 7f80a2235680 1 -- 172.21.15.153:0/3603804854 shutdown_connections 2023-10-05T21:15:12.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.546+0000 7f80a2235680 1 --2- 172.21.15.153:0/3603804854 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55bd24031040 0x55bd240deb30 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.546+0000 7f80a2235680 1 -- 172.21.15.153:0/3603804854 >> 172.21.15.153:0/3603804854 conn(0x55bd240b7b20 msgr2=0x55bd240da600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.546+0000 7f80a2235680 1 -- 172.21.15.153:0/3603804854 shutdown_connections 2023-10-05T21:15:12.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.546+0000 7f80a2235680 1 -- 172.21.15.153:0/3603804854 wait complete. 2023-10-05T21:15:12.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.546+0000 7f80a2235680 1 Processor -- start 2023-10-05T21:15:12.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.546+0000 7f80a2235680 1 -- start start 2023-10-05T21:15:12.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.546+0000 7f80a2235680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55bd24031040 0x55bd240e6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.546+0000 7f80a2235680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd23f61c80 con 0x55bd24031040 2023-10-05T21:15:12.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.546+0000 7f809530d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55bd24031040 0x55bd240e6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.546+0000 7f809530d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55bd24031040 0x55bd240e6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49342/0 (socket says 172.21.15.153:49342) 2023-10-05T21:15:12.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.546+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 learned_addr learned my addr 172.21.15.153:0/1075062210 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.547+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808c00a040 con 0x55bd24031040 2023-10-05T21:15:12.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.547+0000 7f809530d700 1 --2- 172.21.15.153:0/1075062210 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55bd24031040 0x55bd240e6010 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f808c003000 tx=0x7f808c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.547+0000 7f80857fa700 1 -- 172.21.15.153:0/1075062210 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f808c01a480 con 0x55bd24031040 2023-10-05T21:15:12.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.547+0000 7f80857fa700 1 -- 172.21.15.153:0/1075062210 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808c021070 con 0x55bd24031040 2023-10-05T21:15:12.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.547+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bd240e6550 con 0x55bd24031040 2023-10-05T21:15:12.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.547+0000 7f80857fa700 1 -- 172.21.15.153:0/1075062210 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f808c01a740 con 0x55bd24031040 2023-10-05T21:15:12.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.547+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bd240e6a00 con 0x55bd24031040 2023-10-05T21:15:12.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.548+0000 7f80857fa700 1 -- 172.21.15.153:0/1075062210 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f808c01a8f0 con 0x55bd24031040 2023-10-05T21:15:12.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.548+0000 7f80a2235680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.548+0000 7f80857fa700 1 --2- 172.21.15.153:0/1075062210 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8078034130 0x7f80780365e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.548+0000 7f80857fa700 1 -- 172.21.15.153:0/1075062210 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f808c001e40 con 0x55bd24031040 2023-10-05T21:15:12.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.548+0000 7f8094b0c700 1 --2- 172.21.15.153:0/1075062210 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8078034130 0x7f80780365e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.548+0000 7f80a2235680 1 --2- 172.21.15.153:0/1075062210 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55bd240c3b50 0x55bd240f1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.548+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f2590 con 0x55bd240c3b50 2023-10-05T21:15:12.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.548+0000 7f8094b0c700 1 --2- 172.21.15.153:0/1075062210 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8078034130 0x7f80780365e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8088005b50 tx=0x7f8088015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.551+0000 7f8095b0e700 1 --2- 172.21.15.153:0/1075062210 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55bd240c3b50 0x55bd240f1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.551+0000 7f8095b0e700 1 --2- 172.21.15.153:0/1075062210 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55bd240c3b50 0x55bd240f1e00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.551+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.551+0000 7f80a2235680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.551+0000 7f80a2235680 20 realm 2023-10-05T21:15:12.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.551+0000 7f80a2235680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.551+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240ef3e0 con 0x55bd240c3b50 2023-10-05T21:15:12.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.551+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.551+0000 7f80a2235680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.551+0000 7f80a2235680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:12.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.551+0000 7f80a2235680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.551+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f3090 con 0x55bd240c3b50 2023-10-05T21:15:12.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.551+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.551+0000 7f80a2235680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.551+0000 7f80a2235680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.551+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f39b0 con 0x55bd240c3b50 2023-10-05T21:15:12.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.552+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.552+0000 7f80a2235680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.552+0000 7f80a2235680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.552+0000 7f80a2235680 1 --2- 172.21.15.153:0/1075062210 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55bd240f4270 0x55bd240f6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.552+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f6ca0 con 0x55bd240f4270 2023-10-05T21:15:12.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.552+0000 7f809530d700 1 --2- 172.21.15.153:0/1075062210 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55bd240f4270 0x55bd240f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.552+0000 7f809530d700 1 --2- 172.21.15.153:0/1075062210 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55bd240f4270 0x55bd240f6650 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.552+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f808c016070 con 0x55bd240f4270 2023-10-05T21:15:12.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.552+0000 7f80a2235680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:12.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.552+0000 7f80a2235680 20 searching for the correct realm 2023-10-05T21:15:12.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.552+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x55bd240f4270 2023-10-05T21:15:12.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.553+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f808c016070 con 0x55bd240f4270 2023-10-05T21:15:12.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.553+0000 7f809530d700 1 --2- 172.21.15.153:0/1075062210 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f808c017540 0x7f808c0481c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.553+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x7f808c017540 2023-10-05T21:15:12.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.553+0000 7f8094b0c700 1 --2- 172.21.15.153:0/1075062210 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f808c017540 0x7f808c0481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.553+0000 7f8094b0c700 1 --2- 172.21.15.153:0/1075062210 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f808c017540 0x7f808c0481c0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.553+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8088019040 con 0x7f808c017540 2023-10-05T21:15:12.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.553+0000 7f8094b0c700 1 --2- 172.21.15.153:0/1075062210 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f8088007030 0x7f808801d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.553+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x7f8088007030 2023-10-05T21:15:12.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.553+0000 7f8095b0e700 1 --2- 172.21.15.153:0/1075062210 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f8088007030 0x7f808801d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.554+0000 7f8095b0e700 1 --2- 172.21.15.153:0/1075062210 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f8088007030 0x7f808801d420 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.554+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f809000a570 con 0x7f8088007030 2023-10-05T21:15:12.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.554+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x55bd240c3b50 2023-10-05T21:15:12.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.554+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.554+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x55bd240c3b50 2023-10-05T21:15:12.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.554+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.554+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x7f8088007030 2023-10-05T21:15:12.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.555+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f809000a570 con 0x7f8088007030 2023-10-05T21:15:12.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.555+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x7f8088007030 2023-10-05T21:15:12.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.555+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f809000a570 con 0x7f8088007030 2023-10-05T21:15:12.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.555+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x7f808c017540 2023-10-05T21:15:12.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.555+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8088019040 con 0x7f808c017540 2023-10-05T21:15:12.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.555+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x55bd240f4270 2023-10-05T21:15:12.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.555+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f808c016070 con 0x55bd240f4270 2023-10-05T21:15:12.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.555+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x55bd240c3b50 2023-10-05T21:15:12.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.555+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.555+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x7f8088007030 2023-10-05T21:15:12.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.556+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f809000a570 con 0x7f8088007030 2023-10-05T21:15:12.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.556+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x55bd240c3b50 2023-10-05T21:15:12.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.556+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.556+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x7f808c017540 2023-10-05T21:15:12.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.556+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8088019040 con 0x7f808c017540 2023-10-05T21:15:12.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.556+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x55bd240f4270 2023-10-05T21:15:12.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.556+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f808c016070 con 0x55bd240f4270 2023-10-05T21:15:12.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.556+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x55bd240f4270 2023-10-05T21:15:12.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.557+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f808c016070 con 0x55bd240f4270 2023-10-05T21:15:12.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.557+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x7f8088007030 2023-10-05T21:15:12.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.557+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f809000a570 con 0x7f8088007030 2023-10-05T21:15:12.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.557+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x55bd240f4270 2023-10-05T21:15:12.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.557+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f808c016070 con 0x55bd240f4270 2023-10-05T21:15:12.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.557+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x55bd240f4270 2023-10-05T21:15:12.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.557+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f808c016070 con 0x55bd240f4270 2023-10-05T21:15:12.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.557+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x55bd240c3b50 2023-10-05T21:15:12.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.557+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.557+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x55bd240c3b50 2023-10-05T21:15:12.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.558+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.558+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x7f8088007030 2023-10-05T21:15:12.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.558+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f809000a570 con 0x7f8088007030 2023-10-05T21:15:12.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.558+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x55bd240f4270 2023-10-05T21:15:12.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.558+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f808c016070 con 0x55bd240f4270 2023-10-05T21:15:12.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.558+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x7f808c017540 2023-10-05T21:15:12.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.558+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8088019040 con 0x7f808c017540 2023-10-05T21:15:12.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.559+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x55bd240c3b50 2023-10-05T21:15:12.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.559+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.559+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x7f8088007030 2023-10-05T21:15:12.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.559+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f809000a570 con 0x7f8088007030 2023-10-05T21:15:12.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.559+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x55bd240f4270 2023-10-05T21:15:12.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.559+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f808c016070 con 0x55bd240f4270 2023-10-05T21:15:12.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.559+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x7f8088007030 2023-10-05T21:15:12.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.559+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f809000a570 con 0x7f8088007030 2023-10-05T21:15:12.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.559+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x7f808c017540 2023-10-05T21:15:12.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.560+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8088019040 con 0x7f808c017540 2023-10-05T21:15:12.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.560+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x55bd240f4270 2023-10-05T21:15:12.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.560+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f808c016070 con 0x55bd240f4270 2023-10-05T21:15:12.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.560+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x7f8088007030 2023-10-05T21:15:12.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.560+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f809000a570 con 0x7f8088007030 2023-10-05T21:15:12.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.560+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x55bd240c3b50 2023-10-05T21:15:12.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.560+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.560+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8810 con 0x7f808c017540 2023-10-05T21:15:12.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.561+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8088019040 con 0x7f808c017540 2023-10-05T21:15:12.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.561+0000 7f80a2235680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:12.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.561+0000 7f80a2235680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:12.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.561+0000 7f80a2235680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:12.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.561+0000 7f80a2235680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:12.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.561+0000 7f80a2235680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.561+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f7760 con 0x55bd240c3b50 2023-10-05T21:15:12.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.561+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.561+0000 7f80a2235680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.561+0000 7f80a2235680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.561+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f7b60 con 0x55bd240c3b50 2023-10-05T21:15:12.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.561+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.561+0000 7f80a2235680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.561+0000 7f80a2235680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.561+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8ca0 con 0x55bd240c3b50 2023-10-05T21:15:12.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.561+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.561+0000 7f80a2235680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:12.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.561+0000 7f80a2235680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.561+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f9050 con 0x55bd240f4270 2023-10-05T21:15:12.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.562+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f808c016070 con 0x55bd240f4270 2023-10-05T21:15:12.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.562+0000 7f80a2235680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.562+0000 7f80a2235680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.562+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f9400 con 0x55bd240c3b50 2023-10-05T21:15:12.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.562+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.562+0000 7f80a2235680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.562+0000 7f80a2235680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.562+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f9400 con 0x55bd240c3b50 2023-10-05T21:15:12.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.562+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.562+0000 7f80a2235680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.562+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f9400 con 0x55bd240f4270 2023-10-05T21:15:12.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.562+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f808c016070 con 0x55bd240f4270 2023-10-05T21:15:12.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.562+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f9400 con 0x7f808c017540 2023-10-05T21:15:12.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.563+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8088019040 con 0x7f808c017540 2023-10-05T21:15:12.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.563+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f9400 con 0x7f8088007030 2023-10-05T21:15:12.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.563+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f809000a570 con 0x7f8088007030 2023-10-05T21:15:12.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.563+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8ca0 con 0x55bd240c3b50 2023-10-05T21:15:12.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.563+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.563+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8ca0 con 0x55bd240c3b50 2023-10-05T21:15:12.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.563+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.563+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8ca0 con 0x7f8088007030 2023-10-05T21:15:12.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.564+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f809000a570 con 0x7f8088007030 2023-10-05T21:15:12.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.564+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8ca0 con 0x7f8088007030 2023-10-05T21:15:12.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.564+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f809000a570 con 0x7f8088007030 2023-10-05T21:15:12.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.564+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8ca0 con 0x7f808c017540 2023-10-05T21:15:12.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.564+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8088019040 con 0x7f808c017540 2023-10-05T21:15:12.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.564+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8ca0 con 0x55bd240f4270 2023-10-05T21:15:12.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.564+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f808c016070 con 0x55bd240f4270 2023-10-05T21:15:12.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.564+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8ca0 con 0x55bd240c3b50 2023-10-05T21:15:12.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.565+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.565+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8ca0 con 0x7f8088007030 2023-10-05T21:15:12.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.565+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f809000a570 con 0x7f8088007030 2023-10-05T21:15:12.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.565+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8ca0 con 0x55bd240c3b50 2023-10-05T21:15:12.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.565+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.565+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8ca0 con 0x7f808c017540 2023-10-05T21:15:12.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.565+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8088019040 con 0x7f808c017540 2023-10-05T21:15:12.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.565+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8ca0 con 0x55bd240f4270 2023-10-05T21:15:12.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.565+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f808c016070 con 0x55bd240f4270 2023-10-05T21:15:12.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.565+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8ca0 con 0x55bd240f4270 2023-10-05T21:15:12.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.566+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f808c016070 con 0x55bd240f4270 2023-10-05T21:15:12.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.566+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8ca0 con 0x7f8088007030 2023-10-05T21:15:12.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.566+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f809000a570 con 0x7f8088007030 2023-10-05T21:15:12.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.566+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8ca0 con 0x55bd240f4270 2023-10-05T21:15:12.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.566+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f808c016070 con 0x55bd240f4270 2023-10-05T21:15:12.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.566+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8ca0 con 0x55bd240f4270 2023-10-05T21:15:12.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.566+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f808c016070 con 0x55bd240f4270 2023-10-05T21:15:12.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.566+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8ca0 con 0x55bd240c3b50 2023-10-05T21:15:12.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.567+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.567+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8ca0 con 0x55bd240c3b50 2023-10-05T21:15:12.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.567+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.567+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8ca0 con 0x7f8088007030 2023-10-05T21:15:12.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.567+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f809000a570 con 0x7f8088007030 2023-10-05T21:15:12.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.567+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8ca0 con 0x55bd240f4270 2023-10-05T21:15:12.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.567+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f808c016070 con 0x55bd240f4270 2023-10-05T21:15:12.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.567+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8ca0 con 0x7f808c017540 2023-10-05T21:15:12.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.568+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8088019040 con 0x7f808c017540 2023-10-05T21:15:12.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.568+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8ca0 con 0x55bd240c3b50 2023-10-05T21:15:12.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.568+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.568+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8ca0 con 0x7f8088007030 2023-10-05T21:15:12.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.568+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f809000a570 con 0x7f8088007030 2023-10-05T21:15:12.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.568+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8ca0 con 0x55bd240f4270 2023-10-05T21:15:12.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.568+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f808c016070 con 0x55bd240f4270 2023-10-05T21:15:12.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.568+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8ca0 con 0x7f8088007030 2023-10-05T21:15:12.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.569+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f809000a570 con 0x7f8088007030 2023-10-05T21:15:12.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.569+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8ca0 con 0x7f808c017540 2023-10-05T21:15:12.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.569+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8088019040 con 0x7f808c017540 2023-10-05T21:15:12.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.569+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8ca0 con 0x55bd240f4270 2023-10-05T21:15:12.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.569+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f808c016070 con 0x55bd240f4270 2023-10-05T21:15:12.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.569+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8ca0 con 0x7f8088007030 2023-10-05T21:15:12.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.569+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f809000a570 con 0x7f8088007030 2023-10-05T21:15:12.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.569+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8ca0 con 0x55bd240c3b50 2023-10-05T21:15:12.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.569+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.569+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f8ca0 con 0x7f808c017540 2023-10-05T21:15:12.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.570+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8088019040 con 0x7f808c017540 2023-10-05T21:15:12.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.570+0000 7f80a2235680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:12.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.570+0000 7f80a2235680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:12.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.570+0000 7f80a2235680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:12.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.570+0000 7f80a2235680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:12.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.570+0000 7f80a2235680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.570+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f9400 con 0x55bd240c3b50 2023-10-05T21:15:12.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.570+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.570+0000 7f80a2235680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.570+0000 7f80a2235680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.570+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240f9800 con 0x55bd240f4270 2023-10-05T21:15:12.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.570+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f808c016070 con 0x55bd240f4270 2023-10-05T21:15:12.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.570+0000 7f80a2235680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:12.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.570+0000 7f80a2235680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.570+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240fa0a0 con 0x55bd240c3b50 2023-10-05T21:15:12.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.571+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.571+0000 7f80a2235680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.571+0000 7f80a2235680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.571+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240fa0a0 con 0x55bd240c3b50 2023-10-05T21:15:12.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.571+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.571+0000 7f80a2235680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:12.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.571+0000 7f80a2235680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.571+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240fa0a0 con 0x7f8088007030 2023-10-05T21:15:12.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.571+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f809000a570 con 0x7f8088007030 2023-10-05T21:15:12.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.571+0000 7f80a2235680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.571+0000 7f80a2235680 20 zone default found 2023-10-05T21:15:12.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.571+0000 7f80a2235680 4 Realm: () 2023-10-05T21:15:12.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.571+0000 7f80a2235680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:12.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.571+0000 7f80a2235680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:12.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.571+0000 7f80a2235680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:12.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.571+0000 7f80a2235680 20 zonegroup default 2023-10-05T21:15:12.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.571+0000 7f80a2235680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.571+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240fa0a0 con 0x7f8088007030 2023-10-05T21:15:12.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.571+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f809000a570 con 0x7f8088007030 2023-10-05T21:15:12.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.571+0000 7f80a2235680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.571+0000 7f80a2235680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.571+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240fba20 con 0x55bd240f4270 2023-10-05T21:15:12.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.572+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f808c016070 con 0x55bd240f4270 2023-10-05T21:15:12.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.572+0000 7f80a2235680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.572+0000 7f80a2235680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.572+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240fbdd0 con 0x55bd240f4270 2023-10-05T21:15:12.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.572+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f808c016070 con 0x55bd240f4270 2023-10-05T21:15:12.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.572+0000 7f80a2235680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.572+0000 7f80a2235680 20 started sync module instance, tier type = 2023-10-05T21:15:12.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.572+0000 7f80a2235680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:12.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.572+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240fb130 con 0x7f808c017540 2023-10-05T21:15:12.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.573+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8088019040 con 0x7f808c017540 2023-10-05T21:15:12.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.573+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94270842189104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240fc670 con 0x7f808c017540 2023-10-05T21:15:12.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.573+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240fcf10 con 0x55bd240c3b50 2023-10-05T21:15:12.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.573+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.573+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94270842194752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240fd580 con 0x55bd240c3b50 2023-10-05T21:15:12.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.574+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94270842189104] v29'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8088019040 con 0x7f808c017540 2023-10-05T21:15:12.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.574+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240fe180 con 0x55bd240f4270 2023-10-05T21:15:12.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.574+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94270842194752] v29'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.574+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f808c016070 con 0x55bd240f4270 2023-10-05T21:15:12.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.574+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94270842199056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240fcf90 con 0x55bd240f4270 2023-10-05T21:15:12.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.574+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240fea70 con 0x7f808c017540 2023-10-05T21:15:12.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.575+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94270842199056] v29'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f808c016070 con 0x55bd240f4270 2023-10-05T21:15:12.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.575+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8088019040 con 0x7f808c017540 2023-10-05T21:15:12.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.575+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94270842201472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240fee20 con 0x7f808c017540 2023-10-05T21:15:12.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.575+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240ff6c0 con 0x55bd240c3b50 2023-10-05T21:15:12.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.576+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.576+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94270842201472] v29'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8088019040 con 0x7f808c017540 2023-10-05T21:15:12.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.576+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94270842204624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240ff620 con 0x55bd240c3b50 2023-10-05T21:15:12.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.576+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd241004a0 con 0x7f8088007030 2023-10-05T21:15:12.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.576+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94270842204624] v29'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.576+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f809000a570 con 0x7f8088007030 2023-10-05T21:15:12.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.576+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94270842206832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd241003b0 con 0x7f8088007030 2023-10-05T21:15:12.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.576+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd24100f00 con 0x7f8088007030 2023-10-05T21:15:12.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.577+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94270842206832] v29'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f809000a570 con 0x7f8088007030 2023-10-05T21:15:12.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.577+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f809000a570 con 0x7f8088007030 2023-10-05T21:15:12.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.577+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94270842210704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd241003b0 con 0x7f8088007030 2023-10-05T21:15:12.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.577+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd24101960 con 0x7f8088007030 2023-10-05T21:15:12.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.578+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(98 notify.7 [create] v29'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f809000a570 con 0x7f8088007030 2023-10-05T21:15:12.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.578+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94270842213488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd24101df0 con 0x7f8088007030 2023-10-05T21:15:12.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.578+0000 7f80a2235680 20 add_watcher() i=0 2023-10-05T21:15:12.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.578+0000 7f80a2235680 20 add_watcher() i=1 2023-10-05T21:15:12.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.578+0000 7f80a2235680 20 add_watcher() i=2 2023-10-05T21:15:12.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.578+0000 7f80a2235680 20 add_watcher() i=3 2023-10-05T21:15:12.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.578+0000 7f80a2235680 20 add_watcher() i=4 2023-10-05T21:15:12.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.578+0000 7f80a2235680 20 add_watcher() i=5 2023-10-05T21:15:12.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.578+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(97 notify.6 [watch watch cookie 94270842210704] v29'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f809000a570 con 0x7f8088007030 2023-10-05T21:15:12.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.578+0000 7f80a2235680 20 add_watcher() i=6 2023-10-05T21:15:12.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.579+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94270842213488] v29'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f809000a570 con 0x7f8088007030 2023-10-05T21:15:12.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.579+0000 7f80a2235680 20 add_watcher() i=7 2023-10-05T21:15:12.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.579+0000 7f80a2235680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:12.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.579+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240ffec0 con 0x55bd240c3b50 2023-10-05T21:15:12.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.579+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.579+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94270842214592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240ffec0 con 0x55bd240c3b50 2023-10-05T21:15:12.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.580+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94270842214592] v29'50 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.580+0000 7f80667e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:12.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.580+0000 7f80a2235680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:12.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.580+0000 7f80a2235680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:12.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.580+0000 7f80a2235680 1 Processor -- start 2023-10-05T21:15:12.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.580+0000 7f80a2235680 1 -- start start 2023-10-05T21:15:12.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.580+0000 7f80a2235680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55bd2410ea20 0x55bd2410ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.580+0000 7f80a2235680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd2410f440 con 0x55bd2410ea20 2023-10-05T21:15:12.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.580+0000 7f8094b0c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55bd2410ea20 0x55bd2410ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.580+0000 7f8094b0c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55bd2410ea20 0x55bd2410ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49356/0 (socket says 172.21.15.153:49356) 2023-10-05T21:15:12.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.580+0000 7f8094b0c700 1 -- 172.21.15.153:0/2647148638 learned_addr learned my addr 172.21.15.153:0/2647148638 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.581+0000 7f8094b0c700 1 -- 172.21.15.153:0/2647148638 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bd2410f920 con 0x55bd2410ea20 2023-10-05T21:15:12.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.581+0000 7f8094b0c700 1 --2- 172.21.15.153:0/2647148638 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55bd2410ea20 0x55bd2410ee30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55bd240bdef0 tx=0x7f8088012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c867124eac3f8ca server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.581+0000 7f8065fe3700 1 -- 172.21.15.153:0/2647148638 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f808801de90 con 0x55bd2410ea20 2023-10-05T21:15:12.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.581+0000 7f8065fe3700 1 -- 172.21.15.153:0/2647148638 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808802b440 con 0x55bd2410ea20 2023-10-05T21:15:12.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.581+0000 7f8065fe3700 1 -- 172.21.15.153:0/2647148638 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f808802b5f0 con 0x55bd2410ea20 2023-10-05T21:15:12.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.582+0000 7f80a2235680 1 -- 172.21.15.153:0/2647148638 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55bd2410ea20 msgr2=0x55bd2410ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.582+0000 7f80a2235680 1 --2- 172.21.15.153:0/2647148638 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55bd2410ea20 0x55bd2410ee30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55bd240bdef0 tx=0x7f8088012000 comp rx=0 tx=0).stop 2023-10-05T21:15:12.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.582+0000 7f80a2235680 1 -- 172.21.15.153:0/2647148638 shutdown_connections 2023-10-05T21:15:12.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.582+0000 7f80a2235680 1 --2- 172.21.15.153:0/2647148638 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55bd2410ea20 0x55bd2410ee30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.582+0000 7f80a2235680 1 -- 172.21.15.153:0/2647148638 >> 172.21.15.153:0/2647148638 conn(0x55bd2410ad20 msgr2=0x55bd24108e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.582+0000 7f80a2235680 1 -- 172.21.15.153:0/2647148638 shutdown_connections 2023-10-05T21:15:12.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.582+0000 7f80a2235680 1 -- 172.21.15.153:0/2647148638 wait complete. 2023-10-05T21:15:12.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.582+0000 7f80a2235680 1 Processor -- start 2023-10-05T21:15:12.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.582+0000 7f80a2235680 1 -- start start 2023-10-05T21:15:12.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.582+0000 7f80a2235680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55bd2410ea20 0x55bd24115740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.582+0000 7f80a2235680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd24115c80 con 0x55bd2410ea20 2023-10-05T21:15:12.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.582+0000 7f8094b0c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55bd2410ea20 0x55bd24115740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.582+0000 7f8094b0c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55bd2410ea20 0x55bd24115740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49364/0 (socket says 172.21.15.153:49364) 2023-10-05T21:15:12.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.583+0000 7f8094b0c700 1 -- 172.21.15.153:0/1007794332 learned_addr learned my addr 172.21.15.153:0/1007794332 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.583+0000 7f8094b0c700 1 -- 172.21.15.153:0/1007794332 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bd240c7480 con 0x55bd2410ea20 2023-10-05T21:15:12.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.583+0000 7f8094b0c700 1 --2- 172.21.15.153:0/1007794332 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55bd2410ea20 0x55bd24115740 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55bd2410a290 tx=0x7f8088030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.583+0000 7f7fd7fff700 1 -- 172.21.15.153:0/1007794332 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8088048440 con 0x55bd2410ea20 2023-10-05T21:15:12.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.583+0000 7f7fd7fff700 1 -- 172.21.15.153:0/1007794332 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80880485a0 con 0x55bd2410ea20 2023-10-05T21:15:12.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.583+0000 7f7fd7fff700 1 -- 172.21.15.153:0/1007794332 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8088048750 con 0x55bd2410ea20 2023-10-05T21:15:12.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.583+0000 7f80a2235680 1 -- 172.21.15.153:0/1007794332 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bd24115e80 con 0x55bd2410ea20 2023-10-05T21:15:12.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.583+0000 7f80a2235680 1 -- 172.21.15.153:0/1007794332 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bd241162d0 con 0x55bd2410ea20 2023-10-05T21:15:12.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.584+0000 7f7fd7fff700 1 -- 172.21.15.153:0/1007794332 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f8088051440 con 0x55bd2410ea20 2023-10-05T21:15:12.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.584+0000 7f7fd7fff700 1 --2- 172.21.15.153:0/1007794332 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7fdc034140 0x7f7fdc0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.584+0000 7f7fd7fff700 1 -- 172.21.15.153:0/1007794332 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f8088030070 con 0x55bd2410ea20 2023-10-05T21:15:12.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.584+0000 7f80a2235680 5 note: GC not initialized 2023-10-05T21:15:12.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.584+0000 7f8095b0e700 1 --2- 172.21.15.153:0/1007794332 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7fdc034140 0x7f7fdc0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.584+0000 7f8095b0e700 1 --2- 172.21.15.153:0/1007794332 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7fdc034140 0x7f7fdc0365f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x55bd24101d10 tx=0x7f8090037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.585+0000 7f7fd57fa700 20 reqs_thread_entry: start 2023-10-05T21:15:12.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.585+0000 7f7fceffd700 20 reqs_thread_entry: start 2023-10-05T21:15:12.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.585+0000 7f80a2235680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:12.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.585+0000 7f80a2235680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:12.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.585+0000 7f7fcd7fa700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:42 2023 2023-10-05T21:15:12.621 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:12.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.585+0000 7f7fccff9700 20 reqs_thread_entry: start 2023-10-05T21:15:12.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.585+0000 7f80a2235680 20 get_system_obj_state: rctx=0x7ffd47699db8 obj=default.rgw.meta:users.uid:foo state=0x55bd23f70240 s->prefetch_data=0 2023-10-05T21:15:12.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.585+0000 7f80a2235680 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T21:15:12.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.585+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd2417b130 con 0x55bd240c3b50 2023-10-05T21:15:12.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.586+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call,getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.586+0000 7f80a2235680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2023-10-05T21:15:12.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.586+0000 7f80a2235680 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:12.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.586+0000 7f80a2235680 20 get_system_obj_state: rctx=0x7ffd47699aa8 obj=default.rgw.meta:users.email:foo@foo.com state=0x55bd23f70240 s->prefetch_data=0 2023-10-05T21:15:12.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.586+0000 7f80a2235680 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2023-10-05T21:15:12.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.586+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.3 8:c162d5d1:users.email::foo@foo.com:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd2417a120 con 0x55bd240c3b50 2023-10-05T21:15:12.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.586+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo@foo.com [getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 197+0+0 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.586+0000 7f80a2235680 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2023-10-05T21:15:12.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.586+0000 7f80a2235680 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2023-10-05T21:15:12.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.586+0000 7f80a2235680 20 get_system_obj_state: rctx=0x7ffd47699aa8 obj=default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1 state=0x55bd23f70240 s->prefetch_data=0 2023-10-05T21:15:12.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.586+0000 7f80a2235680 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2023-10-05T21:15:12.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.586+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:104 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd2417a120 con 0x7f8088007030 2023-10-05T21:15:12.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.587+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(104 9te6NH5mcdcq0Tc5i8i1 [getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f809000a570 con 0x7f8088007030 2023-10-05T21:15:12.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.587+0000 7f80a2235680 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2023-10-05T21:15:12.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.587+0000 7f80a2235680 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2023-10-05T21:15:12.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.587+0000 7f80a2235680 20 get_system_obj_state: rctx=0x7ffd47699338 obj=default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1 state=0x55bd23f70240 s->prefetch_data=0 2023-10-05T21:15:12.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.587+0000 7f80a2235680 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2023-10-05T21:15:12.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.587+0000 7f80a2235680 20 get_system_obj_state: rctx=0x7ffd476999e8 obj=default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1 state=0x55bd23f70240 s->prefetch_data=0 2023-10-05T21:15:12.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.587+0000 7f80a2235680 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2023-10-05T21:15:12.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.587+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:105 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd2417d8f0 con 0x55bd240c3b50 2023-10-05T21:15:12.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.588+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(105 foo [delete,create,call,writefull 0~357] v29'1 uv1 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.588+0000 7f80a2235680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T21:15:12.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.588+0000 7f80a2235680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:12.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.588+0000 7f80a2235680 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T21:15:12.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.588+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [notify cookie 94270842720992 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd2417e590 con 0x55bd240c3b50 2023-10-05T21:15:12.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.588+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== watch-notify(notify (1) cookie 94270842204624 notify 124554051584 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x7f8090029040 con 0x55bd240c3b50 2023-10-05T21:15:12.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.588+0000 7f8086ffd700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051584 cookie 94270842204624 notifier 4274 bl.length()=533 2023-10-05T21:15:12.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.588+0000 7f8086ffd700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T21:15:12.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.588+0000 7f8086ffd700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:12.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.588+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(106 notify.4 [notify cookie 94270842720992 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.588+0000 7f8086ffd700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f8074003d90 con 0x55bd240c3b50 2023-10-05T21:15:12.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.588+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(107 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.588+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== watch-notify(notify_complete (2) cookie 94270842720992 notify 124554051584 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f809002d040 con 0x55bd240c3b50 2023-10-05T21:15:12.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.588+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:108 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd2417d2e0 con 0x55bd240c3b50 2023-10-05T21:15:12.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.589+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 42 ==== osd_op_reply(108 foo@foo.com [delete,create,writefull 0~7] v29'1 uv1 ondisk = 0) v8 ==== 239+0+0 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.589+0000 7f80a2235680 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2023-10-05T21:15:12.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.589+0000 7f80a2235680 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2023-10-05T21:15:12.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.589+0000 7f80a2235680 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2023-10-05T21:15:12.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.589+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [notify cookie 94270842720992 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd2417e9d0 con 0x7f808c017540 2023-10-05T21:15:12.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.590+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== watch-notify(notify (1) cookie 94270842201472 notify 124554051584 ret 0) v3 ==== 211+0+0 (crc 0 0 0) 0x55bd241162d0 con 0x7f808c017540 2023-10-05T21:15:12.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.590+0000 7f80867fc700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051584 cookie 94270842201472 notifier 4274 bl.length()=169 2023-10-05T21:15:12.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.590+0000 7f80867fc700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2023-10-05T21:15:12.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.590+0000 7f80867fc700 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2023-10-05T21:15:12.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.590+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(109 notify.3 [notify cookie 94270842720992 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f8088033040 con 0x7f808c017540 2023-10-05T21:15:12.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.590+0000 7f80867fc700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:110 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f7fe4003450 con 0x7f808c017540 2023-10-05T21:15:12.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.590+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(110 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8088033040 con 0x7f808c017540 2023-10-05T21:15:12.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.590+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== watch-notify(notify_complete (2) cookie 94270842720992 notify 124554051584 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55bd24115e80 con 0x7f808c017540 2023-10-05T21:15:12.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.590+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:111 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd2417d2e0 con 0x7f8088007030 2023-10-05T21:15:12.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.591+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(111 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v29'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f809000a570 con 0x7f8088007030 2023-10-05T21:15:12.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.591+0000 7f80a2235680 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2023-10-05T21:15:12.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.591+0000 7f80a2235680 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2023-10-05T21:15:12.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.591+0000 7f80a2235680 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2023-10-05T21:15:12.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.591+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:112 7.e 7:7759931f:::notify.3:head [notify cookie 94270842720992 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd2417e050 con 0x7f808c017540 2023-10-05T21:15:12.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.591+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== watch-notify(notify (1) cookie 94270842201472 notify 124554051585 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x55bd24115e80 con 0x7f808c017540 2023-10-05T21:15:12.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.591+0000 7f80867fc700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051585 cookie 94270842201472 notifier 4274 bl.length()=177 2023-10-05T21:15:12.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.591+0000 7f80867fc700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2023-10-05T21:15:12.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.591+0000 7f80867fc700 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2023-10-05T21:15:12.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.591+0000 7f80867fc700 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:113 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f7fe40034c0 con 0x7f808c017540 2023-10-05T21:15:12.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.591+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 <== osd.2 v2:172.21.15.153:6807/140454 22 ==== osd_op_reply(112 notify.3 [notify cookie 94270842720992 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f8088033040 con 0x7f808c017540 2023-10-05T21:15:12.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.591+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 <== osd.2 v2:172.21.15.153:6807/140454 23 ==== watch-notify(notify_complete (2) cookie 94270842720992 notify 124554051585 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f808804c030 con 0x7f808c017540 2023-10-05T21:15:12.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.591+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 <== osd.2 v2:172.21.15.153:6807/140454 24 ==== osd_op_reply(113 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8088033040 con 0x7f808c017540 2023-10-05T21:15:12.628 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:12.628 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "foo", 2023-10-05T21:15:12.628 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Foo", 2023-10-05T21:15:12.628 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "foo@foo.com", 2023-10-05T21:15:12.628 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2023-10-05T21:15:12.628 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 4, 2023-10-05T21:15:12.629 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [], 2023-10-05T21:15:12.629 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2023-10-05T21:15:12.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:12.629 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:12.629 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:12.629 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T21:15:12.629 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:12.629 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:12.629 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [], 2023-10-05T21:15:12.629 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2023-10-05T21:15:12.630 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2023-10-05T21:15:12.630 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2023-10-05T21:15:12.630 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2023-10-05T21:15:12.630 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2023-10-05T21:15:12.630 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:15:12.630 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:12.630 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:12.630 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:12.630 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:12.631 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:12.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:12.631 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2023-10-05T21:15:12.631 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:12.631 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:12.631 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:12.631 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:12.631 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:12.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:12.631 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2023-10-05T21:15:12.632 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2023-10-05T21:15:12.632 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [] 2023-10-05T21:15:12.632 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:12.632 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:15:12.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.592+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:114 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94270842189104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd2417ba10 con 0x7f808c017540 2023-10-05T21:15:12.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.592+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 <== osd.2 v2:172.21.15.153:6807/140454 25 ==== osd_op_reply(114 notify.0 [watch unwatch cookie 94270842189104] v29'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8088033040 con 0x7f808c017540 2023-10-05T21:15:12.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.592+0000 7f80a2235680 20 remove_watcher() i=0 2023-10-05T21:15:12.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.592+0000 7f80a2235680 2 removed watcher, disabling cache 2023-10-05T21:15:12.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.592+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:115 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94270842194752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240fb530 con 0x55bd240c3b50 2023-10-05T21:15:12.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.593+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 43 ==== osd_op_reply(115 notify.1 [watch unwatch cookie 94270842194752] v29'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.593+0000 7f80a2235680 20 remove_watcher() i=1 2023-10-05T21:15:12.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.593+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:116 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94270842199056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240fcb40 con 0x55bd240f4270 2023-10-05T21:15:12.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.594+0000 7f809530d700 1 -- 172.21.15.153:0/1075062210 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(116 notify.2 [watch unwatch cookie 94270842199056] v29'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f808c016070 con 0x55bd240f4270 2023-10-05T21:15:12.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.594+0000 7f80a2235680 20 remove_watcher() i=2 2023-10-05T21:15:12.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.594+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:117 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94270842201472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240fcb40 con 0x7f808c017540 2023-10-05T21:15:12.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.594+0000 7f8094b0c700 1 -- 172.21.15.153:0/1075062210 <== osd.2 v2:172.21.15.153:6807/140454 26 ==== osd_op_reply(117 notify.3 [watch unwatch cookie 94270842201472] v29'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8088033040 con 0x7f808c017540 2023-10-05T21:15:12.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.594+0000 7f80a2235680 20 remove_watcher() i=3 2023-10-05T21:15:12.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.594+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:118 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94270842204624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240fcb40 con 0x55bd240c3b50 2023-10-05T21:15:12.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.595+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 44 ==== osd_op_reply(118 notify.4 [watch unwatch cookie 94270842204624] v29'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.595+0000 7f80a2235680 20 remove_watcher() i=4 2023-10-05T21:15:12.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.595+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:119 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94270842206832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240ff1d0 con 0x7f8088007030 2023-10-05T21:15:12.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.596+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(119 notify.5 [watch unwatch cookie 94270842206832] v29'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f809000a570 con 0x7f8088007030 2023-10-05T21:15:12.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.596+0000 7f80a2235680 20 remove_watcher() i=5 2023-10-05T21:15:12.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.596+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:120 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94270842210704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240fcb40 con 0x7f8088007030 2023-10-05T21:15:12.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.597+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(120 notify.6 [watch unwatch cookie 94270842210704] v29'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f809000a570 con 0x7f8088007030 2023-10-05T21:15:12.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.597+0000 7f80a2235680 20 remove_watcher() i=6 2023-10-05T21:15:12.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.597+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:121 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94270842213488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240ffa70 con 0x7f8088007030 2023-10-05T21:15:12.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.597+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.0 v2:172.21.15.111:6800/111394 31 ==== osd_op_reply(121 notify.7 [watch unwatch cookie 94270842213488] v29'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f809000a570 con 0x7f8088007030 2023-10-05T21:15:12.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.597+0000 7f80a2235680 20 remove_watcher() i=7 2023-10-05T21:15:12.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.598+0000 7f80667e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:12.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.598+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:122 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94270842214592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55bd240ff1d0 con 0x55bd240c3b50 2023-10-05T21:15:12.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.599+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 <== osd.1 v2:172.21.15.153:6816/140456 45 ==== osd_op_reply(122 data_loggenerations_metadata [watch unwatch cookie 94270842214592] v29'51 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f809000a570 con 0x55bd240c3b50 2023-10-05T21:15:12.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.599+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f8088007030 msgr2=0x7f808801d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.599+0000 7f80a2235680 1 --2- 172.21.15.153:0/1075062210 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f8088007030 0x7f808801d420 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.599+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55bd240c3b50 msgr2=0x55bd240f1e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.599+0000 7f80a2235680 1 --2- 172.21.15.153:0/1075062210 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55bd240c3b50 0x55bd240f1e00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.599+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f808c017540 msgr2=0x7f808c0481c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.599+0000 7f80a2235680 1 --2- 172.21.15.153:0/1075062210 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f808c017540 0x7f808c0481c0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.599+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55bd240f4270 msgr2=0x55bd240f6650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.599+0000 7f80a2235680 1 --2- 172.21.15.153:0/1075062210 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55bd240f4270 0x55bd240f6650 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.599+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8078034130 msgr2=0x7f80780365e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.599+0000 7f80a2235680 1 --2- 172.21.15.153:0/1075062210 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8078034130 0x7f80780365e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8088005b50 tx=0x7f8088015000 comp rx=0 tx=0).stop 2023-10-05T21:15:12.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.599+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55bd24031040 msgr2=0x55bd240e6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.599+0000 7f80a2235680 1 --2- 172.21.15.153:0/1075062210 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55bd24031040 0x55bd240e6010 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f808c003000 tx=0x7f808c016000 comp rx=0 tx=0).stop 2023-10-05T21:15:12.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.599+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 reap_dead start 2023-10-05T21:15:12.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.599+0000 7f8095b0e700 1 -- 172.21.15.153:0/1075062210 reap_dead start 2023-10-05T21:15:12.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.599+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 shutdown_connections 2023-10-05T21:15:12.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.599+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 >> 172.21.15.153:0/1075062210 conn(0x55bd240b7b20 msgr2=0x55bd240d8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.599+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 shutdown_connections 2023-10-05T21:15:12.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.599+0000 7f80a2235680 1 -- 172.21.15.153:0/1075062210 wait complete. 2023-10-05T21:15:12.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.599+0000 7f80a2235680 1 -- 172.21.15.153:0/1007794332 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7fdc034140 msgr2=0x7f7fdc0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.599+0000 7f80a2235680 1 --2- 172.21.15.153:0/1007794332 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7fdc034140 0x7f7fdc0365f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x55bd24101d10 tx=0x7f8090037450 comp rx=0 tx=0).stop 2023-10-05T21:15:12.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.599+0000 7f80a2235680 1 -- 172.21.15.153:0/1007794332 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55bd2410ea20 msgr2=0x55bd24115740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.599+0000 7f80a2235680 1 --2- 172.21.15.153:0/1007794332 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55bd2410ea20 0x55bd24115740 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55bd2410a290 tx=0x7f8088030000 comp rx=0 tx=0).stop 2023-10-05T21:15:12.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.599+0000 7f80a2235680 1 -- 172.21.15.153:0/1007794332 shutdown_connections 2023-10-05T21:15:12.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.599+0000 7f80a2235680 1 --2- 172.21.15.153:0/1007794332 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7fdc034140 0x7f7fdc0365f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.599+0000 7f80a2235680 1 --2- 172.21.15.153:0/1007794332 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55bd2410ea20 0x55bd24115740 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.599+0000 7f80a2235680 1 -- 172.21.15.153:0/1007794332 >> 172.21.15.153:0/1007794332 conn(0x55bd2410ad20 msgr2=0x55bd24108df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.600+0000 7f80a2235680 1 -- 172.21.15.153:0/1007794332 shutdown_connections 2023-10-05T21:15:12.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.600+0000 7f80a2235680 1 -- 172.21.15.153:0/1007794332 wait complete. 2023-10-05T21:15:12.643 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:15:12.643 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2023-10-05T21:15:12.643 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2023-10-05T21:15:12.643 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2023-10-05T21:15:12.692 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:12.692 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:12.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.691+0000 7fc64a987680 1 Processor -- start 2023-10-05T21:15:12.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.691+0000 7fc64a987680 1 -- start start 2023-10-05T21:15:12.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.691+0000 7fc64a987680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55e00d972780 0x55e00d974b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.691+0000 7fc64a987680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e00d8bc930 con 0x55e00d96e250 2023-10-05T21:15:12.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.691+0000 7fc64a987680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e00d87cdb0 con 0x55e00d972780 2023-10-05T21:15:12.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.691+0000 7fc63d25e700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55e00d972780 0x55e00d974b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.691+0000 7fc63da5f700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55e00d96e250 0x55e00d96e660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56214/0 (socket says 172.21.15.153:56214) 2023-10-05T21:15:12.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.691+0000 7fc63d25e700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55e00d972780 0x55e00d974b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49376/0 (socket says 172.21.15.153:49376) 2023-10-05T21:15:12.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.691+0000 7fc63da5f700 1 -- 172.21.15.153:0/880671429 learned_addr learned my addr 172.21.15.153:0/880671429 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:12.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.691+0000 7fc63d25e700 1 -- 172.21.15.153:0/880671429 >> v1:172.21.15.111:6789/0 conn(0x55e00d96e250 legacy=0x55e00d96e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.692+0000 7fc63d25e700 1 -- 172.21.15.153:0/880671429 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e00d9760b0 con 0x55e00d972780 2023-10-05T21:15:12.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.692+0000 7fc63d25e700 1 --2- 172.21.15.153:0/880671429 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e00d972780 0x55e00d974b60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc63400a6a0 tx=0x7fc634005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17b89ccc53d23a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.692+0000 7fc63ca5d700 1 -- 172.21.15.153:0/880671429 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc63400f070 con 0x55e00d972780 2023-10-05T21:15:12.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.692+0000 7fc63ca5d700 1 -- 172.21.15.153:0/880671429 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63400a2e0 con 0x55e00d972780 2023-10-05T21:15:12.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.692+0000 7fc63ca5d700 1 -- 172.21.15.153:0/880671429 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc6340085b0 con 0x55e00d972780 2023-10-05T21:15:12.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.692+0000 7fc64a987680 1 -- 172.21.15.153:0/880671429 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e00d972780 msgr2=0x55e00d974b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.692+0000 7fc64a987680 1 --2- 172.21.15.153:0/880671429 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e00d972780 0x55e00d974b60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc63400a6a0 tx=0x7fc634005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:12.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.692+0000 7fc64a987680 1 -- 172.21.15.153:0/880671429 shutdown_connections 2023-10-05T21:15:12.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.692+0000 7fc64a987680 1 --2- 172.21.15.153:0/880671429 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e00d972780 0x55e00d974b60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.692+0000 7fc64a987680 1 -- 172.21.15.153:0/880671429 >> 172.21.15.153:0/880671429 conn(0x55e00d969b20 msgr2=0x55e00d96bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.692+0000 7fc64a987680 1 -- 172.21.15.153:0/880671429 shutdown_connections 2023-10-05T21:15:12.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.692+0000 7fc64a987680 1 -- 172.21.15.153:0/880671429 wait complete. 2023-10-05T21:15:12.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.693+0000 7fc64a987680 1 Processor -- start 2023-10-05T21:15:12.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.693+0000 7fc64a987680 1 -- start start 2023-10-05T21:15:12.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.693+0000 7fc64a987680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e00d96e250 0x55e00d98c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.693+0000 7fc64a987680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00d81cea0 con 0x55e00d96e250 2023-10-05T21:15:12.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.693+0000 7fc63da5f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e00d96e250 0x55e00d98c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.693+0000 7fc63da5f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e00d96e250 0x55e00d98c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49378/0 (socket says 172.21.15.153:49378) 2023-10-05T21:15:12.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.693+0000 7fc63da5f700 1 -- 172.21.15.153:0/3815623306 learned_addr learned my addr 172.21.15.153:0/3815623306 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.694+0000 7fc63da5f700 1 -- 172.21.15.153:0/3815623306 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc634005cf0 con 0x55e00d96e250 2023-10-05T21:15:12.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.694+0000 7fc63da5f700 1 --2- 172.21.15.153:0/3815623306 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e00d96e250 0x55e00d98c650 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc630001c30 tx=0x7fc6300017e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddeee66066f56d88 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.694+0000 7fc62f7fe700 1 -- 172.21.15.153:0/3815623306 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc63000bbf0 con 0x55e00d96e250 2023-10-05T21:15:12.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.694+0000 7fc62f7fe700 1 -- 172.21.15.153:0/3815623306 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63000bd50 con 0x55e00d96e250 2023-10-05T21:15:12.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.694+0000 7fc62f7fe700 1 -- 172.21.15.153:0/3815623306 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc63000e470 con 0x55e00d96e250 2023-10-05T21:15:12.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.694+0000 7fc64a987680 1 -- 172.21.15.153:0/3815623306 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e00d96e250 msgr2=0x55e00d98c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.694+0000 7fc64a987680 1 --2- 172.21.15.153:0/3815623306 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e00d96e250 0x55e00d98c650 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc630001c30 tx=0x7fc6300017e0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.694+0000 7fc64a987680 1 -- 172.21.15.153:0/3815623306 shutdown_connections 2023-10-05T21:15:12.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.694+0000 7fc64a987680 1 --2- 172.21.15.153:0/3815623306 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e00d96e250 0x55e00d98c650 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.694+0000 7fc64a987680 1 -- 172.21.15.153:0/3815623306 >> 172.21.15.153:0/3815623306 conn(0x55e00d969b20 msgr2=0x55e00d988120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.694+0000 7fc64a987680 1 -- 172.21.15.153:0/3815623306 shutdown_connections 2023-10-05T21:15:12.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.694+0000 7fc64a987680 1 -- 172.21.15.153:0/3815623306 wait complete. 2023-10-05T21:15:12.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.695+0000 7fc64a987680 1 Processor -- start 2023-10-05T21:15:12.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.695+0000 7fc64a987680 1 -- start start 2023-10-05T21:15:12.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.695+0000 7fc64a987680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e00d96e250 0x55e00d993b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.695+0000 7fc64a987680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00d813c80 con 0x55e00d96e250 2023-10-05T21:15:12.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.695+0000 7fc63da5f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e00d96e250 0x55e00d993b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.695+0000 7fc63da5f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e00d96e250 0x55e00d993b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49382/0 (socket says 172.21.15.153:49382) 2023-10-05T21:15:12.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.695+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 learned_addr learned my addr 172.21.15.153:0/2562698142 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.695+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e00d8bc930 con 0x55e00d96e250 2023-10-05T21:15:12.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.695+0000 7fc63da5f700 1 --2- 172.21.15.153:0/2562698142 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e00d96e250 0x55e00d993b70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc630001820 tx=0x7fc630016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.695+0000 7fc62dffb700 1 -- 172.21.15.153:0/2562698142 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc63001f070 con 0x55e00d96e250 2023-10-05T21:15:12.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.695+0000 7fc62dffb700 1 -- 172.21.15.153:0/2562698142 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc630019690 con 0x55e00d96e250 2023-10-05T21:15:12.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.696+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e00d9940b0 con 0x55e00d96e250 2023-10-05T21:15:12.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.696+0000 7fc62dffb700 1 -- 172.21.15.153:0/2562698142 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc630019860 con 0x55e00d96e250 2023-10-05T21:15:12.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.696+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e00d994580 con 0x55e00d96e250 2023-10-05T21:15:12.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.696+0000 7fc62dffb700 1 -- 172.21.15.153:0/2562698142 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fc630022020 con 0x55e00d96e250 2023-10-05T21:15:12.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.697+0000 7fc64a987680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.697+0000 7fc62dffb700 1 --2- 172.21.15.153:0/2562698142 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc620034130 0x7fc6200365e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.697+0000 7fc62dffb700 1 -- 172.21.15.153:0/2562698142 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fc630048b60 con 0x55e00d96e250 2023-10-05T21:15:12.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.697+0000 7fc63d25e700 1 --2- 172.21.15.153:0/2562698142 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc620034130 0x7fc6200365e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.697+0000 7fc64a987680 1 --2- 172.21.15.153:0/2562698142 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55e00d972780 0x55e00d99f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.697+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a00e0 con 0x55e00d972780 2023-10-05T21:15:12.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.697+0000 7fc63e260700 1 --2- 172.21.15.153:0/2562698142 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55e00d972780 0x55e00d99f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.697+0000 7fc63d25e700 1 --2- 172.21.15.153:0/2562698142 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc620034130 0x7fc6200365e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc63400c080 tx=0x7fc634018000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.697+0000 7fc63e260700 1 --2- 172.21.15.153:0/2562698142 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55e00d972780 0x55e00d99f950 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.698+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.698+0000 7fc64a987680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.698+0000 7fc64a987680 20 realm 2023-10-05T21:15:12.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.698+0000 7fc64a987680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.698+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d99cf30 con 0x55e00d972780 2023-10-05T21:15:12.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.698+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.698+0000 7fc64a987680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.698+0000 7fc64a987680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:12.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.698+0000 7fc64a987680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.698+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a0be0 con 0x55e00d972780 2023-10-05T21:15:12.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.698+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.698+0000 7fc64a987680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.698+0000 7fc64a987680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.698+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a1500 con 0x55e00d972780 2023-10-05T21:15:12.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.698+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.698+0000 7fc64a987680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.698+0000 7fc64a987680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.698+0000 7fc64a987680 1 --2- 172.21.15.153:0/2562698142 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55e00d9a1dc0 0x55e00d9a41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.698+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a47f0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.698+0000 7fc63da5f700 1 --2- 172.21.15.153:0/2562698142 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55e00d9a1dc0 0x55e00d9a41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.699+0000 7fc63da5f700 1 --2- 172.21.15.153:0/2562698142 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55e00d9a1dc0 0x55e00d9a41a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.699+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc6300173e0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.699+0000 7fc64a987680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:12.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.699+0000 7fc64a987680 20 searching for the correct realm 2023-10-05T21:15:12.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.699+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x55e00d9a1dc0 2023-10-05T21:15:12.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.699+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc6300173e0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.699+0000 7fc63da5f700 1 --2- 172.21.15.153:0/2562698142 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc630041c30 0x7fc6300414d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.699+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x7fc630041c30 2023-10-05T21:15:12.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.699+0000 7fc63d25e700 1 --2- 172.21.15.153:0/2562698142 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc630041c30 0x7fc6300414d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.700+0000 7fc63d25e700 1 --2- 172.21.15.153:0/2562698142 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc630041c30 0x7fc6300414d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.700+0000 7fc63d25e700 1 -- 172.21.15.153:0/2562698142 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc634009ac0 con 0x7fc630041c30 2023-10-05T21:15:12.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.700+0000 7fc63d25e700 1 --2- 172.21.15.153:0/2562698142 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc63401d410 0x7fc63401d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.700+0000 7fc63d25e700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x7fc63401d410 2023-10-05T21:15:12.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.700+0000 7fc63e260700 1 --2- 172.21.15.153:0/2562698142 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc63401d410 0x7fc63401d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.700+0000 7fc63e260700 1 --2- 172.21.15.153:0/2562698142 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc63401d410 0x7fc63401d880 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.701+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc63800a570 con 0x7fc63401d410 2023-10-05T21:15:12.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.701+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x55e00d972780 2023-10-05T21:15:12.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.701+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.701+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x55e00d972780 2023-10-05T21:15:12.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.701+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.701+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x7fc63401d410 2023-10-05T21:15:12.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.701+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc63800a570 con 0x7fc63401d410 2023-10-05T21:15:12.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.701+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x7fc63401d410 2023-10-05T21:15:12.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.701+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc63800a570 con 0x7fc63401d410 2023-10-05T21:15:12.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.701+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x7fc630041c30 2023-10-05T21:15:12.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.702+0000 7fc63d25e700 1 -- 172.21.15.153:0/2562698142 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc634009ac0 con 0x7fc630041c30 2023-10-05T21:15:12.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.702+0000 7fc63d25e700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x55e00d9a1dc0 2023-10-05T21:15:12.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.702+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc6300173e0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.702+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x55e00d972780 2023-10-05T21:15:12.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.702+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.702+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x7fc63401d410 2023-10-05T21:15:12.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.702+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc63800a570 con 0x7fc63401d410 2023-10-05T21:15:12.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.702+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x55e00d972780 2023-10-05T21:15:12.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.702+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.702+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x7fc630041c30 2023-10-05T21:15:12.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.703+0000 7fc63d25e700 1 -- 172.21.15.153:0/2562698142 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc634009ac0 con 0x7fc630041c30 2023-10-05T21:15:12.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.703+0000 7fc63d25e700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x55e00d9a1dc0 2023-10-05T21:15:12.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.703+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc6300173e0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.703+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x55e00d9a1dc0 2023-10-05T21:15:12.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.703+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc6300173e0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.703+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x7fc63401d410 2023-10-05T21:15:12.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.703+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc63800a570 con 0x7fc63401d410 2023-10-05T21:15:12.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.703+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x55e00d9a1dc0 2023-10-05T21:15:12.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.703+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc6300173e0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.704+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x55e00d9a1dc0 2023-10-05T21:15:12.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.704+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc6300173e0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.704+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x55e00d972780 2023-10-05T21:15:12.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.704+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.704+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x55e00d972780 2023-10-05T21:15:12.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.704+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.704+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x7fc63401d410 2023-10-05T21:15:12.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.704+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc63800a570 con 0x7fc63401d410 2023-10-05T21:15:12.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.704+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x55e00d9a1dc0 2023-10-05T21:15:12.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.705+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc6300173e0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.705+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x7fc630041c30 2023-10-05T21:15:12.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.705+0000 7fc63d25e700 1 -- 172.21.15.153:0/2562698142 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc634009ac0 con 0x7fc630041c30 2023-10-05T21:15:12.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.705+0000 7fc63d25e700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x55e00d972780 2023-10-05T21:15:12.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.705+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.705+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x7fc63401d410 2023-10-05T21:15:12.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.705+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc63800a570 con 0x7fc63401d410 2023-10-05T21:15:12.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.705+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x55e00d9a1dc0 2023-10-05T21:15:12.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.705+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc6300173e0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.705+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x7fc63401d410 2023-10-05T21:15:12.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.706+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc63800a570 con 0x7fc63401d410 2023-10-05T21:15:12.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.706+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x7fc630041c30 2023-10-05T21:15:12.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.706+0000 7fc63d25e700 1 -- 172.21.15.153:0/2562698142 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc634009ac0 con 0x7fc630041c30 2023-10-05T21:15:12.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.706+0000 7fc63d25e700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x55e00d9a1dc0 2023-10-05T21:15:12.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.706+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc6300173e0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.706+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x7fc63401d410 2023-10-05T21:15:12.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.707+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc63800a570 con 0x7fc63401d410 2023-10-05T21:15:12.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.707+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x55e00d972780 2023-10-05T21:15:12.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.707+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.707+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6360 con 0x7fc630041c30 2023-10-05T21:15:12.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.707+0000 7fc63d25e700 1 -- 172.21.15.153:0/2562698142 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc634009ac0 con 0x7fc630041c30 2023-10-05T21:15:12.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.707+0000 7fc64a987680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:12.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.707+0000 7fc64a987680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:12.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.707+0000 7fc64a987680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:12.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.707+0000 7fc64a987680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:12.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.707+0000 7fc64a987680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.707+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a52b0 con 0x55e00d972780 2023-10-05T21:15:12.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.707+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.707+0000 7fc64a987680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.707+0000 7fc64a987680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.707+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a56b0 con 0x55e00d972780 2023-10-05T21:15:12.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.707+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.707+0000 7fc64a987680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.707+0000 7fc64a987680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.707+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a67f0 con 0x55e00d972780 2023-10-05T21:15:12.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.708+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.708+0000 7fc64a987680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:12.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.708+0000 7fc64a987680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.708+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6ba0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.708+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fc6300173e0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.708+0000 7fc64a987680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.708+0000 7fc64a987680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.708+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6f50 con 0x55e00d972780 2023-10-05T21:15:12.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.708+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.708+0000 7fc64a987680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.708+0000 7fc64a987680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.708+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6f50 con 0x55e00d972780 2023-10-05T21:15:12.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.708+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.708+0000 7fc64a987680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.708+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6f50 con 0x55e00d9a1dc0 2023-10-05T21:15:12.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.709+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc6300173e0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.709+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6f50 con 0x7fc630041c30 2023-10-05T21:15:12.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.709+0000 7fc63d25e700 1 -- 172.21.15.153:0/2562698142 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc634009ac0 con 0x7fc630041c30 2023-10-05T21:15:12.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.709+0000 7fc63d25e700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6f50 con 0x7fc63401d410 2023-10-05T21:15:12.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.709+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc63800a570 con 0x7fc63401d410 2023-10-05T21:15:12.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.709+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a67f0 con 0x55e00d972780 2023-10-05T21:15:12.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.709+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.709+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a67f0 con 0x55e00d972780 2023-10-05T21:15:12.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.709+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.709+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a67f0 con 0x7fc63401d410 2023-10-05T21:15:12.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.710+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc63800a570 con 0x7fc63401d410 2023-10-05T21:15:12.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.710+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a67f0 con 0x7fc63401d410 2023-10-05T21:15:12.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.710+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc63800a570 con 0x7fc63401d410 2023-10-05T21:15:12.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.710+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a67f0 con 0x7fc630041c30 2023-10-05T21:15:12.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.710+0000 7fc63d25e700 1 -- 172.21.15.153:0/2562698142 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc634009ac0 con 0x7fc630041c30 2023-10-05T21:15:12.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.710+0000 7fc63d25e700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a67f0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.710+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc6300173e0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.710+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a67f0 con 0x55e00d972780 2023-10-05T21:15:12.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.711+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.711+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a67f0 con 0x7fc63401d410 2023-10-05T21:15:12.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.711+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc63800a570 con 0x7fc63401d410 2023-10-05T21:15:12.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.711+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a67f0 con 0x55e00d972780 2023-10-05T21:15:12.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.711+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.711+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a67f0 con 0x7fc630041c30 2023-10-05T21:15:12.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.711+0000 7fc63d25e700 1 -- 172.21.15.153:0/2562698142 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc634009ac0 con 0x7fc630041c30 2023-10-05T21:15:12.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.711+0000 7fc63d25e700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a67f0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.711+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc6300173e0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.711+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a67f0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.712+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc6300173e0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.712+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a67f0 con 0x7fc63401d410 2023-10-05T21:15:12.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.712+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc63800a570 con 0x7fc63401d410 2023-10-05T21:15:12.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.712+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a67f0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.712+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc6300173e0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.712+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a67f0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.712+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc6300173e0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.712+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a67f0 con 0x55e00d972780 2023-10-05T21:15:12.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.712+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.713+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a67f0 con 0x55e00d972780 2023-10-05T21:15:12.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.713+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.713+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a67f0 con 0x7fc63401d410 2023-10-05T21:15:12.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.713+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc63800a570 con 0x7fc63401d410 2023-10-05T21:15:12.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.713+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a67f0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.713+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc6300173e0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.713+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a67f0 con 0x7fc630041c30 2023-10-05T21:15:12.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.713+0000 7fc63d25e700 1 -- 172.21.15.153:0/2562698142 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc634009ac0 con 0x7fc630041c30 2023-10-05T21:15:12.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.713+0000 7fc63d25e700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a67f0 con 0x55e00d972780 2023-10-05T21:15:12.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.714+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.714+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a67f0 con 0x7fc63401d410 2023-10-05T21:15:12.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.714+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc63800a570 con 0x7fc63401d410 2023-10-05T21:15:12.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.714+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a67f0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.714+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc6300173e0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.714+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a67f0 con 0x7fc63401d410 2023-10-05T21:15:12.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.714+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc63800a570 con 0x7fc63401d410 2023-10-05T21:15:12.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.714+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a67f0 con 0x7fc630041c30 2023-10-05T21:15:12.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.715+0000 7fc63d25e700 1 -- 172.21.15.153:0/2562698142 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc634009ac0 con 0x7fc630041c30 2023-10-05T21:15:12.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.715+0000 7fc63d25e700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a67f0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.715+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc6300173e0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.715+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a67f0 con 0x7fc63401d410 2023-10-05T21:15:12.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.715+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc63800a570 con 0x7fc63401d410 2023-10-05T21:15:12.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.715+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a67f0 con 0x55e00d972780 2023-10-05T21:15:12.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.715+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.715+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a67f0 con 0x7fc630041c30 2023-10-05T21:15:12.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.716+0000 7fc63d25e700 1 -- 172.21.15.153:0/2562698142 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc634009ac0 con 0x7fc630041c30 2023-10-05T21:15:12.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.716+0000 7fc64a987680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:12.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.716+0000 7fc64a987680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:12.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.716+0000 7fc64a987680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:12.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.716+0000 7fc64a987680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:12.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.716+0000 7fc64a987680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.716+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a6f50 con 0x55e00d972780 2023-10-05T21:15:12.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.716+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.716+0000 7fc64a987680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.716+0000 7fc64a987680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.716+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a7350 con 0x55e00d9a1dc0 2023-10-05T21:15:12.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.716+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc6300173e0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.716+0000 7fc64a987680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:12.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.716+0000 7fc64a987680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.716+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a4ee0 con 0x55e00d972780 2023-10-05T21:15:12.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.716+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.716+0000 7fc64a987680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.716+0000 7fc64a987680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.716+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a7c70 con 0x55e00d972780 2023-10-05T21:15:12.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.717+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.717+0000 7fc64a987680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:12.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.717+0000 7fc64a987680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.717+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a7c70 con 0x7fc63401d410 2023-10-05T21:15:12.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.717+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fc63800a570 con 0x7fc63401d410 2023-10-05T21:15:12.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.717+0000 7fc64a987680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.717+0000 7fc64a987680 20 zone default found 2023-10-05T21:15:12.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.717+0000 7fc64a987680 4 Realm: () 2023-10-05T21:15:12.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.717+0000 7fc64a987680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:12.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.717+0000 7fc64a987680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:12.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.717+0000 7fc64a987680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:12.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.717+0000 7fc64a987680 20 zonegroup default 2023-10-05T21:15:12.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.717+0000 7fc64a987680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.717+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a7c70 con 0x7fc63401d410 2023-10-05T21:15:12.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.717+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc63800a570 con 0x7fc63401d410 2023-10-05T21:15:12.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.717+0000 7fc64a987680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.717+0000 7fc64a987680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.717+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a95f0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.718+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc6300173e0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.718+0000 7fc64a987680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.718+0000 7fc64a987680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.718+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a99a0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.718+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc6300173e0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.718+0000 7fc64a987680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.718+0000 7fc64a987680 20 started sync module instance, tier type = 2023-10-05T21:15:12.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.718+0000 7fc64a987680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:12.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.718+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a8cb0 con 0x7fc630041c30 2023-10-05T21:15:12.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.719+0000 7fc63d25e700 1 -- 172.21.15.153:0/2562698142 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc634009ac0 con 0x7fc630041c30 2023-10-05T21:15:12.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.719+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94420789268656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9aa240 con 0x7fc630041c30 2023-10-05T21:15:12.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.719+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9aaae0 con 0x55e00d972780 2023-10-05T21:15:12.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.719+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.719+0000 7fc63d25e700 1 -- 172.21.15.153:0/2562698142 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94420789268656] v29'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc634009ac0 con 0x7fc630041c30 2023-10-05T21:15:12.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.719+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94420789274096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9ab050 con 0x55e00d972780 2023-10-05T21:15:12.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.719+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a9d50 con 0x55e00d9a1dc0 2023-10-05T21:15:12.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.720+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc6300173e0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.720+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94420789274096] v29'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.720+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94420789275328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9abbd0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.720+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9ac4d0 con 0x7fc630041c30 2023-10-05T21:15:12.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.721+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94420789275328] v29'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc6300173e0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.721+0000 7fc63d25e700 1 -- 172.21.15.153:0/2562698142 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc634009ac0 con 0x7fc630041c30 2023-10-05T21:15:12.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.721+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94420789278432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9acdc0 con 0x7fc630041c30 2023-10-05T21:15:12.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.721+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9ad660 con 0x55e00d972780 2023-10-05T21:15:12.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.722+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.722+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94420789285824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9ade20 con 0x55e00d972780 2023-10-05T21:15:12.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.722+0000 7fc63d25e700 1 -- 172.21.15.153:0/2562698142 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94420789278432] v29'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc634009ac0 con 0x7fc630041c30 2023-10-05T21:15:12.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.722+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9aea00 con 0x7fc63401d410 2023-10-05T21:15:12.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.722+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94420789285824] v29'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.722+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc63800a570 con 0x7fc63401d410 2023-10-05T21:15:12.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.722+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94420789283104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9ad850 con 0x7fc63401d410 2023-10-05T21:15:12.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.723+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9af020 con 0x7fc63401d410 2023-10-05T21:15:12.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.723+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94420789283104] v29'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc63800a570 con 0x7fc63401d410 2023-10-05T21:15:12.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.723+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc63800a570 con 0x7fc63401d410 2023-10-05T21:15:12.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.723+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94420789290160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9af020 con 0x7fc63401d410 2023-10-05T21:15:12.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.723+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9af8c0 con 0x7fc63401d410 2023-10-05T21:15:12.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.724+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(98 notify.7 [create] v29'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc63800a570 con 0x7fc63401d410 2023-10-05T21:15:12.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.724+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94420789293648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9afda0 con 0x7fc63401d410 2023-10-05T21:15:12.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.724+0000 7fc64a987680 20 add_watcher() i=0 2023-10-05T21:15:12.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.724+0000 7fc64a987680 20 add_watcher() i=1 2023-10-05T21:15:12.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.724+0000 7fc64a987680 20 add_watcher() i=2 2023-10-05T21:15:12.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.724+0000 7fc64a987680 20 add_watcher() i=3 2023-10-05T21:15:12.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.724+0000 7fc64a987680 20 add_watcher() i=4 2023-10-05T21:15:12.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.724+0000 7fc64a987680 20 add_watcher() i=5 2023-10-05T21:15:12.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.724+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(97 notify.6 [watch watch cookie 94420789290160] v29'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc63800a570 con 0x7fc63401d410 2023-10-05T21:15:12.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.724+0000 7fc64a987680 20 add_watcher() i=6 2023-10-05T21:15:12.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.724+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94420789293648] v29'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc63800a570 con 0x7fc63401d410 2023-10-05T21:15:12.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.724+0000 7fc64a987680 20 add_watcher() i=7 2023-10-05T21:15:12.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.724+0000 7fc64a987680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:12.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.725+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9aeb30 con 0x55e00d972780 2023-10-05T21:15:12.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.725+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.725+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94420789295088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9aeb30 con 0x55e00d972780 2023-10-05T21:15:12.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.725+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94420789295088] v29'52 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.726+0000 7fc60efe5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:12.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.726+0000 7fc64a987680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:12.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.726+0000 7fc64a987680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:12.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.726+0000 7fc64a987680 1 Processor -- start 2023-10-05T21:15:12.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.726+0000 7fc64a987680 1 -- start start 2023-10-05T21:15:12.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.726+0000 7fc64a987680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e00d9bc9a0 0x55e00d9bcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.726+0000 7fc64a987680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00d9bd3c0 con 0x55e00d9bc9a0 2023-10-05T21:15:12.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.726+0000 7fc63d25e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e00d9bc9a0 0x55e00d9bcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.726+0000 7fc63d25e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e00d9bc9a0 0x55e00d9bcdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49396/0 (socket says 172.21.15.153:49396) 2023-10-05T21:15:12.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.726+0000 7fc63d25e700 1 -- 172.21.15.153:0/2164034405 learned_addr learned my addr 172.21.15.153:0/2164034405 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.727+0000 7fc63d25e700 1 -- 172.21.15.153:0/2164034405 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e00d9bd8a0 con 0x55e00d9bc9a0 2023-10-05T21:15:12.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.727+0000 7fc63d25e700 1 --2- 172.21.15.153:0/2164034405 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e00d9bc9a0 0x55e00d9bcdb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc634002000 tx=0x7fc634016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3caabe0ce89c5849 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.727+0000 7fc60e7e4700 1 -- 172.21.15.153:0/2164034405 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc6340137c0 con 0x55e00d9bc9a0 2023-10-05T21:15:12.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.727+0000 7fc60e7e4700 1 -- 172.21.15.153:0/2164034405 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63401de90 con 0x55e00d9bc9a0 2023-10-05T21:15:12.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.727+0000 7fc60e7e4700 1 -- 172.21.15.153:0/2164034405 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc63402b8a0 con 0x55e00d9bc9a0 2023-10-05T21:15:12.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.728+0000 7fc64a987680 1 -- 172.21.15.153:0/2164034405 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e00d9bc9a0 msgr2=0x55e00d9bcdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.728+0000 7fc64a987680 1 --2- 172.21.15.153:0/2164034405 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e00d9bc9a0 0x55e00d9bcdb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc634002000 tx=0x7fc634016000 comp rx=0 tx=0).stop 2023-10-05T21:15:12.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.728+0000 7fc64a987680 1 -- 172.21.15.153:0/2164034405 shutdown_connections 2023-10-05T21:15:12.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.728+0000 7fc64a987680 1 --2- 172.21.15.153:0/2164034405 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e00d9bc9a0 0x55e00d9bcdb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.728+0000 7fc64a987680 1 -- 172.21.15.153:0/2164034405 >> 172.21.15.153:0/2164034405 conn(0x55e00d9b8ca0 msgr2=0x55e00d9b6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.728+0000 7fc64a987680 1 -- 172.21.15.153:0/2164034405 shutdown_connections 2023-10-05T21:15:12.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.728+0000 7fc64a987680 1 -- 172.21.15.153:0/2164034405 wait complete. 2023-10-05T21:15:12.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.728+0000 7fc64a987680 1 Processor -- start 2023-10-05T21:15:12.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.728+0000 7fc64a987680 1 -- start start 2023-10-05T21:15:12.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.728+0000 7fc64a987680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e00d9bc9a0 0x55e00d9c36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.728+0000 7fc64a987680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00d9c3c10 con 0x55e00d9bc9a0 2023-10-05T21:15:12.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.728+0000 7fc63d25e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e00d9bc9a0 0x55e00d9c36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.729+0000 7fc63d25e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e00d9bc9a0 0x55e00d9c36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49404/0 (socket says 172.21.15.153:49404) 2023-10-05T21:15:12.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.729+0000 7fc63d25e700 1 -- 172.21.15.153:0/687090368 learned_addr learned my addr 172.21.15.153:0/687090368 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.729+0000 7fc63d25e700 1 -- 172.21.15.153:0/687090368 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e00d9760b0 con 0x55e00d9bc9a0 2023-10-05T21:15:12.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.729+0000 7fc63d25e700 1 --2- 172.21.15.153:0/687090368 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e00d9bc9a0 0x55e00d9c36d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc634016040 tx=0x7fc634030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.729+0000 7fc60cfe1700 1 -- 172.21.15.153:0/687090368 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc63400d040 con 0x55e00d9bc9a0 2023-10-05T21:15:12.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.729+0000 7fc60cfe1700 1 -- 172.21.15.153:0/687090368 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc634042070 con 0x55e00d9bc9a0 2023-10-05T21:15:12.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.729+0000 7fc60cfe1700 1 -- 172.21.15.153:0/687090368 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc634036a90 con 0x55e00d9bc9a0 2023-10-05T21:15:12.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.729+0000 7fc64a987680 1 -- 172.21.15.153:0/687090368 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e00d9c3e10 con 0x55e00d9bc9a0 2023-10-05T21:15:12.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.729+0000 7fc64a987680 1 -- 172.21.15.153:0/687090368 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e00d9c4260 con 0x55e00d9bc9a0 2023-10-05T21:15:12.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.730+0000 7fc60cfe1700 1 -- 172.21.15.153:0/687090368 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fc634036bf0 con 0x55e00d9bc9a0 2023-10-05T21:15:12.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.730+0000 7fc60cfe1700 1 --2- 172.21.15.153:0/687090368 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc584034140 0x7fc5840365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.730+0000 7fc60cfe1700 1 -- 172.21.15.153:0/687090368 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fc634030070 con 0x55e00d9bc9a0 2023-10-05T21:15:12.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.730+0000 7fc63e260700 1 --2- 172.21.15.153:0/687090368 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc584034140 0x7fc5840365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.730+0000 7fc64a987680 5 note: GC not initialized 2023-10-05T21:15:12.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.730+0000 7fc63e260700 1 --2- 172.21.15.153:0/687090368 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc584034140 0x7fc5840365f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x55e00d9afc40 tx=0x7fc638037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.731+0000 7fc57dffb700 20 reqs_thread_entry: start 2023-10-05T21:15:12.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.731+0000 7fc56f7fe700 20 reqs_thread_entry: start 2023-10-05T21:15:12.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.731+0000 7fc64a987680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:12.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.731+0000 7fc64a987680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:12.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.732+0000 7fc56dffb700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:43 2023 2023-10-05T21:15:12.768 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:12.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.732+0000 7fc56d7fa700 20 reqs_thread_entry: start 2023-10-05T21:15:12.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.732+0000 7fc64a987680 20 get_system_obj_state: rctx=0x7fff974ca878 obj=default.rgw.meta:users.uid:fud state=0x55e00d822240 s->prefetch_data=0 2023-10-05T21:15:12.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.732+0000 7fc64a987680 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2023-10-05T21:15:12.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.732+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00da290f0 con 0x7fc63401d410 2023-10-05T21:15:12.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.732+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(102 fud [call,getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fc63800a570 con 0x7fc63401d410 2023-10-05T21:15:12.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.732+0000 7fc64a987680 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2023-10-05T21:15:12.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.732+0000 7fc64a987680 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T21:15:12.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.732+0000 7fc64a987680 20 get_system_obj_state: rctx=0x7fff974ca568 obj=default.rgw.meta:users.email:foo@foo.com state=0x55e00d822240 s->prefetch_data=0 2023-10-05T21:15:12.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.732+0000 7fc64a987680 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2023-10-05T21:15:12.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.732+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.3 8:c162d5d1:users.email::foo@foo.com:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00da280e0 con 0x55e00d972780 2023-10-05T21:15:12.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.732+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(103 foo@foo.com [getxattrs out=4b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 197+0+20 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.732+0000 7fc64a987680 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x6 2023-10-05T21:15:12.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.732+0000 7fc64a987680 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2023-10-05T21:15:12.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.732+0000 7fc64a987680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:12.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.732+0000 7fc64a987680 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : type miss (requested=0x1, cached=0x6) 2023-10-05T21:15:12.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.732+0000 7fc64a987680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.732+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:104 8.3 8:c162d5d1:users.email::foo@foo.com:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00da280e0 con 0x55e00d972780 2023-10-05T21:15:12.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.733+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(104 foo@foo.com [read 0~7 out=7b] v0'0 uv1 ondisk = 0) v8 ==== 155+0+7 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.733+0000 7fc64a987680 20 rados_obj.operate() r=0 bl.length=7 2023-10-05T21:15:12.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.733+0000 7fc64a987680 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x1 2023-10-05T21:15:12.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.733+0000 7fc64a987680 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2023-10-05T21:15:12.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.733+0000 7fc64a987680 20 get_system_obj_state: rctx=0x7fff974ca568 obj=default.rgw.meta:users.uid:foo state=0x55e00d822500 s->prefetch_data=0 2023-10-05T21:15:12.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.733+0000 7fc64a987680 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T21:15:12.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.733+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:105 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00da2a330 con 0x55e00d972780 2023-10-05T21:15:12.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.733+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(105 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.733+0000 7fc64a987680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T21:15:12.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.733+0000 7fc64a987680 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:12.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.733+0000 7fc64a987680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:12.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.733+0000 7fc64a987680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:12.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.733+0000 7fc64a987680 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x11, cached=0x16) 2023-10-05T21:15:12.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.733+0000 7fc64a987680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.733+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00da2ca50 con 0x55e00d972780 2023-10-05T21:15:12.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.733+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(106 foo [call,call out=48b,read 0~357 out=357b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+405 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.733+0000 7fc64a987680 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T21:15:12.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.733+0000 7fc64a987680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x11 2023-10-05T21:15:12.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.733+0000 7fc64a987680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:12.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.733+0000 7fc64a987680 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2023-10-05T21:15:12.772 INFO:teuthology.orchestra.run.smithi153.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2023-10-05T21:15:12.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.733+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:107 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94420789268656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9e7c70 con 0x7fc630041c30 2023-10-05T21:15:12.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.734+0000 7fc63d25e700 1 -- 172.21.15.153:0/2562698142 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(107 notify.0 [watch unwatch cookie 94420789268656] v29'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc63404e070 con 0x7fc630041c30 2023-10-05T21:15:12.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.734+0000 7fc64a987680 20 remove_watcher() i=0 2023-10-05T21:15:12.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.734+0000 7fc64a987680 2 removed watcher, disabling cache 2023-10-05T21:15:12.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.734+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:108 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94420789274096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a90b0 con 0x55e00d972780 2023-10-05T21:15:12.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.735+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(108 notify.1 [watch unwatch cookie 94420789274096] v29'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.735+0000 7fc64a987680 20 remove_watcher() i=1 2023-10-05T21:15:12.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.735+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:109 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94420789275328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a90b0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.736+0000 7fc63da5f700 1 -- 172.21.15.153:0/2562698142 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(109 notify.2 [watch unwatch cookie 94420789275328] v29'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc6300173e0 con 0x55e00d9a1dc0 2023-10-05T21:15:12.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.736+0000 7fc64a987680 20 remove_watcher() i=2 2023-10-05T21:15:12.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.736+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:110 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94420789278432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a90b0 con 0x7fc630041c30 2023-10-05T21:15:12.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.737+0000 7fc63d25e700 1 -- 172.21.15.153:0/2562698142 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(110 notify.3 [watch unwatch cookie 94420789278432] v29'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc63404e070 con 0x7fc630041c30 2023-10-05T21:15:12.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.737+0000 7fc64a987680 20 remove_watcher() i=3 2023-10-05T21:15:12.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.737+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:111 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94420789285824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9a90b0 con 0x55e00d972780 2023-10-05T21:15:12.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.738+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(111 notify.4 [watch unwatch cookie 94420789285824] v29'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.738+0000 7fc64a987680 20 remove_watcher() i=4 2023-10-05T21:15:12.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.738+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94420789283104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9ad3c0 con 0x7fc63401d410 2023-10-05T21:15:12.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.738+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(112 notify.5 [watch unwatch cookie 94420789283104] v29'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc63800a570 con 0x7fc63401d410 2023-10-05T21:15:12.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.738+0000 7fc64a987680 20 remove_watcher() i=5 2023-10-05T21:15:12.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.738+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:113 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94420789290160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9ac920 con 0x7fc63401d410 2023-10-05T21:15:12.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.739+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(113 notify.6 [watch unwatch cookie 94420789290160] v29'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc63800a570 con 0x7fc63401d410 2023-10-05T21:15:12.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.739+0000 7fc64a987680 20 remove_watcher() i=6 2023-10-05T21:15:12.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.739+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:114 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94420789293648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9ae4b0 con 0x7fc63401d410 2023-10-05T21:15:12.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.740+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(114 notify.7 [watch unwatch cookie 94420789293648] v29'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc63800a570 con 0x7fc63401d410 2023-10-05T21:15:12.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.740+0000 7fc64a987680 20 remove_watcher() i=7 2023-10-05T21:15:12.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.740+0000 7fc60efe5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:12.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.740+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:115 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94420789295088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e00d9ac920 con 0x55e00d972780 2023-10-05T21:15:12.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.741+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== osd_op_reply(115 data_loggenerations_metadata [watch unwatch cookie 94420789295088] v29'53 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc63800a570 con 0x55e00d972780 2023-10-05T21:15:12.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.741+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc63401d410 msgr2=0x7fc63401d880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.741+0000 7fc64a987680 1 --2- 172.21.15.153:0/2562698142 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc63401d410 0x7fc63401d880 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.741+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55e00d972780 msgr2=0x55e00d99f950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.741+0000 7fc64a987680 1 --2- 172.21.15.153:0/2562698142 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55e00d972780 0x55e00d99f950 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.741+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc630041c30 msgr2=0x7fc6300414d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.741+0000 7fc64a987680 1 --2- 172.21.15.153:0/2562698142 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc630041c30 0x7fc6300414d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.741+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55e00d9a1dc0 msgr2=0x55e00d9a41a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.741+0000 7fc64a987680 1 --2- 172.21.15.153:0/2562698142 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55e00d9a1dc0 0x55e00d9a41a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.741+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc620034130 msgr2=0x7fc6200365e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.741+0000 7fc64a987680 1 --2- 172.21.15.153:0/2562698142 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc620034130 0x7fc6200365e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc63400c080 tx=0x7fc634018000 comp rx=0 tx=0).stop 2023-10-05T21:15:12.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.741+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e00d96e250 msgr2=0x55e00d993b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.741+0000 7fc64a987680 1 --2- 172.21.15.153:0/2562698142 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e00d96e250 0x55e00d993b70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc630001820 tx=0x7fc630016000 comp rx=0 tx=0).stop 2023-10-05T21:15:12.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.741+0000 7fc63e260700 1 -- 172.21.15.153:0/2562698142 reap_dead start 2023-10-05T21:15:12.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.741+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 shutdown_connections 2023-10-05T21:15:12.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.741+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 >> 172.21.15.153:0/2562698142 conn(0x55e00d969b20 msgr2=0x55e00d986980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.741+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 shutdown_connections 2023-10-05T21:15:12.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.741+0000 7fc64a987680 1 -- 172.21.15.153:0/2562698142 wait complete. 2023-10-05T21:15:12.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.742+0000 7fc64a987680 1 -- 172.21.15.153:0/687090368 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc584034140 msgr2=0x7fc5840365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.742+0000 7fc64a987680 1 --2- 172.21.15.153:0/687090368 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc584034140 0x7fc5840365f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x55e00d9afc40 tx=0x7fc638037450 comp rx=0 tx=0).stop 2023-10-05T21:15:12.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.742+0000 7fc64a987680 1 -- 172.21.15.153:0/687090368 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e00d9bc9a0 msgr2=0x55e00d9c36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.742+0000 7fc64a987680 1 --2- 172.21.15.153:0/687090368 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e00d9bc9a0 0x55e00d9c36d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc634016040 tx=0x7fc634030000 comp rx=0 tx=0).stop 2023-10-05T21:15:12.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.742+0000 7fc64a987680 1 -- 172.21.15.153:0/687090368 shutdown_connections 2023-10-05T21:15:12.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.742+0000 7fc64a987680 1 --2- 172.21.15.153:0/687090368 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc584034140 0x7fc5840365f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.742+0000 7fc64a987680 1 --2- 172.21.15.153:0/687090368 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e00d9bc9a0 0x55e00d9c36d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.742+0000 7fc64a987680 1 -- 172.21.15.153:0/687090368 >> 172.21.15.153:0/687090368 conn(0x55e00d9b8ca0 msgr2=0x55e00d9b6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.742+0000 7fc64a987680 1 -- 172.21.15.153:0/687090368 shutdown_connections 2023-10-05T21:15:12.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.742+0000 7fc64a987680 1 -- 172.21.15.153:0/687090368 wait complete. 2023-10-05T21:15:12.778 DEBUG:teuthology.orchestra.run:got remote process result: 240 2023-10-05T21:15:12.779 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2023-10-05T21:15:12.779 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2023-10-05T21:15:12.779 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2023-10-05T21:15:12.823 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:12.823 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:12.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.822+0000 7fd9a563b680 1 Processor -- start 2023-10-05T21:15:12.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.822+0000 7fd9a563b680 1 -- start start 2023-10-05T21:15:12.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.823+0000 7fd9a563b680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5616f412a0a0 0x5616f41b9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.823+0000 7fd9a563b680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5616f4103990 con 0x5616f41b95d0 2023-10-05T21:15:12.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.823+0000 7fd9a563b680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x5616f40c3db0 con 0x5616f412a0a0 2023-10-05T21:15:12.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.823+0000 7fd998713700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5616f412a0a0 0x5616f41b9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.823+0000 7fd997f12700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x5616f41b95d0 0x5616f41bb9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56218/0 (socket says 172.21.15.153:56218) 2023-10-05T21:15:12.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.823+0000 7fd997f12700 1 -- 172.21.15.153:0/519898508 learned_addr learned my addr 172.21.15.153:0/519898508 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:12.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.823+0000 7fd998713700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5616f412a0a0 0x5616f41b9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49412/0 (socket says 172.21.15.153:49412) 2023-10-05T21:15:12.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.823+0000 7fd998713700 1 -- 172.21.15.153:0/519898508 >> v1:172.21.15.111:6789/0 conn(0x5616f41b95d0 legacy=0x5616f41bb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.823+0000 7fd998713700 1 -- 172.21.15.153:0/519898508 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616f41be1e0 con 0x5616f412a0a0 2023-10-05T21:15:12.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.823+0000 7fd998713700 1 --2- 172.21.15.153:0/519898508 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616f412a0a0 0x5616f41b9090 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd98000a5d0 tx=0x7fd980005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a866b2993d5cc4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.824+0000 7fd997711700 1 -- 172.21.15.153:0/519898508 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9800086a0 con 0x5616f412a0a0 2023-10-05T21:15:12.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.824+0000 7fd997711700 1 -- 172.21.15.153:0/519898508 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd980008800 con 0x5616f412a0a0 2023-10-05T21:15:12.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.824+0000 7fd997711700 1 -- 172.21.15.153:0/519898508 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd980008ad0 con 0x5616f412a0a0 2023-10-05T21:15:12.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.824+0000 7fd9a563b680 1 -- 172.21.15.153:0/519898508 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616f412a0a0 msgr2=0x5616f41b9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.824+0000 7fd9a563b680 1 --2- 172.21.15.153:0/519898508 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616f412a0a0 0x5616f41b9090 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd98000a5d0 tx=0x7fd980005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:12.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.824+0000 7fd9a563b680 1 -- 172.21.15.153:0/519898508 shutdown_connections 2023-10-05T21:15:12.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.824+0000 7fd9a563b680 1 --2- 172.21.15.153:0/519898508 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616f412a0a0 0x5616f41b9090 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.824+0000 7fd9a563b680 1 -- 172.21.15.153:0/519898508 >> 172.21.15.153:0/519898508 conn(0x5616f41b0b80 msgr2=0x5616f41b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.824+0000 7fd9a563b680 1 -- 172.21.15.153:0/519898508 shutdown_connections 2023-10-05T21:15:12.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.824+0000 7fd9a563b680 1 -- 172.21.15.153:0/519898508 wait complete. 2023-10-05T21:15:12.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.825+0000 7fd9a563b680 1 Processor -- start 2023-10-05T21:15:12.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.825+0000 7fd9a563b680 1 -- start start 2023-10-05T21:15:12.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.825+0000 7fd9a563b680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616f41b95d0 0x5616f41d5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.825+0000 7fd9a563b680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616f4063ea0 con 0x5616f41b95d0 2023-10-05T21:15:12.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.825+0000 7fd998713700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616f41b95d0 0x5616f41d5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.825+0000 7fd998713700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616f41b95d0 0x5616f41d5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49418/0 (socket says 172.21.15.153:49418) 2023-10-05T21:15:12.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.825+0000 7fd998713700 1 -- 172.21.15.153:0/4011564849 learned_addr learned my addr 172.21.15.153:0/4011564849 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.825+0000 7fd998713700 1 -- 172.21.15.153:0/4011564849 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd980005cf0 con 0x5616f41b95d0 2023-10-05T21:15:12.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.825+0000 7fd998713700 1 --2- 172.21.15.153:0/4011564849 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616f41b95d0 0x5616f41d5980 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd980005cc0 tx=0x7fd980015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ea675eb2a8eea0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.826+0000 7fd99670f700 1 -- 172.21.15.153:0/4011564849 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd980008970 con 0x5616f41b95d0 2023-10-05T21:15:12.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.826+0000 7fd99670f700 1 -- 172.21.15.153:0/4011564849 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd980008ad0 con 0x5616f41b95d0 2023-10-05T21:15:12.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.826+0000 7fd99670f700 1 -- 172.21.15.153:0/4011564849 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd980008dc0 con 0x5616f41b95d0 2023-10-05T21:15:12.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.826+0000 7fd9a563b680 1 -- 172.21.15.153:0/4011564849 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616f41b95d0 msgr2=0x5616f41d5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.826+0000 7fd9a563b680 1 --2- 172.21.15.153:0/4011564849 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616f41b95d0 0x5616f41d5980 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd980005cc0 tx=0x7fd980015000 comp rx=0 tx=0).stop 2023-10-05T21:15:12.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.826+0000 7fd9a563b680 1 -- 172.21.15.153:0/4011564849 shutdown_connections 2023-10-05T21:15:12.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.826+0000 7fd9a563b680 1 --2- 172.21.15.153:0/4011564849 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616f41b95d0 0x5616f41d5980 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.826+0000 7fd9a563b680 1 -- 172.21.15.153:0/4011564849 >> 172.21.15.153:0/4011564849 conn(0x5616f41b0b80 msgr2=0x5616f41d1450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.826+0000 7fd9a563b680 1 -- 172.21.15.153:0/4011564849 shutdown_connections 2023-10-05T21:15:12.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.826+0000 7fd9a563b680 1 -- 172.21.15.153:0/4011564849 wait complete. 2023-10-05T21:15:12.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.826+0000 7fd9a563b680 1 Processor -- start 2023-10-05T21:15:12.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.826+0000 7fd9a563b680 1 -- start start 2023-10-05T21:15:12.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.827+0000 7fd9a563b680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616f41b95d0 0x5616f41dcd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.827+0000 7fd9a563b680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616f405ac80 con 0x5616f41b95d0 2023-10-05T21:15:12.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.827+0000 7fd998713700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616f41b95d0 0x5616f41dcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.827+0000 7fd998713700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616f41b95d0 0x5616f41dcd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49422/0 (socket says 172.21.15.153:49422) 2023-10-05T21:15:12.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.827+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 learned_addr learned my addr 172.21.15.153:0/2555660682 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.827+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616f41be1e0 con 0x5616f41b95d0 2023-10-05T21:15:12.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.827+0000 7fd998713700 1 --2- 172.21.15.153:0/2555660682 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616f41b95d0 0x5616f41dcd00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd98000a520 tx=0x7fd98001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.827+0000 7fd994f0c700 1 -- 172.21.15.153:0/2555660682 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9800086a0 con 0x5616f41b95d0 2023-10-05T21:15:12.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.827+0000 7fd994f0c700 1 -- 172.21.15.153:0/2555660682 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd980012bf0 con 0x5616f41b95d0 2023-10-05T21:15:12.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.827+0000 7fd994f0c700 1 -- 172.21.15.153:0/2555660682 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd980012ea0 con 0x5616f41b95d0 2023-10-05T21:15:12.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.827+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5616f41dd240 con 0x5616f41b95d0 2023-10-05T21:15:12.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.827+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5616f41dd690 con 0x5616f41b95d0 2023-10-05T21:15:12.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.828+0000 7fd994f0c700 1 -- 172.21.15.153:0/2555660682 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fd98001d420 con 0x5616f41b95d0 2023-10-05T21:15:12.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.828+0000 7fd994f0c700 1 --2- 172.21.15.153:0/2555660682 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd978034130 0x7fd9780365e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.828+0000 7fd994f0c700 1 -- 172.21.15.153:0/2555660682 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fd980029070 con 0x5616f41b95d0 2023-10-05T21:15:12.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.828+0000 7fd9a563b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.828+0000 7fd997f12700 1 --2- 172.21.15.153:0/2555660682 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd978034130 0x7fd9780365e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.828+0000 7fd9a563b680 1 --2- 172.21.15.153:0/2555660682 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5616f41e69f0 0x5616f41e8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.828+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41e9610 con 0x5616f41e69f0 2023-10-05T21:15:12.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.828+0000 7fd998f14700 1 --2- 172.21.15.153:0/2555660682 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5616f41e69f0 0x5616f41e8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.829+0000 7fd997f12700 1 --2- 172.21.15.153:0/2555660682 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd978034130 0x7fd9780365e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd988004170 tx=0x7fd988001380 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.829+0000 7fd998f14700 1 --2- 172.21.15.153:0/2555660682 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5616f41e69f0 0x5616f41e8e80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.829+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.829+0000 7fd9a563b680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.829+0000 7fd9a563b680 20 realm 2023-10-05T21:15:12.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.829+0000 7fd9a563b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.829+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41e6020 con 0x5616f41e69f0 2023-10-05T21:15:12.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.829+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.829+0000 7fd9a563b680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.829+0000 7fd9a563b680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:12.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.829+0000 7fd9a563b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.829+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ea0c0 con 0x5616f41e69f0 2023-10-05T21:15:12.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.830+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.830+0000 7fd9a563b680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.830+0000 7fd9a563b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.830+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ea9e0 con 0x5616f41e69f0 2023-10-05T21:15:12.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.830+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.830+0000 7fd9a563b680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.830+0000 7fd9a563b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.830+0000 7fd9a563b680 1 --2- 172.21.15.153:0/2555660682 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5616f41eb2a0 0x5616f41ed680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.830+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41edc40 con 0x5616f41eb2a0 2023-10-05T21:15:12.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.830+0000 7fd998713700 1 --2- 172.21.15.153:0/2555660682 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5616f41eb2a0 0x5616f41ed680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.830+0000 7fd998713700 1 --2- 172.21.15.153:0/2555660682 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5616f41eb2a0 0x5616f41ed680 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.831+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fd980019040 con 0x5616f41eb2a0 2023-10-05T21:15:12.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.831+0000 7fd9a563b680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:12.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.831+0000 7fd9a563b680 20 searching for the correct realm 2023-10-05T21:15:12.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.831+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x5616f41eb2a0 2023-10-05T21:15:12.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.831+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd980019040 con 0x5616f41eb2a0 2023-10-05T21:15:12.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.831+0000 7fd998713700 1 --2- 172.21.15.153:0/2555660682 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x5616f412a0a0 0x7fd980049190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.831+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x5616f412a0a0 2023-10-05T21:15:12.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.831+0000 7fd997f12700 1 --2- 172.21.15.153:0/2555660682 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x5616f412a0a0 0x7fd980049190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.831+0000 7fd997f12700 1 --2- 172.21.15.153:0/2555660682 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x5616f412a0a0 0x7fd980049190 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.832+0000 7fd997f12700 1 -- 172.21.15.153:0/2555660682 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd988006070 con 0x5616f412a0a0 2023-10-05T21:15:12.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.832+0000 7fd997f12700 1 --2- 172.21.15.153:0/2555660682 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fd98800d3d0 0x7fd98800d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.832+0000 7fd997f12700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x7fd98800d3d0 2023-10-05T21:15:12.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.832+0000 7fd998f14700 1 --2- 172.21.15.153:0/2555660682 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fd98800d3d0 0x7fd98800d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.832+0000 7fd998f14700 1 --2- 172.21.15.153:0/2555660682 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fd98800d3d0 0x7fd98800d820 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.832+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd99000a570 con 0x7fd98800d3d0 2023-10-05T21:15:12.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.833+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x5616f41e69f0 2023-10-05T21:15:12.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.833+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.833+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x5616f41e69f0 2023-10-05T21:15:12.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.833+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.833+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x7fd98800d3d0 2023-10-05T21:15:12.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.833+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd99000a570 con 0x7fd98800d3d0 2023-10-05T21:15:12.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.833+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x7fd98800d3d0 2023-10-05T21:15:12.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.833+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd99000a570 con 0x7fd98800d3d0 2023-10-05T21:15:12.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.833+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x5616f412a0a0 2023-10-05T21:15:12.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.834+0000 7fd997f12700 1 -- 172.21.15.153:0/2555660682 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd988006070 con 0x5616f412a0a0 2023-10-05T21:15:12.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.834+0000 7fd997f12700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x5616f41eb2a0 2023-10-05T21:15:12.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.834+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fd980019040 con 0x5616f41eb2a0 2023-10-05T21:15:12.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.834+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x5616f41e69f0 2023-10-05T21:15:12.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.834+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.834+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x7fd98800d3d0 2023-10-05T21:15:12.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.834+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd99000a570 con 0x7fd98800d3d0 2023-10-05T21:15:12.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.834+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x5616f41e69f0 2023-10-05T21:15:12.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.834+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.834+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x5616f412a0a0 2023-10-05T21:15:12.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.835+0000 7fd997f12700 1 -- 172.21.15.153:0/2555660682 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd988006070 con 0x5616f412a0a0 2023-10-05T21:15:12.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.835+0000 7fd997f12700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x5616f41eb2a0 2023-10-05T21:15:12.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.835+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd980019040 con 0x5616f41eb2a0 2023-10-05T21:15:12.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.835+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x5616f41eb2a0 2023-10-05T21:15:12.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.835+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd980019040 con 0x5616f41eb2a0 2023-10-05T21:15:12.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.835+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x7fd98800d3d0 2023-10-05T21:15:12.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.835+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd99000a570 con 0x7fd98800d3d0 2023-10-05T21:15:12.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.835+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x5616f41eb2a0 2023-10-05T21:15:12.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.835+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd980019040 con 0x5616f41eb2a0 2023-10-05T21:15:12.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.835+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x5616f41eb2a0 2023-10-05T21:15:12.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.836+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd980019040 con 0x5616f41eb2a0 2023-10-05T21:15:12.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.836+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x5616f41e69f0 2023-10-05T21:15:12.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.836+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.836+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x5616f41e69f0 2023-10-05T21:15:12.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.836+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.836+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x7fd98800d3d0 2023-10-05T21:15:12.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.836+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd99000a570 con 0x7fd98800d3d0 2023-10-05T21:15:12.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.836+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x5616f41eb2a0 2023-10-05T21:15:12.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.837+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd980019040 con 0x5616f41eb2a0 2023-10-05T21:15:12.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.837+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x5616f412a0a0 2023-10-05T21:15:12.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.837+0000 7fd997f12700 1 -- 172.21.15.153:0/2555660682 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd988006070 con 0x5616f412a0a0 2023-10-05T21:15:12.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.837+0000 7fd997f12700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x5616f41e69f0 2023-10-05T21:15:12.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.837+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.837+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x7fd98800d3d0 2023-10-05T21:15:12.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.837+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd99000a570 con 0x7fd98800d3d0 2023-10-05T21:15:12.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.837+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x5616f41eb2a0 2023-10-05T21:15:12.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.837+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd980019040 con 0x5616f41eb2a0 2023-10-05T21:15:12.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.837+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x7fd98800d3d0 2023-10-05T21:15:12.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.838+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd99000a570 con 0x7fd98800d3d0 2023-10-05T21:15:12.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.838+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x5616f412a0a0 2023-10-05T21:15:12.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.838+0000 7fd997f12700 1 -- 172.21.15.153:0/2555660682 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd988006070 con 0x5616f412a0a0 2023-10-05T21:15:12.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.838+0000 7fd997f12700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x5616f41eb2a0 2023-10-05T21:15:12.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.838+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd980019040 con 0x5616f41eb2a0 2023-10-05T21:15:12.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.838+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x7fd98800d3d0 2023-10-05T21:15:12.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.838+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd99000a570 con 0x7fd98800d3d0 2023-10-05T21:15:12.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.838+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x5616f41e69f0 2023-10-05T21:15:12.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.839+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.839+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef560 con 0x5616f412a0a0 2023-10-05T21:15:12.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.839+0000 7fd997f12700 1 -- 172.21.15.153:0/2555660682 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd988006070 con 0x5616f412a0a0 2023-10-05T21:15:12.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.839+0000 7fd9a563b680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:12.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.839+0000 7fd9a563b680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:12.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.839+0000 7fd9a563b680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:12.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.839+0000 7fd9a563b680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:12.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.839+0000 7fd9a563b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.839+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ee780 con 0x5616f41e69f0 2023-10-05T21:15:12.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.839+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.839+0000 7fd9a563b680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.839+0000 7fd9a563b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.839+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41eec10 con 0x5616f41e69f0 2023-10-05T21:15:12.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.839+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.839+0000 7fd9a563b680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.839+0000 7fd9a563b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.839+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef040 con 0x5616f41e69f0 2023-10-05T21:15:12.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.839+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.840+0000 7fd9a563b680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:12.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.840+0000 7fd9a563b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.840+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ee310 con 0x5616f41eb2a0 2023-10-05T21:15:12.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.840+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fd980019040 con 0x5616f41eb2a0 2023-10-05T21:15:12.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.840+0000 7fd9a563b680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.840+0000 7fd9a563b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.840+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41efe00 con 0x5616f41e69f0 2023-10-05T21:15:12.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.840+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.840+0000 7fd9a563b680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.840+0000 7fd9a563b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.840+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f0200 con 0x5616f41e69f0 2023-10-05T21:15:12.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.840+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.840+0000 7fd9a563b680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.840+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f1210 con 0x5616f41eb2a0 2023-10-05T21:15:12.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.840+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd980019040 con 0x5616f41eb2a0 2023-10-05T21:15:12.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.840+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f1210 con 0x5616f412a0a0 2023-10-05T21:15:12.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.841+0000 7fd997f12700 1 -- 172.21.15.153:0/2555660682 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd988006070 con 0x5616f412a0a0 2023-10-05T21:15:12.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.841+0000 7fd997f12700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f1210 con 0x7fd98800d3d0 2023-10-05T21:15:12.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.841+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd99000a570 con 0x7fd98800d3d0 2023-10-05T21:15:12.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.841+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef040 con 0x5616f41e69f0 2023-10-05T21:15:12.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.841+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.841+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef040 con 0x5616f41e69f0 2023-10-05T21:15:12.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.841+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.841+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef040 con 0x7fd98800d3d0 2023-10-05T21:15:12.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.842+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd99000a570 con 0x7fd98800d3d0 2023-10-05T21:15:12.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.842+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef040 con 0x7fd98800d3d0 2023-10-05T21:15:12.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.842+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd99000a570 con 0x7fd98800d3d0 2023-10-05T21:15:12.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.842+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef040 con 0x5616f412a0a0 2023-10-05T21:15:12.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.842+0000 7fd997f12700 1 -- 172.21.15.153:0/2555660682 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd988006070 con 0x5616f412a0a0 2023-10-05T21:15:12.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.842+0000 7fd997f12700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef040 con 0x5616f41eb2a0 2023-10-05T21:15:12.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.842+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fd980019040 con 0x5616f41eb2a0 2023-10-05T21:15:12.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.842+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef040 con 0x5616f41e69f0 2023-10-05T21:15:12.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.842+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.842+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef040 con 0x7fd98800d3d0 2023-10-05T21:15:12.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.843+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd99000a570 con 0x7fd98800d3d0 2023-10-05T21:15:12.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.843+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef040 con 0x5616f41e69f0 2023-10-05T21:15:12.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.843+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.843+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef040 con 0x5616f412a0a0 2023-10-05T21:15:12.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.843+0000 7fd997f12700 1 -- 172.21.15.153:0/2555660682 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd988006070 con 0x5616f412a0a0 2023-10-05T21:15:12.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.843+0000 7fd997f12700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef040 con 0x5616f41eb2a0 2023-10-05T21:15:12.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.843+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd980019040 con 0x5616f41eb2a0 2023-10-05T21:15:12.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.843+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef040 con 0x5616f41eb2a0 2023-10-05T21:15:12.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.843+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd980019040 con 0x5616f41eb2a0 2023-10-05T21:15:12.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.843+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef040 con 0x7fd98800d3d0 2023-10-05T21:15:12.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.844+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd99000a570 con 0x7fd98800d3d0 2023-10-05T21:15:12.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.844+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef040 con 0x5616f41eb2a0 2023-10-05T21:15:12.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.844+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd980019040 con 0x5616f41eb2a0 2023-10-05T21:15:12.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.844+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef040 con 0x5616f41eb2a0 2023-10-05T21:15:12.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.844+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd980019040 con 0x5616f41eb2a0 2023-10-05T21:15:12.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.844+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef040 con 0x5616f41e69f0 2023-10-05T21:15:12.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.844+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.844+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef040 con 0x5616f41e69f0 2023-10-05T21:15:12.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.845+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.845+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef040 con 0x7fd98800d3d0 2023-10-05T21:15:12.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.845+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd99000a570 con 0x7fd98800d3d0 2023-10-05T21:15:12.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.845+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef040 con 0x5616f41eb2a0 2023-10-05T21:15:12.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.845+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd980019040 con 0x5616f41eb2a0 2023-10-05T21:15:12.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.845+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef040 con 0x5616f412a0a0 2023-10-05T21:15:12.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.845+0000 7fd997f12700 1 -- 172.21.15.153:0/2555660682 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd988006070 con 0x5616f412a0a0 2023-10-05T21:15:12.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.845+0000 7fd997f12700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef040 con 0x5616f41e69f0 2023-10-05T21:15:12.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.846+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.846+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef040 con 0x7fd98800d3d0 2023-10-05T21:15:12.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.846+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd99000a570 con 0x7fd98800d3d0 2023-10-05T21:15:12.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.846+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef040 con 0x5616f41eb2a0 2023-10-05T21:15:12.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.846+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd980019040 con 0x5616f41eb2a0 2023-10-05T21:15:12.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.846+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef040 con 0x7fd98800d3d0 2023-10-05T21:15:12.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.847+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd99000a570 con 0x7fd98800d3d0 2023-10-05T21:15:12.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.847+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef040 con 0x5616f412a0a0 2023-10-05T21:15:12.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.847+0000 7fd997f12700 1 -- 172.21.15.153:0/2555660682 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd988006070 con 0x5616f412a0a0 2023-10-05T21:15:12.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.847+0000 7fd997f12700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef040 con 0x5616f41eb2a0 2023-10-05T21:15:12.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.847+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd980019040 con 0x5616f41eb2a0 2023-10-05T21:15:12.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.847+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef040 con 0x7fd98800d3d0 2023-10-05T21:15:12.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.847+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd99000a570 con 0x7fd98800d3d0 2023-10-05T21:15:12.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.847+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef040 con 0x5616f41e69f0 2023-10-05T21:15:12.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.848+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.848+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41ef040 con 0x5616f412a0a0 2023-10-05T21:15:12.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.848+0000 7fd997f12700 1 -- 172.21.15.153:0/2555660682 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd988006070 con 0x5616f412a0a0 2023-10-05T21:15:12.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.848+0000 7fd9a563b680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:12.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.848+0000 7fd9a563b680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:12.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.848+0000 7fd9a563b680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:12.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.848+0000 7fd9a563b680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:12.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.848+0000 7fd9a563b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.848+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f0200 con 0x5616f41e69f0 2023-10-05T21:15:12.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.848+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.848+0000 7fd9a563b680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.848+0000 7fd9a563b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.848+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f05b0 con 0x5616f41eb2a0 2023-10-05T21:15:12.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.848+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fd980019040 con 0x5616f41eb2a0 2023-10-05T21:15:12.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.848+0000 7fd9a563b680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:12.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.848+0000 7fd9a563b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.848+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41efaf0 con 0x5616f41e69f0 2023-10-05T21:15:12.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.849+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.849+0000 7fd9a563b680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.849+0000 7fd9a563b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.849+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41efac0 con 0x5616f41e69f0 2023-10-05T21:15:12.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.849+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.849+0000 7fd9a563b680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:12.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.849+0000 7fd9a563b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.849+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f0ea0 con 0x7fd98800d3d0 2023-10-05T21:15:12.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.849+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fd99000a570 con 0x7fd98800d3d0 2023-10-05T21:15:12.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.849+0000 7fd9a563b680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.849+0000 7fd9a563b680 20 zone default found 2023-10-05T21:15:12.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.849+0000 7fd9a563b680 4 Realm: () 2023-10-05T21:15:12.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.849+0000 7fd9a563b680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:12.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.849+0000 7fd9a563b680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:12.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.849+0000 7fd9a563b680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:12.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.849+0000 7fd9a563b680 20 zonegroup default 2023-10-05T21:15:12.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.849+0000 7fd9a563b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.849+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f0ea0 con 0x7fd98800d3d0 2023-10-05T21:15:12.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.849+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd99000a570 con 0x7fd98800d3d0 2023-10-05T21:15:12.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.849+0000 7fd9a563b680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.849+0000 7fd9a563b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.849+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f27d0 con 0x5616f41eb2a0 2023-10-05T21:15:12.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.850+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd980019040 con 0x5616f41eb2a0 2023-10-05T21:15:12.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.850+0000 7fd9a563b680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.850+0000 7fd9a563b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.850+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f2b80 con 0x5616f41eb2a0 2023-10-05T21:15:12.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.850+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd980019040 con 0x5616f41eb2a0 2023-10-05T21:15:12.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.850+0000 7fd9a563b680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.850+0000 7fd9a563b680 20 started sync module instance, tier type = 2023-10-05T21:15:12.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.850+0000 7fd9a563b680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:12.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.850+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f1e90 con 0x5616f412a0a0 2023-10-05T21:15:12.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.851+0000 7fd997f12700 1 -- 172.21.15.153:0/2555660682 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd988006070 con 0x5616f412a0a0 2023-10-05T21:15:12.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.851+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94656584950416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f3420 con 0x5616f412a0a0 2023-10-05T21:15:12.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.851+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f3cc0 con 0x5616f41e69f0 2023-10-05T21:15:12.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.851+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.851+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94656584955856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f4270 con 0x5616f41e69f0 2023-10-05T21:15:12.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.851+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f4e70 con 0x5616f41eb2a0 2023-10-05T21:15:12.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.851+0000 7fd997f12700 1 -- 172.21.15.153:0/2555660682 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94656584950416] v29'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd988006070 con 0x5616f412a0a0 2023-10-05T21:15:12.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.852+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94656584955856] v29'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.852+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd980019040 con 0x5616f41eb2a0 2023-10-05T21:15:12.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.852+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94656584960256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f4230 con 0x5616f41eb2a0 2023-10-05T21:15:12.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.852+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f3df0 con 0x5616f412a0a0 2023-10-05T21:15:12.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.853+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94656584960256] v29'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd980019040 con 0x5616f41eb2a0 2023-10-05T21:15:12.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.853+0000 7fd997f12700 1 -- 172.21.15.153:0/2555660682 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd988006070 con 0x5616f412a0a0 2023-10-05T21:15:12.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.853+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94656584953648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f5760 con 0x5616f412a0a0 2023-10-05T21:15:12.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.853+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f6170 con 0x5616f41e69f0 2023-10-05T21:15:12.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.854+0000 7fd997f12700 1 -- 172.21.15.153:0/2555660682 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94656584953648] v29'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd988006070 con 0x5616f412a0a0 2023-10-05T21:15:12.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.854+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.854+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94656584965248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f65c0 con 0x5616f41e69f0 2023-10-05T21:15:12.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.854+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f6fd0 con 0x7fd98800d3d0 2023-10-05T21:15:12.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.854+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94656584965248] v29'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.854+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd99000a570 con 0x7fd98800d3d0 2023-10-05T21:15:12.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.855+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94656584969488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f65c0 con 0x7fd98800d3d0 2023-10-05T21:15:12.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.855+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f7a30 con 0x7fd98800d3d0 2023-10-05T21:15:12.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.855+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(96 notify.6 [create] v29'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd99000a570 con 0x7fd98800d3d0 2023-10-05T21:15:12.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.855+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(95 notify.5 [watch watch cookie 94656584969488] v29'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd99000a570 con 0x7fd98800d3d0 2023-10-05T21:15:12.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.855+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94656584971584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f7ec0 con 0x7fd98800d3d0 2023-10-05T21:15:12.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.855+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f60d0 con 0x7fd98800d3d0 2023-10-05T21:15:12.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.856+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94656584971584] v29'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd99000a570 con 0x7fd98800d3d0 2023-10-05T21:15:12.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.856+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd99000a570 con 0x7fd98800d3d0 2023-10-05T21:15:12.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.856+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94656584972688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f7de0 con 0x7fd98800d3d0 2023-10-05T21:15:12.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.856+0000 7fd9a563b680 20 add_watcher() i=0 2023-10-05T21:15:12.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.856+0000 7fd9a563b680 20 add_watcher() i=1 2023-10-05T21:15:12.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.856+0000 7fd9a563b680 20 add_watcher() i=2 2023-10-05T21:15:12.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.856+0000 7fd9a563b680 20 add_watcher() i=3 2023-10-05T21:15:12.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.856+0000 7fd9a563b680 20 add_watcher() i=4 2023-10-05T21:15:12.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.856+0000 7fd9a563b680 20 add_watcher() i=5 2023-10-05T21:15:12.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.856+0000 7fd9a563b680 20 add_watcher() i=6 2023-10-05T21:15:12.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.857+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94656584972688] v29'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd99000a570 con 0x7fd98800d3d0 2023-10-05T21:15:12.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.857+0000 7fd9a563b680 20 add_watcher() i=7 2023-10-05T21:15:12.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.857+0000 7fd9a563b680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:12.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.857+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41fba40 con 0x5616f41e69f0 2023-10-05T21:15:12.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.857+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.857+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94656584975648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f8e60 con 0x5616f41e69f0 2023-10-05T21:15:12.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.858+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94656584975648] v29'54 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.858+0000 7fd969fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:12.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.858+0000 7fd9a563b680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:12.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.858+0000 7fd9a563b680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:12.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.858+0000 7fd9a563b680 1 Processor -- start 2023-10-05T21:15:12.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.858+0000 7fd9a563b680 1 -- start start 2023-10-05T21:15:12.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.858+0000 7fd9a563b680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616f4206250 0x5616f4206660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.858+0000 7fd9a563b680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616f4206c30 con 0x5616f4206250 2023-10-05T21:15:12.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.859+0000 7fd997f12700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616f4206250 0x5616f4206660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.859+0000 7fd997f12700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616f4206250 0x5616f4206660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49428/0 (socket says 172.21.15.153:49428) 2023-10-05T21:15:12.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.859+0000 7fd997f12700 1 -- 172.21.15.153:0/1047403230 learned_addr learned my addr 172.21.15.153:0/1047403230 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.859+0000 7fd997f12700 1 -- 172.21.15.153:0/1047403230 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616f4206d70 con 0x5616f4206250 2023-10-05T21:15:12.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.859+0000 7fd997f12700 1 --2- 172.21.15.153:0/1047403230 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616f4206250 0x5616f4206660 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x5616f41ea780 tx=0x7fd988006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c4584f33f2374ba server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.859+0000 7fd9697e2700 1 -- 172.21.15.153:0/1047403230 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd988023040 con 0x5616f4206250 2023-10-05T21:15:12.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.859+0000 7fd9697e2700 1 -- 172.21.15.153:0/1047403230 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd988024040 con 0x5616f4206250 2023-10-05T21:15:12.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.859+0000 7fd9697e2700 1 -- 172.21.15.153:0/1047403230 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd988013040 con 0x5616f4206250 2023-10-05T21:15:12.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.860+0000 7fd9a563b680 1 -- 172.21.15.153:0/1047403230 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616f4206250 msgr2=0x5616f4206660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.860+0000 7fd9a563b680 1 --2- 172.21.15.153:0/1047403230 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616f4206250 0x5616f4206660 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x5616f41ea780 tx=0x7fd988006000 comp rx=0 tx=0).stop 2023-10-05T21:15:12.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.860+0000 7fd9a563b680 1 -- 172.21.15.153:0/1047403230 shutdown_connections 2023-10-05T21:15:12.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.860+0000 7fd9a563b680 1 --2- 172.21.15.153:0/1047403230 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616f4206250 0x5616f4206660 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.860+0000 7fd9a563b680 1 -- 172.21.15.153:0/1047403230 >> 172.21.15.153:0/1047403230 conn(0x5616f4201450 msgr2=0x5616f41ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.860+0000 7fd9a563b680 1 -- 172.21.15.153:0/1047403230 shutdown_connections 2023-10-05T21:15:12.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.860+0000 7fd9a563b680 1 -- 172.21.15.153:0/1047403230 wait complete. 2023-10-05T21:15:12.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.860+0000 7fd9a563b680 1 Processor -- start 2023-10-05T21:15:12.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.860+0000 7fd9a563b680 1 -- start start 2023-10-05T21:15:12.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.860+0000 7fd9a563b680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616f4206250 0x5616f420bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.860+0000 7fd9a563b680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616f420c2f0 con 0x5616f4206250 2023-10-05T21:15:12.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.861+0000 7fd997f12700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616f4206250 0x5616f420bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.861+0000 7fd997f12700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616f4206250 0x5616f420bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49436/0 (socket says 172.21.15.153:49436) 2023-10-05T21:15:12.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.861+0000 7fd997f12700 1 -- 172.21.15.153:0/583730283 learned_addr learned my addr 172.21.15.153:0/583730283 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.861+0000 7fd997f12700 1 -- 172.21.15.153:0/583730283 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616f4103990 con 0x5616f4206250 2023-10-05T21:15:12.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.861+0000 7fd997f12700 1 --2- 172.21.15.153:0/583730283 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616f4206250 0x5616f420bdb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd98800b9a0 tx=0x7fd988030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.861+0000 7fd8e37fe700 1 -- 172.21.15.153:0/583730283 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd988023040 con 0x5616f4206250 2023-10-05T21:15:12.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.861+0000 7fd8e37fe700 1 -- 172.21.15.153:0/583730283 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98801e420 con 0x5616f4206250 2023-10-05T21:15:12.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.861+0000 7fd9a563b680 1 -- 172.21.15.153:0/583730283 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5616f420c4f0 con 0x5616f4206250 2023-10-05T21:15:12.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.861+0000 7fd8e37fe700 1 -- 172.21.15.153:0/583730283 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd98801e590 con 0x5616f4206250 2023-10-05T21:15:12.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.861+0000 7fd9a563b680 1 -- 172.21.15.153:0/583730283 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5616f420c940 con 0x5616f4206250 2023-10-05T21:15:12.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.862+0000 7fd8e37fe700 1 -- 172.21.15.153:0/583730283 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fd98801e6f0 con 0x5616f4206250 2023-10-05T21:15:12.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.862+0000 7fd8e37fe700 1 --2- 172.21.15.153:0/583730283 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd8d8034190 0x7fd8d8036640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.862+0000 7fd8e37fe700 1 -- 172.21.15.153:0/583730283 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fd98804fb00 con 0x5616f4206250 2023-10-05T21:15:12.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.862+0000 7fd998f14700 1 --2- 172.21.15.153:0/583730283 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd8d8034190 0x7fd8d8036640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.862+0000 7fd9a563b680 5 note: GC not initialized 2023-10-05T21:15:12.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.863+0000 7fd998f14700 1 --2- 172.21.15.153:0/583730283 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd8d8034190 0x7fd8d8036640 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x5616f41f7fe0 tx=0x7fd99000aee0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.863+0000 7fd8e0ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:12.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.864+0000 7fd8d67fc700 20 reqs_thread_entry: start 2023-10-05T21:15:12.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.864+0000 7fd9a563b680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:12.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.864+0000 7fd9a563b680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:12.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.864+0000 7fd8d4ff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:42 2023 2023-10-05T21:15:12.896 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:12.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.864+0000 7fd8bbfff700 20 reqs_thread_entry: start 2023-10-05T21:15:12.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.864+0000 7fd9a563b680 20 get_system_obj_state: rctx=0x7ffe02128ed8 obj=default.rgw.meta:users.uid:foo state=0x5616f4069240 s->prefetch_data=0 2023-10-05T21:15:12.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.864+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f42716a0 con 0x5616f41e69f0 2023-10-05T21:15:12.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.864+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.864+0000 7fd9a563b680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:12.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.864+0000 7fd9a563b680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:12.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.864+0000 7fd9a563b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.864+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f4273930 con 0x5616f41e69f0 2023-10-05T21:15:12.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.865+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.865+0000 7fd9a563b680 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T21:15:12.897 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:12.897 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "foo", 2023-10-05T21:15:12.898 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Foo", 2023-10-05T21:15:12.898 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "foo@foo.com", 2023-10-05T21:15:12.898 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2023-10-05T21:15:12.898 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 4, 2023-10-05T21:15:12.898 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [], 2023-10-05T21:15:12.898 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2023-10-05T21:15:12.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:12.898 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:12.898 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:12.898 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T21:15:12.898 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:12.899 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:12.899 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [], 2023-10-05T21:15:12.899 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2023-10-05T21:15:12.899 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2023-10-05T21:15:12.899 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2023-10-05T21:15:12.899 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2023-10-05T21:15:12.899 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2023-10-05T21:15:12.899 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:15:12.899 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:12.899 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:12.899 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:12.899 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:12.900 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:12.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:12.900 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2023-10-05T21:15:12.900 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:12.900 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:12.900 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:12.900 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:12.900 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:12.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:12.900 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2023-10-05T21:15:12.900 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2023-10-05T21:15:12.901 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [] 2023-10-05T21:15:12.901 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:12.901 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:15:12.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.865+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94656584950416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f4273930 con 0x5616f412a0a0 2023-10-05T21:15:12.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.866+0000 7fd997f12700 1 -- 172.21.15.153:0/2555660682 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94656584950416] v29'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd988006070 con 0x5616f412a0a0 2023-10-05T21:15:12.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.866+0000 7fd9a563b680 20 remove_watcher() i=0 2023-10-05T21:15:12.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.866+0000 7fd9a563b680 2 removed watcher, disabling cache 2023-10-05T21:15:12.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.866+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94656584955856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f2290 con 0x5616f41e69f0 2023-10-05T21:15:12.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.867+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94656584955856] v29'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.867+0000 7fd9a563b680 20 remove_watcher() i=1 2023-10-05T21:15:12.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.867+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94656584960256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f2290 con 0x5616f41eb2a0 2023-10-05T21:15:12.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.868+0000 7fd998713700 1 -- 172.21.15.153:0/2555660682 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94656584960256] v29'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd980019040 con 0x5616f41eb2a0 2023-10-05T21:15:12.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.868+0000 7fd9a563b680 20 remove_watcher() i=2 2023-10-05T21:15:12.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.868+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94656584953648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f4900 con 0x5616f412a0a0 2023-10-05T21:15:12.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.868+0000 7fd997f12700 1 -- 172.21.15.153:0/2555660682 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94656584953648] v29'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd988006070 con 0x5616f412a0a0 2023-10-05T21:15:12.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.868+0000 7fd9a563b680 20 remove_watcher() i=3 2023-10-05T21:15:12.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.868+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94656584965248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f2f30 con 0x5616f41e69f0 2023-10-05T21:15:12.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.869+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94656584965248] v29'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.869+0000 7fd9a563b680 20 remove_watcher() i=4 2023-10-05T21:15:12.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.869+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94656584969488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f5c80 con 0x7fd98800d3d0 2023-10-05T21:15:12.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.870+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94656584969488] v29'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd99000a570 con 0x7fd98800d3d0 2023-10-05T21:15:12.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.870+0000 7fd9a563b680 20 remove_watcher() i=5 2023-10-05T21:15:12.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.870+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94656584971584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f6d10 con 0x7fd98800d3d0 2023-10-05T21:15:12.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.871+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94656584971584] v29'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd99000a570 con 0x7fd98800d3d0 2023-10-05T21:15:12.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.871+0000 7fd9a563b680 20 remove_watcher() i=6 2023-10-05T21:15:12.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.871+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94656584972688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f5c80 con 0x7fd98800d3d0 2023-10-05T21:15:12.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.872+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94656584972688] v29'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd99000a570 con 0x7fd98800d3d0 2023-10-05T21:15:12.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.872+0000 7fd9a563b680 20 remove_watcher() i=7 2023-10-05T21:15:12.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.872+0000 7fd969fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:12.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.872+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:112 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94656584975648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5616f41f6d10 con 0x5616f41e69f0 2023-10-05T21:15:12.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.873+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(112 data_loggenerations_metadata [watch unwatch cookie 94656584975648] v29'55 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd99000a570 con 0x5616f41e69f0 2023-10-05T21:15:12.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.873+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fd98800d3d0 msgr2=0x7fd98800d820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.873+0000 7fd9a563b680 1 --2- 172.21.15.153:0/2555660682 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fd98800d3d0 0x7fd98800d820 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.873+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5616f41e69f0 msgr2=0x5616f41e8e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.873+0000 7fd9a563b680 1 --2- 172.21.15.153:0/2555660682 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5616f41e69f0 0x5616f41e8e80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.873+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x5616f412a0a0 msgr2=0x7fd980049190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.873+0000 7fd9a563b680 1 --2- 172.21.15.153:0/2555660682 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x5616f412a0a0 0x7fd980049190 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.873+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5616f41eb2a0 msgr2=0x5616f41ed680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.873+0000 7fd9a563b680 1 --2- 172.21.15.153:0/2555660682 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5616f41eb2a0 0x5616f41ed680 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.873+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd978034130 msgr2=0x7fd9780365e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.873+0000 7fd9a563b680 1 --2- 172.21.15.153:0/2555660682 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd978034130 0x7fd9780365e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd988004170 tx=0x7fd988001380 comp rx=0 tx=0).stop 2023-10-05T21:15:12.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.873+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616f41b95d0 msgr2=0x5616f41dcd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.873+0000 7fd9a563b680 1 --2- 172.21.15.153:0/2555660682 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616f41b95d0 0x5616f41dcd00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd98000a520 tx=0x7fd98001d000 comp rx=0 tx=0).stop 2023-10-05T21:15:12.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.873+0000 7fd998f14700 1 -- 172.21.15.153:0/2555660682 reap_dead start 2023-10-05T21:15:12.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.873+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 shutdown_connections 2023-10-05T21:15:12.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.873+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 >> 172.21.15.153:0/2555660682 conn(0x5616f41b0b80 msgr2=0x5616f41cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.873+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 shutdown_connections 2023-10-05T21:15:12.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.873+0000 7fd9a563b680 1 -- 172.21.15.153:0/2555660682 wait complete. 2023-10-05T21:15:12.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.874+0000 7fd9a563b680 1 -- 172.21.15.153:0/583730283 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd8d8034190 msgr2=0x7fd8d8036640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.874+0000 7fd9a563b680 1 --2- 172.21.15.153:0/583730283 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd8d8034190 0x7fd8d8036640 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x5616f41f7fe0 tx=0x7fd99000aee0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.874+0000 7fd9a563b680 1 -- 172.21.15.153:0/583730283 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616f4206250 msgr2=0x5616f420bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.874+0000 7fd9a563b680 1 --2- 172.21.15.153:0/583730283 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616f4206250 0x5616f420bdb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd98800b9a0 tx=0x7fd988030000 comp rx=0 tx=0).stop 2023-10-05T21:15:12.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.874+0000 7fd9a563b680 1 -- 172.21.15.153:0/583730283 shutdown_connections 2023-10-05T21:15:12.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.874+0000 7fd9a563b680 1 --2- 172.21.15.153:0/583730283 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd8d8034190 0x7fd8d8036640 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.874+0000 7fd9a563b680 1 --2- 172.21.15.153:0/583730283 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616f4206250 0x5616f420bdb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.874+0000 7fd9a563b680 1 -- 172.21.15.153:0/583730283 >> 172.21.15.153:0/583730283 conn(0x5616f4201450 msgr2=0x5616f41ff580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.874+0000 7fd9a563b680 1 -- 172.21.15.153:0/583730283 shutdown_connections 2023-10-05T21:15:12.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.874+0000 7fd9a563b680 1 -- 172.21.15.153:0/583730283 wait complete. 2023-10-05T21:15:12.911 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:15:12.911 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2023-10-05T21:15:12.911 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2023-10-05T21:15:12.911 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2023-10-05T21:15:12.955 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:12.955 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:12.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.954+0000 7f4bf8b71680 1 Processor -- start 2023-10-05T21:15:12.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.954+0000 7f4bf8b71680 1 -- start start 2023-10-05T21:15:12.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.955+0000 7f4bf8b71680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55b404faa2b0 0x55b404faa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.955+0000 7f4bf8b71680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b404ef8990 con 0x55b404faac00 2023-10-05T21:15:12.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.955+0000 7f4bf8b71680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b404eb8db0 con 0x55b404faa2b0 2023-10-05T21:15:12.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.955+0000 7f4bebc49700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55b404faa2b0 0x55b404faa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.955+0000 7f4beb448700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55b404faac00 0x55b404fab5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56222/0 (socket says 172.21.15.153:56222) 2023-10-05T21:15:12.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.955+0000 7f4beb448700 1 -- 172.21.15.153:0/1715860265 learned_addr learned my addr 172.21.15.153:0/1715860265 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:12.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.955+0000 7f4bebc49700 1 -- 172.21.15.153:0/1715860265 >> v1:172.21.15.111:6789/0 conn(0x55b404faac00 legacy=0x55b404fab5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.955+0000 7f4beac47700 1 -- 172.21.15.153:0/1715860265 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1428862337 0 0) 0x55b404ef8990 con 0x55b404faac00 2023-10-05T21:15:12.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.955+0000 7f4bebc49700 1 -- 172.21.15.153:0/1715860265 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b404fabea0 con 0x55b404faa2b0 2023-10-05T21:15:12.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.955+0000 7f4bebc49700 1 --2- 172.21.15.153:0/1715860265 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404faa2b0 0x55b404faa6c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc00a5d0 tx=0x7f4bdc005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84ee69beed09a21c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.955+0000 7f4beac47700 1 -- 172.21.15.153:0/1715860265 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4bdc0086a0 con 0x55b404faa2b0 2023-10-05T21:15:12.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.955+0000 7f4beac47700 1 -- 172.21.15.153:0/1715860265 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bdc008800 con 0x55b404faa2b0 2023-10-05T21:15:12.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.955+0000 7f4beac47700 1 -- 172.21.15.153:0/1715860265 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4bdc008ad0 con 0x55b404faa2b0 2023-10-05T21:15:12.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.956+0000 7f4bf8b71680 1 -- 172.21.15.153:0/1715860265 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404faa2b0 msgr2=0x55b404faa6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.956+0000 7f4bf8b71680 1 --2- 172.21.15.153:0/1715860265 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404faa2b0 0x55b404faa6c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc00a5d0 tx=0x7f4bdc005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:12.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.956+0000 7f4bf8b71680 1 -- 172.21.15.153:0/1715860265 shutdown_connections 2023-10-05T21:15:12.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.956+0000 7f4bf8b71680 1 --2- 172.21.15.153:0/1715860265 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404faa2b0 0x55b404faa6c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.956+0000 7f4bf8b71680 1 -- 172.21.15.153:0/1715860265 >> 172.21.15.153:0/1715860265 conn(0x55b404fa5b80 msgr2=0x55b404fa7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.956+0000 7f4bf8b71680 1 -- 172.21.15.153:0/1715860265 shutdown_connections 2023-10-05T21:15:12.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.956+0000 7f4bf8b71680 1 -- 172.21.15.153:0/1715860265 wait complete. 2023-10-05T21:15:12.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.957+0000 7f4bf8b71680 1 Processor -- start 2023-10-05T21:15:12.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.957+0000 7f4bf8b71680 1 -- start start 2023-10-05T21:15:12.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.957+0000 7f4bf8b71680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404faa2b0 0x55b404fc8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.957+0000 7f4bf8b71680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b404e58ea0 con 0x55b404faa2b0 2023-10-05T21:15:12.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.957+0000 7f4bebc49700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404faa2b0 0x55b404fc8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.957+0000 7f4bebc49700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404faa2b0 0x55b404fc8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49448/0 (socket says 172.21.15.153:49448) 2023-10-05T21:15:12.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.957+0000 7f4bebc49700 1 -- 172.21.15.153:0/2335909970 learned_addr learned my addr 172.21.15.153:0/2335909970 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.957+0000 7f4bebc49700 1 -- 172.21.15.153:0/2335909970 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bdc005cf0 con 0x55b404faa2b0 2023-10-05T21:15:12.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.957+0000 7f4bebc49700 1 --2- 172.21.15.153:0/2335909970 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404faa2b0 0x55b404fc8500 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc000c00 tx=0x7f4bdc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdfc8673a3cf099a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.958+0000 7f4be9c45700 1 -- 172.21.15.153:0/2335909970 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4bdc0086a0 con 0x55b404faa2b0 2023-10-05T21:15:12.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.958+0000 7f4be9c45700 1 -- 172.21.15.153:0/2335909970 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bdc008970 con 0x55b404faa2b0 2023-10-05T21:15:12.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.958+0000 7f4be9c45700 1 -- 172.21.15.153:0/2335909970 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4bdc008b20 con 0x55b404faa2b0 2023-10-05T21:15:12.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.958+0000 7f4bf8b71680 1 -- 172.21.15.153:0/2335909970 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404faa2b0 msgr2=0x55b404fc8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:12.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.958+0000 7f4bf8b71680 1 --2- 172.21.15.153:0/2335909970 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404faa2b0 0x55b404fc8500 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc000c00 tx=0x7f4bdc015000 comp rx=0 tx=0).stop 2023-10-05T21:15:12.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.958+0000 7f4bf8b71680 1 -- 172.21.15.153:0/2335909970 shutdown_connections 2023-10-05T21:15:12.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.958+0000 7f4bf8b71680 1 --2- 172.21.15.153:0/2335909970 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404faa2b0 0x55b404fc8500 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:12.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.958+0000 7f4bf8b71680 1 -- 172.21.15.153:0/2335909970 >> 172.21.15.153:0/2335909970 conn(0x55b404fa5b80 msgr2=0x55b404fc3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:12.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.958+0000 7f4bf8b71680 1 -- 172.21.15.153:0/2335909970 shutdown_connections 2023-10-05T21:15:12.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.958+0000 7f4bf8b71680 1 -- 172.21.15.153:0/2335909970 wait complete. 2023-10-05T21:15:12.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.958+0000 7f4bf8b71680 1 Processor -- start 2023-10-05T21:15:12.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.959+0000 7f4bf8b71680 1 -- start start 2023-10-05T21:15:12.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.959+0000 7f4bf8b71680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404faa2b0 0x55b404fd3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.959+0000 7f4bf8b71680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b404e4fc80 con 0x55b404faa2b0 2023-10-05T21:15:12.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.959+0000 7f4bebc49700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404faa2b0 0x55b404fd3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.959+0000 7f4bebc49700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404faa2b0 0x55b404fd3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49450/0 (socket says 172.21.15.153:49450) 2023-10-05T21:15:12.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.959+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 learned_addr learned my addr 172.21.15.153:0/499871302 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:12.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.959+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b404fabea0 con 0x55b404faa2b0 2023-10-05T21:15:12.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.959+0000 7f4bebc49700 1 --2- 172.21.15.153:0/499871302 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404faa2b0 0x55b404fd3c90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc01f040 tx=0x7f4bdc01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.959+0000 7f4bd3fff700 1 -- 172.21.15.153:0/499871302 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4bdc01d420 con 0x55b404faa2b0 2023-10-05T21:15:12.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.960+0000 7f4bd3fff700 1 -- 172.21.15.153:0/499871302 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bdc01d580 con 0x55b404faa2b0 2023-10-05T21:15:12.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.960+0000 7f4bd3fff700 1 -- 172.21.15.153:0/499871302 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4bdc01d710 con 0x55b404faa2b0 2023-10-05T21:15:12.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.960+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b404fd41d0 con 0x55b404faa2b0 2023-10-05T21:15:12.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.960+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b404fd45c0 con 0x55b404faa2b0 2023-10-05T21:15:12.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.960+0000 7f4bd3fff700 1 -- 172.21.15.153:0/499871302 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f4bdc01d980 con 0x55b404faa2b0 2023-10-05T21:15:12.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.961+0000 7f4bf8b71680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.961+0000 7f4bd3fff700 1 --2- 172.21.15.153:0/499871302 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4bd8034140 0x7f4bd80365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.961+0000 7f4bd3fff700 1 -- 172.21.15.153:0/499871302 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f4bdc04a1d0 con 0x55b404faa2b0 2023-10-05T21:15:12.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.961+0000 7f4beb448700 1 --2- 172.21.15.153:0/499871302 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4bd8034140 0x7f4bd80365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.961+0000 7f4bf8b71680 1 --2- 172.21.15.153:0/499871302 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55b404fdd990 0x55b404fdfe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.961+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe05d0 con 0x55b404fdd990 2023-10-05T21:15:12.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.961+0000 7f4bec44a700 1 --2- 172.21.15.153:0/499871302 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55b404fdd990 0x55b404fdfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.961+0000 7f4beb448700 1 --2- 172.21.15.153:0/499871302 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4bd8034140 0x7f4bd80365f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4be00011e0 tx=0x7f4be0001340 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.961+0000 7f4bec44a700 1 --2- 172.21.15.153:0/499871302 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55b404fdd990 0x55b404fdfe40 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.962+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:12.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.962+0000 7f4bf8b71680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.962+0000 7f4bf8b71680 20 realm 2023-10-05T21:15:12.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.962+0000 7f4bf8b71680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.962+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fdd000 con 0x55b404fdd990 2023-10-05T21:15:12.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.962+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:12.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.962+0000 7f4bf8b71680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.962+0000 7f4bf8b71680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:12.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.962+0000 7f4bf8b71680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.962+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe10d0 con 0x55b404fdd990 2023-10-05T21:15:12.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.962+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:12.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.962+0000 7f4bf8b71680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.962+0000 7f4bf8b71680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.962+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe0d20 con 0x55b404fdd990 2023-10-05T21:15:12.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.962+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:12.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.962+0000 7f4bf8b71680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.962+0000 7f4bf8b71680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.962+0000 7f4bf8b71680 1 --2- 172.21.15.153:0/499871302 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b404fe2490 0x55b404fe4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.962+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe4db0 con 0x55b404fe2490 2023-10-05T21:15:12.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.962+0000 7f4bebc49700 1 --2- 172.21.15.153:0/499871302 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b404fe2490 0x55b404fe4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.963+0000 7f4bebc49700 1 --2- 172.21.15.153:0/499871302 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b404fe2490 0x55b404fe4870 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.963+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f4bdc036070 con 0x55b404fe2490 2023-10-05T21:15:12.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.963+0000 7f4bf8b71680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:12.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.963+0000 7f4bf8b71680 20 searching for the correct realm 2023-10-05T21:15:12.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.963+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x55b404fe2490 2023-10-05T21:15:12.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.963+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bdc036070 con 0x55b404fe2490 2023-10-05T21:15:12.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.963+0000 7f4bebc49700 1 --2- 172.21.15.153:0/499871302 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4bdc030020 0x7f4bdc02f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.963+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x7f4bdc030020 2023-10-05T21:15:12.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.963+0000 7f4beb448700 1 --2- 172.21.15.153:0/499871302 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4bdc030020 0x7f4bdc02f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.964+0000 7f4beb448700 1 --2- 172.21.15.153:0/499871302 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4bdc030020 0x7f4bdc02f3a0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.964+0000 7f4beb448700 1 -- 172.21.15.153:0/499871302 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be0006070 con 0x7f4bdc030020 2023-10-05T21:15:12.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.964+0000 7f4beb448700 1 --2- 172.21.15.153:0/499871302 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4be000d8e0 0x7f4be000c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:12.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.964+0000 7f4beb448700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x7f4be000d8e0 2023-10-05T21:15:12.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.964+0000 7f4bec44a700 1 --2- 172.21.15.153:0/499871302 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4be000d8e0 0x7f4be000c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:12.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.964+0000 7f4bec44a700 1 --2- 172.21.15.153:0/499871302 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4be000d8e0 0x7f4be000c360 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:12.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.965+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a570 con 0x7f4be000d8e0 2023-10-05T21:15:12.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.965+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x55b404fdd990 2023-10-05T21:15:12.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.965+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:12.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.965+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x55b404fdd990 2023-10-05T21:15:12.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.965+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:12.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.965+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x7f4be000d8e0 2023-10-05T21:15:12.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.965+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a570 con 0x7f4be000d8e0 2023-10-05T21:15:12.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.965+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x7f4be000d8e0 2023-10-05T21:15:12.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.965+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a570 con 0x7f4be000d8e0 2023-10-05T21:15:12.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.965+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x7f4bdc030020 2023-10-05T21:15:12.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.966+0000 7f4beb448700 1 -- 172.21.15.153:0/499871302 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be0006070 con 0x7f4bdc030020 2023-10-05T21:15:12.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.966+0000 7f4beb448700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x55b404fe2490 2023-10-05T21:15:12.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.966+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4bdc036070 con 0x55b404fe2490 2023-10-05T21:15:12.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.966+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x55b404fdd990 2023-10-05T21:15:12.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.966+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:12.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.966+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x7f4be000d8e0 2023-10-05T21:15:12.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.966+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a570 con 0x7f4be000d8e0 2023-10-05T21:15:12.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.966+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x55b404fdd990 2023-10-05T21:15:12.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.967+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:12.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.967+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x7f4bdc030020 2023-10-05T21:15:12.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.967+0000 7f4beb448700 1 -- 172.21.15.153:0/499871302 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be0006070 con 0x7f4bdc030020 2023-10-05T21:15:12.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.967+0000 7f4beb448700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x55b404fe2490 2023-10-05T21:15:12.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.967+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bdc036070 con 0x55b404fe2490 2023-10-05T21:15:12.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.967+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x55b404fe2490 2023-10-05T21:15:12.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.967+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bdc036070 con 0x55b404fe2490 2023-10-05T21:15:12.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.967+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x7f4be000d8e0 2023-10-05T21:15:12.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.968+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a570 con 0x7f4be000d8e0 2023-10-05T21:15:12.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.968+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x55b404fe2490 2023-10-05T21:15:12.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.968+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bdc036070 con 0x55b404fe2490 2023-10-05T21:15:12.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.968+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x55b404fe2490 2023-10-05T21:15:12.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.968+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bdc036070 con 0x55b404fe2490 2023-10-05T21:15:12.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.968+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x55b404fdd990 2023-10-05T21:15:12.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.968+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:12.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.968+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x55b404fdd990 2023-10-05T21:15:12.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.968+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:12.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.968+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x7f4be000d8e0 2023-10-05T21:15:12.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.969+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a570 con 0x7f4be000d8e0 2023-10-05T21:15:12.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.969+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x55b404fe2490 2023-10-05T21:15:12.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.969+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bdc036070 con 0x55b404fe2490 2023-10-05T21:15:12.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.969+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x7f4bdc030020 2023-10-05T21:15:12.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.969+0000 7f4beb448700 1 -- 172.21.15.153:0/499871302 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be0006070 con 0x7f4bdc030020 2023-10-05T21:15:12.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.969+0000 7f4beb448700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x55b404fdd990 2023-10-05T21:15:12.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.969+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:12.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.969+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x7f4be000d8e0 2023-10-05T21:15:12.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.970+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a570 con 0x7f4be000d8e0 2023-10-05T21:15:12.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.970+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x55b404fe2490 2023-10-05T21:15:12.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.970+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bdc036070 con 0x55b404fe2490 2023-10-05T21:15:12.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.970+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x7f4be000d8e0 2023-10-05T21:15:12.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.970+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a570 con 0x7f4be000d8e0 2023-10-05T21:15:12.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.970+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x7f4bdc030020 2023-10-05T21:15:12.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.970+0000 7f4beb448700 1 -- 172.21.15.153:0/499871302 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be0006070 con 0x7f4bdc030020 2023-10-05T21:15:12.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.970+0000 7f4beb448700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x55b404fe2490 2023-10-05T21:15:12.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.971+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bdc036070 con 0x55b404fe2490 2023-10-05T21:15:12.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.971+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x7f4be000d8e0 2023-10-05T21:15:12.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.971+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a570 con 0x7f4be000d8e0 2023-10-05T21:15:12.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.971+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x55b404fdd990 2023-10-05T21:15:12.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.971+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:12.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.971+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6660 con 0x7f4bdc030020 2023-10-05T21:15:12.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.971+0000 7f4beb448700 1 -- 172.21.15.153:0/499871302 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be0006070 con 0x7f4bdc030020 2023-10-05T21:15:12.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.971+0000 7f4bf8b71680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:12.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.971+0000 7f4bf8b71680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:12.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.971+0000 7f4bf8b71680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:12.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.971+0000 7f4bf8b71680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:12.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.971+0000 7f4bf8b71680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.971+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5700 con 0x55b404fdd990 2023-10-05T21:15:12.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.971+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:12.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.971+0000 7f4bf8b71680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.971+0000 7f4bf8b71680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.971+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5330 con 0x55b404fdd990 2023-10-05T21:15:12.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.972+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:12.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.972+0000 7f4bf8b71680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:12.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.972+0000 7f4bf8b71680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.972+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5ba0 con 0x55b404fdd990 2023-10-05T21:15:12.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.972+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:12.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.972+0000 7f4bf8b71680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:12.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.972+0000 7f4bf8b71680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.972+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6190 con 0x55b404fe2490 2023-10-05T21:15:12.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.972+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f4bdc036070 con 0x55b404fe2490 2023-10-05T21:15:12.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.972+0000 7f4bf8b71680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:12.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.972+0000 7f4bf8b71680 20 rados->read ofs=0 len=0 2023-10-05T21:15:12.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.972+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6f00 con 0x55b404fdd990 2023-10-05T21:15:12.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.972+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:12.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.972+0000 7f4bf8b71680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.972+0000 7f4bf8b71680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.972+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6ff0 con 0x55b404fdd990 2023-10-05T21:15:13.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.973+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:13.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.973+0000 7f4bf8b71680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.973+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6fc0 con 0x55b404fe2490 2023-10-05T21:15:13.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.973+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bdc036070 con 0x55b404fe2490 2023-10-05T21:15:13.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.973+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6fc0 con 0x7f4bdc030020 2023-10-05T21:15:13.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.973+0000 7f4beb448700 1 -- 172.21.15.153:0/499871302 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be0006070 con 0x7f4bdc030020 2023-10-05T21:15:13.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.973+0000 7f4beb448700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6fc0 con 0x7f4be000d8e0 2023-10-05T21:15:13.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.974+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a570 con 0x7f4be000d8e0 2023-10-05T21:15:13.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.974+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5ba0 con 0x55b404fdd990 2023-10-05T21:15:13.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.974+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:13.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.974+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5ba0 con 0x55b404fdd990 2023-10-05T21:15:13.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.974+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:13.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.974+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5ba0 con 0x7f4be000d8e0 2023-10-05T21:15:13.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.974+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a570 con 0x7f4be000d8e0 2023-10-05T21:15:13.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.974+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5ba0 con 0x7f4be000d8e0 2023-10-05T21:15:13.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.974+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a570 con 0x7f4be000d8e0 2023-10-05T21:15:13.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.974+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5ba0 con 0x7f4bdc030020 2023-10-05T21:15:13.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.975+0000 7f4beb448700 1 -- 172.21.15.153:0/499871302 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be0006070 con 0x7f4bdc030020 2023-10-05T21:15:13.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.975+0000 7f4beb448700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5ba0 con 0x55b404fe2490 2023-10-05T21:15:13.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.975+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4bdc036070 con 0x55b404fe2490 2023-10-05T21:15:13.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.975+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5ba0 con 0x55b404fdd990 2023-10-05T21:15:13.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.975+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:13.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.975+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5ba0 con 0x7f4be000d8e0 2023-10-05T21:15:13.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.975+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a570 con 0x7f4be000d8e0 2023-10-05T21:15:13.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.975+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5ba0 con 0x55b404fdd990 2023-10-05T21:15:13.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.975+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:13.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.975+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5ba0 con 0x7f4bdc030020 2023-10-05T21:15:13.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.976+0000 7f4beb448700 1 -- 172.21.15.153:0/499871302 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be0006070 con 0x7f4bdc030020 2023-10-05T21:15:13.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.976+0000 7f4beb448700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5ba0 con 0x55b404fe2490 2023-10-05T21:15:13.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.976+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bdc036070 con 0x55b404fe2490 2023-10-05T21:15:13.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.976+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5ba0 con 0x55b404fe2490 2023-10-05T21:15:13.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.976+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bdc036070 con 0x55b404fe2490 2023-10-05T21:15:13.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.976+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5ba0 con 0x7f4be000d8e0 2023-10-05T21:15:13.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.976+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a570 con 0x7f4be000d8e0 2023-10-05T21:15:13.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.976+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5ba0 con 0x55b404fe2490 2023-10-05T21:15:13.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.976+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bdc036070 con 0x55b404fe2490 2023-10-05T21:15:13.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.976+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5ba0 con 0x55b404fe2490 2023-10-05T21:15:13.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.977+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bdc036070 con 0x55b404fe2490 2023-10-05T21:15:13.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.977+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5ba0 con 0x55b404fdd990 2023-10-05T21:15:13.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.977+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:13.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.977+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5ba0 con 0x55b404fdd990 2023-10-05T21:15:13.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.977+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:13.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.977+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5ba0 con 0x7f4be000d8e0 2023-10-05T21:15:13.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.977+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a570 con 0x7f4be000d8e0 2023-10-05T21:15:13.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.977+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5ba0 con 0x55b404fe2490 2023-10-05T21:15:13.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.977+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bdc036070 con 0x55b404fe2490 2023-10-05T21:15:13.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.977+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5ba0 con 0x7f4bdc030020 2023-10-05T21:15:13.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.978+0000 7f4beb448700 1 -- 172.21.15.153:0/499871302 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be0006070 con 0x7f4bdc030020 2023-10-05T21:15:13.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.978+0000 7f4beb448700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5ba0 con 0x55b404fdd990 2023-10-05T21:15:13.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.978+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:13.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.978+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5ba0 con 0x7f4be000d8e0 2023-10-05T21:15:13.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.978+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a570 con 0x7f4be000d8e0 2023-10-05T21:15:13.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.978+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5ba0 con 0x55b404fe2490 2023-10-05T21:15:13.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.978+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bdc036070 con 0x55b404fe2490 2023-10-05T21:15:13.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.978+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5ba0 con 0x7f4be000d8e0 2023-10-05T21:15:13.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.978+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a570 con 0x7f4be000d8e0 2023-10-05T21:15:13.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.978+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5ba0 con 0x7f4bdc030020 2023-10-05T21:15:13.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.979+0000 7f4beb448700 1 -- 172.21.15.153:0/499871302 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be0006070 con 0x7f4bdc030020 2023-10-05T21:15:13.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.979+0000 7f4beb448700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5ba0 con 0x55b404fe2490 2023-10-05T21:15:13.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.979+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bdc036070 con 0x55b404fe2490 2023-10-05T21:15:13.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.979+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5ba0 con 0x7f4be000d8e0 2023-10-05T21:15:13.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.979+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a570 con 0x7f4be000d8e0 2023-10-05T21:15:13.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.979+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5ba0 con 0x55b404fdd990 2023-10-05T21:15:13.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.979+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:13.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.979+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe5ba0 con 0x7f4bdc030020 2023-10-05T21:15:13.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.979+0000 7f4beb448700 1 -- 172.21.15.153:0/499871302 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be0006070 con 0x7f4bdc030020 2023-10-05T21:15:13.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.980+0000 7f4bf8b71680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:13.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.980+0000 7f4bf8b71680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:13.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.980+0000 7f4bf8b71680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:13.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.980+0000 7f4bf8b71680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:13.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.980+0000 7f4bf8b71680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.980+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe6fc0 con 0x55b404fdd990 2023-10-05T21:15:13.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.980+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:13.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.980+0000 7f4bf8b71680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.980+0000 7f4bf8b71680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.980+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe7420 con 0x55b404fe2490 2023-10-05T21:15:13.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.980+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f4bdc036070 con 0x55b404fe2490 2023-10-05T21:15:13.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.980+0000 7f4bf8b71680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:13.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.980+0000 7f4bf8b71680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.980+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe7d10 con 0x55b404fdd990 2023-10-05T21:15:13.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.980+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:13.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.980+0000 7f4bf8b71680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.980+0000 7f4bf8b71680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.980+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe7d10 con 0x55b404fdd990 2023-10-05T21:15:13.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.980+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:13.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.980+0000 7f4bf8b71680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:13.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.981+0000 7f4bf8b71680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.981+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe7e10 con 0x7f4be000d8e0 2023-10-05T21:15:13.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.981+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f4be400a570 con 0x7f4be000d8e0 2023-10-05T21:15:13.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.981+0000 7f4bf8b71680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.981+0000 7f4bf8b71680 20 zone default found 2023-10-05T21:15:13.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.981+0000 7f4bf8b71680 4 Realm: () 2023-10-05T21:15:13.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.981+0000 7f4bf8b71680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:13.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.981+0000 7f4bf8b71680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:13.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.981+0000 7f4bf8b71680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:13.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.981+0000 7f4bf8b71680 20 zonegroup default 2023-10-05T21:15:13.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.981+0000 7f4bf8b71680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.981+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe7e10 con 0x7f4be000d8e0 2023-10-05T21:15:13.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.981+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4be400a570 con 0x7f4be000d8e0 2023-10-05T21:15:13.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.981+0000 7f4bf8b71680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.981+0000 7f4bf8b71680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.981+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe9790 con 0x55b404fe2490 2023-10-05T21:15:13.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.981+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4bdc036070 con 0x55b404fe2490 2023-10-05T21:15:13.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.981+0000 7f4bf8b71680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.981+0000 7f4bf8b71680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.981+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe9b40 con 0x55b404fe2490 2023-10-05T21:15:13.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.982+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4bdc036070 con 0x55b404fe2490 2023-10-05T21:15:13.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.982+0000 7f4bf8b71680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.982+0000 7f4bf8b71680 20 started sync module instance, tier type = 2023-10-05T21:15:13.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.982+0000 7f4bf8b71680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:13.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.982+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe8ea0 con 0x7f4bdc030020 2023-10-05T21:15:13.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.982+0000 7f4beb448700 1 -- 172.21.15.153:0/499871302 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4be0006070 con 0x7f4bdc030020 2023-10-05T21:15:13.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.982+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94231666266784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fea450 con 0x7f4bdc030020 2023-10-05T21:15:13.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.982+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404feacf0 con 0x55b404fdd990 2023-10-05T21:15:13.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.983+0000 7f4beb448700 1 -- 172.21.15.153:0/499871302 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94231666266784] v29'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4be0006070 con 0x7f4bdc030020 2023-10-05T21:15:13.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.983+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:13.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.983+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94231666270048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fead30 con 0x55b404fdd990 2023-10-05T21:15:13.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.983+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404feb930 con 0x55b404fe2490 2023-10-05T21:15:13.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.984+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94231666270048] v29'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:13.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.984+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4bdc036070 con 0x55b404fe2490 2023-10-05T21:15:13.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.984+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94231666275264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404febd30 con 0x55b404fe2490 2023-10-05T21:15:13.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.984+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fec740 con 0x7f4bdc030020 2023-10-05T21:15:13.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.985+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94231666275264] v29'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4bdc036070 con 0x55b404fe2490 2023-10-05T21:15:13.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.985+0000 7f4beb448700 1 -- 172.21.15.153:0/499871302 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4be0006070 con 0x7f4bdc030020 2023-10-05T21:15:13.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.985+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94231666278992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fecaf0 con 0x7f4bdc030020 2023-10-05T21:15:13.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.985+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fed500 con 0x55b404fdd990 2023-10-05T21:15:13.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.985+0000 7f4beb448700 1 -- 172.21.15.153:0/499871302 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94231666278992] v29'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4be0006070 con 0x7f4bdc030020 2023-10-05T21:15:13.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.986+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:13.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.986+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94231666282512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fed950 con 0x55b404fdd990 2023-10-05T21:15:13.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.986+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fee250 con 0x7f4be000d8e0 2023-10-05T21:15:13.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.986+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94231666282512] v29'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:13.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.986+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4be400a570 con 0x7f4be000d8e0 2023-10-05T21:15:13.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.986+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94231666283616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fedda0 con 0x7f4be000d8e0 2023-10-05T21:15:13.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.986+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404feecf0 con 0x7f4be000d8e0 2023-10-05T21:15:13.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.987+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94231666283616] v29'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4be400a570 con 0x7f4be000d8e0 2023-10-05T21:15:13.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.987+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4be400a570 con 0x7f4be000d8e0 2023-10-05T21:15:13.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.987+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94231666288576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fedda0 con 0x7f4be000d8e0 2023-10-05T21:15:13.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.987+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fef770 con 0x7f4be000d8e0 2023-10-05T21:15:13.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.988+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94231666288576] v29'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4be400a570 con 0x7f4be000d8e0 2023-10-05T21:15:13.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.988+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4be400a570 con 0x7f4be000d8e0 2023-10-05T21:15:13.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.988+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94231666291296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fedde0 con 0x7f4be000d8e0 2023-10-05T21:15:13.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.988+0000 7f4bf8b71680 20 add_watcher() i=0 2023-10-05T21:15:13.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.988+0000 7f4bf8b71680 20 add_watcher() i=1 2023-10-05T21:15:13.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.988+0000 7f4bf8b71680 20 add_watcher() i=2 2023-10-05T21:15:13.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.988+0000 7f4bf8b71680 20 add_watcher() i=3 2023-10-05T21:15:13.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.988+0000 7f4bf8b71680 20 add_watcher() i=4 2023-10-05T21:15:13.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.988+0000 7f4bf8b71680 20 add_watcher() i=5 2023-10-05T21:15:13.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.988+0000 7f4bf8b71680 20 add_watcher() i=6 2023-10-05T21:15:13.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.988+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94231666291296] v29'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4be400a570 con 0x7f4be000d8e0 2023-10-05T21:15:13.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.988+0000 7f4bf8b71680 20 add_watcher() i=7 2023-10-05T21:15:13.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.988+0000 7f4bf8b71680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:13.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.988+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404ff3080 con 0x55b404fdd990 2023-10-05T21:15:13.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.989+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:13.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.989+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94231666293600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404ff04a0 con 0x55b404fdd990 2023-10-05T21:15:13.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.989+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94231666293600] v29'56 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:13.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.990+0000 7f4bbd7e2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:13.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.990+0000 7f4bf8b71680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:13.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.990+0000 7f4bf8b71680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:13.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.990+0000 7f4bf8b71680 1 Processor -- start 2023-10-05T21:15:13.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.990+0000 7f4bf8b71680 1 -- start start 2023-10-05T21:15:13.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.990+0000 7f4bf8b71680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404ffcb40 0x55b404ffcf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.990+0000 7f4bf8b71680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b404ffd560 con 0x55b404ffcb40 2023-10-05T21:15:13.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.990+0000 7f4beb448700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404ffcb40 0x55b404ffcf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.990+0000 7f4beb448700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404ffcb40 0x55b404ffcf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49454/0 (socket says 172.21.15.153:49454) 2023-10-05T21:15:13.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.990+0000 7f4beb448700 1 -- 172.21.15.153:0/1342791992 learned_addr learned my addr 172.21.15.153:0/1342791992 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:13.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.991+0000 7f4beb448700 1 -- 172.21.15.153:0/1342791992 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b404ffda40 con 0x55b404ffcb40 2023-10-05T21:15:13.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.991+0000 7f4beb448700 1 --2- 172.21.15.153:0/1342791992 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404ffcb40 0x55b404ffcf50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55b404fe1be0 tx=0x7f4be0006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb10f3573f6eeade server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.991+0000 7f4bbcfe1700 1 -- 172.21.15.153:0/1342791992 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4be0023040 con 0x55b404ffcb40 2023-10-05T21:15:13.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.991+0000 7f4bbcfe1700 1 -- 172.21.15.153:0/1342791992 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be0024040 con 0x55b404ffcb40 2023-10-05T21:15:13.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.991+0000 7f4bbcfe1700 1 -- 172.21.15.153:0/1342791992 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4be0013040 con 0x55b404ffcb40 2023-10-05T21:15:13.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.992+0000 7f4bf8b71680 1 -- 172.21.15.153:0/1342791992 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404ffcb40 msgr2=0x55b404ffcf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.992+0000 7f4bf8b71680 1 --2- 172.21.15.153:0/1342791992 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404ffcb40 0x55b404ffcf50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55b404fe1be0 tx=0x7f4be0006000 comp rx=0 tx=0).stop 2023-10-05T21:15:13.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.992+0000 7f4bf8b71680 1 -- 172.21.15.153:0/1342791992 shutdown_connections 2023-10-05T21:15:13.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.992+0000 7f4bf8b71680 1 --2- 172.21.15.153:0/1342791992 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404ffcb40 0x55b404ffcf50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.992+0000 7f4bf8b71680 1 -- 172.21.15.153:0/1342791992 >> 172.21.15.153:0/1342791992 conn(0x55b404ff8e40 msgr2=0x55b404ff6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:13.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.992+0000 7f4bf8b71680 1 -- 172.21.15.153:0/1342791992 shutdown_connections 2023-10-05T21:15:13.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.992+0000 7f4bf8b71680 1 -- 172.21.15.153:0/1342791992 wait complete. 2023-10-05T21:15:13.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.992+0000 7f4bf8b71680 1 Processor -- start 2023-10-05T21:15:13.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.992+0000 7f4bf8b71680 1 -- start start 2023-10-05T21:15:13.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.992+0000 7f4bf8b71680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404ffcb40 0x55b405003840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.992+0000 7f4bf8b71680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b405003d80 con 0x55b404ffcb40 2023-10-05T21:15:13.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.992+0000 7f4beb448700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404ffcb40 0x55b405003840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.992+0000 7f4beb448700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404ffcb40 0x55b405003840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49466/0 (socket says 172.21.15.153:49466) 2023-10-05T21:15:13.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.992+0000 7f4beb448700 1 -- 172.21.15.153:0/1050666073 learned_addr learned my addr 172.21.15.153:0/1050666073 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:13.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.993+0000 7f4beb448700 1 -- 172.21.15.153:0/1050666073 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be000ed40 con 0x55b404ffcb40 2023-10-05T21:15:13.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.993+0000 7f4beb448700 1 --2- 172.21.15.153:0/1050666073 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404ffcb40 0x55b405003840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x55b404fe1480 tx=0x7f4be002f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.993+0000 7f4b36ffd700 1 -- 172.21.15.153:0/1050666073 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4be0023040 con 0x55b404ffcb40 2023-10-05T21:15:13.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.993+0000 7f4b36ffd700 1 -- 172.21.15.153:0/1050666073 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be003b580 con 0x55b404ffcb40 2023-10-05T21:15:13.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.993+0000 7f4b36ffd700 1 -- 172.21.15.153:0/1050666073 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4be003b730 con 0x55b404ffcb40 2023-10-05T21:15:13.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.993+0000 7f4bf8b71680 1 -- 172.21.15.153:0/1050666073 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b405003f80 con 0x55b404ffcb40 2023-10-05T21:15:13.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.993+0000 7f4bf8b71680 1 -- 172.21.15.153:0/1050666073 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b4050043d0 con 0x55b404ffcb40 2023-10-05T21:15:13.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.994+0000 7f4b36ffd700 1 -- 172.21.15.153:0/1050666073 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f4be003b890 con 0x55b404ffcb40 2023-10-05T21:15:13.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.994+0000 7f4b36ffd700 1 --2- 172.21.15.153:0/1050666073 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4b2c034140 0x7f4b2c0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.994+0000 7f4b36ffd700 1 -- 172.21.15.153:0/1050666073 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f4be0044ab0 con 0x55b404ffcb40 2023-10-05T21:15:13.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.994+0000 7f4bec44a700 1 --2- 172.21.15.153:0/1050666073 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4b2c034140 0x7f4b2c0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.994+0000 7f4bf8b71680 5 note: GC not initialized 2023-10-05T21:15:13.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.994+0000 7f4bec44a700 1 --2- 172.21.15.153:0/1050666073 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4b2c034140 0x7f4b2c0365f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x55b404fedc00 tx=0x7f4be4037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.995+0000 7f4b2bfff700 20 reqs_thread_entry: start 2023-10-05T21:15:13.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.995+0000 7f4b29ffb700 20 reqs_thread_entry: start 2023-10-05T21:15:13.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.995+0000 7f4bf8b71680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:13.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.995+0000 7f4bf8b71680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:13.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.995+0000 7f4b17fff700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:43 2023 2023-10-05T21:15:13.028 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:13.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.995+0000 7f4b177fe700 20 reqs_thread_entry: start 2023-10-05T21:15:13.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.995+0000 7f4bf8b71680 20 get_system_obj_state: rctx=0x7fff2aa09e88 obj=default.rgw.meta:users.uid:foo state=0x55b404e5e240 s->prefetch_data=0 2023-10-05T21:15:13.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.995+0000 7f4bf8b71680 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T21:15:13.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.995+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b405069150 con 0x55b404fdd990 2023-10-05T21:15:13.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.996+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:13.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.996+0000 7f4bf8b71680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T21:15:13.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.996+0000 7f4bf8b71680 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:13.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.996+0000 7f4bf8b71680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:13.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.996+0000 7f4bf8b71680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:13.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.996+0000 7f4bf8b71680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:13.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.996+0000 7f4bf8b71680 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:13.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.996+0000 7f4bf8b71680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.996+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b40506b6d0 con 0x55b404fdd990 2023-10-05T21:15:13.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.996+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:13.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.996+0000 7f4bf8b71680 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T21:15:13.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.996+0000 7f4bf8b71680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T21:15:13.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.996+0000 7f4bf8b71680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:13.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.996+0000 7f4bf8b71680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:13.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.996+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:104 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b40506bd50 con 0x7f4bdc030020 2023-10-05T21:15:13.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.996+0000 7f4beb448700 1 -- 172.21.15.153:0/499871302 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(104 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f4be0006070 con 0x7f4bdc030020 2023-10-05T21:15:13.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.997+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:105 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b40506d600 con 0x55b404fdd990 2023-10-05T21:15:13.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.997+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(105 foo [delete,create,call,writefull 0~357] v29'2 uv2 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:13.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.997+0000 7f4bf8b71680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T21:15:13.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.997+0000 7f4bf8b71680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:13.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.997+0000 7f4bf8b71680 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T21:15:13.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.997+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [notify cookie 94231666785360 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b4050680a0 con 0x55b404fdd990 2023-10-05T21:15:13.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.998+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== watch-notify(notify (1) cookie 94231666282512 notify 124554051585 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x7f4be40291f0 con 0x55b404fdd990 2023-10-05T21:15:13.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.998+0000 7f4be9c45700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051585 cookie 94231666282512 notifier 4292 bl.length()=533 2023-10-05T21:15:13.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.998+0000 7f4be9c45700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T21:15:13.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.998+0000 7f4be9c45700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:13.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.998+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(106 notify.4 [notify cookie 94231666785360 out=8b] v0'0 uv33 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:13.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.998+0000 7f4be9c45700 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f4bcc003d90 con 0x55b404fdd990 2023-10-05T21:15:13.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.998+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(107 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:13.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.998+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== watch-notify(notify_complete (2) cookie 94231666785360 notify 124554051585 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f4be402d040 con 0x55b404fdd990 2023-10-05T21:15:13.031 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:13.032 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "foo", 2023-10-05T21:15:13.032 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Foo", 2023-10-05T21:15:13.032 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "foo@foo.com", 2023-10-05T21:15:13.032 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 1, 2023-10-05T21:15:13.032 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 4, 2023-10-05T21:15:13.032 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [], 2023-10-05T21:15:13.032 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2023-10-05T21:15:13.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:13.032 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:13.032 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:13.033 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T21:15:13.033 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:13.033 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:13.033 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [], 2023-10-05T21:15:13.033 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2023-10-05T21:15:13.033 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2023-10-05T21:15:13.033 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2023-10-05T21:15:13.033 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2023-10-05T21:15:13.033 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2023-10-05T21:15:13.033 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:15:13.034 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:13.034 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:13.034 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:13.034 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:13.034 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:13.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:13.034 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2023-10-05T21:15:13.034 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:13.034 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:13.034 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:13.034 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:13.035 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:13.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:13.035 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2023-10-05T21:15:13.035 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2023-10-05T21:15:13.035 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [] 2023-10-05T21:15:13.035 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:13.035 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:15:13.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.998+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:108 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94231666266784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b405067c50 con 0x7f4bdc030020 2023-10-05T21:15:13.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.999+0000 7f4beb448700 1 -- 172.21.15.153:0/499871302 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(108 notify.0 [watch unwatch cookie 94231666266784] v29'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4be0006070 con 0x7f4bdc030020 2023-10-05T21:15:13.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.999+0000 7f4bf8b71680 20 remove_watcher() i=0 2023-10-05T21:15:13.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.999+0000 7f4bf8b71680 2 removed watcher, disabling cache 2023-10-05T21:15:13.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:12.999+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:109 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94231666270048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe92a0 con 0x55b404fdd990 2023-10-05T21:15:13.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.000+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 42 ==== osd_op_reply(109 notify.1 [watch unwatch cookie 94231666270048] v29'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:13.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.000+0000 7f4bf8b71680 20 remove_watcher() i=1 2023-10-05T21:15:13.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.000+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:110 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94231666275264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe92a0 con 0x55b404fe2490 2023-10-05T21:15:13.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.001+0000 7f4bebc49700 1 -- 172.21.15.153:0/499871302 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(110 notify.2 [watch unwatch cookie 94231666275264] v29'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4bdc036070 con 0x55b404fe2490 2023-10-05T21:15:13.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.001+0000 7f4bf8b71680 20 remove_watcher() i=2 2023-10-05T21:15:13.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.001+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:111 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94231666278992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fe92a0 con 0x7f4bdc030020 2023-10-05T21:15:13.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.001+0000 7f4beb448700 1 -- 172.21.15.153:0/499871302 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(111 notify.3 [watch unwatch cookie 94231666278992] v29'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4be0006070 con 0x7f4bdc030020 2023-10-05T21:15:13.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.001+0000 7f4bf8b71680 20 remove_watcher() i=3 2023-10-05T21:15:13.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.001+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:112 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94231666282512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fec250 con 0x55b404fdd990 2023-10-05T21:15:13.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.002+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 43 ==== osd_op_reply(112 notify.4 [watch unwatch cookie 94231666282512] v29'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:13.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.002+0000 7f4bf8b71680 20 remove_watcher() i=4 2023-10-05T21:15:13.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.002+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:113 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94231666283616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fed010 con 0x7f4be000d8e0 2023-10-05T21:15:13.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.003+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(113 notify.5 [watch unwatch cookie 94231666283616] v29'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4be400a570 con 0x7f4be000d8e0 2023-10-05T21:15:13.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.003+0000 7f4bf8b71680 20 remove_watcher() i=5 2023-10-05T21:15:13.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.003+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:114 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94231666288576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fec250 con 0x7f4be000d8e0 2023-10-05T21:15:13.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.003+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(114 notify.6 [watch unwatch cookie 94231666288576] v29'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4be400a570 con 0x7f4be000d8e0 2023-10-05T21:15:13.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.003+0000 7f4bf8b71680 20 remove_watcher() i=6 2023-10-05T21:15:13.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.003+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:115 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94231666291296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fee7c0 con 0x7f4be000d8e0 2023-10-05T21:15:13.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.004+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(115 notify.7 [watch unwatch cookie 94231666291296] v29'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4be400a570 con 0x7f4be000d8e0 2023-10-05T21:15:13.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.004+0000 7f4bf8b71680 20 remove_watcher() i=7 2023-10-05T21:15:13.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.005+0000 7f4bbd7e2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:13.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.005+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:116 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94231666293600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b404fec250 con 0x55b404fdd990 2023-10-05T21:15:13.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.006+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 <== osd.1 v2:172.21.15.153:6816/140456 44 ==== osd_op_reply(116 data_loggenerations_metadata [watch unwatch cookie 94231666293600] v29'57 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4be400a570 con 0x55b404fdd990 2023-10-05T21:15:13.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.006+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4be000d8e0 msgr2=0x7f4be000c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.006+0000 7f4bf8b71680 1 --2- 172.21.15.153:0/499871302 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4be000d8e0 0x7f4be000c360 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.006+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55b404fdd990 msgr2=0x55b404fdfe40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.006+0000 7f4bf8b71680 1 --2- 172.21.15.153:0/499871302 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55b404fdd990 0x55b404fdfe40 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.006+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4bdc030020 msgr2=0x7f4bdc02f3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.006+0000 7f4bf8b71680 1 --2- 172.21.15.153:0/499871302 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4bdc030020 0x7f4bdc02f3a0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.006+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b404fe2490 msgr2=0x55b404fe4870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.006+0000 7f4bf8b71680 1 --2- 172.21.15.153:0/499871302 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b404fe2490 0x55b404fe4870 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.006+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4bd8034140 msgr2=0x7f4bd80365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.006+0000 7f4bf8b71680 1 --2- 172.21.15.153:0/499871302 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4bd8034140 0x7f4bd80365f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4be00011e0 tx=0x7f4be0001340 comp rx=0 tx=0).stop 2023-10-05T21:15:13.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.006+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404faa2b0 msgr2=0x55b404fd3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.006+0000 7f4bec44a700 1 -- 172.21.15.153:0/499871302 reap_dead start 2023-10-05T21:15:13.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.006+0000 7f4bf8b71680 1 --2- 172.21.15.153:0/499871302 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404faa2b0 0x55b404fd3c90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc01f040 tx=0x7f4bdc01d000 comp rx=0 tx=0).stop 2023-10-05T21:15:13.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.006+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 shutdown_connections 2023-10-05T21:15:13.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.006+0000 7f4bf8b71680 1 --2- 172.21.15.153:0/499871302 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404faa2b0 0x55b404fd3c90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.006+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 >> 172.21.15.153:0/499871302 conn(0x55b404fa5b80 msgr2=0x55b404fc2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:13.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.006+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 shutdown_connections 2023-10-05T21:15:13.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.006+0000 7f4bf8b71680 1 -- 172.21.15.153:0/499871302 wait complete. 2023-10-05T21:15:13.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.006+0000 7f4bf8b71680 1 -- 172.21.15.153:0/1050666073 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4b2c034140 msgr2=0x7f4b2c0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.006+0000 7f4bf8b71680 1 --2- 172.21.15.153:0/1050666073 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4b2c034140 0x7f4b2c0365f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x55b404fedc00 tx=0x7f4be4037450 comp rx=0 tx=0).stop 2023-10-05T21:15:13.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.006+0000 7f4bf8b71680 1 -- 172.21.15.153:0/1050666073 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404ffcb40 msgr2=0x55b405003840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.006+0000 7f4bf8b71680 1 --2- 172.21.15.153:0/1050666073 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404ffcb40 0x55b405003840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x55b404fe1480 tx=0x7f4be002f000 comp rx=0 tx=0).stop 2023-10-05T21:15:13.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.006+0000 7f4bf8b71680 1 -- 172.21.15.153:0/1050666073 shutdown_connections 2023-10-05T21:15:13.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.006+0000 7f4bf8b71680 1 --2- 172.21.15.153:0/1050666073 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4b2c034140 0x7f4b2c0365f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.006+0000 7f4bf8b71680 1 --2- 172.21.15.153:0/1050666073 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b404ffcb40 0x55b405003840 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.006+0000 7f4bf8b71680 1 -- 172.21.15.153:0/1050666073 >> 172.21.15.153:0/1050666073 conn(0x55b404ff8e40 msgr2=0x55b404ff6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:13.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.006+0000 7f4bf8b71680 1 -- 172.21.15.153:0/1050666073 shutdown_connections 2023-10-05T21:15:13.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.006+0000 7f4bf8b71680 1 -- 172.21.15.153:0/1050666073 wait complete. 2023-10-05T21:15:13.045 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:15:13.046 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2023-10-05T21:15:13.046 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2023-10-05T21:15:13.046 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2023-10-05T21:15:13.090 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:13.090 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:13.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.089+0000 7f99dc83e680 1 Processor -- start 2023-10-05T21:15:13.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.089+0000 7f99dc83e680 1 -- start start 2023-10-05T21:15:13.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.089+0000 7f99dc83e680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55e817cf62b0 0x55e817cf66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.089+0000 7f99dc83e680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e817c44990 con 0x55e817cf6c00 2023-10-05T21:15:13.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.089+0000 7f99dc83e680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e817c04db0 con 0x55e817cf62b0 2023-10-05T21:15:13.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.090+0000 7f99cf916700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55e817cf62b0 0x55e817cf66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.090+0000 7f99cf115700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55e817cf6c00 0x55e817cf75f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56224/0 (socket says 172.21.15.153:56224) 2023-10-05T21:15:13.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.090+0000 7f99cf115700 1 -- 172.21.15.153:0/1200560602 learned_addr learned my addr 172.21.15.153:0/1200560602 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:13.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.090+0000 7f99cf916700 1 -- 172.21.15.153:0/1200560602 >> v1:172.21.15.111:6789/0 conn(0x55e817cf6c00 legacy=0x55e817cf75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.090+0000 7f99ce914700 1 -- 172.21.15.153:0/1200560602 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 887012564 0 0) 0x55e817c44990 con 0x55e817cf6c00 2023-10-05T21:15:13.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.090+0000 7f99cf916700 1 -- 172.21.15.153:0/1200560602 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e817cf7ea0 con 0x55e817cf62b0 2023-10-05T21:15:13.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.090+0000 7f99cf916700 1 --2- 172.21.15.153:0/1200560602 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817cf62b0 0x55e817cf66c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f99c400a5d0 tx=0x7f99c4005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ac5cd519542960 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.090+0000 7f99ce914700 1 -- 172.21.15.153:0/1200560602 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99c40086a0 con 0x55e817cf62b0 2023-10-05T21:15:13.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.090+0000 7f99ce914700 1 -- 172.21.15.153:0/1200560602 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c4008800 con 0x55e817cf62b0 2023-10-05T21:15:13.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.090+0000 7f99ce914700 1 -- 172.21.15.153:0/1200560602 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99c4008ad0 con 0x55e817cf62b0 2023-10-05T21:15:13.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.091+0000 7f99dc83e680 1 -- 172.21.15.153:0/1200560602 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817cf62b0 msgr2=0x55e817cf66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.091+0000 7f99dc83e680 1 --2- 172.21.15.153:0/1200560602 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817cf62b0 0x55e817cf66c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f99c400a5d0 tx=0x7f99c4005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:13.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.091+0000 7f99dc83e680 1 -- 172.21.15.153:0/1200560602 shutdown_connections 2023-10-05T21:15:13.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.091+0000 7f99dc83e680 1 --2- 172.21.15.153:0/1200560602 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817cf62b0 0x55e817cf66c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.091+0000 7f99dc83e680 1 -- 172.21.15.153:0/1200560602 >> 172.21.15.153:0/1200560602 conn(0x55e817cf1b80 msgr2=0x55e817cf3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:13.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.091+0000 7f99dc83e680 1 -- 172.21.15.153:0/1200560602 shutdown_connections 2023-10-05T21:15:13.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.091+0000 7f99dc83e680 1 -- 172.21.15.153:0/1200560602 wait complete. 2023-10-05T21:15:13.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.092+0000 7f99dc83e680 1 Processor -- start 2023-10-05T21:15:13.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.092+0000 7f99dc83e680 1 -- start start 2023-10-05T21:15:13.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.092+0000 7f99dc83e680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817cf62b0 0x55e817d15570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.092+0000 7f99dc83e680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e817ba4ea0 con 0x55e817cf62b0 2023-10-05T21:15:13.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.092+0000 7f99cf916700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817cf62b0 0x55e817d15570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.092+0000 7f99cf916700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817cf62b0 0x55e817d15570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49480/0 (socket says 172.21.15.153:49480) 2023-10-05T21:15:13.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.092+0000 7f99cf916700 1 -- 172.21.15.153:0/4102549632 learned_addr learned my addr 172.21.15.153:0/4102549632 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:13.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.092+0000 7f99cf916700 1 -- 172.21.15.153:0/4102549632 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c4005cf0 con 0x55e817cf62b0 2023-10-05T21:15:13.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.092+0000 7f99cf916700 1 --2- 172.21.15.153:0/4102549632 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817cf62b0 0x55e817d15570 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f99c4000c00 tx=0x7f99c4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f05580bd3d37aa server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.093+0000 7f99cd912700 1 -- 172.21.15.153:0/4102549632 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99c401f070 con 0x55e817cf62b0 2023-10-05T21:15:13.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.093+0000 7f99cd912700 1 -- 172.21.15.153:0/4102549632 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c4008970 con 0x55e817cf62b0 2023-10-05T21:15:13.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.093+0000 7f99cd912700 1 -- 172.21.15.153:0/4102549632 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99c40086a0 con 0x55e817cf62b0 2023-10-05T21:15:13.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.093+0000 7f99dc83e680 1 -- 172.21.15.153:0/4102549632 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817cf62b0 msgr2=0x55e817d15570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.093+0000 7f99dc83e680 1 --2- 172.21.15.153:0/4102549632 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817cf62b0 0x55e817d15570 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f99c4000c00 tx=0x7f99c4015000 comp rx=0 tx=0).stop 2023-10-05T21:15:13.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.093+0000 7f99dc83e680 1 -- 172.21.15.153:0/4102549632 shutdown_connections 2023-10-05T21:15:13.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.093+0000 7f99dc83e680 1 --2- 172.21.15.153:0/4102549632 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817cf62b0 0x55e817d15570 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.093+0000 7f99dc83e680 1 -- 172.21.15.153:0/4102549632 >> 172.21.15.153:0/4102549632 conn(0x55e817cf1b80 msgr2=0x55e817d11040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:13.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.093+0000 7f99dc83e680 1 -- 172.21.15.153:0/4102549632 shutdown_connections 2023-10-05T21:15:13.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.093+0000 7f99dc83e680 1 -- 172.21.15.153:0/4102549632 wait complete. 2023-10-05T21:15:13.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.093+0000 7f99dc83e680 1 Processor -- start 2023-10-05T21:15:13.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.093+0000 7f99dc83e680 1 -- start start 2023-10-05T21:15:13.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.094+0000 7f99dc83e680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817cf62b0 0x55e817d1b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.094+0000 7f99dc83e680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e817b9bc80 con 0x55e817cf62b0 2023-10-05T21:15:13.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.094+0000 7f99cf916700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817cf62b0 0x55e817d1b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.094+0000 7f99cf916700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817cf62b0 0x55e817d1b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49484/0 (socket says 172.21.15.153:49484) 2023-10-05T21:15:13.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.094+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 learned_addr learned my addr 172.21.15.153:0/1043792403 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:13.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.094+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e817cf7ea0 con 0x55e817cf62b0 2023-10-05T21:15:13.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.094+0000 7f99cf916700 1 --2- 172.21.15.153:0/1043792403 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817cf62b0 0x55e817d1b890 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f99c4005a90 tx=0x7f99c401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.094+0000 7f99b7fff700 1 -- 172.21.15.153:0/1043792403 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99c40086a0 con 0x55e817cf62b0 2023-10-05T21:15:13.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.094+0000 7f99b7fff700 1 -- 172.21.15.153:0/1043792403 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c4012450 con 0x55e817cf62b0 2023-10-05T21:15:13.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.094+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e817d1bdd0 con 0x55e817cf62b0 2023-10-05T21:15:13.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.094+0000 7f99b7fff700 1 -- 172.21.15.153:0/1043792403 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99c4012720 con 0x55e817cf62b0 2023-10-05T21:15:13.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.094+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e817d1c220 con 0x55e817cf62b0 2023-10-05T21:15:13.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.095+0000 7f99b7fff700 1 -- 172.21.15.153:0/1043792403 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f99c4012880 con 0x55e817cf62b0 2023-10-05T21:15:13.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.095+0000 7f99b7fff700 1 --2- 172.21.15.153:0/1043792403 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f99bc034140 0x7f99bc0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.095+0000 7f99dc83e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.095+0000 7f99b7fff700 1 -- 172.21.15.153:0/1043792403 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f99c404b7e0 con 0x55e817cf62b0 2023-10-05T21:15:13.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.096+0000 7f99cf115700 1 --2- 172.21.15.153:0/1043792403 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f99bc034140 0x7f99bc0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.096+0000 7f99dc83e680 1 --2- 172.21.15.153:0/1043792403 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55e817d25530 0x55e817d27990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.096+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d280d0 con 0x55e817d25530 2023-10-05T21:15:13.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.096+0000 7f99d0117700 1 --2- 172.21.15.153:0/1043792403 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55e817d25530 0x55e817d27990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.096+0000 7f99cf115700 1 --2- 172.21.15.153:0/1043792403 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f99bc034140 0x7f99bc0365f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f99c00011e0 tx=0x7f99c0001340 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.096+0000 7f99d0117700 1 --2- 172.21.15.153:0/1043792403 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55e817d25530 0x55e817d27990 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.096+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.096+0000 7f99dc83e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.096+0000 7f99dc83e680 20 realm 2023-10-05T21:15:13.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.096+0000 7f99dc83e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.096+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d24ba0 con 0x55e817d25530 2023-10-05T21:15:13.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.097+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.097+0000 7f99dc83e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.097+0000 7f99dc83e680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:13.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.097+0000 7f99dc83e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.097+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d28b80 con 0x55e817d25530 2023-10-05T21:15:13.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.097+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.097+0000 7f99dc83e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.097+0000 7f99dc83e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.097+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d287a0 con 0x55e817d25530 2023-10-05T21:15:13.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.097+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.097+0000 7f99dc83e680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.097+0000 7f99dc83e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.097+0000 7f99dc83e680 1 --2- 172.21.15.153:0/1043792403 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55e817d29f20 0x55e817d2c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.097+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2c840 con 0x55e817d29f20 2023-10-05T21:15:13.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.097+0000 7f99cf916700 1 --2- 172.21.15.153:0/1043792403 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55e817d29f20 0x55e817d2c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.097+0000 7f99cf916700 1 --2- 172.21.15.153:0/1043792403 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55e817d29f20 0x55e817d2c300 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.098+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f99c402c050 con 0x55e817d29f20 2023-10-05T21:15:13.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.098+0000 7f99dc83e680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:13.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.098+0000 7f99dc83e680 20 searching for the correct realm 2023-10-05T21:15:13.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.098+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x55e817d29f20 2023-10-05T21:15:13.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.098+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c403f040 con 0x55e817d29f20 2023-10-05T21:15:13.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.098+0000 7f99cf916700 1 --2- 172.21.15.153:0/1043792403 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f99c4007030 0x7f99c404b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.098+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x7f99c4007030 2023-10-05T21:15:13.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.098+0000 7f99cf115700 1 --2- 172.21.15.153:0/1043792403 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f99c4007030 0x7f99c404b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.098+0000 7f99cf115700 1 --2- 172.21.15.153:0/1043792403 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f99c4007030 0x7f99c404b050 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.098+0000 7f99cf115700 1 -- 172.21.15.153:0/1043792403 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c0006070 con 0x7f99c4007030 2023-10-05T21:15:13.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.099+0000 7f99cf115700 1 --2- 172.21.15.153:0/1043792403 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f99c000d8e0 0x7f99c000c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.099+0000 7f99cf115700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x7f99c000d8e0 2023-10-05T21:15:13.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.099+0000 7f99d0117700 1 --2- 172.21.15.153:0/1043792403 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f99c000d8e0 0x7f99c000c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.099+0000 7f99d0117700 1 --2- 172.21.15.153:0/1043792403 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f99c000d8e0 0x7f99c000c360 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.099+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a570 con 0x7f99c000d8e0 2023-10-05T21:15:13.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.099+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x55e817d25530 2023-10-05T21:15:13.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.099+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.100+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x55e817d25530 2023-10-05T21:15:13.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.100+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.100+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x7f99c000d8e0 2023-10-05T21:15:13.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.100+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a570 con 0x7f99c000d8e0 2023-10-05T21:15:13.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.100+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x7f99c000d8e0 2023-10-05T21:15:13.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.100+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a570 con 0x7f99c000d8e0 2023-10-05T21:15:13.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.100+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x7f99c4007030 2023-10-05T21:15:13.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.100+0000 7f99cf115700 1 -- 172.21.15.153:0/1043792403 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c0006070 con 0x7f99c4007030 2023-10-05T21:15:13.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.100+0000 7f99cf115700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x55e817d29f20 2023-10-05T21:15:13.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.101+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f99c403f040 con 0x55e817d29f20 2023-10-05T21:15:13.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.101+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x55e817d25530 2023-10-05T21:15:13.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.101+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.101+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x7f99c000d8e0 2023-10-05T21:15:13.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.101+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a570 con 0x7f99c000d8e0 2023-10-05T21:15:13.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.101+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x55e817d25530 2023-10-05T21:15:13.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.101+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.101+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x7f99c4007030 2023-10-05T21:15:13.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.101+0000 7f99cf115700 1 -- 172.21.15.153:0/1043792403 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c0006070 con 0x7f99c4007030 2023-10-05T21:15:13.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.101+0000 7f99cf115700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x55e817d29f20 2023-10-05T21:15:13.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.102+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c403f040 con 0x55e817d29f20 2023-10-05T21:15:13.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.102+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x55e817d29f20 2023-10-05T21:15:13.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.102+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c403f040 con 0x55e817d29f20 2023-10-05T21:15:13.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.102+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x7f99c000d8e0 2023-10-05T21:15:13.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.102+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a570 con 0x7f99c000d8e0 2023-10-05T21:15:13.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.102+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x55e817d29f20 2023-10-05T21:15:13.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.102+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c403f040 con 0x55e817d29f20 2023-10-05T21:15:13.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.102+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x55e817d29f20 2023-10-05T21:15:13.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.102+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c403f040 con 0x55e817d29f20 2023-10-05T21:15:13.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.102+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x55e817d25530 2023-10-05T21:15:13.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.103+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.103+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x55e817d25530 2023-10-05T21:15:13.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.103+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.103+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x7f99c000d8e0 2023-10-05T21:15:13.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.103+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a570 con 0x7f99c000d8e0 2023-10-05T21:15:13.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.103+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x55e817d29f20 2023-10-05T21:15:13.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.103+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c403f040 con 0x55e817d29f20 2023-10-05T21:15:13.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.103+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x7f99c4007030 2023-10-05T21:15:13.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.104+0000 7f99cf115700 1 -- 172.21.15.153:0/1043792403 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c0006070 con 0x7f99c4007030 2023-10-05T21:15:13.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.104+0000 7f99cf115700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x55e817d25530 2023-10-05T21:15:13.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.104+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.104+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x7f99c000d8e0 2023-10-05T21:15:13.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.104+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a570 con 0x7f99c000d8e0 2023-10-05T21:15:13.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.104+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x55e817d29f20 2023-10-05T21:15:13.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.104+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c403f040 con 0x55e817d29f20 2023-10-05T21:15:13.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.104+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x7f99c000d8e0 2023-10-05T21:15:13.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.104+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a570 con 0x7f99c000d8e0 2023-10-05T21:15:13.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.105+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x7f99c4007030 2023-10-05T21:15:13.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.105+0000 7f99cf115700 1 -- 172.21.15.153:0/1043792403 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c0006070 con 0x7f99c4007030 2023-10-05T21:15:13.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.105+0000 7f99cf115700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x55e817d29f20 2023-10-05T21:15:13.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.105+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c403f040 con 0x55e817d29f20 2023-10-05T21:15:13.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.105+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x7f99c000d8e0 2023-10-05T21:15:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.105+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a570 con 0x7f99c000d8e0 2023-10-05T21:15:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.105+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x55e817d25530 2023-10-05T21:15:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.105+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.105+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e0f0 con 0x7f99c4007030 2023-10-05T21:15:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.106+0000 7f99cf115700 1 -- 172.21.15.153:0/1043792403 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c0006070 con 0x7f99c4007030 2023-10-05T21:15:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.106+0000 7f99dc83e680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.106+0000 7f99dc83e680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.106+0000 7f99dc83e680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.106+0000 7f99dc83e680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.106+0000 7f99dc83e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.106+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2d210 con 0x55e817d25530 2023-10-05T21:15:13.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.106+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.106+0000 7f99dc83e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.106+0000 7f99dc83e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.106+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2d6a0 con 0x55e817d25530 2023-10-05T21:15:13.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.106+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.106+0000 7f99dc83e680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.106+0000 7f99dc83e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.106+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2dad0 con 0x55e817d25530 2023-10-05T21:15:13.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.106+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.106+0000 7f99dc83e680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:13.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.106+0000 7f99dc83e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.106+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e4a0 con 0x55e817d29f20 2023-10-05T21:15:13.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.107+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f99c403f040 con 0x55e817d29f20 2023-10-05T21:15:13.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.107+0000 7f99dc83e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.107+0000 7f99dc83e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.107+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2e850 con 0x55e817d25530 2023-10-05T21:15:13.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.107+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.107+0000 7f99dc83e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.107+0000 7f99dc83e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.107+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2ec80 con 0x55e817d25530 2023-10-05T21:15:13.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.107+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.107+0000 7f99dc83e680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.107+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2fc90 con 0x55e817d29f20 2023-10-05T21:15:13.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.107+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c403f040 con 0x55e817d29f20 2023-10-05T21:15:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.107+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2fc90 con 0x7f99c4007030 2023-10-05T21:15:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.107+0000 7f99cf115700 1 -- 172.21.15.153:0/1043792403 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c0006070 con 0x7f99c4007030 2023-10-05T21:15:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.107+0000 7f99cf115700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2fc90 con 0x7f99c000d8e0 2023-10-05T21:15:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.108+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a570 con 0x7f99c000d8e0 2023-10-05T21:15:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.108+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2dad0 con 0x55e817d25530 2023-10-05T21:15:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.108+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.108+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2dad0 con 0x55e817d25530 2023-10-05T21:15:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.108+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.108+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2dad0 con 0x7f99c000d8e0 2023-10-05T21:15:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.109+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a570 con 0x7f99c000d8e0 2023-10-05T21:15:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.109+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2dad0 con 0x7f99c000d8e0 2023-10-05T21:15:13.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.109+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a570 con 0x7f99c000d8e0 2023-10-05T21:15:13.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.109+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2dad0 con 0x7f99c4007030 2023-10-05T21:15:13.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.109+0000 7f99cf115700 1 -- 172.21.15.153:0/1043792403 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c0006070 con 0x7f99c4007030 2023-10-05T21:15:13.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.109+0000 7f99cf115700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2dad0 con 0x55e817d29f20 2023-10-05T21:15:13.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.109+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f99c403f040 con 0x55e817d29f20 2023-10-05T21:15:13.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.109+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2dad0 con 0x55e817d25530 2023-10-05T21:15:13.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.109+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.109+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2dad0 con 0x7f99c000d8e0 2023-10-05T21:15:13.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.110+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a570 con 0x7f99c000d8e0 2023-10-05T21:15:13.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.110+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2dad0 con 0x55e817d25530 2023-10-05T21:15:13.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.110+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.110+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2dad0 con 0x7f99c4007030 2023-10-05T21:15:13.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.110+0000 7f99cf115700 1 -- 172.21.15.153:0/1043792403 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c0006070 con 0x7f99c4007030 2023-10-05T21:15:13.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.110+0000 7f99cf115700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2dad0 con 0x55e817d29f20 2023-10-05T21:15:13.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.110+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c403f040 con 0x55e817d29f20 2023-10-05T21:15:13.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.110+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2dad0 con 0x55e817d29f20 2023-10-05T21:15:13.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.110+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c403f040 con 0x55e817d29f20 2023-10-05T21:15:13.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.110+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2dad0 con 0x7f99c000d8e0 2023-10-05T21:15:13.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.111+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a570 con 0x7f99c000d8e0 2023-10-05T21:15:13.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.111+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2dad0 con 0x55e817d29f20 2023-10-05T21:15:13.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.111+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c403f040 con 0x55e817d29f20 2023-10-05T21:15:13.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.111+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2dad0 con 0x55e817d29f20 2023-10-05T21:15:13.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.111+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c403f040 con 0x55e817d29f20 2023-10-05T21:15:13.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.111+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2dad0 con 0x55e817d25530 2023-10-05T21:15:13.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.111+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.111+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2dad0 con 0x55e817d25530 2023-10-05T21:15:13.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.112+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.112+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2dad0 con 0x7f99c000d8e0 2023-10-05T21:15:13.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.112+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a570 con 0x7f99c000d8e0 2023-10-05T21:15:13.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.112+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2dad0 con 0x55e817d29f20 2023-10-05T21:15:13.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.112+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c403f040 con 0x55e817d29f20 2023-10-05T21:15:13.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.112+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2dad0 con 0x7f99c4007030 2023-10-05T21:15:13.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.112+0000 7f99cf115700 1 -- 172.21.15.153:0/1043792403 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c0006070 con 0x7f99c4007030 2023-10-05T21:15:13.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.112+0000 7f99cf115700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2dad0 con 0x55e817d25530 2023-10-05T21:15:13.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.113+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.113+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2dad0 con 0x7f99c000d8e0 2023-10-05T21:15:13.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.113+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a570 con 0x7f99c000d8e0 2023-10-05T21:15:13.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.113+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2dad0 con 0x55e817d29f20 2023-10-05T21:15:13.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.113+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c403f040 con 0x55e817d29f20 2023-10-05T21:15:13.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.113+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2dad0 con 0x7f99c000d8e0 2023-10-05T21:15:13.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.113+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a570 con 0x7f99c000d8e0 2023-10-05T21:15:13.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.114+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2dad0 con 0x7f99c4007030 2023-10-05T21:15:13.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.114+0000 7f99cf115700 1 -- 172.21.15.153:0/1043792403 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c0006070 con 0x7f99c4007030 2023-10-05T21:15:13.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.114+0000 7f99cf115700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2dad0 con 0x55e817d29f20 2023-10-05T21:15:13.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.114+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c403f040 con 0x55e817d29f20 2023-10-05T21:15:13.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.114+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2dad0 con 0x7f99c000d8e0 2023-10-05T21:15:13.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.114+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c800a570 con 0x7f99c000d8e0 2023-10-05T21:15:13.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.114+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2dad0 con 0x55e817d25530 2023-10-05T21:15:13.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.114+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.114+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2dad0 con 0x7f99c4007030 2023-10-05T21:15:13.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.115+0000 7f99cf115700 1 -- 172.21.15.153:0/1043792403 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f99c0006070 con 0x7f99c4007030 2023-10-05T21:15:13.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.115+0000 7f99dc83e680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:13.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.115+0000 7f99dc83e680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:13.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.115+0000 7f99dc83e680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:13.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.115+0000 7f99dc83e680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:13.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.115+0000 7f99dc83e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.115+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2ec80 con 0x55e817d25530 2023-10-05T21:15:13.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.115+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.115+0000 7f99dc83e680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.115+0000 7f99dc83e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.115+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2f030 con 0x55e817d29f20 2023-10-05T21:15:13.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.115+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f99c403f040 con 0x55e817d29f20 2023-10-05T21:15:13.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.115+0000 7f99dc83e680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:13.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.115+0000 7f99dc83e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.115+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2f8d0 con 0x55e817d25530 2023-10-05T21:15:13.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.115+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.115+0000 7f99dc83e680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.115+0000 7f99dc83e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.115+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2f8d0 con 0x55e817d25530 2023-10-05T21:15:13.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.115+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.115+0000 7f99dc83e680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:13.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.116+0000 7f99dc83e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.116+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2f8d0 con 0x7f99c000d8e0 2023-10-05T21:15:13.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.116+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f99c800a570 con 0x7f99c000d8e0 2023-10-05T21:15:13.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.116+0000 7f99dc83e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.116+0000 7f99dc83e680 20 zone default found 2023-10-05T21:15:13.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.116+0000 7f99dc83e680 4 Realm: () 2023-10-05T21:15:13.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.116+0000 7f99dc83e680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:13.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.116+0000 7f99dc83e680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:13.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.116+0000 7f99dc83e680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:13.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.116+0000 7f99dc83e680 20 zonegroup default 2023-10-05T21:15:13.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.116+0000 7f99dc83e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.116+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d2f8d0 con 0x7f99c000d8e0 2023-10-05T21:15:13.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.116+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f99c800a570 con 0x7f99c000d8e0 2023-10-05T21:15:13.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.116+0000 7f99dc83e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.116+0000 7f99dc83e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.116+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d31250 con 0x55e817d29f20 2023-10-05T21:15:13.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.116+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f99c403f040 con 0x55e817d29f20 2023-10-05T21:15:13.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.117+0000 7f99dc83e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.117+0000 7f99dc83e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.117+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d31600 con 0x55e817d29f20 2023-10-05T21:15:13.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.117+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f99c403f040 con 0x55e817d29f20 2023-10-05T21:15:13.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.117+0000 7f99dc83e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.117+0000 7f99dc83e680 20 started sync module instance, tier type = 2023-10-05T21:15:13.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.117+0000 7f99dc83e680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:13.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.117+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d30960 con 0x7f99c4007030 2023-10-05T21:15:13.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.117+0000 7f99cf115700 1 -- 172.21.15.153:0/1043792403 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c0006070 con 0x7f99c4007030 2023-10-05T21:15:13.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.118+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94455320481120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d31ea0 con 0x7f99c4007030 2023-10-05T21:15:13.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.118+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d32740 con 0x55e817d25530 2023-10-05T21:15:13.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.118+0000 7f99cf115700 1 -- 172.21.15.153:0/1043792403 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94455320481120] v29'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c0006070 con 0x7f99c4007030 2023-10-05T21:15:13.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.118+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.118+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94455320486480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d32b90 con 0x55e817d25530 2023-10-05T21:15:13.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.118+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d33430 con 0x55e817d29f20 2023-10-05T21:15:13.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.119+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94455320486480] v29'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.119+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c403f040 con 0x55e817d29f20 2023-10-05T21:15:13.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.119+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94455320487904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d33830 con 0x55e817d29f20 2023-10-05T21:15:13.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.119+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d34240 con 0x7f99c4007030 2023-10-05T21:15:13.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.120+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94455320487904] v29'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c403f040 con 0x55e817d29f20 2023-10-05T21:15:13.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.120+0000 7f99cf115700 1 -- 172.21.15.153:0/1043792403 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c0006070 con 0x7f99c4007030 2023-10-05T21:15:13.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.120+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94455320489008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d33e90 con 0x7f99c4007030 2023-10-05T21:15:13.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.120+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d35280 con 0x55e817d25530 2023-10-05T21:15:13.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.121+0000 7f99cf115700 1 -- 172.21.15.153:0/1043792403 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94455320489008] v29'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c0006070 con 0x7f99c4007030 2023-10-05T21:15:13.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.121+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.121+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94455320497456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d35680 con 0x55e817d25530 2023-10-05T21:15:13.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.121+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d36180 con 0x7f99c000d8e0 2023-10-05T21:15:13.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.121+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94455320497456] v29'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.121+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c800a570 con 0x7f99c000d8e0 2023-10-05T21:15:13.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.121+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94455320501296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d36140 con 0x7f99c000d8e0 2023-10-05T21:15:13.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.121+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d36c00 con 0x7f99c000d8e0 2023-10-05T21:15:13.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.122+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(96 notify.6 [create] v29'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c800a570 con 0x7f99c000d8e0 2023-10-05T21:15:13.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.122+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(95 notify.5 [watch watch cookie 94455320501296] v29'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c800a570 con 0x7f99c000d8e0 2023-10-05T21:15:13.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.122+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94455320503952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d370b0 con 0x7f99c000d8e0 2023-10-05T21:15:13.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.122+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d379d0 con 0x7f99c000d8e0 2023-10-05T21:15:13.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.123+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(98 notify.7 [create] v29'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c800a570 con 0x7f99c000d8e0 2023-10-05T21:15:13.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.123+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(97 notify.6 [watch watch cookie 94455320503952] v29'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c800a570 con 0x7f99c000d8e0 2023-10-05T21:15:13.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.123+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94455320507616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d37e20 con 0x7f99c000d8e0 2023-10-05T21:15:13.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.123+0000 7f99dc83e680 20 add_watcher() i=0 2023-10-05T21:15:13.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.123+0000 7f99dc83e680 20 add_watcher() i=1 2023-10-05T21:15:13.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.123+0000 7f99dc83e680 20 add_watcher() i=2 2023-10-05T21:15:13.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.123+0000 7f99dc83e680 20 add_watcher() i=3 2023-10-05T21:15:13.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.123+0000 7f99dc83e680 20 add_watcher() i=4 2023-10-05T21:15:13.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.123+0000 7f99dc83e680 20 add_watcher() i=5 2023-10-05T21:15:13.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.123+0000 7f99dc83e680 20 add_watcher() i=6 2023-10-05T21:15:13.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.123+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94455320507616] v29'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c800a570 con 0x7f99c000d8e0 2023-10-05T21:15:13.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.123+0000 7f99dc83e680 20 add_watcher() i=7 2023-10-05T21:15:13.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.124+0000 7f99dc83e680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:13.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.124+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d3a9a0 con 0x55e817d25530 2023-10-05T21:15:13.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.124+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.124+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94455320505280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d37f00 con 0x55e817d25530 2023-10-05T21:15:13.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.125+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94455320505280] v29'58 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f99c800a570 con 0x55e817d25530 2023-10-05T21:15:13.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.125+0000 7f99a17e2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:13.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.125+0000 7f99dc83e680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:13.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.125+0000 7f99dc83e680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:13.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.125+0000 7f99dc83e680 1 Processor -- start 2023-10-05T21:15:13.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.125+0000 7f99dc83e680 1 -- start start 2023-10-05T21:15:13.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.125+0000 7f99dc83e680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817d454e0 0x55e817d458f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.125+0000 7f99dc83e680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e817d45ec0 con 0x55e817d454e0 2023-10-05T21:15:13.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.125+0000 7f99cf115700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817d454e0 0x55e817d458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.125+0000 7f99cf115700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817d454e0 0x55e817d458f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49500/0 (socket says 172.21.15.153:49500) 2023-10-05T21:15:13.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.125+0000 7f99cf115700 1 -- 172.21.15.153:0/3544308461 learned_addr learned my addr 172.21.15.153:0/3544308461 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:13.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.126+0000 7f99cf115700 1 -- 172.21.15.153:0/3544308461 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e817d46000 con 0x55e817d454e0 2023-10-05T21:15:13.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.126+0000 7f99cf115700 1 --2- 172.21.15.153:0/3544308461 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817d454e0 0x55e817d458f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x55e817d296c0 tx=0x7f99c0006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b6d13a65e979811 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.126+0000 7f99a0fe1700 1 -- 172.21.15.153:0/3544308461 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99c0023040 con 0x55e817d454e0 2023-10-05T21:15:13.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.126+0000 7f99a0fe1700 1 -- 172.21.15.153:0/3544308461 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c0024040 con 0x55e817d454e0 2023-10-05T21:15:13.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.126+0000 7f99a0fe1700 1 -- 172.21.15.153:0/3544308461 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99c0013040 con 0x55e817d454e0 2023-10-05T21:15:13.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.127+0000 7f99dc83e680 1 -- 172.21.15.153:0/3544308461 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817d454e0 msgr2=0x55e817d458f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.127+0000 7f99dc83e680 1 --2- 172.21.15.153:0/3544308461 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817d454e0 0x55e817d458f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x55e817d296c0 tx=0x7f99c0006000 comp rx=0 tx=0).stop 2023-10-05T21:15:13.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.127+0000 7f99dc83e680 1 -- 172.21.15.153:0/3544308461 shutdown_connections 2023-10-05T21:15:13.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.127+0000 7f99dc83e680 1 --2- 172.21.15.153:0/3544308461 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817d454e0 0x55e817d458f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.127+0000 7f99dc83e680 1 -- 172.21.15.153:0/3544308461 >> 172.21.15.153:0/3544308461 conn(0x55e817d406e0 msgr2=0x55e817d3e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:13.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.127+0000 7f99dc83e680 1 -- 172.21.15.153:0/3544308461 shutdown_connections 2023-10-05T21:15:13.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.127+0000 7f99dc83e680 1 -- 172.21.15.153:0/3544308461 wait complete. 2023-10-05T21:15:13.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.127+0000 7f99dc83e680 1 Processor -- start 2023-10-05T21:15:13.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.127+0000 7f99dc83e680 1 -- start start 2023-10-05T21:15:13.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.127+0000 7f99dc83e680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817d454e0 0x55e817d4f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.127+0000 7f99dc83e680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e817d4f9f0 con 0x55e817d454e0 2023-10-05T21:15:13.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.127+0000 7f99cf115700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817d454e0 0x55e817d4f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.127+0000 7f99cf115700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817d454e0 0x55e817d4f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49502/0 (socket says 172.21.15.153:49502) 2023-10-05T21:15:13.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.128+0000 7f99cf115700 1 -- 172.21.15.153:0/802883976 learned_addr learned my addr 172.21.15.153:0/802883976 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:13.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.128+0000 7f99cf115700 1 -- 172.21.15.153:0/802883976 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c000ed00 con 0x55e817d454e0 2023-10-05T21:15:13.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.128+0000 7f99cf115700 1 --2- 172.21.15.153:0/802883976 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817d454e0 0x55e817d4f4b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x55e817d28f30 tx=0x7f99c0030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.128+0000 7f991affd700 1 -- 172.21.15.153:0/802883976 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99c0023040 con 0x55e817d454e0 2023-10-05T21:15:13.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.128+0000 7f991affd700 1 -- 172.21.15.153:0/802883976 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c003a420 con 0x55e817d454e0 2023-10-05T21:15:13.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.128+0000 7f991affd700 1 -- 172.21.15.153:0/802883976 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99c003a5b0 con 0x55e817d454e0 2023-10-05T21:15:13.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.128+0000 7f99dc83e680 1 -- 172.21.15.153:0/802883976 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e817d4fbf0 con 0x55e817d454e0 2023-10-05T21:15:13.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.128+0000 7f99dc83e680 1 -- 172.21.15.153:0/802883976 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e817d50040 con 0x55e817d454e0 2023-10-05T21:15:13.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.129+0000 7f991affd700 1 -- 172.21.15.153:0/802883976 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f99c003a710 con 0x55e817d454e0 2023-10-05T21:15:13.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.129+0000 7f991affd700 1 --2- 172.21.15.153:0/802883976 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9910034140 0x7f99100365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.129+0000 7f991affd700 1 -- 172.21.15.153:0/802883976 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f99c004fb00 con 0x55e817d454e0 2023-10-05T21:15:13.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.129+0000 7f99d0117700 1 --2- 172.21.15.153:0/802883976 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9910034140 0x7f99100365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.129+0000 7f99dc83e680 5 note: GC not initialized 2023-10-05T21:15:13.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.129+0000 7f99d0117700 1 --2- 172.21.15.153:0/802883976 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9910034140 0x7f99100365f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x55e817d37e60 tx=0x7f99c800af10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.130+0000 7f990ffff700 20 reqs_thread_entry: start 2023-10-05T21:15:13.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.130+0000 7f990dffb700 20 reqs_thread_entry: start 2023-10-05T21:15:13.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.130+0000 7f99dc83e680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:13.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.130+0000 7f99dc83e680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:13.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.130+0000 7f98fbfff700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:43 2023 2023-10-05T21:15:13.180 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:13.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.130+0000 7f98fb7fe700 20 reqs_thread_entry: start 2023-10-05T21:15:13.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.131+0000 7f99dc83e680 20 get_system_obj_state: rctx=0x7ffc8b6fef88 obj=default.rgw.meta:users.uid:foo state=0x55e817baa240 s->prefetch_data=0 2023-10-05T21:15:13.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.131+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817db4d60 con 0x55e817d25530 2023-10-05T21:15:13.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.131+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f99c804c040 con 0x55e817d25530 2023-10-05T21:15:13.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.131+0000 7f99dc83e680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:13.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.131+0000 7f99dc83e680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:13.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.131+0000 7f99dc83e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.131+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817db6ff0 con 0x55e817d25530 2023-10-05T21:15:13.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.131+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f99c804c040 con 0x55e817d25530 2023-10-05T21:15:13.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.131+0000 7f99dc83e680 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T21:15:13.182 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:13.183 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "foo", 2023-10-05T21:15:13.183 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Foo", 2023-10-05T21:15:13.183 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "foo@foo.com", 2023-10-05T21:15:13.183 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 1, 2023-10-05T21:15:13.183 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 4, 2023-10-05T21:15:13.183 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [], 2023-10-05T21:15:13.184 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2023-10-05T21:15:13.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:13.184 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:13.184 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:13.184 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T21:15:13.184 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:13.184 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:13.184 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [], 2023-10-05T21:15:13.185 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2023-10-05T21:15:13.185 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2023-10-05T21:15:13.185 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2023-10-05T21:15:13.185 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2023-10-05T21:15:13.185 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2023-10-05T21:15:13.185 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:15:13.185 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:13.186 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:13.186 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:13.186 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:13.186 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:13.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:13.186 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2023-10-05T21:15:13.186 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:13.186 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:13.187 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:13.187 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:13.187 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:13.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:13.187 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2023-10-05T21:15:13.187 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2023-10-05T21:15:13.187 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [] 2023-10-05T21:15:13.187 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:13.187 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:15:13.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.132+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94455320481120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817db6ff0 con 0x7f99c4007030 2023-10-05T21:15:13.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.132+0000 7f99cf115700 1 -- 172.21.15.153:0/1043792403 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94455320481120] v29'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c0006070 con 0x7f99c4007030 2023-10-05T21:15:13.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.132+0000 7f99dc83e680 20 remove_watcher() i=0 2023-10-05T21:15:13.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.132+0000 7f99dc83e680 2 removed watcher, disabling cache 2023-10-05T21:15:13.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.132+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94455320486480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d30d60 con 0x55e817d25530 2023-10-05T21:15:13.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.133+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94455320486480] v29'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c804c040 con 0x55e817d25530 2023-10-05T21:15:13.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.133+0000 7f99dc83e680 20 remove_watcher() i=1 2023-10-05T21:15:13.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.133+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94455320487904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d30d60 con 0x55e817d29f20 2023-10-05T21:15:13.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.134+0000 7f99cf916700 1 -- 172.21.15.153:0/1043792403 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94455320487904] v29'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c403f040 con 0x55e817d29f20 2023-10-05T21:15:13.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.134+0000 7f99dc83e680 20 remove_watcher() i=2 2023-10-05T21:15:13.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.134+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94455320489008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d327e0 con 0x7f99c4007030 2023-10-05T21:15:13.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.135+0000 7f99cf115700 1 -- 172.21.15.153:0/1043792403 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94455320489008] v29'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c0006070 con 0x7f99c4007030 2023-10-05T21:15:13.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.135+0000 7f99dc83e680 20 remove_watcher() i=3 2023-10-05T21:15:13.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.135+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94455320497456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d30d60 con 0x55e817d25530 2023-10-05T21:15:13.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.135+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94455320497456] v29'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c804c040 con 0x55e817d25530 2023-10-05T21:15:13.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.135+0000 7f99dc83e680 20 remove_watcher() i=4 2023-10-05T21:15:13.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.135+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94455320501296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d34d30 con 0x7f99c000d8e0 2023-10-05T21:15:13.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.136+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94455320501296] v29'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c804c040 con 0x7f99c000d8e0 2023-10-05T21:15:13.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.136+0000 7f99dc83e680 20 remove_watcher() i=5 2023-10-05T21:15:13.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.136+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94455320503952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d30d60 con 0x7f99c000d8e0 2023-10-05T21:15:13.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.137+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94455320503952] v29'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c804c040 con 0x7f99c000d8e0 2023-10-05T21:15:13.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.137+0000 7f99dc83e680 20 remove_watcher() i=6 2023-10-05T21:15:13.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.137+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94455320507616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d35c30 con 0x7f99c000d8e0 2023-10-05T21:15:13.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.137+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94455320507616] v29'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f99c804c040 con 0x7f99c000d8e0 2023-10-05T21:15:13.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.137+0000 7f99dc83e680 20 remove_watcher() i=7 2023-10-05T21:15:13.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.138+0000 7f99a17e2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:13.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.138+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:112 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94455320505280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e817d36690 con 0x55e817d25530 2023-10-05T21:15:13.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.139+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(112 data_loggenerations_metadata [watch unwatch cookie 94455320505280] v29'59 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f99c804c040 con 0x55e817d25530 2023-10-05T21:15:13.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.139+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f99c000d8e0 msgr2=0x7f99c000c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.139+0000 7f99dc83e680 1 --2- 172.21.15.153:0/1043792403 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f99c000d8e0 0x7f99c000c360 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.139+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55e817d25530 msgr2=0x55e817d27990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.139+0000 7f99dc83e680 1 --2- 172.21.15.153:0/1043792403 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55e817d25530 0x55e817d27990 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.139+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f99c4007030 msgr2=0x7f99c404b050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.139+0000 7f99dc83e680 1 --2- 172.21.15.153:0/1043792403 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f99c4007030 0x7f99c404b050 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.139+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55e817d29f20 msgr2=0x55e817d2c300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.139+0000 7f99dc83e680 1 --2- 172.21.15.153:0/1043792403 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55e817d29f20 0x55e817d2c300 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.139+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f99bc034140 msgr2=0x7f99bc0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.139+0000 7f99dc83e680 1 --2- 172.21.15.153:0/1043792403 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f99bc034140 0x7f99bc0365f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f99c00011e0 tx=0x7f99c0001340 comp rx=0 tx=0).stop 2023-10-05T21:15:13.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.139+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817cf62b0 msgr2=0x55e817d1b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.139+0000 7f99d0117700 1 -- 172.21.15.153:0/1043792403 reap_dead start 2023-10-05T21:15:13.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.139+0000 7f99dc83e680 1 --2- 172.21.15.153:0/1043792403 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817cf62b0 0x55e817d1b890 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f99c4005a90 tx=0x7f99c401f000 comp rx=0 tx=0).stop 2023-10-05T21:15:13.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.139+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 shutdown_connections 2023-10-05T21:15:13.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.139+0000 7f99dc83e680 1 --2- 172.21.15.153:0/1043792403 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817cf62b0 0x55e817d1b890 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.139+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 >> 172.21.15.153:0/1043792403 conn(0x55e817cf1b80 msgr2=0x55e817d0f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:13.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.139+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 shutdown_connections 2023-10-05T21:15:13.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.139+0000 7f99dc83e680 1 -- 172.21.15.153:0/1043792403 wait complete. 2023-10-05T21:15:13.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.139+0000 7f99dc83e680 1 -- 172.21.15.153:0/802883976 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9910034140 msgr2=0x7f99100365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.139+0000 7f99dc83e680 1 --2- 172.21.15.153:0/802883976 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9910034140 0x7f99100365f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x55e817d37e60 tx=0x7f99c800af10 comp rx=0 tx=0).stop 2023-10-05T21:15:13.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.139+0000 7f99dc83e680 1 -- 172.21.15.153:0/802883976 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817d454e0 msgr2=0x55e817d4f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.139+0000 7f99dc83e680 1 --2- 172.21.15.153:0/802883976 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817d454e0 0x55e817d4f4b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x55e817d28f30 tx=0x7f99c0030000 comp rx=0 tx=0).stop 2023-10-05T21:15:13.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.140+0000 7f99dc83e680 1 -- 172.21.15.153:0/802883976 shutdown_connections 2023-10-05T21:15:13.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.140+0000 7f99dc83e680 1 --2- 172.21.15.153:0/802883976 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9910034140 0x7f99100365f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.140+0000 7f99dc83e680 1 --2- 172.21.15.153:0/802883976 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e817d454e0 0x55e817d4f4b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.140+0000 7f99dc83e680 1 -- 172.21.15.153:0/802883976 >> 172.21.15.153:0/802883976 conn(0x55e817d406e0 msgr2=0x55e817d3e810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:13.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.140+0000 7f99dc83e680 1 -- 172.21.15.153:0/802883976 shutdown_connections 2023-10-05T21:15:13.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.140+0000 7f99dc83e680 1 -- 172.21.15.153:0/802883976 wait complete. 2023-10-05T21:15:13.207 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:15:13.207 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2023-10-05T21:15:13.207 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2023-10-05T21:15:13.207 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2023-10-05T21:15:13.252 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:13.253 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:13.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.252+0000 7fb311ccf680 1 Processor -- start 2023-10-05T21:15:13.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.252+0000 7fb311ccf680 1 -- start start 2023-10-05T21:15:13.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.252+0000 7fb311ccf680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55b5e0fba9c0 0x55b5e0fbcda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.252+0000 7fb311ccf680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b5e0f03990 con 0x55b5e0fb47f0 2023-10-05T21:15:13.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.252+0000 7fb311ccf680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b5e0ec3db0 con 0x55b5e0fba9c0 2023-10-05T21:15:13.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.252+0000 7fb2fffff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55b5e0fba9c0 0x55b5e0fbcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.252+0000 7fb2fffff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55b5e0fba9c0 0x55b5e0fbcda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49510/0 (socket says 172.21.15.153:49510) 2023-10-05T21:15:13.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.252+0000 7fb2fffff700 1 -- 172.21.15.153:0/2940062356 learned_addr learned my addr 172.21.15.153:0/2940062356 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:13.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.253+0000 7fb2ff7fe700 1 -- 172.21.15.153:0/2940062356 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2201319418 0 0) 0x55b5e0f03990 con 0x55b5e0fb47f0 2023-10-05T21:15:13.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.253+0000 7fb2ff7fe700 1 -- 172.21.15.153:0/2940062356 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2f4001e10 con 0x55b5e0fb47f0 2023-10-05T21:15:13.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.253+0000 7fb2fffff700 1 -- 172.21.15.153:0/2940062356 >> v1:172.21.15.111:6789/0 conn(0x55b5e0fb47f0 legacy=0x55b5e0fb4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.253+0000 7fb2fffff700 1 -- 172.21.15.153:0/2940062356 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5e0fbe2f0 con 0x55b5e0fba9c0 2023-10-05T21:15:13.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.253+0000 7fb2fffff700 1 --2- 172.21.15.153:0/2940062356 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5e0fba9c0 0x55b5e0fbcda0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb2f000a650 tx=0x7fb2f0005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c16a3bfc456aa1ba server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.253+0000 7fb2ff7fe700 1 -- 172.21.15.153:0/2940062356 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2f00086a0 con 0x55b5e0fba9c0 2023-10-05T21:15:13.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.253+0000 7fb2ff7fe700 1 -- 172.21.15.153:0/2940062356 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f0008800 con 0x55b5e0fba9c0 2023-10-05T21:15:13.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.253+0000 7fb2ff7fe700 1 -- 172.21.15.153:0/2940062356 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2f0008ad0 con 0x55b5e0fba9c0 2023-10-05T21:15:13.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.253+0000 7fb311ccf680 1 -- 172.21.15.153:0/2940062356 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5e0fba9c0 msgr2=0x55b5e0fbcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.253+0000 7fb311ccf680 1 --2- 172.21.15.153:0/2940062356 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5e0fba9c0 0x55b5e0fbcda0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb2f000a650 tx=0x7fb2f0005b10 comp rx=0 tx=0).stop 2023-10-05T21:15:13.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.254+0000 7fb311ccf680 1 -- 172.21.15.153:0/2940062356 shutdown_connections 2023-10-05T21:15:13.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.254+0000 7fb311ccf680 1 --2- 172.21.15.153:0/2940062356 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5e0fba9c0 0x55b5e0fbcda0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.254+0000 7fb311ccf680 1 -- 172.21.15.153:0/2940062356 >> 172.21.15.153:0/2940062356 conn(0x55b5e0fb0300 msgr2=0x55b5e0fb2710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:13.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.254+0000 7fb311ccf680 1 -- 172.21.15.153:0/2940062356 shutdown_connections 2023-10-05T21:15:13.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.254+0000 7fb311ccf680 1 -- 172.21.15.153:0/2940062356 wait complete. 2023-10-05T21:15:13.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.254+0000 7fb311ccf680 1 Processor -- start 2023-10-05T21:15:13.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.254+0000 7fb311ccf680 1 -- start start 2023-10-05T21:15:13.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.254+0000 7fb311ccf680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5e0fb47f0 0x55b5e0fd5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.254+0000 7fb311ccf680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5e0e63ea0 con 0x55b5e0fb47f0 2023-10-05T21:15:13.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.255+0000 7fb304da7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5e0fb47f0 0x55b5e0fd5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.255+0000 7fb304da7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5e0fb47f0 0x55b5e0fd5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49518/0 (socket says 172.21.15.153:49518) 2023-10-05T21:15:13.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.255+0000 7fb304da7700 1 -- 172.21.15.153:0/502779655 learned_addr learned my addr 172.21.15.153:0/502779655 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:13.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.255+0000 7fb304da7700 1 -- 172.21.15.153:0/502779655 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f0005db0 con 0x55b5e0fb47f0 2023-10-05T21:15:13.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.255+0000 7fb304da7700 1 --2- 172.21.15.153:0/502779655 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5e0fb47f0 0x55b5e0fd5700 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8002d80 tx=0x7fb2f8002950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d995cce10d27cbb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.255+0000 7fb2fe7fc700 1 -- 172.21.15.153:0/502779655 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2f800bb60 con 0x55b5e0fb47f0 2023-10-05T21:15:13.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.255+0000 7fb2fe7fc700 1 -- 172.21.15.153:0/502779655 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f8008030 con 0x55b5e0fb47f0 2023-10-05T21:15:13.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.255+0000 7fb2fe7fc700 1 -- 172.21.15.153:0/502779655 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2f800be60 con 0x55b5e0fb47f0 2023-10-05T21:15:13.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.256+0000 7fb311ccf680 1 -- 172.21.15.153:0/502779655 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5e0fb47f0 msgr2=0x55b5e0fd5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.256+0000 7fb311ccf680 1 --2- 172.21.15.153:0/502779655 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5e0fb47f0 0x55b5e0fd5700 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8002d80 tx=0x7fb2f8002950 comp rx=0 tx=0).stop 2023-10-05T21:15:13.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.256+0000 7fb311ccf680 1 -- 172.21.15.153:0/502779655 shutdown_connections 2023-10-05T21:15:13.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.256+0000 7fb311ccf680 1 --2- 172.21.15.153:0/502779655 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5e0fb47f0 0x55b5e0fd5700 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.256+0000 7fb311ccf680 1 -- 172.21.15.153:0/502779655 >> 172.21.15.153:0/502779655 conn(0x55b5e0fb0300 msgr2=0x55b5e0fd11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:13.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.256+0000 7fb311ccf680 1 -- 172.21.15.153:0/502779655 shutdown_connections 2023-10-05T21:15:13.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.256+0000 7fb311ccf680 1 -- 172.21.15.153:0/502779655 wait complete. 2023-10-05T21:15:13.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.256+0000 7fb311ccf680 1 Processor -- start 2023-10-05T21:15:13.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.256+0000 7fb311ccf680 1 -- start start 2023-10-05T21:15:13.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.256+0000 7fb311ccf680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5e0fb47f0 0x55b5e0fb7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.256+0000 7fb311ccf680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5e0e5ac80 con 0x55b5e0fb47f0 2023-10-05T21:15:13.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.256+0000 7fb304da7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5e0fb47f0 0x55b5e0fb7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.256+0000 7fb304da7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5e0fb47f0 0x55b5e0fb7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49530/0 (socket says 172.21.15.153:49530) 2023-10-05T21:15:13.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.256+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 learned_addr learned my addr 172.21.15.153:0/1499312964 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:13.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.257+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f800a040 con 0x55b5e0fb47f0 2023-10-05T21:15:13.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.257+0000 7fb304da7700 1 --2- 172.21.15.153:0/1499312964 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5e0fb47f0 0x55b5e0fb7280 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8011000 tx=0x7fb2f8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.257+0000 7fb2fcff9700 1 -- 172.21.15.153:0/1499312964 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2f801f070 con 0x55b5e0fb47f0 2023-10-05T21:15:13.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.257+0000 7fb2fcff9700 1 -- 172.21.15.153:0/1499312964 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f801a030 con 0x55b5e0fb47f0 2023-10-05T21:15:13.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.257+0000 7fb2fcff9700 1 -- 172.21.15.153:0/1499312964 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2f8018420 con 0x55b5e0fb47f0 2023-10-05T21:15:13.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.257+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b5e0fb58a0 con 0x55b5e0fb47f0 2023-10-05T21:15:13.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.257+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b5e0fb5c90 con 0x55b5e0fb47f0 2023-10-05T21:15:13.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.258+0000 7fb2fcff9700 1 -- 172.21.15.153:0/1499312964 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fb2f80185d0 con 0x55b5e0fb47f0 2023-10-05T21:15:13.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.258+0000 7fb311ccf680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.258+0000 7fb2fcff9700 1 --2- 172.21.15.153:0/1499312964 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fb2e8034130 0x7fb2e80365e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.258+0000 7fb2fcff9700 1 -- 172.21.15.153:0/1499312964 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fb2f8047e30 con 0x55b5e0fb47f0 2023-10-05T21:15:13.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.258+0000 7fb2fffff700 1 --2- 172.21.15.153:0/1499312964 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fb2e8034130 0x7fb2e80365e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.258+0000 7fb311ccf680 1 --2- 172.21.15.153:0/1499312964 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55b5e0fba9c0 0x55b5e0feab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.258+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0feb310 con 0x55b5e0fba9c0 2023-10-05T21:15:13.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.258+0000 7fb3055a8700 1 --2- 172.21.15.153:0/1499312964 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55b5e0fba9c0 0x55b5e0feab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.258+0000 7fb2fffff700 1 --2- 172.21.15.153:0/1499312964 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fb2e8034130 0x7fb2e80365e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0005b50 tx=0x7fb2f0015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.259+0000 7fb3055a8700 1 --2- 172.21.15.153:0/1499312964 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55b5e0fba9c0 0x55b5e0feab80 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.259+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.259+0000 7fb311ccf680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.259+0000 7fb311ccf680 20 realm 2023-10-05T21:15:13.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.259+0000 7fb311ccf680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.259+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0fe8160 con 0x55b5e0fba9c0 2023-10-05T21:15:13.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.259+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.259+0000 7fb311ccf680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.259+0000 7fb311ccf680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:13.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.259+0000 7fb311ccf680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.259+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0febe10 con 0x55b5e0fba9c0 2023-10-05T21:15:13.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.259+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.259+0000 7fb311ccf680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.259+0000 7fb311ccf680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.259+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0fec730 con 0x55b5e0fba9c0 2023-10-05T21:15:13.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.259+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.259+0000 7fb311ccf680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.260+0000 7fb311ccf680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.260+0000 7fb311ccf680 1 --2- 172.21.15.153:0/1499312964 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b5e0fecff0 0x55b5e0fef3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.260+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0fefa20 con 0x55b5e0fecff0 2023-10-05T21:15:13.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.260+0000 7fb304da7700 1 --2- 172.21.15.153:0/1499312964 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b5e0fecff0 0x55b5e0fef3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.260+0000 7fb304da7700 1 --2- 172.21.15.153:0/1499312964 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b5e0fecff0 0x55b5e0fef3d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.260+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fb2f8015070 con 0x55b5e0fecff0 2023-10-05T21:15:13.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.260+0000 7fb311ccf680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:13.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.260+0000 7fb311ccf680 20 searching for the correct realm 2023-10-05T21:15:13.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.260+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x55b5e0fecff0 2023-10-05T21:15:13.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.260+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2f8015070 con 0x55b5e0fecff0 2023-10-05T21:15:13.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.260+0000 7fb304da7700 1 --2- 172.21.15.153:0/1499312964 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fb2f80173b0 0x7fb2f8045130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.260+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x7fb2f80173b0 2023-10-05T21:15:13.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.261+0000 7fb2fffff700 1 --2- 172.21.15.153:0/1499312964 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fb2f80173b0 0x7fb2f8045130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.261+0000 7fb2fffff700 1 --2- 172.21.15.153:0/1499312964 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fb2f80173b0 0x7fb2f8045130 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.261+0000 7fb2fffff700 1 -- 172.21.15.153:0/1499312964 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2f0008d00 con 0x7fb2f80173b0 2023-10-05T21:15:13.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.261+0000 7fb2fffff700 1 --2- 172.21.15.153:0/1499312964 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fb2f0007030 0x7fb2f001c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.261+0000 7fb2fffff700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x7fb2f0007030 2023-10-05T21:15:13.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.261+0000 7fb3055a8700 1 --2- 172.21.15.153:0/1499312964 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fb2f0007030 0x7fb2f001c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.262+0000 7fb3055a8700 1 --2- 172.21.15.153:0/1499312964 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fb2f0007030 0x7fb2f001c410 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.262+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb30000a570 con 0x7fb2f0007030 2023-10-05T21:15:13.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.262+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.262+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.262+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.262+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.262+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x7fb2f0007030 2023-10-05T21:15:13.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.263+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb30000a570 con 0x7fb2f0007030 2023-10-05T21:15:13.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.263+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x7fb2f0007030 2023-10-05T21:15:13.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.263+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb30000a570 con 0x7fb2f0007030 2023-10-05T21:15:13.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.263+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x7fb2f80173b0 2023-10-05T21:15:13.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.263+0000 7fb2fffff700 1 -- 172.21.15.153:0/1499312964 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2f0008d00 con 0x7fb2f80173b0 2023-10-05T21:15:13.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.263+0000 7fb2fffff700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x55b5e0fecff0 2023-10-05T21:15:13.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.263+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fb2f8015070 con 0x55b5e0fecff0 2023-10-05T21:15:13.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.263+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.263+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.263+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x7fb2f0007030 2023-10-05T21:15:13.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.264+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb30000a570 con 0x7fb2f0007030 2023-10-05T21:15:13.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.264+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.264+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.264+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x7fb2f80173b0 2023-10-05T21:15:13.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.264+0000 7fb2fffff700 1 -- 172.21.15.153:0/1499312964 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2f0008d00 con 0x7fb2f80173b0 2023-10-05T21:15:13.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.264+0000 7fb2fffff700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x55b5e0fecff0 2023-10-05T21:15:13.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.265+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2f8015070 con 0x55b5e0fecff0 2023-10-05T21:15:13.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.265+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x55b5e0fecff0 2023-10-05T21:15:13.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.265+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2f8015070 con 0x55b5e0fecff0 2023-10-05T21:15:13.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.265+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x7fb2f0007030 2023-10-05T21:15:13.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.265+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb30000a570 con 0x7fb2f0007030 2023-10-05T21:15:13.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.265+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x55b5e0fecff0 2023-10-05T21:15:13.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.265+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2f8015070 con 0x55b5e0fecff0 2023-10-05T21:15:13.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.265+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x55b5e0fecff0 2023-10-05T21:15:13.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.265+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2f8015070 con 0x55b5e0fecff0 2023-10-05T21:15:13.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.265+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.266+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.266+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.266+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.266+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x7fb2f0007030 2023-10-05T21:15:13.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.266+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb30000a570 con 0x7fb2f0007030 2023-10-05T21:15:13.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.266+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x55b5e0fecff0 2023-10-05T21:15:13.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.266+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2f8015070 con 0x55b5e0fecff0 2023-10-05T21:15:13.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.266+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x7fb2f80173b0 2023-10-05T21:15:13.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.267+0000 7fb2fffff700 1 -- 172.21.15.153:0/1499312964 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2f0008d00 con 0x7fb2f80173b0 2023-10-05T21:15:13.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.267+0000 7fb2fffff700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.267+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.267+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x7fb2f0007030 2023-10-05T21:15:13.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.267+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb30000a570 con 0x7fb2f0007030 2023-10-05T21:15:13.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.267+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x55b5e0fecff0 2023-10-05T21:15:13.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.267+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2f8015070 con 0x55b5e0fecff0 2023-10-05T21:15:13.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.268+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x7fb2f0007030 2023-10-05T21:15:13.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.268+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb30000a570 con 0x7fb2f0007030 2023-10-05T21:15:13.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.268+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x7fb2f80173b0 2023-10-05T21:15:13.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.268+0000 7fb2fffff700 1 -- 172.21.15.153:0/1499312964 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2f0008d00 con 0x7fb2f80173b0 2023-10-05T21:15:13.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.268+0000 7fb2fffff700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x55b5e0fecff0 2023-10-05T21:15:13.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.268+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2f8015070 con 0x55b5e0fecff0 2023-10-05T21:15:13.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.268+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x7fb2f0007030 2023-10-05T21:15:13.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.268+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb30000a570 con 0x7fb2f0007030 2023-10-05T21:15:13.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.268+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.269+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.269+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1570 con 0x7fb2f80173b0 2023-10-05T21:15:13.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.269+0000 7fb2fffff700 1 -- 172.21.15.153:0/1499312964 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2f0008d00 con 0x7fb2f80173b0 2023-10-05T21:15:13.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.269+0000 7fb311ccf680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:13.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.269+0000 7fb311ccf680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:13.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.269+0000 7fb311ccf680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:13.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.269+0000 7fb311ccf680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:13.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.269+0000 7fb311ccf680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.269+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff0710 con 0x55b5e0fba9c0 2023-10-05T21:15:13.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.269+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.269+0000 7fb311ccf680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.269+0000 7fb311ccf680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.269+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff02e0 con 0x55b5e0fba9c0 2023-10-05T21:15:13.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.269+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.269+0000 7fb311ccf680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.269+0000 7fb311ccf680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.269+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff10a0 con 0x55b5e0fba9c0 2023-10-05T21:15:13.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.270+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.270+0000 7fb311ccf680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:13.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.270+0000 7fb311ccf680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.270+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff0cd0 con 0x55b5e0fecff0 2023-10-05T21:15:13.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.270+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fb2f8015070 con 0x55b5e0fecff0 2023-10-05T21:15:13.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.270+0000 7fb311ccf680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.270+0000 7fb311ccf680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.270+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1f90 con 0x55b5e0fba9c0 2023-10-05T21:15:13.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.270+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.270+0000 7fb311ccf680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.270+0000 7fb311ccf680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.270+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff2390 con 0x55b5e0fba9c0 2023-10-05T21:15:13.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.270+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.270+0000 7fb311ccf680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.270+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff33a0 con 0x55b5e0fecff0 2023-10-05T21:15:13.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.271+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2f8015070 con 0x55b5e0fecff0 2023-10-05T21:15:13.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.271+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff33a0 con 0x7fb2f80173b0 2023-10-05T21:15:13.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.271+0000 7fb2fffff700 1 -- 172.21.15.153:0/1499312964 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2f0008d00 con 0x7fb2f80173b0 2023-10-05T21:15:13.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.271+0000 7fb2fffff700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff33a0 con 0x7fb2f0007030 2023-10-05T21:15:13.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.271+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb30000a570 con 0x7fb2f0007030 2023-10-05T21:15:13.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.271+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff10a0 con 0x55b5e0fba9c0 2023-10-05T21:15:13.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.271+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.271+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff10a0 con 0x55b5e0fba9c0 2023-10-05T21:15:13.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.272+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.272+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff10a0 con 0x7fb2f0007030 2023-10-05T21:15:13.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.272+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb30000a570 con 0x7fb2f0007030 2023-10-05T21:15:13.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.272+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff10a0 con 0x7fb2f0007030 2023-10-05T21:15:13.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.272+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb30000a570 con 0x7fb2f0007030 2023-10-05T21:15:13.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.272+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff10a0 con 0x7fb2f80173b0 2023-10-05T21:15:13.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.272+0000 7fb2fffff700 1 -- 172.21.15.153:0/1499312964 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2f0008d00 con 0x7fb2f80173b0 2023-10-05T21:15:13.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.272+0000 7fb2fffff700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff10a0 con 0x55b5e0fecff0 2023-10-05T21:15:13.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.272+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fb2f8015070 con 0x55b5e0fecff0 2023-10-05T21:15:13.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.272+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff10a0 con 0x55b5e0fba9c0 2023-10-05T21:15:13.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.273+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.273+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff10a0 con 0x7fb2f0007030 2023-10-05T21:15:13.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.273+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb30000a570 con 0x7fb2f0007030 2023-10-05T21:15:13.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.273+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff10a0 con 0x55b5e0fba9c0 2023-10-05T21:15:13.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.273+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.273+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff10a0 con 0x7fb2f80173b0 2023-10-05T21:15:13.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.273+0000 7fb2fffff700 1 -- 172.21.15.153:0/1499312964 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2f0008d00 con 0x7fb2f80173b0 2023-10-05T21:15:13.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.273+0000 7fb2fffff700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff10a0 con 0x55b5e0fecff0 2023-10-05T21:15:13.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.274+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2f8015070 con 0x55b5e0fecff0 2023-10-05T21:15:13.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.274+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff10a0 con 0x55b5e0fecff0 2023-10-05T21:15:13.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.274+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2f8015070 con 0x55b5e0fecff0 2023-10-05T21:15:13.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.274+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff10a0 con 0x7fb2f0007030 2023-10-05T21:15:13.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.274+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb30000a570 con 0x7fb2f0007030 2023-10-05T21:15:13.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.274+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff10a0 con 0x55b5e0fecff0 2023-10-05T21:15:13.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.274+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2f8015070 con 0x55b5e0fecff0 2023-10-05T21:15:13.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.274+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff10a0 con 0x55b5e0fecff0 2023-10-05T21:15:13.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.274+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2f8015070 con 0x55b5e0fecff0 2023-10-05T21:15:13.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.274+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff10a0 con 0x55b5e0fba9c0 2023-10-05T21:15:13.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.275+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.275+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff10a0 con 0x55b5e0fba9c0 2023-10-05T21:15:13.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.275+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.275+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff10a0 con 0x7fb2f0007030 2023-10-05T21:15:13.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.275+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb30000a570 con 0x7fb2f0007030 2023-10-05T21:15:13.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.275+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff10a0 con 0x55b5e0fecff0 2023-10-05T21:15:13.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.275+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2f8015070 con 0x55b5e0fecff0 2023-10-05T21:15:13.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.275+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff10a0 con 0x7fb2f80173b0 2023-10-05T21:15:13.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.275+0000 7fb2fffff700 1 -- 172.21.15.153:0/1499312964 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2f0008d00 con 0x7fb2f80173b0 2023-10-05T21:15:13.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.275+0000 7fb2fffff700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff10a0 con 0x55b5e0fba9c0 2023-10-05T21:15:13.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.276+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.276+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff10a0 con 0x7fb2f0007030 2023-10-05T21:15:13.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.276+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb30000a570 con 0x7fb2f0007030 2023-10-05T21:15:13.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.276+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff10a0 con 0x55b5e0fecff0 2023-10-05T21:15:13.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.276+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2f8015070 con 0x55b5e0fecff0 2023-10-05T21:15:13.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.276+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff10a0 con 0x7fb2f0007030 2023-10-05T21:15:13.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.276+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb30000a570 con 0x7fb2f0007030 2023-10-05T21:15:13.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.276+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff10a0 con 0x7fb2f80173b0 2023-10-05T21:15:13.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.277+0000 7fb2fffff700 1 -- 172.21.15.153:0/1499312964 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2f0008d00 con 0x7fb2f80173b0 2023-10-05T21:15:13.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.277+0000 7fb2fffff700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff10a0 con 0x55b5e0fecff0 2023-10-05T21:15:13.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.277+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2f8015070 con 0x55b5e0fecff0 2023-10-05T21:15:13.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.277+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff10a0 con 0x7fb2f0007030 2023-10-05T21:15:13.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.277+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb30000a570 con 0x7fb2f0007030 2023-10-05T21:15:13.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.277+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff10a0 con 0x55b5e0fba9c0 2023-10-05T21:15:13.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.277+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.277+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff10a0 con 0x7fb2f80173b0 2023-10-05T21:15:13.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.277+0000 7fb2fffff700 1 -- 172.21.15.153:0/1499312964 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb2f0008d00 con 0x7fb2f80173b0 2023-10-05T21:15:13.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.277+0000 7fb311ccf680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:13.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.277+0000 7fb311ccf680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:13.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.277+0000 7fb311ccf680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:13.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.277+0000 7fb311ccf680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:13.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.277+0000 7fb311ccf680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.277+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff2390 con 0x55b5e0fba9c0 2023-10-05T21:15:13.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.278+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.278+0000 7fb311ccf680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.278+0000 7fb311ccf680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.278+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff2740 con 0x55b5e0fecff0 2023-10-05T21:15:13.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.278+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fb2f8015070 con 0x55b5e0fecff0 2023-10-05T21:15:13.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.278+0000 7fb311ccf680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:13.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.278+0000 7fb311ccf680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.278+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1b10 con 0x55b5e0fba9c0 2023-10-05T21:15:13.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.278+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.278+0000 7fb311ccf680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.278+0000 7fb311ccf680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.278+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff1b30 con 0x55b5e0fba9c0 2023-10-05T21:15:13.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.278+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.278+0000 7fb311ccf680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:13.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.278+0000 7fb311ccf680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.278+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff3560 con 0x7fb2f0007030 2023-10-05T21:15:13.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.279+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fb30000a570 con 0x7fb2f0007030 2023-10-05T21:15:13.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.279+0000 7fb311ccf680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.279+0000 7fb311ccf680 20 zone default found 2023-10-05T21:15:13.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.279+0000 7fb311ccf680 4 Realm: () 2023-10-05T21:15:13.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.279+0000 7fb311ccf680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:13.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.279+0000 7fb311ccf680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:13.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.279+0000 7fb311ccf680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:13.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.279+0000 7fb311ccf680 20 zonegroup default 2023-10-05T21:15:13.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.279+0000 7fb311ccf680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.279+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff3560 con 0x7fb2f0007030 2023-10-05T21:15:13.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.279+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fb30000a570 con 0x7fb2f0007030 2023-10-05T21:15:13.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.279+0000 7fb311ccf680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.279+0000 7fb311ccf680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.279+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff4b80 con 0x55b5e0fecff0 2023-10-05T21:15:13.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.279+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb2f8015070 con 0x55b5e0fecff0 2023-10-05T21:15:13.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.279+0000 7fb311ccf680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.279+0000 7fb311ccf680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.279+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff4f30 con 0x55b5e0fecff0 2023-10-05T21:15:13.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.280+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb2f8015070 con 0x55b5e0fecff0 2023-10-05T21:15:13.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.280+0000 7fb311ccf680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.280+0000 7fb311ccf680 20 started sync module instance, tier type = 2023-10-05T21:15:13.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.280+0000 7fb311ccf680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:13.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.280+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff4290 con 0x7fb2f80173b0 2023-10-05T21:15:13.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.280+0000 7fb2fffff700 1 -- 172.21.15.153:0/1499312964 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2f0008d00 con 0x7fb2f80173b0 2023-10-05T21:15:13.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.280+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94239652265376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff57d0 con 0x7fb2f80173b0 2023-10-05T21:15:13.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.280+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff6070 con 0x55b5e0fba9c0 2023-10-05T21:15:13.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.281+0000 7fb2fffff700 1 -- 172.21.15.153:0/1499312964 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94239652265376] v29'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2f0008d00 con 0x7fb2f80173b0 2023-10-05T21:15:13.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.281+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.281+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94239652273024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff5400 con 0x55b5e0fba9c0 2023-10-05T21:15:13.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.281+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff6cd0 con 0x55b5e0fecff0 2023-10-05T21:15:13.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.282+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2f8015070 con 0x55b5e0fecff0 2023-10-05T21:15:13.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.282+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94239652276128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff7570 con 0x55b5e0fecff0 2023-10-05T21:15:13.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.282+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94239652273024] v29'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.282+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff8040 con 0x7fb2f80173b0 2023-10-05T21:15:13.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.283+0000 7fb2fffff700 1 -- 172.21.15.153:0/1499312964 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2f0008d00 con 0x7fb2f80173b0 2023-10-05T21:15:13.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.283+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94239652276128] v29'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2f8015070 con 0x55b5e0fecff0 2023-10-05T21:15:13.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.283+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94239652274128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff88e0 con 0x7fb2f80173b0 2023-10-05T21:15:13.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.283+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff8c90 con 0x55b5e0fba9c0 2023-10-05T21:15:13.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.283+0000 7fb2fffff700 1 -- 172.21.15.153:0/1499312964 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94239652274128] v29'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2f0008d00 con 0x7fb2f80173b0 2023-10-05T21:15:13.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.283+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.283+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94239652283376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff9180 con 0x55b5e0fba9c0 2023-10-05T21:15:13.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.284+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff9aa0 con 0x7fb2f0007030 2023-10-05T21:15:13.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.284+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94239652283376] v29'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.284+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb30000a570 con 0x7fb2f0007030 2023-10-05T21:15:13.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.284+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94239652285584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff95d0 con 0x7fb2f0007030 2023-10-05T21:15:13.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.284+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ffa520 con 0x7fb2f0007030 2023-10-05T21:15:13.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.285+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94239652285584] v29'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb30000a570 con 0x7fb2f0007030 2023-10-05T21:15:13.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.285+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb30000a570 con 0x7fb2f0007030 2023-10-05T21:15:13.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.285+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94239652286688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ffa520 con 0x7fb2f0007030 2023-10-05T21:15:13.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.285+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ffafd0 con 0x7fb2f0007030 2023-10-05T21:15:13.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.286+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(98 notify.7 [create] v29'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb30000a570 con 0x7fb2f0007030 2023-10-05T21:15:13.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.286+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(97 notify.6 [watch watch cookie 94239652286688] v29'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb30000a570 con 0x7fb2f0007030 2023-10-05T21:15:13.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.286+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94239652293280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ffb460 con 0x7fb2f0007030 2023-10-05T21:15:13.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.286+0000 7fb311ccf680 20 add_watcher() i=0 2023-10-05T21:15:13.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.286+0000 7fb311ccf680 20 add_watcher() i=1 2023-10-05T21:15:13.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.286+0000 7fb311ccf680 20 add_watcher() i=2 2023-10-05T21:15:13.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.286+0000 7fb311ccf680 20 add_watcher() i=3 2023-10-05T21:15:13.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.286+0000 7fb311ccf680 20 add_watcher() i=4 2023-10-05T21:15:13.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.286+0000 7fb311ccf680 20 add_watcher() i=5 2023-10-05T21:15:13.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.286+0000 7fb311ccf680 20 add_watcher() i=6 2023-10-05T21:15:13.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.286+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94239652293280] v29'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb30000a570 con 0x7fb2f0007030 2023-10-05T21:15:13.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.286+0000 7fb311ccf680 20 add_watcher() i=7 2023-10-05T21:15:13.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.286+0000 7fb311ccf680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:13.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.286+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff9650 con 0x55b5e0fba9c0 2023-10-05T21:15:13.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.287+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.287+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94239652294384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff9650 con 0x55b5e0fba9c0 2023-10-05T21:15:13.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.287+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94239652294384] v29'60 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb30000a570 con 0x55b5e0fba9c0 2023-10-05T21:15:13.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.288+0000 7fb2d5fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:13.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.288+0000 7fb311ccf680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:13.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.288+0000 7fb311ccf680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:13.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.288+0000 7fb311ccf680 1 Processor -- start 2023-10-05T21:15:13.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.288+0000 7fb311ccf680 1 -- start start 2023-10-05T21:15:13.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.288+0000 7fb311ccf680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5e1008000 0x55b5e1008410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.288+0000 7fb311ccf680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5e1008a20 con 0x55b5e1008000 2023-10-05T21:15:13.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.288+0000 7fb2fffff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5e1008000 0x55b5e1008410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.288+0000 7fb2fffff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5e1008000 0x55b5e1008410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49544/0 (socket says 172.21.15.153:49544) 2023-10-05T21:15:13.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.288+0000 7fb2fffff700 1 -- 172.21.15.153:0/3700542986 learned_addr learned my addr 172.21.15.153:0/3700542986 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:13.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.288+0000 7fb2fffff700 1 -- 172.21.15.153:0/3700542986 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5e1008f00 con 0x55b5e1008000 2023-10-05T21:15:13.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.289+0000 7fb2fffff700 1 --2- 172.21.15.153:0/3700542986 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5e1008000 0x55b5e1008410 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55b5e0fb54c0 tx=0x7fb2f0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f250aaac52ab660e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.289+0000 7fb2d57e2700 1 -- 172.21.15.153:0/3700542986 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2f0012510 con 0x55b5e1008000 2023-10-05T21:15:13.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.289+0000 7fb2d57e2700 1 -- 172.21.15.153:0/3700542986 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f002a450 con 0x55b5e1008000 2023-10-05T21:15:13.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.289+0000 7fb2d57e2700 1 -- 172.21.15.153:0/3700542986 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2f002a600 con 0x55b5e1008000 2023-10-05T21:15:13.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.289+0000 7fb311ccf680 1 -- 172.21.15.153:0/3700542986 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5e1008000 msgr2=0x55b5e1008410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.289+0000 7fb311ccf680 1 --2- 172.21.15.153:0/3700542986 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5e1008000 0x55b5e1008410 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55b5e0fb54c0 tx=0x7fb2f0012000 comp rx=0 tx=0).stop 2023-10-05T21:15:13.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.290+0000 7fb311ccf680 1 -- 172.21.15.153:0/3700542986 shutdown_connections 2023-10-05T21:15:13.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.290+0000 7fb311ccf680 1 --2- 172.21.15.153:0/3700542986 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5e1008000 0x55b5e1008410 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.290+0000 7fb311ccf680 1 -- 172.21.15.153:0/3700542986 >> 172.21.15.153:0/3700542986 conn(0x55b5e1004300 msgr2=0x55b5e1002400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:13.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.290+0000 7fb311ccf680 1 -- 172.21.15.153:0/3700542986 shutdown_connections 2023-10-05T21:15:13.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.290+0000 7fb311ccf680 1 -- 172.21.15.153:0/3700542986 wait complete. 2023-10-05T21:15:13.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.290+0000 7fb311ccf680 1 Processor -- start 2023-10-05T21:15:13.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.290+0000 7fb311ccf680 1 -- start start 2023-10-05T21:15:13.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.290+0000 7fb311ccf680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5e1008000 0x55b5e100ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.290+0000 7fb311ccf680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5e100f270 con 0x55b5e1008000 2023-10-05T21:15:13.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.290+0000 7fb2fffff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5e1008000 0x55b5e100ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.290+0000 7fb2fffff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5e1008000 0x55b5e100ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49546/0 (socket says 172.21.15.153:49546) 2023-10-05T21:15:13.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.290+0000 7fb2fffff700 1 -- 172.21.15.153:0/2599913453 learned_addr learned my addr 172.21.15.153:0/2599913453 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:13.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.291+0000 7fb2fffff700 1 -- 172.21.15.153:0/2599913453 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5e0fbe2f0 con 0x55b5e1008000 2023-10-05T21:15:13.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.291+0000 7fb2fffff700 1 --2- 172.21.15.153:0/2599913453 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5e1008000 0x55b5e100ed30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0038040 tx=0x7fb2f0030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.291+0000 7fb24f7fe700 1 -- 172.21.15.153:0/2599913453 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2f002ae90 con 0x55b5e1008000 2023-10-05T21:15:13.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.291+0000 7fb24f7fe700 1 -- 172.21.15.153:0/2599913453 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f0009640 con 0x55b5e1008000 2023-10-05T21:15:13.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.291+0000 7fb311ccf680 1 -- 172.21.15.153:0/2599913453 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b5e100f470 con 0x55b5e1008000 2023-10-05T21:15:13.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.291+0000 7fb24f7fe700 1 -- 172.21.15.153:0/2599913453 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2f0009910 con 0x55b5e1008000 2023-10-05T21:15:13.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.291+0000 7fb311ccf680 1 -- 172.21.15.153:0/2599913453 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b5e100f860 con 0x55b5e1008000 2023-10-05T21:15:13.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.292+0000 7fb24f7fe700 1 -- 172.21.15.153:0/2599913453 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fb2f0025040 con 0x55b5e1008000 2023-10-05T21:15:13.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.292+0000 7fb24f7fe700 1 --2- 172.21.15.153:0/2599913453 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fb244034140 0x7fb2440365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.292+0000 7fb24f7fe700 1 -- 172.21.15.153:0/2599913453 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fb2f0030070 con 0x55b5e1008000 2023-10-05T21:15:13.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.292+0000 7fb311ccf680 5 note: GC not initialized 2023-10-05T21:15:13.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.292+0000 7fb3055a8700 1 --2- 172.21.15.153:0/2599913453 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fb244034140 0x7fb2440365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.292+0000 7fb3055a8700 1 --2- 172.21.15.153:0/2599913453 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fb244034140 0x7fb2440365f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55b5e0ffb340 tx=0x7fb300037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.293+0000 7fb24cff9700 20 reqs_thread_entry: start 2023-10-05T21:15:13.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.293+0000 7fb2427fc700 20 reqs_thread_entry: start 2023-10-05T21:15:13.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.293+0000 7fb311ccf680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:13.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.293+0000 7fb311ccf680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:13.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.293+0000 7fb240ff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:43 2023 2023-10-05T21:15:13.347 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:13.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.293+0000 7fb227fff700 20 reqs_thread_entry: start 2023-10-05T21:15:13.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.293+0000 7fb311ccf680 20 get_system_obj_state: rctx=0x7ffd762b5058 obj=default.rgw.meta:users.uid:foo state=0x55b5e0e69240 s->prefetch_data=0 2023-10-05T21:15:13.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.293+0000 7fb311ccf680 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T21:15:13.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.293+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e10745f0 con 0x55b5e0fba9c0 2023-10-05T21:15:13.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.294+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7fb30004d0a0 con 0x55b5e0fba9c0 2023-10-05T21:15:13.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.294+0000 7fb311ccf680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T21:15:13.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.294+0000 7fb311ccf680 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:13.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.294+0000 7fb311ccf680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:13.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.294+0000 7fb311ccf680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:13.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.294+0000 7fb311ccf680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:13.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.294+0000 7fb311ccf680 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:13.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.294+0000 7fb311ccf680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.294+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e1076b70 con 0x55b5e0fba9c0 2023-10-05T21:15:13.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.294+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7fb30004d0a0 con 0x55b5e0fba9c0 2023-10-05T21:15:13.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.294+0000 7fb311ccf680 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T21:15:13.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.294+0000 7fb311ccf680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T21:15:13.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.294+0000 7fb311ccf680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:13.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.294+0000 7fb311ccf680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:13.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.294+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:104 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e10771f0 con 0x7fb2f80173b0 2023-10-05T21:15:13.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.294+0000 7fb2fffff700 1 -- 172.21.15.153:0/1499312964 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(104 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7fb2f0033040 con 0x7fb2f80173b0 2023-10-05T21:15:13.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.295+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:105 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e1078aa0 con 0x55b5e0fba9c0 2023-10-05T21:15:13.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.295+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(105 foo [delete,create,call,writefull 0~357] v29'3 uv3 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7fb30004d0a0 con 0x55b5e0fba9c0 2023-10-05T21:15:13.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.295+0000 7fb311ccf680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T21:15:13.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.295+0000 7fb311ccf680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:13.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.295+0000 7fb311ccf680 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T21:15:13.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.295+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [notify cookie 94239652786416 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e1073540 con 0x55b5e0fba9c0 2023-10-05T21:15:13.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.296+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== watch-notify(notify (1) cookie 94239652283376 notify 124554051586 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x7fb3000291f0 con 0x55b5e0fba9c0 2023-10-05T21:15:13.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.296+0000 7fb2fe7fc700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051586 cookie 94239652283376 notifier 4304 bl.length()=533 2023-10-05T21:15:13.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.296+0000 7fb2fe7fc700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T21:15:13.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.296+0000 7fb2fe7fc700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:13.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.296+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(106 notify.4 [notify cookie 94239652786416 out=8b] v0'0 uv39 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fb30004d0a0 con 0x55b5e0fba9c0 2023-10-05T21:15:13.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.296+0000 7fb2fe7fc700 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fb2e4003d90 con 0x55b5e0fba9c0 2023-10-05T21:15:13.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.296+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(107 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb30004d0a0 con 0x55b5e0fba9c0 2023-10-05T21:15:13.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.296+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== watch-notify(notify_complete (2) cookie 94239652786416 notify 124554051586 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fb30002d040 con 0x55b5e0fba9c0 2023-10-05T21:15:13.353 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:13.354 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "foo", 2023-10-05T21:15:13.354 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Foo", 2023-10-05T21:15:13.354 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "foo@foo.com", 2023-10-05T21:15:13.354 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2023-10-05T21:15:13.354 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 4, 2023-10-05T21:15:13.354 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [], 2023-10-05T21:15:13.355 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2023-10-05T21:15:13.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:13.355 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:13.355 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:13.355 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T21:15:13.355 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:13.356 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:13.356 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [], 2023-10-05T21:15:13.356 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2023-10-05T21:15:13.356 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2023-10-05T21:15:13.356 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2023-10-05T21:15:13.357 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2023-10-05T21:15:13.357 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2023-10-05T21:15:13.357 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:15:13.357 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:13.357 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:13.357 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:13.358 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:13.358 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:13.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:13.358 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2023-10-05T21:15:13.358 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:13.358 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:13.359 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:13.359 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:13.359 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:13.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:13.359 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2023-10-05T21:15:13.360 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2023-10-05T21:15:13.360 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [] 2023-10-05T21:15:13.360 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:13.360 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:15:13.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.296+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:108 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94239652265376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e10730f0 con 0x7fb2f80173b0 2023-10-05T21:15:13.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.297+0000 7fb2fffff700 1 -- 172.21.15.153:0/1499312964 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(108 notify.0 [watch unwatch cookie 94239652265376] v29'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2f0033040 con 0x7fb2f80173b0 2023-10-05T21:15:13.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.297+0000 7fb311ccf680 20 remove_watcher() i=0 2023-10-05T21:15:13.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.297+0000 7fb311ccf680 2 removed watcher, disabling cache 2023-10-05T21:15:13.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.297+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:109 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94239652273024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff3da0 con 0x55b5e0fba9c0 2023-10-05T21:15:13.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.298+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 42 ==== osd_op_reply(109 notify.1 [watch unwatch cookie 94239652273024] v29'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb30004d0a0 con 0x55b5e0fba9c0 2023-10-05T21:15:13.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.298+0000 7fb311ccf680 20 remove_watcher() i=1 2023-10-05T21:15:13.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.298+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:110 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94239652276128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff3da0 con 0x55b5e0fecff0 2023-10-05T21:15:13.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.299+0000 7fb304da7700 1 -- 172.21.15.153:0/1499312964 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(110 notify.2 [watch unwatch cookie 94239652276128] v29'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2f8015070 con 0x55b5e0fecff0 2023-10-05T21:15:13.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.299+0000 7fb311ccf680 20 remove_watcher() i=2 2023-10-05T21:15:13.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.299+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:111 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94239652274128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff67a0 con 0x7fb2f80173b0 2023-10-05T21:15:13.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.299+0000 7fb2fffff700 1 -- 172.21.15.153:0/1499312964 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(111 notify.3 [watch unwatch cookie 94239652274128] v29'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb2f0033040 con 0x7fb2f80173b0 2023-10-05T21:15:13.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.299+0000 7fb311ccf680 20 remove_watcher() i=3 2023-10-05T21:15:13.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.299+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:112 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94239652283376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff67a0 con 0x55b5e0fba9c0 2023-10-05T21:15:13.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.300+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 43 ==== osd_op_reply(112 notify.4 [watch unwatch cookie 94239652283376] v29'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb30004d0a0 con 0x55b5e0fba9c0 2023-10-05T21:15:13.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.300+0000 7fb311ccf680 20 remove_watcher() i=4 2023-10-05T21:15:13.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.300+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:113 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94239652285584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff67a0 con 0x7fb2f0007030 2023-10-05T21:15:13.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.301+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(113 notify.5 [watch unwatch cookie 94239652285584] v29'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb30004d0a0 con 0x7fb2f0007030 2023-10-05T21:15:13.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.301+0000 7fb311ccf680 20 remove_watcher() i=5 2023-10-05T21:15:13.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.301+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:114 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94239652286688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff67a0 con 0x7fb2f0007030 2023-10-05T21:15:13.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.301+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(114 notify.6 [watch unwatch cookie 94239652286688] v29'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb30004d0a0 con 0x7fb2f0007030 2023-10-05T21:15:13.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.301+0000 7fb311ccf680 20 remove_watcher() i=6 2023-10-05T21:15:13.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.301+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:115 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94239652293280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff67a0 con 0x7fb2f0007030 2023-10-05T21:15:13.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.302+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(115 notify.7 [watch unwatch cookie 94239652293280] v29'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb30004d0a0 con 0x7fb2f0007030 2023-10-05T21:15:13.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.302+0000 7fb311ccf680 20 remove_watcher() i=7 2023-10-05T21:15:13.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.303+0000 7fb2d5fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:13.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.303+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:116 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94239652294384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b5e0ff67a0 con 0x55b5e0fba9c0 2023-10-05T21:15:13.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.304+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 <== osd.1 v2:172.21.15.153:6816/140456 44 ==== osd_op_reply(116 data_loggenerations_metadata [watch unwatch cookie 94239652294384] v29'61 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb30004d0a0 con 0x55b5e0fba9c0 2023-10-05T21:15:13.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.304+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fb2f0007030 msgr2=0x7fb2f001c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.304+0000 7fb311ccf680 1 --2- 172.21.15.153:0/1499312964 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fb2f0007030 0x7fb2f001c410 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.304+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55b5e0fba9c0 msgr2=0x55b5e0feab80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.304+0000 7fb311ccf680 1 --2- 172.21.15.153:0/1499312964 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55b5e0fba9c0 0x55b5e0feab80 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.304+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fb2f80173b0 msgr2=0x7fb2f8045130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.304+0000 7fb311ccf680 1 --2- 172.21.15.153:0/1499312964 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fb2f80173b0 0x7fb2f8045130 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.304+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b5e0fecff0 msgr2=0x55b5e0fef3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.304+0000 7fb311ccf680 1 --2- 172.21.15.153:0/1499312964 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b5e0fecff0 0x55b5e0fef3d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.304+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fb2e8034130 msgr2=0x7fb2e80365e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.304+0000 7fb311ccf680 1 --2- 172.21.15.153:0/1499312964 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fb2e8034130 0x7fb2e80365e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0005b50 tx=0x7fb2f0015000 comp rx=0 tx=0).stop 2023-10-05T21:15:13.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.304+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5e0fb47f0 msgr2=0x55b5e0fb7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.304+0000 7fb311ccf680 1 --2- 172.21.15.153:0/1499312964 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5e0fb47f0 0x55b5e0fb7280 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8011000 tx=0x7fb2f8017000 comp rx=0 tx=0).stop 2023-10-05T21:15:13.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.304+0000 7fb3055a8700 1 -- 172.21.15.153:0/1499312964 reap_dead start 2023-10-05T21:15:13.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.304+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 shutdown_connections 2023-10-05T21:15:13.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.304+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 >> 172.21.15.153:0/1499312964 conn(0x55b5e0fb0300 msgr2=0x55b5e0fcfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:13.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.304+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 shutdown_connections 2023-10-05T21:15:13.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.304+0000 7fb311ccf680 1 -- 172.21.15.153:0/1499312964 wait complete. 2023-10-05T21:15:13.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.304+0000 7fb311ccf680 1 -- 172.21.15.153:0/2599913453 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fb244034140 msgr2=0x7fb2440365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.304+0000 7fb311ccf680 1 --2- 172.21.15.153:0/2599913453 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fb244034140 0x7fb2440365f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55b5e0ffb340 tx=0x7fb300037450 comp rx=0 tx=0).stop 2023-10-05T21:15:13.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.304+0000 7fb311ccf680 1 -- 172.21.15.153:0/2599913453 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5e1008000 msgr2=0x55b5e100ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.304+0000 7fb311ccf680 1 --2- 172.21.15.153:0/2599913453 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5e1008000 0x55b5e100ed30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0038040 tx=0x7fb2f0030000 comp rx=0 tx=0).stop 2023-10-05T21:15:13.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.304+0000 7fb311ccf680 1 -- 172.21.15.153:0/2599913453 shutdown_connections 2023-10-05T21:15:13.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.304+0000 7fb311ccf680 1 --2- 172.21.15.153:0/2599913453 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fb244034140 0x7fb2440365f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.304+0000 7fb311ccf680 1 --2- 172.21.15.153:0/2599913453 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5e1008000 0x55b5e100ed30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.304+0000 7fb311ccf680 1 -- 172.21.15.153:0/2599913453 >> 172.21.15.153:0/2599913453 conn(0x55b5e1004300 msgr2=0x55b5e10023d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:13.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.304+0000 7fb311ccf680 1 -- 172.21.15.153:0/2599913453 shutdown_connections 2023-10-05T21:15:13.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.304+0000 7fb311ccf680 1 -- 172.21.15.153:0/2599913453 wait complete. 2023-10-05T21:15:13.373 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:15:13.373 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2023-10-05T21:15:13.373 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2023-10-05T21:15:13.373 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2023-10-05T21:15:13.417 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:13.417 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:13.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.416+0000 7f11c39b9680 1 Processor -- start 2023-10-05T21:15:13.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.416+0000 7f11c39b9680 1 -- start start 2023-10-05T21:15:13.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.416+0000 7f11c39b9680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55c4295f1930 0x55c429682490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.416+0000 7f11c39b9680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c4295ca990 con 0x55c4296829d0 2023-10-05T21:15:13.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.416+0000 7f11c39b9680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c42958adb0 con 0x55c4295f1930 2023-10-05T21:15:13.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.417+0000 7f11b6a91700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55c4295f1930 0x55c429682490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.417+0000 7f11b6290700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55c4296829d0 0x55c429684db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56244/0 (socket says 172.21.15.153:56244) 2023-10-05T21:15:13.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.417+0000 7f11b6290700 1 -- 172.21.15.153:0/2167277529 learned_addr learned my addr 172.21.15.153:0/2167277529 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:13.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.417+0000 7f11b6a91700 1 -- 172.21.15.153:0/2167277529 >> v1:172.21.15.111:6789/0 conn(0x55c4296829d0 legacy=0x55c429684db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.417+0000 7f11b5a8f700 1 -- 172.21.15.153:0/2167277529 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 146935092 0 0) 0x55c4295ca990 con 0x55c4296829d0 2023-10-05T21:15:13.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.417+0000 7f11b6a91700 1 -- 172.21.15.153:0/2167277529 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4296874e0 con 0x55c4295f1930 2023-10-05T21:15:13.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.417+0000 7f11b6a91700 1 --2- 172.21.15.153:0/2167277529 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c4295f1930 0x55c429682490 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f11a800a5d0 tx=0x7f11a8005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d730a56a18c447b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.417+0000 7f11b5a8f700 1 -- 172.21.15.153:0/2167277529 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11a80086a0 con 0x55c4295f1930 2023-10-05T21:15:13.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.417+0000 7f11b5a8f700 1 -- 172.21.15.153:0/2167277529 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a8008800 con 0x55c4295f1930 2023-10-05T21:15:13.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.417+0000 7f11b5a8f700 1 -- 172.21.15.153:0/2167277529 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11a8008ad0 con 0x55c4295f1930 2023-10-05T21:15:13.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.418+0000 7f11c39b9680 1 -- 172.21.15.153:0/2167277529 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c4295f1930 msgr2=0x55c429682490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.418+0000 7f11c39b9680 1 --2- 172.21.15.153:0/2167277529 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c4295f1930 0x55c429682490 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f11a800a5d0 tx=0x7f11a8005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:13.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.418+0000 7f11c39b9680 1 -- 172.21.15.153:0/2167277529 shutdown_connections 2023-10-05T21:15:13.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.418+0000 7f11c39b9680 1 --2- 172.21.15.153:0/2167277529 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c4295f1930 0x55c429682490 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.418+0000 7f11c39b9680 1 -- 172.21.15.153:0/2167277529 >> 172.21.15.153:0/2167277529 conn(0x55c429677b80 msgr2=0x55c429679f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:13.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.418+0000 7f11c39b9680 1 -- 172.21.15.153:0/2167277529 shutdown_connections 2023-10-05T21:15:13.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.418+0000 7f11c39b9680 1 -- 172.21.15.153:0/2167277529 wait complete. 2023-10-05T21:15:13.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.418+0000 7f11c39b9680 1 Processor -- start 2023-10-05T21:15:13.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.419+0000 7f11c39b9680 1 -- start start 2023-10-05T21:15:13.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.419+0000 7f11c39b9680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c4295f1930 0x55c42969e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.419+0000 7f11c39b9680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c42952aea0 con 0x55c4295f1930 2023-10-05T21:15:13.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.419+0000 7f11b6a91700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c4295f1930 0x55c42969e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.419+0000 7f11b6a91700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c4295f1930 0x55c42969e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49570/0 (socket says 172.21.15.153:49570) 2023-10-05T21:15:13.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.419+0000 7f11b6a91700 1 -- 172.21.15.153:0/2646775217 learned_addr learned my addr 172.21.15.153:0/2646775217 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:13.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.419+0000 7f11b6a91700 1 -- 172.21.15.153:0/2646775217 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a8005cf0 con 0x55c4295f1930 2023-10-05T21:15:13.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.419+0000 7f11b6a91700 1 --2- 172.21.15.153:0/2646775217 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c4295f1930 0x55c42969e900 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f11a8000c00 tx=0x7f11a8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4337968ce054deb server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.419+0000 7f11b4a8d700 1 -- 172.21.15.153:0/2646775217 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11a80086a0 con 0x55c4295f1930 2023-10-05T21:15:13.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.419+0000 7f11b4a8d700 1 -- 172.21.15.153:0/2646775217 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a8008970 con 0x55c4295f1930 2023-10-05T21:15:13.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.419+0000 7f11b4a8d700 1 -- 172.21.15.153:0/2646775217 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11a8008b20 con 0x55c4295f1930 2023-10-05T21:15:13.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.420+0000 7f11c39b9680 1 -- 172.21.15.153:0/2646775217 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c4295f1930 msgr2=0x55c42969e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.420+0000 7f11c39b9680 1 --2- 172.21.15.153:0/2646775217 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c4295f1930 0x55c42969e900 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f11a8000c00 tx=0x7f11a8015000 comp rx=0 tx=0).stop 2023-10-05T21:15:13.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.420+0000 7f11c39b9680 1 -- 172.21.15.153:0/2646775217 shutdown_connections 2023-10-05T21:15:13.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.420+0000 7f11c39b9680 1 --2- 172.21.15.153:0/2646775217 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c4295f1930 0x55c42969e900 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.420+0000 7f11c39b9680 1 -- 172.21.15.153:0/2646775217 >> 172.21.15.153:0/2646775217 conn(0x55c429677b80 msgr2=0x55c42969a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:13.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.420+0000 7f11c39b9680 1 -- 172.21.15.153:0/2646775217 shutdown_connections 2023-10-05T21:15:13.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.420+0000 7f11c39b9680 1 -- 172.21.15.153:0/2646775217 wait complete. 2023-10-05T21:15:13.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.420+0000 7f11c39b9680 1 Processor -- start 2023-10-05T21:15:13.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.420+0000 7f11c39b9680 1 -- start start 2023-10-05T21:15:13.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.420+0000 7f11c39b9680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c4295f1930 0x55c4296a5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.420+0000 7f11c39b9680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c429521c80 con 0x55c4295f1930 2023-10-05T21:15:13.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.421+0000 7f11b6a91700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c4295f1930 0x55c4296a5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.421+0000 7f11b6a91700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c4295f1930 0x55c4296a5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49572/0 (socket says 172.21.15.153:49572) 2023-10-05T21:15:13.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.421+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 learned_addr learned my addr 172.21.15.153:0/2282905613 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:13.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.421+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4296874e0 con 0x55c4295f1930 2023-10-05T21:15:13.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.421+0000 7f11b6a91700 1 --2- 172.21.15.153:0/2282905613 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c4295f1930 0x55c4296a5cb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f11a800a520 tx=0x7f11a801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.421+0000 7f11a6ffd700 1 -- 172.21.15.153:0/2282905613 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11a801d420 con 0x55c4295f1930 2023-10-05T21:15:13.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.421+0000 7f11a6ffd700 1 -- 172.21.15.153:0/2282905613 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a801d580 con 0x55c4295f1930 2023-10-05T21:15:13.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.421+0000 7f11a6ffd700 1 -- 172.21.15.153:0/2282905613 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11a801d730 con 0x55c4295f1930 2023-10-05T21:15:13.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.421+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c4296a61f0 con 0x55c4295f1930 2023-10-05T21:15:13.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.421+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c4296a65e0 con 0x55c4295f1930 2023-10-05T21:15:13.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.422+0000 7f11a6ffd700 1 -- 172.21.15.153:0/2282905613 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f11a801d9a0 con 0x55c4295f1930 2023-10-05T21:15:13.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.422+0000 7f11a6ffd700 1 --2- 172.21.15.153:0/2282905613 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f119c034140 0x7f119c0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.422+0000 7f11a6ffd700 1 -- 172.21.15.153:0/2282905613 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f11a804a370 con 0x55c4295f1930 2023-10-05T21:15:13.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.422+0000 7f11b6290700 1 --2- 172.21.15.153:0/2282905613 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f119c034140 0x7f119c0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.422+0000 7f11c39b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.422+0000 7f11b6290700 1 --2- 172.21.15.153:0/2282905613 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f119c034140 0x7f119c0365f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0011e0 tx=0x7f11ac0013a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.422+0000 7f11c39b9680 1 --2- 172.21.15.153:0/2282905613 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55c4296829d0 0x55c4296b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.422+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b2180 con 0x55c4296829d0 2023-10-05T21:15:13.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.423+0000 7f11b7292700 1 --2- 172.21.15.153:0/2282905613 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55c4296829d0 0x55c4296b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.423+0000 7f11b7292700 1 --2- 172.21.15.153:0/2282905613 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55c4296829d0 0x55c4296b19f0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.423+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.423+0000 7f11c39b9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.423+0000 7f11c39b9680 20 realm 2023-10-05T21:15:13.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.423+0000 7f11c39b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.423+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296aef50 con 0x55c4296829d0 2023-10-05T21:15:13.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.423+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.423+0000 7f11c39b9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.423+0000 7f11c39b9680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:13.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.423+0000 7f11c39b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.423+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b2c30 con 0x55c4296829d0 2023-10-05T21:15:13.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.424+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.424+0000 7f11c39b9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.424+0000 7f11c39b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.424+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b3550 con 0x55c4296829d0 2023-10-05T21:15:13.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.424+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.424+0000 7f11c39b9680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.424+0000 7f11c39b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.424+0000 7f11c39b9680 1 --2- 172.21.15.153:0/2282905613 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55c4296b3e10 0x55c4296b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.424+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b67b0 con 0x55c4296b3e10 2023-10-05T21:15:13.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.424+0000 7f11b6a91700 1 --2- 172.21.15.153:0/2282905613 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55c4296b3e10 0x55c4296b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.424+0000 7f11b6a91700 1 --2- 172.21.15.153:0/2282905613 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55c4296b3e10 0x55c4296b61f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.425+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f11a8036070 con 0x55c4296b3e10 2023-10-05T21:15:13.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.425+0000 7f11c39b9680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:13.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.425+0000 7f11c39b9680 20 searching for the correct realm 2023-10-05T21:15:13.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.425+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x55c4296b3e10 2023-10-05T21:15:13.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.425+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11a8036070 con 0x55c4296b3e10 2023-10-05T21:15:13.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.425+0000 7f11b6a91700 1 --2- 172.21.15.153:0/2282905613 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f11a8039030 0x7f11a80063a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.425+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x7f11a8039030 2023-10-05T21:15:13.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.425+0000 7f11b6290700 1 --2- 172.21.15.153:0/2282905613 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f11a8039030 0x7f11a80063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.425+0000 7f11b6290700 1 --2- 172.21.15.153:0/2282905613 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f11a8039030 0x7f11a80063a0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.425+0000 7f11b6290700 1 -- 172.21.15.153:0/2282905613 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11ac006070 con 0x7f11a8039030 2023-10-05T21:15:13.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.426+0000 7f11b6290700 1 --2- 172.21.15.153:0/2282905613 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f11ac00d8e0 0x7f11ac00c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.426+0000 7f11b6290700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x7f11ac00d8e0 2023-10-05T21:15:13.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.426+0000 7f11b7292700 1 --2- 172.21.15.153:0/2282905613 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f11ac00d8e0 0x7f11ac00c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.426+0000 7f11b7292700 1 --2- 172.21.15.153:0/2282905613 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f11ac00d8e0 0x7f11ac00c360 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.426+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11b000a570 con 0x7f11ac00d8e0 2023-10-05T21:15:13.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.426+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x55c4296829d0 2023-10-05T21:15:13.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.427+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.427+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x55c4296829d0 2023-10-05T21:15:13.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.427+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.427+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x7f11ac00d8e0 2023-10-05T21:15:13.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.427+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11b000a570 con 0x7f11ac00d8e0 2023-10-05T21:15:13.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.427+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x7f11ac00d8e0 2023-10-05T21:15:13.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.427+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11b000a570 con 0x7f11ac00d8e0 2023-10-05T21:15:13.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.427+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x7f11a8039030 2023-10-05T21:15:13.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.427+0000 7f11b6290700 1 -- 172.21.15.153:0/2282905613 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11ac006070 con 0x7f11a8039030 2023-10-05T21:15:13.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.427+0000 7f11b6290700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x55c4296b3e10 2023-10-05T21:15:13.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.428+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f11a8036070 con 0x55c4296b3e10 2023-10-05T21:15:13.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.428+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x55c4296829d0 2023-10-05T21:15:13.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.428+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.428+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x7f11ac00d8e0 2023-10-05T21:15:13.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.428+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11b000a570 con 0x7f11ac00d8e0 2023-10-05T21:15:13.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.428+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x55c4296829d0 2023-10-05T21:15:13.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.428+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.428+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x7f11a8039030 2023-10-05T21:15:13.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.429+0000 7f11b6290700 1 -- 172.21.15.153:0/2282905613 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11ac006070 con 0x7f11a8039030 2023-10-05T21:15:13.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.429+0000 7f11b6290700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x55c4296b3e10 2023-10-05T21:15:13.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.429+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11a8036070 con 0x55c4296b3e10 2023-10-05T21:15:13.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.429+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x55c4296b3e10 2023-10-05T21:15:13.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.429+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11a8036070 con 0x55c4296b3e10 2023-10-05T21:15:13.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.429+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x7f11ac00d8e0 2023-10-05T21:15:13.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.429+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11b000a570 con 0x7f11ac00d8e0 2023-10-05T21:15:13.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.429+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x55c4296b3e10 2023-10-05T21:15:13.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.429+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11a8036070 con 0x55c4296b3e10 2023-10-05T21:15:13.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.429+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x55c4296b3e10 2023-10-05T21:15:13.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.430+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11a8036070 con 0x55c4296b3e10 2023-10-05T21:15:13.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.430+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x55c4296829d0 2023-10-05T21:15:13.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.430+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.430+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x55c4296829d0 2023-10-05T21:15:13.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.430+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.430+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x7f11ac00d8e0 2023-10-05T21:15:13.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.430+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11b000a570 con 0x7f11ac00d8e0 2023-10-05T21:15:13.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.430+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x55c4296b3e10 2023-10-05T21:15:13.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.431+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11a8036070 con 0x55c4296b3e10 2023-10-05T21:15:13.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.431+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x7f11a8039030 2023-10-05T21:15:13.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.431+0000 7f11b6290700 1 -- 172.21.15.153:0/2282905613 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11ac006070 con 0x7f11a8039030 2023-10-05T21:15:13.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.431+0000 7f11b6290700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x55c4296829d0 2023-10-05T21:15:13.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.431+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.431+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x7f11ac00d8e0 2023-10-05T21:15:13.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.431+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11b000a570 con 0x7f11ac00d8e0 2023-10-05T21:15:13.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.431+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x55c4296b3e10 2023-10-05T21:15:13.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.431+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11a8036070 con 0x55c4296b3e10 2023-10-05T21:15:13.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.431+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x7f11ac00d8e0 2023-10-05T21:15:13.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.432+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11b000a570 con 0x7f11ac00d8e0 2023-10-05T21:15:13.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.432+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x7f11a8039030 2023-10-05T21:15:13.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.432+0000 7f11b6290700 1 -- 172.21.15.153:0/2282905613 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11ac006070 con 0x7f11a8039030 2023-10-05T21:15:13.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.432+0000 7f11b6290700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x55c4296b3e10 2023-10-05T21:15:13.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.432+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11a8036070 con 0x55c4296b3e10 2023-10-05T21:15:13.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.432+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x7f11ac00d8e0 2023-10-05T21:15:13.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.432+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11b000a570 con 0x7f11ac00d8e0 2023-10-05T21:15:13.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.432+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x55c4296829d0 2023-10-05T21:15:13.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.433+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.433+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b80d0 con 0x7f11a8039030 2023-10-05T21:15:13.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.433+0000 7f11b6290700 1 -- 172.21.15.153:0/2282905613 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11ac006070 con 0x7f11a8039030 2023-10-05T21:15:13.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.433+0000 7f11c39b9680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:13.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.433+0000 7f11c39b9680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:13.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.433+0000 7f11c39b9680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:13.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.433+0000 7f11c39b9680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:13.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.433+0000 7f11c39b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.433+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b71f0 con 0x55c4296829d0 2023-10-05T21:15:13.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.433+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.433+0000 7f11c39b9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.433+0000 7f11c39b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.433+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b6df0 con 0x55c4296829d0 2023-10-05T21:15:13.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.433+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.433+0000 7f11c39b9680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.433+0000 7f11c39b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.433+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b7b30 con 0x55c4296829d0 2023-10-05T21:15:13.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.433+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.433+0000 7f11c39b9680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:13.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.434+0000 7f11c39b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.434+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b8480 con 0x55c4296b3e10 2023-10-05T21:15:13.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.434+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f11a8036070 con 0x55c4296b3e10 2023-10-05T21:15:13.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.434+0000 7f11c39b9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.434+0000 7f11c39b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.434+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b7620 con 0x55c4296829d0 2023-10-05T21:15:13.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.434+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.434+0000 7f11c39b9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.434+0000 7f11c39b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.434+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b8da0 con 0x55c4296829d0 2023-10-05T21:15:13.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.434+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.434+0000 7f11c39b9680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.434+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b9db0 con 0x55c4296b3e10 2023-10-05T21:15:13.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.434+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11a8036070 con 0x55c4296b3e10 2023-10-05T21:15:13.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.434+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b9db0 con 0x7f11a8039030 2023-10-05T21:15:13.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.435+0000 7f11b6290700 1 -- 172.21.15.153:0/2282905613 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11ac006070 con 0x7f11a8039030 2023-10-05T21:15:13.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.435+0000 7f11b6290700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b9db0 con 0x7f11ac00d8e0 2023-10-05T21:15:13.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.435+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11b000a570 con 0x7f11ac00d8e0 2023-10-05T21:15:13.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.435+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b7b30 con 0x55c4296829d0 2023-10-05T21:15:13.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.435+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.435+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b7b30 con 0x55c4296829d0 2023-10-05T21:15:13.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.435+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.435+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b7b30 con 0x7f11ac00d8e0 2023-10-05T21:15:13.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.436+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11b000a570 con 0x7f11ac00d8e0 2023-10-05T21:15:13.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.436+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b7b30 con 0x7f11ac00d8e0 2023-10-05T21:15:13.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.436+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11b000a570 con 0x7f11ac00d8e0 2023-10-05T21:15:13.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.436+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b7b30 con 0x7f11a8039030 2023-10-05T21:15:13.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.436+0000 7f11b6290700 1 -- 172.21.15.153:0/2282905613 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11ac006070 con 0x7f11a8039030 2023-10-05T21:15:13.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.436+0000 7f11b6290700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b7b30 con 0x55c4296b3e10 2023-10-05T21:15:13.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.436+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f11a8036070 con 0x55c4296b3e10 2023-10-05T21:15:13.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.436+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b7b30 con 0x55c4296829d0 2023-10-05T21:15:13.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.437+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.437+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b7b30 con 0x7f11ac00d8e0 2023-10-05T21:15:13.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.437+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11b000a570 con 0x7f11ac00d8e0 2023-10-05T21:15:13.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.437+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b7b30 con 0x55c4296829d0 2023-10-05T21:15:13.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.437+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.437+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b7b30 con 0x7f11a8039030 2023-10-05T21:15:13.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.437+0000 7f11b6290700 1 -- 172.21.15.153:0/2282905613 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11ac006070 con 0x7f11a8039030 2023-10-05T21:15:13.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.437+0000 7f11b6290700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b7b30 con 0x55c4296b3e10 2023-10-05T21:15:13.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.437+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11a8036070 con 0x55c4296b3e10 2023-10-05T21:15:13.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.437+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b7b30 con 0x55c4296b3e10 2023-10-05T21:15:13.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.438+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11a8036070 con 0x55c4296b3e10 2023-10-05T21:15:13.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.438+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b7b30 con 0x7f11ac00d8e0 2023-10-05T21:15:13.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.438+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11b000a570 con 0x7f11ac00d8e0 2023-10-05T21:15:13.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.438+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b7b30 con 0x55c4296b3e10 2023-10-05T21:15:13.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.438+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11a8036070 con 0x55c4296b3e10 2023-10-05T21:15:13.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.438+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b7b30 con 0x55c4296b3e10 2023-10-05T21:15:13.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.438+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11a8036070 con 0x55c4296b3e10 2023-10-05T21:15:13.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.438+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b7b30 con 0x55c4296829d0 2023-10-05T21:15:13.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.438+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.438+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b7b30 con 0x55c4296829d0 2023-10-05T21:15:13.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.439+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.439+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b7b30 con 0x7f11ac00d8e0 2023-10-05T21:15:13.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.439+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11b000a570 con 0x7f11ac00d8e0 2023-10-05T21:15:13.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.439+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b7b30 con 0x55c4296b3e10 2023-10-05T21:15:13.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.439+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11a8036070 con 0x55c4296b3e10 2023-10-05T21:15:13.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.439+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b7b30 con 0x7f11a8039030 2023-10-05T21:15:13.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.439+0000 7f11b6290700 1 -- 172.21.15.153:0/2282905613 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11ac006070 con 0x7f11a8039030 2023-10-05T21:15:13.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.439+0000 7f11b6290700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b7b30 con 0x55c4296829d0 2023-10-05T21:15:13.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.440+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.440+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b7b30 con 0x7f11ac00d8e0 2023-10-05T21:15:13.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.440+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11b000a570 con 0x7f11ac00d8e0 2023-10-05T21:15:13.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.440+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b7b30 con 0x55c4296b3e10 2023-10-05T21:15:13.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.440+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11a8036070 con 0x55c4296b3e10 2023-10-05T21:15:13.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.440+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b7b30 con 0x7f11ac00d8e0 2023-10-05T21:15:13.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.440+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11b000a570 con 0x7f11ac00d8e0 2023-10-05T21:15:13.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.440+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b7b30 con 0x7f11a8039030 2023-10-05T21:15:13.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.440+0000 7f11b6290700 1 -- 172.21.15.153:0/2282905613 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11ac006070 con 0x7f11a8039030 2023-10-05T21:15:13.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.440+0000 7f11b6290700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b7b30 con 0x55c4296b3e10 2023-10-05T21:15:13.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.441+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11a8036070 con 0x55c4296b3e10 2023-10-05T21:15:13.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.441+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b7b30 con 0x7f11ac00d8e0 2023-10-05T21:15:13.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.441+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11b000a570 con 0x7f11ac00d8e0 2023-10-05T21:15:13.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.441+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b7b30 con 0x55c4296829d0 2023-10-05T21:15:13.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.441+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.441+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b7b30 con 0x7f11a8039030 2023-10-05T21:15:13.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.441+0000 7f11b6290700 1 -- 172.21.15.153:0/2282905613 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f11ac006070 con 0x7f11a8039030 2023-10-05T21:15:13.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.441+0000 7f11c39b9680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:13.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.441+0000 7f11c39b9680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:13.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.441+0000 7f11c39b9680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:13.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.441+0000 7f11c39b9680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:13.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.441+0000 7f11c39b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.441+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b8da0 con 0x55c4296829d0 2023-10-05T21:15:13.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.442+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.442+0000 7f11c39b9680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.442+0000 7f11c39b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.442+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b9150 con 0x55c4296b3e10 2023-10-05T21:15:13.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.442+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f11a8036070 con 0x55c4296b3e10 2023-10-05T21:15:13.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.442+0000 7f11c39b9680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:13.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.442+0000 7f11c39b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.442+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b8940 con 0x55c4296829d0 2023-10-05T21:15:13.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.442+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.442+0000 7f11c39b9680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.442+0000 7f11c39b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.442+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b8960 con 0x55c4296829d0 2023-10-05T21:15:13.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.442+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.442+0000 7f11c39b9680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:13.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.442+0000 7f11c39b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.442+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b9f70 con 0x7f11ac00d8e0 2023-10-05T21:15:13.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.443+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f11b000a570 con 0x7f11ac00d8e0 2023-10-05T21:15:13.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.443+0000 7f11c39b9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.443+0000 7f11c39b9680 20 zone default found 2023-10-05T21:15:13.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.443+0000 7f11c39b9680 4 Realm: () 2023-10-05T21:15:13.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.443+0000 7f11c39b9680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:13.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.443+0000 7f11c39b9680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:13.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.443+0000 7f11c39b9680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:13.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.443+0000 7f11c39b9680 20 zonegroup default 2023-10-05T21:15:13.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.443+0000 7f11c39b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.443+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296b9f70 con 0x7f11ac00d8e0 2023-10-05T21:15:13.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.443+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f11b000a570 con 0x7f11ac00d8e0 2023-10-05T21:15:13.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.443+0000 7f11c39b9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.443+0000 7f11c39b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.443+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296bb590 con 0x55c4296b3e10 2023-10-05T21:15:13.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.443+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f11a8036070 con 0x55c4296b3e10 2023-10-05T21:15:13.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.443+0000 7f11c39b9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.443+0000 7f11c39b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.443+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296bb940 con 0x55c4296b3e10 2023-10-05T21:15:13.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.443+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f11a8036070 con 0x55c4296b3e10 2023-10-05T21:15:13.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.443+0000 7f11c39b9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.443+0000 7f11c39b9680 20 started sync module instance, tier type = 2023-10-05T21:15:13.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.443+0000 7f11c39b9680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:13.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.443+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296baca0 con 0x7f11a8039030 2023-10-05T21:15:13.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.444+0000 7f11b6290700 1 -- 172.21.15.153:0/2282905613 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11ac006070 con 0x7f11a8039030 2023-10-05T21:15:13.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.444+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94300996874400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296bc260 con 0x7f11a8039030 2023-10-05T21:15:13.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.444+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296bcb00 con 0x55c4296829d0 2023-10-05T21:15:13.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.445+0000 7f11b6290700 1 -- 172.21.15.153:0/2282905613 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94300996874400] v29'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11ac006070 con 0x7f11a8039030 2023-10-05T21:15:13.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.445+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.445+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94300996879888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296bbe90 con 0x55c4296829d0 2023-10-05T21:15:13.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.445+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296bd750 con 0x55c4296b3e10 2023-10-05T21:15:13.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.445+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94300996879888] v29'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.445+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11a8036070 con 0x55c4296b3e10 2023-10-05T21:15:13.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.445+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94300996882944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296bd710 con 0x55c4296b3e10 2023-10-05T21:15:13.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.446+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296be1b0 con 0x7f11a8039030 2023-10-05T21:15:13.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.446+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94300996882944] v29'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11a8036070 con 0x55c4296b3e10 2023-10-05T21:15:13.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.446+0000 7f11b6290700 1 -- 172.21.15.153:0/2282905613 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11ac006070 con 0x7f11a8039030 2023-10-05T21:15:13.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.446+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94300996885696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296be560 con 0x7f11a8039030 2023-10-05T21:15:13.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.446+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296bef70 con 0x55c4296829d0 2023-10-05T21:15:13.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.447+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.447+0000 7f11b6290700 1 -- 172.21.15.153:0/2282905613 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94300996885696] v29'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11ac006070 con 0x7f11a8039030 2023-10-05T21:15:13.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.447+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94300996889776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296bf6f0 con 0x55c4296829d0 2023-10-05T21:15:13.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.447+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296bcbd0 con 0x7f11ac00d8e0 2023-10-05T21:15:13.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.448+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94300996889776] v29'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.448+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11b000a570 con 0x7f11ac00d8e0 2023-10-05T21:15:13.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.448+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94300996893712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296bcbd0 con 0x7f11ac00d8e0 2023-10-05T21:15:13.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.448+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296c07b0 con 0x7f11ac00d8e0 2023-10-05T21:15:13.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.448+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94300996893712] v29'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11b000a570 con 0x7f11ac00d8e0 2023-10-05T21:15:13.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.448+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11b000a570 con 0x7f11ac00d8e0 2023-10-05T21:15:13.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.448+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94300996890880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296c07b0 con 0x7f11ac00d8e0 2023-10-05T21:15:13.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.449+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296c1220 con 0x7f11ac00d8e0 2023-10-05T21:15:13.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.449+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94300996890880] v29'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11b000a570 con 0x7f11ac00d8e0 2023-10-05T21:15:13.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.449+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11b000a570 con 0x7f11ac00d8e0 2023-10-05T21:15:13.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.449+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94300996898000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296c1450 con 0x7f11ac00d8e0 2023-10-05T21:15:13.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.449+0000 7f11c39b9680 20 add_watcher() i=0 2023-10-05T21:15:13.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.449+0000 7f11c39b9680 20 add_watcher() i=1 2023-10-05T21:15:13.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.449+0000 7f11c39b9680 20 add_watcher() i=2 2023-10-05T21:15:13.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.449+0000 7f11c39b9680 20 add_watcher() i=3 2023-10-05T21:15:13.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.449+0000 7f11c39b9680 20 add_watcher() i=4 2023-10-05T21:15:13.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.449+0000 7f11c39b9680 20 add_watcher() i=5 2023-10-05T21:15:13.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.449+0000 7f11c39b9680 20 add_watcher() i=6 2023-10-05T21:15:13.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.450+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94300996898000] v29'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11b000a570 con 0x7f11ac00d8e0 2023-10-05T21:15:13.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.450+0000 7f11c39b9680 20 add_watcher() i=7 2023-10-05T21:15:13.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.450+0000 7f11c39b9680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:13.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.450+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296c4860 con 0x55c4296829d0 2023-10-05T21:15:13.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.450+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.450+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94300996899648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296c1c80 con 0x55c4296829d0 2023-10-05T21:15:13.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.451+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94300996899648] v29'62 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.451+0000 7f1187fe7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:13.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.451+0000 7f11c39b9680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:13.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.451+0000 7f11c39b9680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:13.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.451+0000 7f11c39b9680 1 Processor -- start 2023-10-05T21:15:13.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.451+0000 7f11c39b9680 1 -- start start 2023-10-05T21:15:13.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.451+0000 7f11c39b9680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c4296cf050 0x55c4296cf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.452+0000 7f11c39b9680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4296cfa30 con 0x55c4296cf050 2023-10-05T21:15:13.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.452+0000 7f11b6290700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c4296cf050 0x55c4296cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.452+0000 7f11b6290700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c4296cf050 0x55c4296cf460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49588/0 (socket says 172.21.15.153:49588) 2023-10-05T21:15:13.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.452+0000 7f11b6290700 1 -- 172.21.15.153:0/3251593648 learned_addr learned my addr 172.21.15.153:0/3251593648 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:13.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.452+0000 7f11b6290700 1 -- 172.21.15.153:0/3251593648 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4296cfb70 con 0x55c4296cf050 2023-10-05T21:15:13.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.452+0000 7f11b6290700 1 --2- 172.21.15.153:0/3251593648 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c4296cf050 0x55c4296cf460 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55c4296b3260 tx=0x7f11ac006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f4e0dde5daa35c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.452+0000 7f11877e6700 1 -- 172.21.15.153:0/3251593648 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11ac023040 con 0x55c4296cf050 2023-10-05T21:15:13.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.452+0000 7f11877e6700 1 -- 172.21.15.153:0/3251593648 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ac024040 con 0x55c4296cf050 2023-10-05T21:15:13.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.452+0000 7f11877e6700 1 -- 172.21.15.153:0/3251593648 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11ac013040 con 0x55c4296cf050 2023-10-05T21:15:13.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.453+0000 7f11c39b9680 1 -- 172.21.15.153:0/3251593648 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c4296cf050 msgr2=0x55c4296cf460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.453+0000 7f11c39b9680 1 --2- 172.21.15.153:0/3251593648 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c4296cf050 0x55c4296cf460 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55c4296b3260 tx=0x7f11ac006000 comp rx=0 tx=0).stop 2023-10-05T21:15:13.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.453+0000 7f11c39b9680 1 -- 172.21.15.153:0/3251593648 shutdown_connections 2023-10-05T21:15:13.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.453+0000 7f11c39b9680 1 --2- 172.21.15.153:0/3251593648 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c4296cf050 0x55c4296cf460 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.453+0000 7f11c39b9680 1 -- 172.21.15.153:0/3251593648 >> 172.21.15.153:0/3251593648 conn(0x55c4296ca250 msgr2=0x55c4296c83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:13.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.453+0000 7f11c39b9680 1 -- 172.21.15.153:0/3251593648 shutdown_connections 2023-10-05T21:15:13.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.453+0000 7f11c39b9680 1 -- 172.21.15.153:0/3251593648 wait complete. 2023-10-05T21:15:13.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.453+0000 7f11c39b9680 1 Processor -- start 2023-10-05T21:15:13.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.454+0000 7f11c39b9680 1 -- start start 2023-10-05T21:15:13.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.454+0000 7f11c39b9680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c4296cf050 0x55c4296d4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.454+0000 7f11c39b9680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4296d5100 con 0x55c4296cf050 2023-10-05T21:15:13.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.454+0000 7f11b6290700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c4296cf050 0x55c4296d4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.454+0000 7f11b6290700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c4296cf050 0x55c4296d4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49594/0 (socket says 172.21.15.153:49594) 2023-10-05T21:15:13.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.454+0000 7f11b6290700 1 -- 172.21.15.153:0/4222775173 learned_addr learned my addr 172.21.15.153:0/4222775173 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:13.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.454+0000 7f11b6290700 1 -- 172.21.15.153:0/4222775173 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ac00ecc0 con 0x55c4296cf050 2023-10-05T21:15:13.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.454+0000 7f11b6290700 1 --2- 172.21.15.153:0/4222775173 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c4296cf050 0x55c4296d4bc0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55c4296b2fe0 tx=0x7f11ac030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.455+0000 7f1185fe3700 1 -- 172.21.15.153:0/4222775173 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11ac023040 con 0x55c4296cf050 2023-10-05T21:15:13.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.455+0000 7f1185fe3700 1 -- 172.21.15.153:0/4222775173 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ac01e570 con 0x55c4296cf050 2023-10-05T21:15:13.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.455+0000 7f11c39b9680 1 -- 172.21.15.153:0/4222775173 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c4296d5300 con 0x55c4296cf050 2023-10-05T21:15:13.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.455+0000 7f1185fe3700 1 -- 172.21.15.153:0/4222775173 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11ac01e700 con 0x55c4296cf050 2023-10-05T21:15:13.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.455+0000 7f11c39b9680 1 -- 172.21.15.153:0/4222775173 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c4296d5750 con 0x55c4296cf050 2023-10-05T21:15:13.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.455+0000 7f1185fe3700 1 -- 172.21.15.153:0/4222775173 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f11ac01e860 con 0x55c4296cf050 2023-10-05T21:15:13.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.456+0000 7f1185fe3700 1 --2- 172.21.15.153:0/4222775173 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f10fc034140 0x7f10fc0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.456+0000 7f1185fe3700 1 -- 172.21.15.153:0/4222775173 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f11ac04fb00 con 0x55c4296cf050 2023-10-05T21:15:13.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.456+0000 7f11b7292700 1 --2- 172.21.15.153:0/4222775173 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f10fc034140 0x7f10fc0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.456+0000 7f11c39b9680 5 note: GC not initialized 2023-10-05T21:15:13.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.456+0000 7f11b7292700 1 --2- 172.21.15.153:0/4222775173 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f10fc034140 0x7f10fc0365f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x55c4296c05d0 tx=0x7f11b000af00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.457+0000 7f10f6ffd700 20 reqs_thread_entry: start 2023-10-05T21:15:13.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.457+0000 7f10f4ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:13.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.457+0000 7f11c39b9680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:13.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.457+0000 7f11c39b9680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:13.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.457+0000 7f10e6ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:43 2023 2023-10-05T21:15:13.517 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:13.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.457+0000 7f10e67fc700 20 reqs_thread_entry: start 2023-10-05T21:15:13.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.457+0000 7f11c39b9680 20 get_system_obj_state: rctx=0x7ffdcf69de38 obj=default.rgw.meta:users.uid:foo state=0x55c429530240 s->prefetch_data=0 2023-10-05T21:15:13.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.457+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c42973a470 con 0x55c4296829d0 2023-10-05T21:15:13.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.458+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.458+0000 7f11c39b9680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:13.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.458+0000 7f11c39b9680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:13.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.458+0000 7f11c39b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.458+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c42973c700 con 0x55c4296829d0 2023-10-05T21:15:13.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.458+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.458+0000 7f11c39b9680 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T21:15:13.518 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "foo", 2023-10-05T21:15:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Foo", 2023-10-05T21:15:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "foo@foo.com", 2023-10-05T21:15:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2023-10-05T21:15:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 4, 2023-10-05T21:15:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [], 2023-10-05T21:15:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2023-10-05T21:15:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T21:15:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [], 2023-10-05T21:15:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2023-10-05T21:15:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2023-10-05T21:15:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2023-10-05T21:15:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2023-10-05T21:15:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2023-10-05T21:15:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:15:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2023-10-05T21:15:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2023-10-05T21:15:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2023-10-05T21:15:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [] 2023-10-05T21:15:13.523 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:15:13.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.458+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94300996874400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c42973c700 con 0x7f11a8039030 2023-10-05T21:15:13.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.459+0000 7f11b6290700 1 -- 172.21.15.153:0/2282905613 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94300996874400] v29'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11ac006070 con 0x7f11a8039030 2023-10-05T21:15:13.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.459+0000 7f11c39b9680 20 remove_watcher() i=0 2023-10-05T21:15:13.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.459+0000 7f11c39b9680 2 removed watcher, disabling cache 2023-10-05T21:15:13.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.459+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94300996879888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296bb0a0 con 0x55c4296829d0 2023-10-05T21:15:13.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.460+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94300996879888] v29'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.460+0000 7f11c39b9680 20 remove_watcher() i=1 2023-10-05T21:15:13.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.460+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94300996882944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296bc610 con 0x55c4296b3e10 2023-10-05T21:15:13.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.460+0000 7f11b6a91700 1 -- 172.21.15.153:0/2282905613 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94300996882944] v29'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11a8036070 con 0x55c4296b3e10 2023-10-05T21:15:13.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.460+0000 7f11c39b9680 20 remove_watcher() i=2 2023-10-05T21:15:13.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.460+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94300996885696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296bc610 con 0x7f11a8039030 2023-10-05T21:15:13.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.461+0000 7f11b6290700 1 -- 172.21.15.153:0/2282905613 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94300996885696] v29'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11ac006070 con 0x7f11a8039030 2023-10-05T21:15:13.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.461+0000 7f11c39b9680 20 remove_watcher() i=3 2023-10-05T21:15:13.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.461+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94300996889776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296bc610 con 0x55c4296829d0 2023-10-05T21:15:13.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.462+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94300996889776] v29'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.462+0000 7f11c39b9680 20 remove_watcher() i=4 2023-10-05T21:15:13.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.462+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94300996893712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296becb0 con 0x7f11ac00d8e0 2023-10-05T21:15:13.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.463+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94300996893712] v29'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11b000a570 con 0x7f11ac00d8e0 2023-10-05T21:15:13.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.463+0000 7f11c39b9680 20 remove_watcher() i=5 2023-10-05T21:15:13.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.463+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94300996890880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296bc610 con 0x7f11ac00d8e0 2023-10-05T21:15:13.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.463+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94300996890880] v29'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11b000a570 con 0x7f11ac00d8e0 2023-10-05T21:15:13.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.463+0000 7f11c39b9680 20 remove_watcher() i=6 2023-10-05T21:15:13.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.463+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94300996898000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296bfc10 con 0x7f11ac00d8e0 2023-10-05T21:15:13.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.464+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94300996898000] v29'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f11b000a570 con 0x7f11ac00d8e0 2023-10-05T21:15:13.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.464+0000 7f11c39b9680 20 remove_watcher() i=7 2023-10-05T21:15:13.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.465+0000 7f1187fe7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:13.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.465+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:112 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94300996899648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c4296bc610 con 0x55c4296829d0 2023-10-05T21:15:13.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.465+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(112 data_loggenerations_metadata [watch unwatch cookie 94300996899648] v29'63 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f11b000a570 con 0x55c4296829d0 2023-10-05T21:15:13.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.465+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f11ac00d8e0 msgr2=0x7f11ac00c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.465+0000 7f11c39b9680 1 --2- 172.21.15.153:0/2282905613 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f11ac00d8e0 0x7f11ac00c360 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.465+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55c4296829d0 msgr2=0x55c4296b19f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.465+0000 7f11c39b9680 1 --2- 172.21.15.153:0/2282905613 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55c4296829d0 0x55c4296b19f0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.465+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f11a8039030 msgr2=0x7f11a80063a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.465+0000 7f11c39b9680 1 --2- 172.21.15.153:0/2282905613 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f11a8039030 0x7f11a80063a0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.465+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55c4296b3e10 msgr2=0x55c4296b61f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.465+0000 7f11c39b9680 1 --2- 172.21.15.153:0/2282905613 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55c4296b3e10 0x55c4296b61f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.466+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f119c034140 msgr2=0x7f119c0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.466+0000 7f11c39b9680 1 --2- 172.21.15.153:0/2282905613 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f119c034140 0x7f119c0365f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0011e0 tx=0x7f11ac0013a0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.466+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c4295f1930 msgr2=0x55c4296a5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.466+0000 7f11c39b9680 1 --2- 172.21.15.153:0/2282905613 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c4295f1930 0x55c4296a5cb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f11a800a520 tx=0x7f11a801d000 comp rx=0 tx=0).stop 2023-10-05T21:15:13.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.466+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 reap_dead start 2023-10-05T21:15:13.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.466+0000 7f11b7292700 1 -- 172.21.15.153:0/2282905613 reap_dead start 2023-10-05T21:15:13.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.466+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 shutdown_connections 2023-10-05T21:15:13.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.466+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 >> 172.21.15.153:0/2282905613 conn(0x55c429677b80 msgr2=0x55c429698c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:13.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.466+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 shutdown_connections 2023-10-05T21:15:13.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.466+0000 7f11c39b9680 1 -- 172.21.15.153:0/2282905613 wait complete. 2023-10-05T21:15:13.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.466+0000 7f11c39b9680 1 -- 172.21.15.153:0/4222775173 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f10fc034140 msgr2=0x7f10fc0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.466+0000 7f11c39b9680 1 --2- 172.21.15.153:0/4222775173 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f10fc034140 0x7f10fc0365f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x55c4296c05d0 tx=0x7f11b000af00 comp rx=0 tx=0).stop 2023-10-05T21:15:13.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.466+0000 7f11c39b9680 1 -- 172.21.15.153:0/4222775173 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c4296cf050 msgr2=0x55c4296d4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.466+0000 7f11c39b9680 1 --2- 172.21.15.153:0/4222775173 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c4296cf050 0x55c4296d4bc0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55c4296b2fe0 tx=0x7f11ac030000 comp rx=0 tx=0).stop 2023-10-05T21:15:13.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.466+0000 7f11c39b9680 1 -- 172.21.15.153:0/4222775173 shutdown_connections 2023-10-05T21:15:13.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.466+0000 7f11c39b9680 1 --2- 172.21.15.153:0/4222775173 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f10fc034140 0x7f10fc0365f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.466+0000 7f11c39b9680 1 --2- 172.21.15.153:0/4222775173 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c4296cf050 0x55c4296d4bc0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.466+0000 7f11c39b9680 1 -- 172.21.15.153:0/4222775173 >> 172.21.15.153:0/4222775173 conn(0x55c4296ca250 msgr2=0x55c4296c8380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:13.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.466+0000 7f11c39b9680 1 -- 172.21.15.153:0/4222775173 shutdown_connections 2023-10-05T21:15:13.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.466+0000 7f11c39b9680 1 -- 172.21.15.153:0/4222775173 wait complete. 2023-10-05T21:15:13.542 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:15:13.542 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2023-10-05T21:15:13.542 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2023-10-05T21:15:13.542 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2023-10-05T21:15:13.592 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:13.592 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:13.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.591+0000 7f40d836c680 1 Processor -- start 2023-10-05T21:15:13.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.591+0000 7f40d836c680 1 -- start start 2023-10-05T21:15:13.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.591+0000 7f40d836c680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x563c0d084040 0x563c0d113030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.591+0000 7f40d836c680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563c0d05d930 con 0x563c0d113570 2023-10-05T21:15:13.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.591+0000 7f40d836c680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x563c0d01ddb0 con 0x563c0d084040 2023-10-05T21:15:13.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.592+0000 7f40cb444700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x563c0d084040 0x563c0d113030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.592+0000 7f40cac43700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x563c0d113570 0x563c0d115950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56254/0 (socket says 172.21.15.153:56254) 2023-10-05T21:15:13.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.592+0000 7f40cac43700 1 -- 172.21.15.153:0/911583369 learned_addr learned my addr 172.21.15.153:0/911583369 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:13.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.592+0000 7f40cb444700 1 -- 172.21.15.153:0/911583369 >> v1:172.21.15.111:6789/0 conn(0x563c0d113570 legacy=0x563c0d115950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.592+0000 7f40cb444700 1 -- 172.21.15.153:0/911583369 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c0d118180 con 0x563c0d084040 2023-10-05T21:15:13.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.592+0000 7f40cb444700 1 --2- 172.21.15.153:0/911583369 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d084040 0x563c0d113030 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f40c000a5d0 tx=0x7f40c0005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c42671625f4bbd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.592+0000 7f40ca442700 1 -- 172.21.15.153:0/911583369 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40c00086a0 con 0x563c0d084040 2023-10-05T21:15:13.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.592+0000 7f40ca442700 1 -- 172.21.15.153:0/911583369 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c0008800 con 0x563c0d084040 2023-10-05T21:15:13.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.592+0000 7f40ca442700 1 -- 172.21.15.153:0/911583369 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40c0008ad0 con 0x563c0d084040 2023-10-05T21:15:13.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.593+0000 7f40d836c680 1 -- 172.21.15.153:0/911583369 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d084040 msgr2=0x563c0d113030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.593+0000 7f40d836c680 1 --2- 172.21.15.153:0/911583369 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d084040 0x563c0d113030 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f40c000a5d0 tx=0x7f40c0005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:13.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.593+0000 7f40d836c680 1 -- 172.21.15.153:0/911583369 shutdown_connections 2023-10-05T21:15:13.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.593+0000 7f40d836c680 1 --2- 172.21.15.153:0/911583369 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d084040 0x563c0d113030 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.593+0000 7f40d836c680 1 -- 172.21.15.153:0/911583369 >> 172.21.15.153:0/911583369 conn(0x563c0d10ab20 msgr2=0x563c0d10cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:13.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.593+0000 7f40d836c680 1 -- 172.21.15.153:0/911583369 shutdown_connections 2023-10-05T21:15:13.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.593+0000 7f40d836c680 1 -- 172.21.15.153:0/911583369 wait complete. 2023-10-05T21:15:13.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.594+0000 7f40d836c680 1 Processor -- start 2023-10-05T21:15:13.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.594+0000 7f40d836c680 1 -- start start 2023-10-05T21:15:13.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.594+0000 7f40d836c680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d084040 0x563c0d12f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.594+0000 7f40d836c680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c0cfbdea0 con 0x563c0d084040 2023-10-05T21:15:13.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.594+0000 7f40cb444700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d084040 0x563c0d12f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.594+0000 7f40cb444700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d084040 0x563c0d12f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49610/0 (socket says 172.21.15.153:49610) 2023-10-05T21:15:13.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.594+0000 7f40cb444700 1 -- 172.21.15.153:0/2043634800 learned_addr learned my addr 172.21.15.153:0/2043634800 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:13.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.594+0000 7f40cb444700 1 -- 172.21.15.153:0/2043634800 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c0005cf0 con 0x563c0d084040 2023-10-05T21:15:13.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.594+0000 7f40cb444700 1 --2- 172.21.15.153:0/2043634800 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d084040 0x563c0d12f960 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f40c0000c00 tx=0x7f40c0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f950f96284b3f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.594+0000 7f40c9440700 1 -- 172.21.15.153:0/2043634800 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40c00086a0 con 0x563c0d084040 2023-10-05T21:15:13.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.594+0000 7f40c9440700 1 -- 172.21.15.153:0/2043634800 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c0008970 con 0x563c0d084040 2023-10-05T21:15:13.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.594+0000 7f40c9440700 1 -- 172.21.15.153:0/2043634800 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40c0008b00 con 0x563c0d084040 2023-10-05T21:15:13.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.595+0000 7f40d836c680 1 -- 172.21.15.153:0/2043634800 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d084040 msgr2=0x563c0d12f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.595+0000 7f40d836c680 1 --2- 172.21.15.153:0/2043634800 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d084040 0x563c0d12f960 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f40c0000c00 tx=0x7f40c0015000 comp rx=0 tx=0).stop 2023-10-05T21:15:13.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.595+0000 7f40d836c680 1 -- 172.21.15.153:0/2043634800 shutdown_connections 2023-10-05T21:15:13.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.595+0000 7f40d836c680 1 --2- 172.21.15.153:0/2043634800 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d084040 0x563c0d12f960 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.595+0000 7f40d836c680 1 -- 172.21.15.153:0/2043634800 >> 172.21.15.153:0/2043634800 conn(0x563c0d10ab20 msgr2=0x563c0d12b430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:13.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.595+0000 7f40d836c680 1 -- 172.21.15.153:0/2043634800 shutdown_connections 2023-10-05T21:15:13.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.595+0000 7f40d836c680 1 -- 172.21.15.153:0/2043634800 wait complete. 2023-10-05T21:15:13.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.595+0000 7f40d836c680 1 Processor -- start 2023-10-05T21:15:13.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.595+0000 7f40d836c680 1 -- start start 2023-10-05T21:15:13.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.596+0000 7f40d836c680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d084040 0x563c0d136d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.596+0000 7f40d836c680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c0cfb4c80 con 0x563c0d084040 2023-10-05T21:15:13.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.596+0000 7f40cb444700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d084040 0x563c0d136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.596+0000 7f40cb444700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d084040 0x563c0d136d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49612/0 (socket says 172.21.15.153:49612) 2023-10-05T21:15:13.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.596+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 learned_addr learned my addr 172.21.15.153:0/459013977 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:13.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.596+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c0d118180 con 0x563c0d084040 2023-10-05T21:15:13.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.596+0000 7f40cb444700 1 --2- 172.21.15.153:0/459013977 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d084040 0x563c0d136d70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f40c000afd0 tx=0x7f40c001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.596+0000 7f40bb7fe700 1 -- 172.21.15.153:0/459013977 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40c001d420 con 0x563c0d084040 2023-10-05T21:15:13.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.596+0000 7f40bb7fe700 1 -- 172.21.15.153:0/459013977 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c001d580 con 0x563c0d084040 2023-10-05T21:15:13.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.596+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563c0d1372b0 con 0x563c0d084040 2023-10-05T21:15:13.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.596+0000 7f40bb7fe700 1 -- 172.21.15.153:0/459013977 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40c001d730 con 0x563c0d084040 2023-10-05T21:15:13.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.596+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c0d137780 con 0x563c0d084040 2023-10-05T21:15:13.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.597+0000 7f40bb7fe700 1 -- 172.21.15.153:0/459013977 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f40c001d890 con 0x563c0d084040 2023-10-05T21:15:13.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.597+0000 7f40bb7fe700 1 --2- 172.21.15.153:0/459013977 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f40b0034140 0x7f40b00365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.597+0000 7f40bb7fe700 1 -- 172.21.15.153:0/459013977 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f40c0049fd0 con 0x563c0d084040 2023-10-05T21:15:13.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.597+0000 7f40cac43700 1 --2- 172.21.15.153:0/459013977 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f40b0034140 0x7f40b00365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.598+0000 7f40d836c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.598+0000 7f40d836c680 1 --2- 172.21.15.153:0/459013977 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x563c0d113570 0x563c0d142b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.598+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1432e0 con 0x563c0d113570 2023-10-05T21:15:13.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.598+0000 7f40cac43700 1 --2- 172.21.15.153:0/459013977 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f40b0034140 0x7f40b00365f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f40bc004170 tx=0x7f40bc001380 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.598+0000 7f40cbc45700 1 --2- 172.21.15.153:0/459013977 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x563c0d113570 0x563c0d142b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.598+0000 7f40cbc45700 1 --2- 172.21.15.153:0/459013977 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x563c0d113570 0x563c0d142b50 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.598+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.598+0000 7f40d836c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.598+0000 7f40d836c680 20 realm 2023-10-05T21:15:13.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.598+0000 7f40d836c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.598+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d140070 con 0x563c0d113570 2023-10-05T21:15:13.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.599+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.599+0000 7f40d836c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.599+0000 7f40d836c680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:13.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.599+0000 7f40d836c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.599+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d143d90 con 0x563c0d113570 2023-10-05T21:15:13.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.599+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.599+0000 7f40d836c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.599+0000 7f40d836c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.599+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1446b0 con 0x563c0d113570 2023-10-05T21:15:13.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.599+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.599+0000 7f40d836c680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.599+0000 7f40d836c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.599+0000 7f40d836c680 1 --2- 172.21.15.153:0/459013977 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x563c0d144f70 0x563c0d147350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.599+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1479a0 con 0x563c0d144f70 2023-10-05T21:15:13.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.599+0000 7f40cb444700 1 --2- 172.21.15.153:0/459013977 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x563c0d144f70 0x563c0d147350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.600+0000 7f40cb444700 1 --2- 172.21.15.153:0/459013977 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x563c0d144f70 0x563c0d147350 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.600+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f40c0019040 con 0x563c0d144f70 2023-10-05T21:15:13.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.600+0000 7f40d836c680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:13.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.600+0000 7f40d836c680 20 searching for the correct realm 2023-10-05T21:15:13.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.600+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x563c0d144f70 2023-10-05T21:15:13.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.600+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c0019040 con 0x563c0d144f70 2023-10-05T21:15:13.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.600+0000 7f40cb444700 1 --2- 172.21.15.153:0/459013977 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f40c0007030 0x7f40c00113b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.600+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x7f40c0007030 2023-10-05T21:15:13.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.600+0000 7f40cac43700 1 --2- 172.21.15.153:0/459013977 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f40c0007030 0x7f40c00113b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.601+0000 7f40cac43700 1 --2- 172.21.15.153:0/459013977 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f40c0007030 0x7f40c00113b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.601+0000 7f40cac43700 1 -- 172.21.15.153:0/459013977 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40bc006070 con 0x7f40c0007030 2023-10-05T21:15:13.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.601+0000 7f40cac43700 1 --2- 172.21.15.153:0/459013977 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f40bc00d3d0 0x7f40bc00d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.601+0000 7f40cac43700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x7f40bc00d3d0 2023-10-05T21:15:13.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.601+0000 7f40cbc45700 1 --2- 172.21.15.153:0/459013977 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f40bc00d3d0 0x7f40bc00d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.601+0000 7f40cbc45700 1 --2- 172.21.15.153:0/459013977 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f40bc00d3d0 0x7f40bc00d820 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.601+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c400a570 con 0x7f40bc00d3d0 2023-10-05T21:15:13.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.602+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x563c0d113570 2023-10-05T21:15:13.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.602+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.602+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x563c0d113570 2023-10-05T21:15:13.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.602+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.602+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x7f40bc00d3d0 2023-10-05T21:15:13.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.602+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c400a570 con 0x7f40bc00d3d0 2023-10-05T21:15:13.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.602+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x7f40bc00d3d0 2023-10-05T21:15:13.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.602+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c400a570 con 0x7f40bc00d3d0 2023-10-05T21:15:13.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.602+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x7f40c0007030 2023-10-05T21:15:13.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.603+0000 7f40cac43700 1 -- 172.21.15.153:0/459013977 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40bc006070 con 0x7f40c0007030 2023-10-05T21:15:13.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.603+0000 7f40cac43700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x563c0d144f70 2023-10-05T21:15:13.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.603+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f40c0019040 con 0x563c0d144f70 2023-10-05T21:15:13.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.603+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x563c0d113570 2023-10-05T21:15:13.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.603+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.603+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x7f40bc00d3d0 2023-10-05T21:15:13.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.603+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c400a570 con 0x7f40bc00d3d0 2023-10-05T21:15:13.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.603+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x563c0d113570 2023-10-05T21:15:13.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.603+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.603+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x7f40c0007030 2023-10-05T21:15:13.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.604+0000 7f40cac43700 1 -- 172.21.15.153:0/459013977 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40bc006070 con 0x7f40c0007030 2023-10-05T21:15:13.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.604+0000 7f40cac43700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x563c0d144f70 2023-10-05T21:15:13.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.604+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c0019040 con 0x563c0d144f70 2023-10-05T21:15:13.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.604+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x563c0d144f70 2023-10-05T21:15:13.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.604+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c0019040 con 0x563c0d144f70 2023-10-05T21:15:13.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.604+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x7f40bc00d3d0 2023-10-05T21:15:13.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.604+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c400a570 con 0x7f40bc00d3d0 2023-10-05T21:15:13.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.604+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x563c0d144f70 2023-10-05T21:15:13.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.604+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c0019040 con 0x563c0d144f70 2023-10-05T21:15:13.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.604+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x563c0d144f70 2023-10-05T21:15:13.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.605+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c0019040 con 0x563c0d144f70 2023-10-05T21:15:13.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.605+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x563c0d113570 2023-10-05T21:15:13.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.605+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.605+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x563c0d113570 2023-10-05T21:15:13.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.605+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.605+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x7f40bc00d3d0 2023-10-05T21:15:13.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.605+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c400a570 con 0x7f40bc00d3d0 2023-10-05T21:15:13.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.605+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x563c0d144f70 2023-10-05T21:15:13.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.606+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c0019040 con 0x563c0d144f70 2023-10-05T21:15:13.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.606+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x7f40c0007030 2023-10-05T21:15:13.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.606+0000 7f40cac43700 1 -- 172.21.15.153:0/459013977 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40bc006070 con 0x7f40c0007030 2023-10-05T21:15:13.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.606+0000 7f40cac43700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x563c0d113570 2023-10-05T21:15:13.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.606+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.606+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x7f40bc00d3d0 2023-10-05T21:15:13.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.606+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c400a570 con 0x7f40bc00d3d0 2023-10-05T21:15:13.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.606+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x563c0d144f70 2023-10-05T21:15:13.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.607+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c0019040 con 0x563c0d144f70 2023-10-05T21:15:13.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.607+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x7f40bc00d3d0 2023-10-05T21:15:13.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.607+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c400a570 con 0x7f40bc00d3d0 2023-10-05T21:15:13.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.607+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x7f40c0007030 2023-10-05T21:15:13.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.607+0000 7f40cac43700 1 -- 172.21.15.153:0/459013977 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40bc006070 con 0x7f40c0007030 2023-10-05T21:15:13.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.607+0000 7f40cac43700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x563c0d144f70 2023-10-05T21:15:13.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.607+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c0019040 con 0x563c0d144f70 2023-10-05T21:15:13.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.607+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x7f40bc00d3d0 2023-10-05T21:15:13.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.608+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c400a570 con 0x7f40bc00d3d0 2023-10-05T21:15:13.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.608+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x563c0d113570 2023-10-05T21:15:13.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.608+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.608+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1494d0 con 0x7f40c0007030 2023-10-05T21:15:13.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.608+0000 7f40cac43700 1 -- 172.21.15.153:0/459013977 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40bc006070 con 0x7f40c0007030 2023-10-05T21:15:13.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.608+0000 7f40d836c680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:13.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.608+0000 7f40d836c680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:13.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.608+0000 7f40d836c680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:13.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.608+0000 7f40d836c680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:13.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.608+0000 7f40d836c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.608+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d148420 con 0x563c0d113570 2023-10-05T21:15:13.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.608+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.608+0000 7f40d836c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.608+0000 7f40d836c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.608+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d148820 con 0x563c0d113570 2023-10-05T21:15:13.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.608+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.609+0000 7f40d836c680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.609+0000 7f40d836c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.609+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d149960 con 0x563c0d113570 2023-10-05T21:15:13.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.609+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.609+0000 7f40d836c680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:13.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.609+0000 7f40d836c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.609+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d149d10 con 0x563c0d144f70 2023-10-05T21:15:13.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.609+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f40c0019040 con 0x563c0d144f70 2023-10-05T21:15:13.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.609+0000 7f40d836c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.609+0000 7f40d836c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.609+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d14a0c0 con 0x563c0d113570 2023-10-05T21:15:13.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.609+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.609+0000 7f40d836c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.609+0000 7f40d836c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.609+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d14a0c0 con 0x563c0d113570 2023-10-05T21:15:13.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.609+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.609+0000 7f40d836c680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.609+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d14a0c0 con 0x563c0d144f70 2023-10-05T21:15:13.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.610+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c0019040 con 0x563c0d144f70 2023-10-05T21:15:13.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.610+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d14a0c0 con 0x7f40c0007030 2023-10-05T21:15:13.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.610+0000 7f40cac43700 1 -- 172.21.15.153:0/459013977 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40bc006070 con 0x7f40c0007030 2023-10-05T21:15:13.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.610+0000 7f40cac43700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d14a0c0 con 0x7f40bc00d3d0 2023-10-05T21:15:13.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.610+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c400a570 con 0x7f40bc00d3d0 2023-10-05T21:15:13.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.610+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d149960 con 0x563c0d113570 2023-10-05T21:15:13.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.610+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.610+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d149960 con 0x563c0d113570 2023-10-05T21:15:13.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.611+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.611+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d149960 con 0x7f40bc00d3d0 2023-10-05T21:15:13.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.611+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c400a570 con 0x7f40bc00d3d0 2023-10-05T21:15:13.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.611+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d149960 con 0x7f40bc00d3d0 2023-10-05T21:15:13.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.611+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c400a570 con 0x7f40bc00d3d0 2023-10-05T21:15:13.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.611+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d149960 con 0x7f40c0007030 2023-10-05T21:15:13.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.611+0000 7f40cac43700 1 -- 172.21.15.153:0/459013977 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40bc006070 con 0x7f40c0007030 2023-10-05T21:15:13.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.611+0000 7f40cac43700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d149960 con 0x563c0d144f70 2023-10-05T21:15:13.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.611+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f40c0019040 con 0x563c0d144f70 2023-10-05T21:15:13.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.611+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d149960 con 0x563c0d113570 2023-10-05T21:15:13.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.612+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.612+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d149960 con 0x7f40bc00d3d0 2023-10-05T21:15:13.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.612+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c400a570 con 0x7f40bc00d3d0 2023-10-05T21:15:13.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.612+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d149960 con 0x563c0d113570 2023-10-05T21:15:13.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.612+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.612+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d149960 con 0x7f40c0007030 2023-10-05T21:15:13.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.612+0000 7f40cac43700 1 -- 172.21.15.153:0/459013977 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40bc006070 con 0x7f40c0007030 2023-10-05T21:15:13.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.612+0000 7f40cac43700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d149960 con 0x563c0d144f70 2023-10-05T21:15:13.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.613+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c0019040 con 0x563c0d144f70 2023-10-05T21:15:13.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.613+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d149960 con 0x563c0d144f70 2023-10-05T21:15:13.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.613+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c0019040 con 0x563c0d144f70 2023-10-05T21:15:13.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.613+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d149960 con 0x7f40bc00d3d0 2023-10-05T21:15:13.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.613+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c400a570 con 0x7f40bc00d3d0 2023-10-05T21:15:13.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.613+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d149960 con 0x563c0d144f70 2023-10-05T21:15:13.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.613+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c0019040 con 0x563c0d144f70 2023-10-05T21:15:13.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.613+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d149960 con 0x563c0d144f70 2023-10-05T21:15:13.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.613+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c0019040 con 0x563c0d144f70 2023-10-05T21:15:13.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.613+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d149960 con 0x563c0d113570 2023-10-05T21:15:13.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.614+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.614+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d149960 con 0x563c0d113570 2023-10-05T21:15:13.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.614+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.614+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d149960 con 0x7f40bc00d3d0 2023-10-05T21:15:13.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.614+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c400a570 con 0x7f40bc00d3d0 2023-10-05T21:15:13.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.614+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d149960 con 0x563c0d144f70 2023-10-05T21:15:13.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.614+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c0019040 con 0x563c0d144f70 2023-10-05T21:15:13.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.614+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d149960 con 0x7f40c0007030 2023-10-05T21:15:13.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.614+0000 7f40cac43700 1 -- 172.21.15.153:0/459013977 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40bc006070 con 0x7f40c0007030 2023-10-05T21:15:13.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.615+0000 7f40cac43700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d149960 con 0x563c0d113570 2023-10-05T21:15:13.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.615+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.615+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d149960 con 0x7f40bc00d3d0 2023-10-05T21:15:13.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.615+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c400a570 con 0x7f40bc00d3d0 2023-10-05T21:15:13.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.615+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d149960 con 0x563c0d144f70 2023-10-05T21:15:13.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.615+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c0019040 con 0x563c0d144f70 2023-10-05T21:15:13.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.615+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d149960 con 0x7f40bc00d3d0 2023-10-05T21:15:13.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.615+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c400a570 con 0x7f40bc00d3d0 2023-10-05T21:15:13.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.615+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d149960 con 0x7f40c0007030 2023-10-05T21:15:13.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.616+0000 7f40cac43700 1 -- 172.21.15.153:0/459013977 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40bc006070 con 0x7f40c0007030 2023-10-05T21:15:13.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.616+0000 7f40cac43700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d149960 con 0x563c0d144f70 2023-10-05T21:15:13.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.616+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c0019040 con 0x563c0d144f70 2023-10-05T21:15:13.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.616+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d149960 con 0x7f40bc00d3d0 2023-10-05T21:15:13.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.616+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40c400a570 con 0x7f40bc00d3d0 2023-10-05T21:15:13.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.616+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d149960 con 0x563c0d113570 2023-10-05T21:15:13.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.616+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.616+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d149960 con 0x7f40c0007030 2023-10-05T21:15:13.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.616+0000 7f40cac43700 1 -- 172.21.15.153:0/459013977 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40bc006070 con 0x7f40c0007030 2023-10-05T21:15:13.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.616+0000 7f40d836c680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:13.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.616+0000 7f40d836c680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:13.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.616+0000 7f40d836c680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:13.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.616+0000 7f40d836c680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:13.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.617+0000 7f40d836c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.617+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d14a0c0 con 0x563c0d113570 2023-10-05T21:15:13.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.617+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.617+0000 7f40d836c680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.617+0000 7f40d836c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.617+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d14a4c0 con 0x563c0d144f70 2023-10-05T21:15:13.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.617+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f40c0019040 con 0x563c0d144f70 2023-10-05T21:15:13.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.617+0000 7f40d836c680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:13.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.617+0000 7f40d836c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.617+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d14adf0 con 0x563c0d113570 2023-10-05T21:15:13.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.617+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.617+0000 7f40d836c680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.617+0000 7f40d836c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.617+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d14adf0 con 0x563c0d113570 2023-10-05T21:15:13.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.617+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.617+0000 7f40d836c680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:13.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.617+0000 7f40d836c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.617+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d14b230 con 0x7f40bc00d3d0 2023-10-05T21:15:13.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.618+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f40c400a570 con 0x7f40bc00d3d0 2023-10-05T21:15:13.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.618+0000 7f40d836c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.618+0000 7f40d836c680 20 zone default found 2023-10-05T21:15:13.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.618+0000 7f40d836c680 4 Realm: () 2023-10-05T21:15:13.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.618+0000 7f40d836c680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:13.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.618+0000 7f40d836c680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:13.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.618+0000 7f40d836c680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:13.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.618+0000 7f40d836c680 20 zonegroup default 2023-10-05T21:15:13.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.618+0000 7f40d836c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.618+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d14b230 con 0x7f40bc00d3d0 2023-10-05T21:15:13.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.618+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f40c400a570 con 0x7f40bc00d3d0 2023-10-05T21:15:13.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.618+0000 7f40d836c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.618+0000 7f40d836c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.618+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d14cbb0 con 0x563c0d144f70 2023-10-05T21:15:13.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.619+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f40c0019040 con 0x563c0d144f70 2023-10-05T21:15:13.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.619+0000 7f40d836c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.619+0000 7f40d836c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.619+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d14cf60 con 0x563c0d144f70 2023-10-05T21:15:13.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.619+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f40c0019040 con 0x563c0d144f70 2023-10-05T21:15:13.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.619+0000 7f40d836c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.619+0000 7f40d836c680 20 started sync module instance, tier type = 2023-10-05T21:15:13.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.619+0000 7f40d836c680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:13.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.619+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d14c270 con 0x7f40c0007030 2023-10-05T21:15:13.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.620+0000 7f40cac43700 1 -- 172.21.15.153:0/459013977 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40bc006070 con 0x7f40c0007030 2023-10-05T21:15:13.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.620+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94815917484544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d14d310 con 0x7f40c0007030 2023-10-05T21:15:13.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.620+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d14dcc0 con 0x563c0d113570 2023-10-05T21:15:13.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.620+0000 7f40cac43700 1 -- 172.21.15.153:0/459013977 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94815917484544] v29'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40bc006070 con 0x7f40c0007030 2023-10-05T21:15:13.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.621+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.621+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94815917496144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d14e0c0 con 0x563c0d113570 2023-10-05T21:15:13.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.621+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d14ead0 con 0x563c0d144f70 2023-10-05T21:15:13.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.621+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94815917496144] v29'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.621+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40c0019040 con 0x563c0d144f70 2023-10-05T21:15:13.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.621+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94815917499872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d14eed0 con 0x563c0d144f70 2023-10-05T21:15:13.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.621+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d14f8e0 con 0x7f40c0007030 2023-10-05T21:15:13.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.622+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94815917499872] v29'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40c0019040 con 0x563c0d144f70 2023-10-05T21:15:13.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.622+0000 7f40cac43700 1 -- 172.21.15.153:0/459013977 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40bc006070 con 0x7f40c0007030 2023-10-05T21:15:13.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.622+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94815917503472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d14fc90 con 0x7f40c0007030 2023-10-05T21:15:13.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.622+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1506a0 con 0x563c0d113570 2023-10-05T21:15:13.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.623+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.623+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94815917507552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d150ef0 con 0x563c0d113570 2023-10-05T21:15:13.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.623+0000 7f40cac43700 1 -- 172.21.15.153:0/459013977 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94815917503472] v29'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40bc006070 con 0x7f40c0007030 2023-10-05T21:15:13.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.623+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d151af0 con 0x7f40bc00d3d0 2023-10-05T21:15:13.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.624+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94815917507552] v29'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.624+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40c400a570 con 0x7f40bc00d3d0 2023-10-05T21:15:13.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.624+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94815917512064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d150900 con 0x7f40bc00d3d0 2023-10-05T21:15:13.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.624+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d151fa0 con 0x7f40bc00d3d0 2023-10-05T21:15:13.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.624+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94815917512064] v29'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40c400a570 con 0x7f40bc00d3d0 2023-10-05T21:15:13.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.624+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40c400a570 con 0x7f40bc00d3d0 2023-10-05T21:15:13.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.625+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94815917491824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d151fa0 con 0x7f40bc00d3d0 2023-10-05T21:15:13.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.625+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1529b0 con 0x7f40bc00d3d0 2023-10-05T21:15:13.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.625+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94815917491824] v29'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40c400a570 con 0x7f40bc00d3d0 2023-10-05T21:15:13.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.625+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40c400a570 con 0x7f40bc00d3d0 2023-10-05T21:15:13.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.625+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94815917513392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d152be0 con 0x7f40bc00d3d0 2023-10-05T21:15:13.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.625+0000 7f40d836c680 20 add_watcher() i=0 2023-10-05T21:15:13.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.625+0000 7f40d836c680 20 add_watcher() i=1 2023-10-05T21:15:13.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.625+0000 7f40d836c680 20 add_watcher() i=2 2023-10-05T21:15:13.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.625+0000 7f40d836c680 20 add_watcher() i=3 2023-10-05T21:15:13.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.625+0000 7f40d836c680 20 add_watcher() i=4 2023-10-05T21:15:13.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.625+0000 7f40d836c680 20 add_watcher() i=5 2023-10-05T21:15:13.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.625+0000 7f40d836c680 20 add_watcher() i=6 2023-10-05T21:15:13.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.626+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94815917513392] v29'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40c400a570 con 0x7f40bc00d3d0 2023-10-05T21:15:13.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.626+0000 7f40d836c680 20 add_watcher() i=7 2023-10-05T21:15:13.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.626+0000 7f40d836c680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:13.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.626+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d155c70 con 0x563c0d113570 2023-10-05T21:15:13.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.626+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.626+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94815917516256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d152f20 con 0x563c0d113570 2023-10-05T21:15:13.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.627+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94815917516256] v29'64 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.627+0000 7f4017fff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:13.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.627+0000 7f40d836c680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:13.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.627+0000 7f40d836c680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:13.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.627+0000 7f40d836c680 1 Processor -- start 2023-10-05T21:15:13.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.627+0000 7f40d836c680 1 -- start start 2023-10-05T21:15:13.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.628+0000 7f40d836c680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d1618e0 0x563c0d161cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.628+0000 7f40d836c680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c0d1622c0 con 0x563c0d1618e0 2023-10-05T21:15:13.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.628+0000 7f40cac43700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d1618e0 0x563c0d161cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.628+0000 7f40cac43700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d1618e0 0x563c0d161cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49626/0 (socket says 172.21.15.153:49626) 2023-10-05T21:15:13.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.628+0000 7f40cac43700 1 -- 172.21.15.153:0/3064578036 learned_addr learned my addr 172.21.15.153:0/3064578036 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:13.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.628+0000 7f40cac43700 1 -- 172.21.15.153:0/3064578036 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c0d162b40 con 0x563c0d1618e0 2023-10-05T21:15:13.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.628+0000 7f40cac43700 1 --2- 172.21.15.153:0/3064578036 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d1618e0 0x563c0d161cf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x563c0d147e70 tx=0x7f40bc006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80aff3e53ce9422 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.628+0000 7f40177fe700 1 -- 172.21.15.153:0/3064578036 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40bc023040 con 0x563c0d1618e0 2023-10-05T21:15:13.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.628+0000 7f40177fe700 1 -- 172.21.15.153:0/3064578036 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40bc024040 con 0x563c0d1618e0 2023-10-05T21:15:13.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.628+0000 7f40177fe700 1 -- 172.21.15.153:0/3064578036 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40bc013040 con 0x563c0d1618e0 2023-10-05T21:15:13.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.629+0000 7f40d836c680 1 -- 172.21.15.153:0/3064578036 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d1618e0 msgr2=0x563c0d161cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.629+0000 7f40d836c680 1 --2- 172.21.15.153:0/3064578036 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d1618e0 0x563c0d161cf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x563c0d147e70 tx=0x7f40bc006000 comp rx=0 tx=0).stop 2023-10-05T21:15:13.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.629+0000 7f40d836c680 1 -- 172.21.15.153:0/3064578036 shutdown_connections 2023-10-05T21:15:13.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.629+0000 7f40d836c680 1 --2- 172.21.15.153:0/3064578036 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d1618e0 0x563c0d161cf0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.629+0000 7f40d836c680 1 -- 172.21.15.153:0/3064578036 >> 172.21.15.153:0/3064578036 conn(0x563c0d10efb0 msgr2=0x563c0d10f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:13.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.629+0000 7f40d836c680 1 -- 172.21.15.153:0/3064578036 shutdown_connections 2023-10-05T21:15:13.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.629+0000 7f40d836c680 1 -- 172.21.15.153:0/3064578036 wait complete. 2023-10-05T21:15:13.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.629+0000 7f40d836c680 1 Processor -- start 2023-10-05T21:15:13.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.630+0000 7f40d836c680 1 -- start start 2023-10-05T21:15:13.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.630+0000 7f40d836c680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d1618e0 0x563c0d168910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.630+0000 7f40d836c680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c0d168e50 con 0x563c0d1618e0 2023-10-05T21:15:13.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.630+0000 7f40cac43700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d1618e0 0x563c0d168910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.630+0000 7f40cac43700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d1618e0 0x563c0d168910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49628/0 (socket says 172.21.15.153:49628) 2023-10-05T21:15:13.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.630+0000 7f40cac43700 1 -- 172.21.15.153:0/1602149293 learned_addr learned my addr 172.21.15.153:0/1602149293 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:13.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.630+0000 7f40cac43700 1 -- 172.21.15.153:0/1602149293 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c0d05d930 con 0x563c0d1618e0 2023-10-05T21:15:13.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.630+0000 7f40cac43700 1 --2- 172.21.15.153:0/1602149293 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d1618e0 0x563c0d168910 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00b9a0 tx=0x7f40bc030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.630+0000 7f4015ffb700 1 -- 172.21.15.153:0/1602149293 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40bc023040 con 0x563c0d1618e0 2023-10-05T21:15:13.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.630+0000 7f4015ffb700 1 -- 172.21.15.153:0/1602149293 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40bc01e420 con 0x563c0d1618e0 2023-10-05T21:15:13.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.630+0000 7f40d836c680 1 -- 172.21.15.153:0/1602149293 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563c0d169050 con 0x563c0d1618e0 2023-10-05T21:15:13.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.630+0000 7f4015ffb700 1 -- 172.21.15.153:0/1602149293 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40bc01e590 con 0x563c0d1618e0 2023-10-05T21:15:13.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.631+0000 7f40d836c680 1 -- 172.21.15.153:0/1602149293 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c0d1694a0 con 0x563c0d1618e0 2023-10-05T21:15:13.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.631+0000 7f4015ffb700 1 -- 172.21.15.153:0/1602149293 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f40bc01e6f0 con 0x563c0d1618e0 2023-10-05T21:15:13.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.631+0000 7f4015ffb700 1 --2- 172.21.15.153:0/1602149293 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4008034140 0x7f40080365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.631+0000 7f4015ffb700 1 -- 172.21.15.153:0/1602149293 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f40bc04fb00 con 0x563c0d1618e0 2023-10-05T21:15:13.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.631+0000 7f40cbc45700 1 --2- 172.21.15.153:0/1602149293 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4008034140 0x7f40080365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.631+0000 7f40d836c680 5 note: GC not initialized 2023-10-05T21:15:13.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.632+0000 7f40cbc45700 1 --2- 172.21.15.153:0/1602149293 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4008034140 0x7f40080365f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x563c0d155ca0 tx=0x7f40c4037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.632+0000 7f400effd700 20 reqs_thread_entry: start 2023-10-05T21:15:13.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.633+0000 7f400cff9700 20 reqs_thread_entry: start 2023-10-05T21:15:13.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.633+0000 7f40d836c680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:13.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.633+0000 7f40d836c680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:13.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.633+0000 7f3ffaffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:44 2023 2023-10-05T21:15:13.664 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:13.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.633+0000 7f3ffa7fc700 20 reqs_thread_entry: start 2023-10-05T21:15:13.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.633+0000 7f40d836c680 20 get_system_obj_state: rctx=0x7fff06e6df58 obj=default.rgw.meta:users.uid:foo state=0x563c0cfc3240 s->prefetch_data=0 2023-10-05T21:15:13.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.633+0000 7f40d836c680 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T21:15:13.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.633+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1ce220 con 0x563c0d113570 2023-10-05T21:15:13.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.633+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.633+0000 7f40d836c680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T21:15:13.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.633+0000 7f40d836c680 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:13.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.633+0000 7f40d836c680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:13.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.633+0000 7f40d836c680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:13.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.633+0000 7f40d836c680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:13.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.633+0000 7f40d836c680 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:13.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.633+0000 7f40d836c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.633+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1d0810 con 0x563c0d113570 2023-10-05T21:15:13.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.634+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.634+0000 7f40d836c680 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T21:15:13.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.634+0000 7f40d836c680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T21:15:13.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.634+0000 7f40d836c680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:13.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.634+0000 7f40d836c680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:13.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.634+0000 7f40d836c680 20 get_system_obj_state: rctx=0x7fff06e6d9d8 obj=default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ state=0x563c0cfc3240 s->prefetch_data=0 2023-10-05T21:15:13.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.634+0000 7f40d836c680 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2023-10-05T21:15:13.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.634+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:104 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1cdd30 con 0x7f40bc00d3d0 2023-10-05T21:15:13.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.634+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(104 p5YnriCv1nAtykxBrupQ [getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f40c400a570 con 0x7f40bc00d3d0 2023-10-05T21:15:13.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.634+0000 7f40d836c680 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2023-10-05T21:15:13.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.634+0000 7f40d836c680 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-10-05T21:15:13.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.634+0000 7f40d836c680 20 get_system_obj_state: rctx=0x7fff06e6df08 obj=default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ state=0x563c0cfc3240 s->prefetch_data=0 2023-10-05T21:15:13.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.634+0000 7f40d836c680 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2023-10-05T21:15:13.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.634+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:105 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~459 in=459b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1cf190 con 0x563c0d113570 2023-10-05T21:15:13.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.635+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(105 foo [delete,create,call,writefull 0~459] v29'4 uv4 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.635+0000 7f40d836c680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T21:15:13.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.635+0000 7f40d836c680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:13.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.635+0000 7f40d836c680 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T21:15:13.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.635+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [notify cookie 94815918031344 in=647b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1d1ea0 con 0x563c0d113570 2023-10-05T21:15:13.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.635+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== watch-notify(notify (1) cookie 94815917507552 notify 124554051587 ret 0) v3 ==== 677+0+0 (crc 0 0 0) 0x7f40c4029040 con 0x563c0d113570 2023-10-05T21:15:13.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.635+0000 7f40c9440700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051587 cookie 94815917507552 notifier 4316 bl.length()=635 2023-10-05T21:15:13.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.635+0000 7f40c9440700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T21:15:13.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.635+0000 7f40c9440700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:13.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.635+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(106 notify.4 [notify cookie 94815918031344 out=8b] v0'0 uv45 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.635+0000 7f40c9440700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f40a8003d90 con 0x563c0d113570 2023-10-05T21:15:13.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.635+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(107 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.635+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== watch-notify(notify_complete (2) cookie 94815918031344 notify 124554051587 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f40c402d040 con 0x563c0d113570 2023-10-05T21:15:13.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.635+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:108 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1d01f0 con 0x7f40bc00d3d0 2023-10-05T21:15:13.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.636+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(108 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v29'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f40c400a570 con 0x7f40bc00d3d0 2023-10-05T21:15:13.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.636+0000 7f40d836c680 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2023-10-05T21:15:13.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.636+0000 7f40d836c680 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-10-05T21:15:13.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.636+0000 7f40d836c680 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2023-10-05T21:15:13.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.636+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:109 7.15 7:a93a5511:::notify.2:head [notify cookie 94815918031296 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1d1ea0 con 0x563c0d144f70 2023-10-05T21:15:13.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.637+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== watch-notify(notify (1) cookie 94815917499872 notify 124554051584 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x563c0d137780 con 0x563c0d144f70 2023-10-05T21:15:13.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.637+0000 7f40c9440700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051584 cookie 94815917499872 notifier 4316 bl.length()=177 2023-10-05T21:15:13.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.637+0000 7f40c9440700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2023-10-05T21:15:13.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.637+0000 7f40c9440700 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-10-05T21:15:13.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.637+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(109 notify.2 [notify cookie 94815918031296 out=8b] v0'0 uv45 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f40c0019040 con 0x563c0d144f70 2023-10-05T21:15:13.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.637+0000 7f40c9440700 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:110 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f40a8003d90 con 0x563c0d144f70 2023-10-05T21:15:13.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.637+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== watch-notify(notify_complete (2) cookie 94815918031296 notify 124554051584 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x563c0d1372b0 con 0x563c0d144f70 2023-10-05T21:15:13.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.637+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== osd_op_reply(110 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40c0019040 con 0x563c0d144f70 2023-10-05T21:15:13.669 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:13.670 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "foo", 2023-10-05T21:15:13.670 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Foo", 2023-10-05T21:15:13.670 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "foo@foo.com", 2023-10-05T21:15:13.670 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2023-10-05T21:15:13.670 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 4, 2023-10-05T21:15:13.670 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [], 2023-10-05T21:15:13.670 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2023-10-05T21:15:13.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:13.670 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:13.670 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:13.670 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T21:15:13.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:13.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:13.671 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:13.671 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "p5YnriCv1nAtykxBrupQ", 2023-10-05T21:15:13.671 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh" 2023-10-05T21:15:13.671 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:13.671 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:13.671 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [], 2023-10-05T21:15:13.671 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2023-10-05T21:15:13.671 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2023-10-05T21:15:13.671 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2023-10-05T21:15:13.671 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2023-10-05T21:15:13.671 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2023-10-05T21:15:13.672 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:15:13.672 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:13.672 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:13.672 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:13.672 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:13.672 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:13.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:13.672 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2023-10-05T21:15:13.672 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:13.672 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:13.672 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:13.672 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:13.673 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:13.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:13.673 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2023-10-05T21:15:13.673 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2023-10-05T21:15:13.673 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [] 2023-10-05T21:15:13.673 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:13.673 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:15:13.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.637+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:111 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94815917484544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1ceb60 con 0x7f40c0007030 2023-10-05T21:15:13.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.638+0000 7f40cac43700 1 -- 172.21.15.153:0/459013977 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(111 notify.0 [watch unwatch cookie 94815917484544] v29'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40bc006070 con 0x7f40c0007030 2023-10-05T21:15:13.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.638+0000 7f40d836c680 20 remove_watcher() i=0 2023-10-05T21:15:13.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.638+0000 7f40d836c680 2 removed watcher, disabling cache 2023-10-05T21:15:13.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.638+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:112 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94815917496144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d14aa00 con 0x563c0d113570 2023-10-05T21:15:13.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.639+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 42 ==== osd_op_reply(112 notify.1 [watch unwatch cookie 94815917496144] v29'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.639+0000 7f40d836c680 20 remove_watcher() i=1 2023-10-05T21:15:13.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.639+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:113 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94815917499872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d14aa00 con 0x563c0d144f70 2023-10-05T21:15:13.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.640+0000 7f40cb444700 1 -- 172.21.15.153:0/459013977 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(113 notify.2 [watch unwatch cookie 94815917499872] v29'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40c0019040 con 0x563c0d144f70 2023-10-05T21:15:13.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.640+0000 7f40d836c680 20 remove_watcher() i=2 2023-10-05T21:15:13.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.640+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:114 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94815917503472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d14aa00 con 0x7f40c0007030 2023-10-05T21:15:13.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.641+0000 7f40cac43700 1 -- 172.21.15.153:0/459013977 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(114 notify.3 [watch unwatch cookie 94815917503472] v29'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40bc006070 con 0x7f40c0007030 2023-10-05T21:15:13.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.641+0000 7f40d836c680 20 remove_watcher() i=3 2023-10-05T21:15:13.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.641+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:115 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94815917507552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d14f3f0 con 0x563c0d113570 2023-10-05T21:15:13.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.641+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 43 ==== osd_op_reply(115 notify.4 [watch unwatch cookie 94815917507552] v29'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.641+0000 7f40d836c680 20 remove_watcher() i=4 2023-10-05T21:15:13.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.641+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:116 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94815917512064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1503e0 con 0x7f40bc00d3d0 2023-10-05T21:15:13.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.642+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(116 notify.5 [watch unwatch cookie 94815917512064] v29'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40c400a570 con 0x7f40bc00d3d0 2023-10-05T21:15:13.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.642+0000 7f40d836c680 20 remove_watcher() i=5 2023-10-05T21:15:13.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.642+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:117 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94815917491824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d14f3f0 con 0x7f40bc00d3d0 2023-10-05T21:15:13.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.643+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(117 notify.6 [watch unwatch cookie 94815917491824] v29'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40c400a570 con 0x7f40bc00d3d0 2023-10-05T21:15:13.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.643+0000 7f40d836c680 20 remove_watcher() i=6 2023-10-05T21:15:13.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.643+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:118 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94815917513392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d151580 con 0x7f40bc00d3d0 2023-10-05T21:15:13.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.643+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.0 v2:172.21.15.111:6800/111394 31 ==== osd_op_reply(118 notify.7 [watch unwatch cookie 94815917513392] v29'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40c400a570 con 0x7f40bc00d3d0 2023-10-05T21:15:13.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.643+0000 7f40d836c680 20 remove_watcher() i=7 2023-10-05T21:15:13.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.644+0000 7f4017fff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:13.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.644+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:119 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94815917516256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563c0d1503e0 con 0x563c0d113570 2023-10-05T21:15:13.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.645+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 <== osd.1 v2:172.21.15.153:6816/140456 44 ==== osd_op_reply(119 data_loggenerations_metadata [watch unwatch cookie 94815917516256] v29'65 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f40c400a570 con 0x563c0d113570 2023-10-05T21:15:13.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.645+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f40bc00d3d0 msgr2=0x7f40bc00d820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.645+0000 7f40d836c680 1 --2- 172.21.15.153:0/459013977 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f40bc00d3d0 0x7f40bc00d820 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.645+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x563c0d113570 msgr2=0x563c0d142b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.645+0000 7f40d836c680 1 --2- 172.21.15.153:0/459013977 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x563c0d113570 0x563c0d142b50 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.645+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f40c0007030 msgr2=0x7f40c00113b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.645+0000 7f40d836c680 1 --2- 172.21.15.153:0/459013977 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f40c0007030 0x7f40c00113b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.645+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x563c0d144f70 msgr2=0x563c0d147350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.645+0000 7f40d836c680 1 --2- 172.21.15.153:0/459013977 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x563c0d144f70 0x563c0d147350 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.645+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f40b0034140 msgr2=0x7f40b00365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.645+0000 7f40d836c680 1 --2- 172.21.15.153:0/459013977 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f40b0034140 0x7f40b00365f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f40bc004170 tx=0x7f40bc001380 comp rx=0 tx=0).stop 2023-10-05T21:15:13.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.645+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d084040 msgr2=0x563c0d136d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.645+0000 7f40cbc45700 1 -- 172.21.15.153:0/459013977 reap_dead start 2023-10-05T21:15:13.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.645+0000 7f40d836c680 1 --2- 172.21.15.153:0/459013977 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d084040 0x563c0d136d70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f40c000afd0 tx=0x7f40c001d000 comp rx=0 tx=0).stop 2023-10-05T21:15:13.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.645+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 shutdown_connections 2023-10-05T21:15:13.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.645+0000 7f40d836c680 1 --2- 172.21.15.153:0/459013977 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d084040 0x563c0d136d70 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.645+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 >> 172.21.15.153:0/459013977 conn(0x563c0d10ab20 msgr2=0x563c0d129c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:13.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.645+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 shutdown_connections 2023-10-05T21:15:13.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.645+0000 7f40d836c680 1 -- 172.21.15.153:0/459013977 wait complete. 2023-10-05T21:15:13.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.646+0000 7f40d836c680 1 -- 172.21.15.153:0/1602149293 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4008034140 msgr2=0x7f40080365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.646+0000 7f40d836c680 1 --2- 172.21.15.153:0/1602149293 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4008034140 0x7f40080365f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x563c0d155ca0 tx=0x7f40c4037450 comp rx=0 tx=0).stop 2023-10-05T21:15:13.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.646+0000 7f40d836c680 1 -- 172.21.15.153:0/1602149293 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d1618e0 msgr2=0x563c0d168910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.646+0000 7f40d836c680 1 --2- 172.21.15.153:0/1602149293 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d1618e0 0x563c0d168910 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00b9a0 tx=0x7f40bc030000 comp rx=0 tx=0).stop 2023-10-05T21:15:13.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.646+0000 7f40d836c680 1 -- 172.21.15.153:0/1602149293 shutdown_connections 2023-10-05T21:15:13.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.646+0000 7f40d836c680 1 --2- 172.21.15.153:0/1602149293 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4008034140 0x7f40080365f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.646+0000 7f40d836c680 1 --2- 172.21.15.153:0/1602149293 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563c0d1618e0 0x563c0d168910 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.646+0000 7f40d836c680 1 -- 172.21.15.153:0/1602149293 >> 172.21.15.153:0/1602149293 conn(0x563c0d10efb0 msgr2=0x563c0d10f380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:13.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.646+0000 7f40d836c680 1 -- 172.21.15.153:0/1602149293 shutdown_connections 2023-10-05T21:15:13.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.646+0000 7f40d836c680 1 -- 172.21.15.153:0/1602149293 wait complete. 2023-10-05T21:15:13.683 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:15:13.683 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2023-10-05T21:15:13.684 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2023-10-05T21:15:13.684 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2023-10-05T21:15:13.727 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:13.728 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:13.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.727+0000 7fe249ff0680 1 Processor -- start 2023-10-05T21:15:13.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.727+0000 7fe249ff0680 1 -- start start 2023-10-05T21:15:13.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.727+0000 7fe249ff0680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5566b6f02bb0 0x5566b6f04f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.727+0000 7fe249ff0680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5566b6e49990 con 0x5566b6e70930 2023-10-05T21:15:13.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.727+0000 7fe249ff0680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x5566b6e09db0 con 0x5566b6f02bb0 2023-10-05T21:15:13.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.727+0000 7fe23c8c7700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5566b6f02bb0 0x5566b6f04f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.727+0000 7fe23d0c8700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x5566b6e70930 0x5566b6f01490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56256/0 (socket says 172.21.15.153:56256) 2023-10-05T21:15:13.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.727+0000 7fe23d0c8700 1 -- 172.21.15.153:0/3513179359 learned_addr learned my addr 172.21.15.153:0/3513179359 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:13.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.728+0000 7fe23c8c7700 1 -- 172.21.15.153:0/3513179359 >> v1:172.21.15.111:6789/0 conn(0x5566b6e70930 legacy=0x5566b6f01490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.728+0000 7fe22ffff700 1 -- 172.21.15.153:0/3513179359 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2254638876 0 0) 0x5566b6e49990 con 0x5566b6e70930 2023-10-05T21:15:13.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.728+0000 7fe23c8c7700 1 -- 172.21.15.153:0/3513179359 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5566b6f064e0 con 0x5566b6f02bb0 2023-10-05T21:15:13.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.728+0000 7fe23c8c7700 1 --2- 172.21.15.153:0/3513179359 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6f02bb0 0x5566b6f04f90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe23400a5d0 tx=0x7fe234005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffde1c991edaa977 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.728+0000 7fe22ffff700 1 -- 172.21.15.153:0/3513179359 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2340086a0 con 0x5566b6f02bb0 2023-10-05T21:15:13.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.728+0000 7fe22ffff700 1 -- 172.21.15.153:0/3513179359 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe234008800 con 0x5566b6f02bb0 2023-10-05T21:15:13.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.728+0000 7fe22ffff700 1 -- 172.21.15.153:0/3513179359 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe234008ad0 con 0x5566b6f02bb0 2023-10-05T21:15:13.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.728+0000 7fe249ff0680 1 -- 172.21.15.153:0/3513179359 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6f02bb0 msgr2=0x5566b6f04f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.728+0000 7fe249ff0680 1 --2- 172.21.15.153:0/3513179359 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6f02bb0 0x5566b6f04f90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe23400a5d0 tx=0x7fe234005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:13.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.728+0000 7fe249ff0680 1 -- 172.21.15.153:0/3513179359 shutdown_connections 2023-10-05T21:15:13.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.728+0000 7fe249ff0680 1 --2- 172.21.15.153:0/3513179359 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6f02bb0 0x5566b6f04f90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.728+0000 7fe249ff0680 1 -- 172.21.15.153:0/3513179359 >> 172.21.15.153:0/3513179359 conn(0x5566b6ef6b80 msgr2=0x5566b6ef8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:13.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.728+0000 7fe249ff0680 1 -- 172.21.15.153:0/3513179359 shutdown_connections 2023-10-05T21:15:13.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.728+0000 7fe249ff0680 1 -- 172.21.15.153:0/3513179359 wait complete. 2023-10-05T21:15:13.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.729+0000 7fe249ff0680 1 Processor -- start 2023-10-05T21:15:13.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.729+0000 7fe249ff0680 1 -- start start 2023-10-05T21:15:13.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.729+0000 7fe249ff0680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6e70930 0x5566b6f1d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.729+0000 7fe249ff0680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566b6da9ea0 con 0x5566b6e70930 2023-10-05T21:15:13.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.730+0000 7fe23d0c8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6e70930 0x5566b6f1d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.730+0000 7fe23d0c8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6e70930 0x5566b6f1d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49654/0 (socket says 172.21.15.153:49654) 2023-10-05T21:15:13.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.730+0000 7fe23d0c8700 1 -- 172.21.15.153:0/326536644 learned_addr learned my addr 172.21.15.153:0/326536644 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:13.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.730+0000 7fe23d0c8700 1 -- 172.21.15.153:0/326536644 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe234005cf0 con 0x5566b6e70930 2023-10-05T21:15:13.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.730+0000 7fe23d0c8700 1 --2- 172.21.15.153:0/326536644 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6e70930 0x5566b6f1d910 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe230001d70 tx=0x7fe230001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66dd32ce6cf20cf3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.730+0000 7fe22effd700 1 -- 172.21.15.153:0/326536644 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe23000bcc0 con 0x5566b6e70930 2023-10-05T21:15:13.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.730+0000 7fe22effd700 1 -- 172.21.15.153:0/326536644 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23000be20 con 0x5566b6e70930 2023-10-05T21:15:13.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.730+0000 7fe22effd700 1 -- 172.21.15.153:0/326536644 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe23000e5f0 con 0x5566b6e70930 2023-10-05T21:15:13.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.730+0000 7fe249ff0680 1 -- 172.21.15.153:0/326536644 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6e70930 msgr2=0x5566b6f1d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.730+0000 7fe249ff0680 1 --2- 172.21.15.153:0/326536644 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6e70930 0x5566b6f1d910 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe230001d70 tx=0x7fe230001770 comp rx=0 tx=0).stop 2023-10-05T21:15:13.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.730+0000 7fe249ff0680 1 -- 172.21.15.153:0/326536644 shutdown_connections 2023-10-05T21:15:13.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.730+0000 7fe249ff0680 1 --2- 172.21.15.153:0/326536644 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6e70930 0x5566b6f1d910 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.730+0000 7fe249ff0680 1 -- 172.21.15.153:0/326536644 >> 172.21.15.153:0/326536644 conn(0x5566b6ef6b80 msgr2=0x5566b6f193e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:13.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.731+0000 7fe249ff0680 1 -- 172.21.15.153:0/326536644 shutdown_connections 2023-10-05T21:15:13.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.731+0000 7fe249ff0680 1 -- 172.21.15.153:0/326536644 wait complete. 2023-10-05T21:15:13.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.731+0000 7fe249ff0680 1 Processor -- start 2023-10-05T21:15:13.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.731+0000 7fe249ff0680 1 -- start start 2023-10-05T21:15:13.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.731+0000 7fe249ff0680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6e70930 0x5566b6f24db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.731+0000 7fe249ff0680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566b6da0c80 con 0x5566b6e70930 2023-10-05T21:15:13.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.731+0000 7fe23d0c8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6e70930 0x5566b6f24db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.731+0000 7fe23d0c8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6e70930 0x5566b6f24db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49662/0 (socket says 172.21.15.153:49662) 2023-10-05T21:15:13.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.731+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 learned_addr learned my addr 172.21.15.153:0/1260345751 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:13.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.731+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe230001a50 con 0x5566b6e70930 2023-10-05T21:15:13.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.732+0000 7fe23d0c8700 1 --2- 172.21.15.153:0/1260345751 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6e70930 0x5566b6f24db0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe2300017b0 tx=0x7fe230016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.732+0000 7fe22d7fa700 1 -- 172.21.15.153:0/1260345751 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe23001f070 con 0x5566b6e70930 2023-10-05T21:15:13.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.732+0000 7fe22d7fa700 1 -- 172.21.15.153:0/1260345751 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23001a2e0 con 0x5566b6e70930 2023-10-05T21:15:13.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.732+0000 7fe22d7fa700 1 -- 172.21.15.153:0/1260345751 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe23001a650 con 0x5566b6e70930 2023-10-05T21:15:13.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.732+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5566b6f252f0 con 0x5566b6e70930 2023-10-05T21:15:13.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.732+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5566b6f25740 con 0x5566b6e70930 2023-10-05T21:15:13.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.732+0000 7fe22d7fa700 1 -- 172.21.15.153:0/1260345751 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fe23001a7b0 con 0x5566b6e70930 2023-10-05T21:15:13.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.733+0000 7fe249ff0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.733+0000 7fe22d7fa700 1 --2- 172.21.15.153:0/1260345751 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fe220034140 0x7fe2200365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.733+0000 7fe22d7fa700 1 -- 172.21.15.153:0/1260345751 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fe230048f80 con 0x5566b6e70930 2023-10-05T21:15:13.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.733+0000 7fe23c8c7700 1 --2- 172.21.15.153:0/1260345751 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fe220034140 0x7fe2200365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.733+0000 7fe249ff0680 1 --2- 172.21.15.153:0/1260345751 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5566b6f02bb0 0x5566b6f30ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.733+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f31260 con 0x5566b6f02bb0 2023-10-05T21:15:13.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.733+0000 7fe23d8c9700 1 --2- 172.21.15.153:0/1260345751 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5566b6f02bb0 0x5566b6f30ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.733+0000 7fe23c8c7700 1 --2- 172.21.15.153:0/1260345751 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fe220034140 0x7fe2200365f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe234003080 tx=0x7fe234015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.733+0000 7fe23d8c9700 1 --2- 172.21.15.153:0/1260345751 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5566b6f02bb0 0x5566b6f30ad0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.734+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.734+0000 7fe249ff0680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.734+0000 7fe249ff0680 20 realm 2023-10-05T21:15:13.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.734+0000 7fe249ff0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.734+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f2e0f0 con 0x5566b6f02bb0 2023-10-05T21:15:13.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.734+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.734+0000 7fe249ff0680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.734+0000 7fe249ff0680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:13.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.734+0000 7fe249ff0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.734+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f31d60 con 0x5566b6f02bb0 2023-10-05T21:15:13.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.734+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.734+0000 7fe249ff0680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.734+0000 7fe249ff0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.734+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f32680 con 0x5566b6f02bb0 2023-10-05T21:15:13.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.734+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.734+0000 7fe249ff0680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.734+0000 7fe249ff0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.734+0000 7fe249ff0680 1 --2- 172.21.15.153:0/1260345751 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5566b6f32f40 0x5566b6f35320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.734+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f358f0 con 0x5566b6f32f40 2023-10-05T21:15:13.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.734+0000 7fe23d0c8700 1 --2- 172.21.15.153:0/1260345751 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5566b6f32f40 0x5566b6f35320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.735+0000 7fe23d0c8700 1 --2- 172.21.15.153:0/1260345751 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5566b6f32f40 0x5566b6f35320 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.735+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fe230014070 con 0x5566b6f32f40 2023-10-05T21:15:13.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.735+0000 7fe249ff0680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:13.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.735+0000 7fe249ff0680 20 searching for the correct realm 2023-10-05T21:15:13.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.735+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f37210 con 0x5566b6f32f40 2023-10-05T21:15:13.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.735+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe230014070 con 0x5566b6f32f40 2023-10-05T21:15:13.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.735+0000 7fe23d0c8700 1 --2- 172.21.15.153:0/1260345751 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fe23000d750 0x7fe230017430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.735+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe23003e040 con 0x7fe23000d750 2023-10-05T21:15:13.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.735+0000 7fe23c8c7700 1 --2- 172.21.15.153:0/1260345751 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fe23000d750 0x7fe230017430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.736+0000 7fe23c8c7700 1 --2- 172.21.15.153:0/1260345751 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fe23000d750 0x7fe230017430 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.736+0000 7fe23c8c7700 1 -- 172.21.15.153:0/1260345751 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe234019040 con 0x7fe23000d750 2023-10-05T21:15:13.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.736+0000 7fe23c8c7700 1 --2- 172.21.15.153:0/1260345751 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fe234007030 0x7fe23401d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.736+0000 7fe23c8c7700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe23003e040 con 0x7fe234007030 2023-10-05T21:15:13.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.736+0000 7fe23d8c9700 1 --2- 172.21.15.153:0/1260345751 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fe234007030 0x7fe23401d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.736+0000 7fe23d8c9700 1 --2- 172.21.15.153:0/1260345751 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fe234007030 0x7fe23401d420 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.736+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe23800a570 con 0x7fe234007030 2023-10-05T21:15:13.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.737+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe23003e040 con 0x5566b6f02bb0 2023-10-05T21:15:13.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.737+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.737+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe23003e040 con 0x5566b6f02bb0 2023-10-05T21:15:13.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.737+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.737+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe23003e040 con 0x7fe234007030 2023-10-05T21:15:13.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.737+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe23800a570 con 0x7fe234007030 2023-10-05T21:15:13.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.737+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe23003e040 con 0x7fe234007030 2023-10-05T21:15:13.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.737+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe23800a570 con 0x7fe234007030 2023-10-05T21:15:13.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.737+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe23003e040 con 0x7fe23000d750 2023-10-05T21:15:13.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.738+0000 7fe23c8c7700 1 -- 172.21.15.153:0/1260345751 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe234019040 con 0x7fe23000d750 2023-10-05T21:15:13.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.738+0000 7fe23c8c7700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe23003e040 con 0x5566b6f32f40 2023-10-05T21:15:13.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.738+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fe230014070 con 0x5566b6f32f40 2023-10-05T21:15:13.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.738+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe23003e040 con 0x5566b6f02bb0 2023-10-05T21:15:13.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.738+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.738+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe23003e040 con 0x7fe234007030 2023-10-05T21:15:13.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.738+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe23800a570 con 0x7fe234007030 2023-10-05T21:15:13.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.738+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe23003e040 con 0x5566b6f02bb0 2023-10-05T21:15:13.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.738+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.738+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe23003e040 con 0x7fe23000d750 2023-10-05T21:15:13.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.739+0000 7fe23c8c7700 1 -- 172.21.15.153:0/1260345751 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe234019040 con 0x7fe23000d750 2023-10-05T21:15:13.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.739+0000 7fe23c8c7700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe23003e040 con 0x5566b6f32f40 2023-10-05T21:15:13.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.739+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe230014070 con 0x5566b6f32f40 2023-10-05T21:15:13.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.739+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe23003e040 con 0x5566b6f32f40 2023-10-05T21:15:13.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.739+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe230014070 con 0x5566b6f32f40 2023-10-05T21:15:13.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.739+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe23003e040 con 0x7fe234007030 2023-10-05T21:15:13.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.739+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe23800a570 con 0x7fe234007030 2023-10-05T21:15:13.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.739+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe23003e040 con 0x5566b6f32f40 2023-10-05T21:15:13.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.739+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe230014070 con 0x5566b6f32f40 2023-10-05T21:15:13.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.739+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe23003e040 con 0x5566b6f32f40 2023-10-05T21:15:13.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.740+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe230014070 con 0x5566b6f32f40 2023-10-05T21:15:13.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.740+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe23003e040 con 0x5566b6f02bb0 2023-10-05T21:15:13.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.740+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.740+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe23003e040 con 0x5566b6f02bb0 2023-10-05T21:15:13.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.740+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.740+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe23003e040 con 0x7fe234007030 2023-10-05T21:15:13.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.740+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe23800a570 con 0x7fe234007030 2023-10-05T21:15:13.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.740+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe23003e040 con 0x5566b6f32f40 2023-10-05T21:15:13.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.741+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe230014070 con 0x5566b6f32f40 2023-10-05T21:15:13.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.741+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe23003e040 con 0x7fe23000d750 2023-10-05T21:15:13.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.741+0000 7fe23c8c7700 1 -- 172.21.15.153:0/1260345751 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe234019040 con 0x7fe23000d750 2023-10-05T21:15:13.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.741+0000 7fe23c8c7700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe23003e040 con 0x5566b6f02bb0 2023-10-05T21:15:13.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.741+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.741+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe23003e040 con 0x7fe234007030 2023-10-05T21:15:13.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.741+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe23800a570 con 0x7fe234007030 2023-10-05T21:15:13.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.741+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe23003e040 con 0x5566b6f32f40 2023-10-05T21:15:13.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.742+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe230014070 con 0x5566b6f32f40 2023-10-05T21:15:13.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.742+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe23003e040 con 0x7fe234007030 2023-10-05T21:15:13.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.742+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe23800a570 con 0x7fe234007030 2023-10-05T21:15:13.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.742+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe23003e040 con 0x7fe23000d750 2023-10-05T21:15:13.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.742+0000 7fe23c8c7700 1 -- 172.21.15.153:0/1260345751 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe234019040 con 0x7fe23000d750 2023-10-05T21:15:13.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.742+0000 7fe23c8c7700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe23003e040 con 0x5566b6f32f40 2023-10-05T21:15:13.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.743+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe230014070 con 0x5566b6f32f40 2023-10-05T21:15:13.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.743+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe23003e040 con 0x7fe234007030 2023-10-05T21:15:13.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.743+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe23800a570 con 0x7fe234007030 2023-10-05T21:15:13.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.743+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe23003e040 con 0x5566b6f02bb0 2023-10-05T21:15:13.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.743+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.743+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe23003e040 con 0x7fe23000d750 2023-10-05T21:15:13.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.743+0000 7fe23c8c7700 1 -- 172.21.15.153:0/1260345751 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe234019040 con 0x7fe23000d750 2023-10-05T21:15:13.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.743+0000 7fe249ff0680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:13.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.743+0000 7fe249ff0680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:13.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.743+0000 7fe249ff0680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:13.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.743+0000 7fe249ff0680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:13.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.743+0000 7fe249ff0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.743+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36430 con 0x5566b6f02bb0 2023-10-05T21:15:13.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.743+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.743+0000 7fe249ff0680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.743+0000 7fe249ff0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.743+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36860 con 0x5566b6f02bb0 2023-10-05T21:15:13.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.744+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.744+0000 7fe249ff0680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.744+0000 7fe249ff0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.744+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36c90 con 0x5566b6f02bb0 2023-10-05T21:15:13.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.744+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.744+0000 7fe249ff0680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:13.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.744+0000 7fe249ff0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.744+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f375c0 con 0x5566b6f32f40 2023-10-05T21:15:13.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.744+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fe230014070 con 0x5566b6f32f40 2023-10-05T21:15:13.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.744+0000 7fe249ff0680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.744+0000 7fe249ff0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.744+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f35f70 con 0x5566b6f02bb0 2023-10-05T21:15:13.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.744+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.744+0000 7fe249ff0680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.744+0000 7fe249ff0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.744+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f37eb0 con 0x5566b6f02bb0 2023-10-05T21:15:13.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.745+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.745+0000 7fe249ff0680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.745+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f38ec0 con 0x5566b6f32f40 2023-10-05T21:15:13.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.745+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe230014070 con 0x5566b6f32f40 2023-10-05T21:15:13.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.745+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f38ec0 con 0x7fe23000d750 2023-10-05T21:15:13.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.745+0000 7fe23c8c7700 1 -- 172.21.15.153:0/1260345751 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe234019040 con 0x7fe23000d750 2023-10-05T21:15:13.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.745+0000 7fe23c8c7700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f38ec0 con 0x7fe234007030 2023-10-05T21:15:13.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.745+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe23800a570 con 0x7fe234007030 2023-10-05T21:15:13.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.745+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36c90 con 0x5566b6f02bb0 2023-10-05T21:15:13.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.746+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.746+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36c90 con 0x5566b6f02bb0 2023-10-05T21:15:13.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.746+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.746+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36c90 con 0x7fe234007030 2023-10-05T21:15:13.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.746+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe23800a570 con 0x7fe234007030 2023-10-05T21:15:13.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.746+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36c90 con 0x7fe234007030 2023-10-05T21:15:13.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.746+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe23800a570 con 0x7fe234007030 2023-10-05T21:15:13.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.746+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36c90 con 0x7fe23000d750 2023-10-05T21:15:13.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.746+0000 7fe23c8c7700 1 -- 172.21.15.153:0/1260345751 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe234019040 con 0x7fe23000d750 2023-10-05T21:15:13.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.747+0000 7fe23c8c7700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36c90 con 0x5566b6f32f40 2023-10-05T21:15:13.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.747+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fe230014070 con 0x5566b6f32f40 2023-10-05T21:15:13.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.747+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36c90 con 0x5566b6f02bb0 2023-10-05T21:15:13.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.747+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.747+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36c90 con 0x7fe234007030 2023-10-05T21:15:13.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.747+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe23800a570 con 0x7fe234007030 2023-10-05T21:15:13.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.747+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36c90 con 0x5566b6f02bb0 2023-10-05T21:15:13.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.747+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.747+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36c90 con 0x7fe23000d750 2023-10-05T21:15:13.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.748+0000 7fe23c8c7700 1 -- 172.21.15.153:0/1260345751 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe234019040 con 0x7fe23000d750 2023-10-05T21:15:13.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.748+0000 7fe23c8c7700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36c90 con 0x5566b6f32f40 2023-10-05T21:15:13.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.748+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe230014070 con 0x5566b6f32f40 2023-10-05T21:15:13.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.748+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36c90 con 0x5566b6f32f40 2023-10-05T21:15:13.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.748+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe230014070 con 0x5566b6f32f40 2023-10-05T21:15:13.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.748+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36c90 con 0x7fe234007030 2023-10-05T21:15:13.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.748+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe23800a570 con 0x7fe234007030 2023-10-05T21:15:13.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.748+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36c90 con 0x5566b6f32f40 2023-10-05T21:15:13.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.748+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe230014070 con 0x5566b6f32f40 2023-10-05T21:15:13.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.748+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36c90 con 0x5566b6f32f40 2023-10-05T21:15:13.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.749+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe230014070 con 0x5566b6f32f40 2023-10-05T21:15:13.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.749+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36c90 con 0x5566b6f02bb0 2023-10-05T21:15:13.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.749+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.749+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36c90 con 0x5566b6f02bb0 2023-10-05T21:15:13.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.749+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.749+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36c90 con 0x7fe234007030 2023-10-05T21:15:13.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.749+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe23800a570 con 0x7fe234007030 2023-10-05T21:15:13.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.749+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36c90 con 0x5566b6f32f40 2023-10-05T21:15:13.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.749+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe230014070 con 0x5566b6f32f40 2023-10-05T21:15:13.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.749+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36c90 con 0x7fe23000d750 2023-10-05T21:15:13.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.749+0000 7fe23c8c7700 1 -- 172.21.15.153:0/1260345751 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe234019040 con 0x7fe23000d750 2023-10-05T21:15:13.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.750+0000 7fe23c8c7700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36c90 con 0x5566b6f02bb0 2023-10-05T21:15:13.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.750+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.750+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36c90 con 0x7fe234007030 2023-10-05T21:15:13.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.750+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe23800a570 con 0x7fe234007030 2023-10-05T21:15:13.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.750+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36c90 con 0x5566b6f32f40 2023-10-05T21:15:13.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.750+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe230014070 con 0x5566b6f32f40 2023-10-05T21:15:13.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.750+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36c90 con 0x7fe234007030 2023-10-05T21:15:13.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.750+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe23800a570 con 0x7fe234007030 2023-10-05T21:15:13.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.750+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36c90 con 0x7fe23000d750 2023-10-05T21:15:13.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.751+0000 7fe23c8c7700 1 -- 172.21.15.153:0/1260345751 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe234019040 con 0x7fe23000d750 2023-10-05T21:15:13.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.751+0000 7fe23c8c7700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36c90 con 0x5566b6f32f40 2023-10-05T21:15:13.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.751+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe230014070 con 0x5566b6f32f40 2023-10-05T21:15:13.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.751+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36c90 con 0x7fe234007030 2023-10-05T21:15:13.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.751+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe23800a570 con 0x7fe234007030 2023-10-05T21:15:13.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.751+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36c90 con 0x5566b6f02bb0 2023-10-05T21:15:13.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.751+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.751+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f36c90 con 0x7fe23000d750 2023-10-05T21:15:13.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.751+0000 7fe23c8c7700 1 -- 172.21.15.153:0/1260345751 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe234019040 con 0x7fe23000d750 2023-10-05T21:15:13.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.751+0000 7fe249ff0680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:13.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.751+0000 7fe249ff0680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:13.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.751+0000 7fe249ff0680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:13.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.751+0000 7fe249ff0680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:13.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.751+0000 7fe249ff0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.751+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f37eb0 con 0x5566b6f02bb0 2023-10-05T21:15:13.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.752+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.752+0000 7fe249ff0680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.752+0000 7fe249ff0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.752+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f38260 con 0x5566b6f32f40 2023-10-05T21:15:13.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.752+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fe230014070 con 0x5566b6f32f40 2023-10-05T21:15:13.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.752+0000 7fe249ff0680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:13.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.752+0000 7fe249ff0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.752+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f38610 con 0x5566b6f02bb0 2023-10-05T21:15:13.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.752+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.752+0000 7fe249ff0680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.752+0000 7fe249ff0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.752+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f38610 con 0x5566b6f02bb0 2023-10-05T21:15:13.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.752+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.752+0000 7fe249ff0680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:13.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.752+0000 7fe249ff0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.752+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f38a10 con 0x7fe234007030 2023-10-05T21:15:13.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.753+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fe23800a570 con 0x7fe234007030 2023-10-05T21:15:13.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.753+0000 7fe249ff0680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.753+0000 7fe249ff0680 20 zone default found 2023-10-05T21:15:13.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.753+0000 7fe249ff0680 4 Realm: () 2023-10-05T21:15:13.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.753+0000 7fe249ff0680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:13.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.753+0000 7fe249ff0680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:13.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.753+0000 7fe249ff0680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:13.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.753+0000 7fe249ff0680 20 zonegroup default 2023-10-05T21:15:13.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.753+0000 7fe249ff0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.753+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f38a10 con 0x7fe234007030 2023-10-05T21:15:13.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.753+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe23800a570 con 0x7fe234007030 2023-10-05T21:15:13.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.753+0000 7fe249ff0680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.753+0000 7fe249ff0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.753+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f3a240 con 0x5566b6f32f40 2023-10-05T21:15:13.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.753+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe230014070 con 0x5566b6f32f40 2023-10-05T21:15:13.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.753+0000 7fe249ff0680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.753+0000 7fe249ff0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.753+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f3a5f0 con 0x5566b6f32f40 2023-10-05T21:15:13.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.753+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe230014070 con 0x5566b6f32f40 2023-10-05T21:15:13.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.753+0000 7fe249ff0680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.753+0000 7fe249ff0680 20 started sync module instance, tier type = 2023-10-05T21:15:13.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.753+0000 7fe249ff0680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:13.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.753+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f39900 con 0x7fe23000d750 2023-10-05T21:15:13.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.754+0000 7fe23c8c7700 1 -- 172.21.15.153:0/1260345751 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe234019040 con 0x7fe23000d750 2023-10-05T21:15:13.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.754+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93899644443904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f3ae90 con 0x7fe23000d750 2023-10-05T21:15:13.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.754+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f3b730 con 0x5566b6f02bb0 2023-10-05T21:15:13.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.755+0000 7fe23c8c7700 1 -- 172.21.15.153:0/1260345751 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 93899644443904] v29'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe234019040 con 0x7fe23000d750 2023-10-05T21:15:13.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.755+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.755+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93899644449344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f3aae0 con 0x5566b6f02bb0 2023-10-05T21:15:13.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.755+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f3c3d0 con 0x5566b6f32f40 2023-10-05T21:15:13.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.756+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 93899644449344] v29'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.756+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe230014070 con 0x5566b6f32f40 2023-10-05T21:15:13.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.756+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93899644452448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f3c7d0 con 0x5566b6f32f40 2023-10-05T21:15:13.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.756+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f3d1e0 con 0x7fe23000d750 2023-10-05T21:15:13.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.757+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 93899644452448] v29'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe230014070 con 0x5566b6f32f40 2023-10-05T21:15:13.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.757+0000 7fe23c8c7700 1 -- 172.21.15.153:0/1260345751 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe234019040 con 0x7fe23000d750 2023-10-05T21:15:13.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.757+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 93899644456176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f3d590 con 0x7fe23000d750 2023-10-05T21:15:13.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.757+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f3deb0 con 0x5566b6f02bb0 2023-10-05T21:15:13.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.757+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.757+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 93899644459328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f3e7a0 con 0x5566b6f02bb0 2023-10-05T21:15:13.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.757+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f3f2c0 con 0x7fe234007030 2023-10-05T21:15:13.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.757+0000 7fe23c8c7700 1 -- 172.21.15.153:0/1260345751 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 93899644456176] v29'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe234019040 con 0x7fe23000d750 2023-10-05T21:15:13.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.758+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 93899644459328] v29'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.758+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe23800a570 con 0x7fe234007030 2023-10-05T21:15:13.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.758+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 93899644464464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f3e200 con 0x7fe234007030 2023-10-05T21:15:13.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.758+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f3fbb0 con 0x7fe234007030 2023-10-05T21:15:13.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.759+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 93899644464464] v29'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe23800a570 con 0x7fe234007030 2023-10-05T21:15:13.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.759+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe23800a570 con 0x7fe234007030 2023-10-05T21:15:13.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.759+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93899644450448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f3e180 con 0x7fe234007030 2023-10-05T21:15:13.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.759+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f40210 con 0x7fe234007030 2023-10-05T21:15:13.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.759+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 93899644450448] v29'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe23800a570 con 0x7fe234007030 2023-10-05T21:15:13.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.759+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe23800a570 con 0x7fe234007030 2023-10-05T21:15:13.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.759+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93899644466800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f40210 con 0x7fe234007030 2023-10-05T21:15:13.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.759+0000 7fe249ff0680 20 add_watcher() i=0 2023-10-05T21:15:13.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.759+0000 7fe249ff0680 20 add_watcher() i=1 2023-10-05T21:15:13.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.759+0000 7fe249ff0680 20 add_watcher() i=2 2023-10-05T21:15:13.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.759+0000 7fe249ff0680 20 add_watcher() i=3 2023-10-05T21:15:13.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.759+0000 7fe249ff0680 20 add_watcher() i=4 2023-10-05T21:15:13.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.759+0000 7fe249ff0680 20 add_watcher() i=5 2023-10-05T21:15:13.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.759+0000 7fe249ff0680 20 add_watcher() i=6 2023-10-05T21:15:13.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.760+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 93899644466800] v29'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe23800a570 con 0x7fe234007030 2023-10-05T21:15:13.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.760+0000 7fe249ff0680 20 add_watcher() i=7 2023-10-05T21:15:13.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.760+0000 7fe249ff0680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:13.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.760+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f43460 con 0x5566b6f02bb0 2023-10-05T21:15:13.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.760+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.760+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93899644468880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6f407d0 con 0x5566b6f02bb0 2023-10-05T21:15:13.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.761+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 93899644468880] v29'66 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.761+0000 7fe20e7e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:13.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.761+0000 7fe249ff0680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:13.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.761+0000 7fe249ff0680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:13.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.761+0000 7fe249ff0680 1 Processor -- start 2023-10-05T21:15:13.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.761+0000 7fe249ff0680 1 -- start start 2023-10-05T21:15:13.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.762+0000 7fe249ff0680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6f4dfd0 0x5566b6f4e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.762+0000 7fe249ff0680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566b6f4e9b0 con 0x5566b6f4dfd0 2023-10-05T21:15:13.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.762+0000 7fe23c8c7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6f4dfd0 0x5566b6f4e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.762+0000 7fe23c8c7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6f4dfd0 0x5566b6f4e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49676/0 (socket says 172.21.15.153:49676) 2023-10-05T21:15:13.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.762+0000 7fe23c8c7700 1 -- 172.21.15.153:0/3089427819 learned_addr learned my addr 172.21.15.153:0/3089427819 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:13.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.762+0000 7fe23c8c7700 1 -- 172.21.15.153:0/3089427819 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5566b6f4eaf0 con 0x5566b6f4dfd0 2023-10-05T21:15:13.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.762+0000 7fe23c8c7700 1 --2- 172.21.15.153:0/3089427819 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6f4dfd0 0x5566b6f4e3e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x5566b6efcf50 tx=0x7fe234012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df500f4f84fdd2ae server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.762+0000 7fe20dfe3700 1 -- 172.21.15.153:0/3089427819 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe23401ddc0 con 0x5566b6f4dfd0 2023-10-05T21:15:13.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.762+0000 7fe20dfe3700 1 -- 172.21.15.153:0/3089427819 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23402b450 con 0x5566b6f4dfd0 2023-10-05T21:15:13.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.762+0000 7fe20dfe3700 1 -- 172.21.15.153:0/3089427819 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe23402b620 con 0x5566b6f4dfd0 2023-10-05T21:15:13.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.763+0000 7fe249ff0680 1 -- 172.21.15.153:0/3089427819 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6f4dfd0 msgr2=0x5566b6f4e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.763+0000 7fe249ff0680 1 --2- 172.21.15.153:0/3089427819 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6f4dfd0 0x5566b6f4e3e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x5566b6efcf50 tx=0x7fe234012000 comp rx=0 tx=0).stop 2023-10-05T21:15:13.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.763+0000 7fe249ff0680 1 -- 172.21.15.153:0/3089427819 shutdown_connections 2023-10-05T21:15:13.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.763+0000 7fe249ff0680 1 --2- 172.21.15.153:0/3089427819 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6f4dfd0 0x5566b6f4e3e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.763+0000 7fe249ff0680 1 -- 172.21.15.153:0/3089427819 >> 172.21.15.153:0/3089427819 conn(0x5566b6f491d0 msgr2=0x5566b6f47330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:13.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.763+0000 7fe249ff0680 1 -- 172.21.15.153:0/3089427819 shutdown_connections 2023-10-05T21:15:13.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.763+0000 7fe249ff0680 1 -- 172.21.15.153:0/3089427819 wait complete. 2023-10-05T21:15:13.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.764+0000 7fe249ff0680 1 Processor -- start 2023-10-05T21:15:13.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.764+0000 7fe249ff0680 1 -- start start 2023-10-05T21:15:13.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.764+0000 7fe249ff0680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6f4dfd0 0x5566b6f53b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.764+0000 7fe249ff0680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566b6f540b0 con 0x5566b6f4dfd0 2023-10-05T21:15:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.764+0000 7fe23c8c7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6f4dfd0 0x5566b6f53b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.764+0000 7fe23c8c7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6f4dfd0 0x5566b6f53b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49688/0 (socket says 172.21.15.153:49688) 2023-10-05T21:15:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.764+0000 7fe23c8c7700 1 -- 172.21.15.153:0/611080531 learned_addr learned my addr 172.21.15.153:0/611080531 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.764+0000 7fe23c8c7700 1 -- 172.21.15.153:0/611080531 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5566b6f064e0 con 0x5566b6f4dfd0 2023-10-05T21:15:13.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.765+0000 7fe23c8c7700 1 --2- 172.21.15.153:0/611080531 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6f4dfd0 0x5566b6f53b70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe23403b040 tx=0x7fe234031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.765+0000 7fe17ffff700 1 -- 172.21.15.153:0/611080531 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2340377c0 con 0x5566b6f4dfd0 2023-10-05T21:15:13.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.765+0000 7fe17ffff700 1 -- 172.21.15.153:0/611080531 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe234037940 con 0x5566b6f4dfd0 2023-10-05T21:15:13.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.765+0000 7fe249ff0680 1 -- 172.21.15.153:0/611080531 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5566b6f542b0 con 0x5566b6f4dfd0 2023-10-05T21:15:13.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.765+0000 7fe17ffff700 1 -- 172.21.15.153:0/611080531 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe234037c30 con 0x5566b6f4dfd0 2023-10-05T21:15:13.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.765+0000 7fe249ff0680 1 -- 172.21.15.153:0/611080531 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5566b6f54700 con 0x5566b6f4dfd0 2023-10-05T21:15:13.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.765+0000 7fe17ffff700 1 -- 172.21.15.153:0/611080531 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fe234026040 con 0x5566b6f4dfd0 2023-10-05T21:15:13.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.766+0000 7fe17ffff700 1 --2- 172.21.15.153:0/611080531 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fe1840340f0 0x7fe1840365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.766+0000 7fe17ffff700 1 -- 172.21.15.153:0/611080531 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fe234031070 con 0x5566b6f4dfd0 2023-10-05T21:15:13.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.766+0000 7fe23d8c9700 1 --2- 172.21.15.153:0/611080531 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fe1840340f0 0x7fe1840365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.766+0000 7fe249ff0680 5 note: GC not initialized 2023-10-05T21:15:13.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.766+0000 7fe23d8c9700 1 --2- 172.21.15.153:0/611080531 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fe1840340f0 0x7fe1840365a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x5566b6f434a0 tx=0x7fe23800aee0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.767+0000 7fe17d7fa700 20 reqs_thread_entry: start 2023-10-05T21:15:13.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.767+0000 7fe176ffd700 20 reqs_thread_entry: start 2023-10-05T21:15:13.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.767+0000 7fe249ff0680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:13.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.767+0000 7fe249ff0680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:13.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.767+0000 7fe1757fa700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:44 2023 2023-10-05T21:15:13.829 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:13.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.767+0000 7fe174ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:13.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.767+0000 7fe249ff0680 20 get_system_obj_state: rctx=0x7fff98caa2b8 obj=default.rgw.meta:users.uid:foo state=0x5566b6daf240 s->prefetch_data=0 2023-10-05T21:15:13.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.767+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6fb9590 con 0x5566b6f02bb0 2023-10-05T21:15:13.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.768+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.768+0000 7fe249ff0680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:13.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.768+0000 7fe249ff0680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:13.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.768+0000 7fe249ff0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.768+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6fbb820 con 0x5566b6f02bb0 2023-10-05T21:15:13.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.768+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~459 out=459b,getxattrs out=75b] v0'0 uv4 ondisk = 0) v8 ==== 273+0+582 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.768+0000 7fe249ff0680 20 rados_obj.operate() r=0 bl.length=459 2023-10-05T21:15:13.831 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:13.831 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "foo", 2023-10-05T21:15:13.831 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Foo", 2023-10-05T21:15:13.831 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "foo@foo.com", 2023-10-05T21:15:13.831 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2023-10-05T21:15:13.831 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 4, 2023-10-05T21:15:13.831 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [], 2023-10-05T21:15:13.831 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2023-10-05T21:15:13.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:13.831 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:13.832 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:13.832 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T21:15:13.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:13.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:13.832 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:13.832 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "p5YnriCv1nAtykxBrupQ", 2023-10-05T21:15:13.832 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh" 2023-10-05T21:15:13.832 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:13.832 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:13.832 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [], 2023-10-05T21:15:13.832 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2023-10-05T21:15:13.832 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2023-10-05T21:15:13.833 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2023-10-05T21:15:13.833 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2023-10-05T21:15:13.833 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2023-10-05T21:15:13.833 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:15:13.833 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:13.833 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:13.833 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:13.833 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:13.833 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:13.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:13.833 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2023-10-05T21:15:13.833 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:13.834 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:13.834 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:13.834 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:13.834 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:13.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:13.834 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2023-10-05T21:15:13.834 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2023-10-05T21:15:13.834 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [] 2023-10-05T21:15:13.834 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:13.834 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:15:13.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.768+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93899644443904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6fb8090 con 0x7fe23000d750 2023-10-05T21:15:13.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.769+0000 7fe23c8c7700 1 -- 172.21.15.153:0/1260345751 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 93899644443904] v29'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe234046070 con 0x7fe23000d750 2023-10-05T21:15:13.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.769+0000 7fe249ff0680 20 remove_watcher() i=0 2023-10-05T21:15:13.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.769+0000 7fe249ff0680 2 removed watcher, disabling cache 2023-10-05T21:15:13.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.769+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93899644449344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6fb8090 con 0x5566b6f02bb0 2023-10-05T21:15:13.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.770+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 93899644449344] v29'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.770+0000 7fe249ff0680 20 remove_watcher() i=1 2023-10-05T21:15:13.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.770+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93899644452448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6fb8090 con 0x5566b6f32f40 2023-10-05T21:15:13.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.771+0000 7fe23d0c8700 1 -- 172.21.15.153:0/1260345751 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 93899644452448] v29'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe230014070 con 0x5566b6f32f40 2023-10-05T21:15:13.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.771+0000 7fe249ff0680 20 remove_watcher() i=2 2023-10-05T21:15:13.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.771+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93899644456176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6fb8090 con 0x7fe23000d750 2023-10-05T21:15:13.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.771+0000 7fe23c8c7700 1 -- 172.21.15.153:0/1260345751 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 93899644456176] v29'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe234046070 con 0x7fe23000d750 2023-10-05T21:15:13.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.771+0000 7fe249ff0680 20 remove_watcher() i=3 2023-10-05T21:15:13.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.771+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93899644459328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6fb8090 con 0x5566b6f02bb0 2023-10-05T21:15:13.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.772+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 93899644459328] v29'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.772+0000 7fe249ff0680 20 remove_watcher() i=4 2023-10-05T21:15:13.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.772+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93899644464464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6fb8090 con 0x7fe234007030 2023-10-05T21:15:13.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.773+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 93899644464464] v29'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe23800a570 con 0x7fe234007030 2023-10-05T21:15:13.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.773+0000 7fe249ff0680 20 remove_watcher() i=5 2023-10-05T21:15:13.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.773+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93899644450448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6fb8090 con 0x7fe234007030 2023-10-05T21:15:13.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.773+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 93899644450448] v29'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe23800a570 con 0x7fe234007030 2023-10-05T21:15:13.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.773+0000 7fe249ff0680 20 remove_watcher() i=6 2023-10-05T21:15:13.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.773+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93899644466800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6fb8090 con 0x7fe234007030 2023-10-05T21:15:13.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.774+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 93899644466800] v29'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe23800a570 con 0x7fe234007030 2023-10-05T21:15:13.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.774+0000 7fe249ff0680 20 remove_watcher() i=7 2023-10-05T21:15:13.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.775+0000 7fe20e7e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:13.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.775+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:112 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93899644468880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5566b6fb8090 con 0x5566b6f02bb0 2023-10-05T21:15:13.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.775+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(112 data_loggenerations_metadata [watch unwatch cookie 93899644468880] v29'67 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe23800a570 con 0x5566b6f02bb0 2023-10-05T21:15:13.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.776+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fe234007030 msgr2=0x7fe23401d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.776+0000 7fe249ff0680 1 --2- 172.21.15.153:0/1260345751 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fe234007030 0x7fe23401d420 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.776+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5566b6f02bb0 msgr2=0x5566b6f30ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.776+0000 7fe249ff0680 1 --2- 172.21.15.153:0/1260345751 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5566b6f02bb0 0x5566b6f30ad0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.776+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fe23000d750 msgr2=0x7fe230017430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.776+0000 7fe249ff0680 1 --2- 172.21.15.153:0/1260345751 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fe23000d750 0x7fe230017430 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.776+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5566b6f32f40 msgr2=0x5566b6f35320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.776+0000 7fe249ff0680 1 --2- 172.21.15.153:0/1260345751 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5566b6f32f40 0x5566b6f35320 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.776+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fe220034140 msgr2=0x7fe2200365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.776+0000 7fe249ff0680 1 --2- 172.21.15.153:0/1260345751 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fe220034140 0x7fe2200365f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe234003080 tx=0x7fe234015000 comp rx=0 tx=0).stop 2023-10-05T21:15:13.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.776+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6e70930 msgr2=0x5566b6f24db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.776+0000 7fe23d8c9700 1 -- 172.21.15.153:0/1260345751 reap_dead start 2023-10-05T21:15:13.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.776+0000 7fe249ff0680 1 --2- 172.21.15.153:0/1260345751 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6e70930 0x5566b6f24db0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe2300017b0 tx=0x7fe230016000 comp rx=0 tx=0).stop 2023-10-05T21:15:13.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.776+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 shutdown_connections 2023-10-05T21:15:13.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.776+0000 7fe249ff0680 1 --2- 172.21.15.153:0/1260345751 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6e70930 0x5566b6f24db0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.776+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 >> 172.21.15.153:0/1260345751 conn(0x5566b6ef6b80 msgr2=0x5566b6f17c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:13.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.776+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 shutdown_connections 2023-10-05T21:15:13.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.776+0000 7fe249ff0680 1 -- 172.21.15.153:0/1260345751 wait complete. 2023-10-05T21:15:13.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.776+0000 7fe249ff0680 1 -- 172.21.15.153:0/611080531 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fe1840340f0 msgr2=0x7fe1840365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.776+0000 7fe249ff0680 1 --2- 172.21.15.153:0/611080531 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fe1840340f0 0x7fe1840365a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x5566b6f434a0 tx=0x7fe23800aee0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.776+0000 7fe249ff0680 1 -- 172.21.15.153:0/611080531 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6f4dfd0 msgr2=0x5566b6f53b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.776+0000 7fe249ff0680 1 --2- 172.21.15.153:0/611080531 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6f4dfd0 0x5566b6f53b70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe23403b040 tx=0x7fe234031000 comp rx=0 tx=0).stop 2023-10-05T21:15:13.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.776+0000 7fe249ff0680 1 -- 172.21.15.153:0/611080531 shutdown_connections 2023-10-05T21:15:13.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.776+0000 7fe249ff0680 1 --2- 172.21.15.153:0/611080531 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fe1840340f0 0x7fe1840365a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.776+0000 7fe249ff0680 1 --2- 172.21.15.153:0/611080531 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5566b6f4dfd0 0x5566b6f53b70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.776+0000 7fe249ff0680 1 -- 172.21.15.153:0/611080531 >> 172.21.15.153:0/611080531 conn(0x5566b6f491d0 msgr2=0x5566b6f47300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:13.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.776+0000 7fe249ff0680 1 -- 172.21.15.153:0/611080531 shutdown_connections 2023-10-05T21:15:13.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.776+0000 7fe249ff0680 1 -- 172.21.15.153:0/611080531 wait complete. 2023-10-05T21:15:13.851 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:15:13.852 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2023-10-05T21:15:13.852 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2023-10-05T21:15:13.852 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2023-10-05T21:15:13.899 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:13.899 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:13.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.898+0000 7f0ec58a6680 1 Processor -- start 2023-10-05T21:15:13.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.898+0000 7f0ec58a6680 1 -- start start 2023-10-05T21:15:13.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.899+0000 7f0ec58a6680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55918523f7f0 0x559185241bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.899+0000 7f0ec58a6680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559185189930 con 0x55918523b2c0 2023-10-05T21:15:13.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.899+0000 7f0ec58a6680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x559185149db0 con 0x55918523f7f0 2023-10-05T21:15:13.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.899+0000 7f0eb017d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55918523f7f0 0x559185241bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.899+0000 7f0eb017d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55918523f7f0 0x559185241bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49702/0 (socket says 172.21.15.153:49702) 2023-10-05T21:15:13.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.899+0000 7f0eb017d700 1 -- 172.21.15.153:0/4285279224 learned_addr learned my addr 172.21.15.153:0/4285279224 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:13.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.899+0000 7f0eb897e700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55918523b2c0 0x55918523b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56268/0 (socket says 172.21.15.153:56268) 2023-10-05T21:15:13.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.899+0000 7f0eb3fff700 1 -- 172.21.15.153:0/4285279224 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408560751 0 0) 0x559185189930 con 0x55918523b2c0 2023-10-05T21:15:13.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.899+0000 7f0eb3fff700 1 -- 172.21.15.153:0/4285279224 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ea4001e10 con 0x55918523b2c0 2023-10-05T21:15:13.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.899+0000 7f0eb017d700 1 -- 172.21.15.153:0/4285279224 >> v1:172.21.15.111:6789/0 conn(0x55918523b2c0 legacy=0x55918523b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.899+0000 7f0eb017d700 1 -- 172.21.15.153:0/4285279224 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559185243120 con 0x55918523f7f0 2023-10-05T21:15:13.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.900+0000 7f0eb017d700 1 --2- 172.21.15.153:0/4285279224 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918523f7f0 0x559185241bd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0ea000a760 tx=0x7f0ea0005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa5df5cc7430040 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.900+0000 7f0eb3fff700 1 -- 172.21.15.153:0/4285279224 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ea000f070 con 0x55918523f7f0 2023-10-05T21:15:13.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.900+0000 7f0eb3fff700 1 -- 172.21.15.153:0/4285279224 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea000a2e0 con 0x55918523f7f0 2023-10-05T21:15:13.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.900+0000 7f0eb3fff700 1 -- 172.21.15.153:0/4285279224 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ea00085b0 con 0x55918523f7f0 2023-10-05T21:15:13.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.900+0000 7f0ec58a6680 1 -- 172.21.15.153:0/4285279224 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918523f7f0 msgr2=0x559185241bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.900+0000 7f0ec58a6680 1 --2- 172.21.15.153:0/4285279224 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918523f7f0 0x559185241bd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0ea000a760 tx=0x7f0ea0005b10 comp rx=0 tx=0).stop 2023-10-05T21:15:13.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.900+0000 7f0ec58a6680 1 -- 172.21.15.153:0/4285279224 shutdown_connections 2023-10-05T21:15:13.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.900+0000 7f0ec58a6680 1 --2- 172.21.15.153:0/4285279224 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918523f7f0 0x559185241bd0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.900+0000 7f0ec58a6680 1 -- 172.21.15.153:0/4285279224 >> 172.21.15.153:0/4285279224 conn(0x559185236b90 msgr2=0x559185238fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:13.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.900+0000 7f0ec58a6680 1 -- 172.21.15.153:0/4285279224 shutdown_connections 2023-10-05T21:15:13.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.900+0000 7f0ec58a6680 1 -- 172.21.15.153:0/4285279224 wait complete. 2023-10-05T21:15:13.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.901+0000 7f0ec58a6680 1 Processor -- start 2023-10-05T21:15:13.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.901+0000 7f0ec58a6680 1 -- start start 2023-10-05T21:15:13.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.901+0000 7f0ec58a6680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918523b2c0 0x55918525d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.901+0000 7f0ec58a6680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591850e9ea0 con 0x55918523b2c0 2023-10-05T21:15:13.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.901+0000 7f0eb897e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918523b2c0 0x55918525d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.901+0000 7f0eb897e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918523b2c0 0x55918525d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49710/0 (socket says 172.21.15.153:49710) 2023-10-05T21:15:13.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.901+0000 7f0eb897e700 1 -- 172.21.15.153:0/3032509197 learned_addr learned my addr 172.21.15.153:0/3032509197 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:13.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.902+0000 7f0eb897e700 1 -- 172.21.15.153:0/3032509197 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea0005db0 con 0x55918523b2c0 2023-10-05T21:15:13.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.902+0000 7f0eb897e700 1 --2- 172.21.15.153:0/3032509197 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918523b2c0 0x55918525d970 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8001d30 tx=0x7f0ea80018e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47a23a8438d7c63b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.902+0000 7f0eb2ffd700 1 -- 172.21.15.153:0/3032509197 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ea8014070 con 0x55918523b2c0 2023-10-05T21:15:13.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.902+0000 7f0eb2ffd700 1 -- 172.21.15.153:0/3032509197 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea800be10 con 0x55918523b2c0 2023-10-05T21:15:13.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.902+0000 7f0eb2ffd700 1 -- 172.21.15.153:0/3032509197 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ea800f5b0 con 0x55918523b2c0 2023-10-05T21:15:13.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.902+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3032509197 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918523b2c0 msgr2=0x55918525d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.902+0000 7f0ec58a6680 1 --2- 172.21.15.153:0/3032509197 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918523b2c0 0x55918525d970 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8001d30 tx=0x7f0ea80018e0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.902+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3032509197 shutdown_connections 2023-10-05T21:15:13.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.902+0000 7f0ec58a6680 1 --2- 172.21.15.153:0/3032509197 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918523b2c0 0x55918525d970 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.902+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3032509197 >> 172.21.15.153:0/3032509197 conn(0x559185236b90 msgr2=0x559185255030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:13.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.902+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3032509197 shutdown_connections 2023-10-05T21:15:13.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.902+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3032509197 wait complete. 2023-10-05T21:15:13.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.903+0000 7f0ec58a6680 1 Processor -- start 2023-10-05T21:15:13.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.903+0000 7f0ec58a6680 1 -- start start 2023-10-05T21:15:13.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.903+0000 7f0ec58a6680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918523b2c0 0x559185264e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.903+0000 7f0ec58a6680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591850e0c80 con 0x55918523b2c0 2023-10-05T21:15:13.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.903+0000 7f0eb897e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918523b2c0 0x559185264e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.903+0000 7f0eb897e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918523b2c0 0x559185264e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49720/0 (socket says 172.21.15.153:49720) 2023-10-05T21:15:13.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.903+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 learned_addr learned my addr 172.21.15.153:0/3846836054 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:13.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.903+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea4001e10 con 0x55918523b2c0 2023-10-05T21:15:13.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.903+0000 7f0eb897e700 1 --2- 172.21.15.153:0/3846836054 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918523b2c0 0x559185264e50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8004000 tx=0x7f0ea8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.903+0000 7f0eb17fa700 1 -- 172.21.15.153:0/3846836054 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ea801c7c0 con 0x55918523b2c0 2023-10-05T21:15:13.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.904+0000 7f0eb17fa700 1 -- 172.21.15.153:0/3846836054 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea801c940 con 0x55918523b2c0 2023-10-05T21:15:13.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.904+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559185265390 con 0x55918523b2c0 2023-10-05T21:15:13.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.904+0000 7f0eb17fa700 1 -- 172.21.15.153:0/3846836054 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ea801cc30 con 0x55918523b2c0 2023-10-05T21:15:13.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.904+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5591852657e0 con 0x55918523b2c0 2023-10-05T21:15:13.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.904+0000 7f0eb17fa700 1 -- 172.21.15.153:0/3846836054 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f0ea8023020 con 0x55918523b2c0 2023-10-05T21:15:13.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.904+0000 7f0eb17fa700 1 --2- 172.21.15.153:0/3846836054 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0e98034140 0x7f0e980365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.905+0000 7f0eb17fa700 1 -- 172.21.15.153:0/3846836054 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f0ea8008030 con 0x55918523b2c0 2023-10-05T21:15:13.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.905+0000 7f0eb017d700 1 --2- 172.21.15.153:0/3846836054 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0e98034140 0x7f0e980365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.905+0000 7f0ec58a6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.905+0000 7f0ec58a6680 1 --2- 172.21.15.153:0/3846836054 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55918523f7f0 0x559185270c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.905+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852713b0 con 0x55918523f7f0 2023-10-05T21:15:13.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.905+0000 7f0eb917f700 1 --2- 172.21.15.153:0/3846836054 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55918523f7f0 0x559185270c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.905+0000 7f0eb017d700 1 --2- 172.21.15.153:0/3846836054 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0e98034140 0x7f0e980365f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0003080 tx=0x7f0ea0018000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.905+0000 7f0eb917f700 1 --2- 172.21.15.153:0/3846836054 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55918523f7f0 0x559185270c20 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.906+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.906+0000 7f0ec58a6680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.906+0000 7f0ec58a6680 20 realm 2023-10-05T21:15:13.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.906+0000 7f0ec58a6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.906+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55918526e120 con 0x55918523f7f0 2023-10-05T21:15:13.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.906+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.906+0000 7f0ec58a6680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.906+0000 7f0ec58a6680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:13.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.906+0000 7f0ec58a6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.906+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185271e60 con 0x55918523f7f0 2023-10-05T21:15:13.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.906+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.906+0000 7f0ec58a6680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.906+0000 7f0ec58a6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.906+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185272780 con 0x55918523f7f0 2023-10-05T21:15:13.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.906+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.906+0000 7f0ec58a6680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.906+0000 7f0ec58a6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.906+0000 7f0ec58a6680 1 --2- 172.21.15.153:0/3846836054 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x559185273040 0x559185275420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.906+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185275a30 con 0x559185273040 2023-10-05T21:15:13.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.906+0000 7f0eb897e700 1 --2- 172.21.15.153:0/3846836054 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x559185273040 0x559185275420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.907+0000 7f0eb897e700 1 --2- 172.21.15.153:0/3846836054 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x559185273040 0x559185275420 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.907+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f0ea8016070 con 0x559185273040 2023-10-05T21:15:13.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.907+0000 7f0ec58a6680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:13.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.907+0000 7f0ec58a6680 20 searching for the correct realm 2023-10-05T21:15:13.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.907+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x559185273040 2023-10-05T21:15:13.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.907+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ea8016070 con 0x559185273040 2023-10-05T21:15:13.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.907+0000 7f0eb897e700 1 --2- 172.21.15.153:0/3846836054 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f0ea801a070 0x7f0ea8041130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.907+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x7f0ea801a070 2023-10-05T21:15:13.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.907+0000 7f0eb017d700 1 --2- 172.21.15.153:0/3846836054 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f0ea801a070 0x7f0ea8041130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.908+0000 7f0eb017d700 1 --2- 172.21.15.153:0/3846836054 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f0ea801a070 0x7f0ea8041130 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.908+0000 7f0eb017d700 1 -- 172.21.15.153:0/3846836054 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ea001f040 con 0x7f0ea801a070 2023-10-05T21:15:13.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.908+0000 7f0eb017d700 1 --2- 172.21.15.153:0/3846836054 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f0ea001e070 0x7f0ea001e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.908+0000 7f0eb017d700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x7f0ea001e070 2023-10-05T21:15:13.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.908+0000 7f0eb917f700 1 --2- 172.21.15.153:0/3846836054 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f0ea001e070 0x7f0ea001e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.908+0000 7f0eb917f700 1 --2- 172.21.15.153:0/3846836054 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f0ea001e070 0x7f0ea001e950 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.909+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb400a570 con 0x7f0ea001e070 2023-10-05T21:15:13.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.909+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x55918523f7f0 2023-10-05T21:15:13.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.909+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.909+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x55918523f7f0 2023-10-05T21:15:13.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.909+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.909+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x7f0ea001e070 2023-10-05T21:15:13.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.909+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb400a570 con 0x7f0ea001e070 2023-10-05T21:15:13.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.909+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x7f0ea001e070 2023-10-05T21:15:13.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.909+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb400a570 con 0x7f0ea001e070 2023-10-05T21:15:13.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.909+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x7f0ea801a070 2023-10-05T21:15:13.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.910+0000 7f0eb017d700 1 -- 172.21.15.153:0/3846836054 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ea0028040 con 0x7f0ea801a070 2023-10-05T21:15:13.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.910+0000 7f0eb017d700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x559185273040 2023-10-05T21:15:13.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.910+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0ea8016070 con 0x559185273040 2023-10-05T21:15:13.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.910+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x55918523f7f0 2023-10-05T21:15:13.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.910+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.910+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x7f0ea001e070 2023-10-05T21:15:13.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.910+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb400a570 con 0x7f0ea001e070 2023-10-05T21:15:13.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.910+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x55918523f7f0 2023-10-05T21:15:13.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.911+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.911+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x7f0ea801a070 2023-10-05T21:15:13.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.911+0000 7f0eb017d700 1 -- 172.21.15.153:0/3846836054 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ea0028040 con 0x7f0ea801a070 2023-10-05T21:15:13.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.911+0000 7f0eb017d700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x559185273040 2023-10-05T21:15:13.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.911+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ea8016070 con 0x559185273040 2023-10-05T21:15:13.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.911+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x559185273040 2023-10-05T21:15:13.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.911+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ea8016070 con 0x559185273040 2023-10-05T21:15:13.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.911+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x7f0ea001e070 2023-10-05T21:15:13.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.912+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb400a570 con 0x7f0ea001e070 2023-10-05T21:15:13.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.912+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x559185273040 2023-10-05T21:15:13.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.912+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ea8016070 con 0x559185273040 2023-10-05T21:15:13.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.912+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x559185273040 2023-10-05T21:15:13.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.912+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ea8016070 con 0x559185273040 2023-10-05T21:15:13.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.912+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x55918523f7f0 2023-10-05T21:15:13.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.912+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.912+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x55918523f7f0 2023-10-05T21:15:13.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.912+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.912+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x7f0ea001e070 2023-10-05T21:15:13.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.913+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb400a570 con 0x7f0ea001e070 2023-10-05T21:15:13.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.913+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x559185273040 2023-10-05T21:15:13.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.913+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ea8016070 con 0x559185273040 2023-10-05T21:15:13.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.913+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x7f0ea801a070 2023-10-05T21:15:13.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.913+0000 7f0eb017d700 1 -- 172.21.15.153:0/3846836054 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ea0028040 con 0x7f0ea801a070 2023-10-05T21:15:13.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.913+0000 7f0eb017d700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x55918523f7f0 2023-10-05T21:15:13.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.913+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.913+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x7f0ea001e070 2023-10-05T21:15:13.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.914+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb400a570 con 0x7f0ea001e070 2023-10-05T21:15:13.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.914+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x559185273040 2023-10-05T21:15:13.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.914+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ea8016070 con 0x559185273040 2023-10-05T21:15:13.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.914+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x7f0ea001e070 2023-10-05T21:15:13.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.914+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb400a570 con 0x7f0ea001e070 2023-10-05T21:15:13.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.914+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x7f0ea801a070 2023-10-05T21:15:13.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.914+0000 7f0eb017d700 1 -- 172.21.15.153:0/3846836054 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ea0028040 con 0x7f0ea801a070 2023-10-05T21:15:13.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.914+0000 7f0eb017d700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x559185273040 2023-10-05T21:15:13.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.915+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ea8016070 con 0x559185273040 2023-10-05T21:15:13.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.915+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x7f0ea001e070 2023-10-05T21:15:13.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.915+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb400a570 con 0x7f0ea001e070 2023-10-05T21:15:13.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.915+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x55918523f7f0 2023-10-05T21:15:13.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.915+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.915+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852775a0 con 0x7f0ea801a070 2023-10-05T21:15:13.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.916+0000 7f0eb017d700 1 -- 172.21.15.153:0/3846836054 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ea0028040 con 0x7f0ea801a070 2023-10-05T21:15:13.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.916+0000 7f0ec58a6680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:13.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.916+0000 7f0ec58a6680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:13.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.916+0000 7f0ec58a6680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:13.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.916+0000 7f0ec58a6680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:13.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.916+0000 7f0ec58a6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.916+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852764f0 con 0x55918523f7f0 2023-10-05T21:15:13.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.916+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.916+0000 7f0ec58a6680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.916+0000 7f0ec58a6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.916+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852768f0 con 0x55918523f7f0 2023-10-05T21:15:13.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.916+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.916+0000 7f0ec58a6680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.916+0000 7f0ec58a6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.916+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185277a30 con 0x55918523f7f0 2023-10-05T21:15:13.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.916+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.916+0000 7f0ec58a6680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:13.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.916+0000 7f0ec58a6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.916+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185277de0 con 0x559185273040 2023-10-05T21:15:13.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.917+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f0ea8016070 con 0x559185273040 2023-10-05T21:15:13.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.917+0000 7f0ec58a6680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.917+0000 7f0ec58a6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.917+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185278190 con 0x55918523f7f0 2023-10-05T21:15:13.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.917+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.917+0000 7f0ec58a6680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.917+0000 7f0ec58a6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.917+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185278190 con 0x55918523f7f0 2023-10-05T21:15:13.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.917+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.917+0000 7f0ec58a6680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.917+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185278190 con 0x559185273040 2023-10-05T21:15:13.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.917+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ea8016070 con 0x559185273040 2023-10-05T21:15:13.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.917+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185278190 con 0x7f0ea801a070 2023-10-05T21:15:13.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.917+0000 7f0eb017d700 1 -- 172.21.15.153:0/3846836054 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ea0028040 con 0x7f0ea801a070 2023-10-05T21:15:13.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.917+0000 7f0eb017d700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185278190 con 0x7f0ea001e070 2023-10-05T21:15:13.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.918+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb400a570 con 0x7f0ea001e070 2023-10-05T21:15:13.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.918+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185277a30 con 0x55918523f7f0 2023-10-05T21:15:13.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.918+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.918+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185277a30 con 0x55918523f7f0 2023-10-05T21:15:13.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.918+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.918+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185277a30 con 0x7f0ea001e070 2023-10-05T21:15:13.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.919+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb400a570 con 0x7f0ea001e070 2023-10-05T21:15:13.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.919+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185277a30 con 0x7f0ea001e070 2023-10-05T21:15:13.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.919+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb400a570 con 0x7f0ea001e070 2023-10-05T21:15:13.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.919+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185277a30 con 0x7f0ea801a070 2023-10-05T21:15:13.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.919+0000 7f0eb017d700 1 -- 172.21.15.153:0/3846836054 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ea0028040 con 0x7f0ea801a070 2023-10-05T21:15:13.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.919+0000 7f0eb017d700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185277a30 con 0x559185273040 2023-10-05T21:15:13.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.919+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0ea8016070 con 0x559185273040 2023-10-05T21:15:13.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.919+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185277a30 con 0x55918523f7f0 2023-10-05T21:15:13.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.920+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.920+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185277a30 con 0x7f0ea001e070 2023-10-05T21:15:13.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.920+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb400a570 con 0x7f0ea001e070 2023-10-05T21:15:13.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.920+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185277a30 con 0x55918523f7f0 2023-10-05T21:15:13.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.920+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.920+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185277a30 con 0x7f0ea801a070 2023-10-05T21:15:13.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.920+0000 7f0eb017d700 1 -- 172.21.15.153:0/3846836054 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ea0028040 con 0x7f0ea801a070 2023-10-05T21:15:13.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.920+0000 7f0eb017d700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185277a30 con 0x559185273040 2023-10-05T21:15:13.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.921+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ea8016070 con 0x559185273040 2023-10-05T21:15:13.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.921+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185277a30 con 0x559185273040 2023-10-05T21:15:13.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.921+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ea8016070 con 0x559185273040 2023-10-05T21:15:13.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.921+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185277a30 con 0x7f0ea001e070 2023-10-05T21:15:13.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.921+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb400a570 con 0x7f0ea001e070 2023-10-05T21:15:13.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.921+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185277a30 con 0x559185273040 2023-10-05T21:15:13.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.921+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ea8016070 con 0x559185273040 2023-10-05T21:15:13.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.921+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185277a30 con 0x559185273040 2023-10-05T21:15:13.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.921+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ea8016070 con 0x559185273040 2023-10-05T21:15:13.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.921+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185277a30 con 0x55918523f7f0 2023-10-05T21:15:13.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.922+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.922+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185277a30 con 0x55918523f7f0 2023-10-05T21:15:13.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.922+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.922+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185277a30 con 0x7f0ea001e070 2023-10-05T21:15:13.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.922+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb400a570 con 0x7f0ea001e070 2023-10-05T21:15:13.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.922+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185277a30 con 0x559185273040 2023-10-05T21:15:13.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.922+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ea8016070 con 0x559185273040 2023-10-05T21:15:13.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.922+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185277a30 con 0x7f0ea801a070 2023-10-05T21:15:13.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.922+0000 7f0eb017d700 1 -- 172.21.15.153:0/3846836054 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ea0028040 con 0x7f0ea801a070 2023-10-05T21:15:13.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.922+0000 7f0eb017d700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185277a30 con 0x55918523f7f0 2023-10-05T21:15:13.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.923+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.923+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185277a30 con 0x7f0ea001e070 2023-10-05T21:15:13.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.923+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb400a570 con 0x7f0ea001e070 2023-10-05T21:15:13.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.923+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185277a30 con 0x559185273040 2023-10-05T21:15:13.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.923+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ea8016070 con 0x559185273040 2023-10-05T21:15:13.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.923+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185277a30 con 0x7f0ea001e070 2023-10-05T21:15:13.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.923+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb400a570 con 0x7f0ea001e070 2023-10-05T21:15:13.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.923+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185277a30 con 0x7f0ea801a070 2023-10-05T21:15:13.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.924+0000 7f0eb017d700 1 -- 172.21.15.153:0/3846836054 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ea0028040 con 0x7f0ea801a070 2023-10-05T21:15:13.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.924+0000 7f0eb017d700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185277a30 con 0x559185273040 2023-10-05T21:15:13.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.924+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ea8016070 con 0x559185273040 2023-10-05T21:15:13.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.924+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185277a30 con 0x7f0ea001e070 2023-10-05T21:15:13.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.924+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0eb400a570 con 0x7f0ea001e070 2023-10-05T21:15:13.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.924+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185277a30 con 0x55918523f7f0 2023-10-05T21:15:13.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.924+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.924+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185277a30 con 0x7f0ea801a070 2023-10-05T21:15:13.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.924+0000 7f0eb017d700 1 -- 172.21.15.153:0/3846836054 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ea0028040 con 0x7f0ea801a070 2023-10-05T21:15:13.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.924+0000 7f0ec58a6680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:13.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.924+0000 7f0ec58a6680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:13.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.924+0000 7f0ec58a6680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:13.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.924+0000 7f0ec58a6680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:13.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.924+0000 7f0ec58a6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.924+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185278190 con 0x55918523f7f0 2023-10-05T21:15:13.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.925+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.925+0000 7f0ec58a6680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.925+0000 7f0ec58a6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.925+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852785c0 con 0x559185273040 2023-10-05T21:15:13.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.925+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f0ea8016070 con 0x559185273040 2023-10-05T21:15:13.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.925+0000 7f0ec58a6680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:13.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.925+0000 7f0ec58a6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.925+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185278e60 con 0x55918523f7f0 2023-10-05T21:15:13.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.925+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.925+0000 7f0ec58a6680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:13.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.925+0000 7f0ec58a6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.925+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185278e60 con 0x55918523f7f0 2023-10-05T21:15:13.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.925+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.925+0000 7f0ec58a6680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:13.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.925+0000 7f0ec58a6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.925+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185278f60 con 0x7f0ea001e070 2023-10-05T21:15:13.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.926+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f0eb400a570 con 0x7f0ea001e070 2023-10-05T21:15:13.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.926+0000 7f0ec58a6680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.926+0000 7f0ec58a6680 20 zone default found 2023-10-05T21:15:13.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.926+0000 7f0ec58a6680 4 Realm: () 2023-10-05T21:15:13.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.926+0000 7f0ec58a6680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:13.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.926+0000 7f0ec58a6680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:13.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.926+0000 7f0ec58a6680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:13.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.926+0000 7f0ec58a6680 20 zonegroup default 2023-10-05T21:15:13.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.926+0000 7f0ec58a6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.926+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185278f60 con 0x7f0ea001e070 2023-10-05T21:15:13.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.926+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f0eb400a570 con 0x7f0ea001e070 2023-10-05T21:15:13.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.926+0000 7f0ec58a6680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.926+0000 7f0ec58a6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.926+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55918527a8e0 con 0x559185273040 2023-10-05T21:15:13.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.926+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0ea8016070 con 0x559185273040 2023-10-05T21:15:13.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.926+0000 7f0ec58a6680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.926+0000 7f0ec58a6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:13.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.926+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55918527ac90 con 0x559185273040 2023-10-05T21:15:13.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.927+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0ea8016070 con 0x559185273040 2023-10-05T21:15:13.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.927+0000 7f0ec58a6680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:13.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.927+0000 7f0ec58a6680 20 started sync module instance, tier type = 2023-10-05T21:15:13.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.927+0000 7f0ec58a6680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:13.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.927+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185279ff0 con 0x7f0ea801a070 2023-10-05T21:15:13.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.927+0000 7f0eb017d700 1 -- 172.21.15.153:0/3846836054 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ea0028040 con 0x7f0ea801a070 2023-10-05T21:15:13.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.927+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94083492586480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55918527b530 con 0x7f0ea801a070 2023-10-05T21:15:13.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.927+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55918527bdd0 con 0x55918523f7f0 2023-10-05T21:15:13.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.928+0000 7f0eb017d700 1 -- 172.21.15.153:0/3846836054 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94083492586480] v29'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ea0028040 con 0x7f0ea801a070 2023-10-05T21:15:13.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.928+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.928+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94083492589632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55918527be10 con 0x55918523f7f0 2023-10-05T21:15:13.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.928+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55918527c9f0 con 0x559185273040 2023-10-05T21:15:13.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.929+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ea8016070 con 0x559185273040 2023-10-05T21:15:13.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.929+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94083492594848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55918527d2e0 con 0x559185273040 2023-10-05T21:15:13.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.929+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55918527dd80 con 0x7f0ea801a070 2023-10-05T21:15:13.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.929+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94083492589632] v29'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.930+0000 7f0eb017d700 1 -- 172.21.15.153:0/3846836054 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ea0028040 con 0x7f0ea801a070 2023-10-05T21:15:13.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.930+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94083492591840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55918527e670 con 0x7f0ea801a070 2023-10-05T21:15:13.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.930+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94083492594848] v29'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ea8016070 con 0x559185273040 2023-10-05T21:15:13.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.930+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55918527cdf0 con 0x55918523f7f0 2023-10-05T21:15:13.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.930+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.930+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94083492604448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55918527f360 con 0x55918523f7f0 2023-10-05T21:15:13.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.930+0000 7f0eb017d700 1 -- 172.21.15.153:0/3846836054 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94083492591840] v29'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ea0028040 con 0x7f0ea801a070 2023-10-05T21:15:13.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.930+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55918527fdb0 con 0x7f0ea001e070 2023-10-05T21:15:13.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.931+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94083492604448] v29'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.931+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb400a570 con 0x7f0ea001e070 2023-10-05T21:15:13.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.931+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94083492602240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55918527f360 con 0x7f0ea001e070 2023-10-05T21:15:13.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.931+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185280210 con 0x7f0ea001e070 2023-10-05T21:15:13.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.932+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(96 notify.6 [create] v29'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb400a570 con 0x7f0ea001e070 2023-10-05T21:15:13.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.932+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(95 notify.5 [watch watch cookie 94083492602240] v29'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb400a570 con 0x7f0ea001e070 2023-10-05T21:15:13.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.932+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94083492609248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852806e0 con 0x7f0ea001e070 2023-10-05T21:15:13.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.932+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852810f0 con 0x7f0ea001e070 2023-10-05T21:15:13.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.933+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94083492609248] v29'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb400a570 con 0x7f0ea001e070 2023-10-05T21:15:13.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.933+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb400a570 con 0x7f0ea001e070 2023-10-05T21:15:13.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.933+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94083492610352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852806a0 con 0x7f0ea001e070 2023-10-05T21:15:13.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.933+0000 7f0ec58a6680 20 add_watcher() i=0 2023-10-05T21:15:13.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.933+0000 7f0ec58a6680 20 add_watcher() i=1 2023-10-05T21:15:13.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.933+0000 7f0ec58a6680 20 add_watcher() i=2 2023-10-05T21:15:13.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.933+0000 7f0ec58a6680 20 add_watcher() i=3 2023-10-05T21:15:13.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.933+0000 7f0ec58a6680 20 add_watcher() i=4 2023-10-05T21:15:13.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.933+0000 7f0ec58a6680 20 add_watcher() i=5 2023-10-05T21:15:13.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.933+0000 7f0ec58a6680 20 add_watcher() i=6 2023-10-05T21:15:13.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.933+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94083492610352] v29'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb400a570 con 0x7f0ea001e070 2023-10-05T21:15:13.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.933+0000 7f0ec58a6680 20 add_watcher() i=7 2023-10-05T21:15:13.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.933+0000 7f0ec58a6680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:13.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.933+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185284120 con 0x55918523f7f0 2023-10-05T21:15:13.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.934+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.934+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94083492613120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559185281570 con 0x55918523f7f0 2023-10-05T21:15:13.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.934+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94083492613120] v29'68 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:13.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.935+0000 7f0e8a7e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:13.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.935+0000 7f0ec58a6680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:13.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.935+0000 7f0ec58a6680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:13.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.935+0000 7f0ec58a6680 1 Processor -- start 2023-10-05T21:15:13.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.935+0000 7f0ec58a6680 1 -- start start 2023-10-05T21:15:13.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.935+0000 7f0ec58a6680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918528dd40 0x55918528e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.935+0000 7f0ec58a6680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55918528e760 con 0x55918528dd40 2023-10-05T21:15:13.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.935+0000 7f0eb017d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918528dd40 0x55918528e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.935+0000 7f0eb017d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918528dd40 0x55918528e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49726/0 (socket says 172.21.15.153:49726) 2023-10-05T21:15:13.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.935+0000 7f0eb017d700 1 -- 172.21.15.153:0/3607902249 learned_addr learned my addr 172.21.15.153:0/3607902249 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:13.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.935+0000 7f0eb017d700 1 -- 172.21.15.153:0/3607902249 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55918528ec40 con 0x55918528dd40 2023-10-05T21:15:13.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.936+0000 7f0eb017d700 1 --2- 172.21.15.153:0/3607902249 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918528dd40 0x55918528e150 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0005720 tx=0x7f0ea0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74195f8b0b3b7e83 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.936+0000 7f0e89fe3700 1 -- 172.21.15.153:0/3607902249 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ea0024040 con 0x55918528dd40 2023-10-05T21:15:13.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.936+0000 7f0e89fe3700 1 -- 172.21.15.153:0/3607902249 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea0038450 con 0x55918528dd40 2023-10-05T21:15:13.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.936+0000 7f0e89fe3700 1 -- 172.21.15.153:0/3607902249 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ea0038780 con 0x55918528dd40 2023-10-05T21:15:13.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.936+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3607902249 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918528dd40 msgr2=0x55918528e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:13.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.936+0000 7f0ec58a6680 1 --2- 172.21.15.153:0/3607902249 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918528dd40 0x55918528e150 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0005720 tx=0x7f0ea0016000 comp rx=0 tx=0).stop 2023-10-05T21:15:13.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.936+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3607902249 shutdown_connections 2023-10-05T21:15:13.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.936+0000 7f0ec58a6680 1 --2- 172.21.15.153:0/3607902249 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918528dd40 0x55918528e150 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:13.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.936+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3607902249 >> 172.21.15.153:0/3607902249 conn(0x55918528a040 msgr2=0x559185288140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:13.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.937+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3607902249 shutdown_connections 2023-10-05T21:15:13.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.937+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3607902249 wait complete. 2023-10-05T21:15:13.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.937+0000 7f0ec58a6680 1 Processor -- start 2023-10-05T21:15:13.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.937+0000 7f0ec58a6680 1 -- start start 2023-10-05T21:15:13.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.937+0000 7f0ec58a6680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918528dd40 0x5591852949c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:13.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.937+0000 7f0ec58a6680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x559185294f00 con 0x55918528dd40 2023-10-05T21:15:13.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.937+0000 7f0eb017d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918528dd40 0x5591852949c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:13.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.937+0000 7f0eb017d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918528dd40 0x5591852949c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49742/0 (socket says 172.21.15.153:49742) 2023-10-05T21:15:13.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.937+0000 7f0eb017d700 1 -- 172.21.15.153:0/79487026 learned_addr learned my addr 172.21.15.153:0/79487026 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:13.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.938+0000 7f0eb017d700 1 -- 172.21.15.153:0/79487026 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559185243120 con 0x55918528dd40 2023-10-05T21:15:13.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.938+0000 7f0eb017d700 1 --2- 172.21.15.153:0/79487026 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918528dd40 0x5591852949c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0016040 tx=0x7f0ea0038000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:13.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.938+0000 7f0dfbfff700 1 -- 172.21.15.153:0/79487026 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ea0024040 con 0x55918528dd40 2023-10-05T21:15:13.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.938+0000 7f0dfbfff700 1 -- 172.21.15.153:0/79487026 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea002c830 con 0x55918528dd40 2023-10-05T21:15:13.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.938+0000 7f0dfbfff700 1 -- 172.21.15.153:0/79487026 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ea002cb00 con 0x55918528dd40 2023-10-05T21:15:13.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.938+0000 7f0ec58a6680 1 -- 172.21.15.153:0/79487026 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559185295100 con 0x55918528dd40 2023-10-05T21:15:14.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.938+0000 7f0ec58a6680 1 -- 172.21.15.153:0/79487026 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5591852955b0 con 0x55918528dd40 2023-10-05T21:15:14.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.939+0000 7f0dfbfff700 1 -- 172.21.15.153:0/79487026 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f0ea001a040 con 0x55918528dd40 2023-10-05T21:15:14.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.939+0000 7f0dfbfff700 1 --2- 172.21.15.153:0/79487026 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0e00034140 0x7f0e000365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.939+0000 7f0dfbfff700 1 -- 172.21.15.153:0/79487026 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f0ea000d040 con 0x55918528dd40 2023-10-05T21:15:14.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.939+0000 7f0eb917f700 1 --2- 172.21.15.153:0/79487026 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0e00034140 0x7f0e000365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.939+0000 7f0ec58a6680 5 note: GC not initialized 2023-10-05T21:15:14.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.939+0000 7f0eb917f700 1 --2- 172.21.15.153:0/79487026 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0e00034140 0x7f0e000365f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x5591852809c0 tx=0x7f0eb4037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.940+0000 7f0df97fa700 20 reqs_thread_entry: start 2023-10-05T21:15:14.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.940+0000 7f0df2ffd700 20 reqs_thread_entry: start 2023-10-05T21:15:14.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.940+0000 7f0ec58a6680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:14.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.940+0000 7f0ec58a6680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:14.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.940+0000 7f0df17fa700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:44 2023 2023-10-05T21:15:14.001 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:14.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.940+0000 7f0df0ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:14.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.940+0000 7f0ec58a6680 20 get_system_obj_state: rctx=0x7ffd86740a18 obj=default.rgw.meta:users.uid:foo state=0x5591850ef240 s->prefetch_data=0 2023-10-05T21:15:14.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.940+0000 7f0ec58a6680 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T21:15:14.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.940+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852fa390 con 0x55918523f7f0 2023-10-05T21:15:14.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.941+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:14.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.941+0000 7f0ec58a6680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T21:15:14.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.941+0000 7f0ec58a6680 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:14.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.941+0000 7f0ec58a6680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:14.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.941+0000 7f0ec58a6680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:14.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.941+0000 7f0ec58a6680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:14.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.941+0000 7f0ec58a6680 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:14.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.941+0000 7f0ec58a6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.941+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852fc620 con 0x55918523f7f0 2023-10-05T21:15:14.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.941+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~459 out=459b,getxattrs out=75b] v0'0 uv4 ondisk = 0) v8 ==== 273+0+582 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:14.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.941+0000 7f0ec58a6680 20 rados_obj.operate() r=0 bl.length=459 2023-10-05T21:15:14.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.941+0000 7f0ec58a6680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T21:15:14.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.941+0000 7f0ec58a6680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:14.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.941+0000 7f0ec58a6680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:14.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.941+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:104 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852fe3f0 con 0x55918523f7f0 2023-10-05T21:15:14.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.942+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(104 foo [delete,create,call,writefull 0~357] v29'5 uv5 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:14.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.942+0000 7f0ec58a6680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T21:15:14.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.942+0000 7f0ec58a6680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:14.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.942+0000 7f0ec58a6680 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T21:15:14.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.942+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [notify cookie 94083493125888 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852fb3a0 con 0x55918523f7f0 2023-10-05T21:15:14.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.942+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== watch-notify(notify (1) cookie 94083492604448 notify 124554051588 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x7f0eb4029250 con 0x55918523f7f0 2023-10-05T21:15:14.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.942+0000 7f0eb2ffd700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051588 cookie 94083492604448 notifier 4328 bl.length()=533 2023-10-05T21:15:14.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.942+0000 7f0eb2ffd700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T21:15:14.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.942+0000 7f0eb2ffd700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:14.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.942+0000 7f0eb2ffd700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f0e9c003d90 con 0x55918523f7f0 2023-10-05T21:15:14.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.942+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(105 notify.4 [notify cookie 94083493125888 out=8b] v0'0 uv51 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:14.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.943+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(106 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:14.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.943+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== watch-notify(notify_complete (2) cookie 94083493125888 notify 124554051588 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f0eb402d040 con 0x55918523f7f0 2023-10-05T21:15:14.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.943+0000 7f0ec58a6680 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2023-10-05T21:15:14.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.943+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [notify cookie 94083493125888 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852faeb0 con 0x559185273040 2023-10-05T21:15:14.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.943+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== watch-notify(notify (1) cookie 94083492594848 notify 124554051585 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x7f0ea8034040 con 0x559185273040 2023-10-05T21:15:14.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.943+0000 7f0eb27fc700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051585 cookie 94083492594848 notifier 4328 bl.length()=170 2023-10-05T21:15:14.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.943+0000 7f0eb27fc700 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f0e080032d0 con 0x559185273040 2023-10-05T21:15:14.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.943+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(107 notify.2 [notify cookie 94083493125888 out=8b] v0'0 uv51 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f0ea8016070 con 0x559185273040 2023-10-05T21:15:14.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.943+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(108 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ea8016070 con 0x559185273040 2023-10-05T21:15:14.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.943+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== watch-notify(notify_complete (2) cookie 94083493125888 notify 124554051585 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5591852657e0 con 0x559185273040 2023-10-05T21:15:14.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.943+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852fdf00 con 0x7f0ea001e070 2023-10-05T21:15:14.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.944+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(109 p5YnriCv1nAtykxBrupQ [delete] v29'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f0eb400a570 con 0x7f0ea001e070 2023-10-05T21:15:14.005 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "foo", 2023-10-05T21:15:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Foo", 2023-10-05T21:15:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "foo@foo.com", 2023-10-05T21:15:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2023-10-05T21:15:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 4, 2023-10-05T21:15:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [], 2023-10-05T21:15:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2023-10-05T21:15:14.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T21:15:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [], 2023-10-05T21:15:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2023-10-05T21:15:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2023-10-05T21:15:14.006 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2023-10-05T21:15:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2023-10-05T21:15:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2023-10-05T21:15:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:15:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2023-10-05T21:15:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2023-10-05T21:15:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2023-10-05T21:15:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [] 2023-10-05T21:15:14.008 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:14.008 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:15:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.945+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:110 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94083492586480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5591852fb2b0 con 0x7f0ea801a070 2023-10-05T21:15:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.945+0000 7f0eb017d700 1 -- 172.21.15.153:0/3846836054 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(110 notify.0 [watch unwatch cookie 94083492586480] v29'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ea003e020 con 0x7f0ea801a070 2023-10-05T21:15:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.945+0000 7f0ec58a6680 20 remove_watcher() i=0 2023-10-05T21:15:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.945+0000 7f0ec58a6680 2 removed watcher, disabling cache 2023-10-05T21:15:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.945+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:111 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94083492589632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55918527a3f0 con 0x55918523f7f0 2023-10-05T21:15:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.946+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 42 ==== osd_op_reply(111 notify.1 [watch unwatch cookie 94083492589632] v29'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.946+0000 7f0ec58a6680 20 remove_watcher() i=1 2023-10-05T21:15:14.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.946+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:112 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94083492594848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55918527a3f0 con 0x559185273040 2023-10-05T21:15:14.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.947+0000 7f0eb897e700 1 -- 172.21.15.153:0/3846836054 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(112 notify.2 [watch unwatch cookie 94083492594848] v29'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ea8016070 con 0x559185273040 2023-10-05T21:15:14.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.947+0000 7f0ec58a6680 20 remove_watcher() i=2 2023-10-05T21:15:14.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.947+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:113 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94083492591840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55918527a3f0 con 0x7f0ea801a070 2023-10-05T21:15:14.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.948+0000 7f0eb017d700 1 -- 172.21.15.153:0/3846836054 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(113 notify.3 [watch unwatch cookie 94083492591840] v29'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ea003e020 con 0x7f0ea801a070 2023-10-05T21:15:14.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.948+0000 7f0ec58a6680 20 remove_watcher() i=3 2023-10-05T21:15:14.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.948+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:114 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94083492604448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55918527a3f0 con 0x55918523f7f0 2023-10-05T21:15:14.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.948+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 43 ==== osd_op_reply(114 notify.4 [watch unwatch cookie 94083492604448] v29'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:14.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.948+0000 7f0ec58a6680 20 remove_watcher() i=4 2023-10-05T21:15:14.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.948+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:115 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94083492602240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55918527ea20 con 0x7f0ea001e070 2023-10-05T21:15:14.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.949+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(115 notify.5 [watch unwatch cookie 94083492602240] v29'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb400a570 con 0x7f0ea001e070 2023-10-05T21:15:14.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.949+0000 7f0ec58a6680 20 remove_watcher() i=5 2023-10-05T21:15:14.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.949+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:116 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94083492609248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55918527e180 con 0x7f0ea001e070 2023-10-05T21:15:14.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.950+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(116 notify.6 [watch unwatch cookie 94083492609248] v29'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb400a570 con 0x7f0ea001e070 2023-10-05T21:15:14.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.950+0000 7f0ec58a6680 20 remove_watcher() i=6 2023-10-05T21:15:14.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.950+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:117 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94083492610352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55918527e180 con 0x7f0ea001e070 2023-10-05T21:15:14.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.950+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(117 notify.7 [watch unwatch cookie 94083492610352] v29'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0eb400a570 con 0x7f0ea001e070 2023-10-05T21:15:14.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.950+0000 7f0ec58a6680 20 remove_watcher() i=7 2023-10-05T21:15:14.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.951+0000 7f0e8a7e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:14.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.951+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:118 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94083492613120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55918527e180 con 0x55918523f7f0 2023-10-05T21:15:14.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.952+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 <== osd.1 v2:172.21.15.153:6816/140456 44 ==== osd_op_reply(118 data_loggenerations_metadata [watch unwatch cookie 94083492613120] v29'69 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0eb400a570 con 0x55918523f7f0 2023-10-05T21:15:14.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.952+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f0ea001e070 msgr2=0x7f0ea001e950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.952+0000 7f0ec58a6680 1 --2- 172.21.15.153:0/3846836054 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f0ea001e070 0x7f0ea001e950 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.952+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55918523f7f0 msgr2=0x559185270c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.952+0000 7f0ec58a6680 1 --2- 172.21.15.153:0/3846836054 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55918523f7f0 0x559185270c20 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.952+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f0ea801a070 msgr2=0x7f0ea8041130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.952+0000 7f0ec58a6680 1 --2- 172.21.15.153:0/3846836054 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f0ea801a070 0x7f0ea8041130 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.952+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x559185273040 msgr2=0x559185275420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.952+0000 7f0ec58a6680 1 --2- 172.21.15.153:0/3846836054 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x559185273040 0x559185275420 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.952+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0e98034140 msgr2=0x7f0e980365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.952+0000 7f0ec58a6680 1 --2- 172.21.15.153:0/3846836054 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0e98034140 0x7f0e980365f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0003080 tx=0x7f0ea0018000 comp rx=0 tx=0).stop 2023-10-05T21:15:14.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.952+0000 7f0eb917f700 1 -- 172.21.15.153:0/3846836054 reap_dead start 2023-10-05T21:15:14.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.952+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918523b2c0 msgr2=0x559185264e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.952+0000 7f0ec58a6680 1 --2- 172.21.15.153:0/3846836054 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918523b2c0 0x559185264e50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8004000 tx=0x7f0ea8016000 comp rx=0 tx=0).stop 2023-10-05T21:15:14.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.952+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 shutdown_connections 2023-10-05T21:15:14.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.952+0000 7f0ec58a6680 1 --2- 172.21.15.153:0/3846836054 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918523b2c0 0x559185264e50 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.952+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 >> 172.21.15.153:0/3846836054 conn(0x559185236b90 msgr2=0x5591852538b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.952+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 shutdown_connections 2023-10-05T21:15:14.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.952+0000 7f0ec58a6680 1 -- 172.21.15.153:0/3846836054 wait complete. 2023-10-05T21:15:14.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.952+0000 7f0ec58a6680 1 -- 172.21.15.153:0/79487026 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0e00034140 msgr2=0x7f0e000365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.952+0000 7f0ec58a6680 1 --2- 172.21.15.153:0/79487026 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0e00034140 0x7f0e000365f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x5591852809c0 tx=0x7f0eb4037450 comp rx=0 tx=0).stop 2023-10-05T21:15:14.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.952+0000 7f0ec58a6680 1 -- 172.21.15.153:0/79487026 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918528dd40 msgr2=0x5591852949c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.952+0000 7f0ec58a6680 1 --2- 172.21.15.153:0/79487026 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918528dd40 0x5591852949c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0016040 tx=0x7f0ea0038000 comp rx=0 tx=0).stop 2023-10-05T21:15:14.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.952+0000 7f0ec58a6680 1 -- 172.21.15.153:0/79487026 shutdown_connections 2023-10-05T21:15:14.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.952+0000 7f0ec58a6680 1 --2- 172.21.15.153:0/79487026 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0e00034140 0x7f0e000365f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.952+0000 7f0ec58a6680 1 --2- 172.21.15.153:0/79487026 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55918528dd40 0x5591852949c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.952+0000 7f0ec58a6680 1 -- 172.21.15.153:0/79487026 >> 172.21.15.153:0/79487026 conn(0x55918528a040 msgr2=0x559185288110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.953+0000 7f0ec58a6680 1 -- 172.21.15.153:0/79487026 shutdown_connections 2023-10-05T21:15:14.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:13.953+0000 7f0ec58a6680 1 -- 172.21.15.153:0/79487026 wait complete. 2023-10-05T21:15:14.018 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:15:14.018 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2023-10-05T21:15:14.019 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2023-10-05T21:15:14.019 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2023-10-05T21:15:14.067 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:14.068 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:14.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.067+0000 7ff4f63dd680 1 Processor -- start 2023-10-05T21:15:14.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.067+0000 7ff4f63dd680 1 -- start start 2023-10-05T21:15:14.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.067+0000 7ff4f63dd680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55df48de2a50 0x55df48de2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.067+0000 7ff4f63dd680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55df48d2f930 con 0x55df48de33a0 2023-10-05T21:15:14.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.067+0000 7ff4f63dd680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55df48cefdb0 con 0x55df48de2a50 2023-10-05T21:15:14.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.067+0000 7ff4e94b5700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55df48de2a50 0x55df48de2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.067+0000 7ff4e8cb4700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55df48de33a0 0x55df48de9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56284/0 (socket says 172.21.15.153:56284) 2023-10-05T21:15:14.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.067+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/1170142125 learned_addr learned my addr 172.21.15.153:0/1170142125 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:14.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.067+0000 7ff4e94b5700 1 -- 172.21.15.153:0/1170142125 >> v1:172.21.15.111:6789/0 conn(0x55df48de33a0 legacy=0x55df48de9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.067+0000 7ff4dbfff700 1 -- 172.21.15.153:0/1170142125 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1207270576 0 0) 0x55df48d2f930 con 0x55df48de33a0 2023-10-05T21:15:14.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.067+0000 7ff4e94b5700 1 -- 172.21.15.153:0/1170142125 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df48dec470 con 0x55df48de2a50 2023-10-05T21:15:14.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.068+0000 7ff4e94b5700 1 --2- 172.21.15.153:0/1170142125 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48de2a50 0x55df48de2e60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00a5d0 tx=0x7ff4dc005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7499379a1c5001 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.068+0000 7ff4dbfff700 1 -- 172.21.15.153:0/1170142125 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4dc0086a0 con 0x55df48de2a50 2023-10-05T21:15:14.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.068+0000 7ff4dbfff700 1 -- 172.21.15.153:0/1170142125 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4dc008800 con 0x55df48de2a50 2023-10-05T21:15:14.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.068+0000 7ff4dbfff700 1 -- 172.21.15.153:0/1170142125 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4dc008ad0 con 0x55df48de2a50 2023-10-05T21:15:14.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.068+0000 7ff4f63dd680 1 -- 172.21.15.153:0/1170142125 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48de2a50 msgr2=0x55df48de2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.068+0000 7ff4f63dd680 1 --2- 172.21.15.153:0/1170142125 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48de2a50 0x55df48de2e60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00a5d0 tx=0x7ff4dc005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:14.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.068+0000 7ff4f63dd680 1 -- 172.21.15.153:0/1170142125 shutdown_connections 2023-10-05T21:15:14.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.068+0000 7ff4f63dd680 1 --2- 172.21.15.153:0/1170142125 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48de2a50 0x55df48de2e60 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.068+0000 7ff4f63dd680 1 -- 172.21.15.153:0/1170142125 >> 172.21.15.153:0/1170142125 conn(0x55df48ddc310 msgr2=0x55df48dde720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.068+0000 7ff4f63dd680 1 -- 172.21.15.153:0/1170142125 shutdown_connections 2023-10-05T21:15:14.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.068+0000 7ff4f63dd680 1 -- 172.21.15.153:0/1170142125 wait complete. 2023-10-05T21:15:14.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.069+0000 7ff4f63dd680 1 Processor -- start 2023-10-05T21:15:14.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.069+0000 7ff4f63dd680 1 -- start start 2023-10-05T21:15:14.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.069+0000 7ff4f63dd680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48de2a50 0x55df48e038a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.069+0000 7ff4f63dd680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df48c8fea0 con 0x55df48de2a50 2023-10-05T21:15:14.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.070+0000 7ff4e94b5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48de2a50 0x55df48e038a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.070+0000 7ff4e94b5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48de2a50 0x55df48e038a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49752/0 (socket says 172.21.15.153:49752) 2023-10-05T21:15:14.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.070+0000 7ff4e94b5700 1 -- 172.21.15.153:0/1854127077 learned_addr learned my addr 172.21.15.153:0/1854127077 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:14.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.070+0000 7ff4e94b5700 1 -- 172.21.15.153:0/1854127077 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4dc005cf0 con 0x55df48de2a50 2023-10-05T21:15:14.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.070+0000 7ff4e94b5700 1 --2- 172.21.15.153:0/1854127077 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48de2a50 0x55df48e038a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc000c00 tx=0x7ff4dc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e7cb06afe861f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.070+0000 7ff4daffd700 1 -- 172.21.15.153:0/1854127077 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4dc0086a0 con 0x55df48de2a50 2023-10-05T21:15:14.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.070+0000 7ff4daffd700 1 -- 172.21.15.153:0/1854127077 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4dc008970 con 0x55df48de2a50 2023-10-05T21:15:14.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.070+0000 7ff4daffd700 1 -- 172.21.15.153:0/1854127077 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4dc008b20 con 0x55df48de2a50 2023-10-05T21:15:14.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.071+0000 7ff4f63dd680 1 -- 172.21.15.153:0/1854127077 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48de2a50 msgr2=0x55df48e038a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.071+0000 7ff4f63dd680 1 --2- 172.21.15.153:0/1854127077 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48de2a50 0x55df48e038a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc000c00 tx=0x7ff4dc015000 comp rx=0 tx=0).stop 2023-10-05T21:15:14.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.071+0000 7ff4f63dd680 1 -- 172.21.15.153:0/1854127077 shutdown_connections 2023-10-05T21:15:14.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.071+0000 7ff4f63dd680 1 --2- 172.21.15.153:0/1854127077 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48de2a50 0x55df48e038a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.071+0000 7ff4f63dd680 1 -- 172.21.15.153:0/1854127077 >> 172.21.15.153:0/1854127077 conn(0x55df48ddc310 msgr2=0x55df48dff370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.071+0000 7ff4f63dd680 1 -- 172.21.15.153:0/1854127077 shutdown_connections 2023-10-05T21:15:14.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.071+0000 7ff4f63dd680 1 -- 172.21.15.153:0/1854127077 wait complete. 2023-10-05T21:15:14.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.071+0000 7ff4f63dd680 1 Processor -- start 2023-10-05T21:15:14.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.071+0000 7ff4f63dd680 1 -- start start 2023-10-05T21:15:14.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.071+0000 7ff4f63dd680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48de2a50 0x55df48e0ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.071+0000 7ff4f63dd680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df48c86c80 con 0x55df48de2a50 2023-10-05T21:15:14.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.071+0000 7ff4e94b5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48de2a50 0x55df48e0ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.071+0000 7ff4e94b5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48de2a50 0x55df48e0ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49764/0 (socket says 172.21.15.153:49764) 2023-10-05T21:15:14.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.071+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 learned_addr learned my addr 172.21.15.153:0/2448784669 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:14.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.072+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df48dec470 con 0x55df48de2a50 2023-10-05T21:15:14.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.072+0000 7ff4e94b5700 1 --2- 172.21.15.153:0/2448784669 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48de2a50 0x55df48e0ad30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc01f040 tx=0x7ff4dc01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.072+0000 7ff4d97fa700 1 -- 172.21.15.153:0/2448784669 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4dc01d420 con 0x55df48de2a50 2023-10-05T21:15:14.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.072+0000 7ff4d97fa700 1 -- 172.21.15.153:0/2448784669 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4dc01d580 con 0x55df48de2a50 2023-10-05T21:15:14.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.072+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55df48e0b270 con 0x55df48de2a50 2023-10-05T21:15:14.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.072+0000 7ff4d97fa700 1 -- 172.21.15.153:0/2448784669 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4dc01d710 con 0x55df48de2a50 2023-10-05T21:15:14.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.072+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55df48e0b6c0 con 0x55df48de2a50 2023-10-05T21:15:14.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.073+0000 7ff4f63dd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.073+0000 7ff4d97fa700 1 -- 172.21.15.153:0/2448784669 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7ff4dc01d870 con 0x55df48de2a50 2023-10-05T21:15:14.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.073+0000 7ff4d97fa700 1 --2- 172.21.15.153:0/2448784669 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff4cc034140 0x7ff4cc0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.073+0000 7ff4d97fa700 1 -- 172.21.15.153:0/2448784669 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7ff4dc04a150 con 0x55df48de2a50 2023-10-05T21:15:14.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.073+0000 7ff4e8cb4700 1 --2- 172.21.15.153:0/2448784669 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff4cc034140 0x7ff4cc0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.073+0000 7ff4f63dd680 1 --2- 172.21.15.153:0/2448784669 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55df48de33a0 0x55df48e16b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.073+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e172b0 con 0x55df48de33a0 2023-10-05T21:15:14.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.073+0000 7ff4e9cb6700 1 --2- 172.21.15.153:0/2448784669 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55df48de33a0 0x55df48e16b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.074+0000 7ff4e8cb4700 1 --2- 172.21.15.153:0/2448784669 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff4cc034140 0x7ff4cc0365f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00011e0 tx=0x7ff4e0001340 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.074+0000 7ff4e9cb6700 1 --2- 172.21.15.153:0/2448784669 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55df48de33a0 0x55df48e16b20 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.074+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.074+0000 7ff4f63dd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.074+0000 7ff4f63dd680 20 realm 2023-10-05T21:15:14.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.074+0000 7ff4f63dd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.074+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e14100 con 0x55df48de33a0 2023-10-05T21:15:14.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.074+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.074+0000 7ff4f63dd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.074+0000 7ff4f63dd680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:14.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.074+0000 7ff4f63dd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.074+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e17db0 con 0x55df48de33a0 2023-10-05T21:15:14.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.074+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.074+0000 7ff4f63dd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.074+0000 7ff4f63dd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.074+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e17a00 con 0x55df48de33a0 2023-10-05T21:15:14.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.075+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.075+0000 7ff4f63dd680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.075+0000 7ff4f63dd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.075+0000 7ff4f63dd680 1 --2- 172.21.15.153:0/2448784669 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55df48e19170 0x55df48e1b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.075+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1ba90 con 0x55df48e19170 2023-10-05T21:15:14.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.075+0000 7ff4e94b5700 1 --2- 172.21.15.153:0/2448784669 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55df48e19170 0x55df48e1b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.075+0000 7ff4e94b5700 1 --2- 172.21.15.153:0/2448784669 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55df48e19170 0x55df48e1b550 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.075+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff4dc036070 con 0x55df48e19170 2023-10-05T21:15:14.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.075+0000 7ff4f63dd680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:14.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.075+0000 7ff4f63dd680 20 searching for the correct realm 2023-10-05T21:15:14.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.075+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x55df48e19170 2023-10-05T21:15:14.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.076+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4dc036070 con 0x55df48e19170 2023-10-05T21:15:14.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.076+0000 7ff4e94b5700 1 --2- 172.21.15.153:0/2448784669 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ff4dc030020 0x7ff4dc049890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.076+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x7ff4dc030020 2023-10-05T21:15:14.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.076+0000 7ff4e8cb4700 1 --2- 172.21.15.153:0/2448784669 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ff4dc030020 0x7ff4dc049890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.076+0000 7ff4e8cb4700 1 --2- 172.21.15.153:0/2448784669 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ff4dc030020 0x7ff4dc049890 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.076+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e0006070 con 0x7ff4dc030020 2023-10-05T21:15:14.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.076+0000 7ff4e8cb4700 1 --2- 172.21.15.153:0/2448784669 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ff4e000d8e0 0x7ff4e000c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.076+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x7ff4e000d8e0 2023-10-05T21:15:14.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.076+0000 7ff4e9cb6700 1 --2- 172.21.15.153:0/2448784669 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ff4e000d8e0 0x7ff4e000c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.077+0000 7ff4e9cb6700 1 --2- 172.21.15.153:0/2448784669 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ff4e000d8e0 0x7ff4e000c360 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.077+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e400a570 con 0x7ff4e000d8e0 2023-10-05T21:15:14.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.077+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x55df48de33a0 2023-10-05T21:15:14.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.077+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.077+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x55df48de33a0 2023-10-05T21:15:14.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.077+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.077+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x7ff4e000d8e0 2023-10-05T21:15:14.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.078+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e400a570 con 0x7ff4e000d8e0 2023-10-05T21:15:14.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.078+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x7ff4e000d8e0 2023-10-05T21:15:14.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.078+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e400a570 con 0x7ff4e000d8e0 2023-10-05T21:15:14.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.078+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x7ff4dc030020 2023-10-05T21:15:14.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.078+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e0006070 con 0x7ff4dc030020 2023-10-05T21:15:14.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.078+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x55df48e19170 2023-10-05T21:15:14.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.078+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff4dc036070 con 0x55df48e19170 2023-10-05T21:15:14.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.078+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x55df48de33a0 2023-10-05T21:15:14.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.079+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.079+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x7ff4e000d8e0 2023-10-05T21:15:14.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.079+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e400a570 con 0x7ff4e000d8e0 2023-10-05T21:15:14.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.079+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x55df48de33a0 2023-10-05T21:15:14.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.079+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.079+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x7ff4dc030020 2023-10-05T21:15:14.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.079+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e0006070 con 0x7ff4dc030020 2023-10-05T21:15:14.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.079+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x55df48e19170 2023-10-05T21:15:14.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.079+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4dc036070 con 0x55df48e19170 2023-10-05T21:15:14.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.079+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x55df48e19170 2023-10-05T21:15:14.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.080+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4dc036070 con 0x55df48e19170 2023-10-05T21:15:14.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.080+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x7ff4e000d8e0 2023-10-05T21:15:14.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.080+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e400a570 con 0x7ff4e000d8e0 2023-10-05T21:15:14.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.080+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x55df48e19170 2023-10-05T21:15:14.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.080+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4dc036070 con 0x55df48e19170 2023-10-05T21:15:14.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.080+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x55df48e19170 2023-10-05T21:15:14.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.080+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4dc036070 con 0x55df48e19170 2023-10-05T21:15:14.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.080+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x55df48de33a0 2023-10-05T21:15:14.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.080+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.080+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x55df48de33a0 2023-10-05T21:15:14.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.081+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.081+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x7ff4e000d8e0 2023-10-05T21:15:14.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.081+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e400a570 con 0x7ff4e000d8e0 2023-10-05T21:15:14.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.081+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x55df48e19170 2023-10-05T21:15:14.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.081+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4dc036070 con 0x55df48e19170 2023-10-05T21:15:14.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.081+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x7ff4dc030020 2023-10-05T21:15:14.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.081+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e0006070 con 0x7ff4dc030020 2023-10-05T21:15:14.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.081+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x55df48de33a0 2023-10-05T21:15:14.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.082+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.082+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x7ff4e000d8e0 2023-10-05T21:15:14.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.082+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e400a570 con 0x7ff4e000d8e0 2023-10-05T21:15:14.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.082+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x55df48e19170 2023-10-05T21:15:14.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.082+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4dc036070 con 0x55df48e19170 2023-10-05T21:15:14.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.082+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x7ff4e000d8e0 2023-10-05T21:15:14.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.082+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e400a570 con 0x7ff4e000d8e0 2023-10-05T21:15:14.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.082+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x7ff4dc030020 2023-10-05T21:15:14.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.083+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e0006070 con 0x7ff4dc030020 2023-10-05T21:15:14.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.083+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x55df48e19170 2023-10-05T21:15:14.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.083+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4dc036070 con 0x55df48e19170 2023-10-05T21:15:14.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.083+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x7ff4e000d8e0 2023-10-05T21:15:14.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.083+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e400a570 con 0x7ff4e000d8e0 2023-10-05T21:15:14.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.083+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x55df48de33a0 2023-10-05T21:15:14.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.083+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.083+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d500 con 0x7ff4dc030020 2023-10-05T21:15:14.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.084+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e0006070 con 0x7ff4dc030020 2023-10-05T21:15:14.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.084+0000 7ff4f63dd680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:14.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.084+0000 7ff4f63dd680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:14.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.084+0000 7ff4f63dd680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:14.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.084+0000 7ff4f63dd680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:14.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.084+0000 7ff4f63dd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.084+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1c420 con 0x55df48de33a0 2023-10-05T21:15:14.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.084+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.084+0000 7ff4f63dd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.084+0000 7ff4f63dd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.084+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1c820 con 0x55df48de33a0 2023-10-05T21:15:14.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.084+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.084+0000 7ff4f63dd680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.084+0000 7ff4f63dd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.084+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d990 con 0x55df48de33a0 2023-10-05T21:15:14.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.084+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.084+0000 7ff4f63dd680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:14.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.084+0000 7ff4f63dd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.084+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1dd40 con 0x55df48e19170 2023-10-05T21:15:14.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.084+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7ff4dc036070 con 0x55df48e19170 2023-10-05T21:15:14.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.084+0000 7ff4f63dd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.084+0000 7ff4f63dd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.085+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1e0f0 con 0x55df48de33a0 2023-10-05T21:15:14.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.085+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.085+0000 7ff4f63dd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.085+0000 7ff4f63dd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.085+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1e0f0 con 0x55df48de33a0 2023-10-05T21:15:14.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.085+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.085+0000 7ff4f63dd680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.085+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1e0f0 con 0x55df48e19170 2023-10-05T21:15:14.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.085+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4dc036070 con 0x55df48e19170 2023-10-05T21:15:14.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.085+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1e0f0 con 0x7ff4dc030020 2023-10-05T21:15:14.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.085+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e0006070 con 0x7ff4dc030020 2023-10-05T21:15:14.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.085+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1e0f0 con 0x7ff4e000d8e0 2023-10-05T21:15:14.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.086+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e400a570 con 0x7ff4e000d8e0 2023-10-05T21:15:14.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.086+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d990 con 0x55df48de33a0 2023-10-05T21:15:14.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.086+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.086+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d990 con 0x55df48de33a0 2023-10-05T21:15:14.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.086+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.086+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d990 con 0x7ff4e000d8e0 2023-10-05T21:15:14.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.087+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e400a570 con 0x7ff4e000d8e0 2023-10-05T21:15:14.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.087+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d990 con 0x7ff4e000d8e0 2023-10-05T21:15:14.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.087+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e400a570 con 0x7ff4e000d8e0 2023-10-05T21:15:14.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.087+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d990 con 0x7ff4dc030020 2023-10-05T21:15:14.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.087+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e0006070 con 0x7ff4dc030020 2023-10-05T21:15:14.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.087+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d990 con 0x55df48e19170 2023-10-05T21:15:14.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.087+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff4dc036070 con 0x55df48e19170 2023-10-05T21:15:14.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.087+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d990 con 0x55df48de33a0 2023-10-05T21:15:14.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.087+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.087+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d990 con 0x7ff4e000d8e0 2023-10-05T21:15:14.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.088+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e400a570 con 0x7ff4e000d8e0 2023-10-05T21:15:14.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.088+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d990 con 0x55df48de33a0 2023-10-05T21:15:14.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.088+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.088+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d990 con 0x7ff4dc030020 2023-10-05T21:15:14.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.088+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e0006070 con 0x7ff4dc030020 2023-10-05T21:15:14.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.088+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d990 con 0x55df48e19170 2023-10-05T21:15:14.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.088+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4dc036070 con 0x55df48e19170 2023-10-05T21:15:14.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.088+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d990 con 0x55df48e19170 2023-10-05T21:15:14.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.088+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4dc036070 con 0x55df48e19170 2023-10-05T21:15:14.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.088+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d990 con 0x7ff4e000d8e0 2023-10-05T21:15:14.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.089+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e400a570 con 0x7ff4e000d8e0 2023-10-05T21:15:14.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.089+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d990 con 0x55df48e19170 2023-10-05T21:15:14.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.089+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4dc036070 con 0x55df48e19170 2023-10-05T21:15:14.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.089+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d990 con 0x55df48e19170 2023-10-05T21:15:14.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.089+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4dc036070 con 0x55df48e19170 2023-10-05T21:15:14.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.089+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d990 con 0x55df48de33a0 2023-10-05T21:15:14.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.089+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.089+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d990 con 0x55df48de33a0 2023-10-05T21:15:14.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.089+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.089+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d990 con 0x7ff4e000d8e0 2023-10-05T21:15:14.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.090+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e400a570 con 0x7ff4e000d8e0 2023-10-05T21:15:14.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.090+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d990 con 0x55df48e19170 2023-10-05T21:15:14.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.090+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4dc036070 con 0x55df48e19170 2023-10-05T21:15:14.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.090+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d990 con 0x7ff4dc030020 2023-10-05T21:15:14.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.090+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e0006070 con 0x7ff4dc030020 2023-10-05T21:15:14.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.090+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d990 con 0x55df48de33a0 2023-10-05T21:15:14.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.090+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.090+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d990 con 0x7ff4e000d8e0 2023-10-05T21:15:14.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.091+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e400a570 con 0x7ff4e000d8e0 2023-10-05T21:15:14.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.091+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d990 con 0x55df48e19170 2023-10-05T21:15:14.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.091+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4dc036070 con 0x55df48e19170 2023-10-05T21:15:14.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.091+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d990 con 0x7ff4e000d8e0 2023-10-05T21:15:14.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.091+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e400a570 con 0x7ff4e000d8e0 2023-10-05T21:15:14.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.091+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d990 con 0x7ff4dc030020 2023-10-05T21:15:14.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.091+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e0006070 con 0x7ff4dc030020 2023-10-05T21:15:14.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.091+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d990 con 0x55df48e19170 2023-10-05T21:15:14.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.091+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4dc036070 con 0x55df48e19170 2023-10-05T21:15:14.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.091+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d990 con 0x7ff4e000d8e0 2023-10-05T21:15:14.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.092+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e400a570 con 0x7ff4e000d8e0 2023-10-05T21:15:14.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.092+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d990 con 0x55df48de33a0 2023-10-05T21:15:14.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.092+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.092+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1d990 con 0x7ff4dc030020 2023-10-05T21:15:14.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.092+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4e0006070 con 0x7ff4dc030020 2023-10-05T21:15:14.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.092+0000 7ff4f63dd680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:14.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.092+0000 7ff4f63dd680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:14.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.092+0000 7ff4f63dd680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:14.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.092+0000 7ff4f63dd680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:14.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.092+0000 7ff4f63dd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.092+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1e0f0 con 0x55df48de33a0 2023-10-05T21:15:14.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.092+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.092+0000 7ff4f63dd680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.092+0000 7ff4f63dd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.092+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1e4f0 con 0x55df48e19170 2023-10-05T21:15:14.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.093+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff4dc036070 con 0x55df48e19170 2023-10-05T21:15:14.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.093+0000 7ff4f63dd680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:14.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.093+0000 7ff4f63dd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.093+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1ede0 con 0x55df48de33a0 2023-10-05T21:15:14.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.093+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.093+0000 7ff4f63dd680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.093+0000 7ff4f63dd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.093+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1ede0 con 0x55df48de33a0 2023-10-05T21:15:14.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.093+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.093+0000 7ff4f63dd680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:14.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.093+0000 7ff4f63dd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.093+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1ede0 con 0x7ff4e000d8e0 2023-10-05T21:15:14.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.093+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7ff4e400a570 con 0x7ff4e000d8e0 2023-10-05T21:15:14.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.093+0000 7ff4f63dd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.093+0000 7ff4f63dd680 20 zone default found 2023-10-05T21:15:14.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.093+0000 7ff4f63dd680 4 Realm: () 2023-10-05T21:15:14.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.093+0000 7ff4f63dd680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:14.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.093+0000 7ff4f63dd680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:14.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.093+0000 7ff4f63dd680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:14.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.093+0000 7ff4f63dd680 20 zonegroup default 2023-10-05T21:15:14.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.093+0000 7ff4f63dd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.093+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1ede0 con 0x7ff4e000d8e0 2023-10-05T21:15:14.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.094+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff4e400a570 con 0x7ff4e000d8e0 2023-10-05T21:15:14.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.094+0000 7ff4f63dd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.094+0000 7ff4f63dd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.094+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e20760 con 0x55df48e19170 2023-10-05T21:15:14.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.094+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff4dc036070 con 0x55df48e19170 2023-10-05T21:15:14.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.094+0000 7ff4f63dd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.094+0000 7ff4f63dd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.094+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e20b10 con 0x55df48e19170 2023-10-05T21:15:14.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.094+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff4dc036070 con 0x55df48e19170 2023-10-05T21:15:14.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.094+0000 7ff4f63dd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.094+0000 7ff4f63dd680 20 started sync module instance, tier type = 2023-10-05T21:15:14.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.094+0000 7ff4f63dd680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:14.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.094+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e1fe70 con 0x7ff4dc030020 2023-10-05T21:15:14.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.095+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e0006070 con 0x7ff4dc030020 2023-10-05T21:15:14.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.095+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94417488839280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e21450 con 0x7ff4dc030020 2023-10-05T21:15:14.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.095+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e21cf0 con 0x55df48de33a0 2023-10-05T21:15:14.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.096+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94417488839280] v29'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e0006070 con 0x7ff4dc030020 2023-10-05T21:15:14.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.096+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.096+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94417488844800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e22140 con 0x55df48de33a0 2023-10-05T21:15:14.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.096+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e229e0 con 0x55df48e19170 2023-10-05T21:15:14.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.097+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4dc036070 con 0x55df48e19170 2023-10-05T21:15:14.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.097+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94417488844800] v29'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.097+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94417488847488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e232d0 con 0x55df48e19170 2023-10-05T21:15:14.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.097+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e23b70 con 0x7ff4dc030020 2023-10-05T21:15:14.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.098+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94417488847488] v29'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4dc036070 con 0x55df48e19170 2023-10-05T21:15:14.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.098+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e0006070 con 0x7ff4dc030020 2023-10-05T21:15:14.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.098+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94417488850400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e23720 con 0x7ff4dc030020 2023-10-05T21:15:14.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.098+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e24580 con 0x55df48de33a0 2023-10-05T21:15:14.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.098+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.098+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94417488855744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e24db0 con 0x55df48de33a0 2023-10-05T21:15:14.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.098+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e259b0 con 0x7ff4e000d8e0 2023-10-05T21:15:14.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.098+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94417488850400] v29'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e0006070 con 0x7ff4dc030020 2023-10-05T21:15:14.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.099+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94417488855744] v29'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.099+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e400a570 con 0x7ff4e000d8e0 2023-10-05T21:15:14.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.099+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94417488860224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e25970 con 0x7ff4e000d8e0 2023-10-05T21:15:14.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.099+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e24930 con 0x7ff4e000d8e0 2023-10-05T21:15:14.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.100+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94417488860224] v29'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e400a570 con 0x7ff4e000d8e0 2023-10-05T21:15:14.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.100+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e400a570 con 0x7ff4e000d8e0 2023-10-05T21:15:14.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.100+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94417488861552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e262b0 con 0x7ff4e000d8e0 2023-10-05T21:15:14.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.100+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e26cc0 con 0x7ff4e000d8e0 2023-10-05T21:15:14.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.100+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94417488861552] v29'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e400a570 con 0x7ff4e000d8e0 2023-10-05T21:15:14.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.100+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e400a570 con 0x7ff4e000d8e0 2023-10-05T21:15:14.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.100+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94417488863216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e26cc0 con 0x7ff4e000d8e0 2023-10-05T21:15:14.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.100+0000 7ff4f63dd680 20 add_watcher() i=0 2023-10-05T21:15:14.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.100+0000 7ff4f63dd680 20 add_watcher() i=1 2023-10-05T21:15:14.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.100+0000 7ff4f63dd680 20 add_watcher() i=2 2023-10-05T21:15:14.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.100+0000 7ff4f63dd680 20 add_watcher() i=3 2023-10-05T21:15:14.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.100+0000 7ff4f63dd680 20 add_watcher() i=4 2023-10-05T21:15:14.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.100+0000 7ff4f63dd680 20 add_watcher() i=5 2023-10-05T21:15:14.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.100+0000 7ff4f63dd680 20 add_watcher() i=6 2023-10-05T21:15:14.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.101+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94417488863216] v29'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e400a570 con 0x7ff4e000d8e0 2023-10-05T21:15:14.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.101+0000 7ff4f63dd680 20 add_watcher() i=7 2023-10-05T21:15:14.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.101+0000 7ff4f63dd680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:14.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.101+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e29f50 con 0x55df48de33a0 2023-10-05T21:15:14.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.101+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.101+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94417488865600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e27280 con 0x55df48de33a0 2023-10-05T21:15:14.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.102+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94417488865600] v29'70 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.102+0000 7ff4ba7e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:14.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.102+0000 7ff4f63dd680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:14.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.102+0000 7ff4f63dd680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:14.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.102+0000 7ff4f63dd680 1 Processor -- start 2023-10-05T21:15:14.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.102+0000 7ff4f63dd680 1 -- start start 2023-10-05T21:15:14.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.103+0000 7ff4f63dd680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48e33cc0 0x55df48e340d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.103+0000 7ff4f63dd680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df48e346e0 con 0x55df48e33cc0 2023-10-05T21:15:14.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.103+0000 7ff4e8cb4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48e33cc0 0x55df48e340d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.103+0000 7ff4e8cb4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48e33cc0 0x55df48e340d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49774/0 (socket says 172.21.15.153:49774) 2023-10-05T21:15:14.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.103+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/3160930497 learned_addr learned my addr 172.21.15.153:0/3160930497 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:14.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.103+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/3160930497 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df48e34bc0 con 0x55df48e33cc0 2023-10-05T21:15:14.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.103+0000 7ff4e8cb4700 1 --2- 172.21.15.153:0/3160930497 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48e33cc0 0x55df48e340d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55df48e1bed0 tx=0x7ff4e0006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65bc4b90c31a79de server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.103+0000 7ff4b9fe3700 1 -- 172.21.15.153:0/3160930497 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4e0023040 con 0x55df48e33cc0 2023-10-05T21:15:14.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.103+0000 7ff4b9fe3700 1 -- 172.21.15.153:0/3160930497 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e0024040 con 0x55df48e33cc0 2023-10-05T21:15:14.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.103+0000 7ff4b9fe3700 1 -- 172.21.15.153:0/3160930497 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4e0013040 con 0x55df48e33cc0 2023-10-05T21:15:14.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.104+0000 7ff4f63dd680 1 -- 172.21.15.153:0/3160930497 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48e33cc0 msgr2=0x55df48e340d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.104+0000 7ff4f63dd680 1 --2- 172.21.15.153:0/3160930497 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48e33cc0 0x55df48e340d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55df48e1bed0 tx=0x7ff4e0006000 comp rx=0 tx=0).stop 2023-10-05T21:15:14.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.104+0000 7ff4f63dd680 1 -- 172.21.15.153:0/3160930497 shutdown_connections 2023-10-05T21:15:14.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.104+0000 7ff4f63dd680 1 --2- 172.21.15.153:0/3160930497 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48e33cc0 0x55df48e340d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.104+0000 7ff4f63dd680 1 -- 172.21.15.153:0/3160930497 >> 172.21.15.153:0/3160930497 conn(0x55df48e2ffc0 msgr2=0x55df48e2e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.104+0000 7ff4f63dd680 1 -- 172.21.15.153:0/3160930497 shutdown_connections 2023-10-05T21:15:14.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.104+0000 7ff4f63dd680 1 -- 172.21.15.153:0/3160930497 wait complete. 2023-10-05T21:15:14.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.104+0000 7ff4f63dd680 1 Processor -- start 2023-10-05T21:15:14.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.104+0000 7ff4f63dd680 1 -- start start 2023-10-05T21:15:14.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.105+0000 7ff4f63dd680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48e33cc0 0x55df48e3a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.105+0000 7ff4f63dd680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df48e3aee0 con 0x55df48e33cc0 2023-10-05T21:15:14.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.105+0000 7ff4e8cb4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48e33cc0 0x55df48e3a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.105+0000 7ff4e8cb4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48e33cc0 0x55df48e3a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49790/0 (socket says 172.21.15.153:49790) 2023-10-05T21:15:14.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.105+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/714154824 learned_addr learned my addr 172.21.15.153:0/714154824 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:14.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.105+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/714154824 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e000ed20 con 0x55df48e33cc0 2023-10-05T21:15:14.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.105+0000 7ff4e8cb4700 1 --2- 172.21.15.153:0/714154824 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48e33cc0 0x55df48e3a9a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55df48e18160 tx=0x7ff4e0030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.105+0000 7ff42bfff700 1 -- 172.21.15.153:0/714154824 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4e0023040 con 0x55df48e33cc0 2023-10-05T21:15:14.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.105+0000 7ff42bfff700 1 -- 172.21.15.153:0/714154824 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e001e570 con 0x55df48e33cc0 2023-10-05T21:15:14.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.105+0000 7ff4f63dd680 1 -- 172.21.15.153:0/714154824 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55df48e3b0e0 con 0x55df48e33cc0 2023-10-05T21:15:14.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.105+0000 7ff42bfff700 1 -- 172.21.15.153:0/714154824 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4e001e700 con 0x55df48e33cc0 2023-10-05T21:15:14.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.105+0000 7ff4f63dd680 1 -- 172.21.15.153:0/714154824 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55df48e3b530 con 0x55df48e33cc0 2023-10-05T21:15:14.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.106+0000 7ff42bfff700 1 -- 172.21.15.153:0/714154824 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7ff4e001e860 con 0x55df48e33cc0 2023-10-05T21:15:14.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.106+0000 7ff42bfff700 1 --2- 172.21.15.153:0/714154824 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff430034190 0x7ff430036640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.106+0000 7ff42bfff700 1 -- 172.21.15.153:0/714154824 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7ff4e004fb00 con 0x55df48e33cc0 2023-10-05T21:15:14.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.106+0000 7ff4e9cb6700 1 --2- 172.21.15.153:0/714154824 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff430034190 0x7ff430036640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.106+0000 7ff4f63dd680 5 note: GC not initialized 2023-10-05T21:15:14.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.107+0000 7ff4e9cb6700 1 --2- 172.21.15.153:0/714154824 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff430034190 0x7ff430036640 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55df48e29f80 tx=0x7ff4e4037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.107+0000 7ff4297fa700 20 reqs_thread_entry: start 2023-10-05T21:15:14.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.107+0000 7ff422ffd700 20 reqs_thread_entry: start 2023-10-05T21:15:14.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.107+0000 7ff4f63dd680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:14.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.108+0000 7ff4f63dd680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:14.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.108+0000 7ff4217fa700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:44 2023 2023-10-05T21:15:14.140 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:14.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.108+0000 7ff420ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:14.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.108+0000 7ff4f63dd680 20 get_system_obj_state: rctx=0x7ffe299c8358 obj=default.rgw.meta:users.uid:foo state=0x55df48c95240 s->prefetch_data=0 2023-10-05T21:15:14.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.108+0000 7ff4f63dd680 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T21:15:14.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.108+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48ea0290 con 0x55df48de33a0 2023-10-05T21:15:14.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.108+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.108+0000 7ff4f63dd680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T21:15:14.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.108+0000 7ff4f63dd680 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:14.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.108+0000 7ff4f63dd680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:14.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.108+0000 7ff4f63dd680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:14.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.108+0000 7ff4f63dd680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:14.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.108+0000 7ff4f63dd680 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:14.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.108+0000 7ff4f63dd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.108+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48ea27c0 con 0x55df48de33a0 2023-10-05T21:15:14.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.108+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.108+0000 7ff4f63dd680 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T21:15:14.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.108+0000 7ff4f63dd680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T21:15:14.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.108+0000 7ff4f63dd680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:14.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.108+0000 7ff4f63dd680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:14.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.108+0000 7ff4f63dd680 20 get_system_obj_state: rctx=0x7ffe299c7b88 obj=default.rgw.meta:users.swift:foo:foo1 state=0x55df48c95240 s->prefetch_data=0 2023-10-05T21:15:14.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.108+0000 7ff4f63dd680 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2023-10-05T21:15:14.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.108+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:104 8.8 8:17d68d04:users.swift::foo%3afoo1:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e9fda0 con 0x55df48de33a0 2023-10-05T21:15:14.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.109+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(104 foo:foo1 [getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 194+0+0 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.109+0000 7ff4f63dd680 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2023-10-05T21:15:14.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.109+0000 7ff4f63dd680 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2023-10-05T21:15:14.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.109+0000 7ff4f63dd680 20 get_system_obj_state: rctx=0x7ffe299c8238 obj=default.rgw.meta:users.swift:foo:foo1 state=0x55df48c95240 s->prefetch_data=0 2023-10-05T21:15:14.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.109+0000 7ff4f63dd680 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2023-10-05T21:15:14.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.109+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:105 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~513 in=513b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48ea11b0 con 0x55df48de33a0 2023-10-05T21:15:14.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.109+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(105 foo [delete,create,call,writefull 0~513] v29'6 uv6 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.109+0000 7ff4f63dd680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T21:15:14.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.109+0000 7ff4f63dd680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:14.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.110+0000 7ff4f63dd680 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T21:15:14.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.110+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [notify cookie 94417489371552 in=701b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48ea3e70 con 0x55df48de33a0 2023-10-05T21:15:14.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.110+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== watch-notify(notify (1) cookie 94417488855744 notify 124554051589 ret 0) v3 ==== 731+0+0 (crc 0 0 0) 0x7ff4e40291f0 con 0x55df48de33a0 2023-10-05T21:15:14.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.110+0000 7ff4daffd700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051589 cookie 94417488855744 notifier 4334 bl.length()=689 2023-10-05T21:15:14.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.110+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(106 notify.4 [notify cookie 94417489371552 out=8b] v0'0 uv54 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.110+0000 7ff4daffd700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T21:15:14.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.110+0000 7ff4daffd700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:14.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.110+0000 7ff4daffd700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7ff4c8003d90 con 0x55df48de33a0 2023-10-05T21:15:14.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.110+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== osd_op_reply(107 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.110+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 42 ==== watch-notify(notify_complete (2) cookie 94417489371552 notify 124554051589 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7ff4e402d040 con 0x55df48de33a0 2023-10-05T21:15:14.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.110+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:108 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48ea21a0 con 0x55df48de33a0 2023-10-05T21:15:14.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.111+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 43 ==== osd_op_reply(108 foo:foo1 [delete,create,writefull 0~7] v29'1 uv1 ondisk = 0) v8 ==== 236+0+0 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.111+0000 7ff4f63dd680 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2023-10-05T21:15:14.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.111+0000 7ff4f63dd680 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2023-10-05T21:15:14.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.111+0000 7ff4f63dd680 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2023-10-05T21:15:14.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.111+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:109 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94417489371552 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48ea0370 con 0x7ff4dc030020 2023-10-05T21:15:14.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.111+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== watch-notify(notify (1) cookie 94417488839280 notify 124554051586 ret 0) v3 ==== 208+0+0 (crc 0 0 0) 0x55df48e3b530 con 0x7ff4dc030020 2023-10-05T21:15:14.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.111+0000 7ff4daffd700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051586 cookie 94417488839280 notifier 4334 bl.length()=166 2023-10-05T21:15:14.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.111+0000 7ff4daffd700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2023-10-05T21:15:14.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.111+0000 7ff4daffd700 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2023-10-05T21:15:14.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.111+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(109 notify.0 [notify cookie 94417489371552 out=8b] v0'0 uv54 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff4e0006070 con 0x7ff4dc030020 2023-10-05T21:15:14.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.111+0000 7ff4daffd700 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:110 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7ff4c8003d90 con 0x7ff4dc030020 2023-10-05T21:15:14.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.112+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(110 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e0006070 con 0x7ff4dc030020 2023-10-05T21:15:14.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.112+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== watch-notify(notify_complete (2) cookie 94417489371552 notify 124554051586 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55df48e3b0e0 con 0x7ff4dc030020 2023-10-05T21:15:14.145 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:14.145 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "foo", 2023-10-05T21:15:14.145 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Foo", 2023-10-05T21:15:14.146 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "foo@foo.com", 2023-10-05T21:15:14.146 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2023-10-05T21:15:14.146 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 4, 2023-10-05T21:15:14.146 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [ 2023-10-05T21:15:14.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:14.146 INFO:teuthology.orchestra.run.smithi153.stdout: "id": "foo:foo1", 2023-10-05T21:15:14.146 INFO:teuthology.orchestra.run.smithi153.stdout: "permissions": "full-control" 2023-10-05T21:15:14.146 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:14.146 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:14.146 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2023-10-05T21:15:14.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:14.147 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:14.147 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:14.147 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T21:15:14.147 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:14.147 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:14.147 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [ 2023-10-05T21:15:14.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:14.147 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo:foo1", 2023-10-05T21:15:14.147 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "CQcUEFJaBHqvZa5iaAHjmCCeAv161RZLQXCU8SU5" 2023-10-05T21:15:14.147 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:14.147 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:14.147 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2023-10-05T21:15:14.148 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2023-10-05T21:15:14.148 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2023-10-05T21:15:14.148 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2023-10-05T21:15:14.148 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2023-10-05T21:15:14.148 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:15:14.148 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:14.148 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:14.148 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:14.148 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:14.148 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:14.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:14.148 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2023-10-05T21:15:14.149 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:14.149 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:14.149 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:14.149 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:14.149 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:14.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:14.149 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2023-10-05T21:15:14.149 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2023-10-05T21:15:14.149 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [] 2023-10-05T21:15:14.149 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:14.149 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:15:14.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.112+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:111 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94417488839280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e5ea80 con 0x7ff4dc030020 2023-10-05T21:15:14.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.113+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== osd_op_reply(111 notify.0 [watch unwatch cookie 94417488839280] v29'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e0006070 con 0x7ff4dc030020 2023-10-05T21:15:14.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.113+0000 7ff4f63dd680 20 remove_watcher() i=0 2023-10-05T21:15:14.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.113+0000 7ff4f63dd680 2 removed watcher, disabling cache 2023-10-05T21:15:14.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.113+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:112 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94417488844800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e20270 con 0x55df48de33a0 2023-10-05T21:15:14.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.114+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 44 ==== osd_op_reply(112 notify.1 [watch unwatch cookie 94417488844800] v29'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.114+0000 7ff4f63dd680 20 remove_watcher() i=1 2023-10-05T21:15:14.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.114+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:113 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94417488847488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e20270 con 0x55df48e19170 2023-10-05T21:15:14.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.115+0000 7ff4e94b5700 1 -- 172.21.15.153:0/2448784669 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(113 notify.2 [watch unwatch cookie 94417488847488] v29'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4dc036070 con 0x55df48e19170 2023-10-05T21:15:14.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.115+0000 7ff4f63dd680 20 remove_watcher() i=2 2023-10-05T21:15:14.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.115+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:114 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94417488850400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e22280 con 0x7ff4dc030020 2023-10-05T21:15:14.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.115+0000 7ff4e8cb4700 1 -- 172.21.15.153:0/2448784669 <== osd.2 v2:172.21.15.153:6807/140454 22 ==== osd_op_reply(114 notify.3 [watch unwatch cookie 94417488850400] v29'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e0006070 con 0x7ff4dc030020 2023-10-05T21:15:14.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.115+0000 7ff4f63dd680 20 remove_watcher() i=3 2023-10-05T21:15:14.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.115+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:115 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94417488855744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e20270 con 0x55df48de33a0 2023-10-05T21:15:14.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.116+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 45 ==== osd_op_reply(115 notify.4 [watch unwatch cookie 94417488855744] v29'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.116+0000 7ff4f63dd680 20 remove_watcher() i=4 2023-10-05T21:15:14.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.116+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:116 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94417488860224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e22280 con 0x7ff4e000d8e0 2023-10-05T21:15:14.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.117+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(116 notify.5 [watch unwatch cookie 94417488860224] v29'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e400a570 con 0x7ff4e000d8e0 2023-10-05T21:15:14.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.117+0000 7ff4f63dd680 20 remove_watcher() i=5 2023-10-05T21:15:14.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.117+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:117 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94417488861552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48e20270 con 0x7ff4e000d8e0 2023-10-05T21:15:14.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.118+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(117 notify.6 [watch unwatch cookie 94417488861552] v29'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e400a570 con 0x7ff4e000d8e0 2023-10-05T21:15:14.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.118+0000 7ff4f63dd680 20 remove_watcher() i=6 2023-10-05T21:15:14.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.118+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:118 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94417488863216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48ea2250 con 0x7ff4e000d8e0 2023-10-05T21:15:14.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.118+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(118 notify.7 [watch unwatch cookie 94417488863216] v29'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4e400a570 con 0x7ff4e000d8e0 2023-10-05T21:15:14.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.118+0000 7ff4f63dd680 20 remove_watcher() i=7 2023-10-05T21:15:14.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.119+0000 7ff4ba7e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:14.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.119+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:119 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94417488865600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df48ea2250 con 0x55df48de33a0 2023-10-05T21:15:14.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.120+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 <== osd.1 v2:172.21.15.153:6816/140456 46 ==== osd_op_reply(119 data_loggenerations_metadata [watch unwatch cookie 94417488865600] v29'71 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff4e400a570 con 0x55df48de33a0 2023-10-05T21:15:14.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.120+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ff4e000d8e0 msgr2=0x7ff4e000c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.120+0000 7ff4f63dd680 1 --2- 172.21.15.153:0/2448784669 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ff4e000d8e0 0x7ff4e000c360 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.120+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55df48de33a0 msgr2=0x55df48e16b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.120+0000 7ff4f63dd680 1 --2- 172.21.15.153:0/2448784669 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55df48de33a0 0x55df48e16b20 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.120+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ff4dc030020 msgr2=0x7ff4dc049890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.120+0000 7ff4f63dd680 1 --2- 172.21.15.153:0/2448784669 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ff4dc030020 0x7ff4dc049890 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.120+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55df48e19170 msgr2=0x55df48e1b550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.120+0000 7ff4f63dd680 1 --2- 172.21.15.153:0/2448784669 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55df48e19170 0x55df48e1b550 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.120+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff4cc034140 msgr2=0x7ff4cc0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.120+0000 7ff4f63dd680 1 --2- 172.21.15.153:0/2448784669 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff4cc034140 0x7ff4cc0365f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00011e0 tx=0x7ff4e0001340 comp rx=0 tx=0).stop 2023-10-05T21:15:14.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.120+0000 7ff4e9cb6700 1 -- 172.21.15.153:0/2448784669 reap_dead start 2023-10-05T21:15:14.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.120+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48de2a50 msgr2=0x55df48e0ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.120+0000 7ff4f63dd680 1 --2- 172.21.15.153:0/2448784669 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48de2a50 0x55df48e0ad30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc01f040 tx=0x7ff4dc01d000 comp rx=0 tx=0).stop 2023-10-05T21:15:14.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.120+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 shutdown_connections 2023-10-05T21:15:14.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.120+0000 7ff4f63dd680 1 --2- 172.21.15.153:0/2448784669 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48de2a50 0x55df48e0ad30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.120+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 >> 172.21.15.153:0/2448784669 conn(0x55df48ddc310 msgr2=0x55df48dfdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.120+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 shutdown_connections 2023-10-05T21:15:14.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.120+0000 7ff4f63dd680 1 -- 172.21.15.153:0/2448784669 wait complete. 2023-10-05T21:15:14.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.121+0000 7ff4f63dd680 1 -- 172.21.15.153:0/714154824 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff430034190 msgr2=0x7ff430036640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.121+0000 7ff4f63dd680 1 --2- 172.21.15.153:0/714154824 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff430034190 0x7ff430036640 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55df48e29f80 tx=0x7ff4e4037450 comp rx=0 tx=0).stop 2023-10-05T21:15:14.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.121+0000 7ff4f63dd680 1 -- 172.21.15.153:0/714154824 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48e33cc0 msgr2=0x55df48e3a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.121+0000 7ff4f63dd680 1 --2- 172.21.15.153:0/714154824 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48e33cc0 0x55df48e3a9a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55df48e18160 tx=0x7ff4e0030000 comp rx=0 tx=0).stop 2023-10-05T21:15:14.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.121+0000 7ff4f63dd680 1 -- 172.21.15.153:0/714154824 shutdown_connections 2023-10-05T21:15:14.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.121+0000 7ff4f63dd680 1 --2- 172.21.15.153:0/714154824 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff430034190 0x7ff430036640 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.121+0000 7ff4f63dd680 1 --2- 172.21.15.153:0/714154824 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df48e33cc0 0x55df48e3a9a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.121+0000 7ff4f63dd680 1 -- 172.21.15.153:0/714154824 >> 172.21.15.153:0/714154824 conn(0x55df48e2ffc0 msgr2=0x55df48e2e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.121+0000 7ff4f63dd680 1 -- 172.21.15.153:0/714154824 shutdown_connections 2023-10-05T21:15:14.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.121+0000 7ff4f63dd680 1 -- 172.21.15.153:0/714154824 wait complete. 2023-10-05T21:15:14.159 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'CQcUEFJaBHqvZa5iaAHjmCCeAv161RZLQXCU8SU5'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:15:14.160 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2023-10-05T21:15:14.160 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2023-10-05T21:15:14.160 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2023-10-05T21:15:14.208 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:14.208 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:14.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.207+0000 7f1dc6fe7680 1 Processor -- start 2023-10-05T21:15:14.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.207+0000 7f1dc6fe7680 1 -- start start 2023-10-05T21:15:14.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.208+0000 7f1dc6fe7680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x56460268a750 0x56460268cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.208+0000 7f1dc6fe7680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5646025d3930 con 0x5646025fa040 2023-10-05T21:15:14.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.208+0000 7f1dc6fe7680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x564602593db0 con 0x56460268a750 2023-10-05T21:15:14.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.208+0000 7f1db98be700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x56460268a750 0x56460268cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.208+0000 7f1dba0bf700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x5646025fa040 0x564602689030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56288/0 (socket says 172.21.15.153:56288) 2023-10-05T21:15:14.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.208+0000 7f1dba0bf700 1 -- 172.21.15.153:0/2443908256 learned_addr learned my addr 172.21.15.153:0/2443908256 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:14.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.208+0000 7f1db98be700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x56460268a750 0x56460268cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49794/0 (socket says 172.21.15.153:49794) 2023-10-05T21:15:14.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.208+0000 7f1db98be700 1 -- 172.21.15.153:0/2443908256 >> v1:172.21.15.111:6789/0 conn(0x5646025fa040 legacy=0x564602689030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.208+0000 7f1db98be700 1 -- 172.21.15.153:0/2443908256 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56460268e180 con 0x56460268a750 2023-10-05T21:15:14.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.208+0000 7f1db98be700 1 --2- 172.21.15.153:0/2443908256 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56460268a750 0x56460268cb30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1dac00a5d0 tx=0x7f1dac005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f62c26d340a54249 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.209+0000 7f1db90bd700 1 -- 172.21.15.153:0/2443908256 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1dac0086a0 con 0x56460268a750 2023-10-05T21:15:14.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.209+0000 7f1db90bd700 1 -- 172.21.15.153:0/2443908256 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dac008800 con 0x56460268a750 2023-10-05T21:15:14.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.209+0000 7f1db90bd700 1 -- 172.21.15.153:0/2443908256 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1dac008ad0 con 0x56460268a750 2023-10-05T21:15:14.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.209+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/2443908256 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56460268a750 msgr2=0x56460268cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.209+0000 7f1dc6fe7680 1 --2- 172.21.15.153:0/2443908256 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56460268a750 0x56460268cb30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1dac00a5d0 tx=0x7f1dac005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:14.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.209+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/2443908256 shutdown_connections 2023-10-05T21:15:14.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.209+0000 7f1dc6fe7680 1 --2- 172.21.15.153:0/2443908256 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56460268a750 0x56460268cb30 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.209+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/2443908256 >> 172.21.15.153:0/2443908256 conn(0x564602680b20 msgr2=0x564602682f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.209+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/2443908256 shutdown_connections 2023-10-05T21:15:14.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.209+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/2443908256 wait complete. 2023-10-05T21:15:14.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.210+0000 7f1dc6fe7680 1 Processor -- start 2023-10-05T21:15:14.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.210+0000 7f1dc6fe7680 1 -- start start 2023-10-05T21:15:14.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.210+0000 7f1dc6fe7680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5646025fa040 0x5646026a58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.210+0000 7f1dc6fe7680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x564602533ea0 con 0x5646025fa040 2023-10-05T21:15:14.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.210+0000 7f1dba0bf700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5646025fa040 0x5646026a58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.210+0000 7f1dba0bf700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5646025fa040 0x5646026a58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49808/0 (socket says 172.21.15.153:49808) 2023-10-05T21:15:14.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.210+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3672712562 learned_addr learned my addr 172.21.15.153:0/3672712562 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:14.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.210+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3672712562 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dac005cf0 con 0x5646025fa040 2023-10-05T21:15:14.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.211+0000 7f1dba0bf700 1 --2- 172.21.15.153:0/3672712562 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5646025fa040 0x5646026a58c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1db0001c00 tx=0x7f1db00017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa39b552bcb7a72 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.211+0000 7f1dabfff700 1 -- 172.21.15.153:0/3672712562 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1db000bbf0 con 0x5646025fa040 2023-10-05T21:15:14.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.211+0000 7f1dabfff700 1 -- 172.21.15.153:0/3672712562 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db000bd50 con 0x5646025fa040 2023-10-05T21:15:14.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.211+0000 7f1dabfff700 1 -- 172.21.15.153:0/3672712562 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1db000e470 con 0x5646025fa040 2023-10-05T21:15:14.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.211+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3672712562 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5646025fa040 msgr2=0x5646026a58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.211+0000 7f1dc6fe7680 1 --2- 172.21.15.153:0/3672712562 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5646025fa040 0x5646026a58c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1db0001c00 tx=0x7f1db00017b0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.211+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3672712562 shutdown_connections 2023-10-05T21:15:14.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.211+0000 7f1dc6fe7680 1 --2- 172.21.15.153:0/3672712562 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5646025fa040 0x5646026a58c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.211+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3672712562 >> 172.21.15.153:0/3672712562 conn(0x564602680b20 msgr2=0x5646026a1390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.211+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3672712562 shutdown_connections 2023-10-05T21:15:14.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.211+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3672712562 wait complete. 2023-10-05T21:15:14.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.212+0000 7f1dc6fe7680 1 Processor -- start 2023-10-05T21:15:14.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.212+0000 7f1dc6fe7680 1 -- start start 2023-10-05T21:15:14.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.212+0000 7f1dc6fe7680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5646025fa040 0x5646026acd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.212+0000 7f1dc6fe7680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x56460252ac80 con 0x5646025fa040 2023-10-05T21:15:14.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.212+0000 7f1dba0bf700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5646025fa040 0x5646026acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.212+0000 7f1dba0bf700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5646025fa040 0x5646026acd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49822/0 (socket says 172.21.15.153:49822) 2023-10-05T21:15:14.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.212+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 learned_addr learned my addr 172.21.15.153:0/3163114538 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:14.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.212+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646025d3930 con 0x5646025fa040 2023-10-05T21:15:14.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.213+0000 7f1dba0bf700 1 --2- 172.21.15.153:0/3163114538 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5646025fa040 0x5646026acd70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1db00017f0 tx=0x7f1db0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.213+0000 7f1daa7fc700 1 -- 172.21.15.153:0/3163114538 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1db001f070 con 0x5646025fa040 2023-10-05T21:15:14.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.213+0000 7f1daa7fc700 1 -- 172.21.15.153:0/3163114538 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db00197b0 con 0x5646025fa040 2023-10-05T21:15:14.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.213+0000 7f1daa7fc700 1 -- 172.21.15.153:0/3163114538 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1db0019960 con 0x5646025fa040 2023-10-05T21:15:14.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.213+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5646026ad2b0 con 0x5646025fa040 2023-10-05T21:15:14.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.213+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5646026ad780 con 0x5646025fa040 2023-10-05T21:15:14.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.214+0000 7f1daa7fc700 1 -- 172.21.15.153:0/3163114538 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f1db0022020 con 0x5646025fa040 2023-10-05T21:15:14.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.214+0000 7f1dc6fe7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.214+0000 7f1daa7fc700 1 --2- 172.21.15.153:0/3163114538 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1d9c034140 0x7f1d9c0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.214+0000 7f1daa7fc700 1 -- 172.21.15.153:0/3163114538 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f1db0048af0 con 0x5646025fa040 2023-10-05T21:15:14.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.214+0000 7f1db98be700 1 --2- 172.21.15.153:0/3163114538 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1d9c034140 0x7f1d9c0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.214+0000 7f1dc6fe7680 1 --2- 172.21.15.153:0/3163114538 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x56460268a750 0x5646026b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.214+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026b9300 con 0x56460268a750 2023-10-05T21:15:14.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.214+0000 7f1dba8c0700 1 --2- 172.21.15.153:0/3163114538 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x56460268a750 0x5646026b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.214+0000 7f1db98be700 1 --2- 172.21.15.153:0/3163114538 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1d9c034140 0x7f1d9c0365f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1dac003080 tx=0x7f1dac015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.214+0000 7f1dba8c0700 1 --2- 172.21.15.153:0/3163114538 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x56460268a750 0x5646026b8b70 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.215+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.215+0000 7f1dc6fe7680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.215+0000 7f1dc6fe7680 20 realm 2023-10-05T21:15:14.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.215+0000 7f1dc6fe7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.215+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026b6170 con 0x56460268a750 2023-10-05T21:15:14.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.215+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.215+0000 7f1dc6fe7680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.215+0000 7f1dc6fe7680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:14.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.215+0000 7f1dc6fe7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.215+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026b9db0 con 0x56460268a750 2023-10-05T21:15:14.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.215+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.215+0000 7f1dc6fe7680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.215+0000 7f1dc6fe7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.215+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026ba6d0 con 0x56460268a750 2023-10-05T21:15:14.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.215+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.215+0000 7f1dc6fe7680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.215+0000 7f1dc6fe7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.215+0000 7f1dc6fe7680 1 --2- 172.21.15.153:0/3163114538 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5646026baf90 0x5646026bd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.215+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bd9c0 con 0x5646026baf90 2023-10-05T21:15:14.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.215+0000 7f1dba0bf700 1 --2- 172.21.15.153:0/3163114538 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5646026baf90 0x5646026bd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.216+0000 7f1dba0bf700 1 --2- 172.21.15.153:0/3163114538 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5646026baf90 0x5646026bd370 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.216+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f1db0019ac0 con 0x5646026baf90 2023-10-05T21:15:14.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.216+0000 7f1dc6fe7680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:14.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.216+0000 7f1dc6fe7680 20 searching for the correct realm 2023-10-05T21:15:14.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.216+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x5646026baf90 2023-10-05T21:15:14.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.216+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db0019ac0 con 0x5646026baf90 2023-10-05T21:15:14.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.216+0000 7f1dba0bf700 1 --2- 172.21.15.153:0/3163114538 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f1db0016b80 0x7f1db0041460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.216+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x7f1db0016b80 2023-10-05T21:15:14.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.216+0000 7f1db98be700 1 --2- 172.21.15.153:0/3163114538 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f1db0016b80 0x7f1db0041460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.217+0000 7f1db98be700 1 --2- 172.21.15.153:0/3163114538 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f1db0016b80 0x7f1db0041460 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.217+0000 7f1db98be700 1 -- 172.21.15.153:0/3163114538 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dac019040 con 0x7f1db0016b80 2023-10-05T21:15:14.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.217+0000 7f1db98be700 1 --2- 172.21.15.153:0/3163114538 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f1dac007030 0x7f1dac01d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.217+0000 7f1db98be700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x7f1dac007030 2023-10-05T21:15:14.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.217+0000 7f1dba8c0700 1 --2- 172.21.15.153:0/3163114538 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f1dac007030 0x7f1dac01d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.217+0000 7f1dba8c0700 1 --2- 172.21.15.153:0/3163114538 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f1dac007030 0x7f1dac01d420 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.218+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a570 con 0x7f1dac007030 2023-10-05T21:15:14.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.218+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x56460268a750 2023-10-05T21:15:14.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.218+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.218+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x56460268a750 2023-10-05T21:15:14.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.218+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.218+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x7f1dac007030 2023-10-05T21:15:14.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.218+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a570 con 0x7f1dac007030 2023-10-05T21:15:14.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.218+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x7f1dac007030 2023-10-05T21:15:14.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.218+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a570 con 0x7f1dac007030 2023-10-05T21:15:14.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.218+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x7f1db0016b80 2023-10-05T21:15:14.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.219+0000 7f1db98be700 1 -- 172.21.15.153:0/3163114538 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dac019040 con 0x7f1db0016b80 2023-10-05T21:15:14.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.219+0000 7f1db98be700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x5646026baf90 2023-10-05T21:15:14.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.219+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1db0019ac0 con 0x5646026baf90 2023-10-05T21:15:14.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.219+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x56460268a750 2023-10-05T21:15:14.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.219+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.219+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x7f1dac007030 2023-10-05T21:15:14.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.220+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a570 con 0x7f1dac007030 2023-10-05T21:15:14.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.220+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x56460268a750 2023-10-05T21:15:14.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.220+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.220+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x7f1db0016b80 2023-10-05T21:15:14.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.220+0000 7f1db98be700 1 -- 172.21.15.153:0/3163114538 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dac019040 con 0x7f1db0016b80 2023-10-05T21:15:14.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.220+0000 7f1db98be700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x5646026baf90 2023-10-05T21:15:14.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.220+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db0019ac0 con 0x5646026baf90 2023-10-05T21:15:14.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.220+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x5646026baf90 2023-10-05T21:15:14.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.220+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db0019ac0 con 0x5646026baf90 2023-10-05T21:15:14.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.220+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x7f1dac007030 2023-10-05T21:15:14.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.221+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a570 con 0x7f1dac007030 2023-10-05T21:15:14.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.221+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x5646026baf90 2023-10-05T21:15:14.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.221+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db0019ac0 con 0x5646026baf90 2023-10-05T21:15:14.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.221+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x5646026baf90 2023-10-05T21:15:14.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.221+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db0019ac0 con 0x5646026baf90 2023-10-05T21:15:14.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.221+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x56460268a750 2023-10-05T21:15:14.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.221+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.221+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x56460268a750 2023-10-05T21:15:14.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.221+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.222+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x7f1dac007030 2023-10-05T21:15:14.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.222+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a570 con 0x7f1dac007030 2023-10-05T21:15:14.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.222+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x5646026baf90 2023-10-05T21:15:14.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.222+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db0019ac0 con 0x5646026baf90 2023-10-05T21:15:14.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.222+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x7f1db0016b80 2023-10-05T21:15:14.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.222+0000 7f1db98be700 1 -- 172.21.15.153:0/3163114538 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dac019040 con 0x7f1db0016b80 2023-10-05T21:15:14.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.222+0000 7f1db98be700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x56460268a750 2023-10-05T21:15:14.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.223+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.223+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x7f1dac007030 2023-10-05T21:15:14.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.223+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a570 con 0x7f1dac007030 2023-10-05T21:15:14.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.223+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x5646026baf90 2023-10-05T21:15:14.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.223+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db0019ac0 con 0x5646026baf90 2023-10-05T21:15:14.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.223+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x7f1dac007030 2023-10-05T21:15:14.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.223+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a570 con 0x7f1dac007030 2023-10-05T21:15:14.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.223+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x7f1db0016b80 2023-10-05T21:15:14.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.224+0000 7f1db98be700 1 -- 172.21.15.153:0/3163114538 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dac019040 con 0x7f1db0016b80 2023-10-05T21:15:14.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.224+0000 7f1db98be700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x5646026baf90 2023-10-05T21:15:14.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.224+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db0019ac0 con 0x5646026baf90 2023-10-05T21:15:14.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.224+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x7f1dac007030 2023-10-05T21:15:14.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.224+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a570 con 0x7f1dac007030 2023-10-05T21:15:14.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.224+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x56460268a750 2023-10-05T21:15:14.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.224+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.224+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf530 con 0x7f1db0016b80 2023-10-05T21:15:14.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.225+0000 7f1db98be700 1 -- 172.21.15.153:0/3163114538 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dac019040 con 0x7f1db0016b80 2023-10-05T21:15:14.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.225+0000 7f1dc6fe7680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:14.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.225+0000 7f1dc6fe7680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:14.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.225+0000 7f1dc6fe7680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:14.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.225+0000 7f1dc6fe7680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:14.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.225+0000 7f1dc6fe7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.225+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026be480 con 0x56460268a750 2023-10-05T21:15:14.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.225+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.225+0000 7f1dc6fe7680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.225+0000 7f1dc6fe7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.225+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026be880 con 0x56460268a750 2023-10-05T21:15:14.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.225+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.225+0000 7f1dc6fe7680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.225+0000 7f1dc6fe7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.225+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf9c0 con 0x56460268a750 2023-10-05T21:15:14.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.225+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.225+0000 7f1dc6fe7680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:14.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.225+0000 7f1dc6fe7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.225+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bfd70 con 0x5646026baf90 2023-10-05T21:15:14.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.225+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f1db0019ac0 con 0x5646026baf90 2023-10-05T21:15:14.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.225+0000 7f1dc6fe7680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.226+0000 7f1dc6fe7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.226+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c0120 con 0x56460268a750 2023-10-05T21:15:14.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.226+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.226+0000 7f1dc6fe7680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.226+0000 7f1dc6fe7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.226+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c0120 con 0x56460268a750 2023-10-05T21:15:14.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.226+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.226+0000 7f1dc6fe7680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.226+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c1130 con 0x5646026baf90 2023-10-05T21:15:14.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.226+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db0019ac0 con 0x5646026baf90 2023-10-05T21:15:14.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.226+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c1130 con 0x7f1db0016b80 2023-10-05T21:15:14.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.226+0000 7f1db98be700 1 -- 172.21.15.153:0/3163114538 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dac019040 con 0x7f1db0016b80 2023-10-05T21:15:14.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.226+0000 7f1db98be700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c1130 con 0x7f1dac007030 2023-10-05T21:15:14.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.227+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a570 con 0x7f1dac007030 2023-10-05T21:15:14.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.227+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf9c0 con 0x56460268a750 2023-10-05T21:15:14.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.227+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.227+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf9c0 con 0x56460268a750 2023-10-05T21:15:14.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.227+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.227+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf9c0 con 0x7f1dac007030 2023-10-05T21:15:14.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.227+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a570 con 0x7f1dac007030 2023-10-05T21:15:14.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.227+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf9c0 con 0x7f1dac007030 2023-10-05T21:15:14.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.228+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a570 con 0x7f1dac007030 2023-10-05T21:15:14.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.228+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf9c0 con 0x7f1db0016b80 2023-10-05T21:15:14.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.228+0000 7f1db98be700 1 -- 172.21.15.153:0/3163114538 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dac019040 con 0x7f1db0016b80 2023-10-05T21:15:14.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.228+0000 7f1db98be700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf9c0 con 0x5646026baf90 2023-10-05T21:15:14.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.228+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1db0019ac0 con 0x5646026baf90 2023-10-05T21:15:14.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.228+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf9c0 con 0x56460268a750 2023-10-05T21:15:14.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.228+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.228+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf9c0 con 0x7f1dac007030 2023-10-05T21:15:14.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.229+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a570 con 0x7f1dac007030 2023-10-05T21:15:14.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.229+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf9c0 con 0x56460268a750 2023-10-05T21:15:14.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.229+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.229+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf9c0 con 0x7f1db0016b80 2023-10-05T21:15:14.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.229+0000 7f1db98be700 1 -- 172.21.15.153:0/3163114538 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dac019040 con 0x7f1db0016b80 2023-10-05T21:15:14.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.229+0000 7f1db98be700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf9c0 con 0x5646026baf90 2023-10-05T21:15:14.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.229+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db0019ac0 con 0x5646026baf90 2023-10-05T21:15:14.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.229+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf9c0 con 0x5646026baf90 2023-10-05T21:15:14.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.229+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db0019ac0 con 0x5646026baf90 2023-10-05T21:15:14.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.229+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf9c0 con 0x7f1dac007030 2023-10-05T21:15:14.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.230+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a570 con 0x7f1dac007030 2023-10-05T21:15:14.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.230+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf9c0 con 0x5646026baf90 2023-10-05T21:15:14.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.230+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db0019ac0 con 0x5646026baf90 2023-10-05T21:15:14.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.230+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf9c0 con 0x5646026baf90 2023-10-05T21:15:14.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.230+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db0019ac0 con 0x5646026baf90 2023-10-05T21:15:14.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.230+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf9c0 con 0x56460268a750 2023-10-05T21:15:14.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.230+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.230+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf9c0 con 0x56460268a750 2023-10-05T21:15:14.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.230+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.230+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf9c0 con 0x7f1dac007030 2023-10-05T21:15:14.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.231+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a570 con 0x7f1dac007030 2023-10-05T21:15:14.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.231+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf9c0 con 0x5646026baf90 2023-10-05T21:15:14.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.231+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db0019ac0 con 0x5646026baf90 2023-10-05T21:15:14.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.231+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf9c0 con 0x7f1db0016b80 2023-10-05T21:15:14.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.231+0000 7f1db98be700 1 -- 172.21.15.153:0/3163114538 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dac019040 con 0x7f1db0016b80 2023-10-05T21:15:14.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.231+0000 7f1db98be700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf9c0 con 0x56460268a750 2023-10-05T21:15:14.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.231+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.231+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf9c0 con 0x7f1dac007030 2023-10-05T21:15:14.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.232+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a570 con 0x7f1dac007030 2023-10-05T21:15:14.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.232+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf9c0 con 0x5646026baf90 2023-10-05T21:15:14.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.232+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db0019ac0 con 0x5646026baf90 2023-10-05T21:15:14.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.232+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf9c0 con 0x7f1dac007030 2023-10-05T21:15:14.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.233+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a570 con 0x7f1dac007030 2023-10-05T21:15:14.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.233+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf9c0 con 0x7f1db0016b80 2023-10-05T21:15:14.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.233+0000 7f1db98be700 1 -- 172.21.15.153:0/3163114538 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dac019040 con 0x7f1db0016b80 2023-10-05T21:15:14.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.233+0000 7f1db98be700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf9c0 con 0x5646026baf90 2023-10-05T21:15:14.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.233+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db0019ac0 con 0x5646026baf90 2023-10-05T21:15:14.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.233+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf9c0 con 0x7f1dac007030 2023-10-05T21:15:14.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.234+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1db400a570 con 0x7f1dac007030 2023-10-05T21:15:14.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.234+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf9c0 con 0x56460268a750 2023-10-05T21:15:14.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.234+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.234+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026bf9c0 con 0x7f1db0016b80 2023-10-05T21:15:14.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.234+0000 7f1db98be700 1 -- 172.21.15.153:0/3163114538 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1dac019040 con 0x7f1db0016b80 2023-10-05T21:15:14.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.234+0000 7f1dc6fe7680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:14.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.234+0000 7f1dc6fe7680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:14.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.234+0000 7f1dc6fe7680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:14.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.234+0000 7f1dc6fe7680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:14.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.234+0000 7f1dc6fe7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.234+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c0120 con 0x56460268a750 2023-10-05T21:15:14.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.234+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.234+0000 7f1dc6fe7680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.234+0000 7f1dc6fe7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.234+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c04d0 con 0x5646026baf90 2023-10-05T21:15:14.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.234+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f1db0019ac0 con 0x5646026baf90 2023-10-05T21:15:14.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.235+0000 7f1dc6fe7680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:14.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.235+0000 7f1dc6fe7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.235+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026be0b0 con 0x56460268a750 2023-10-05T21:15:14.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.235+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.235+0000 7f1dc6fe7680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.235+0000 7f1dc6fe7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.235+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c0dc0 con 0x56460268a750 2023-10-05T21:15:14.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.235+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.235+0000 7f1dc6fe7680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:14.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.235+0000 7f1dc6fe7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.235+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c0dc0 con 0x7f1dac007030 2023-10-05T21:15:14.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.235+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f1db400a570 con 0x7f1dac007030 2023-10-05T21:15:14.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.235+0000 7f1dc6fe7680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.235+0000 7f1dc6fe7680 20 zone default found 2023-10-05T21:15:14.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.235+0000 7f1dc6fe7680 4 Realm: () 2023-10-05T21:15:14.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.235+0000 7f1dc6fe7680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:14.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.235+0000 7f1dc6fe7680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:14.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.235+0000 7f1dc6fe7680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:14.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.235+0000 7f1dc6fe7680 20 zonegroup default 2023-10-05T21:15:14.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.235+0000 7f1dc6fe7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.235+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c0dc0 con 0x7f1dac007030 2023-10-05T21:15:14.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.235+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1db400a570 con 0x7f1dac007030 2023-10-05T21:15:14.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.235+0000 7f1dc6fe7680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.236+0000 7f1dc6fe7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.236+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c2740 con 0x5646026baf90 2023-10-05T21:15:14.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.236+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1db0019ac0 con 0x5646026baf90 2023-10-05T21:15:14.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.236+0000 7f1dc6fe7680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.236+0000 7f1dc6fe7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.236+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c2af0 con 0x5646026baf90 2023-10-05T21:15:14.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.236+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1db0019ac0 con 0x5646026baf90 2023-10-05T21:15:14.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.236+0000 7f1dc6fe7680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.236+0000 7f1dc6fe7680 20 started sync module instance, tier type = 2023-10-05T21:15:14.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.236+0000 7f1dc6fe7680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:14.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.236+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c22f0 con 0x7f1db0016b80 2023-10-05T21:15:14.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.237+0000 7f1db98be700 1 -- 172.21.15.153:0/3163114538 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1dac019040 con 0x7f1db0016b80 2023-10-05T21:15:14.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.237+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94858688339456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c3390 con 0x7f1db0016b80 2023-10-05T21:15:14.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.237+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c3c30 con 0x56460268a750 2023-10-05T21:15:14.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.237+0000 7f1db98be700 1 -- 172.21.15.153:0/3163114538 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94858688339456] v29'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1dac019040 con 0x7f1db0016b80 2023-10-05T21:15:14.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.238+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.238+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94858688343712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c3c30 con 0x56460268a750 2023-10-05T21:15:14.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.238+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c47f0 con 0x5646026baf90 2023-10-05T21:15:14.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.238+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1db0019ac0 con 0x5646026baf90 2023-10-05T21:15:14.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.238+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94858688343712] v29'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.238+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94858688345920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c3b90 con 0x5646026baf90 2023-10-05T21:15:14.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.238+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c55d0 con 0x7f1db0016b80 2023-10-05T21:15:14.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.239+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94858688345920] v29'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1db0019ac0 con 0x5646026baf90 2023-10-05T21:15:14.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.239+0000 7f1db98be700 1 -- 172.21.15.153:0/3163114538 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1dac019040 con 0x7f1db0016b80 2023-10-05T21:15:14.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.239+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94858688351536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c5ec0 con 0x7f1db0016b80 2023-10-05T21:15:14.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.239+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c67a0 con 0x56460268a750 2023-10-05T21:15:14.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.240+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.240+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94858688356976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c7090 con 0x56460268a750 2023-10-05T21:15:14.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.240+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c7b90 con 0x7f1dac007030 2023-10-05T21:15:14.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.240+0000 7f1db98be700 1 -- 172.21.15.153:0/3163114538 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94858688351536] v29'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1dac019040 con 0x7f1db0016b80 2023-10-05T21:15:14.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.241+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94858688356976] v29'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.241+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1db400a570 con 0x7f1dac007030 2023-10-05T21:15:14.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.241+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94858688362048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c6af0 con 0x7f1dac007030 2023-10-05T21:15:14.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.241+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c8480 con 0x7f1dac007030 2023-10-05T21:15:14.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.241+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94858688362048] v29'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1db400a570 con 0x7f1dac007030 2023-10-05T21:15:14.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.241+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1db400a570 con 0x7f1dac007030 2023-10-05T21:15:14.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.241+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94858688354768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c6af0 con 0x7f1dac007030 2023-10-05T21:15:14.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.241+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c8ac0 con 0x7f1dac007030 2023-10-05T21:15:14.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.242+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94858688354768] v29'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1db400a570 con 0x7f1dac007030 2023-10-05T21:15:14.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.242+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1db400a570 con 0x7f1dac007030 2023-10-05T21:15:14.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.242+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94858688363968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c8a80 con 0x7f1dac007030 2023-10-05T21:15:14.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.242+0000 7f1dc6fe7680 20 add_watcher() i=0 2023-10-05T21:15:14.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.242+0000 7f1dc6fe7680 20 add_watcher() i=1 2023-10-05T21:15:14.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.242+0000 7f1dc6fe7680 20 add_watcher() i=2 2023-10-05T21:15:14.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.242+0000 7f1dc6fe7680 20 add_watcher() i=3 2023-10-05T21:15:14.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.242+0000 7f1dc6fe7680 20 add_watcher() i=4 2023-10-05T21:15:14.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.242+0000 7f1dc6fe7680 20 add_watcher() i=5 2023-10-05T21:15:14.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.242+0000 7f1dc6fe7680 20 add_watcher() i=6 2023-10-05T21:15:14.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.243+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94858688363968] v29'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1db400a570 con 0x7f1dac007030 2023-10-05T21:15:14.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.243+0000 7f1dc6fe7680 20 add_watcher() i=7 2023-10-05T21:15:14.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.243+0000 7f1dc6fe7680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:14.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.243+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026cbec0 con 0x56460268a750 2023-10-05T21:15:14.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.243+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.243+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94858688366432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c9380 con 0x56460268a750 2023-10-05T21:15:14.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.244+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94858688366432] v29'72 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.244+0000 7f1d8bfdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:14.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.244+0000 7f1dc6fe7680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:14.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.244+0000 7f1dc6fe7680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:14.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.244+0000 7f1dc6fe7680 1 Processor -- start 2023-10-05T21:15:14.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.244+0000 7f1dc6fe7680 1 -- start start 2023-10-05T21:15:14.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.244+0000 7f1dc6fe7680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5646026d5ad0 0x5646026d5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.244+0000 7f1dc6fe7680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646026d64f0 con 0x5646026d5ad0 2023-10-05T21:15:14.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.245+0000 7f1db98be700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5646026d5ad0 0x5646026d5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.245+0000 7f1db98be700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5646026d5ad0 0x5646026d5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49826/0 (socket says 172.21.15.153:49826) 2023-10-05T21:15:14.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.245+0000 7f1db98be700 1 -- 172.21.15.153:0/3297672716 learned_addr learned my addr 172.21.15.153:0/3297672716 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:14.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.245+0000 7f1db98be700 1 -- 172.21.15.153:0/3297672716 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646026d69d0 con 0x5646026d5ad0 2023-10-05T21:15:14.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.245+0000 7f1db98be700 1 --2- 172.21.15.153:0/3297672716 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5646026d5ad0 0x5646026d5ee0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x56460268e150 tx=0x7f1dac012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68ffad712fde350 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.245+0000 7f1d8b7de700 1 -- 172.21.15.153:0/3297672716 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1dac01de90 con 0x5646026d5ad0 2023-10-05T21:15:14.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.245+0000 7f1d8b7de700 1 -- 172.21.15.153:0/3297672716 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dac02b450 con 0x5646026d5ad0 2023-10-05T21:15:14.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.245+0000 7f1d8b7de700 1 -- 172.21.15.153:0/3297672716 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1dac02b640 con 0x5646026d5ad0 2023-10-05T21:15:14.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.246+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3297672716 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5646026d5ad0 msgr2=0x5646026d5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.246+0000 7f1dc6fe7680 1 --2- 172.21.15.153:0/3297672716 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5646026d5ad0 0x5646026d5ee0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x56460268e150 tx=0x7f1dac012000 comp rx=0 tx=0).stop 2023-10-05T21:15:14.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.246+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3297672716 shutdown_connections 2023-10-05T21:15:14.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.246+0000 7f1dc6fe7680 1 --2- 172.21.15.153:0/3297672716 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5646026d5ad0 0x5646026d5ee0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.246+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3297672716 >> 172.21.15.153:0/3297672716 conn(0x5646026d1dd0 msgr2=0x5646026cfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.246+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3297672716 shutdown_connections 2023-10-05T21:15:14.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.246+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3297672716 wait complete. 2023-10-05T21:15:14.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.246+0000 7f1dc6fe7680 1 Processor -- start 2023-10-05T21:15:14.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.247+0000 7f1dc6fe7680 1 -- start start 2023-10-05T21:15:14.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.247+0000 7f1dc6fe7680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5646026d5ad0 0x5646026dc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.247+0000 7f1dc6fe7680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646026dcd70 con 0x5646026d5ad0 2023-10-05T21:15:14.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.247+0000 7f1db98be700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5646026d5ad0 0x5646026dc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.247+0000 7f1db98be700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5646026d5ad0 0x5646026dc830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49842/0 (socket says 172.21.15.153:49842) 2023-10-05T21:15:14.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.247+0000 7f1db98be700 1 -- 172.21.15.153:0/2146810280 learned_addr learned my addr 172.21.15.153:0/2146810280 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:14.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.247+0000 7f1db98be700 1 -- 172.21.15.153:0/2146810280 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56460268e180 con 0x5646026d5ad0 2023-10-05T21:15:14.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.247+0000 7f1db98be700 1 --2- 172.21.15.153:0/2146810280 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5646026d5ad0 0x5646026dc830 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1dac03b040 tx=0x7f1dac031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.247+0000 7f1d89fdb700 1 -- 172.21.15.153:0/2146810280 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1dac037910 con 0x5646026d5ad0 2023-10-05T21:15:14.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.248+0000 7f1d89fdb700 1 -- 172.21.15.153:0/2146810280 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dac037a70 con 0x5646026d5ad0 2023-10-05T21:15:14.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.248+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/2146810280 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5646026dcf70 con 0x5646026d5ad0 2023-10-05T21:15:14.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.248+0000 7f1d89fdb700 1 -- 172.21.15.153:0/2146810280 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1dac037c20 con 0x5646026d5ad0 2023-10-05T21:15:14.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.248+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/2146810280 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5646026dd420 con 0x5646026d5ad0 2023-10-05T21:15:14.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.248+0000 7f1d89fdb700 1 -- 172.21.15.153:0/2146810280 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f1dac026040 con 0x5646026d5ad0 2023-10-05T21:15:14.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.248+0000 7f1d89fdb700 1 --2- 172.21.15.153:0/2146810280 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1d00034140 0x7f1d000365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.248+0000 7f1d89fdb700 1 -- 172.21.15.153:0/2146810280 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f1dac031070 con 0x5646026d5ad0 2023-10-05T21:15:14.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.248+0000 7f1dba8c0700 1 --2- 172.21.15.153:0/2146810280 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1d00034140 0x7f1d000365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.248+0000 7f1dc6fe7680 5 note: GC not initialized 2023-10-05T21:15:14.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.249+0000 7f1dba8c0700 1 --2- 172.21.15.153:0/2146810280 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1d00034140 0x7f1d000365f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x5646026c6d60 tx=0x7f1db4037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.249+0000 7f1cfaffd700 20 reqs_thread_entry: start 2023-10-05T21:15:14.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.250+0000 7f1cf8ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:14.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.250+0000 7f1dc6fe7680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:14.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.250+0000 7f1dc6fe7680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:14.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.250+0000 7f1ceaffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:44 2023 2023-10-05T21:15:14.282 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:14.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.250+0000 7f1cea7fc700 20 reqs_thread_entry: start 2023-10-05T21:15:14.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.250+0000 7f1dc6fe7680 20 get_system_obj_state: rctx=0x7ffff1ea3918 obj=default.rgw.meta:users.uid:foo state=0x564602539240 s->prefetch_data=0 2023-10-05T21:15:14.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.250+0000 7f1dc6fe7680 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T21:15:14.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.250+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646027421f0 con 0x56460268a750 2023-10-05T21:15:14.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.250+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.250+0000 7f1dc6fe7680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T21:15:14.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.250+0000 7f1dc6fe7680 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:14.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.250+0000 7f1dc6fe7680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:14.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.250+0000 7f1dc6fe7680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:14.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.250+0000 7f1dc6fe7680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:14.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.250+0000 7f1dc6fe7680 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:14.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.250+0000 7f1dc6fe7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.250+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564602744480 con 0x56460268a750 2023-10-05T21:15:14.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.251+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv6 ondisk = 0) v8 ==== 273+0+636 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.251+0000 7f1dc6fe7680 20 rados_obj.operate() r=0 bl.length=513 2023-10-05T21:15:14.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.251+0000 7f1dc6fe7680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T21:15:14.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.251+0000 7f1dc6fe7680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:14.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.251+0000 7f1dc6fe7680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:14.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.251+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:104 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~513 in=513b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564602745fe0 con 0x56460268a750 2023-10-05T21:15:14.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.251+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(104 foo [delete,create,call,writefull 0~513] v29'7 uv7 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.251+0000 7f1dc6fe7680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T21:15:14.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.251+0000 7f1dc6fe7680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:14.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.251+0000 7f1dc6fe7680 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T21:15:14.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.251+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [notify cookie 94858688859376 in=701b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564602741140 con 0x56460268a750 2023-10-05T21:15:14.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.252+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== watch-notify(notify (1) cookie 94858688356976 notify 124554051590 ret 0) v3 ==== 731+0+0 (crc 0 0 0) 0x7f1db4029290 con 0x56460268a750 2023-10-05T21:15:14.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.252+0000 7f1dabfff700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051590 cookie 94858688356976 notifier 4340 bl.length()=689 2023-10-05T21:15:14.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.252+0000 7f1dabfff700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T21:15:14.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.252+0000 7f1dabfff700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:14.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.252+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(105 notify.4 [notify cookie 94858688859376 out=8b] v0'0 uv57 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.252+0000 7f1dabfff700 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f1da0003d90 con 0x56460268a750 2023-10-05T21:15:14.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.252+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(106 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.252+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== watch-notify(notify_complete (2) cookie 94858688859376 notify 124554051590 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f1db402d040 con 0x56460268a750 2023-10-05T21:15:14.285 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:14.286 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "foo", 2023-10-05T21:15:14.286 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Foo", 2023-10-05T21:15:14.286 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "foo@foo.com", 2023-10-05T21:15:14.286 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2023-10-05T21:15:14.286 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 4, 2023-10-05T21:15:14.286 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [ 2023-10-05T21:15:14.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:14.286 INFO:teuthology.orchestra.run.smithi153.stdout: "id": "foo:foo1", 2023-10-05T21:15:14.286 INFO:teuthology.orchestra.run.smithi153.stdout: "permissions": "full-control" 2023-10-05T21:15:14.286 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:14.286 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:14.287 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2023-10-05T21:15:14.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:14.287 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:14.287 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:14.287 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T21:15:14.287 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:14.287 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:14.287 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [ 2023-10-05T21:15:14.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:14.287 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo:foo1", 2023-10-05T21:15:14.287 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL" 2023-10-05T21:15:14.288 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:14.288 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:14.288 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2023-10-05T21:15:14.288 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2023-10-05T21:15:14.288 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2023-10-05T21:15:14.288 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2023-10-05T21:15:14.288 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2023-10-05T21:15:14.288 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:15:14.288 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:14.288 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:14.288 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:14.289 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:14.289 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:14.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:14.289 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2023-10-05T21:15:14.289 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:14.289 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:14.289 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:14.289 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:14.289 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:14.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:14.289 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2023-10-05T21:15:14.290 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2023-10-05T21:15:14.290 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [] 2023-10-05T21:15:14.290 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:14.290 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:15:14.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.252+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:107 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94858688339456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564602700880 con 0x7f1db0016b80 2023-10-05T21:15:14.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.253+0000 7f1db98be700 1 -- 172.21.15.153:0/3163114538 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(107 notify.0 [watch unwatch cookie 94858688339456] v29'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1dac034040 con 0x7f1db0016b80 2023-10-05T21:15:14.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.253+0000 7f1dc6fe7680 20 remove_watcher() i=0 2023-10-05T21:15:14.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.253+0000 7f1dc6fe7680 2 removed watcher, disabling cache 2023-10-05T21:15:14.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.253+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:108 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94858688343712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c1e00 con 0x56460268a750 2023-10-05T21:15:14.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.254+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 42 ==== osd_op_reply(108 notify.1 [watch unwatch cookie 94858688343712] v29'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.254+0000 7f1dc6fe7680 20 remove_watcher() i=1 2023-10-05T21:15:14.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.254+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:109 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94858688345920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c1e00 con 0x5646026baf90 2023-10-05T21:15:14.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.255+0000 7f1dba0bf700 1 -- 172.21.15.153:0/3163114538 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(109 notify.2 [watch unwatch cookie 94858688345920] v29'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1db0019ac0 con 0x5646026baf90 2023-10-05T21:15:14.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.255+0000 7f1dc6fe7680 20 remove_watcher() i=2 2023-10-05T21:15:14.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.255+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:110 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94858688351536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c1e00 con 0x7f1db0016b80 2023-10-05T21:15:14.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.256+0000 7f1db98be700 1 -- 172.21.15.153:0/3163114538 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(110 notify.3 [watch unwatch cookie 94858688351536] v29'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1dac034040 con 0x7f1db0016b80 2023-10-05T21:15:14.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.256+0000 7f1dc6fe7680 20 remove_watcher() i=3 2023-10-05T21:15:14.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.256+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:111 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94858688356976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c4d30 con 0x56460268a750 2023-10-05T21:15:14.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.256+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 43 ==== osd_op_reply(111 notify.4 [watch unwatch cookie 94858688356976] v29'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.256+0000 7f1dc6fe7680 20 remove_watcher() i=4 2023-10-05T21:15:14.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.256+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94858688362048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c6270 con 0x7f1dac007030 2023-10-05T21:15:14.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.257+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(112 notify.5 [watch unwatch cookie 94858688362048] v29'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1db400a570 con 0x7f1dac007030 2023-10-05T21:15:14.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.257+0000 7f1dc6fe7680 20 remove_watcher() i=5 2023-10-05T21:15:14.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.257+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:113 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94858688354768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c4d30 con 0x7f1dac007030 2023-10-05T21:15:14.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.258+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(113 notify.6 [watch unwatch cookie 94858688354768] v29'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1db400a570 con 0x7f1dac007030 2023-10-05T21:15:14.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.258+0000 7f1dc6fe7680 20 remove_watcher() i=6 2023-10-05T21:15:14.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.258+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:114 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94858688363968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c7640 con 0x7f1dac007030 2023-10-05T21:15:14.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.259+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(114 notify.7 [watch unwatch cookie 94858688363968] v29'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1db400a570 con 0x7f1dac007030 2023-10-05T21:15:14.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.259+0000 7f1dc6fe7680 20 remove_watcher() i=7 2023-10-05T21:15:14.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.259+0000 7f1d8bfdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:14.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.259+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:115 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94858688366432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5646026c6270 con 0x56460268a750 2023-10-05T21:15:14.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.260+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 <== osd.1 v2:172.21.15.153:6816/140456 44 ==== osd_op_reply(115 data_loggenerations_metadata [watch unwatch cookie 94858688366432] v29'73 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1db400a570 con 0x56460268a750 2023-10-05T21:15:14.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.260+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f1dac007030 msgr2=0x7f1dac01d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.260+0000 7f1dc6fe7680 1 --2- 172.21.15.153:0/3163114538 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f1dac007030 0x7f1dac01d420 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.260+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x56460268a750 msgr2=0x5646026b8b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.260+0000 7f1dc6fe7680 1 --2- 172.21.15.153:0/3163114538 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x56460268a750 0x5646026b8b70 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.260+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f1db0016b80 msgr2=0x7f1db0041460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.260+0000 7f1dc6fe7680 1 --2- 172.21.15.153:0/3163114538 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f1db0016b80 0x7f1db0041460 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.260+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5646026baf90 msgr2=0x5646026bd370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.260+0000 7f1dc6fe7680 1 --2- 172.21.15.153:0/3163114538 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5646026baf90 0x5646026bd370 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.260+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1d9c034140 msgr2=0x7f1d9c0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.260+0000 7f1dc6fe7680 1 --2- 172.21.15.153:0/3163114538 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1d9c034140 0x7f1d9c0365f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1dac003080 tx=0x7f1dac015000 comp rx=0 tx=0).stop 2023-10-05T21:15:14.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.260+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5646025fa040 msgr2=0x5646026acd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.260+0000 7f1dba8c0700 1 -- 172.21.15.153:0/3163114538 reap_dead start 2023-10-05T21:15:14.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.260+0000 7f1dc6fe7680 1 --2- 172.21.15.153:0/3163114538 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5646025fa040 0x5646026acd70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1db00017f0 tx=0x7f1db0016000 comp rx=0 tx=0).stop 2023-10-05T21:15:14.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.260+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 shutdown_connections 2023-10-05T21:15:14.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.260+0000 7f1dc6fe7680 1 --2- 172.21.15.153:0/3163114538 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5646025fa040 0x5646026acd70 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.260+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 >> 172.21.15.153:0/3163114538 conn(0x564602680b20 msgr2=0x56460269fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.260+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 shutdown_connections 2023-10-05T21:15:14.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.260+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/3163114538 wait complete. 2023-10-05T21:15:14.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.261+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/2146810280 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1d00034140 msgr2=0x7f1d000365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.261+0000 7f1dc6fe7680 1 --2- 172.21.15.153:0/2146810280 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1d00034140 0x7f1d000365f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x5646026c6d60 tx=0x7f1db4037450 comp rx=0 tx=0).stop 2023-10-05T21:15:14.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.261+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/2146810280 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5646026d5ad0 msgr2=0x5646026dc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.261+0000 7f1dc6fe7680 1 --2- 172.21.15.153:0/2146810280 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5646026d5ad0 0x5646026dc830 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1dac03b040 tx=0x7f1dac031000 comp rx=0 tx=0).stop 2023-10-05T21:15:14.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.261+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/2146810280 shutdown_connections 2023-10-05T21:15:14.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.261+0000 7f1dc6fe7680 1 --2- 172.21.15.153:0/2146810280 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1d00034140 0x7f1d000365f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.261+0000 7f1dc6fe7680 1 --2- 172.21.15.153:0/2146810280 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5646026d5ad0 0x5646026dc830 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.261+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/2146810280 >> 172.21.15.153:0/2146810280 conn(0x5646026d1dd0 msgr2=0x5646026cfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.261+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/2146810280 shutdown_connections 2023-10-05T21:15:14.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.261+0000 7f1dc6fe7680 1 -- 172.21.15.153:0/2146810280 wait complete. 2023-10-05T21:15:14.299 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:15:14.300 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2023-10-05T21:15:14.300 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2023-10-05T21:15:14.300 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2023-10-05T21:15:14.344 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:14.344 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:14.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.343+0000 7fa0ed485680 1 Processor -- start 2023-10-05T21:15:14.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.343+0000 7fa0ed485680 1 -- start start 2023-10-05T21:15:14.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.343+0000 7fa0ed485680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5607c7740be0 0x5607c7742fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.343+0000 7fa0ed485680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5607c7689990 con 0x5607c773a7b0 2023-10-05T21:15:14.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.343+0000 7fa0ed485680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x5607c7649db0 con 0x5607c7740be0 2023-10-05T21:15:14.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.344+0000 7fa0dfd5c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5607c7740be0 0x5607c7742fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.344+0000 7fa0dfd5c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5607c7740be0 0x5607c7742fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49856/0 (socket says 172.21.15.153:49856) 2023-10-05T21:15:14.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.344+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2440674760 learned_addr learned my addr 172.21.15.153:0/2440674760 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:14.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.344+0000 7fa0e055d700 1 --1- 172.21.15.153:0/2440674760 >> v1:172.21.15.111:6789/0 conn(0x5607c773a7b0 0x5607c773abc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56296/0 (socket says 172.21.15.153:56296) 2023-10-05T21:15:14.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.344+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2440674760 >> v1:172.21.15.111:6789/0 conn(0x5607c773a7b0 legacy=0x5607c773abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.344+0000 7fa0df55b700 1 -- 172.21.15.153:0/2440674760 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2243293395 0 0) 0x5607c7689990 con 0x5607c773a7b0 2023-10-05T21:15:14.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.344+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2440674760 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607c7744510 con 0x5607c7740be0 2023-10-05T21:15:14.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.344+0000 7fa0dfd5c700 1 --2- 172.21.15.153:0/2440674760 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c7740be0 0x5607c7742fc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa0d400a650 tx=0x7fa0d4005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb71c87de88397f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.344+0000 7fa0df55b700 1 -- 172.21.15.153:0/2440674760 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0d4008760 con 0x5607c7740be0 2023-10-05T21:15:14.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.344+0000 7fa0df55b700 1 -- 172.21.15.153:0/2440674760 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d40088c0 con 0x5607c7740be0 2023-10-05T21:15:14.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.344+0000 7fa0df55b700 1 -- 172.21.15.153:0/2440674760 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0d4008bb0 con 0x5607c7740be0 2023-10-05T21:15:14.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.345+0000 7fa0ed485680 1 -- 172.21.15.153:0/2440674760 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c7740be0 msgr2=0x5607c7742fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.345+0000 7fa0ed485680 1 --2- 172.21.15.153:0/2440674760 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c7740be0 0x5607c7742fc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa0d400a650 tx=0x7fa0d4005b10 comp rx=0 tx=0).stop 2023-10-05T21:15:14.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.345+0000 7fa0ed485680 1 -- 172.21.15.153:0/2440674760 shutdown_connections 2023-10-05T21:15:14.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.345+0000 7fa0ed485680 1 --2- 172.21.15.153:0/2440674760 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c7740be0 0x5607c7742fc0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.345+0000 7fa0ed485680 1 -- 172.21.15.153:0/2440674760 >> 172.21.15.153:0/2440674760 conn(0x5607c7736300 msgr2=0x5607c7738710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.345+0000 7fa0ed485680 1 -- 172.21.15.153:0/2440674760 shutdown_connections 2023-10-05T21:15:14.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.345+0000 7fa0ed485680 1 -- 172.21.15.153:0/2440674760 wait complete. 2023-10-05T21:15:14.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.346+0000 7fa0ed485680 1 Processor -- start 2023-10-05T21:15:14.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.346+0000 7fa0ed485680 1 -- start start 2023-10-05T21:15:14.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.346+0000 7fa0ed485680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c773a7b0 0x5607c775b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.346+0000 7fa0ed485680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607c75e9ea0 con 0x5607c773a7b0 2023-10-05T21:15:14.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.346+0000 7fa0e055d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c773a7b0 0x5607c775b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.346+0000 7fa0e055d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c773a7b0 0x5607c775b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49868/0 (socket says 172.21.15.153:49868) 2023-10-05T21:15:14.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.346+0000 7fa0e055d700 1 -- 172.21.15.153:0/4062770092 learned_addr learned my addr 172.21.15.153:0/4062770092 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:14.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.346+0000 7fa0e055d700 1 -- 172.21.15.153:0/4062770092 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d4005db0 con 0x5607c773a7b0 2023-10-05T21:15:14.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.346+0000 7fa0e055d700 1 --2- 172.21.15.153:0/4062770092 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c773a7b0 0x5607c775b910 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0001e80 tx=0x7fa0d0001850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0e89ed76c918ab server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.346+0000 7fa0de559700 1 -- 172.21.15.153:0/4062770092 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0d0014070 con 0x5607c773a7b0 2023-10-05T21:15:14.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.346+0000 7fa0de559700 1 -- 172.21.15.153:0/4062770092 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d000f450 con 0x5607c773a7b0 2023-10-05T21:15:14.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.346+0000 7fa0de559700 1 -- 172.21.15.153:0/4062770092 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0d000f740 con 0x5607c773a7b0 2023-10-05T21:15:14.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.347+0000 7fa0ed485680 1 -- 172.21.15.153:0/4062770092 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c773a7b0 msgr2=0x5607c775b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.347+0000 7fa0ed485680 1 --2- 172.21.15.153:0/4062770092 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c773a7b0 0x5607c775b910 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0001e80 tx=0x7fa0d0001850 comp rx=0 tx=0).stop 2023-10-05T21:15:14.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.347+0000 7fa0ed485680 1 -- 172.21.15.153:0/4062770092 shutdown_connections 2023-10-05T21:15:14.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.347+0000 7fa0ed485680 1 --2- 172.21.15.153:0/4062770092 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c773a7b0 0x5607c775b910 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.347+0000 7fa0ed485680 1 -- 172.21.15.153:0/4062770092 >> 172.21.15.153:0/4062770092 conn(0x5607c7736300 msgr2=0x5607c77573e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.347+0000 7fa0ed485680 1 -- 172.21.15.153:0/4062770092 shutdown_connections 2023-10-05T21:15:14.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.347+0000 7fa0ed485680 1 -- 172.21.15.153:0/4062770092 wait complete. 2023-10-05T21:15:14.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.347+0000 7fa0ed485680 1 Processor -- start 2023-10-05T21:15:14.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.347+0000 7fa0ed485680 1 -- start start 2023-10-05T21:15:14.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.347+0000 7fa0ed485680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c773a7b0 0x5607c7762dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.347+0000 7fa0ed485680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607c75e0c80 con 0x5607c773a7b0 2023-10-05T21:15:14.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.348+0000 7fa0e055d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c773a7b0 0x5607c7762dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.348+0000 7fa0e055d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c773a7b0 0x5607c7762dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49876/0 (socket says 172.21.15.153:49876) 2023-10-05T21:15:14.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.348+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 learned_addr learned my addr 172.21.15.153:0/2369079952 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:14.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.348+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d0001b30 con 0x5607c773a7b0 2023-10-05T21:15:14.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.348+0000 7fa0e055d700 1 --2- 172.21.15.153:0/2369079952 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c773a7b0 0x5607c7762dd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa0d00011e0 tx=0x7fa0d0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.348+0000 7fa0dcd56700 1 -- 172.21.15.153:0/2369079952 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0d000fe50 con 0x5607c773a7b0 2023-10-05T21:15:14.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.348+0000 7fa0dcd56700 1 -- 172.21.15.153:0/2369079952 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d001cb40 con 0x5607c773a7b0 2023-10-05T21:15:14.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.348+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5607c7763310 con 0x5607c773a7b0 2023-10-05T21:15:14.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.348+0000 7fa0dcd56700 1 -- 172.21.15.153:0/2369079952 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0d001ce30 con 0x5607c773a7b0 2023-10-05T21:15:14.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.348+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5607c7763760 con 0x5607c773a7b0 2023-10-05T21:15:14.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.349+0000 7fa0dcd56700 1 -- 172.21.15.153:0/2369079952 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fa0d0023020 con 0x5607c773a7b0 2023-10-05T21:15:14.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.349+0000 7fa0dcd56700 1 --2- 172.21.15.153:0/2369079952 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa0cc034140 0x7fa0cc0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.349+0000 7fa0dcd56700 1 -- 172.21.15.153:0/2369079952 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fa0d0008030 con 0x5607c773a7b0 2023-10-05T21:15:14.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.349+0000 7fa0dfd5c700 1 --2- 172.21.15.153:0/2369079952 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa0cc034140 0x7fa0cc0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.349+0000 7fa0ed485680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.349+0000 7fa0ed485680 1 --2- 172.21.15.153:0/2369079952 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5607c7740be0 0x5607c776eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.349+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c776f2d0 con 0x5607c7740be0 2023-10-05T21:15:14.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.349+0000 7fa0e0d5e700 1 --2- 172.21.15.153:0/2369079952 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5607c7740be0 0x5607c776eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.350+0000 7fa0dfd5c700 1 --2- 172.21.15.153:0/2369079952 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa0cc034140 0x7fa0cc0365f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4005b50 tx=0x7fa0d4015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.350+0000 7fa0e0d5e700 1 --2- 172.21.15.153:0/2369079952 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5607c7740be0 0x5607c776eb40 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.350+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.350+0000 7fa0ed485680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.350+0000 7fa0ed485680 20 realm 2023-10-05T21:15:14.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.350+0000 7fa0ed485680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.350+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c776c040 con 0x5607c7740be0 2023-10-05T21:15:14.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.350+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.350+0000 7fa0ed485680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.350+0000 7fa0ed485680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:14.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.350+0000 7fa0ed485680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.350+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c776fd80 con 0x5607c7740be0 2023-10-05T21:15:14.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.350+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.351+0000 7fa0ed485680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.351+0000 7fa0ed485680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.351+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c776f9c0 con 0x5607c7740be0 2023-10-05T21:15:14.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.351+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.351+0000 7fa0ed485680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.351+0000 7fa0ed485680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.351+0000 7fa0ed485680 1 --2- 172.21.15.153:0/2369079952 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5607c7771140 0x5607c7773520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.351+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7773a60 con 0x5607c7771140 2023-10-05T21:15:14.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.351+0000 7fa0e055d700 1 --2- 172.21.15.153:0/2369079952 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5607c7771140 0x5607c7773520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.351+0000 7fa0e055d700 1 --2- 172.21.15.153:0/2369079952 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5607c7771140 0x5607c7773520 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.351+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa0d0016070 con 0x5607c7771140 2023-10-05T21:15:14.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.351+0000 7fa0ed485680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:14.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.351+0000 7fa0ed485680 20 searching for the correct realm 2023-10-05T21:15:14.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.351+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x5607c7771140 2023-10-05T21:15:14.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.352+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d0016070 con 0x5607c7771140 2023-10-05T21:15:14.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.352+0000 7fa0e055d700 1 --2- 172.21.15.153:0/2369079952 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fa0d001a070 0x7fa0d001d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.352+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x7fa0d001a070 2023-10-05T21:15:14.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.352+0000 7fa0dfd5c700 1 --2- 172.21.15.153:0/2369079952 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fa0d001a070 0x7fa0d001d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.352+0000 7fa0dfd5c700 1 --2- 172.21.15.153:0/2369079952 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fa0d001a070 0x7fa0d001d450 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.352+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2369079952 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d4019040 con 0x7fa0d001a070 2023-10-05T21:15:14.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.352+0000 7fa0dfd5c700 1 --2- 172.21.15.153:0/2369079952 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fa0d4007030 0x7fa0d401d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.352+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x7fa0d4007030 2023-10-05T21:15:14.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.353+0000 7fa0e0d5e700 1 --2- 172.21.15.153:0/2369079952 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fa0d4007030 0x7fa0d401d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.353+0000 7fa0e0d5e700 1 --2- 172.21.15.153:0/2369079952 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fa0d4007030 0x7fa0d401d420 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.353+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d800a570 con 0x7fa0d4007030 2023-10-05T21:15:14.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.353+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x5607c7740be0 2023-10-05T21:15:14.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.353+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.353+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x5607c7740be0 2023-10-05T21:15:14.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.354+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.354+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x7fa0d4007030 2023-10-05T21:15:14.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.354+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d800a570 con 0x7fa0d4007030 2023-10-05T21:15:14.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.354+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x7fa0d4007030 2023-10-05T21:15:14.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.354+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d800a570 con 0x7fa0d4007030 2023-10-05T21:15:14.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.354+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x7fa0d001a070 2023-10-05T21:15:14.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.354+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2369079952 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d4019040 con 0x7fa0d001a070 2023-10-05T21:15:14.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.354+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x5607c7771140 2023-10-05T21:15:14.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.354+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa0d0016070 con 0x5607c7771140 2023-10-05T21:15:14.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.354+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x5607c7740be0 2023-10-05T21:15:14.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.355+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.355+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x7fa0d4007030 2023-10-05T21:15:14.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.355+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d800a570 con 0x7fa0d4007030 2023-10-05T21:15:14.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.355+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x5607c7740be0 2023-10-05T21:15:14.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.355+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.355+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x7fa0d001a070 2023-10-05T21:15:14.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.355+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2369079952 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d4019040 con 0x7fa0d001a070 2023-10-05T21:15:14.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.355+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x5607c7771140 2023-10-05T21:15:14.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.356+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d0016070 con 0x5607c7771140 2023-10-05T21:15:14.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.356+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x5607c7771140 2023-10-05T21:15:14.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.356+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d0016070 con 0x5607c7771140 2023-10-05T21:15:14.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.356+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x7fa0d4007030 2023-10-05T21:15:14.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.356+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d800a570 con 0x7fa0d4007030 2023-10-05T21:15:14.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.356+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x5607c7771140 2023-10-05T21:15:14.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.356+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d0016070 con 0x5607c7771140 2023-10-05T21:15:14.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.356+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x5607c7771140 2023-10-05T21:15:14.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.356+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d0016070 con 0x5607c7771140 2023-10-05T21:15:14.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.356+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x5607c7740be0 2023-10-05T21:15:14.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.357+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.357+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x5607c7740be0 2023-10-05T21:15:14.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.357+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.357+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x7fa0d4007030 2023-10-05T21:15:14.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.357+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d800a570 con 0x7fa0d4007030 2023-10-05T21:15:14.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.357+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x5607c7771140 2023-10-05T21:15:14.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.357+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d0016070 con 0x5607c7771140 2023-10-05T21:15:14.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.357+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x7fa0d001a070 2023-10-05T21:15:14.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.358+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2369079952 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d4019040 con 0x7fa0d001a070 2023-10-05T21:15:14.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.358+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x5607c7740be0 2023-10-05T21:15:14.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.358+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.358+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x7fa0d4007030 2023-10-05T21:15:14.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.358+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d800a570 con 0x7fa0d4007030 2023-10-05T21:15:14.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.358+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x5607c7771140 2023-10-05T21:15:14.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.358+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d0016070 con 0x5607c7771140 2023-10-05T21:15:14.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.358+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x7fa0d4007030 2023-10-05T21:15:14.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.359+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d800a570 con 0x7fa0d4007030 2023-10-05T21:15:14.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.359+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x7fa0d001a070 2023-10-05T21:15:14.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.359+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2369079952 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d4019040 con 0x7fa0d001a070 2023-10-05T21:15:14.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.359+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x5607c7771140 2023-10-05T21:15:14.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.359+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d0016070 con 0x5607c7771140 2023-10-05T21:15:14.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.359+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x7fa0d4007030 2023-10-05T21:15:14.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.359+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d800a570 con 0x7fa0d4007030 2023-10-05T21:15:14.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.359+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x5607c7740be0 2023-10-05T21:15:14.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.360+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.360+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775310 con 0x7fa0d001a070 2023-10-05T21:15:14.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.360+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2369079952 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d4019040 con 0x7fa0d001a070 2023-10-05T21:15:14.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.360+0000 7fa0ed485680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:14.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.360+0000 7fa0ed485680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:14.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.360+0000 7fa0ed485680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:14.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.360+0000 7fa0ed485680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:14.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.360+0000 7fa0ed485680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.360+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7774430 con 0x5607c7740be0 2023-10-05T21:15:14.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.360+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.360+0000 7fa0ed485680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.360+0000 7fa0ed485680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.360+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c77748c0 con 0x5607c7740be0 2023-10-05T21:15:14.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.360+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.360+0000 7fa0ed485680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.360+0000 7fa0ed485680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.360+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7774cf0 con 0x5607c7740be0 2023-10-05T21:15:14.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.361+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.361+0000 7fa0ed485680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:14.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.361+0000 7fa0ed485680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.361+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c77756c0 con 0x5607c7771140 2023-10-05T21:15:14.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.361+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fa0d0016070 con 0x5607c7771140 2023-10-05T21:15:14.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.361+0000 7fa0ed485680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.361+0000 7fa0ed485680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.361+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775a70 con 0x5607c7740be0 2023-10-05T21:15:14.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.361+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.361+0000 7fa0ed485680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.361+0000 7fa0ed485680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.361+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7774030 con 0x5607c7740be0 2023-10-05T21:15:14.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.361+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.361+0000 7fa0ed485680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.361+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7774000 con 0x5607c7771140 2023-10-05T21:15:14.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.361+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d0016070 con 0x5607c7771140 2023-10-05T21:15:14.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.362+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7774000 con 0x7fa0d001a070 2023-10-05T21:15:14.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.362+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2369079952 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d4019040 con 0x7fa0d001a070 2023-10-05T21:15:14.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.362+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7774000 con 0x7fa0d4007030 2023-10-05T21:15:14.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.362+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d800a570 con 0x7fa0d4007030 2023-10-05T21:15:14.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.362+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775a70 con 0x5607c7740be0 2023-10-05T21:15:14.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.362+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.362+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775a70 con 0x5607c7740be0 2023-10-05T21:15:14.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.362+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.362+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775a70 con 0x7fa0d4007030 2023-10-05T21:15:14.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.363+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d800a570 con 0x7fa0d4007030 2023-10-05T21:15:14.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.363+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775a70 con 0x7fa0d4007030 2023-10-05T21:15:14.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.363+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d800a570 con 0x7fa0d4007030 2023-10-05T21:15:14.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.363+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775a70 con 0x7fa0d001a070 2023-10-05T21:15:14.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.363+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2369079952 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d4019040 con 0x7fa0d001a070 2023-10-05T21:15:14.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.363+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775a70 con 0x5607c7771140 2023-10-05T21:15:14.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.363+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa0d0016070 con 0x5607c7771140 2023-10-05T21:15:14.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.363+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775a70 con 0x5607c7740be0 2023-10-05T21:15:14.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.364+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.364+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775a70 con 0x7fa0d4007030 2023-10-05T21:15:14.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.364+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d800a570 con 0x7fa0d4007030 2023-10-05T21:15:14.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.364+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775a70 con 0x5607c7740be0 2023-10-05T21:15:14.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.364+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.364+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775a70 con 0x7fa0d001a070 2023-10-05T21:15:14.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.364+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2369079952 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d4019040 con 0x7fa0d001a070 2023-10-05T21:15:14.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.364+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775a70 con 0x5607c7771140 2023-10-05T21:15:14.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.364+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d0016070 con 0x5607c7771140 2023-10-05T21:15:14.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.365+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775a70 con 0x5607c7771140 2023-10-05T21:15:14.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.365+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d0016070 con 0x5607c7771140 2023-10-05T21:15:14.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.365+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775a70 con 0x7fa0d4007030 2023-10-05T21:15:14.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.365+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d800a570 con 0x7fa0d4007030 2023-10-05T21:15:14.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.365+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775a70 con 0x5607c7771140 2023-10-05T21:15:14.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.365+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d0016070 con 0x5607c7771140 2023-10-05T21:15:14.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.365+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775a70 con 0x5607c7771140 2023-10-05T21:15:14.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.365+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d0016070 con 0x5607c7771140 2023-10-05T21:15:14.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.365+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775a70 con 0x5607c7740be0 2023-10-05T21:15:14.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.366+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.366+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775a70 con 0x5607c7740be0 2023-10-05T21:15:14.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.366+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.366+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775a70 con 0x7fa0d4007030 2023-10-05T21:15:14.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.366+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d800a570 con 0x7fa0d4007030 2023-10-05T21:15:14.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.366+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775a70 con 0x5607c7771140 2023-10-05T21:15:14.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.366+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d0016070 con 0x5607c7771140 2023-10-05T21:15:14.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.366+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775a70 con 0x7fa0d001a070 2023-10-05T21:15:14.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.366+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2369079952 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d4019040 con 0x7fa0d001a070 2023-10-05T21:15:14.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.366+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775a70 con 0x5607c7740be0 2023-10-05T21:15:14.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.367+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.367+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775a70 con 0x7fa0d4007030 2023-10-05T21:15:14.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.367+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d800a570 con 0x7fa0d4007030 2023-10-05T21:15:14.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.367+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775a70 con 0x5607c7771140 2023-10-05T21:15:14.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.367+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d0016070 con 0x5607c7771140 2023-10-05T21:15:14.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.367+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775a70 con 0x7fa0d4007030 2023-10-05T21:15:14.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.367+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d800a570 con 0x7fa0d4007030 2023-10-05T21:15:14.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.367+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775a70 con 0x7fa0d001a070 2023-10-05T21:15:14.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.368+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2369079952 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d4019040 con 0x7fa0d001a070 2023-10-05T21:15:14.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.368+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775a70 con 0x5607c7771140 2023-10-05T21:15:14.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.368+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d0016070 con 0x5607c7771140 2023-10-05T21:15:14.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.368+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775a70 con 0x7fa0d4007030 2023-10-05T21:15:14.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.368+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d800a570 con 0x7fa0d4007030 2023-10-05T21:15:14.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.368+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775a70 con 0x5607c7740be0 2023-10-05T21:15:14.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.368+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.368+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7775a70 con 0x7fa0d001a070 2023-10-05T21:15:14.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.368+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2369079952 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0d4019040 con 0x7fa0d001a070 2023-10-05T21:15:14.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.369+0000 7fa0ed485680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:14.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.369+0000 7fa0ed485680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:14.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.369+0000 7fa0ed485680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:14.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.369+0000 7fa0ed485680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:14.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.369+0000 7fa0ed485680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.369+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7774000 con 0x5607c7740be0 2023-10-05T21:15:14.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.369+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.369+0000 7fa0ed485680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.369+0000 7fa0ed485680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.369+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c77763b0 con 0x5607c7771140 2023-10-05T21:15:14.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.369+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa0d0016070 con 0x5607c7771140 2023-10-05T21:15:14.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.369+0000 7fa0ed485680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:14.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.369+0000 7fa0ed485680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.369+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7776ca0 con 0x5607c7740be0 2023-10-05T21:15:14.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.369+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.369+0000 7fa0ed485680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.369+0000 7fa0ed485680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.369+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7776ca0 con 0x5607c7740be0 2023-10-05T21:15:14.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.369+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.369+0000 7fa0ed485680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:14.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.369+0000 7fa0ed485680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.369+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7776ca0 con 0x7fa0d4007030 2023-10-05T21:15:14.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.370+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa0d800a570 con 0x7fa0d4007030 2023-10-05T21:15:14.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.370+0000 7fa0ed485680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.370+0000 7fa0ed485680 20 zone default found 2023-10-05T21:15:14.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.370+0000 7fa0ed485680 4 Realm: () 2023-10-05T21:15:14.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.370+0000 7fa0ed485680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:14.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.370+0000 7fa0ed485680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:14.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.370+0000 7fa0ed485680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:14.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.370+0000 7fa0ed485680 20 zonegroup default 2023-10-05T21:15:14.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.370+0000 7fa0ed485680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.370+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7776ca0 con 0x7fa0d4007030 2023-10-05T21:15:14.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.370+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa0d800a570 con 0x7fa0d4007030 2023-10-05T21:15:14.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.370+0000 7fa0ed485680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.370+0000 7fa0ed485680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.370+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7776ca0 con 0x5607c7771140 2023-10-05T21:15:14.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.370+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa0d0016070 con 0x5607c7771140 2023-10-05T21:15:14.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.370+0000 7fa0ed485680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.370+0000 7fa0ed485680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.370+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7778d90 con 0x5607c7771140 2023-10-05T21:15:14.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.371+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa0d0016070 con 0x5607c7771140 2023-10-05T21:15:14.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.371+0000 7fa0ed485680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.371+0000 7fa0ed485680 20 started sync module instance, tier type = 2023-10-05T21:15:14.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.371+0000 7fa0ed485680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:14.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.371+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7778450 con 0x7fa0d001a070 2023-10-05T21:15:14.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.371+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2369079952 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0d4019040 con 0x7fa0d001a070 2023-10-05T21:15:14.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.371+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94591411251120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7779140 con 0x7fa0d001a070 2023-10-05T21:15:14.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.371+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7779b10 con 0x5607c7740be0 2023-10-05T21:15:14.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.372+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.372+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2369079952 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94591411251120] v29'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0d4019040 con 0x7fa0d001a070 2023-10-05T21:15:14.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.372+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94591411262848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c777a400 con 0x5607c7740be0 2023-10-05T21:15:14.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.372+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7778850 con 0x5607c7771140 2023-10-05T21:15:14.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.373+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94591411262848] v29'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.373+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0d0016070 con 0x5607c7771140 2023-10-05T21:15:14.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.373+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94591411265584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c777ae10 con 0x5607c7771140 2023-10-05T21:15:14.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.373+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c777b6b0 con 0x7fa0d001a070 2023-10-05T21:15:14.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.374+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94591411265584] v29'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0d0016070 con 0x5607c7771140 2023-10-05T21:15:14.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.374+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2369079952 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0d4019040 con 0x7fa0d001a070 2023-10-05T21:15:14.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.374+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94591411268160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c777bab0 con 0x7fa0d001a070 2023-10-05T21:15:14.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.374+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c777c4c0 con 0x5607c7740be0 2023-10-05T21:15:14.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.375+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2369079952 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94591411268160] v29'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0d4019040 con 0x7fa0d001a070 2023-10-05T21:15:14.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.375+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.375+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94591411273680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c777c910 con 0x5607c7740be0 2023-10-05T21:15:14.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.375+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c777d320 con 0x7fa0d4007030 2023-10-05T21:15:14.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.375+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94591411273680] v29'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.375+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0d800a570 con 0x7fa0d4007030 2023-10-05T21:15:14.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.375+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94591411275376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c777d320 con 0x7fa0d4007030 2023-10-05T21:15:14.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.375+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c777dd30 con 0x7fa0d4007030 2023-10-05T21:15:14.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.376+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94591411275376] v29'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0d800a570 con 0x7fa0d4007030 2023-10-05T21:15:14.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.376+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0d800a570 con 0x7fa0d4007030 2023-10-05T21:15:14.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.376+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94591411277360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c777d300 con 0x7fa0d4007030 2023-10-05T21:15:14.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.376+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c777e790 con 0x7fa0d4007030 2023-10-05T21:15:14.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.377+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(98 notify.7 [create] v29'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0d800a570 con 0x7fa0d4007030 2023-10-05T21:15:14.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.377+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(97 notify.6 [watch watch cookie 94591411277360] v29'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0d800a570 con 0x7fa0d4007030 2023-10-05T21:15:14.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.377+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94591411282496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c777e750 con 0x7fa0d4007030 2023-10-05T21:15:14.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.377+0000 7fa0ed485680 20 add_watcher() i=0 2023-10-05T21:15:14.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.377+0000 7fa0ed485680 20 add_watcher() i=1 2023-10-05T21:15:14.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.377+0000 7fa0ed485680 20 add_watcher() i=2 2023-10-05T21:15:14.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.377+0000 7fa0ed485680 20 add_watcher() i=3 2023-10-05T21:15:14.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.377+0000 7fa0ed485680 20 add_watcher() i=4 2023-10-05T21:15:14.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.377+0000 7fa0ed485680 20 add_watcher() i=5 2023-10-05T21:15:14.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.377+0000 7fa0ed485680 20 add_watcher() i=6 2023-10-05T21:15:14.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.377+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94591411282496] v29'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0d800a570 con 0x7fa0d4007030 2023-10-05T21:15:14.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.378+0000 7fa0ed485680 20 add_watcher() i=7 2023-10-05T21:15:14.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.378+0000 7fa0ed485680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:14.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.378+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c7781c50 con 0x5607c7740be0 2023-10-05T21:15:14.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.378+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.378+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94591411280496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c777f110 con 0x5607c7740be0 2023-10-05T21:15:14.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.379+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94591411280496] v29'74 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.379+0000 7fa0b1fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:14.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.379+0000 7fa0ed485680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:14.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.379+0000 7fa0ed485680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:14.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.379+0000 7fa0ed485680 1 Processor -- start 2023-10-05T21:15:14.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.379+0000 7fa0ed485680 1 -- start start 2023-10-05T21:15:14.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.379+0000 7fa0ed485680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c773ce40 0x5607c773d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.379+0000 7fa0ed485680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607c773d790 con 0x5607c773ce40 2023-10-05T21:15:14.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.379+0000 7fa0dfd5c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c773ce40 0x5607c773d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.379+0000 7fa0dfd5c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c773ce40 0x5607c773d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49892/0 (socket says 172.21.15.153:49892) 2023-10-05T21:15:14.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.380+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/1987588915 learned_addr learned my addr 172.21.15.153:0/1987588915 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:14.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.380+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/1987588915 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607c773b6c0 con 0x5607c773ce40 2023-10-05T21:15:14.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.380+0000 7fa0dfd5c700 1 --2- 172.21.15.153:0/1987588915 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c773ce40 0x5607c773d250 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x5607c773b480 tx=0x7fa0d4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e51632ae94712c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.380+0000 7fa0b17e2700 1 -- 172.21.15.153:0/1987588915 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0d401de90 con 0x5607c773ce40 2023-10-05T21:15:14.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.380+0000 7fa0b17e2700 1 -- 172.21.15.153:0/1987588915 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d402b440 con 0x5607c773ce40 2023-10-05T21:15:14.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.380+0000 7fa0b17e2700 1 -- 172.21.15.153:0/1987588915 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0d402b5f0 con 0x5607c773ce40 2023-10-05T21:15:14.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.381+0000 7fa0ed485680 1 -- 172.21.15.153:0/1987588915 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c773ce40 msgr2=0x5607c773d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.381+0000 7fa0ed485680 1 --2- 172.21.15.153:0/1987588915 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c773ce40 0x5607c773d250 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x5607c773b480 tx=0x7fa0d4012000 comp rx=0 tx=0).stop 2023-10-05T21:15:14.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.381+0000 7fa0ed485680 1 -- 172.21.15.153:0/1987588915 shutdown_connections 2023-10-05T21:15:14.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.381+0000 7fa0ed485680 1 --2- 172.21.15.153:0/1987588915 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c773ce40 0x5607c773d250 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.381+0000 7fa0ed485680 1 -- 172.21.15.153:0/1987588915 >> 172.21.15.153:0/1987588915 conn(0x5607c7787760 msgr2=0x5607c77858c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.381+0000 7fa0ed485680 1 -- 172.21.15.153:0/1987588915 shutdown_connections 2023-10-05T21:15:14.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.381+0000 7fa0ed485680 1 -- 172.21.15.153:0/1987588915 wait complete. 2023-10-05T21:15:14.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.381+0000 7fa0ed485680 1 Processor -- start 2023-10-05T21:15:14.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.381+0000 7fa0ed485680 1 -- start start 2023-10-05T21:15:14.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.381+0000 7fa0ed485680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c773ce40 0x5607c77942f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.381+0000 7fa0ed485680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607c7794830 con 0x5607c773ce40 2023-10-05T21:15:14.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.382+0000 7fa0dfd5c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c773ce40 0x5607c77942f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.382+0000 7fa0dfd5c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c773ce40 0x5607c77942f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49906/0 (socket says 172.21.15.153:49906) 2023-10-05T21:15:14.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.382+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2573099816 learned_addr learned my addr 172.21.15.153:0/2573099816 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:14.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.382+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2573099816 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607c7744510 con 0x5607c773ce40 2023-10-05T21:15:14.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.382+0000 7fa0dfd5c700 1 --2- 172.21.15.153:0/2573099816 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c773ce40 0x5607c77942f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4012910 tx=0x7fa0d4030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.382+0000 7fa02b7fe700 1 -- 172.21.15.153:0/2573099816 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0d4009640 con 0x5607c773ce40 2023-10-05T21:15:14.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.382+0000 7fa02b7fe700 1 -- 172.21.15.153:0/2573099816 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d40097a0 con 0x5607c773ce40 2023-10-05T21:15:14.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.382+0000 7fa0ed485680 1 -- 172.21.15.153:0/2573099816 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5607c7794a30 con 0x5607c773ce40 2023-10-05T21:15:14.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.382+0000 7fa02b7fe700 1 -- 172.21.15.153:0/2573099816 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0d4009950 con 0x5607c773ce40 2023-10-05T21:15:14.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.382+0000 7fa0ed485680 1 -- 172.21.15.153:0/2573099816 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5607c7794e80 con 0x5607c773ce40 2023-10-05T21:15:14.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.383+0000 7fa02b7fe700 1 -- 172.21.15.153:0/2573099816 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fa0d4009ab0 con 0x5607c773ce40 2023-10-05T21:15:14.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.383+0000 7fa02b7fe700 1 --2- 172.21.15.153:0/2573099816 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa020034140 0x7fa0200365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.383+0000 7fa02b7fe700 1 -- 172.21.15.153:0/2573099816 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fa0d402be40 con 0x5607c773ce40 2023-10-05T21:15:14.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.383+0000 7fa0e0d5e700 1 --2- 172.21.15.153:0/2573099816 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa020034140 0x7fa0200365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.383+0000 7fa0ed485680 5 note: GC not initialized 2023-10-05T21:15:14.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.383+0000 7fa0e0d5e700 1 --2- 172.21.15.153:0/2573099816 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa020034140 0x7fa0200365f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x5607c777eab0 tx=0x7fa0d800af30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.384+0000 7fa028ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:14.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.384+0000 7fa01e7fc700 20 reqs_thread_entry: start 2023-10-05T21:15:14.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.384+0000 7fa0ed485680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:14.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.384+0000 7fa0ed485680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:14.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.384+0000 7fa01cff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:44 2023 2023-10-05T21:15:14.412 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:14.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.384+0000 7fa003fff700 20 reqs_thread_entry: start 2023-10-05T21:15:14.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.384+0000 7fa0ed485680 20 get_system_obj_state: rctx=0x7fff594267c8 obj=default.rgw.meta:users.uid:foo state=0x5607c76af330 s->prefetch_data=0 2023-10-05T21:15:14.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.385+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c77f9cd0 con 0x5607c7740be0 2023-10-05T21:15:14.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.385+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.385+0000 7fa0ed485680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:14.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.385+0000 7fa0ed485680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:14.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.385+0000 7fa0ed485680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.385+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c77fbf60 con 0x5607c7740be0 2023-10-05T21:15:14.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.385+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 273+0+636 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.385+0000 7fa0ed485680 20 rados_obj.operate() r=0 bl.length=513 2023-10-05T21:15:14.414 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:14.414 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "foo", 2023-10-05T21:15:14.414 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Foo", 2023-10-05T21:15:14.414 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "foo@foo.com", 2023-10-05T21:15:14.414 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2023-10-05T21:15:14.414 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 4, 2023-10-05T21:15:14.414 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [ 2023-10-05T21:15:14.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:14.414 INFO:teuthology.orchestra.run.smithi153.stdout: "id": "foo:foo1", 2023-10-05T21:15:14.414 INFO:teuthology.orchestra.run.smithi153.stdout: "permissions": "full-control" 2023-10-05T21:15:14.414 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:14.415 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:14.415 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2023-10-05T21:15:14.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:14.415 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:14.415 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:14.415 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T21:15:14.415 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:14.415 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:14.415 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [ 2023-10-05T21:15:14.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:14.415 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo:foo1", 2023-10-05T21:15:14.416 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL" 2023-10-05T21:15:14.416 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:14.416 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:14.416 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2023-10-05T21:15:14.416 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2023-10-05T21:15:14.416 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2023-10-05T21:15:14.416 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2023-10-05T21:15:14.416 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2023-10-05T21:15:14.416 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:15:14.416 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:14.416 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:14.416 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:14.417 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:14.417 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:14.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:14.417 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2023-10-05T21:15:14.417 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:14.417 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:14.417 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:14.417 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:14.417 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:14.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:14.417 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2023-10-05T21:15:14.417 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2023-10-05T21:15:14.418 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [] 2023-10-05T21:15:14.418 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:14.418 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:15:14.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.385+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94591411251120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c77f87d0 con 0x7fa0d001a070 2023-10-05T21:15:14.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.386+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2369079952 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94591411251120] v29'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0d4033040 con 0x7fa0d001a070 2023-10-05T21:15:14.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.386+0000 7fa0ed485680 20 remove_watcher() i=0 2023-10-05T21:15:14.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.386+0000 7fa0ed485680 2 removed watcher, disabling cache 2023-10-05T21:15:14.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.386+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94591411262848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c77767b0 con 0x5607c7740be0 2023-10-05T21:15:14.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.387+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94591411262848] v29'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.387+0000 7fa0ed485680 20 remove_watcher() i=1 2023-10-05T21:15:14.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.387+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94591411265584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c77767b0 con 0x5607c7771140 2023-10-05T21:15:14.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.388+0000 7fa0e055d700 1 -- 172.21.15.153:0/2369079952 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94591411265584] v29'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0d0016070 con 0x5607c7771140 2023-10-05T21:15:14.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.388+0000 7fa0ed485680 20 remove_watcher() i=2 2023-10-05T21:15:14.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.388+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94591411268160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c77767b0 con 0x7fa0d001a070 2023-10-05T21:15:14.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.388+0000 7fa0dfd5c700 1 -- 172.21.15.153:0/2369079952 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94591411268160] v29'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0d4033040 con 0x7fa0d001a070 2023-10-05T21:15:14.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.388+0000 7fa0ed485680 20 remove_watcher() i=3 2023-10-05T21:15:14.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.388+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94591411273680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c777aa40 con 0x5607c7740be0 2023-10-05T21:15:14.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.389+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94591411273680] v29'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.389+0000 7fa0ed485680 20 remove_watcher() i=4 2023-10-05T21:15:14.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.389+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94591411275376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c77767b0 con 0x7fa0d4007030 2023-10-05T21:15:14.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.390+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94591411275376] v29'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0d800a570 con 0x7fa0d4007030 2023-10-05T21:15:14.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.390+0000 7fa0ed485680 20 remove_watcher() i=5 2023-10-05T21:15:14.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.390+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94591411277360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c777bfd0 con 0x7fa0d4007030 2023-10-05T21:15:14.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.391+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94591411277360] v29'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0d800a570 con 0x7fa0d4007030 2023-10-05T21:15:14.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.391+0000 7fa0ed485680 20 remove_watcher() i=6 2023-10-05T21:15:14.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.391+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94591411282496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c777c670 con 0x7fa0d4007030 2023-10-05T21:15:14.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.391+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94591411282496] v29'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0d800a570 con 0x7fa0d4007030 2023-10-05T21:15:14.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.391+0000 7fa0ed485680 20 remove_watcher() i=7 2023-10-05T21:15:14.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.392+0000 7fa0b1fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:14.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.392+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:112 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94591411280496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5607c77767b0 con 0x5607c7740be0 2023-10-05T21:15:14.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.393+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(112 data_loggenerations_metadata [watch unwatch cookie 94591411280496] v29'75 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa0d800a570 con 0x5607c7740be0 2023-10-05T21:15:14.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.393+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fa0d4007030 msgr2=0x7fa0d401d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.393+0000 7fa0ed485680 1 --2- 172.21.15.153:0/2369079952 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fa0d4007030 0x7fa0d401d420 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.393+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5607c7740be0 msgr2=0x5607c776eb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.393+0000 7fa0ed485680 1 --2- 172.21.15.153:0/2369079952 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5607c7740be0 0x5607c776eb40 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.393+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fa0d001a070 msgr2=0x7fa0d001d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.393+0000 7fa0ed485680 1 --2- 172.21.15.153:0/2369079952 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fa0d001a070 0x7fa0d001d450 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.393+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5607c7771140 msgr2=0x5607c7773520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.393+0000 7fa0ed485680 1 --2- 172.21.15.153:0/2369079952 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5607c7771140 0x5607c7773520 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.393+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa0cc034140 msgr2=0x7fa0cc0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.393+0000 7fa0ed485680 1 --2- 172.21.15.153:0/2369079952 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa0cc034140 0x7fa0cc0365f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4005b50 tx=0x7fa0d4015000 comp rx=0 tx=0).stop 2023-10-05T21:15:14.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.393+0000 7fa0e0d5e700 1 -- 172.21.15.153:0/2369079952 reap_dead start 2023-10-05T21:15:14.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.393+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c773a7b0 msgr2=0x5607c7762dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.393+0000 7fa0ed485680 1 --2- 172.21.15.153:0/2369079952 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c773a7b0 0x5607c7762dd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa0d00011e0 tx=0x7fa0d0016000 comp rx=0 tx=0).stop 2023-10-05T21:15:14.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.393+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 shutdown_connections 2023-10-05T21:15:14.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.393+0000 7fa0ed485680 1 --2- 172.21.15.153:0/2369079952 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c773a7b0 0x5607c7762dd0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.393+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 >> 172.21.15.153:0/2369079952 conn(0x5607c7736300 msgr2=0x5607c7755c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.393+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 shutdown_connections 2023-10-05T21:15:14.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.393+0000 7fa0ed485680 1 -- 172.21.15.153:0/2369079952 wait complete. 2023-10-05T21:15:14.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.393+0000 7fa0ed485680 1 -- 172.21.15.153:0/2573099816 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa020034140 msgr2=0x7fa0200365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.393+0000 7fa0ed485680 1 --2- 172.21.15.153:0/2573099816 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa020034140 0x7fa0200365f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x5607c777eab0 tx=0x7fa0d800af30 comp rx=0 tx=0).stop 2023-10-05T21:15:14.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.394+0000 7fa0ed485680 1 -- 172.21.15.153:0/2573099816 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c773ce40 msgr2=0x5607c77942f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.394+0000 7fa0ed485680 1 --2- 172.21.15.153:0/2573099816 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c773ce40 0x5607c77942f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4012910 tx=0x7fa0d4030000 comp rx=0 tx=0).stop 2023-10-05T21:15:14.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.394+0000 7fa0ed485680 1 -- 172.21.15.153:0/2573099816 shutdown_connections 2023-10-05T21:15:14.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.394+0000 7fa0ed485680 1 --2- 172.21.15.153:0/2573099816 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa020034140 0x7fa0200365f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.394+0000 7fa0ed485680 1 --2- 172.21.15.153:0/2573099816 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607c773ce40 0x5607c77942f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.394+0000 7fa0ed485680 1 -- 172.21.15.153:0/2573099816 >> 172.21.15.153:0/2573099816 conn(0x5607c7787760 msgr2=0x5607c7785890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.394+0000 7fa0ed485680 1 -- 172.21.15.153:0/2573099816 shutdown_connections 2023-10-05T21:15:14.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.394+0000 7fa0ed485680 1 -- 172.21.15.153:0/2573099816 wait complete. 2023-10-05T21:15:14.428 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:15:14.428 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2023-10-05T21:15:14.428 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2023-10-05T21:15:14.428 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2023-10-05T21:15:14.472 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:14.473 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:14.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.472+0000 7f7326171680 1 Processor -- start 2023-10-05T21:15:14.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.472+0000 7f7326171680 1 -- start start 2023-10-05T21:15:14.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.472+0000 7f7326171680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55a04d0b52b0 0x55a04d0b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.472+0000 7f7326171680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a04d003990 con 0x55a04d0b5c00 2023-10-05T21:15:14.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.472+0000 7f7326171680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a04cfc3db0 con 0x55a04d0b52b0 2023-10-05T21:15:14.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.472+0000 7f7319249700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55a04d0b52b0 0x55a04d0b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.472+0000 7f7318a48700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55a04d0b5c00 0x55a04d0b65f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56308/0 (socket says 172.21.15.153:56308) 2023-10-05T21:15:14.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.472+0000 7f7318a48700 1 -- 172.21.15.153:0/4096419864 learned_addr learned my addr 172.21.15.153:0/4096419864 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:14.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.472+0000 7f730bfff700 1 -- 172.21.15.153:0/4096419864 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1435733003 0 0) 0x55a04d003990 con 0x55a04d0b5c00 2023-10-05T21:15:14.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.472+0000 7f730bfff700 1 -- 172.21.15.153:0/4096419864 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7304001e10 con 0x55a04d0b5c00 2023-10-05T21:15:14.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.472+0000 7f7319249700 1 -- 172.21.15.153:0/4096419864 >> v1:172.21.15.111:6789/0 conn(0x55a04d0b5c00 legacy=0x55a04d0b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.472+0000 7f7319249700 1 -- 172.21.15.153:0/4096419864 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a04d0b6ea0 con 0x55a04d0b52b0 2023-10-05T21:15:14.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.473+0000 7f7319249700 1 --2- 172.21.15.153:0/4096419864 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d0b52b0 0x55a04d0b56c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f730c00a5d0 tx=0x7f730c005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9aa19d6566af05 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.473+0000 7f730bfff700 1 -- 172.21.15.153:0/4096419864 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f730c007610 con 0x55a04d0b52b0 2023-10-05T21:15:14.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.473+0000 7f730bfff700 1 -- 172.21.15.153:0/4096419864 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730c007770 con 0x55a04d0b52b0 2023-10-05T21:15:14.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.473+0000 7f730bfff700 1 -- 172.21.15.153:0/4096419864 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f730c007a40 con 0x55a04d0b52b0 2023-10-05T21:15:14.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.473+0000 7f7326171680 1 -- 172.21.15.153:0/4096419864 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d0b52b0 msgr2=0x55a04d0b56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.473+0000 7f7326171680 1 --2- 172.21.15.153:0/4096419864 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d0b52b0 0x55a04d0b56c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f730c00a5d0 tx=0x7f730c005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:14.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.473+0000 7f7326171680 1 -- 172.21.15.153:0/4096419864 shutdown_connections 2023-10-05T21:15:14.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.473+0000 7f7326171680 1 --2- 172.21.15.153:0/4096419864 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d0b52b0 0x55a04d0b56c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.473+0000 7f7326171680 1 -- 172.21.15.153:0/4096419864 >> 172.21.15.153:0/4096419864 conn(0x55a04d0b0b80 msgr2=0x55a04d0b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.473+0000 7f7326171680 1 -- 172.21.15.153:0/4096419864 shutdown_connections 2023-10-05T21:15:14.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.473+0000 7f7326171680 1 -- 172.21.15.153:0/4096419864 wait complete. 2023-10-05T21:15:14.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.474+0000 7f7326171680 1 Processor -- start 2023-10-05T21:15:14.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.474+0000 7f7326171680 1 -- start start 2023-10-05T21:15:14.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.474+0000 7f7326171680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d0b52b0 0x55a04d0d4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.474+0000 7f7326171680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a04cf63ea0 con 0x55a04d0b52b0 2023-10-05T21:15:14.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.474+0000 7f7319249700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d0b52b0 0x55a04d0d4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.475+0000 7f7319249700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d0b52b0 0x55a04d0d4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49920/0 (socket says 172.21.15.153:49920) 2023-10-05T21:15:14.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.475+0000 7f7319249700 1 -- 172.21.15.153:0/1873025898 learned_addr learned my addr 172.21.15.153:0/1873025898 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:14.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.475+0000 7f7319249700 1 -- 172.21.15.153:0/1873025898 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730c005cf0 con 0x55a04d0b52b0 2023-10-05T21:15:14.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.475+0000 7f7319249700 1 --2- 172.21.15.153:0/1873025898 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d0b52b0 0x55a04d0d4590 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f730c005a90 tx=0x7f730c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adbfc3ab5a92533 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.475+0000 7f730affd700 1 -- 172.21.15.153:0/1873025898 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f730c0078e0 con 0x55a04d0b52b0 2023-10-05T21:15:14.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.475+0000 7f730affd700 1 -- 172.21.15.153:0/1873025898 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730c007a40 con 0x55a04d0b52b0 2023-10-05T21:15:14.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.475+0000 7f730affd700 1 -- 172.21.15.153:0/1873025898 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f730c007bb0 con 0x55a04d0b52b0 2023-10-05T21:15:14.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.475+0000 7f7326171680 1 -- 172.21.15.153:0/1873025898 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d0b52b0 msgr2=0x55a04d0d4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.475+0000 7f7326171680 1 --2- 172.21.15.153:0/1873025898 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d0b52b0 0x55a04d0d4590 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f730c005a90 tx=0x7f730c014000 comp rx=0 tx=0).stop 2023-10-05T21:15:14.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.475+0000 7f7326171680 1 -- 172.21.15.153:0/1873025898 shutdown_connections 2023-10-05T21:15:14.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.475+0000 7f7326171680 1 --2- 172.21.15.153:0/1873025898 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d0b52b0 0x55a04d0d4590 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.475+0000 7f7326171680 1 -- 172.21.15.153:0/1873025898 >> 172.21.15.153:0/1873025898 conn(0x55a04d0b0b80 msgr2=0x55a04d0d0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.475+0000 7f7326171680 1 -- 172.21.15.153:0/1873025898 shutdown_connections 2023-10-05T21:15:14.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.476+0000 7f7326171680 1 -- 172.21.15.153:0/1873025898 wait complete. 2023-10-05T21:15:14.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.476+0000 7f7326171680 1 Processor -- start 2023-10-05T21:15:14.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.476+0000 7f7326171680 1 -- start start 2023-10-05T21:15:14.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.476+0000 7f7326171680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d0b52b0 0x55a04d02a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.476+0000 7f7326171680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a04cf5ac80 con 0x55a04d0b52b0 2023-10-05T21:15:14.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.476+0000 7f7319249700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d0b52b0 0x55a04d02a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.476+0000 7f7319249700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d0b52b0 0x55a04d02a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49924/0 (socket says 172.21.15.153:49924) 2023-10-05T21:15:14.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.476+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 learned_addr learned my addr 172.21.15.153:0/4018189895 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:14.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.476+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a04d0b6ea0 con 0x55a04d0b52b0 2023-10-05T21:15:14.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.477+0000 7f7319249700 1 --2- 172.21.15.153:0/4018189895 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d0b52b0 0x55a04d02a8f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f730c00afd0 tx=0x7f730c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.477+0000 7f73097fa700 1 -- 172.21.15.153:0/4018189895 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f730c007e20 con 0x55a04d0b52b0 2023-10-05T21:15:14.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.477+0000 7f73097fa700 1 -- 172.21.15.153:0/4018189895 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730c026440 con 0x55a04d0b52b0 2023-10-05T21:15:14.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.477+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a04d0df7b0 con 0x55a04d0b52b0 2023-10-05T21:15:14.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.477+0000 7f73097fa700 1 -- 172.21.15.153:0/4018189895 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f730c026630 con 0x55a04d0b52b0 2023-10-05T21:15:14.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.477+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a04d0dfc00 con 0x55a04d0b52b0 2023-10-05T21:15:14.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.477+0000 7f73097fa700 1 -- 172.21.15.153:0/4018189895 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f730c026790 con 0x55a04d0b52b0 2023-10-05T21:15:14.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.478+0000 7f7326171680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.478+0000 7f73097fa700 1 --2- 172.21.15.153:0/4018189895 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f72fc034140 0x7f72fc0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.478+0000 7f73097fa700 1 -- 172.21.15.153:0/4018189895 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f730c04a350 con 0x55a04d0b52b0 2023-10-05T21:15:14.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.478+0000 7f7318a48700 1 --2- 172.21.15.153:0/4018189895 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f72fc034140 0x7f72fc0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.478+0000 7f7326171680 1 --2- 172.21.15.153:0/4018189895 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55a04d0e6770 0x55a04d0e8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.478+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0e9320 con 0x55a04d0e6770 2023-10-05T21:15:14.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.478+0000 7f7319a4a700 1 --2- 172.21.15.153:0/4018189895 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55a04d0e6770 0x55a04d0e8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.478+0000 7f7318a48700 1 --2- 172.21.15.153:0/4018189895 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f72fc034140 0x7f72fc0365f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7310004170 tx=0x7f7310001360 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.478+0000 7f7319a4a700 1 --2- 172.21.15.153:0/4018189895 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55a04d0e6770 0x55a04d0e8b90 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.479+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.479+0000 7f7326171680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.479+0000 7f7326171680 20 realm 2023-10-05T21:15:14.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.479+0000 7f7326171680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.479+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0e5de0 con 0x55a04d0e6770 2023-10-05T21:15:14.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.479+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.479+0000 7f7326171680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.479+0000 7f7326171680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:14.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.479+0000 7f7326171680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.479+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0e9e50 con 0x55a04d0e6770 2023-10-05T21:15:14.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.479+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.479+0000 7f7326171680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.479+0000 7f7326171680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.479+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0e9a90 con 0x55a04d0e6770 2023-10-05T21:15:14.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.479+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.479+0000 7f7326171680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.479+0000 7f7326171680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.479+0000 7f7326171680 1 --2- 172.21.15.153:0/4018189895 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55a04d0eb210 0x55a04d0ed5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.479+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0edb30 con 0x55a04d0eb210 2023-10-05T21:15:14.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.480+0000 7f7319249700 1 --2- 172.21.15.153:0/4018189895 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55a04d0eb210 0x55a04d0ed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.480+0000 7f7319249700 1 --2- 172.21.15.153:0/4018189895 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55a04d0eb210 0x55a04d0ed5f0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.480+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f730c037c70 con 0x55a04d0eb210 2023-10-05T21:15:14.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.480+0000 7f7326171680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:14.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.480+0000 7f7326171680 20 searching for the correct realm 2023-10-05T21:15:14.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.480+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x55a04d0eb210 2023-10-05T21:15:14.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.480+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730c037c70 con 0x55a04d0eb210 2023-10-05T21:15:14.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.480+0000 7f7319249700 1 --2- 172.21.15.153:0/4018189895 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f730c007030 0x7f730c048a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.480+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x7f730c007030 2023-10-05T21:15:14.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.480+0000 7f7318a48700 1 --2- 172.21.15.153:0/4018189895 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f730c007030 0x7f730c048a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.481+0000 7f7318a48700 1 --2- 172.21.15.153:0/4018189895 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f730c007030 0x7f730c048a20 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.481+0000 7f7318a48700 1 -- 172.21.15.153:0/4018189895 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7310006070 con 0x7f730c007030 2023-10-05T21:15:14.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.481+0000 7f7318a48700 1 --2- 172.21.15.153:0/4018189895 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f731000ebe0 0x7f731000d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.481+0000 7f7318a48700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x7f731000ebe0 2023-10-05T21:15:14.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.481+0000 7f7319a4a700 1 --2- 172.21.15.153:0/4018189895 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f731000ebe0 0x7f731000d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.482+0000 7f7319a4a700 1 --2- 172.21.15.153:0/4018189895 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f731000ebe0 0x7f731000d8e0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.482+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f731400a570 con 0x7f731000ebe0 2023-10-05T21:15:14.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.482+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x55a04d0e6770 2023-10-05T21:15:14.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.482+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.482+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x55a04d0e6770 2023-10-05T21:15:14.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.482+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.482+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x7f731000ebe0 2023-10-05T21:15:14.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.482+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f731400a570 con 0x7f731000ebe0 2023-10-05T21:15:14.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.482+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x7f731000ebe0 2023-10-05T21:15:14.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.483+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f731400a570 con 0x7f731000ebe0 2023-10-05T21:15:14.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.483+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x7f730c007030 2023-10-05T21:15:14.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.483+0000 7f7318a48700 1 -- 172.21.15.153:0/4018189895 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7310006070 con 0x7f730c007030 2023-10-05T21:15:14.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.483+0000 7f7318a48700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x55a04d0eb210 2023-10-05T21:15:14.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.483+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f730c037c70 con 0x55a04d0eb210 2023-10-05T21:15:14.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.483+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x55a04d0e6770 2023-10-05T21:15:14.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.483+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.483+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x7f731000ebe0 2023-10-05T21:15:14.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.483+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f731400a570 con 0x7f731000ebe0 2023-10-05T21:15:14.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.484+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x55a04d0e6770 2023-10-05T21:15:14.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.484+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.484+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x7f730c007030 2023-10-05T21:15:14.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.484+0000 7f7318a48700 1 -- 172.21.15.153:0/4018189895 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7310006070 con 0x7f730c007030 2023-10-05T21:15:14.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.484+0000 7f7318a48700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x55a04d0eb210 2023-10-05T21:15:14.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.484+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730c037c70 con 0x55a04d0eb210 2023-10-05T21:15:14.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.484+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x55a04d0eb210 2023-10-05T21:15:14.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.484+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730c037c70 con 0x55a04d0eb210 2023-10-05T21:15:14.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.484+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x7f731000ebe0 2023-10-05T21:15:14.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.485+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f731400a570 con 0x7f731000ebe0 2023-10-05T21:15:14.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.485+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x55a04d0eb210 2023-10-05T21:15:14.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.485+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730c037c70 con 0x55a04d0eb210 2023-10-05T21:15:14.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.485+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x55a04d0eb210 2023-10-05T21:15:14.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.485+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730c037c70 con 0x55a04d0eb210 2023-10-05T21:15:14.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.485+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x55a04d0e6770 2023-10-05T21:15:14.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.485+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.485+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x55a04d0e6770 2023-10-05T21:15:14.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.485+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.485+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x7f731000ebe0 2023-10-05T21:15:14.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.486+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f731400a570 con 0x7f731000ebe0 2023-10-05T21:15:14.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.486+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x55a04d0eb210 2023-10-05T21:15:14.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.486+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730c037c70 con 0x55a04d0eb210 2023-10-05T21:15:14.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.486+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x7f730c007030 2023-10-05T21:15:14.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.486+0000 7f7318a48700 1 -- 172.21.15.153:0/4018189895 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7310006070 con 0x7f730c007030 2023-10-05T21:15:14.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.486+0000 7f7318a48700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x55a04d0e6770 2023-10-05T21:15:14.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.486+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.486+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x7f731000ebe0 2023-10-05T21:15:14.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.487+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f731400a570 con 0x7f731000ebe0 2023-10-05T21:15:14.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.487+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x55a04d0eb210 2023-10-05T21:15:14.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.487+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730c037c70 con 0x55a04d0eb210 2023-10-05T21:15:14.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.487+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x7f731000ebe0 2023-10-05T21:15:14.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.488+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f731400a570 con 0x7f731000ebe0 2023-10-05T21:15:14.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.488+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x7f730c007030 2023-10-05T21:15:14.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.488+0000 7f7318a48700 1 -- 172.21.15.153:0/4018189895 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7310006070 con 0x7f730c007030 2023-10-05T21:15:14.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.488+0000 7f7318a48700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x55a04d0eb210 2023-10-05T21:15:14.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.488+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730c037c70 con 0x55a04d0eb210 2023-10-05T21:15:14.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.488+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x7f731000ebe0 2023-10-05T21:15:14.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.488+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f731400a570 con 0x7f731000ebe0 2023-10-05T21:15:14.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.488+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x55a04d0e6770 2023-10-05T21:15:14.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.489+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.489+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef3e0 con 0x7f730c007030 2023-10-05T21:15:14.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.489+0000 7f7318a48700 1 -- 172.21.15.153:0/4018189895 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7310006070 con 0x7f730c007030 2023-10-05T21:15:14.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.489+0000 7f7326171680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:14.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.489+0000 7f7326171680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:14.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.489+0000 7f7326171680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:14.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.489+0000 7f7326171680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:14.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.489+0000 7f7326171680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.489+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ee500 con 0x55a04d0e6770 2023-10-05T21:15:14.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.489+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.489+0000 7f7326171680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.489+0000 7f7326171680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.489+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ee990 con 0x55a04d0e6770 2023-10-05T21:15:14.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.489+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.489+0000 7f7326171680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.489+0000 7f7326171680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.489+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0eedc0 con 0x55a04d0e6770 2023-10-05T21:15:14.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.490+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.490+0000 7f7326171680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:14.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.490+0000 7f7326171680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.490+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ef790 con 0x55a04d0eb210 2023-10-05T21:15:14.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.490+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f730c037c70 con 0x55a04d0eb210 2023-10-05T21:15:14.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.490+0000 7f7326171680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.490+0000 7f7326171680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.490+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0efb40 con 0x55a04d0e6770 2023-10-05T21:15:14.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.490+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.490+0000 7f7326171680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.490+0000 7f7326171680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.490+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ee100 con 0x55a04d0e6770 2023-10-05T21:15:14.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.490+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.490+0000 7f7326171680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.490+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ee0d0 con 0x55a04d0eb210 2023-10-05T21:15:14.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.491+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730c037c70 con 0x55a04d0eb210 2023-10-05T21:15:14.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.491+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ee0d0 con 0x7f730c007030 2023-10-05T21:15:14.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.491+0000 7f7318a48700 1 -- 172.21.15.153:0/4018189895 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7310006070 con 0x7f730c007030 2023-10-05T21:15:14.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.491+0000 7f7318a48700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ee0d0 con 0x7f731000ebe0 2023-10-05T21:15:14.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.491+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f731400a570 con 0x7f731000ebe0 2023-10-05T21:15:14.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.491+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0efb40 con 0x55a04d0e6770 2023-10-05T21:15:14.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.491+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.491+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0efb40 con 0x55a04d0e6770 2023-10-05T21:15:14.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.492+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.492+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0efb40 con 0x7f731000ebe0 2023-10-05T21:15:14.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.492+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f731400a570 con 0x7f731000ebe0 2023-10-05T21:15:14.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.492+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0efb40 con 0x7f731000ebe0 2023-10-05T21:15:14.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.492+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f731400a570 con 0x7f731000ebe0 2023-10-05T21:15:14.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.492+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0efb40 con 0x7f730c007030 2023-10-05T21:15:14.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.492+0000 7f7318a48700 1 -- 172.21.15.153:0/4018189895 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7310006070 con 0x7f730c007030 2023-10-05T21:15:14.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.492+0000 7f7318a48700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0efb40 con 0x55a04d0eb210 2023-10-05T21:15:14.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.493+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f730c037c70 con 0x55a04d0eb210 2023-10-05T21:15:14.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.493+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0efb40 con 0x55a04d0e6770 2023-10-05T21:15:14.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.493+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.493+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0efb40 con 0x7f731000ebe0 2023-10-05T21:15:14.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.493+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f731400a570 con 0x7f731000ebe0 2023-10-05T21:15:14.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.493+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0efb40 con 0x55a04d0e6770 2023-10-05T21:15:14.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.493+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.493+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0efb40 con 0x7f730c007030 2023-10-05T21:15:14.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.493+0000 7f7318a48700 1 -- 172.21.15.153:0/4018189895 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7310006070 con 0x7f730c007030 2023-10-05T21:15:14.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.493+0000 7f7318a48700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0efb40 con 0x55a04d0eb210 2023-10-05T21:15:14.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.494+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730c037c70 con 0x55a04d0eb210 2023-10-05T21:15:14.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.494+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0efb40 con 0x55a04d0eb210 2023-10-05T21:15:14.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.494+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730c037c70 con 0x55a04d0eb210 2023-10-05T21:15:14.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.494+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0efb40 con 0x7f731000ebe0 2023-10-05T21:15:14.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.494+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f731400a570 con 0x7f731000ebe0 2023-10-05T21:15:14.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.494+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0efb40 con 0x55a04d0eb210 2023-10-05T21:15:14.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.494+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730c037c70 con 0x55a04d0eb210 2023-10-05T21:15:14.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.494+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0efb40 con 0x55a04d0eb210 2023-10-05T21:15:14.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.494+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730c037c70 con 0x55a04d0eb210 2023-10-05T21:15:14.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.494+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0efb40 con 0x55a04d0e6770 2023-10-05T21:15:14.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.495+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.495+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0efb40 con 0x55a04d0e6770 2023-10-05T21:15:14.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.495+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.495+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0efb40 con 0x7f731000ebe0 2023-10-05T21:15:14.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.495+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f731400a570 con 0x7f731000ebe0 2023-10-05T21:15:14.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.495+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0efb40 con 0x55a04d0eb210 2023-10-05T21:15:14.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.495+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730c037c70 con 0x55a04d0eb210 2023-10-05T21:15:14.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.495+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0efb40 con 0x7f730c007030 2023-10-05T21:15:14.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.495+0000 7f7318a48700 1 -- 172.21.15.153:0/4018189895 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7310006070 con 0x7f730c007030 2023-10-05T21:15:14.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.495+0000 7f7318a48700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0efb40 con 0x55a04d0e6770 2023-10-05T21:15:14.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.496+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.496+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0efb40 con 0x7f731000ebe0 2023-10-05T21:15:14.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.496+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f731400a570 con 0x7f731000ebe0 2023-10-05T21:15:14.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.496+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0efb40 con 0x55a04d0eb210 2023-10-05T21:15:14.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.496+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730c037c70 con 0x55a04d0eb210 2023-10-05T21:15:14.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.496+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0efb40 con 0x7f731000ebe0 2023-10-05T21:15:14.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.496+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f731400a570 con 0x7f731000ebe0 2023-10-05T21:15:14.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.496+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0efb40 con 0x7f730c007030 2023-10-05T21:15:14.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.497+0000 7f7318a48700 1 -- 172.21.15.153:0/4018189895 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7310006070 con 0x7f730c007030 2023-10-05T21:15:14.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.497+0000 7f7318a48700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0efb40 con 0x55a04d0eb210 2023-10-05T21:15:14.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.497+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730c037c70 con 0x55a04d0eb210 2023-10-05T21:15:14.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.497+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0efb40 con 0x7f731000ebe0 2023-10-05T21:15:14.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.497+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f731400a570 con 0x7f731000ebe0 2023-10-05T21:15:14.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.497+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0efb40 con 0x55a04d0e6770 2023-10-05T21:15:14.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.497+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.497+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0efb40 con 0x7f730c007030 2023-10-05T21:15:14.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.497+0000 7f7318a48700 1 -- 172.21.15.153:0/4018189895 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7310006070 con 0x7f730c007030 2023-10-05T21:15:14.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.497+0000 7f7326171680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:14.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.497+0000 7f7326171680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:14.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.497+0000 7f7326171680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:14.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.497+0000 7f7326171680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:14.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.497+0000 7f7326171680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.497+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0ee0d0 con 0x55a04d0e6770 2023-10-05T21:15:14.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.498+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.498+0000 7f7326171680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.498+0000 7f7326171680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.498+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f0480 con 0x55a04d0eb210 2023-10-05T21:15:14.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.498+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f730c037c70 con 0x55a04d0eb210 2023-10-05T21:15:14.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.498+0000 7f7326171680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:14.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.498+0000 7f7326171680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.498+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f0d20 con 0x55a04d0e6770 2023-10-05T21:15:14.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.498+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.498+0000 7f7326171680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.498+0000 7f7326171680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.498+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f0d20 con 0x55a04d0e6770 2023-10-05T21:15:14.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.498+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.499+0000 7f7326171680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:14.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.499+0000 7f7326171680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.499+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f0e20 con 0x7f731000ebe0 2023-10-05T21:15:14.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.499+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f731400a570 con 0x7f731000ebe0 2023-10-05T21:15:14.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.499+0000 7f7326171680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.499+0000 7f7326171680 20 zone default found 2023-10-05T21:15:14.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.499+0000 7f7326171680 4 Realm: () 2023-10-05T21:15:14.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.499+0000 7f7326171680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:14.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.499+0000 7f7326171680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:14.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.499+0000 7f7326171680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:14.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.499+0000 7f7326171680 20 zonegroup default 2023-10-05T21:15:14.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.499+0000 7f7326171680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.499+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f0e20 con 0x7f731000ebe0 2023-10-05T21:15:14.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.499+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f731400a570 con 0x7f731000ebe0 2023-10-05T21:15:14.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.499+0000 7f7326171680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.499+0000 7f7326171680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.499+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f27a0 con 0x55a04d0eb210 2023-10-05T21:15:14.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.499+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f730c037c70 con 0x55a04d0eb210 2023-10-05T21:15:14.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.499+0000 7f7326171680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.499+0000 7f7326171680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.499+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f2b50 con 0x55a04d0eb210 2023-10-05T21:15:14.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.500+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f730c037c70 con 0x55a04d0eb210 2023-10-05T21:15:14.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.500+0000 7f7326171680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.500+0000 7f7326171680 20 started sync module instance, tier type = 2023-10-05T21:15:14.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.500+0000 7f7326171680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:14.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.500+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f1e60 con 0x7f730c007030 2023-10-05T21:15:14.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.500+0000 7f7318a48700 1 -- 172.21.15.153:0/4018189895 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7310006070 con 0x7f730c007030 2023-10-05T21:15:14.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.500+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94146975965792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f33f0 con 0x7f730c007030 2023-10-05T21:15:14.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.500+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f3c90 con 0x55a04d0e6770 2023-10-05T21:15:14.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.501+0000 7f7318a48700 1 -- 172.21.15.153:0/4018189895 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94146975965792] v29'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7310006070 con 0x7f730c007030 2023-10-05T21:15:14.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.501+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.501+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94146975969056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f3cf0 con 0x55a04d0e6770 2023-10-05T21:15:14.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.501+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f48f0 con 0x55a04d0eb210 2023-10-05T21:15:14.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.502+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94146975969056] v29'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.502+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f730c037c70 con 0x55a04d0eb210 2023-10-05T21:15:14.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.502+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94146975974272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f4cf0 con 0x55a04d0eb210 2023-10-05T21:15:14.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.502+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f5700 con 0x7f730c007030 2023-10-05T21:15:14.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.503+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94146975974272] v29'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f730c037c70 con 0x55a04d0eb210 2023-10-05T21:15:14.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.503+0000 7f7318a48700 1 -- 172.21.15.153:0/4018189895 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7310006070 con 0x7f730c007030 2023-10-05T21:15:14.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.503+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94146975971232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f5350 con 0x7f730c007030 2023-10-05T21:15:14.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.503+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f6710 con 0x55a04d0e6770 2023-10-05T21:15:14.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.503+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.503+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94146975981984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f7000 con 0x55a04d0e6770 2023-10-05T21:15:14.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.503+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f7b60 con 0x7f731000ebe0 2023-10-05T21:15:14.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.503+0000 7f7318a48700 1 -- 172.21.15.153:0/4018189895 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94146975971232] v29'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7310006070 con 0x7f730c007030 2023-10-05T21:15:14.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.504+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94146975981984] v29'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.504+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f731400a570 con 0x7f731000ebe0 2023-10-05T21:15:14.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.504+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94146975987216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f6ac0 con 0x7f731000ebe0 2023-10-05T21:15:14.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.504+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f8450 con 0x7f731000ebe0 2023-10-05T21:15:14.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.505+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(96 notify.6 [create] v29'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f731400a570 con 0x7f731000ebe0 2023-10-05T21:15:14.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.505+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(95 notify.5 [watch watch cookie 94146975987216] v29'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f731400a570 con 0x7f731000ebe0 2023-10-05T21:15:14.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.505+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94146975989136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f81e0 con 0x7f731000ebe0 2023-10-05T21:15:14.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.505+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f8a80 con 0x7f731000ebe0 2023-10-05T21:15:14.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.506+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94146975989136] v29'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f731400a570 con 0x7f731000ebe0 2023-10-05T21:15:14.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.506+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f731400a570 con 0x7f731000ebe0 2023-10-05T21:15:14.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.506+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94146975990240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f8e80 con 0x7f731000ebe0 2023-10-05T21:15:14.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.506+0000 7f7326171680 20 add_watcher() i=0 2023-10-05T21:15:14.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.506+0000 7f7326171680 20 add_watcher() i=1 2023-10-05T21:15:14.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.506+0000 7f7326171680 20 add_watcher() i=2 2023-10-05T21:15:14.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.506+0000 7f7326171680 20 add_watcher() i=3 2023-10-05T21:15:14.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.506+0000 7f7326171680 20 add_watcher() i=4 2023-10-05T21:15:14.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.506+0000 7f7326171680 20 add_watcher() i=5 2023-10-05T21:15:14.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.506+0000 7f7326171680 20 add_watcher() i=6 2023-10-05T21:15:14.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.506+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94146975990240] v29'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f731400a570 con 0x7f731000ebe0 2023-10-05T21:15:14.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.506+0000 7f7326171680 20 add_watcher() i=7 2023-10-05T21:15:14.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.506+0000 7f7326171680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:14.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.506+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0fbeb0 con 0x55a04d0e6770 2023-10-05T21:15:14.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.507+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.507+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94146975991808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f92f0 con 0x55a04d0e6770 2023-10-05T21:15:14.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.507+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94146975991808] v29'76 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.508+0000 7f72ea7e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:14.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.508+0000 7f7326171680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:14.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.508+0000 7f7326171680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:14.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.508+0000 7f7326171680 1 Processor -- start 2023-10-05T21:15:14.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.508+0000 7f7326171680 1 -- start start 2023-10-05T21:15:14.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.508+0000 7f7326171680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d1068c0 0x55a04d106cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.508+0000 7f7326171680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a04d1072a0 con 0x55a04d1068c0 2023-10-05T21:15:14.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.508+0000 7f7318a48700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d1068c0 0x55a04d106cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.508+0000 7f7318a48700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d1068c0 0x55a04d106cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49928/0 (socket says 172.21.15.153:49928) 2023-10-05T21:15:14.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.508+0000 7f7318a48700 1 -- 172.21.15.153:0/4072068597 learned_addr learned my addr 172.21.15.153:0/4072068597 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:14.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.509+0000 7f7318a48700 1 -- 172.21.15.153:0/4072068597 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a04d1073e0 con 0x55a04d1068c0 2023-10-05T21:15:14.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.509+0000 7f7318a48700 1 --2- 172.21.15.153:0/4072068597 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d1068c0 0x55a04d106cd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55a04d0e5d70 tx=0x7f7310006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6885bdd2a6ced3c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.509+0000 7f72e9fe3700 1 -- 172.21.15.153:0/4072068597 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7310023040 con 0x55a04d1068c0 2023-10-05T21:15:14.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.509+0000 7f72e9fe3700 1 -- 172.21.15.153:0/4072068597 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7310024040 con 0x55a04d1068c0 2023-10-05T21:15:14.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.509+0000 7f72e9fe3700 1 -- 172.21.15.153:0/4072068597 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7310013040 con 0x55a04d1068c0 2023-10-05T21:15:14.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.510+0000 7f7326171680 1 -- 172.21.15.153:0/4072068597 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d1068c0 msgr2=0x55a04d106cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.510+0000 7f7326171680 1 --2- 172.21.15.153:0/4072068597 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d1068c0 0x55a04d106cd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55a04d0e5d70 tx=0x7f7310006000 comp rx=0 tx=0).stop 2023-10-05T21:15:14.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.510+0000 7f7326171680 1 -- 172.21.15.153:0/4072068597 shutdown_connections 2023-10-05T21:15:14.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.510+0000 7f7326171680 1 --2- 172.21.15.153:0/4072068597 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d1068c0 0x55a04d106cd0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.510+0000 7f7326171680 1 -- 172.21.15.153:0/4072068597 >> 172.21.15.153:0/4072068597 conn(0x55a04d101ac0 msgr2=0x55a04d0ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.510+0000 7f7326171680 1 -- 172.21.15.153:0/4072068597 shutdown_connections 2023-10-05T21:15:14.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.510+0000 7f7326171680 1 -- 172.21.15.153:0/4072068597 wait complete. 2023-10-05T21:15:14.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.510+0000 7f7326171680 1 Processor -- start 2023-10-05T21:15:14.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.510+0000 7f7326171680 1 -- start start 2023-10-05T21:15:14.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.510+0000 7f7326171680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d1068c0 0x55a04d10c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.510+0000 7f7326171680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a04d10c9e0 con 0x55a04d1068c0 2023-10-05T21:15:14.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.510+0000 7f7318a48700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d1068c0 0x55a04d10c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.510+0000 7f7318a48700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d1068c0 0x55a04d10c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49940/0 (socket says 172.21.15.153:49940) 2023-10-05T21:15:14.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.510+0000 7f7318a48700 1 -- 172.21.15.153:0/1986000114 learned_addr learned my addr 172.21.15.153:0/1986000114 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:14.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.511+0000 7f7318a48700 1 -- 172.21.15.153:0/1986000114 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7304001e10 con 0x55a04d1068c0 2023-10-05T21:15:14.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.511+0000 7f7318a48700 1 --2- 172.21.15.153:0/1986000114 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d1068c0 0x55a04d10c4a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55a04d101030 tx=0x7f7310030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.511+0000 7f725bfff700 1 -- 172.21.15.153:0/1986000114 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7310023070 con 0x55a04d1068c0 2023-10-05T21:15:14.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.511+0000 7f725bfff700 1 -- 172.21.15.153:0/1986000114 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731001e630 con 0x55a04d1068c0 2023-10-05T21:15:14.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.511+0000 7f725bfff700 1 -- 172.21.15.153:0/1986000114 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f731001e7e0 con 0x55a04d1068c0 2023-10-05T21:15:14.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.511+0000 7f7326171680 1 -- 172.21.15.153:0/1986000114 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a04d10cbe0 con 0x55a04d1068c0 2023-10-05T21:15:14.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.511+0000 7f7326171680 1 -- 172.21.15.153:0/1986000114 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a04d10d030 con 0x55a04d1068c0 2023-10-05T21:15:14.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.512+0000 7f725bfff700 1 -- 172.21.15.153:0/1986000114 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f731003f040 con 0x55a04d1068c0 2023-10-05T21:15:14.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.512+0000 7f725bfff700 1 --2- 172.21.15.153:0/1986000114 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7260034140 0x7f72600365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.512+0000 7f725bfff700 1 -- 172.21.15.153:0/1986000114 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f731004cb00 con 0x55a04d1068c0 2023-10-05T21:15:14.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.512+0000 7f7319a4a700 1 --2- 172.21.15.153:0/1986000114 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7260034140 0x7f72600365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.512+0000 7f7326171680 5 note: GC not initialized 2023-10-05T21:15:14.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.512+0000 7f7319a4a700 1 --2- 172.21.15.153:0/1986000114 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7260034140 0x7f72600365f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x55a04d0f8d40 tx=0x7f7314036440 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.513+0000 7f72597fa700 20 reqs_thread_entry: start 2023-10-05T21:15:14.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.513+0000 7f7252ffd700 20 reqs_thread_entry: start 2023-10-05T21:15:14.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.513+0000 7f7326171680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:14.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.513+0000 7f7326171680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:14.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.513+0000 7f72517fa700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:44 2023 2023-10-05T21:15:14.547 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:14.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.514+0000 7f7250ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:14.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.514+0000 7f7326171680 20 get_system_obj_state: rctx=0x7fff9ba78738 obj=default.rgw.meta:users.uid:foo state=0x55a04cf69240 s->prefetch_data=0 2023-10-05T21:15:14.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.514+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d171d70 con 0x55a04d0e6770 2023-10-05T21:15:14.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.514+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.514+0000 7f7326171680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:14.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.514+0000 7f7326171680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:14.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.514+0000 7f7326171680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.514+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d174000 con 0x55a04d0e6770 2023-10-05T21:15:14.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.514+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 273+0+636 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.514+0000 7f7326171680 20 rados_obj.operate() r=0 bl.length=513 2023-10-05T21:15:14.548 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:14.548 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "foo", 2023-10-05T21:15:14.548 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Foo", 2023-10-05T21:15:14.548 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "foo@foo.com", 2023-10-05T21:15:14.549 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2023-10-05T21:15:14.549 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 4, 2023-10-05T21:15:14.549 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [ 2023-10-05T21:15:14.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:14.549 INFO:teuthology.orchestra.run.smithi153.stdout: "id": "foo:foo1", 2023-10-05T21:15:14.549 INFO:teuthology.orchestra.run.smithi153.stdout: "permissions": "full-control" 2023-10-05T21:15:14.549 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:14.549 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:14.549 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2023-10-05T21:15:14.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:14.549 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:14.549 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:14.550 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T21:15:14.550 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:14.550 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:14.550 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [ 2023-10-05T21:15:14.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:14.550 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo:foo1", 2023-10-05T21:15:14.550 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL" 2023-10-05T21:15:14.550 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:14.550 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:14.550 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2023-10-05T21:15:14.550 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2023-10-05T21:15:14.550 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2023-10-05T21:15:14.551 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2023-10-05T21:15:14.551 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2023-10-05T21:15:14.551 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:15:14.551 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:14.551 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:14.551 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:14.551 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:14.551 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:14.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:14.551 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2023-10-05T21:15:14.551 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:14.551 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:14.552 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:14.552 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:14.552 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:14.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:14.552 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2023-10-05T21:15:14.552 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2023-10-05T21:15:14.552 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [] 2023-10-05T21:15:14.552 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:14.552 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:15:14.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.515+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94146975965792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d130560 con 0x7f730c007030 2023-10-05T21:15:14.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.515+0000 7f7318a48700 1 -- 172.21.15.153:0/4018189895 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94146975965792] v29'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7310006070 con 0x7f730c007030 2023-10-05T21:15:14.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.515+0000 7f7326171680 20 remove_watcher() i=0 2023-10-05T21:15:14.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.515+0000 7f7326171680 2 removed watcher, disabling cache 2023-10-05T21:15:14.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.515+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94146975969056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f2260 con 0x55a04d0e6770 2023-10-05T21:15:14.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.516+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94146975969056] v29'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.516+0000 7f7326171680 20 remove_watcher() i=1 2023-10-05T21:15:14.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.516+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94146975974272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f2260 con 0x55a04d0eb210 2023-10-05T21:15:14.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.517+0000 7f7319249700 1 -- 172.21.15.153:0/4018189895 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94146975974272] v29'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f730c037c70 con 0x55a04d0eb210 2023-10-05T21:15:14.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.517+0000 7f7326171680 20 remove_watcher() i=2 2023-10-05T21:15:14.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.517+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94146975971232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f4380 con 0x7f730c007030 2023-10-05T21:15:14.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.518+0000 7f7318a48700 1 -- 172.21.15.153:0/4018189895 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94146975971232] v29'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7310006070 con 0x7f730c007030 2023-10-05T21:15:14.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.518+0000 7f7326171680 20 remove_watcher() i=3 2023-10-05T21:15:14.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.518+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94146975981984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f2260 con 0x55a04d0e6770 2023-10-05T21:15:14.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.518+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94146975981984] v29'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.518+0000 7f7326171680 20 remove_watcher() i=4 2023-10-05T21:15:14.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.518+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94146975987216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f4380 con 0x7f731000ebe0 2023-10-05T21:15:14.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.519+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94146975987216] v29'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f731400a570 con 0x7f731000ebe0 2023-10-05T21:15:14.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.519+0000 7f7326171680 20 remove_watcher() i=5 2023-10-05T21:15:14.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.519+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94146975989136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f61a0 con 0x7f731000ebe0 2023-10-05T21:15:14.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.520+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94146975989136] v29'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f731400a570 con 0x7f731000ebe0 2023-10-05T21:15:14.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.520+0000 7f7326171680 20 remove_watcher() i=6 2023-10-05T21:15:14.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.520+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94146975990240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f2260 con 0x7f731000ebe0 2023-10-05T21:15:14.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.520+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94146975990240] v29'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f731400a570 con 0x7f731000ebe0 2023-10-05T21:15:14.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.520+0000 7f7326171680 20 remove_watcher() i=7 2023-10-05T21:15:14.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.521+0000 7f72ea7e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:14.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.521+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:112 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94146975991808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a04d0f61a0 con 0x55a04d0e6770 2023-10-05T21:15:14.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.522+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(112 data_loggenerations_metadata [watch unwatch cookie 94146975991808] v29'77 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f731400a570 con 0x55a04d0e6770 2023-10-05T21:15:14.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.522+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f731000ebe0 msgr2=0x7f731000d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.522+0000 7f7326171680 1 --2- 172.21.15.153:0/4018189895 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f731000ebe0 0x7f731000d8e0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.522+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55a04d0e6770 msgr2=0x55a04d0e8b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.522+0000 7f7326171680 1 --2- 172.21.15.153:0/4018189895 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55a04d0e6770 0x55a04d0e8b90 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.522+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f730c007030 msgr2=0x7f730c048a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.522+0000 7f7326171680 1 --2- 172.21.15.153:0/4018189895 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f730c007030 0x7f730c048a20 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.522+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55a04d0eb210 msgr2=0x55a04d0ed5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.522+0000 7f7326171680 1 --2- 172.21.15.153:0/4018189895 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55a04d0eb210 0x55a04d0ed5f0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.522+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f72fc034140 msgr2=0x7f72fc0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.522+0000 7f7326171680 1 --2- 172.21.15.153:0/4018189895 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f72fc034140 0x7f72fc0365f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7310004170 tx=0x7f7310001360 comp rx=0 tx=0).stop 2023-10-05T21:15:14.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.522+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d0b52b0 msgr2=0x55a04d02a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.522+0000 7f7326171680 1 --2- 172.21.15.153:0/4018189895 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d0b52b0 0x55a04d02a8f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f730c00afd0 tx=0x7f730c01c000 comp rx=0 tx=0).stop 2023-10-05T21:15:14.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.522+0000 7f7319a4a700 1 -- 172.21.15.153:0/4018189895 reap_dead start 2023-10-05T21:15:14.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.522+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 shutdown_connections 2023-10-05T21:15:14.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.522+0000 7f7326171680 1 --2- 172.21.15.153:0/4018189895 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d0b52b0 0x55a04d02a8f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.522+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 >> 172.21.15.153:0/4018189895 conn(0x55a04d0b0b80 msgr2=0x55a04d0ce8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.522+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 shutdown_connections 2023-10-05T21:15:14.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.522+0000 7f7326171680 1 -- 172.21.15.153:0/4018189895 wait complete. 2023-10-05T21:15:14.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.522+0000 7f7326171680 1 -- 172.21.15.153:0/1986000114 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7260034140 msgr2=0x7f72600365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.522+0000 7f7326171680 1 --2- 172.21.15.153:0/1986000114 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7260034140 0x7f72600365f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x55a04d0f8d40 tx=0x7f7314036440 comp rx=0 tx=0).stop 2023-10-05T21:15:14.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.523+0000 7f7326171680 1 -- 172.21.15.153:0/1986000114 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d1068c0 msgr2=0x55a04d10c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.523+0000 7f7326171680 1 --2- 172.21.15.153:0/1986000114 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d1068c0 0x55a04d10c4a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55a04d101030 tx=0x7f7310030000 comp rx=0 tx=0).stop 2023-10-05T21:15:14.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.523+0000 7f7326171680 1 -- 172.21.15.153:0/1986000114 shutdown_connections 2023-10-05T21:15:14.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.523+0000 7f7326171680 1 --2- 172.21.15.153:0/1986000114 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7260034140 0x7f72600365f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.523+0000 7f7326171680 1 --2- 172.21.15.153:0/1986000114 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a04d1068c0 0x55a04d10c4a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.523+0000 7f7326171680 1 -- 172.21.15.153:0/1986000114 >> 172.21.15.153:0/1986000114 conn(0x55a04d101ac0 msgr2=0x55a04d0ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.523+0000 7f7326171680 1 -- 172.21.15.153:0/1986000114 shutdown_connections 2023-10-05T21:15:14.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.523+0000 7f7326171680 1 -- 172.21.15.153:0/1986000114 wait complete. 2023-10-05T21:15:14.567 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:15:14.567 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2023-10-05T21:15:14.567 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2023-10-05T21:15:14.568 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2023-10-05T21:15:14.616 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:14.616 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:14.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.615+0000 7ff14d0d1680 1 Processor -- start 2023-10-05T21:15:14.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.615+0000 7ff14d0d1680 1 -- start start 2023-10-05T21:15:14.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.615+0000 7ff14d0d1680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55a522cc6750 0x55a522cc6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.615+0000 7ff14d0d1680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a522c15930 con 0x55a522cc70a0 2023-10-05T21:15:14.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.615+0000 7ff14d0d1680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a522bd5db0 con 0x55a522cc6750 2023-10-05T21:15:14.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.615+0000 7ff1401a9700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55a522cc6750 0x55a522cc6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.615+0000 7ff13f9a8700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55a522cc70a0 0x55a522cc9950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56310/0 (socket says 172.21.15.153:56310) 2023-10-05T21:15:14.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.615+0000 7ff13f9a8700 1 -- 172.21.15.153:0/1707691794 learned_addr learned my addr 172.21.15.153:0/1707691794 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:14.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.616+0000 7ff1401a9700 1 -- 172.21.15.153:0/1707691794 >> v1:172.21.15.111:6789/0 conn(0x55a522cc70a0 legacy=0x55a522cc9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.616+0000 7ff1401a9700 1 -- 172.21.15.153:0/1707691794 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a522cca150 con 0x55a522cc6750 2023-10-05T21:15:14.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.616+0000 7ff1401a9700 1 --2- 172.21.15.153:0/1707691794 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522cc6750 0x55a522cc6b60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff13000a520 tx=0x7ff130005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa3c5521351ba76 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.616+0000 7ff13f1a7700 1 -- 172.21.15.153:0/1707691794 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff13000f590 con 0x55a522cc6750 2023-10-05T21:15:14.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.616+0000 7ff13f1a7700 1 -- 172.21.15.153:0/1707691794 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13000f6f0 con 0x55a522cc6750 2023-10-05T21:15:14.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.616+0000 7ff13f1a7700 1 -- 172.21.15.153:0/1707691794 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff13000f880 con 0x55a522cc6750 2023-10-05T21:15:14.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.616+0000 7ff14d0d1680 1 -- 172.21.15.153:0/1707691794 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522cc6750 msgr2=0x55a522cc6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.616+0000 7ff14d0d1680 1 --2- 172.21.15.153:0/1707691794 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522cc6750 0x55a522cc6b60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff13000a520 tx=0x7ff130005d40 comp rx=0 tx=0).stop 2023-10-05T21:15:14.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.617+0000 7ff14d0d1680 1 -- 172.21.15.153:0/1707691794 shutdown_connections 2023-10-05T21:15:14.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.617+0000 7ff14d0d1680 1 --2- 172.21.15.153:0/1707691794 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522cc6750 0x55a522cc6b60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.617+0000 7ff14d0d1680 1 -- 172.21.15.153:0/1707691794 >> 172.21.15.153:0/1707691794 conn(0x55a522cc22a0 msgr2=0x55a522cc46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.617+0000 7ff14d0d1680 1 -- 172.21.15.153:0/1707691794 shutdown_connections 2023-10-05T21:15:14.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.617+0000 7ff14d0d1680 1 -- 172.21.15.153:0/1707691794 wait complete. 2023-10-05T21:15:14.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.617+0000 7ff14d0d1680 1 Processor -- start 2023-10-05T21:15:14.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.617+0000 7ff14d0d1680 1 -- start start 2023-10-05T21:15:14.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.618+0000 7ff14d0d1680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522cc6750 0x55a522ce7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.618+0000 7ff14d0d1680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a522b75ea0 con 0x55a522cc6750 2023-10-05T21:15:14.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.618+0000 7ff1401a9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522cc6750 0x55a522ce7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.618+0000 7ff1401a9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522cc6750 0x55a522ce7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49958/0 (socket says 172.21.15.153:49958) 2023-10-05T21:15:14.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.618+0000 7ff1401a9700 1 -- 172.21.15.153:0/3659255584 learned_addr learned my addr 172.21.15.153:0/3659255584 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:14.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.618+0000 7ff1401a9700 1 -- 172.21.15.153:0/3659255584 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13000a0e0 con 0x55a522cc6750 2023-10-05T21:15:14.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.618+0000 7ff1401a9700 1 --2- 172.21.15.153:0/3659255584 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522cc6750 0x55a522ce7aa0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff130000f80 tx=0x7ff130014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9ce0e9ca70d5c2a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.618+0000 7ff13e1a5700 1 -- 172.21.15.153:0/3659255584 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff13000f860 con 0x55a522cc6750 2023-10-05T21:15:14.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.618+0000 7ff13e1a5700 1 -- 172.21.15.153:0/3659255584 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13000f9e0 con 0x55a522cc6750 2023-10-05T21:15:14.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.618+0000 7ff13e1a5700 1 -- 172.21.15.153:0/3659255584 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff13000fb90 con 0x55a522cc6750 2023-10-05T21:15:14.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.619+0000 7ff14d0d1680 1 -- 172.21.15.153:0/3659255584 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522cc6750 msgr2=0x55a522ce7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.619+0000 7ff14d0d1680 1 --2- 172.21.15.153:0/3659255584 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522cc6750 0x55a522ce7aa0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff130000f80 tx=0x7ff130014000 comp rx=0 tx=0).stop 2023-10-05T21:15:14.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.619+0000 7ff14d0d1680 1 -- 172.21.15.153:0/3659255584 shutdown_connections 2023-10-05T21:15:14.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.619+0000 7ff14d0d1680 1 --2- 172.21.15.153:0/3659255584 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522cc6750 0x55a522ce7aa0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.619+0000 7ff14d0d1680 1 -- 172.21.15.153:0/3659255584 >> 172.21.15.153:0/3659255584 conn(0x55a522cc22a0 msgr2=0x55a522ce3570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.619+0000 7ff14d0d1680 1 -- 172.21.15.153:0/3659255584 shutdown_connections 2023-10-05T21:15:14.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.619+0000 7ff14d0d1680 1 -- 172.21.15.153:0/3659255584 wait complete. 2023-10-05T21:15:14.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.619+0000 7ff14d0d1680 1 Processor -- start 2023-10-05T21:15:14.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.619+0000 7ff14d0d1680 1 -- start start 2023-10-05T21:15:14.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.619+0000 7ff14d0d1680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522cc6750 0x55a522cc91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.619+0000 7ff14d0d1680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a522b6cc80 con 0x55a522cc6750 2023-10-05T21:15:14.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.620+0000 7ff1401a9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522cc6750 0x55a522cc91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.620+0000 7ff1401a9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522cc6750 0x55a522cc91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49960/0 (socket says 172.21.15.153:49960) 2023-10-05T21:15:14.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.620+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 learned_addr learned my addr 172.21.15.153:0/2739069251 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:14.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.620+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a522cca150 con 0x55a522cc6750 2023-10-05T21:15:14.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.620+0000 7ff1401a9700 1 --2- 172.21.15.153:0/2739069251 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522cc6750 0x55a522cc91c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff130005b20 tx=0x7ff13001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.620+0000 7ff13c9a2700 1 -- 172.21.15.153:0/2739069251 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff13002f430 con 0x55a522cc6750 2023-10-05T21:15:14.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.620+0000 7ff13c9a2700 1 -- 172.21.15.153:0/2739069251 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13002f590 con 0x55a522cc6750 2023-10-05T21:15:14.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.620+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a522cc77e0 con 0x55a522cc6750 2023-10-05T21:15:14.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.620+0000 7ff13c9a2700 1 -- 172.21.15.153:0/2739069251 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff13002f720 con 0x55a522cc6750 2023-10-05T21:15:14.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.620+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a522cc7cb0 con 0x55a522cc6750 2023-10-05T21:15:14.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.621+0000 7ff13c9a2700 1 -- 172.21.15.153:0/2739069251 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7ff130038450 con 0x55a522cc6750 2023-10-05T21:15:14.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.621+0000 7ff13c9a2700 1 --2- 172.21.15.153:0/2739069251 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff120034140 0x7ff1200365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.621+0000 7ff14d0d1680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.621+0000 7ff13c9a2700 1 -- 172.21.15.153:0/2739069251 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7ff13002b070 con 0x55a522cc6750 2023-10-05T21:15:14.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.621+0000 7ff13f9a8700 1 --2- 172.21.15.153:0/2739069251 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff120034140 0x7ff1200365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.621+0000 7ff14d0d1680 1 --2- 172.21.15.153:0/2739069251 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55a522cc70a0 0x55a522cfced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.621+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522cfd640 con 0x55a522cc70a0 2023-10-05T21:15:14.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.622+0000 7ff1409aa700 1 --2- 172.21.15.153:0/2739069251 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55a522cc70a0 0x55a522cfced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.622+0000 7ff13f9a8700 1 --2- 172.21.15.153:0/2739069251 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff120034140 0x7ff1200365f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff128004170 tx=0x7ff1280012e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.622+0000 7ff1409aa700 1 --2- 172.21.15.153:0/2739069251 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55a522cc70a0 0x55a522cfced0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.622+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff13800a500 con 0x55a522cc70a0 2023-10-05T21:15:14.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.622+0000 7ff14d0d1680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.622+0000 7ff14d0d1680 20 realm 2023-10-05T21:15:14.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.622+0000 7ff14d0d1680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.622+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522cfa530 con 0x55a522cc70a0 2023-10-05T21:15:14.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.622+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff13800a500 con 0x55a522cc70a0 2023-10-05T21:15:14.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.622+0000 7ff14d0d1680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.622+0000 7ff14d0d1680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:14.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.622+0000 7ff14d0d1680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.622+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522cfe0f0 con 0x55a522cc70a0 2023-10-05T21:15:14.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.623+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff13800a500 con 0x55a522cc70a0 2023-10-05T21:15:14.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.623+0000 7ff14d0d1680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.623+0000 7ff14d0d1680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.623+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522cfea10 con 0x55a522cc70a0 2023-10-05T21:15:14.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.623+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff13800a500 con 0x55a522cc70a0 2023-10-05T21:15:14.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.623+0000 7ff14d0d1680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.623+0000 7ff14d0d1680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.623+0000 7ff14d0d1680 1 --2- 172.21.15.153:0/2739069251 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55a522cff2d0 0x55a522d016b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.623+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d01d00 con 0x55a522cff2d0 2023-10-05T21:15:14.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.623+0000 7ff1401a9700 1 --2- 172.21.15.153:0/2739069251 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55a522cff2d0 0x55a522d016b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.623+0000 7ff1401a9700 1 --2- 172.21.15.153:0/2739069251 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55a522cff2d0 0x55a522d016b0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.623+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff130040040 con 0x55a522cff2d0 2023-10-05T21:15:14.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.623+0000 7ff14d0d1680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:14.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.623+0000 7ff14d0d1680 20 searching for the correct realm 2023-10-05T21:15:14.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.623+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x55a522cff2d0 2023-10-05T21:15:14.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.624+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff130040040 con 0x55a522cff2d0 2023-10-05T21:15:14.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.624+0000 7ff1401a9700 1 --2- 172.21.15.153:0/2739069251 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ff13004a050 0x7ff130024740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.624+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x7ff13004a050 2023-10-05T21:15:14.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.624+0000 7ff13f9a8700 1 --2- 172.21.15.153:0/2739069251 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ff13004a050 0x7ff130024740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.624+0000 7ff13f9a8700 1 --2- 172.21.15.153:0/2739069251 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ff13004a050 0x7ff130024740 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.624+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff128006070 con 0x7ff13004a050 2023-10-05T21:15:14.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.624+0000 7ff13f9a8700 1 --2- 172.21.15.153:0/2739069251 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ff12800d8e0 0x7ff12800c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.624+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x7ff12800d8e0 2023-10-05T21:15:14.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.625+0000 7ff1409aa700 1 --2- 172.21.15.153:0/2739069251 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ff12800d8e0 0x7ff12800c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.625+0000 7ff1409aa700 1 --2- 172.21.15.153:0/2739069251 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ff12800d8e0 0x7ff12800c360 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.625+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff138014040 con 0x7ff12800d8e0 2023-10-05T21:15:14.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.625+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x55a522cc70a0 2023-10-05T21:15:14.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.625+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff138014040 con 0x55a522cc70a0 2023-10-05T21:15:14.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.625+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x55a522cc70a0 2023-10-05T21:15:14.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.626+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff138014040 con 0x55a522cc70a0 2023-10-05T21:15:14.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.626+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x7ff12800d8e0 2023-10-05T21:15:14.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.626+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff138014040 con 0x7ff12800d8e0 2023-10-05T21:15:14.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.626+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x7ff12800d8e0 2023-10-05T21:15:14.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.626+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff138014040 con 0x7ff12800d8e0 2023-10-05T21:15:14.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.626+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x7ff13004a050 2023-10-05T21:15:14.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.626+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff128006070 con 0x7ff13004a050 2023-10-05T21:15:14.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.626+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x55a522cff2d0 2023-10-05T21:15:14.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.626+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff130040040 con 0x55a522cff2d0 2023-10-05T21:15:14.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.627+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x55a522cc70a0 2023-10-05T21:15:14.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.627+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff138014040 con 0x55a522cc70a0 2023-10-05T21:15:14.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.627+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x7ff12800d8e0 2023-10-05T21:15:14.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.627+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff138014040 con 0x7ff12800d8e0 2023-10-05T21:15:14.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.627+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x55a522cc70a0 2023-10-05T21:15:14.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.627+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff138014040 con 0x55a522cc70a0 2023-10-05T21:15:14.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.627+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x7ff13004a050 2023-10-05T21:15:14.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.627+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff128006070 con 0x7ff13004a050 2023-10-05T21:15:14.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.627+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x55a522cff2d0 2023-10-05T21:15:14.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.628+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff130040040 con 0x55a522cff2d0 2023-10-05T21:15:14.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.628+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x55a522cff2d0 2023-10-05T21:15:14.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.628+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff130040040 con 0x55a522cff2d0 2023-10-05T21:15:14.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.628+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x7ff12800d8e0 2023-10-05T21:15:14.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.628+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff138014040 con 0x7ff12800d8e0 2023-10-05T21:15:14.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.628+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x55a522cff2d0 2023-10-05T21:15:14.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.628+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff130040040 con 0x55a522cff2d0 2023-10-05T21:15:14.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.628+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x55a522cff2d0 2023-10-05T21:15:14.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.629+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff130040040 con 0x55a522cff2d0 2023-10-05T21:15:14.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.629+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x55a522cc70a0 2023-10-05T21:15:14.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.629+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff138014040 con 0x55a522cc70a0 2023-10-05T21:15:14.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.629+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x55a522cc70a0 2023-10-05T21:15:14.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.629+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.629+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x7ff12800d8e0 2023-10-05T21:15:14.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.629+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff138022080 con 0x7ff12800d8e0 2023-10-05T21:15:14.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.629+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x55a522cff2d0 2023-10-05T21:15:14.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.629+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff130040040 con 0x55a522cff2d0 2023-10-05T21:15:14.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.630+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x7ff13004a050 2023-10-05T21:15:14.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.630+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff128006070 con 0x7ff13004a050 2023-10-05T21:15:14.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.630+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x55a522cc70a0 2023-10-05T21:15:14.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.630+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.630+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x7ff12800d8e0 2023-10-05T21:15:14.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.630+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff138022080 con 0x7ff12800d8e0 2023-10-05T21:15:14.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.630+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x55a522cff2d0 2023-10-05T21:15:14.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.630+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff130040040 con 0x55a522cff2d0 2023-10-05T21:15:14.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.630+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x7ff12800d8e0 2023-10-05T21:15:14.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.631+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff138022080 con 0x7ff12800d8e0 2023-10-05T21:15:14.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.631+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x7ff13004a050 2023-10-05T21:15:14.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.631+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff128006070 con 0x7ff13004a050 2023-10-05T21:15:14.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.631+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x55a522cff2d0 2023-10-05T21:15:14.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.631+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff130040040 con 0x55a522cff2d0 2023-10-05T21:15:14.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.631+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x7ff12800d8e0 2023-10-05T21:15:14.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.631+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff138022080 con 0x7ff12800d8e0 2023-10-05T21:15:14.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.631+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x55a522cc70a0 2023-10-05T21:15:14.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.632+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.632+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03830 con 0x7ff13004a050 2023-10-05T21:15:14.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.632+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff128006070 con 0x7ff13004a050 2023-10-05T21:15:14.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.632+0000 7ff14d0d1680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:14.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.632+0000 7ff14d0d1680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:14.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.632+0000 7ff14d0d1680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:14.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.632+0000 7ff14d0d1680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:14.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.632+0000 7ff14d0d1680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.632+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d02780 con 0x55a522cc70a0 2023-10-05T21:15:14.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.632+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.632+0000 7ff14d0d1680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.632+0000 7ff14d0d1680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.632+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d02b80 con 0x55a522cc70a0 2023-10-05T21:15:14.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.632+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.632+0000 7ff14d0d1680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.632+0000 7ff14d0d1680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.632+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03cc0 con 0x55a522cc70a0 2023-10-05T21:15:14.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.633+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.633+0000 7ff14d0d1680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:14.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.633+0000 7ff14d0d1680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.633+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d04070 con 0x55a522cff2d0 2023-10-05T21:15:14.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.633+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7ff130040040 con 0x55a522cff2d0 2023-10-05T21:15:14.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.633+0000 7ff14d0d1680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.633+0000 7ff14d0d1680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.633+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d04420 con 0x55a522cc70a0 2023-10-05T21:15:14.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.633+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.633+0000 7ff14d0d1680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.633+0000 7ff14d0d1680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.633+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d04420 con 0x55a522cc70a0 2023-10-05T21:15:14.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.633+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.633+0000 7ff14d0d1680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.633+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d04420 con 0x55a522cff2d0 2023-10-05T21:15:14.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.634+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff130040040 con 0x55a522cff2d0 2023-10-05T21:15:14.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.634+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d04420 con 0x7ff13004a050 2023-10-05T21:15:14.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.634+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff128006070 con 0x7ff13004a050 2023-10-05T21:15:14.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.634+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d04420 con 0x7ff12800d8e0 2023-10-05T21:15:14.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.634+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff138022080 con 0x7ff12800d8e0 2023-10-05T21:15:14.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.634+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03cc0 con 0x55a522cc70a0 2023-10-05T21:15:14.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.634+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.634+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03cc0 con 0x55a522cc70a0 2023-10-05T21:15:14.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.635+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.635+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03cc0 con 0x7ff12800d8e0 2023-10-05T21:15:14.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.635+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff138022080 con 0x7ff12800d8e0 2023-10-05T21:15:14.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.635+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03cc0 con 0x7ff12800d8e0 2023-10-05T21:15:14.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.635+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff138022080 con 0x7ff12800d8e0 2023-10-05T21:15:14.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.635+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03cc0 con 0x7ff13004a050 2023-10-05T21:15:14.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.636+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff128006070 con 0x7ff13004a050 2023-10-05T21:15:14.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.636+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03cc0 con 0x55a522cff2d0 2023-10-05T21:15:14.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.636+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff130040040 con 0x55a522cff2d0 2023-10-05T21:15:14.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.636+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03cc0 con 0x55a522cc70a0 2023-10-05T21:15:14.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.636+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.636+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03cc0 con 0x7ff12800d8e0 2023-10-05T21:15:14.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.637+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff138022080 con 0x7ff12800d8e0 2023-10-05T21:15:14.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.637+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03cc0 con 0x55a522cc70a0 2023-10-05T21:15:14.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.637+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.637+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03cc0 con 0x7ff13004a050 2023-10-05T21:15:14.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.637+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff128006070 con 0x7ff13004a050 2023-10-05T21:15:14.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.637+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03cc0 con 0x55a522cff2d0 2023-10-05T21:15:14.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.637+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff130040040 con 0x55a522cff2d0 2023-10-05T21:15:14.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.637+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03cc0 con 0x55a522cff2d0 2023-10-05T21:15:14.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.637+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff130040040 con 0x55a522cff2d0 2023-10-05T21:15:14.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.637+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03cc0 con 0x7ff12800d8e0 2023-10-05T21:15:14.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.638+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff138022080 con 0x7ff12800d8e0 2023-10-05T21:15:14.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.638+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03cc0 con 0x55a522cff2d0 2023-10-05T21:15:14.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.638+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff130040040 con 0x55a522cff2d0 2023-10-05T21:15:14.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.638+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03cc0 con 0x55a522cff2d0 2023-10-05T21:15:14.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.638+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff130040040 con 0x55a522cff2d0 2023-10-05T21:15:14.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.638+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03cc0 con 0x55a522cc70a0 2023-10-05T21:15:14.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.639+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.639+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03cc0 con 0x55a522cc70a0 2023-10-05T21:15:14.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.639+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.639+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03cc0 con 0x7ff12800d8e0 2023-10-05T21:15:14.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.639+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff138022080 con 0x7ff12800d8e0 2023-10-05T21:15:14.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.639+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03cc0 con 0x55a522cff2d0 2023-10-05T21:15:14.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.639+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff130040040 con 0x55a522cff2d0 2023-10-05T21:15:14.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.639+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03cc0 con 0x7ff13004a050 2023-10-05T21:15:14.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.639+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff128006070 con 0x7ff13004a050 2023-10-05T21:15:14.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.640+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03cc0 con 0x55a522cc70a0 2023-10-05T21:15:14.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.640+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.640+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03cc0 con 0x7ff12800d8e0 2023-10-05T21:15:14.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.640+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff138022080 con 0x7ff12800d8e0 2023-10-05T21:15:14.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.640+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03cc0 con 0x55a522cff2d0 2023-10-05T21:15:14.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.640+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff130040040 con 0x55a522cff2d0 2023-10-05T21:15:14.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.640+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03cc0 con 0x7ff12800d8e0 2023-10-05T21:15:14.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.641+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff138022080 con 0x7ff12800d8e0 2023-10-05T21:15:14.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.641+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03cc0 con 0x7ff13004a050 2023-10-05T21:15:14.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.641+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff128006070 con 0x7ff13004a050 2023-10-05T21:15:14.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.641+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03cc0 con 0x55a522cff2d0 2023-10-05T21:15:14.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.641+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff130040040 con 0x55a522cff2d0 2023-10-05T21:15:14.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.641+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03cc0 con 0x7ff12800d8e0 2023-10-05T21:15:14.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.642+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff138022080 con 0x7ff12800d8e0 2023-10-05T21:15:14.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.642+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03cc0 con 0x55a522cc70a0 2023-10-05T21:15:14.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.642+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.642+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d03cc0 con 0x7ff13004a050 2023-10-05T21:15:14.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.642+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff128006070 con 0x7ff13004a050 2023-10-05T21:15:14.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.642+0000 7ff14d0d1680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:14.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.642+0000 7ff14d0d1680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:14.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.642+0000 7ff14d0d1680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:14.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.642+0000 7ff14d0d1680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:14.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.642+0000 7ff14d0d1680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.642+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d04420 con 0x55a522cc70a0 2023-10-05T21:15:14.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.643+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.643+0000 7ff14d0d1680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.643+0000 7ff14d0d1680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.643+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d04820 con 0x55a522cff2d0 2023-10-05T21:15:14.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.643+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff130040040 con 0x55a522cff2d0 2023-10-05T21:15:14.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.643+0000 7ff14d0d1680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:14.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.643+0000 7ff14d0d1680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.643+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d05110 con 0x55a522cc70a0 2023-10-05T21:15:14.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.643+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.643+0000 7ff14d0d1680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.643+0000 7ff14d0d1680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.643+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d05110 con 0x55a522cc70a0 2023-10-05T21:15:14.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.643+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.643+0000 7ff14d0d1680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:14.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.643+0000 7ff14d0d1680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.643+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d05110 con 0x7ff12800d8e0 2023-10-05T21:15:14.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.644+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7ff138022080 con 0x7ff12800d8e0 2023-10-05T21:15:14.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.644+0000 7ff14d0d1680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.644+0000 7ff14d0d1680 20 zone default found 2023-10-05T21:15:14.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.644+0000 7ff14d0d1680 4 Realm: () 2023-10-05T21:15:14.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.644+0000 7ff14d0d1680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:14.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.644+0000 7ff14d0d1680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:14.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.644+0000 7ff14d0d1680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:14.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.644+0000 7ff14d0d1680 20 zonegroup default 2023-10-05T21:15:14.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.644+0000 7ff14d0d1680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.644+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d05110 con 0x7ff12800d8e0 2023-10-05T21:15:14.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.644+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff138022080 con 0x7ff12800d8e0 2023-10-05T21:15:14.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.644+0000 7ff14d0d1680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.644+0000 7ff14d0d1680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.644+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d06a90 con 0x55a522cff2d0 2023-10-05T21:15:14.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.644+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff130040040 con 0x55a522cff2d0 2023-10-05T21:15:14.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.644+0000 7ff14d0d1680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.644+0000 7ff14d0d1680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.644+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d06e40 con 0x55a522cff2d0 2023-10-05T21:15:14.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.644+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff130040040 con 0x55a522cff2d0 2023-10-05T21:15:14.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.644+0000 7ff14d0d1680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.644+0000 7ff14d0d1680 20 started sync module instance, tier type = 2023-10-05T21:15:14.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.644+0000 7ff14d0d1680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:14.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.644+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d061a0 con 0x7ff13004a050 2023-10-05T21:15:14.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.645+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff128006070 con 0x7ff13004a050 2023-10-05T21:15:14.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.645+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94167742047568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d07780 con 0x7ff13004a050 2023-10-05T21:15:14.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.645+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d08020 con 0x55a522cc70a0 2023-10-05T21:15:14.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.646+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.646+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94167742053456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d08670 con 0x55a522cc70a0 2023-10-05T21:15:14.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.646+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d09270 con 0x55a522cff2d0 2023-10-05T21:15:14.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.646+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94167742047568] v29'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff128006070 con 0x7ff13004a050 2023-10-05T21:15:14.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.647+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94167742053456] v29'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.647+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff130040040 con 0x55a522cff2d0 2023-10-05T21:15:14.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.647+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94167742057728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d080a0 con 0x55a522cff2d0 2023-10-05T21:15:14.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.647+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d09b60 con 0x7ff13004a050 2023-10-05T21:15:14.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.648+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff128006070 con 0x7ff13004a050 2023-10-05T21:15:14.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.648+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94167742060144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d0a400 con 0x7ff13004a050 2023-10-05T21:15:14.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.648+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d0ae10 con 0x55a522cc70a0 2023-10-05T21:15:14.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.648+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94167742057728] v29'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff130040040 con 0x55a522cff2d0 2023-10-05T21:15:14.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.648+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94167742060144] v29'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff128006070 con 0x7ff13004a050 2023-10-05T21:15:14.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.648+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.648+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94167742050960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d0ae10 con 0x55a522cc70a0 2023-10-05T21:15:14.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.648+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d0b700 con 0x7ff12800d8e0 2023-10-05T21:15:14.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.649+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94167742050960] v29'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.649+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff138022080 con 0x7ff12800d8e0 2023-10-05T21:15:14.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.649+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94167742065488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d0b4d0 con 0x7ff12800d8e0 2023-10-05T21:15:14.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.649+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d0c090 con 0x7ff12800d8e0 2023-10-05T21:15:14.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.650+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94167742065488] v29'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff138022080 con 0x7ff12800d8e0 2023-10-05T21:15:14.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.650+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff138022080 con 0x7ff12800d8e0 2023-10-05T21:15:14.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.650+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94167742066592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d0c050 con 0x7ff12800d8e0 2023-10-05T21:15:14.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.650+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d0cac0 con 0x7ff12800d8e0 2023-10-05T21:15:14.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.651+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94167742066592] v29'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff138022080 con 0x7ff12800d8e0 2023-10-05T21:15:14.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.651+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff138022080 con 0x7ff12800d8e0 2023-10-05T21:15:14.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.651+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94167742070160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d0cac0 con 0x7ff12800d8e0 2023-10-05T21:15:14.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.651+0000 7ff14d0d1680 20 add_watcher() i=0 2023-10-05T21:15:14.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.651+0000 7ff14d0d1680 20 add_watcher() i=1 2023-10-05T21:15:14.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.651+0000 7ff14d0d1680 20 add_watcher() i=2 2023-10-05T21:15:14.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.651+0000 7ff14d0d1680 20 add_watcher() i=3 2023-10-05T21:15:14.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.651+0000 7ff14d0d1680 20 add_watcher() i=4 2023-10-05T21:15:14.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.651+0000 7ff14d0d1680 20 add_watcher() i=5 2023-10-05T21:15:14.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.651+0000 7ff14d0d1680 20 add_watcher() i=6 2023-10-05T21:15:14.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.651+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94167742070160] v29'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff138022080 con 0x7ff12800d8e0 2023-10-05T21:15:14.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.651+0000 7ff14d0d1680 20 add_watcher() i=7 2023-10-05T21:15:14.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.651+0000 7ff14d0d1680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:14.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.651+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d0fed0 con 0x55a522cc70a0 2023-10-05T21:15:14.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.652+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.652+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94167742072736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d0d390 con 0x55a522cc70a0 2023-10-05T21:15:14.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.652+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94167742072736] v29'78 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.652+0000 7ff111fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:14.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.653+0000 7ff14d0d1680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:14.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.653+0000 7ff14d0d1680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:14.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.653+0000 7ff14d0d1680 1 Processor -- start 2023-10-05T21:15:14.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.653+0000 7ff14d0d1680 1 -- start start 2023-10-05T21:15:14.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.653+0000 7ff14d0d1680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522d19c10 0x55a522d1a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.653+0000 7ff14d0d1680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a522d1a630 con 0x55a522d19c10 2023-10-05T21:15:14.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.653+0000 7ff13f9a8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522d19c10 0x55a522d1a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.653+0000 7ff13f9a8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522d19c10 0x55a522d1a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49976/0 (socket says 172.21.15.153:49976) 2023-10-05T21:15:14.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.653+0000 7ff13f9a8700 1 -- 172.21.15.153:0/1250444305 learned_addr learned my addr 172.21.15.153:0/1250444305 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:14.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.653+0000 7ff13f9a8700 1 -- 172.21.15.153:0/1250444305 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a522d1ab10 con 0x55a522d19c10 2023-10-05T21:15:14.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.654+0000 7ff13f9a8700 1 --2- 172.21.15.153:0/1250444305 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522d19c10 0x55a522d1a020 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff13000ffd0 tx=0x7ff128006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c52730d40b63da4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.654+0000 7ff1117e2700 1 -- 172.21.15.153:0/1250444305 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff128023040 con 0x55a522d19c10 2023-10-05T21:15:14.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.654+0000 7ff1117e2700 1 -- 172.21.15.153:0/1250444305 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff128024040 con 0x55a522d19c10 2023-10-05T21:15:14.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.654+0000 7ff1117e2700 1 -- 172.21.15.153:0/1250444305 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff128013040 con 0x55a522d19c10 2023-10-05T21:15:14.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.654+0000 7ff14d0d1680 1 -- 172.21.15.153:0/1250444305 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522d19c10 msgr2=0x55a522d1a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.654+0000 7ff14d0d1680 1 --2- 172.21.15.153:0/1250444305 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522d19c10 0x55a522d1a020 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff13000ffd0 tx=0x7ff128006000 comp rx=0 tx=0).stop 2023-10-05T21:15:14.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.654+0000 7ff14d0d1680 1 -- 172.21.15.153:0/1250444305 shutdown_connections 2023-10-05T21:15:14.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.654+0000 7ff14d0d1680 1 --2- 172.21.15.153:0/1250444305 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522d19c10 0x55a522d1a020 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.654+0000 7ff14d0d1680 1 -- 172.21.15.153:0/1250444305 >> 172.21.15.153:0/1250444305 conn(0x55a522d15f10 msgr2=0x55a522d14010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.654+0000 7ff14d0d1680 1 -- 172.21.15.153:0/1250444305 shutdown_connections 2023-10-05T21:15:14.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.654+0000 7ff14d0d1680 1 -- 172.21.15.153:0/1250444305 wait complete. 2023-10-05T21:15:14.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.655+0000 7ff14d0d1680 1 Processor -- start 2023-10-05T21:15:14.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.655+0000 7ff14d0d1680 1 -- start start 2023-10-05T21:15:14.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.655+0000 7ff14d0d1680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522d19c10 0x55a522d208c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.655+0000 7ff14d0d1680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a522d20e00 con 0x55a522d19c10 2023-10-05T21:15:14.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.655+0000 7ff13f9a8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522d19c10 0x55a522d208c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.655+0000 7ff13f9a8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522d19c10 0x55a522d208c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:49992/0 (socket says 172.21.15.153:49992) 2023-10-05T21:15:14.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.655+0000 7ff13f9a8700 1 -- 172.21.15.153:0/815748952 learned_addr learned my addr 172.21.15.153:0/815748952 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:14.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.656+0000 7ff13f9a8700 1 -- 172.21.15.153:0/815748952 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a522c15930 con 0x55a522d19c10 2023-10-05T21:15:14.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.656+0000 7ff13f9a8700 1 --2- 172.21.15.153:0/815748952 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522d19c10 0x55a522d208c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff12800bed0 tx=0x7ff128030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.656+0000 7ff08b7fe700 1 -- 172.21.15.153:0/815748952 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff128023040 con 0x55a522d19c10 2023-10-05T21:15:14.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.656+0000 7ff08b7fe700 1 -- 172.21.15.153:0/815748952 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12800ce90 con 0x55a522d19c10 2023-10-05T21:15:14.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.656+0000 7ff14d0d1680 1 -- 172.21.15.153:0/815748952 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a522d21000 con 0x55a522d19c10 2023-10-05T21:15:14.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.656+0000 7ff08b7fe700 1 -- 172.21.15.153:0/815748952 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff12801e420 con 0x55a522d19c10 2023-10-05T21:15:14.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.656+0000 7ff14d0d1680 1 -- 172.21.15.153:0/815748952 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a522d213f0 con 0x55a522d19c10 2023-10-05T21:15:14.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.657+0000 7ff08b7fe700 1 -- 172.21.15.153:0/815748952 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7ff12801e580 con 0x55a522d19c10 2023-10-05T21:15:14.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.657+0000 7ff08b7fe700 1 --2- 172.21.15.153:0/815748952 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff080034140 0x7ff0800365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.657+0000 7ff08b7fe700 1 -- 172.21.15.153:0/815748952 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7ff12803bae0 con 0x55a522d19c10 2023-10-05T21:15:14.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.657+0000 7ff1409aa700 1 --2- 172.21.15.153:0/815748952 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff080034140 0x7ff0800365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.657+0000 7ff14d0d1680 5 note: GC not initialized 2023-10-05T21:15:14.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.657+0000 7ff1409aa700 1 --2- 172.21.15.153:0/815748952 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff080034140 0x7ff0800365f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55a522d0cbf0 tx=0x7ff13800ae50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.658+0000 7ff088ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:14.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.658+0000 7ff07e7fc700 20 reqs_thread_entry: start 2023-10-05T21:15:14.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.658+0000 7ff14d0d1680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:14.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.658+0000 7ff14d0d1680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:14.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.658+0000 7ff07cff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:45 2023 2023-10-05T21:15:14.687 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:14.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.658+0000 7ff063fff700 20 reqs_thread_entry: start 2023-10-05T21:15:14.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.658+0000 7ff14d0d1680 20 get_system_obj_state: rctx=0x7fffe7314758 obj=default.rgw.meta:users.uid:foo state=0x55a522c3b2d0 s->prefetch_data=0 2023-10-05T21:15:14.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.658+0000 7ff14d0d1680 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T21:15:14.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.658+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d862a0 con 0x55a522cc70a0 2023-10-05T21:15:14.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.659+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.659+0000 7ff14d0d1680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T21:15:14.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.659+0000 7ff14d0d1680 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:14.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.659+0000 7ff14d0d1680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:14.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.659+0000 7ff14d0d1680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:14.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.659+0000 7ff14d0d1680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:14.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.659+0000 7ff14d0d1680 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:14.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.659+0000 7ff14d0d1680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.659+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d88530 con 0x55a522cc70a0 2023-10-05T21:15:14.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.659+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 273+0+636 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.659+0000 7ff14d0d1680 20 rados_obj.operate() r=0 bl.length=513 2023-10-05T21:15:14.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.659+0000 7ff14d0d1680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T21:15:14.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.659+0000 7ff14d0d1680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:14.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.659+0000 7ff14d0d1680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:14.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.659+0000 7ff14d0d1680 20 get_system_obj_state: rctx=0x7fffe7313f88 obj=default.rgw.meta:users.swift:foo:foo2 state=0x55a522c3b2d0 s->prefetch_data=0 2023-10-05T21:15:14.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.659+0000 7ff14d0d1680 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2023-10-05T21:15:14.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.659+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:104 8.2 8:45671577:users.swift::foo%3afoo2:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d862a0 con 0x7ff13004a050 2023-10-05T21:15:14.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.660+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(104 foo:foo2 [getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 194+0+0 (crc 0 0 0) 0x7ff12804a070 con 0x7ff13004a050 2023-10-05T21:15:14.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.660+0000 7ff14d0d1680 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2023-10-05T21:15:14.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.660+0000 7ff14d0d1680 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2023-10-05T21:15:14.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.660+0000 7ff14d0d1680 20 get_system_obj_state: rctx=0x7fffe7314638 obj=default.rgw.meta:users.swift:foo:foo2 state=0x55a522c3b2d0 s->prefetch_data=0 2023-10-05T21:15:14.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.660+0000 7ff14d0d1680 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2023-10-05T21:15:14.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.660+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:105 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~621 in=621b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d85e90 con 0x55a522cc70a0 2023-10-05T21:15:14.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.660+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(105 foo [delete,create,call,writefull 0~621] v29'8 uv8 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.660+0000 7ff14d0d1680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T21:15:14.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.660+0000 7ff14d0d1680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:14.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.660+0000 7ff14d0d1680 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T21:15:14.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.660+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [notify cookie 94167742576224 in=809b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d8a070 con 0x55a522cc70a0 2023-10-05T21:15:14.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.661+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== watch-notify(notify (1) cookie 94167742050960 notify 124554051591 ret 0) v3 ==== 839+0+0 (crc 0 0 0) 0x7ff138029c40 con 0x55a522cc70a0 2023-10-05T21:15:14.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.661+0000 7ff13e1a5700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051591 cookie 94167742050960 notifier 4358 bl.length()=797 2023-10-05T21:15:14.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.661+0000 7ff13e1a5700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T21:15:14.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.661+0000 7ff13e1a5700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:14.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.661+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(106 notify.4 [notify cookie 94167742576224 out=8b] v0'0 uv66 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.661+0000 7ff13e1a5700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7ff124003d90 con 0x55a522cc70a0 2023-10-05T21:15:14.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.661+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(107 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.661+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== watch-notify(notify_complete (2) cookie 94167742576224 notify 124554051591 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7ff138029dd0 con 0x55a522cc70a0 2023-10-05T21:15:14.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.661+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:108 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d86650 con 0x7ff13004a050 2023-10-05T21:15:14.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.662+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(108 foo:foo2 [delete,create,writefull 0~7] v29'1 uv1 ondisk = 0) v8 ==== 236+0+0 (crc 0 0 0) 0x7ff12804a070 con 0x7ff13004a050 2023-10-05T21:15:14.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.662+0000 7ff14d0d1680 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2023-10-05T21:15:14.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.662+0000 7ff14d0d1680 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2023-10-05T21:15:14.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.662+0000 7ff14d0d1680 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2023-10-05T21:15:14.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.662+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:109 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94167742588080 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d86650 con 0x7ff13004a050 2023-10-05T21:15:14.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.662+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== watch-notify(notify (1) cookie 94167742047568 notify 124554051587 ret 0) v3 ==== 208+0+0 (crc 0 0 0) 0x55a522d213f0 con 0x7ff13004a050 2023-10-05T21:15:14.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.663+0000 7ff13d9a4700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051587 cookie 94167742047568 notifier 4358 bl.length()=166 2023-10-05T21:15:14.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.663+0000 7ff13d9a4700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2023-10-05T21:15:14.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.663+0000 7ff13d9a4700 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2023-10-05T21:15:14.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.663+0000 7ff13d9a4700 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:110 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7ff090003410 con 0x7ff13004a050 2023-10-05T21:15:14.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.663+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(109 notify.0 [notify cookie 94167742588080 out=8b] v0'0 uv66 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff128053020 con 0x7ff13004a050 2023-10-05T21:15:14.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.663+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== osd_op_reply(110 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff128053020 con 0x7ff13004a050 2023-10-05T21:15:14.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.663+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 <== osd.2 v2:172.21.15.153:6807/140454 22 ==== watch-notify(notify_complete (2) cookie 94167742588080 notify 124554051587 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55a522d21000 con 0x7ff13004a050 2023-10-05T21:15:14.692 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:14.692 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "foo", 2023-10-05T21:15:14.692 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Foo", 2023-10-05T21:15:14.692 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "foo@foo.com", 2023-10-05T21:15:14.692 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2023-10-05T21:15:14.693 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 4, 2023-10-05T21:15:14.693 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [ 2023-10-05T21:15:14.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:14.693 INFO:teuthology.orchestra.run.smithi153.stdout: "id": "foo:foo1", 2023-10-05T21:15:14.693 INFO:teuthology.orchestra.run.smithi153.stdout: "permissions": "full-control" 2023-10-05T21:15:14.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:14.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:14.693 INFO:teuthology.orchestra.run.smithi153.stdout: "id": "foo:foo2", 2023-10-05T21:15:14.693 INFO:teuthology.orchestra.run.smithi153.stdout: "permissions": "" 2023-10-05T21:15:14.693 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:14.693 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:14.694 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2023-10-05T21:15:14.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:14.694 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:14.694 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:14.694 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T21:15:14.694 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:14.694 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:14.694 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [ 2023-10-05T21:15:14.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:14.694 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo:foo1", 2023-10-05T21:15:14.694 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL" 2023-10-05T21:15:14.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:14.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:14.695 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo:foo2", 2023-10-05T21:15:14.695 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy" 2023-10-05T21:15:14.695 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:14.695 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:14.695 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2023-10-05T21:15:14.695 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2023-10-05T21:15:14.695 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2023-10-05T21:15:14.695 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2023-10-05T21:15:14.695 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2023-10-05T21:15:14.695 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:15:14.695 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:14.695 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:14.696 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:14.696 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:14.696 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:14.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:14.696 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2023-10-05T21:15:14.696 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:14.696 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:14.696 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:14.696 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:14.696 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:14.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:14.696 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2023-10-05T21:15:14.697 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2023-10-05T21:15:14.697 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [] 2023-10-05T21:15:14.697 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:14.697 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:15:14.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.663+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:111 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94167742047568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d873e0 con 0x7ff13004a050 2023-10-05T21:15:14.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.664+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 <== osd.2 v2:172.21.15.153:6807/140454 23 ==== osd_op_reply(111 notify.0 [watch unwatch cookie 94167742047568] v29'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff128053020 con 0x7ff13004a050 2023-10-05T21:15:14.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.664+0000 7ff14d0d1680 20 remove_watcher() i=0 2023-10-05T21:15:14.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.664+0000 7ff14d0d1680 2 removed watcher, disabling cache 2023-10-05T21:15:14.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.664+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:112 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94167742053456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d04420 con 0x55a522cc70a0 2023-10-05T21:15:14.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.664+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 42 ==== osd_op_reply(112 notify.1 [watch unwatch cookie 94167742053456] v29'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.664+0000 7ff14d0d1680 20 remove_watcher() i=1 2023-10-05T21:15:14.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.664+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:113 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94167742057728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d04420 con 0x55a522cff2d0 2023-10-05T21:15:14.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.666+0000 7ff1401a9700 1 -- 172.21.15.153:0/2739069251 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(113 notify.2 [watch unwatch cookie 94167742057728] v29'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff130040040 con 0x55a522cff2d0 2023-10-05T21:15:14.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.666+0000 7ff14d0d1680 20 remove_watcher() i=2 2023-10-05T21:15:14.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.666+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:114 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94167742060144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d04420 con 0x7ff13004a050 2023-10-05T21:15:14.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.666+0000 7ff13f9a8700 1 -- 172.21.15.153:0/2739069251 <== osd.2 v2:172.21.15.153:6807/140454 24 ==== osd_op_reply(114 notify.3 [watch unwatch cookie 94167742060144] v29'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff128053020 con 0x7ff13004a050 2023-10-05T21:15:14.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.666+0000 7ff14d0d1680 20 remove_watcher() i=3 2023-10-05T21:15:14.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.666+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:115 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94167742050960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d04420 con 0x55a522cc70a0 2023-10-05T21:15:14.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.667+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 43 ==== osd_op_reply(115 notify.4 [watch unwatch cookie 94167742050960] v29'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.667+0000 7ff14d0d1680 20 remove_watcher() i=4 2023-10-05T21:15:14.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.667+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:116 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94167742065488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d04420 con 0x7ff12800d8e0 2023-10-05T21:15:14.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.668+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(116 notify.5 [watch unwatch cookie 94167742065488] v29'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff138022080 con 0x7ff12800d8e0 2023-10-05T21:15:14.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.668+0000 7ff14d0d1680 20 remove_watcher() i=5 2023-10-05T21:15:14.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.668+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:117 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94167742066592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d04420 con 0x7ff12800d8e0 2023-10-05T21:15:14.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.668+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(117 notify.6 [watch unwatch cookie 94167742066592] v29'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff138022080 con 0x7ff12800d8e0 2023-10-05T21:15:14.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.668+0000 7ff14d0d1680 20 remove_watcher() i=6 2023-10-05T21:15:14.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.668+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:118 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94167742070160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d04420 con 0x7ff12800d8e0 2023-10-05T21:15:14.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.669+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(118 notify.7 [watch unwatch cookie 94167742070160] v29'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff138022080 con 0x7ff12800d8e0 2023-10-05T21:15:14.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.669+0000 7ff14d0d1680 20 remove_watcher() i=7 2023-10-05T21:15:14.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.670+0000 7ff111fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:14.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.670+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:119 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94167742072736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55a522d04420 con 0x55a522cc70a0 2023-10-05T21:15:14.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.671+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 <== osd.1 v2:172.21.15.153:6816/140456 44 ==== osd_op_reply(119 data_loggenerations_metadata [watch unwatch cookie 94167742072736] v29'79 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff138022080 con 0x55a522cc70a0 2023-10-05T21:15:14.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.671+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ff12800d8e0 msgr2=0x7ff12800c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.671+0000 7ff14d0d1680 1 --2- 172.21.15.153:0/2739069251 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ff12800d8e0 0x7ff12800c360 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.671+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55a522cc70a0 msgr2=0x55a522cfced0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.671+0000 7ff14d0d1680 1 --2- 172.21.15.153:0/2739069251 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55a522cc70a0 0x55a522cfced0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.671+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ff13004a050 msgr2=0x7ff130024740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.671+0000 7ff14d0d1680 1 --2- 172.21.15.153:0/2739069251 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ff13004a050 0x7ff130024740 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.671+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55a522cff2d0 msgr2=0x55a522d016b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.671+0000 7ff14d0d1680 1 --2- 172.21.15.153:0/2739069251 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55a522cff2d0 0x55a522d016b0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.671+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff120034140 msgr2=0x7ff1200365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.671+0000 7ff14d0d1680 1 --2- 172.21.15.153:0/2739069251 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff120034140 0x7ff1200365f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff128004170 tx=0x7ff1280012e0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.671+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522cc6750 msgr2=0x55a522cc91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.671+0000 7ff1409aa700 1 -- 172.21.15.153:0/2739069251 reap_dead start 2023-10-05T21:15:14.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.671+0000 7ff14d0d1680 1 --2- 172.21.15.153:0/2739069251 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522cc6750 0x55a522cc91c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff130005b20 tx=0x7ff13001d000 comp rx=0 tx=0).stop 2023-10-05T21:15:14.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.671+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 shutdown_connections 2023-10-05T21:15:14.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.671+0000 7ff14d0d1680 1 --2- 172.21.15.153:0/2739069251 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522cc6750 0x55a522cc91c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.671+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 >> 172.21.15.153:0/2739069251 conn(0x55a522cc22a0 msgr2=0x55a522ce1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.671+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 shutdown_connections 2023-10-05T21:15:14.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.671+0000 7ff14d0d1680 1 -- 172.21.15.153:0/2739069251 wait complete. 2023-10-05T21:15:14.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.671+0000 7ff14d0d1680 1 -- 172.21.15.153:0/815748952 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff080034140 msgr2=0x7ff0800365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.671+0000 7ff14d0d1680 1 --2- 172.21.15.153:0/815748952 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff080034140 0x7ff0800365f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55a522d0cbf0 tx=0x7ff13800ae50 comp rx=0 tx=0).stop 2023-10-05T21:15:14.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.671+0000 7ff14d0d1680 1 -- 172.21.15.153:0/815748952 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522d19c10 msgr2=0x55a522d208c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.671+0000 7ff14d0d1680 1 --2- 172.21.15.153:0/815748952 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522d19c10 0x55a522d208c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff12800bed0 tx=0x7ff128030000 comp rx=0 tx=0).stop 2023-10-05T21:15:14.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.671+0000 7ff14d0d1680 1 -- 172.21.15.153:0/815748952 shutdown_connections 2023-10-05T21:15:14.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.671+0000 7ff14d0d1680 1 --2- 172.21.15.153:0/815748952 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff080034140 0x7ff0800365f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.671+0000 7ff14d0d1680 1 --2- 172.21.15.153:0/815748952 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a522d19c10 0x55a522d208c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.671+0000 7ff14d0d1680 1 -- 172.21.15.153:0/815748952 >> 172.21.15.153:0/815748952 conn(0x55a522d15f10 msgr2=0x55a522d13fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.671+0000 7ff14d0d1680 1 -- 172.21.15.153:0/815748952 shutdown_connections 2023-10-05T21:15:14.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.671+0000 7ff14d0d1680 1 -- 172.21.15.153:0/815748952 wait complete. 2023-10-05T21:15:14.707 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:15:14.707 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2023-10-05T21:15:14.707 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2023-10-05T21:15:14.707 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2023-10-05T21:15:14.751 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:14.751 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:14.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.750+0000 7ff788d58680 1 Processor -- start 2023-10-05T21:15:14.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.750+0000 7ff788d58680 1 -- start start 2023-10-05T21:15:14.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.750+0000 7ff788d58680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5654dcb3c0a0 0x5654dcbcb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.750+0000 7ff788d58680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5654dcb15990 con 0x5654dcbcb5d0 2023-10-05T21:15:14.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.750+0000 7ff788d58680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x5654dcad5db0 con 0x5654dcb3c0a0 2023-10-05T21:15:14.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.750+0000 7ff77be30700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5654dcb3c0a0 0x5654dcbcb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.750+0000 7ff77b62f700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x5654dcbcb5d0 0x5654dcbcd9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56320/0 (socket says 172.21.15.153:56320) 2023-10-05T21:15:14.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.751+0000 7ff77b62f700 1 -- 172.21.15.153:0/2545426707 learned_addr learned my addr 172.21.15.153:0/2545426707 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:14.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.751+0000 7ff77ae2e700 1 -- 172.21.15.153:0/2545426707 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1113430470 0 0) 0x5654dcb15990 con 0x5654dcbcb5d0 2023-10-05T21:15:14.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.751+0000 7ff77be30700 1 -- 172.21.15.153:0/2545426707 >> v1:172.21.15.111:6789/0 conn(0x5654dcbcb5d0 legacy=0x5654dcbcd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.751+0000 7ff77be30700 1 -- 172.21.15.153:0/2545426707 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654dcbd01e0 con 0x5654dcb3c0a0 2023-10-05T21:15:14.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.751+0000 7ff77be30700 1 --2- 172.21.15.153:0/2545426707 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcb3c0a0 0x5654dcbcb090 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff76c00a520 tx=0x7ff76c005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e1320139af2f94a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.751+0000 7ff77ae2e700 1 -- 172.21.15.153:0/2545426707 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff76c00f590 con 0x5654dcb3c0a0 2023-10-05T21:15:14.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.751+0000 7ff77ae2e700 1 -- 172.21.15.153:0/2545426707 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76c00f6f0 con 0x5654dcb3c0a0 2023-10-05T21:15:14.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.751+0000 7ff77ae2e700 1 -- 172.21.15.153:0/2545426707 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff76c00f880 con 0x5654dcb3c0a0 2023-10-05T21:15:14.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.751+0000 7ff788d58680 1 -- 172.21.15.153:0/2545426707 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcb3c0a0 msgr2=0x5654dcbcb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.751+0000 7ff788d58680 1 --2- 172.21.15.153:0/2545426707 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcb3c0a0 0x5654dcbcb090 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff76c00a520 tx=0x7ff76c005d40 comp rx=0 tx=0).stop 2023-10-05T21:15:14.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.752+0000 7ff788d58680 1 -- 172.21.15.153:0/2545426707 shutdown_connections 2023-10-05T21:15:14.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.752+0000 7ff788d58680 1 --2- 172.21.15.153:0/2545426707 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcb3c0a0 0x5654dcbcb090 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.752+0000 7ff788d58680 1 -- 172.21.15.153:0/2545426707 >> 172.21.15.153:0/2545426707 conn(0x5654dcbc2b80 msgr2=0x5654dcbc4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.752+0000 7ff788d58680 1 -- 172.21.15.153:0/2545426707 shutdown_connections 2023-10-05T21:15:14.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.752+0000 7ff788d58680 1 -- 172.21.15.153:0/2545426707 wait complete. 2023-10-05T21:15:14.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.752+0000 7ff788d58680 1 Processor -- start 2023-10-05T21:15:14.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.752+0000 7ff788d58680 1 -- start start 2023-10-05T21:15:14.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.753+0000 7ff788d58680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcb3c0a0 0x5654dcbe76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.753+0000 7ff788d58680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654dca75ea0 con 0x5654dcb3c0a0 2023-10-05T21:15:14.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.753+0000 7ff77be30700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcb3c0a0 0x5654dcbe76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.753+0000 7ff77be30700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcb3c0a0 0x5654dcbe76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50012/0 (socket says 172.21.15.153:50012) 2023-10-05T21:15:14.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.753+0000 7ff77be30700 1 -- 172.21.15.153:0/3195676712 learned_addr learned my addr 172.21.15.153:0/3195676712 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:14.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.753+0000 7ff77be30700 1 -- 172.21.15.153:0/3195676712 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76c00a0e0 con 0x5654dcb3c0a0 2023-10-05T21:15:14.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.753+0000 7ff77be30700 1 --2- 172.21.15.153:0/3195676712 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcb3c0a0 0x5654dcbe76d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff76c000f80 tx=0x7ff76c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85826c2e551123c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.753+0000 7ff779e2c700 1 -- 172.21.15.153:0/3195676712 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff76c00f860 con 0x5654dcb3c0a0 2023-10-05T21:15:14.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.753+0000 7ff779e2c700 1 -- 172.21.15.153:0/3195676712 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76c00f9c0 con 0x5654dcb3c0a0 2023-10-05T21:15:14.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.753+0000 7ff779e2c700 1 -- 172.21.15.153:0/3195676712 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff76c00fb30 con 0x5654dcb3c0a0 2023-10-05T21:15:14.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.754+0000 7ff788d58680 1 -- 172.21.15.153:0/3195676712 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcb3c0a0 msgr2=0x5654dcbe76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.754+0000 7ff788d58680 1 --2- 172.21.15.153:0/3195676712 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcb3c0a0 0x5654dcbe76d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff76c000f80 tx=0x7ff76c014000 comp rx=0 tx=0).stop 2023-10-05T21:15:14.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.754+0000 7ff788d58680 1 -- 172.21.15.153:0/3195676712 shutdown_connections 2023-10-05T21:15:14.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.754+0000 7ff788d58680 1 --2- 172.21.15.153:0/3195676712 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcb3c0a0 0x5654dcbe76d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.754+0000 7ff788d58680 1 -- 172.21.15.153:0/3195676712 >> 172.21.15.153:0/3195676712 conn(0x5654dcbc2b80 msgr2=0x5654dcbe31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.754+0000 7ff788d58680 1 -- 172.21.15.153:0/3195676712 shutdown_connections 2023-10-05T21:15:14.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.754+0000 7ff788d58680 1 -- 172.21.15.153:0/3195676712 wait complete. 2023-10-05T21:15:14.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.754+0000 7ff788d58680 1 Processor -- start 2023-10-05T21:15:14.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.754+0000 7ff788d58680 1 -- start start 2023-10-05T21:15:14.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.754+0000 7ff788d58680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcb3c0a0 0x5654dcbeea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.754+0000 7ff788d58680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654dca6cc80 con 0x5654dcb3c0a0 2023-10-05T21:15:14.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.755+0000 7ff77be30700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcb3c0a0 0x5654dcbeea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.755+0000 7ff77be30700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcb3c0a0 0x5654dcbeea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50028/0 (socket says 172.21.15.153:50028) 2023-10-05T21:15:14.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.755+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 learned_addr learned my addr 172.21.15.153:0/1196324131 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:14.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.755+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654dcbd01e0 con 0x5654dcb3c0a0 2023-10-05T21:15:14.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.755+0000 7ff77be30700 1 --2- 172.21.15.153:0/1196324131 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcb3c0a0 0x5654dcbeea90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff76c00a520 tx=0x7ff76c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.755+0000 7ff773fff700 1 -- 172.21.15.153:0/1196324131 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff76c010420 con 0x5654dcb3c0a0 2023-10-05T21:15:14.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.755+0000 7ff773fff700 1 -- 172.21.15.153:0/1196324131 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76c010580 con 0x5654dcb3c0a0 2023-10-05T21:15:14.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.755+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5654dcbeefd0 con 0x5654dcb3c0a0 2023-10-05T21:15:14.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.755+0000 7ff773fff700 1 -- 172.21.15.153:0/1196324131 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff76c0106f0 con 0x5654dcb3c0a0 2023-10-05T21:15:14.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.755+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5654dcbef480 con 0x5654dcb3c0a0 2023-10-05T21:15:14.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.756+0000 7ff788d58680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.756+0000 7ff773fff700 1 -- 172.21.15.153:0/1196324131 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7ff76c010850 con 0x5654dcb3c0a0 2023-10-05T21:15:14.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.756+0000 7ff773fff700 1 --2- 172.21.15.153:0/1196324131 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff75c034140 0x7ff75c0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.756+0000 7ff773fff700 1 -- 172.21.15.153:0/1196324131 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7ff76c02b070 con 0x5654dcb3c0a0 2023-10-05T21:15:14.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.756+0000 7ff77b62f700 1 --2- 172.21.15.153:0/1196324131 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff75c034140 0x7ff75c0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.757+0000 7ff788d58680 1 --2- 172.21.15.153:0/1196324131 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5654dcbcb5d0 0x5654dcbfa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.757+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcbfaf10 con 0x5654dcbcb5d0 2023-10-05T21:15:14.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.757+0000 7ff77c631700 1 --2- 172.21.15.153:0/1196324131 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5654dcbcb5d0 0x5654dcbfa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.757+0000 7ff77b62f700 1 --2- 172.21.15.153:0/1196324131 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff75c034140 0x7ff75c0365f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff7640011e0 tx=0x7ff7640013a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.757+0000 7ff77c631700 1 --2- 172.21.15.153:0/1196324131 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5654dcbcb5d0 0x5654dcbfa7a0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.757+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff77400a500 con 0x5654dcbcb5d0 2023-10-05T21:15:14.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.757+0000 7ff788d58680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.757+0000 7ff788d58680 20 realm 2023-10-05T21:15:14.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.757+0000 7ff788d58680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.757+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcbf7e00 con 0x5654dcbcb5d0 2023-10-05T21:15:14.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.758+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff77400a500 con 0x5654dcbcb5d0 2023-10-05T21:15:14.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.758+0000 7ff788d58680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.758+0000 7ff788d58680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:14.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.758+0000 7ff788d58680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.758+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcbfb9c0 con 0x5654dcbcb5d0 2023-10-05T21:15:14.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.758+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff77400a500 con 0x5654dcbcb5d0 2023-10-05T21:15:14.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.758+0000 7ff788d58680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.758+0000 7ff788d58680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.758+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcbfb5c0 con 0x5654dcbcb5d0 2023-10-05T21:15:14.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.758+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff77400a500 con 0x5654dcbcb5d0 2023-10-05T21:15:14.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.758+0000 7ff788d58680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.758+0000 7ff788d58680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.758+0000 7ff788d58680 1 --2- 172.21.15.153:0/1196324131 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5654dcbfcd30 0x5654dcbff110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.758+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcbff650 con 0x5654dcbfcd30 2023-10-05T21:15:14.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.758+0000 7ff77be30700 1 --2- 172.21.15.153:0/1196324131 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5654dcbfcd30 0x5654dcbff110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.758+0000 7ff77be30700 1 --2- 172.21.15.153:0/1196324131 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5654dcbfcd30 0x5654dcbff110 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.759+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff76c01b7e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.759+0000 7ff788d58680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:14.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.759+0000 7ff788d58680 20 searching for the correct realm 2023-10-05T21:15:14.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.759+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x5654dcbfcd30 2023-10-05T21:15:14.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.759+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff76c01b7e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.759+0000 7ff77be30700 1 --2- 172.21.15.153:0/1196324131 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ff76c018bd0 0x7ff76c01baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.759+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x7ff76c018bd0 2023-10-05T21:15:14.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.759+0000 7ff77b62f700 1 --2- 172.21.15.153:0/1196324131 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ff76c018bd0 0x7ff76c01baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.759+0000 7ff77b62f700 1 --2- 172.21.15.153:0/1196324131 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ff76c018bd0 0x7ff76c01baa0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.760+0000 7ff77b62f700 1 -- 172.21.15.153:0/1196324131 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff764006070 con 0x7ff76c018bd0 2023-10-05T21:15:14.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.760+0000 7ff77b62f700 1 --2- 172.21.15.153:0/1196324131 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ff76400d8e0 0x7ff76400c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.760+0000 7ff77b62f700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x7ff76400d8e0 2023-10-05T21:15:14.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.760+0000 7ff77c631700 1 --2- 172.21.15.153:0/1196324131 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ff76400d8e0 0x7ff76400c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.760+0000 7ff77c631700 1 --2- 172.21.15.153:0/1196324131 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ff76400d8e0 0x7ff76400c360 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.760+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff774014040 con 0x7ff76400d8e0 2023-10-05T21:15:14.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.760+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x5654dcbcb5d0 2023-10-05T21:15:14.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.761+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff774014040 con 0x5654dcbcb5d0 2023-10-05T21:15:14.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.761+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x5654dcbcb5d0 2023-10-05T21:15:14.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.761+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff774014040 con 0x5654dcbcb5d0 2023-10-05T21:15:14.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.761+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x7ff76400d8e0 2023-10-05T21:15:14.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.761+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff774014040 con 0x7ff76400d8e0 2023-10-05T21:15:14.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.761+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x7ff76400d8e0 2023-10-05T21:15:14.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.761+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff774014040 con 0x7ff76400d8e0 2023-10-05T21:15:14.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.761+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x7ff76c018bd0 2023-10-05T21:15:14.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.761+0000 7ff77b62f700 1 -- 172.21.15.153:0/1196324131 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff764006070 con 0x7ff76c018bd0 2023-10-05T21:15:14.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.761+0000 7ff77b62f700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x5654dcbfcd30 2023-10-05T21:15:14.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.762+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff76c01b7e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.762+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x5654dcbcb5d0 2023-10-05T21:15:14.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.762+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff774014040 con 0x5654dcbcb5d0 2023-10-05T21:15:14.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.762+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x7ff76400d8e0 2023-10-05T21:15:14.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.762+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff774014040 con 0x7ff76400d8e0 2023-10-05T21:15:14.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.762+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x5654dcbcb5d0 2023-10-05T21:15:14.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.762+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff774014040 con 0x5654dcbcb5d0 2023-10-05T21:15:14.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.762+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x7ff76c018bd0 2023-10-05T21:15:14.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.762+0000 7ff77b62f700 1 -- 172.21.15.153:0/1196324131 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff764006070 con 0x7ff76c018bd0 2023-10-05T21:15:14.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.763+0000 7ff77b62f700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x5654dcbfcd30 2023-10-05T21:15:14.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.763+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff76c01b7e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.763+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x5654dcbfcd30 2023-10-05T21:15:14.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.763+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff76c01b7e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.763+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x7ff76400d8e0 2023-10-05T21:15:14.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.763+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff774014040 con 0x7ff76400d8e0 2023-10-05T21:15:14.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.763+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x5654dcbfcd30 2023-10-05T21:15:14.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.763+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff76c01b7e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.763+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x5654dcbfcd30 2023-10-05T21:15:14.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.763+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff76c01b7e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.763+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x5654dcbcb5d0 2023-10-05T21:15:14.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.764+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff774014040 con 0x5654dcbcb5d0 2023-10-05T21:15:14.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.764+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x5654dcbcb5d0 2023-10-05T21:15:14.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.764+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff774022080 con 0x5654dcbcb5d0 2023-10-05T21:15:14.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.764+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x7ff76400d8e0 2023-10-05T21:15:14.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.764+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff774022080 con 0x7ff76400d8e0 2023-10-05T21:15:14.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.764+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x5654dcbfcd30 2023-10-05T21:15:14.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.764+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff76c01b7e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.764+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x7ff76c018bd0 2023-10-05T21:15:14.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.765+0000 7ff77b62f700 1 -- 172.21.15.153:0/1196324131 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff764006070 con 0x7ff76c018bd0 2023-10-05T21:15:14.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.765+0000 7ff77b62f700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x5654dcbcb5d0 2023-10-05T21:15:14.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.765+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff774022080 con 0x5654dcbcb5d0 2023-10-05T21:15:14.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.765+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x7ff76400d8e0 2023-10-05T21:15:14.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.765+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff774022080 con 0x7ff76400d8e0 2023-10-05T21:15:14.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.765+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x5654dcbfcd30 2023-10-05T21:15:14.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.765+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff76c01b7e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.765+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x7ff76400d8e0 2023-10-05T21:15:14.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.765+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff774022080 con 0x7ff76400d8e0 2023-10-05T21:15:14.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.765+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x7ff76c018bd0 2023-10-05T21:15:14.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.766+0000 7ff77b62f700 1 -- 172.21.15.153:0/1196324131 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff764006070 con 0x7ff76c018bd0 2023-10-05T21:15:14.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.766+0000 7ff77b62f700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x5654dcbfcd30 2023-10-05T21:15:14.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.766+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff76c01b7e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.766+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x7ff76400d8e0 2023-10-05T21:15:14.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.766+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff774022080 con 0x7ff76400d8e0 2023-10-05T21:15:14.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.766+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x5654dcbcb5d0 2023-10-05T21:15:14.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.766+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff774022080 con 0x5654dcbcb5d0 2023-10-05T21:15:14.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.766+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc00f00 con 0x7ff76c018bd0 2023-10-05T21:15:14.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.767+0000 7ff77b62f700 1 -- 172.21.15.153:0/1196324131 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff764006070 con 0x7ff76c018bd0 2023-10-05T21:15:14.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.767+0000 7ff788d58680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:14.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.767+0000 7ff788d58680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:14.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.767+0000 7ff788d58680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:14.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.767+0000 7ff788d58680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:14.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.767+0000 7ff788d58680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.767+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcbfffa0 con 0x5654dcbcb5d0 2023-10-05T21:15:14.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.767+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff774022080 con 0x5654dcbcb5d0 2023-10-05T21:15:14.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.767+0000 7ff788d58680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.767+0000 7ff788d58680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.767+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcbffba0 con 0x5654dcbcb5d0 2023-10-05T21:15:14.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.767+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff774022080 con 0x5654dcbcb5d0 2023-10-05T21:15:14.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.767+0000 7ff788d58680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.767+0000 7ff788d58680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.767+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc008e0 con 0x5654dcbcb5d0 2023-10-05T21:15:14.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.767+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7ff774022080 con 0x5654dcbcb5d0 2023-10-05T21:15:14.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.767+0000 7ff788d58680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:14.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.767+0000 7ff788d58680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.767+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc012b0 con 0x5654dcbfcd30 2023-10-05T21:15:14.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.767+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7ff76c01b7e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.767+0000 7ff788d58680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.767+0000 7ff788d58680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.767+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc003d0 con 0x5654dcbcb5d0 2023-10-05T21:15:14.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.768+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff774022080 con 0x5654dcbcb5d0 2023-10-05T21:15:14.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.768+0000 7ff788d58680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.768+0000 7ff788d58680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.768+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc01b50 con 0x5654dcbcb5d0 2023-10-05T21:15:14.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.768+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff774022080 con 0x5654dcbcb5d0 2023-10-05T21:15:14.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.768+0000 7ff788d58680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.768+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc02b60 con 0x5654dcbfcd30 2023-10-05T21:15:14.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.768+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff76c01b7e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.768+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc02b60 con 0x7ff76c018bd0 2023-10-05T21:15:14.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.768+0000 7ff77b62f700 1 -- 172.21.15.153:0/1196324131 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff764006070 con 0x7ff76c018bd0 2023-10-05T21:15:14.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.768+0000 7ff77b62f700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc02b60 con 0x7ff76400d8e0 2023-10-05T21:15:14.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.769+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff774022080 con 0x7ff76400d8e0 2023-10-05T21:15:14.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.769+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc008e0 con 0x5654dcbcb5d0 2023-10-05T21:15:14.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.769+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff774022080 con 0x5654dcbcb5d0 2023-10-05T21:15:14.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.769+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc008e0 con 0x5654dcbcb5d0 2023-10-05T21:15:14.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.769+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff774022080 con 0x5654dcbcb5d0 2023-10-05T21:15:14.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.769+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc008e0 con 0x7ff76400d8e0 2023-10-05T21:15:14.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.770+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff774022080 con 0x7ff76400d8e0 2023-10-05T21:15:14.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.770+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc008e0 con 0x7ff76400d8e0 2023-10-05T21:15:14.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.770+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff774022080 con 0x7ff76400d8e0 2023-10-05T21:15:14.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.770+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc008e0 con 0x7ff76c018bd0 2023-10-05T21:15:14.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.770+0000 7ff77b62f700 1 -- 172.21.15.153:0/1196324131 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff764006070 con 0x7ff76c018bd0 2023-10-05T21:15:14.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.770+0000 7ff77b62f700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc008e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.770+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff76c01b7e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.770+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc008e0 con 0x5654dcbcb5d0 2023-10-05T21:15:14.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.770+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff774022080 con 0x5654dcbcb5d0 2023-10-05T21:15:14.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.770+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc008e0 con 0x7ff76400d8e0 2023-10-05T21:15:14.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.771+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff774022080 con 0x7ff76400d8e0 2023-10-05T21:15:14.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.771+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc008e0 con 0x5654dcbcb5d0 2023-10-05T21:15:14.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.771+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff774022080 con 0x5654dcbcb5d0 2023-10-05T21:15:14.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.771+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc008e0 con 0x7ff76c018bd0 2023-10-05T21:15:14.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.771+0000 7ff77b62f700 1 -- 172.21.15.153:0/1196324131 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff764006070 con 0x7ff76c018bd0 2023-10-05T21:15:14.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.771+0000 7ff77b62f700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc008e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.771+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff76c01b7e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.771+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc008e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.771+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff76c01b7e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.771+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc008e0 con 0x7ff76400d8e0 2023-10-05T21:15:14.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.772+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff774022080 con 0x7ff76400d8e0 2023-10-05T21:15:14.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.772+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc008e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.772+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff76c01b7e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.772+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc008e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.772+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff76c01b7e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.772+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc008e0 con 0x5654dcbcb5d0 2023-10-05T21:15:14.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.772+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff774022080 con 0x5654dcbcb5d0 2023-10-05T21:15:14.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.772+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc008e0 con 0x5654dcbcb5d0 2023-10-05T21:15:14.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.772+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff774022080 con 0x5654dcbcb5d0 2023-10-05T21:15:14.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.772+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc008e0 con 0x7ff76400d8e0 2023-10-05T21:15:14.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.773+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff774022080 con 0x7ff76400d8e0 2023-10-05T21:15:14.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.773+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc008e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.773+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff76c01b7e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.773+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc008e0 con 0x7ff76c018bd0 2023-10-05T21:15:14.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.773+0000 7ff77b62f700 1 -- 172.21.15.153:0/1196324131 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff764006070 con 0x7ff76c018bd0 2023-10-05T21:15:14.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.773+0000 7ff77b62f700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc008e0 con 0x5654dcbcb5d0 2023-10-05T21:15:14.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.773+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff774022080 con 0x5654dcbcb5d0 2023-10-05T21:15:14.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.773+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc008e0 con 0x7ff76400d8e0 2023-10-05T21:15:14.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.774+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff774022080 con 0x7ff76400d8e0 2023-10-05T21:15:14.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.774+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc008e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.774+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff76c01b7e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.774+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc008e0 con 0x7ff76400d8e0 2023-10-05T21:15:14.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.775+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff774022080 con 0x7ff76400d8e0 2023-10-05T21:15:14.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.775+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc008e0 con 0x7ff76c018bd0 2023-10-05T21:15:14.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.775+0000 7ff77b62f700 1 -- 172.21.15.153:0/1196324131 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff764006070 con 0x7ff76c018bd0 2023-10-05T21:15:14.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.775+0000 7ff77b62f700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc008e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.775+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff76c01b7e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.775+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc008e0 con 0x7ff76400d8e0 2023-10-05T21:15:14.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.775+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff774022080 con 0x7ff76400d8e0 2023-10-05T21:15:14.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.775+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc008e0 con 0x5654dcbcb5d0 2023-10-05T21:15:14.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.776+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff774022080 con 0x5654dcbcb5d0 2023-10-05T21:15:14.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.776+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc008e0 con 0x7ff76c018bd0 2023-10-05T21:15:14.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.776+0000 7ff77b62f700 1 -- 172.21.15.153:0/1196324131 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff764006070 con 0x7ff76c018bd0 2023-10-05T21:15:14.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.776+0000 7ff788d58680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:14.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.776+0000 7ff788d58680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:14.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.776+0000 7ff788d58680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:14.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.776+0000 7ff788d58680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:14.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.776+0000 7ff788d58680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.776+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc01b50 con 0x5654dcbcb5d0 2023-10-05T21:15:14.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.776+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff774022080 con 0x5654dcbcb5d0 2023-10-05T21:15:14.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.776+0000 7ff788d58680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.776+0000 7ff788d58680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.776+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc01f00 con 0x5654dcbfcd30 2023-10-05T21:15:14.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.776+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff76c01b7e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.776+0000 7ff788d58680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:14.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.776+0000 7ff788d58680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.776+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc022b0 con 0x5654dcbcb5d0 2023-10-05T21:15:14.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.777+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff774022080 con 0x5654dcbcb5d0 2023-10-05T21:15:14.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.777+0000 7ff788d58680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.777+0000 7ff788d58680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.777+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc022b0 con 0x5654dcbcb5d0 2023-10-05T21:15:14.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.777+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7ff774022080 con 0x5654dcbcb5d0 2023-10-05T21:15:14.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.777+0000 7ff788d58680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:14.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.777+0000 7ff788d58680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.777+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc02700 con 0x7ff76400d8e0 2023-10-05T21:15:14.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.777+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7ff774022080 con 0x7ff76400d8e0 2023-10-05T21:15:14.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.777+0000 7ff788d58680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.777+0000 7ff788d58680 20 zone default found 2023-10-05T21:15:14.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.777+0000 7ff788d58680 4 Realm: () 2023-10-05T21:15:14.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.777+0000 7ff788d58680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:14.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.777+0000 7ff788d58680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:14.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.777+0000 7ff788d58680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:14.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.777+0000 7ff788d58680 20 zonegroup default 2023-10-05T21:15:14.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.777+0000 7ff788d58680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.777+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc02700 con 0x7ff76400d8e0 2023-10-05T21:15:14.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.777+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff774022080 con 0x7ff76400d8e0 2023-10-05T21:15:14.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.777+0000 7ff788d58680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.777+0000 7ff788d58680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.777+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc03f20 con 0x5654dcbfcd30 2023-10-05T21:15:14.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.778+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff76c01b7e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.778+0000 7ff788d58680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.778+0000 7ff788d58680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.778+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc042d0 con 0x5654dcbfcd30 2023-10-05T21:15:14.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.778+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff76c01b7e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.778+0000 7ff788d58680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.778+0000 7ff788d58680 20 started sync module instance, tier type = 2023-10-05T21:15:14.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.778+0000 7ff788d58680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:14.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.778+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc035e0 con 0x7ff76c018bd0 2023-10-05T21:15:14.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.779+0000 7ff77b62f700 1 -- 172.21.15.153:0/1196324131 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff764006070 con 0x7ff76c018bd0 2023-10-05T21:15:14.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.779+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94922480826848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc04b70 con 0x7ff76c018bd0 2023-10-05T21:15:14.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.779+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc05410 con 0x5654dcbcb5d0 2023-10-05T21:15:14.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.779+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff774022080 con 0x5654dcbcb5d0 2023-10-05T21:15:14.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.779+0000 7ff77b62f700 1 -- 172.21.15.153:0/1196324131 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94922480826848] v29'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff764006070 con 0x7ff76c018bd0 2023-10-05T21:15:14.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.779+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94922480832288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc05860 con 0x5654dcbcb5d0 2023-10-05T21:15:14.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.779+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc06100 con 0x5654dcbfcd30 2023-10-05T21:15:14.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.780+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94922480832288] v29'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff774022080 con 0x5654dcbcb5d0 2023-10-05T21:15:14.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.780+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff76c01b7e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.780+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94922480833680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc064b0 con 0x5654dcbfcd30 2023-10-05T21:15:14.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.780+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc06ec0 con 0x7ff76c018bd0 2023-10-05T21:15:14.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.781+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94922480833680] v29'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff76c01b7e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.781+0000 7ff77b62f700 1 -- 172.21.15.153:0/1196324131 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff764006070 con 0x7ff76c018bd0 2023-10-05T21:15:14.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.781+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94922480839120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc07270 con 0x7ff76c018bd0 2023-10-05T21:15:14.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.781+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc07c80 con 0x5654dcbcb5d0 2023-10-05T21:15:14.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.782+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff774022080 con 0x5654dcbcb5d0 2023-10-05T21:15:14.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.782+0000 7ff77b62f700 1 -- 172.21.15.153:0/1196324131 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94922480839120] v29'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff764006070 con 0x7ff76c018bd0 2023-10-05T21:15:14.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.782+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94922480842928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc081f0 con 0x5654dcbcb5d0 2023-10-05T21:15:14.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.782+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc08a90 con 0x7ff76400d8e0 2023-10-05T21:15:14.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.782+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94922480842928] v29'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff774022080 con 0x5654dcbcb5d0 2023-10-05T21:15:14.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.782+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff774022080 con 0x7ff76400d8e0 2023-10-05T21:15:14.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.782+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94922480844592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc088b0 con 0x7ff76400d8e0 2023-10-05T21:15:14.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.782+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc088b0 con 0x7ff76400d8e0 2023-10-05T21:15:14.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.783+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94922480844592] v29'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff774022080 con 0x7ff76400d8e0 2023-10-05T21:15:14.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.783+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff774022080 con 0x7ff76400d8e0 2023-10-05T21:15:14.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.783+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94922480848656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc09440 con 0x7ff76400d8e0 2023-10-05T21:15:14.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.783+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc09ee0 con 0x7ff76400d8e0 2023-10-05T21:15:14.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.784+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94922480848656] v29'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff774022080 con 0x7ff76400d8e0 2023-10-05T21:15:14.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.784+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff774022080 con 0x7ff76400d8e0 2023-10-05T21:15:14.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.784+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94922480851344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc09ea0 con 0x7ff76400d8e0 2023-10-05T21:15:14.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.784+0000 7ff788d58680 20 add_watcher() i=0 2023-10-05T21:15:14.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.784+0000 7ff788d58680 20 add_watcher() i=1 2023-10-05T21:15:14.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.784+0000 7ff788d58680 20 add_watcher() i=2 2023-10-05T21:15:14.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.784+0000 7ff788d58680 20 add_watcher() i=3 2023-10-05T21:15:14.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.784+0000 7ff788d58680 20 add_watcher() i=4 2023-10-05T21:15:14.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.784+0000 7ff788d58680 20 add_watcher() i=5 2023-10-05T21:15:14.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.784+0000 7ff788d58680 20 add_watcher() i=6 2023-10-05T21:15:14.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.784+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94922480851344] v29'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff774022080 con 0x7ff76400d8e0 2023-10-05T21:15:14.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.784+0000 7ff788d58680 20 add_watcher() i=7 2023-10-05T21:15:14.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.784+0000 7ff788d58680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:14.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.784+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc0d2e0 con 0x5654dcbcb5d0 2023-10-05T21:15:14.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.785+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff774022080 con 0x5654dcbcb5d0 2023-10-05T21:15:14.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.785+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94922480845696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc0a7a0 con 0x5654dcbcb5d0 2023-10-05T21:15:14.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.785+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94922480845696] v29'80 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff774022080 con 0x5654dcbcb5d0 2023-10-05T21:15:14.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.786+0000 7ff74d7e2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:14.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.786+0000 7ff788d58680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:14.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.786+0000 7ff788d58680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:14.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.786+0000 7ff788d58680 1 Processor -- start 2023-10-05T21:15:14.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.786+0000 7ff788d58680 1 -- start start 2023-10-05T21:15:14.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.786+0000 7ff788d58680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcbc85f0 0x5654dcbc8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.786+0000 7ff788d58680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654dcbc8f40 con 0x5654dcbc85f0 2023-10-05T21:15:14.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.786+0000 7ff77b62f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcbc85f0 0x5654dcbc8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.786+0000 7ff77b62f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcbc85f0 0x5654dcbc8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50036/0 (socket says 172.21.15.153:50036) 2023-10-05T21:15:14.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.786+0000 7ff77b62f700 1 -- 172.21.15.153:0/1880065301 learned_addr learned my addr 172.21.15.153:0/1880065301 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:14.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.787+0000 7ff77b62f700 1 -- 172.21.15.153:0/1880065301 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654dcbc6e70 con 0x5654dcbc85f0 2023-10-05T21:15:14.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.787+0000 7ff77b62f700 1 --2- 172.21.15.153:0/1880065301 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcbc85f0 0x5654dcbc8a00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x5654dcbfc4b0 tx=0x7ff764006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd7c9a7cc91612d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.787+0000 7ff74cfe1700 1 -- 172.21.15.153:0/1880065301 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff764023040 con 0x5654dcbc85f0 2023-10-05T21:15:14.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.787+0000 7ff74cfe1700 1 -- 172.21.15.153:0/1880065301 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff764024040 con 0x5654dcbc85f0 2023-10-05T21:15:14.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.787+0000 7ff74cfe1700 1 -- 172.21.15.153:0/1880065301 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff764013040 con 0x5654dcbc85f0 2023-10-05T21:15:14.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.788+0000 7ff788d58680 1 -- 172.21.15.153:0/1880065301 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcbc85f0 msgr2=0x5654dcbc8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.788+0000 7ff788d58680 1 --2- 172.21.15.153:0/1880065301 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcbc85f0 0x5654dcbc8a00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x5654dcbfc4b0 tx=0x7ff764006000 comp rx=0 tx=0).stop 2023-10-05T21:15:14.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.788+0000 7ff788d58680 1 -- 172.21.15.153:0/1880065301 shutdown_connections 2023-10-05T21:15:14.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.788+0000 7ff788d58680 1 --2- 172.21.15.153:0/1880065301 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcbc85f0 0x5654dcbc8a00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.788+0000 7ff788d58680 1 -- 172.21.15.153:0/1880065301 >> 172.21.15.153:0/1880065301 conn(0x5654dcc12ee0 msgr2=0x5654dcc11040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.788+0000 7ff788d58680 1 -- 172.21.15.153:0/1880065301 shutdown_connections 2023-10-05T21:15:14.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.788+0000 7ff788d58680 1 -- 172.21.15.153:0/1880065301 wait complete. 2023-10-05T21:15:14.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.788+0000 7ff788d58680 1 Processor -- start 2023-10-05T21:15:14.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.788+0000 7ff788d58680 1 -- start start 2023-10-05T21:15:14.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.788+0000 7ff788d58680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcbc85f0 0x5654dcc1fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.788+0000 7ff788d58680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654dcc20040 con 0x5654dcbc85f0 2023-10-05T21:15:14.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.788+0000 7ff77b62f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcbc85f0 0x5654dcc1fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.788+0000 7ff77b62f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcbc85f0 0x5654dcc1fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50038/0 (socket says 172.21.15.153:50038) 2023-10-05T21:15:14.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.788+0000 7ff77b62f700 1 -- 172.21.15.153:0/521819540 learned_addr learned my addr 172.21.15.153:0/521819540 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:14.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.789+0000 7ff77b62f700 1 -- 172.21.15.153:0/521819540 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76400ed40 con 0x5654dcbc85f0 2023-10-05T21:15:14.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.789+0000 7ff77b62f700 1 --2- 172.21.15.153:0/521819540 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcbc85f0 0x5654dcc1fb00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff76400dfd0 tx=0x7ff76402f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.789+0000 7ff6c6ffd700 1 -- 172.21.15.153:0/521819540 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff764023040 con 0x5654dcbc85f0 2023-10-05T21:15:14.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.789+0000 7ff6c6ffd700 1 -- 172.21.15.153:0/521819540 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76403b600 con 0x5654dcbc85f0 2023-10-05T21:15:14.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.789+0000 7ff6c6ffd700 1 -- 172.21.15.153:0/521819540 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff76403b770 con 0x5654dcbc85f0 2023-10-05T21:15:14.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.789+0000 7ff788d58680 1 -- 172.21.15.153:0/521819540 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5654dcc20240 con 0x5654dcbc85f0 2023-10-05T21:15:14.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.789+0000 7ff788d58680 1 -- 172.21.15.153:0/521819540 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5654dcc20690 con 0x5654dcbc85f0 2023-10-05T21:15:14.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.789+0000 7ff6c6ffd700 1 -- 172.21.15.153:0/521819540 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7ff76403b8d0 con 0x5654dcbc85f0 2023-10-05T21:15:14.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.790+0000 7ff6c6ffd700 1 --2- 172.21.15.153:0/521819540 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff6bc034140 0x7ff6bc0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.790+0000 7ff6c6ffd700 1 -- 172.21.15.153:0/521819540 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7ff76404eb00 con 0x5654dcbc85f0 2023-10-05T21:15:14.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.790+0000 7ff77c631700 1 --2- 172.21.15.153:0/521819540 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff6bc034140 0x7ff6bc0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.790+0000 7ff788d58680 5 note: GC not initialized 2023-10-05T21:15:14.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.790+0000 7ff77c631700 1 --2- 172.21.15.153:0/521819540 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff6bc034140 0x7ff6bc0365f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x5654dcc0a100 tx=0x7ff774005500 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.791+0000 7ff6bbfff700 20 reqs_thread_entry: start 2023-10-05T21:15:14.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.791+0000 7ff6b9ffb700 20 reqs_thread_entry: start 2023-10-05T21:15:14.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.791+0000 7ff788d58680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:14.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.791+0000 7ff788d58680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:14.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.791+0000 7ff6a7fff700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:44 2023 2023-10-05T21:15:14.827 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:14.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.791+0000 7ff6a77fe700 20 reqs_thread_entry: start 2023-10-05T21:15:14.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.791+0000 7ff788d58680 20 get_system_obj_state: rctx=0x7ffd93dc5188 obj=default.rgw.meta:users.uid:foo state=0x5654dca7b240 s->prefetch_data=0 2023-10-05T21:15:14.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.791+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc853e0 con 0x5654dcbcb5d0 2023-10-05T21:15:14.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.792+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv8 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7ff774022080 con 0x5654dcbcb5d0 2023-10-05T21:15:14.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.792+0000 7ff788d58680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:14.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.792+0000 7ff788d58680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:14.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.792+0000 7ff788d58680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.792+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc87670 con 0x5654dcbcb5d0 2023-10-05T21:15:14.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.792+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~621 out=621b,getxattrs out=75b] v0'0 uv8 ondisk = 0) v8 ==== 273+0+744 (crc 0 0 0) 0x7ff774022080 con 0x5654dcbcb5d0 2023-10-05T21:15:14.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.792+0000 7ff788d58680 20 rados_obj.operate() r=0 bl.length=621 2023-10-05T21:15:14.829 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "foo", 2023-10-05T21:15:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Foo", 2023-10-05T21:15:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "foo@foo.com", 2023-10-05T21:15:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2023-10-05T21:15:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 4, 2023-10-05T21:15:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [ 2023-10-05T21:15:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: "id": "foo:foo1", 2023-10-05T21:15:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: "permissions": "full-control" 2023-10-05T21:15:14.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: "id": "foo:foo2", 2023-10-05T21:15:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: "permissions": "" 2023-10-05T21:15:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2023-10-05T21:15:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T21:15:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:14.830 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [ 2023-10-05T21:15:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo:foo1", 2023-10-05T21:15:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL" 2023-10-05T21:15:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo:foo2", 2023-10-05T21:15:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy" 2023-10-05T21:15:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2023-10-05T21:15:14.831 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2023-10-05T21:15:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2023-10-05T21:15:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2023-10-05T21:15:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2023-10-05T21:15:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:15:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2023-10-05T21:15:14.832 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2023-10-05T21:15:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2023-10-05T21:15:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [] 2023-10-05T21:15:14.833 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:14.833 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:15:14.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.792+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94922480826848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc87660 con 0x7ff76c018bd0 2023-10-05T21:15:14.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.793+0000 7ff77b62f700 1 -- 172.21.15.153:0/1196324131 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94922480826848] v29'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff764006070 con 0x7ff76c018bd0 2023-10-05T21:15:14.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.793+0000 7ff788d58680 20 remove_watcher() i=0 2023-10-05T21:15:14.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.793+0000 7ff788d58680 2 removed watcher, disabling cache 2023-10-05T21:15:14.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.793+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94922480832288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc039e0 con 0x5654dcbcb5d0 2023-10-05T21:15:14.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.794+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94922480832288] v29'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff774022080 con 0x5654dcbcb5d0 2023-10-05T21:15:14.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.794+0000 7ff788d58680 20 remove_watcher() i=1 2023-10-05T21:15:14.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.794+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94922480833680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc039e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.794+0000 7ff77be30700 1 -- 172.21.15.153:0/1196324131 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94922480833680] v29'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff76c01b7e0 con 0x5654dcbfcd30 2023-10-05T21:15:14.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.794+0000 7ff788d58680 20 remove_watcher() i=2 2023-10-05T21:15:14.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.794+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94922480839120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc05490 con 0x7ff76c018bd0 2023-10-05T21:15:14.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.795+0000 7ff77b62f700 1 -- 172.21.15.153:0/1196324131 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94922480839120] v29'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff764006070 con 0x7ff76c018bd0 2023-10-05T21:15:14.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.795+0000 7ff788d58680 20 remove_watcher() i=3 2023-10-05T21:15:14.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.795+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94922480842928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc039e0 con 0x5654dcbcb5d0 2023-10-05T21:15:14.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.796+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94922480842928] v29'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff774022080 con 0x5654dcbcb5d0 2023-10-05T21:15:14.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.796+0000 7ff788d58680 20 remove_watcher() i=4 2023-10-05T21:15:14.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.796+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94922480844592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc069d0 con 0x7ff76400d8e0 2023-10-05T21:15:14.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.797+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94922480844592] v29'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff774022080 con 0x7ff76400d8e0 2023-10-05T21:15:14.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.797+0000 7ff788d58680 20 remove_watcher() i=5 2023-10-05T21:15:14.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.797+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94922480848656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc078b0 con 0x7ff76400d8e0 2023-10-05T21:15:14.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.797+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94922480848656] v29'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff774022080 con 0x7ff76400d8e0 2023-10-05T21:15:14.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.797+0000 7ff788d58680 20 remove_watcher() i=6 2023-10-05T21:15:14.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.797+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94922480851344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc039e0 con 0x7ff76400d8e0 2023-10-05T21:15:14.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.798+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94922480851344] v29'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff774022080 con 0x7ff76400d8e0 2023-10-05T21:15:14.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.798+0000 7ff788d58680 20 remove_watcher() i=7 2023-10-05T21:15:14.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.799+0000 7ff74d7e2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:14.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.799+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:112 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94922480845696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5654dcc07f30 con 0x5654dcbcb5d0 2023-10-05T21:15:14.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.799+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(112 data_loggenerations_metadata [watch unwatch cookie 94922480845696] v29'81 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff774022080 con 0x5654dcbcb5d0 2023-10-05T21:15:14.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.799+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ff76400d8e0 msgr2=0x7ff76400c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.799+0000 7ff788d58680 1 --2- 172.21.15.153:0/1196324131 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ff76400d8e0 0x7ff76400c360 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.799+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5654dcbcb5d0 msgr2=0x5654dcbfa7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.799+0000 7ff788d58680 1 --2- 172.21.15.153:0/1196324131 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5654dcbcb5d0 0x5654dcbfa7a0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.799+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ff76c018bd0 msgr2=0x7ff76c01baa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.799+0000 7ff788d58680 1 --2- 172.21.15.153:0/1196324131 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ff76c018bd0 0x7ff76c01baa0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.799+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5654dcbfcd30 msgr2=0x5654dcbff110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.799+0000 7ff788d58680 1 --2- 172.21.15.153:0/1196324131 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5654dcbfcd30 0x5654dcbff110 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.800+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff75c034140 msgr2=0x7ff75c0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.800+0000 7ff788d58680 1 --2- 172.21.15.153:0/1196324131 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff75c034140 0x7ff75c0365f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff7640011e0 tx=0x7ff7640013a0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.800+0000 7ff77c631700 1 -- 172.21.15.153:0/1196324131 reap_dead start 2023-10-05T21:15:14.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.800+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcb3c0a0 msgr2=0x5654dcbeea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.800+0000 7ff788d58680 1 --2- 172.21.15.153:0/1196324131 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcb3c0a0 0x5654dcbeea90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff76c00a520 tx=0x7ff76c01d000 comp rx=0 tx=0).stop 2023-10-05T21:15:14.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.800+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 shutdown_connections 2023-10-05T21:15:14.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.800+0000 7ff788d58680 1 --2- 172.21.15.153:0/1196324131 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcb3c0a0 0x5654dcbeea90 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.800+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 >> 172.21.15.153:0/1196324131 conn(0x5654dcbc2b80 msgr2=0x5654dcbe1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.800+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 shutdown_connections 2023-10-05T21:15:14.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.800+0000 7ff788d58680 1 -- 172.21.15.153:0/1196324131 wait complete. 2023-10-05T21:15:14.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.800+0000 7ff788d58680 1 -- 172.21.15.153:0/521819540 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff6bc034140 msgr2=0x7ff6bc0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.800+0000 7ff788d58680 1 --2- 172.21.15.153:0/521819540 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff6bc034140 0x7ff6bc0365f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x5654dcc0a100 tx=0x7ff774005500 comp rx=0 tx=0).stop 2023-10-05T21:15:14.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.800+0000 7ff788d58680 1 -- 172.21.15.153:0/521819540 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcbc85f0 msgr2=0x5654dcc1fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.800+0000 7ff788d58680 1 --2- 172.21.15.153:0/521819540 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcbc85f0 0x5654dcc1fb00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff76400dfd0 tx=0x7ff76402f000 comp rx=0 tx=0).stop 2023-10-05T21:15:14.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.800+0000 7ff788d58680 1 -- 172.21.15.153:0/521819540 shutdown_connections 2023-10-05T21:15:14.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.800+0000 7ff788d58680 1 --2- 172.21.15.153:0/521819540 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff6bc034140 0x7ff6bc0365f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.800+0000 7ff788d58680 1 --2- 172.21.15.153:0/521819540 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5654dcbc85f0 0x5654dcc1fb00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.800+0000 7ff788d58680 1 -- 172.21.15.153:0/521819540 >> 172.21.15.153:0/521819540 conn(0x5654dcc12ee0 msgr2=0x5654dcc11010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.800+0000 7ff788d58680 1 -- 172.21.15.153:0/521819540 shutdown_connections 2023-10-05T21:15:14.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.800+0000 7ff788d58680 1 -- 172.21.15.153:0/521819540 wait complete. 2023-10-05T21:15:14.843 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:15:14.843 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2023-10-05T21:15:14.843 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2023-10-05T21:15:14.843 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2023-10-05T21:15:14.890 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:14.890 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:14.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.889+0000 7eff32bbe680 1 Processor -- start 2023-10-05T21:15:14.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.889+0000 7eff32bbe680 1 -- start start 2023-10-05T21:15:14.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.890+0000 7eff32bbe680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55df8423c910 0x55df8423cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.890+0000 7eff32bbe680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55df8418a930 con 0x55df8423d260 2023-10-05T21:15:14.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.890+0000 7eff32bbe680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55df8414adb0 con 0x55df8423c910 2023-10-05T21:15:14.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.890+0000 7eff25c96700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55df8423c910 0x55df8423cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.890+0000 7eff25495700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55df8423d260 0x55df8423d6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56322/0 (socket says 172.21.15.153:56322) 2023-10-05T21:15:14.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.890+0000 7eff25495700 1 -- 172.21.15.153:0/4137764110 learned_addr learned my addr 172.21.15.153:0/4137764110 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:14.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.890+0000 7eff24c94700 1 -- 172.21.15.153:0/4137764110 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3850495430 0 0) 0x55df8418a930 con 0x55df8423d260 2023-10-05T21:15:14.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.890+0000 7eff24c94700 1 -- 172.21.15.153:0/4137764110 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff10001e10 con 0x55df8423d260 2023-10-05T21:15:14.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.890+0000 7eff25c96700 1 -- 172.21.15.153:0/4137764110 >> v1:172.21.15.111:6789/0 conn(0x55df8423d260 legacy=0x55df8423d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.890+0000 7eff25c96700 1 -- 172.21.15.153:0/4137764110 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df8423dea0 con 0x55df8423c910 2023-10-05T21:15:14.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.890+0000 7eff25c96700 1 --2- 172.21.15.153:0/4137764110 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8423c910 0x55df8423cd20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7eff1800a5d0 tx=0x7eff18005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4359ccc46bbec856 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.891+0000 7eff24c94700 1 -- 172.21.15.153:0/4137764110 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff18007610 con 0x55df8423c910 2023-10-05T21:15:14.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.891+0000 7eff24c94700 1 -- 172.21.15.153:0/4137764110 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff18007770 con 0x55df8423c910 2023-10-05T21:15:14.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.891+0000 7eff24c94700 1 -- 172.21.15.153:0/4137764110 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff18007a40 con 0x55df8423c910 2023-10-05T21:15:14.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.891+0000 7eff32bbe680 1 -- 172.21.15.153:0/4137764110 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8423c910 msgr2=0x55df8423cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.891+0000 7eff32bbe680 1 --2- 172.21.15.153:0/4137764110 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8423c910 0x55df8423cd20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7eff1800a5d0 tx=0x7eff18005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:14.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.891+0000 7eff32bbe680 1 -- 172.21.15.153:0/4137764110 shutdown_connections 2023-10-05T21:15:14.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.891+0000 7eff32bbe680 1 --2- 172.21.15.153:0/4137764110 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8423c910 0x55df8423cd20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.891+0000 7eff32bbe680 1 -- 172.21.15.153:0/4137764110 >> 172.21.15.153:0/4137764110 conn(0x55df84237310 msgr2=0x55df84239720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.891+0000 7eff32bbe680 1 -- 172.21.15.153:0/4137764110 shutdown_connections 2023-10-05T21:15:14.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.891+0000 7eff32bbe680 1 -- 172.21.15.153:0/4137764110 wait complete. 2023-10-05T21:15:14.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.892+0000 7eff32bbe680 1 Processor -- start 2023-10-05T21:15:14.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.892+0000 7eff32bbe680 1 -- start start 2023-10-05T21:15:14.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.892+0000 7eff32bbe680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8423c910 0x55df8425a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.892+0000 7eff32bbe680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df840eaea0 con 0x55df8423c910 2023-10-05T21:15:14.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.892+0000 7eff25c96700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8423c910 0x55df8425a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.892+0000 7eff25c96700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8423c910 0x55df8425a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50056/0 (socket says 172.21.15.153:50056) 2023-10-05T21:15:14.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.892+0000 7eff25c96700 1 -- 172.21.15.153:0/937013790 learned_addr learned my addr 172.21.15.153:0/937013790 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:14.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.893+0000 7eff25c96700 1 -- 172.21.15.153:0/937013790 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff18005cf0 con 0x55df8423c910 2023-10-05T21:15:14.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.893+0000 7eff25c96700 1 --2- 172.21.15.153:0/937013790 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8423c910 0x55df8425a4c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7eff18005a90 tx=0x7eff18014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ebd6cc2d181f73 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.893+0000 7eff177fe700 1 -- 172.21.15.153:0/937013790 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff180078e0 con 0x55df8423c910 2023-10-05T21:15:14.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.893+0000 7eff177fe700 1 -- 172.21.15.153:0/937013790 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff18007a40 con 0x55df8423c910 2023-10-05T21:15:14.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.893+0000 7eff177fe700 1 -- 172.21.15.153:0/937013790 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff18007bb0 con 0x55df8423c910 2023-10-05T21:15:14.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.893+0000 7eff32bbe680 1 -- 172.21.15.153:0/937013790 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8423c910 msgr2=0x55df8425a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.893+0000 7eff32bbe680 1 --2- 172.21.15.153:0/937013790 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8423c910 0x55df8425a4c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7eff18005a90 tx=0x7eff18014000 comp rx=0 tx=0).stop 2023-10-05T21:15:14.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.893+0000 7eff32bbe680 1 -- 172.21.15.153:0/937013790 shutdown_connections 2023-10-05T21:15:14.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.893+0000 7eff32bbe680 1 --2- 172.21.15.153:0/937013790 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8423c910 0x55df8425a4c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.893+0000 7eff32bbe680 1 -- 172.21.15.153:0/937013790 >> 172.21.15.153:0/937013790 conn(0x55df84237310 msgr2=0x55df84255f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.893+0000 7eff32bbe680 1 -- 172.21.15.153:0/937013790 shutdown_connections 2023-10-05T21:15:14.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.893+0000 7eff32bbe680 1 -- 172.21.15.153:0/937013790 wait complete. 2023-10-05T21:15:14.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.894+0000 7eff32bbe680 1 Processor -- start 2023-10-05T21:15:14.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.894+0000 7eff32bbe680 1 -- start start 2023-10-05T21:15:14.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.894+0000 7eff32bbe680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8423c910 0x55df84261940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.894+0000 7eff32bbe680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df840e1c80 con 0x55df8423c910 2023-10-05T21:15:14.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.894+0000 7eff25c96700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8423c910 0x55df84261940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.894+0000 7eff25c96700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8423c910 0x55df84261940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50066/0 (socket says 172.21.15.153:50066) 2023-10-05T21:15:14.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.894+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 learned_addr learned my addr 172.21.15.153:0/2395871686 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:14.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.894+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df8423dea0 con 0x55df8423c910 2023-10-05T21:15:14.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.894+0000 7eff25c96700 1 --2- 172.21.15.153:0/2395871686 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8423c910 0x55df84261940 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7eff18005a90 tx=0x7eff1801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.895+0000 7eff15ffb700 1 -- 172.21.15.153:0/2395871686 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff18026440 con 0x55df8423c910 2023-10-05T21:15:14.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.895+0000 7eff15ffb700 1 -- 172.21.15.153:0/2395871686 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff180265a0 con 0x55df8423c910 2023-10-05T21:15:14.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.895+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55df84261e80 con 0x55df8423c910 2023-10-05T21:15:14.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.895+0000 7eff15ffb700 1 -- 172.21.15.153:0/2395871686 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff18026750 con 0x55df8423c910 2023-10-05T21:15:14.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.895+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55df842622d0 con 0x55df8423c910 2023-10-05T21:15:14.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.895+0000 7eff15ffb700 1 -- 172.21.15.153:0/2395871686 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7eff180268b0 con 0x55df8423c910 2023-10-05T21:15:14.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.895+0000 7eff32bbe680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.896+0000 7eff15ffb700 1 --2- 172.21.15.153:0/2395871686 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7eff08034140 0x7eff080365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.896+0000 7eff15ffb700 1 -- 172.21.15.153:0/2395871686 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7eff1804a420 con 0x55df8423c910 2023-10-05T21:15:14.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.896+0000 7eff25495700 1 --2- 172.21.15.153:0/2395871686 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7eff08034140 0x7eff080365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.896+0000 7eff32bbe680 1 --2- 172.21.15.153:0/2395871686 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55df8423d260 0x55df8426d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.896+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df8426de60 con 0x55df8423d260 2023-10-05T21:15:14.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.896+0000 7eff26497700 1 --2- 172.21.15.153:0/2395871686 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55df8423d260 0x55df8426d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.896+0000 7eff25495700 1 --2- 172.21.15.153:0/2395871686 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7eff08034140 0x7eff080365f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7eff1c004170 tx=0x7eff1c001360 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.896+0000 7eff26497700 1 --2- 172.21.15.153:0/2395871686 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55df8423d260 0x55df8426d6d0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.897+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.897+0000 7eff32bbe680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.897+0000 7eff32bbe680 20 realm 2023-10-05T21:15:14.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.897+0000 7eff32bbe680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.897+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df8426acb0 con 0x55df8423d260 2023-10-05T21:15:14.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.897+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.897+0000 7eff32bbe680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.897+0000 7eff32bbe680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:14.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.897+0000 7eff32bbe680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.897+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df8426e960 con 0x55df8423d260 2023-10-05T21:15:14.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.897+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.897+0000 7eff32bbe680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.897+0000 7eff32bbe680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.897+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df8426f280 con 0x55df8423d260 2023-10-05T21:15:14.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.897+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.897+0000 7eff32bbe680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.897+0000 7eff32bbe680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.897+0000 7eff32bbe680 1 --2- 172.21.15.153:0/2395871686 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55df8426fb40 0x55df84271f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.897+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84272570 con 0x55df8426fb40 2023-10-05T21:15:14.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.897+0000 7eff25c96700 1 --2- 172.21.15.153:0/2395871686 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55df8426fb40 0x55df84271f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.898+0000 7eff25c96700 1 --2- 172.21.15.153:0/2395871686 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55df8426fb40 0x55df84271f20 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.898+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7eff18025cd0 con 0x55df8426fb40 2023-10-05T21:15:14.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.898+0000 7eff32bbe680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:14.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.898+0000 7eff32bbe680 20 searching for the correct realm 2023-10-05T21:15:14.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.898+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x55df8426fb40 2023-10-05T21:15:14.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.898+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff18025cd0 con 0x55df8426fb40 2023-10-05T21:15:14.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.898+0000 7eff25c96700 1 --2- 172.21.15.153:0/2395871686 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7eff18007030 0x7eff180373f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.898+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x7eff18007030 2023-10-05T21:15:14.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.898+0000 7eff25495700 1 --2- 172.21.15.153:0/2395871686 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7eff18007030 0x7eff180373f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.899+0000 7eff25495700 1 --2- 172.21.15.153:0/2395871686 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7eff18007030 0x7eff180373f0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.899+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1c006070 con 0x7eff18007030 2023-10-05T21:15:14.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.899+0000 7eff25495700 1 --2- 172.21.15.153:0/2395871686 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7eff1c00ebe0 0x7eff1c00d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.899+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x7eff1c00ebe0 2023-10-05T21:15:14.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.899+0000 7eff26497700 1 --2- 172.21.15.153:0/2395871686 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7eff1c00ebe0 0x7eff1c00d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.899+0000 7eff26497700 1 --2- 172.21.15.153:0/2395871686 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7eff1c00ebe0 0x7eff1c00d8e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.900+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2000a570 con 0x7eff1c00ebe0 2023-10-05T21:15:14.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.900+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x55df8423d260 2023-10-05T21:15:14.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.900+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.900+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x55df8423d260 2023-10-05T21:15:14.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.900+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.900+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x7eff1c00ebe0 2023-10-05T21:15:14.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.900+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2000a570 con 0x7eff1c00ebe0 2023-10-05T21:15:14.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.900+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x7eff1c00ebe0 2023-10-05T21:15:14.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.900+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2000a570 con 0x7eff1c00ebe0 2023-10-05T21:15:14.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.900+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x7eff18007030 2023-10-05T21:15:14.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.901+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1c006070 con 0x7eff18007030 2023-10-05T21:15:14.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.901+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x55df8426fb40 2023-10-05T21:15:14.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.901+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7eff18025cd0 con 0x55df8426fb40 2023-10-05T21:15:14.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.901+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x55df8423d260 2023-10-05T21:15:14.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.901+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.901+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x7eff1c00ebe0 2023-10-05T21:15:14.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.901+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2000a570 con 0x7eff1c00ebe0 2023-10-05T21:15:14.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.901+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x55df8423d260 2023-10-05T21:15:14.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.901+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.902+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x7eff18007030 2023-10-05T21:15:14.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.902+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1c006070 con 0x7eff18007030 2023-10-05T21:15:14.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.902+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x55df8426fb40 2023-10-05T21:15:14.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.902+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff18025cd0 con 0x55df8426fb40 2023-10-05T21:15:14.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.902+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x55df8426fb40 2023-10-05T21:15:14.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.902+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff18025cd0 con 0x55df8426fb40 2023-10-05T21:15:14.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.902+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x7eff1c00ebe0 2023-10-05T21:15:14.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.902+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2000a570 con 0x7eff1c00ebe0 2023-10-05T21:15:14.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.902+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x55df8426fb40 2023-10-05T21:15:14.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.903+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff18025cd0 con 0x55df8426fb40 2023-10-05T21:15:14.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.903+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x55df8426fb40 2023-10-05T21:15:14.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.903+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff18025cd0 con 0x55df8426fb40 2023-10-05T21:15:14.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.903+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x55df8423d260 2023-10-05T21:15:14.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.903+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.903+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x55df8423d260 2023-10-05T21:15:14.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.903+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.903+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x7eff1c00ebe0 2023-10-05T21:15:14.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.903+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2000a570 con 0x7eff1c00ebe0 2023-10-05T21:15:14.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.904+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x55df8426fb40 2023-10-05T21:15:14.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.904+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff18025cd0 con 0x55df8426fb40 2023-10-05T21:15:14.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.904+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x7eff18007030 2023-10-05T21:15:14.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.904+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1c006070 con 0x7eff18007030 2023-10-05T21:15:14.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.904+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x55df8423d260 2023-10-05T21:15:14.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.904+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.904+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x7eff1c00ebe0 2023-10-05T21:15:14.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.904+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2000a570 con 0x7eff1c00ebe0 2023-10-05T21:15:14.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.904+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x55df8426fb40 2023-10-05T21:15:14.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.905+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff18025cd0 con 0x55df8426fb40 2023-10-05T21:15:14.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.905+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x7eff1c00ebe0 2023-10-05T21:15:14.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.905+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2000a570 con 0x7eff1c00ebe0 2023-10-05T21:15:14.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.905+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x7eff18007030 2023-10-05T21:15:14.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.905+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1c006070 con 0x7eff18007030 2023-10-05T21:15:14.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.905+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x55df8426fb40 2023-10-05T21:15:14.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.905+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff18025cd0 con 0x55df8426fb40 2023-10-05T21:15:14.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.905+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x7eff1c00ebe0 2023-10-05T21:15:14.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.906+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2000a570 con 0x7eff1c00ebe0 2023-10-05T21:15:14.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.906+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x55df8423d260 2023-10-05T21:15:14.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.906+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.906+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842740a0 con 0x7eff18007030 2023-10-05T21:15:14.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.906+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1c006070 con 0x7eff18007030 2023-10-05T21:15:14.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.906+0000 7eff32bbe680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:14.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.906+0000 7eff32bbe680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:14.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.906+0000 7eff32bbe680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:14.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.906+0000 7eff32bbe680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:14.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.906+0000 7eff32bbe680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.906+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84272ff0 con 0x55df8423d260 2023-10-05T21:15:14.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.907+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.907+0000 7eff32bbe680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.907+0000 7eff32bbe680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.907+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842733f0 con 0x55df8423d260 2023-10-05T21:15:14.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.907+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.907+0000 7eff32bbe680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.907+0000 7eff32bbe680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.907+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274530 con 0x55df8423d260 2023-10-05T21:15:14.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.907+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.907+0000 7eff32bbe680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:14.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.907+0000 7eff32bbe680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.907+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842748e0 con 0x55df8426fb40 2023-10-05T21:15:14.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.907+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7eff18025cd0 con 0x55df8426fb40 2023-10-05T21:15:14.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.907+0000 7eff32bbe680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.907+0000 7eff32bbe680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.907+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274c90 con 0x55df8423d260 2023-10-05T21:15:14.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.908+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.908+0000 7eff32bbe680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.908+0000 7eff32bbe680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.908+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274c90 con 0x55df8423d260 2023-10-05T21:15:14.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.908+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.908+0000 7eff32bbe680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.908+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274c90 con 0x55df8426fb40 2023-10-05T21:15:14.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.908+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff18025cd0 con 0x55df8426fb40 2023-10-05T21:15:14.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.908+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274c90 con 0x7eff18007030 2023-10-05T21:15:14.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.908+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1c006070 con 0x7eff18007030 2023-10-05T21:15:14.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.908+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274c90 con 0x7eff1c00ebe0 2023-10-05T21:15:14.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.909+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2000a570 con 0x7eff1c00ebe0 2023-10-05T21:15:14.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.909+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274530 con 0x55df8423d260 2023-10-05T21:15:14.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.909+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.909+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274530 con 0x55df8423d260 2023-10-05T21:15:14.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.909+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.909+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274530 con 0x7eff1c00ebe0 2023-10-05T21:15:14.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.909+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2000a570 con 0x7eff1c00ebe0 2023-10-05T21:15:14.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.909+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274530 con 0x7eff1c00ebe0 2023-10-05T21:15:14.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.910+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2000a570 con 0x7eff1c00ebe0 2023-10-05T21:15:14.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.910+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274530 con 0x7eff18007030 2023-10-05T21:15:14.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.910+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1c006070 con 0x7eff18007030 2023-10-05T21:15:14.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.910+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274530 con 0x55df8426fb40 2023-10-05T21:15:14.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.910+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7eff18025cd0 con 0x55df8426fb40 2023-10-05T21:15:14.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.910+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274530 con 0x55df8423d260 2023-10-05T21:15:14.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.910+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.910+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274530 con 0x7eff1c00ebe0 2023-10-05T21:15:14.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.911+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2000a570 con 0x7eff1c00ebe0 2023-10-05T21:15:14.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.911+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274530 con 0x55df8423d260 2023-10-05T21:15:14.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.911+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.911+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274530 con 0x7eff18007030 2023-10-05T21:15:14.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.911+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1c006070 con 0x7eff18007030 2023-10-05T21:15:14.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.911+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274530 con 0x55df8426fb40 2023-10-05T21:15:14.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.911+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff18025cd0 con 0x55df8426fb40 2023-10-05T21:15:14.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.911+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274530 con 0x55df8426fb40 2023-10-05T21:15:14.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.912+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff18025cd0 con 0x55df8426fb40 2023-10-05T21:15:14.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.912+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274530 con 0x7eff1c00ebe0 2023-10-05T21:15:14.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.912+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2000a570 con 0x7eff1c00ebe0 2023-10-05T21:15:14.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.912+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274530 con 0x55df8426fb40 2023-10-05T21:15:14.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.912+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff18025cd0 con 0x55df8426fb40 2023-10-05T21:15:14.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.912+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274530 con 0x55df8426fb40 2023-10-05T21:15:14.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.913+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff18025cd0 con 0x55df8426fb40 2023-10-05T21:15:14.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.913+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274530 con 0x55df8423d260 2023-10-05T21:15:14.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.913+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.913+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274530 con 0x55df8423d260 2023-10-05T21:15:14.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.913+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.913+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274530 con 0x7eff1c00ebe0 2023-10-05T21:15:14.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.913+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2000a570 con 0x7eff1c00ebe0 2023-10-05T21:15:14.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.913+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274530 con 0x55df8426fb40 2023-10-05T21:15:14.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.913+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff18025cd0 con 0x55df8426fb40 2023-10-05T21:15:14.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.913+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274530 con 0x7eff18007030 2023-10-05T21:15:14.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.914+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1c006070 con 0x7eff18007030 2023-10-05T21:15:14.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.914+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274530 con 0x55df8423d260 2023-10-05T21:15:14.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.914+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.914+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274530 con 0x7eff1c00ebe0 2023-10-05T21:15:14.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.914+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2000a570 con 0x7eff1c00ebe0 2023-10-05T21:15:14.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.914+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274530 con 0x55df8426fb40 2023-10-05T21:15:14.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.914+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff18025cd0 con 0x55df8426fb40 2023-10-05T21:15:14.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.914+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274530 con 0x7eff1c00ebe0 2023-10-05T21:15:14.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.915+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2000a570 con 0x7eff1c00ebe0 2023-10-05T21:15:14.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.915+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274530 con 0x7eff18007030 2023-10-05T21:15:14.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.915+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1c006070 con 0x7eff18007030 2023-10-05T21:15:14.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.915+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274530 con 0x55df8426fb40 2023-10-05T21:15:14.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.915+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff18025cd0 con 0x55df8426fb40 2023-10-05T21:15:14.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.915+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274530 con 0x7eff1c00ebe0 2023-10-05T21:15:14.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.915+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff2000a570 con 0x7eff1c00ebe0 2023-10-05T21:15:14.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.915+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274530 con 0x55df8423d260 2023-10-05T21:15:14.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.915+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.915+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274530 con 0x7eff18007030 2023-10-05T21:15:14.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.916+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1c006070 con 0x7eff18007030 2023-10-05T21:15:14.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.916+0000 7eff32bbe680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:14.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.916+0000 7eff32bbe680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:14.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.916+0000 7eff32bbe680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:14.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.916+0000 7eff32bbe680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:14.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.916+0000 7eff32bbe680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.916+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84274c90 con 0x55df8423d260 2023-10-05T21:15:14.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.916+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.916+0000 7eff32bbe680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.916+0000 7eff32bbe680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.916+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842750f0 con 0x55df8426fb40 2023-10-05T21:15:14.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.916+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7eff18025cd0 con 0x55df8426fb40 2023-10-05T21:15:14.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.916+0000 7eff32bbe680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:14.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.916+0000 7eff32bbe680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.916+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842759e0 con 0x55df8423d260 2023-10-05T21:15:14.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.916+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.916+0000 7eff32bbe680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:14.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.916+0000 7eff32bbe680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.916+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842759e0 con 0x55df8423d260 2023-10-05T21:15:14.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.917+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.917+0000 7eff32bbe680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:14.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.917+0000 7eff32bbe680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.917+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842759e0 con 0x7eff1c00ebe0 2023-10-05T21:15:14.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.917+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7eff2000a570 con 0x7eff1c00ebe0 2023-10-05T21:15:14.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.917+0000 7eff32bbe680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.917+0000 7eff32bbe680 20 zone default found 2023-10-05T21:15:14.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.917+0000 7eff32bbe680 4 Realm: () 2023-10-05T21:15:14.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.917+0000 7eff32bbe680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:14.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.917+0000 7eff32bbe680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:14.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.917+0000 7eff32bbe680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:14.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.917+0000 7eff32bbe680 20 zonegroup default 2023-10-05T21:15:14.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.917+0000 7eff32bbe680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.917+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842759e0 con 0x7eff1c00ebe0 2023-10-05T21:15:14.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.918+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7eff2000a570 con 0x7eff1c00ebe0 2023-10-05T21:15:14.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.918+0000 7eff32bbe680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.918+0000 7eff32bbe680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.918+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842759e0 con 0x55df8426fb40 2023-10-05T21:15:14.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.918+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7eff18025cd0 con 0x55df8426fb40 2023-10-05T21:15:14.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.918+0000 7eff32bbe680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.918+0000 7eff32bbe680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.918+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84277810 con 0x55df8426fb40 2023-10-05T21:15:14.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.918+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7eff18025cd0 con 0x55df8426fb40 2023-10-05T21:15:14.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.918+0000 7eff32bbe680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:14.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.918+0000 7eff32bbe680 20 started sync module instance, tier type = 2023-10-05T21:15:14.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.918+0000 7eff32bbe680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:14.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.918+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84276ed0 con 0x7eff18007030 2023-10-05T21:15:14.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.919+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff1c006070 con 0x7eff18007030 2023-10-05T21:15:14.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.919+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94418483245776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842780b0 con 0x7eff18007030 2023-10-05T21:15:14.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.919+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84278950 con 0x55df8423d260 2023-10-05T21:15:14.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.920+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94418483245776] v29'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff1c006070 con 0x7eff18007030 2023-10-05T21:15:14.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.920+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.920+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94418483248064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84278990 con 0x55df8423d260 2023-10-05T21:15:14.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.920+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84279570 con 0x55df8426fb40 2023-10-05T21:15:14.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.921+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff18025cd0 con 0x55df8426fb40 2023-10-05T21:15:14.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.921+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94418483248064] v29'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.921+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94418483253280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84279e60 con 0x55df8426fb40 2023-10-05T21:15:14.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.921+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df8427a380 con 0x7eff18007030 2023-10-05T21:15:14.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.922+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff1c006070 con 0x7eff18007030 2023-10-05T21:15:14.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.922+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94418483253280] v29'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff18025cd0 con 0x55df8426fb40 2023-10-05T21:15:14.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.922+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94418483250272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84279ab0 con 0x7eff18007030 2023-10-05T21:15:14.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.922+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df8427b3f0 con 0x55df8423d260 2023-10-05T21:15:14.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.922+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94418483250272] v29'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff1c006070 con 0x7eff18007030 2023-10-05T21:15:14.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.922+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.922+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94418483261088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df8427b7f0 con 0x55df8423d260 2023-10-05T21:15:14.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.922+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df8427c260 con 0x7eff1c00ebe0 2023-10-05T21:15:14.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.923+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94418483261088] v29'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.923+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff2000a570 con 0x7eff1c00ebe0 2023-10-05T21:15:14.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.923+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94418483264784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df8427c220 con 0x7eff1c00ebe0 2023-10-05T21:15:14.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.923+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df8427ccf0 con 0x7eff1c00ebe0 2023-10-05T21:15:14.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.924+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94418483264784] v29'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff2000a570 con 0x7eff1c00ebe0 2023-10-05T21:15:14.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.924+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff2000a570 con 0x7eff1c00ebe0 2023-10-05T21:15:14.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.924+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94418483267488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df8427ccb0 con 0x7eff1c00ebe0 2023-10-05T21:15:14.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.924+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df8427d7b0 con 0x7eff1c00ebe0 2023-10-05T21:15:14.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.925+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94418483267488] v29'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff2000a570 con 0x7eff1c00ebe0 2023-10-05T21:15:14.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.925+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff2000a570 con 0x7eff1c00ebe0 2023-10-05T21:15:14.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.925+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94418483270240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df8427d770 con 0x7eff1c00ebe0 2023-10-05T21:15:14.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.925+0000 7eff32bbe680 20 add_watcher() i=0 2023-10-05T21:15:14.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.925+0000 7eff32bbe680 20 add_watcher() i=1 2023-10-05T21:15:14.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.925+0000 7eff32bbe680 20 add_watcher() i=2 2023-10-05T21:15:14.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.925+0000 7eff32bbe680 20 add_watcher() i=3 2023-10-05T21:15:14.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.925+0000 7eff32bbe680 20 add_watcher() i=4 2023-10-05T21:15:14.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.925+0000 7eff32bbe680 20 add_watcher() i=5 2023-10-05T21:15:14.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.925+0000 7eff32bbe680 20 add_watcher() i=6 2023-10-05T21:15:14.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.925+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94418483270240] v29'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff2000a570 con 0x7eff1c00ebe0 2023-10-05T21:15:14.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.925+0000 7eff32bbe680 20 add_watcher() i=7 2023-10-05T21:15:14.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.925+0000 7eff32bbe680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:14.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.925+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84280bb0 con 0x55df8423d260 2023-10-05T21:15:14.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.926+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.926+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94418483259184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df8427e0a0 con 0x55df8423d260 2023-10-05T21:15:14.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.926+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94418483259184] v29'82 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.927+0000 7efef6fe5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:14.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.927+0000 7eff32bbe680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:14.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.927+0000 7eff32bbe680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:14.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.927+0000 7eff32bbe680 1 Processor -- start 2023-10-05T21:15:14.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.927+0000 7eff32bbe680 1 -- start start 2023-10-05T21:15:14.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.927+0000 7eff32bbe680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8428a870 0x55df8428ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.927+0000 7eff32bbe680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df8428b290 con 0x55df8428a870 2023-10-05T21:15:14.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.927+0000 7eff25495700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8428a870 0x55df8428ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.927+0000 7eff25495700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8428a870 0x55df8428ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50072/0 (socket says 172.21.15.153:50072) 2023-10-05T21:15:14.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.927+0000 7eff25495700 1 -- 172.21.15.153:0/1601924961 learned_addr learned my addr 172.21.15.153:0/1601924961 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:14.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.928+0000 7eff25495700 1 -- 172.21.15.153:0/1601924961 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df8428b770 con 0x55df8428a870 2023-10-05T21:15:14.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.928+0000 7eff25495700 1 --2- 172.21.15.153:0/1601924961 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8428a870 0x55df8428ac80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00c010 tx=0x7eff1c006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5171f05858ee1d39 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.928+0000 7efef67e4700 1 -- 172.21.15.153:0/1601924961 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff1c023040 con 0x55df8428a870 2023-10-05T21:15:14.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.928+0000 7efef67e4700 1 -- 172.21.15.153:0/1601924961 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1c024040 con 0x55df8428a870 2023-10-05T21:15:14.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.928+0000 7efef67e4700 1 -- 172.21.15.153:0/1601924961 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff1c013040 con 0x55df8428a870 2023-10-05T21:15:14.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.929+0000 7eff32bbe680 1 -- 172.21.15.153:0/1601924961 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8428a870 msgr2=0x55df8428ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.929+0000 7eff32bbe680 1 --2- 172.21.15.153:0/1601924961 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8428a870 0x55df8428ac80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00c010 tx=0x7eff1c006000 comp rx=0 tx=0).stop 2023-10-05T21:15:14.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.929+0000 7eff32bbe680 1 -- 172.21.15.153:0/1601924961 shutdown_connections 2023-10-05T21:15:14.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.929+0000 7eff32bbe680 1 --2- 172.21.15.153:0/1601924961 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8428a870 0x55df8428ac80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.929+0000 7eff32bbe680 1 -- 172.21.15.153:0/1601924961 >> 172.21.15.153:0/1601924961 conn(0x55df84286b70 msgr2=0x55df84284c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.929+0000 7eff32bbe680 1 -- 172.21.15.153:0/1601924961 shutdown_connections 2023-10-05T21:15:14.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.929+0000 7eff32bbe680 1 -- 172.21.15.153:0/1601924961 wait complete. 2023-10-05T21:15:14.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.929+0000 7eff32bbe680 1 Processor -- start 2023-10-05T21:15:14.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.929+0000 7eff32bbe680 1 -- start start 2023-10-05T21:15:14.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.929+0000 7eff32bbe680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8428a870 0x55df84291600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.929+0000 7eff32bbe680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df84291b40 con 0x55df8428a870 2023-10-05T21:15:14.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.930+0000 7eff25495700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8428a870 0x55df84291600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.930+0000 7eff25495700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8428a870 0x55df84291600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50088/0 (socket says 172.21.15.153:50088) 2023-10-05T21:15:14.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.930+0000 7eff25495700 1 -- 172.21.15.153:0/3620430975 learned_addr learned my addr 172.21.15.153:0/3620430975 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:14.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.930+0000 7eff25495700 1 -- 172.21.15.153:0/3620430975 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff10001e10 con 0x55df8428a870 2023-10-05T21:15:14.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.930+0000 7eff25495700 1 --2- 172.21.15.153:0/3620430975 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8428a870 0x55df84291600 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00ea40 tx=0x7eff1c030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.930+0000 7efef4fe1700 1 -- 172.21.15.153:0/3620430975 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff1c023030 con 0x55df8428a870 2023-10-05T21:15:14.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.930+0000 7efef4fe1700 1 -- 172.21.15.153:0/3620430975 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1c01e630 con 0x55df8428a870 2023-10-05T21:15:14.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.930+0000 7eff32bbe680 1 -- 172.21.15.153:0/3620430975 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55df84291d40 con 0x55df8428a870 2023-10-05T21:15:14.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.930+0000 7efef4fe1700 1 -- 172.21.15.153:0/3620430975 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff1c01e7c0 con 0x55df8428a870 2023-10-05T21:15:14.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.930+0000 7eff32bbe680 1 -- 172.21.15.153:0/3620430975 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55df84292190 con 0x55df8428a870 2023-10-05T21:15:14.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.931+0000 7efef4fe1700 1 -- 172.21.15.153:0/3620430975 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7eff1c01e920 con 0x55df8428a870 2023-10-05T21:15:14.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.931+0000 7efef4fe1700 1 --2- 172.21.15.153:0/3620430975 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7efe6c034190 0x7efe6c036640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:14.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.931+0000 7efef4fe1700 1 -- 172.21.15.153:0/3620430975 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7eff1c043b00 con 0x55df8428a870 2023-10-05T21:15:14.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.931+0000 7eff26497700 1 --2- 172.21.15.153:0/3620430975 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7efe6c034190 0x7efe6c036640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:14.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.931+0000 7eff32bbe680 5 note: GC not initialized 2023-10-05T21:15:14.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.931+0000 7eff26497700 1 --2- 172.21.15.153:0/3620430975 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7efe6c034190 0x7efe6c036640 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55df8427c540 tx=0x7eff20037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:14.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.932+0000 7efe65ffb700 20 reqs_thread_entry: start 2023-10-05T21:15:14.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.932+0000 7efe577fe700 20 reqs_thread_entry: start 2023-10-05T21:15:14.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.932+0000 7eff32bbe680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:14.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.933+0000 7eff32bbe680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:14.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.933+0000 7efe55ffb700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:45 2023 2023-10-05T21:15:14.963 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:14.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.933+0000 7efe557fa700 20 reqs_thread_entry: start 2023-10-05T21:15:14.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.933+0000 7eff32bbe680 20 get_system_obj_state: rctx=0x7ffddbb4f278 obj=default.rgw.meta:users.uid:foo state=0x55df840f0240 s->prefetch_data=0 2023-10-05T21:15:14.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.933+0000 7eff32bbe680 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T21:15:14.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.933+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842f6ec0 con 0x55df8423d260 2023-10-05T21:15:14.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.933+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv8 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.933+0000 7eff32bbe680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T21:15:14.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.933+0000 7eff32bbe680 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:14.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.933+0000 7eff32bbe680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:14.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.933+0000 7eff32bbe680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:14.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.933+0000 7eff32bbe680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:14.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.933+0000 7eff32bbe680 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:14.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.933+0000 7eff32bbe680 20 rados->read ofs=0 len=0 2023-10-05T21:15:14.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.933+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842f93f0 con 0x55df8423d260 2023-10-05T21:15:14.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.934+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~621 out=621b,getxattrs out=75b] v0'0 uv8 ondisk = 0) v8 ==== 273+0+744 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.934+0000 7eff32bbe680 20 rados_obj.operate() r=0 bl.length=621 2023-10-05T21:15:14.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.934+0000 7eff32bbe680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T21:15:14.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.934+0000 7eff32bbe680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:14.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.934+0000 7eff32bbe680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:14.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.934+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:104 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~539 in=539b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842fb2f0 con 0x55df8423d260 2023-10-05T21:15:14.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.934+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(104 foo [delete,create,call,writefull 0~539] v29'9 uv9 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.934+0000 7eff32bbe680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T21:15:14.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.934+0000 7eff32bbe680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:14.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.934+0000 7eff32bbe680 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T21:15:14.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.934+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [notify cookie 94418483784976 in=727b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842f7ed0 con 0x55df8423d260 2023-10-05T21:15:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.935+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== watch-notify(notify (1) cookie 94418483261088 notify 124554051592 ret 0) v3 ==== 757+0+0 (crc 0 0 0) 0x7eff200292f0 con 0x55df8423d260 2023-10-05T21:15:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.935+0000 7eff177fe700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051592 cookie 94418483261088 notifier 4370 bl.length()=715 2023-10-05T21:15:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.935+0000 7eff177fe700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T21:15:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.935+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(105 notify.4 [notify cookie 94418483784976 out=8b] v0'0 uv72 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.935+0000 7eff177fe700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.935+0000 7eff177fe700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7eff04003d90 con 0x55df8423d260 2023-10-05T21:15:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.935+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(106 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.935+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== watch-notify(notify_complete (2) cookie 94418483784976 notify 124554051592 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7eff2002d040 con 0x55df8423d260 2023-10-05T21:15:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.935+0000 7eff32bbe680 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2023-10-05T21:15:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.935+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:107 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94418483784976 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842f79e0 con 0x7eff18007030 2023-10-05T21:15:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.935+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== watch-notify(notify (1) cookie 94418483245776 notify 124554051588 ret 0) v3 ==== 201+0+0 (crc 0 0 0) 0x55df84292190 con 0x7eff18007030 2023-10-05T21:15:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.935+0000 7eff177fe700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051588 cookie 94418483245776 notifier 4370 bl.length()=159 2023-10-05T21:15:14.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.935+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(107 notify.0 [notify cookie 94418483784976 out=8b] v0'0 uv72 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7eff1c03f040 con 0x7eff18007030 2023-10-05T21:15:14.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.935+0000 7eff177fe700 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:108 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7eff04003d90 con 0x7eff18007030 2023-10-05T21:15:14.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.936+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== watch-notify(notify_complete (2) cookie 94418483784976 notify 124554051588 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55df84291d40 con 0x7eff18007030 2023-10-05T21:15:14.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.936+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(108 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff1c03f040 con 0x7eff18007030 2023-10-05T21:15:14.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.936+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:109 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842fad10 con 0x55df8423d260 2023-10-05T21:15:14.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.936+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 42 ==== osd_op_reply(109 foo:foo1 [delete] v29'2 uv2 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.967 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:14.967 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "foo", 2023-10-05T21:15:14.968 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Foo", 2023-10-05T21:15:14.968 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "foo@foo.com", 2023-10-05T21:15:14.968 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2023-10-05T21:15:14.968 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 4, 2023-10-05T21:15:14.968 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [ 2023-10-05T21:15:14.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:14.968 INFO:teuthology.orchestra.run.smithi153.stdout: "id": "foo:foo1", 2023-10-05T21:15:14.968 INFO:teuthology.orchestra.run.smithi153.stdout: "permissions": "full-control" 2023-10-05T21:15:14.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:14.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:14.968 INFO:teuthology.orchestra.run.smithi153.stdout: "id": "foo:foo2", 2023-10-05T21:15:14.969 INFO:teuthology.orchestra.run.smithi153.stdout: "permissions": "" 2023-10-05T21:15:14.969 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:14.969 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:14.969 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2023-10-05T21:15:14.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:14.969 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:14.969 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:14.969 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T21:15:14.969 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:14.969 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:14.969 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [ 2023-10-05T21:15:14.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:14.970 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo:foo2", 2023-10-05T21:15:14.970 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy" 2023-10-05T21:15:14.970 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:14.970 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:14.970 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2023-10-05T21:15:14.970 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2023-10-05T21:15:14.970 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2023-10-05T21:15:14.970 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2023-10-05T21:15:14.970 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2023-10-05T21:15:14.970 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:15:14.970 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:14.971 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:14.971 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:14.971 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:14.971 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:14.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:14.971 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2023-10-05T21:15:14.971 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:14.971 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:14.971 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:14.971 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:14.971 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:14.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:14.972 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2023-10-05T21:15:14.972 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2023-10-05T21:15:14.972 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [] 2023-10-05T21:15:14.972 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:14.972 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:15:14.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.937+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:110 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94418483245776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842fad10 con 0x7eff18007030 2023-10-05T21:15:14.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.937+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== osd_op_reply(110 notify.0 [watch unwatch cookie 94418483245776] v29'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff1c03f040 con 0x7eff18007030 2023-10-05T21:15:14.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.937+0000 7eff32bbe680 20 remove_watcher() i=0 2023-10-05T21:15:14.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.937+0000 7eff32bbe680 2 removed watcher, disabling cache 2023-10-05T21:15:14.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.937+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:111 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94418483248064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df842772d0 con 0x55df8423d260 2023-10-05T21:15:14.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.938+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 43 ==== osd_op_reply(111 notify.1 [watch unwatch cookie 94418483248064] v29'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.938+0000 7eff32bbe680 20 remove_watcher() i=1 2023-10-05T21:15:14.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.938+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:112 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94418483253280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84277bc0 con 0x55df8426fb40 2023-10-05T21:15:14.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.939+0000 7eff25c96700 1 -- 172.21.15.153:0/2395871686 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(112 notify.2 [watch unwatch cookie 94418483253280] v29'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff18025cd0 con 0x55df8426fb40 2023-10-05T21:15:14.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.939+0000 7eff32bbe680 20 remove_watcher() i=2 2023-10-05T21:15:14.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.939+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:113 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94418483250272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84277bc0 con 0x7eff18007030 2023-10-05T21:15:14.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.940+0000 7eff25495700 1 -- 172.21.15.153:0/2395871686 <== osd.2 v2:172.21.15.153:6807/140454 22 ==== osd_op_reply(113 notify.3 [watch unwatch cookie 94418483250272] v29'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff1c03f040 con 0x7eff18007030 2023-10-05T21:15:14.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.940+0000 7eff32bbe680 20 remove_watcher() i=3 2023-10-05T21:15:14.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.940+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:114 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94418483261088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84278460 con 0x55df8423d260 2023-10-05T21:15:14.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.940+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 44 ==== osd_op_reply(114 notify.4 [watch unwatch cookie 94418483261088] v29'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.940+0000 7eff32bbe680 20 remove_watcher() i=4 2023-10-05T21:15:14.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.940+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:115 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94418483264784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df8427aea0 con 0x7eff1c00ebe0 2023-10-05T21:15:14.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.941+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(115 notify.5 [watch unwatch cookie 94418483264784] v29'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff2000a570 con 0x7eff1c00ebe0 2023-10-05T21:15:14.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.941+0000 7eff32bbe680 20 remove_watcher() i=5 2023-10-05T21:15:14.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.941+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:116 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94418483267488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84278460 con 0x7eff1c00ebe0 2023-10-05T21:15:14.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.942+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(116 notify.6 [watch unwatch cookie 94418483267488] v29'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff2000a570 con 0x7eff1c00ebe0 2023-10-05T21:15:14.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.942+0000 7eff32bbe680 20 remove_watcher() i=6 2023-10-05T21:15:14.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.942+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:117 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94418483270240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df8427aea0 con 0x7eff1c00ebe0 2023-10-05T21:15:14.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.943+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(117 notify.7 [watch unwatch cookie 94418483270240] v29'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff2000a570 con 0x7eff1c00ebe0 2023-10-05T21:15:14.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.943+0000 7eff32bbe680 20 remove_watcher() i=7 2023-10-05T21:15:14.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.943+0000 7efef6fe5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:14.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.943+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:118 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94418483259184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55df84278460 con 0x55df8423d260 2023-10-05T21:15:14.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.944+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 <== osd.1 v2:172.21.15.153:6816/140456 45 ==== osd_op_reply(118 data_loggenerations_metadata [watch unwatch cookie 94418483259184] v29'83 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7eff2000a570 con 0x55df8423d260 2023-10-05T21:15:14.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.944+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7eff1c00ebe0 msgr2=0x7eff1c00d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.944+0000 7eff32bbe680 1 --2- 172.21.15.153:0/2395871686 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7eff1c00ebe0 0x7eff1c00d8e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.944+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55df8423d260 msgr2=0x55df8426d6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.944+0000 7eff32bbe680 1 --2- 172.21.15.153:0/2395871686 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55df8423d260 0x55df8426d6d0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.944+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7eff18007030 msgr2=0x7eff180373f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.944+0000 7eff32bbe680 1 --2- 172.21.15.153:0/2395871686 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7eff18007030 0x7eff180373f0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.944+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55df8426fb40 msgr2=0x55df84271f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.944+0000 7eff32bbe680 1 --2- 172.21.15.153:0/2395871686 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55df8426fb40 0x55df84271f20 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.944+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7eff08034140 msgr2=0x7eff080365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.944+0000 7eff32bbe680 1 --2- 172.21.15.153:0/2395871686 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7eff08034140 0x7eff080365f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7eff1c004170 tx=0x7eff1c001360 comp rx=0 tx=0).stop 2023-10-05T21:15:14.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.944+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8423c910 msgr2=0x55df84261940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.944+0000 7eff26497700 1 -- 172.21.15.153:0/2395871686 reap_dead start 2023-10-05T21:15:14.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.944+0000 7eff32bbe680 1 --2- 172.21.15.153:0/2395871686 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8423c910 0x55df84261940 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7eff18005a90 tx=0x7eff1801c000 comp rx=0 tx=0).stop 2023-10-05T21:15:14.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.944+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 shutdown_connections 2023-10-05T21:15:14.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.944+0000 7eff32bbe680 1 --2- 172.21.15.153:0/2395871686 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8423c910 0x55df84261940 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.944+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 >> 172.21.15.153:0/2395871686 conn(0x55df84237310 msgr2=0x55df842547d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.944+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 shutdown_connections 2023-10-05T21:15:14.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.944+0000 7eff32bbe680 1 -- 172.21.15.153:0/2395871686 wait complete. 2023-10-05T21:15:14.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.945+0000 7eff32bbe680 1 -- 172.21.15.153:0/3620430975 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7efe6c034190 msgr2=0x7efe6c036640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.945+0000 7eff32bbe680 1 --2- 172.21.15.153:0/3620430975 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7efe6c034190 0x7efe6c036640 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55df8427c540 tx=0x7eff20037450 comp rx=0 tx=0).stop 2023-10-05T21:15:14.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.945+0000 7eff32bbe680 1 -- 172.21.15.153:0/3620430975 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8428a870 msgr2=0x55df84291600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:14.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.945+0000 7eff32bbe680 1 --2- 172.21.15.153:0/3620430975 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8428a870 0x55df84291600 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00ea40 tx=0x7eff1c030000 comp rx=0 tx=0).stop 2023-10-05T21:15:14.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.945+0000 7eff32bbe680 1 -- 172.21.15.153:0/3620430975 shutdown_connections 2023-10-05T21:15:14.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.945+0000 7eff32bbe680 1 --2- 172.21.15.153:0/3620430975 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7efe6c034190 0x7efe6c036640 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.945+0000 7eff32bbe680 1 --2- 172.21.15.153:0/3620430975 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55df8428a870 0x55df84291600 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:14.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.945+0000 7eff32bbe680 1 -- 172.21.15.153:0/3620430975 >> 172.21.15.153:0/3620430975 conn(0x55df84286b70 msgr2=0x55df84284c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:14.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.945+0000 7eff32bbe680 1 -- 172.21.15.153:0/3620430975 shutdown_connections 2023-10-05T21:15:14.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:14.945+0000 7eff32bbe680 1 -- 172.21.15.153:0/3620430975 wait complete. 2023-10-05T21:15:14.982 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:15:14.982 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2023-10-05T21:15:14.982 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2023-10-05T21:15:14.982 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2023-10-05T21:15:15.027 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:15.027 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:15.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.026+0000 7fe3f6c79680 1 Processor -- start 2023-10-05T21:15:15.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.026+0000 7fe3f6c79680 1 -- start start 2023-10-05T21:15:15.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.026+0000 7fe3f6c79680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x559981ff2bb0 0x559981ff4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.026+0000 7fe3f6c79680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559981f39990 con 0x559981f600a0 2023-10-05T21:15:15.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.026+0000 7fe3f6c79680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x559981ef9db0 con 0x559981ff2bb0 2023-10-05T21:15:15.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.027+0000 7fe3e9550700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x559981ff2bb0 0x559981ff4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.027+0000 7fe3e9550700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x559981ff2bb0 0x559981ff4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50098/0 (socket says 172.21.15.153:50098) 2023-10-05T21:15:15.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.027+0000 7fe3e9550700 1 -- 172.21.15.153:0/724968931 learned_addr learned my addr 172.21.15.153:0/724968931 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:15.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.027+0000 7fe3e9d51700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x559981f600a0 0x559981ff1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56334/0 (socket says 172.21.15.153:56334) 2023-10-05T21:15:15.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.027+0000 7fe3e9550700 1 -- 172.21.15.153:0/724968931 >> v1:172.21.15.111:6789/0 conn(0x559981f600a0 legacy=0x559981ff1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.027+0000 7fe3e8d4f700 1 -- 172.21.15.153:0/724968931 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913466211 0 0) 0x559981f39990 con 0x559981f600a0 2023-10-05T21:15:15.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.027+0000 7fe3e9550700 1 -- 172.21.15.153:0/724968931 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559981ff64e0 con 0x559981ff2bb0 2023-10-05T21:15:15.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.027+0000 7fe3e9550700 1 --2- 172.21.15.153:0/724968931 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559981ff2bb0 0x559981ff4f90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc00a650 tx=0x7fe3dc005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cda38cc62255f73 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.027+0000 7fe3e8d4f700 1 -- 172.21.15.153:0/724968931 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3dc008760 con 0x559981ff2bb0 2023-10-05T21:15:15.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.027+0000 7fe3e8d4f700 1 -- 172.21.15.153:0/724968931 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3dc0088c0 con 0x559981ff2bb0 2023-10-05T21:15:15.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.027+0000 7fe3e8d4f700 1 -- 172.21.15.153:0/724968931 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3dc008bb0 con 0x559981ff2bb0 2023-10-05T21:15:15.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.028+0000 7fe3f6c79680 1 -- 172.21.15.153:0/724968931 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559981ff2bb0 msgr2=0x559981ff4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.028+0000 7fe3f6c79680 1 --2- 172.21.15.153:0/724968931 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559981ff2bb0 0x559981ff4f90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc00a650 tx=0x7fe3dc005b10 comp rx=0 tx=0).stop 2023-10-05T21:15:15.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.028+0000 7fe3f6c79680 1 -- 172.21.15.153:0/724968931 shutdown_connections 2023-10-05T21:15:15.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.028+0000 7fe3f6c79680 1 --2- 172.21.15.153:0/724968931 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559981ff2bb0 0x559981ff4f90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.028+0000 7fe3f6c79680 1 -- 172.21.15.153:0/724968931 >> 172.21.15.153:0/724968931 conn(0x559981fe6b80 msgr2=0x559981fe8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:15.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.028+0000 7fe3f6c79680 1 -- 172.21.15.153:0/724968931 shutdown_connections 2023-10-05T21:15:15.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.028+0000 7fe3f6c79680 1 -- 172.21.15.153:0/724968931 wait complete. 2023-10-05T21:15:15.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.029+0000 7fe3f6c79680 1 Processor -- start 2023-10-05T21:15:15.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.029+0000 7fe3f6c79680 1 -- start start 2023-10-05T21:15:15.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.029+0000 7fe3f6c79680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559981f600a0 0x55998200d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.029+0000 7fe3f6c79680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x559981e99ea0 con 0x559981f600a0 2023-10-05T21:15:15.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.029+0000 7fe3e9d51700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559981f600a0 0x55998200d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.029+0000 7fe3e9d51700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559981f600a0 0x55998200d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50100/0 (socket says 172.21.15.153:50100) 2023-10-05T21:15:15.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.029+0000 7fe3e9d51700 1 -- 172.21.15.153:0/4008867988 learned_addr learned my addr 172.21.15.153:0/4008867988 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:15.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.029+0000 7fe3e9d51700 1 -- 172.21.15.153:0/4008867988 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3dc005db0 con 0x559981f600a0 2023-10-05T21:15:15.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.030+0000 7fe3e9d51700 1 --2- 172.21.15.153:0/4008867988 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559981f600a0 0x55998200d940 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0001e50 tx=0x7fe3e0001820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139e64a239489440 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.030+0000 7fe3db7fe700 1 -- 172.21.15.153:0/4008867988 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3e0014070 con 0x559981f600a0 2023-10-05T21:15:15.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.030+0000 7fe3db7fe700 1 -- 172.21.15.153:0/4008867988 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e000f450 con 0x559981f600a0 2023-10-05T21:15:15.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.030+0000 7fe3db7fe700 1 -- 172.21.15.153:0/4008867988 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3e000f600 con 0x559981f600a0 2023-10-05T21:15:15.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.030+0000 7fe3f6c79680 1 -- 172.21.15.153:0/4008867988 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559981f600a0 msgr2=0x55998200d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.030+0000 7fe3f6c79680 1 --2- 172.21.15.153:0/4008867988 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559981f600a0 0x55998200d940 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0001e50 tx=0x7fe3e0001820 comp rx=0 tx=0).stop 2023-10-05T21:15:15.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.030+0000 7fe3f6c79680 1 -- 172.21.15.153:0/4008867988 shutdown_connections 2023-10-05T21:15:15.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.030+0000 7fe3f6c79680 1 --2- 172.21.15.153:0/4008867988 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559981f600a0 0x55998200d940 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.030+0000 7fe3f6c79680 1 -- 172.21.15.153:0/4008867988 >> 172.21.15.153:0/4008867988 conn(0x559981fe6b80 msgr2=0x559982009410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:15.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.030+0000 7fe3f6c79680 1 -- 172.21.15.153:0/4008867988 shutdown_connections 2023-10-05T21:15:15.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.030+0000 7fe3f6c79680 1 -- 172.21.15.153:0/4008867988 wait complete. 2023-10-05T21:15:15.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.031+0000 7fe3f6c79680 1 Processor -- start 2023-10-05T21:15:15.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.031+0000 7fe3f6c79680 1 -- start start 2023-10-05T21:15:15.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.031+0000 7fe3f6c79680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559981f600a0 0x559982014de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.031+0000 7fe3f6c79680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x559981e90c80 con 0x559981f600a0 2023-10-05T21:15:15.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.031+0000 7fe3e9d51700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559981f600a0 0x559982014de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.031+0000 7fe3e9d51700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559981f600a0 0x559982014de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50104/0 (socket says 172.21.15.153:50104) 2023-10-05T21:15:15.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.031+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 learned_addr learned my addr 172.21.15.153:0/550618120 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:15.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.031+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e0001b00 con 0x559981f600a0 2023-10-05T21:15:15.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.031+0000 7fe3e9d51700 1 --2- 172.21.15.153:0/550618120 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559981f600a0 0x559982014de0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0000fb0 tx=0x7fe3e0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.032+0000 7fe3d9ffb700 1 -- 172.21.15.153:0/550618120 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3e001c8d0 con 0x559981f600a0 2023-10-05T21:15:15.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.032+0000 7fe3d9ffb700 1 -- 172.21.15.153:0/550618120 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e001ca30 con 0x559981f600a0 2023-10-05T21:15:15.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.032+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559982015320 con 0x559981f600a0 2023-10-05T21:15:15.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.032+0000 7fe3d9ffb700 1 -- 172.21.15.153:0/550618120 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3e001cd00 con 0x559981f600a0 2023-10-05T21:15:15.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.032+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559982015770 con 0x559981f600a0 2023-10-05T21:15:15.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.032+0000 7fe3d9ffb700 1 -- 172.21.15.153:0/550618120 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fe3e0023020 con 0x559981f600a0 2023-10-05T21:15:15.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.033+0000 7fe3d9ffb700 1 --2- 172.21.15.153:0/550618120 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fe3cc034140 0x7fe3cc0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.033+0000 7fe3d9ffb700 1 -- 172.21.15.153:0/550618120 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fe3e0008030 con 0x559981f600a0 2023-10-05T21:15:15.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.033+0000 7fe3e9550700 1 --2- 172.21.15.153:0/550618120 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fe3cc034140 0x7fe3cc0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.033+0000 7fe3e9550700 1 --2- 172.21.15.153:0/550618120 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fe3cc034140 0x7fe3cc0365f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc000c00 tx=0x7fe3dc015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.033+0000 7fe3f6c79680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.033+0000 7fe3f6c79680 1 --2- 172.21.15.153:0/550618120 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x559981ff2bb0 0x559982020b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.033+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982021320 con 0x559981ff2bb0 2023-10-05T21:15:15.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.033+0000 7fe3ea552700 1 --2- 172.21.15.153:0/550618120 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x559981ff2bb0 0x559982020b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.034+0000 7fe3ea552700 1 --2- 172.21.15.153:0/550618120 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x559981ff2bb0 0x559982020b90 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.034+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.034+0000 7fe3f6c79680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.034+0000 7fe3f6c79680 20 realm 2023-10-05T21:15:15.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.034+0000 7fe3f6c79680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.034+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55998201e0b0 con 0x559981ff2bb0 2023-10-05T21:15:15.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.034+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.034+0000 7fe3f6c79680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.034+0000 7fe3f6c79680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:15.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.034+0000 7fe3f6c79680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.034+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982021dd0 con 0x559981ff2bb0 2023-10-05T21:15:15.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.034+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.034+0000 7fe3f6c79680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.034+0000 7fe3f6c79680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.034+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820226f0 con 0x559981ff2bb0 2023-10-05T21:15:15.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.034+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.034+0000 7fe3f6c79680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:15.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.035+0000 7fe3f6c79680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.035+0000 7fe3f6c79680 1 --2- 172.21.15.153:0/550618120 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x559982022fb0 0x559982025390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.035+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820259e0 con 0x559982022fb0 2023-10-05T21:15:15.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.035+0000 7fe3e9d51700 1 --2- 172.21.15.153:0/550618120 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x559982022fb0 0x559982025390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.035+0000 7fe3e9d51700 1 --2- 172.21.15.153:0/550618120 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x559982022fb0 0x559982025390 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.035+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fe3e0043040 con 0x559982022fb0 2023-10-05T21:15:15.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.035+0000 7fe3f6c79680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:15.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.035+0000 7fe3f6c79680 20 searching for the correct realm 2023-10-05T21:15:15.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.035+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x559982022fb0 2023-10-05T21:15:15.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.035+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e0043040 con 0x559982022fb0 2023-10-05T21:15:15.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.035+0000 7fe3e9d51700 1 --2- 172.21.15.153:0/550618120 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fe3e001a070 0x7fe3e0046320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.035+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x7fe3e001a070 2023-10-05T21:15:15.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.036+0000 7fe3e9550700 1 --2- 172.21.15.153:0/550618120 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fe3e001a070 0x7fe3e0046320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.036+0000 7fe3e9550700 1 --2- 172.21.15.153:0/550618120 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fe3e001a070 0x7fe3e0046320 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.036+0000 7fe3e9550700 1 -- 172.21.15.153:0/550618120 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc019040 con 0x7fe3e001a070 2023-10-05T21:15:15.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.036+0000 7fe3e9550700 1 --2- 172.21.15.153:0/550618120 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fe3dc007030 0x7fe3dc01d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.036+0000 7fe3e9550700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x7fe3dc007030 2023-10-05T21:15:15.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.036+0000 7fe3ea552700 1 --2- 172.21.15.153:0/550618120 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fe3dc007030 0x7fe3dc01d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.037+0000 7fe3ea552700 1 --2- 172.21.15.153:0/550618120 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fe3dc007030 0x7fe3dc01d420 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.037+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e400a570 con 0x7fe3dc007030 2023-10-05T21:15:15.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.037+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x559981ff2bb0 2023-10-05T21:15:15.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.037+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.037+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x559981ff2bb0 2023-10-05T21:15:15.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.037+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.037+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x7fe3dc007030 2023-10-05T21:15:15.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.037+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e400a570 con 0x7fe3dc007030 2023-10-05T21:15:15.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.037+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x7fe3dc007030 2023-10-05T21:15:15.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.038+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e400a570 con 0x7fe3dc007030 2023-10-05T21:15:15.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.038+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x7fe3e001a070 2023-10-05T21:15:15.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.038+0000 7fe3e9550700 1 -- 172.21.15.153:0/550618120 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc019040 con 0x7fe3e001a070 2023-10-05T21:15:15.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.038+0000 7fe3e9550700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x559982022fb0 2023-10-05T21:15:15.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.038+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fe3e0043040 con 0x559982022fb0 2023-10-05T21:15:15.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.038+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x559981ff2bb0 2023-10-05T21:15:15.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.038+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.038+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x7fe3dc007030 2023-10-05T21:15:15.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.039+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e400a570 con 0x7fe3dc007030 2023-10-05T21:15:15.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.039+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x559981ff2bb0 2023-10-05T21:15:15.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.039+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.039+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x7fe3e001a070 2023-10-05T21:15:15.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.039+0000 7fe3e9550700 1 -- 172.21.15.153:0/550618120 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc019040 con 0x7fe3e001a070 2023-10-05T21:15:15.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.039+0000 7fe3e9550700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x559982022fb0 2023-10-05T21:15:15.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.039+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e0043040 con 0x559982022fb0 2023-10-05T21:15:15.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.039+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x559982022fb0 2023-10-05T21:15:15.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.039+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e0043040 con 0x559982022fb0 2023-10-05T21:15:15.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.039+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x7fe3dc007030 2023-10-05T21:15:15.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.040+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e400a570 con 0x7fe3dc007030 2023-10-05T21:15:15.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.040+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x559982022fb0 2023-10-05T21:15:15.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.040+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e0043040 con 0x559982022fb0 2023-10-05T21:15:15.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.040+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x559982022fb0 2023-10-05T21:15:15.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.040+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e0043040 con 0x559982022fb0 2023-10-05T21:15:15.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.040+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x559981ff2bb0 2023-10-05T21:15:15.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.040+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.040+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x559981ff2bb0 2023-10-05T21:15:15.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.040+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.040+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x7fe3dc007030 2023-10-05T21:15:15.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.041+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e400a570 con 0x7fe3dc007030 2023-10-05T21:15:15.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.041+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x559982022fb0 2023-10-05T21:15:15.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.041+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e0043040 con 0x559982022fb0 2023-10-05T21:15:15.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.041+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x7fe3e001a070 2023-10-05T21:15:15.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.041+0000 7fe3e9550700 1 -- 172.21.15.153:0/550618120 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc019040 con 0x7fe3e001a070 2023-10-05T21:15:15.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.041+0000 7fe3e9550700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x559981ff2bb0 2023-10-05T21:15:15.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.041+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.041+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x7fe3dc007030 2023-10-05T21:15:15.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.042+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e400a570 con 0x7fe3dc007030 2023-10-05T21:15:15.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.042+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x559982022fb0 2023-10-05T21:15:15.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.042+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e0043040 con 0x559982022fb0 2023-10-05T21:15:15.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.042+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x7fe3dc007030 2023-10-05T21:15:15.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.042+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e400a570 con 0x7fe3dc007030 2023-10-05T21:15:15.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.042+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x7fe3e001a070 2023-10-05T21:15:15.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.043+0000 7fe3e9550700 1 -- 172.21.15.153:0/550618120 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc019040 con 0x7fe3e001a070 2023-10-05T21:15:15.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.043+0000 7fe3e9550700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x559982022fb0 2023-10-05T21:15:15.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.043+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e0043040 con 0x559982022fb0 2023-10-05T21:15:15.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.043+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x7fe3dc007030 2023-10-05T21:15:15.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.043+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e400a570 con 0x7fe3dc007030 2023-10-05T21:15:15.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.043+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x559981ff2bb0 2023-10-05T21:15:15.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.043+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.043+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027510 con 0x7fe3e001a070 2023-10-05T21:15:15.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.043+0000 7fe3e9550700 1 -- 172.21.15.153:0/550618120 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc019040 con 0x7fe3e001a070 2023-10-05T21:15:15.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.043+0000 7fe3f6c79680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:15.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.044+0000 7fe3f6c79680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:15.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.044+0000 7fe3f6c79680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:15.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.044+0000 7fe3f6c79680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:15.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.044+0000 7fe3f6c79680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.044+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982026460 con 0x559981ff2bb0 2023-10-05T21:15:15.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.044+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.044+0000 7fe3f6c79680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.044+0000 7fe3f6c79680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.044+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982026860 con 0x559981ff2bb0 2023-10-05T21:15:15.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.044+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.044+0000 7fe3f6c79680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:15.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.044+0000 7fe3f6c79680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.044+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820279a0 con 0x559981ff2bb0 2023-10-05T21:15:15.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.044+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.044+0000 7fe3f6c79680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:15.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.044+0000 7fe3f6c79680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.044+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982027d50 con 0x559982022fb0 2023-10-05T21:15:15.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.044+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fe3e0043040 con 0x559982022fb0 2023-10-05T21:15:15.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.044+0000 7fe3f6c79680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.044+0000 7fe3f6c79680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.044+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982028100 con 0x559981ff2bb0 2023-10-05T21:15:15.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.045+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.045+0000 7fe3f6c79680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.045+0000 7fe3f6c79680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.045+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982028100 con 0x559981ff2bb0 2023-10-05T21:15:15.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.045+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.045+0000 7fe3f6c79680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:15.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.045+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982029110 con 0x559982022fb0 2023-10-05T21:15:15.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.045+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e0043040 con 0x559982022fb0 2023-10-05T21:15:15.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.045+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982029110 con 0x7fe3e001a070 2023-10-05T21:15:15.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.045+0000 7fe3e9550700 1 -- 172.21.15.153:0/550618120 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc019040 con 0x7fe3e001a070 2023-10-05T21:15:15.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.045+0000 7fe3e9550700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982029110 con 0x7fe3dc007030 2023-10-05T21:15:15.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.046+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e400a570 con 0x7fe3dc007030 2023-10-05T21:15:15.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.046+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820279a0 con 0x559981ff2bb0 2023-10-05T21:15:15.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.046+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.046+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820279a0 con 0x559981ff2bb0 2023-10-05T21:15:15.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.046+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.046+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820279a0 con 0x7fe3dc007030 2023-10-05T21:15:15.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.046+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e400a570 con 0x7fe3dc007030 2023-10-05T21:15:15.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.046+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820279a0 con 0x7fe3dc007030 2023-10-05T21:15:15.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.046+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e400a570 con 0x7fe3dc007030 2023-10-05T21:15:15.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.046+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820279a0 con 0x7fe3e001a070 2023-10-05T21:15:15.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.047+0000 7fe3e9550700 1 -- 172.21.15.153:0/550618120 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc019040 con 0x7fe3e001a070 2023-10-05T21:15:15.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.047+0000 7fe3e9550700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820279a0 con 0x559982022fb0 2023-10-05T21:15:15.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.047+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fe3e0043040 con 0x559982022fb0 2023-10-05T21:15:15.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.047+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820279a0 con 0x559981ff2bb0 2023-10-05T21:15:15.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.047+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.047+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820279a0 con 0x7fe3dc007030 2023-10-05T21:15:15.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.047+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e400a570 con 0x7fe3dc007030 2023-10-05T21:15:15.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.047+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820279a0 con 0x559981ff2bb0 2023-10-05T21:15:15.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.047+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.047+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820279a0 con 0x7fe3e001a070 2023-10-05T21:15:15.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.048+0000 7fe3e9550700 1 -- 172.21.15.153:0/550618120 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc019040 con 0x7fe3e001a070 2023-10-05T21:15:15.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.048+0000 7fe3e9550700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820279a0 con 0x559982022fb0 2023-10-05T21:15:15.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.048+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e0043040 con 0x559982022fb0 2023-10-05T21:15:15.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.048+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820279a0 con 0x559982022fb0 2023-10-05T21:15:15.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.048+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e0043040 con 0x559982022fb0 2023-10-05T21:15:15.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.048+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820279a0 con 0x7fe3dc007030 2023-10-05T21:15:15.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.048+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e400a570 con 0x7fe3dc007030 2023-10-05T21:15:15.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.048+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820279a0 con 0x559982022fb0 2023-10-05T21:15:15.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.049+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e0043040 con 0x559982022fb0 2023-10-05T21:15:15.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.049+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820279a0 con 0x559982022fb0 2023-10-05T21:15:15.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.049+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e0043040 con 0x559982022fb0 2023-10-05T21:15:15.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.049+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820279a0 con 0x559981ff2bb0 2023-10-05T21:15:15.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.049+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.049+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820279a0 con 0x559981ff2bb0 2023-10-05T21:15:15.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.049+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.049+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820279a0 con 0x7fe3dc007030 2023-10-05T21:15:15.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.049+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e400a570 con 0x7fe3dc007030 2023-10-05T21:15:15.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.049+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820279a0 con 0x559982022fb0 2023-10-05T21:15:15.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.050+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e0043040 con 0x559982022fb0 2023-10-05T21:15:15.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.050+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820279a0 con 0x7fe3e001a070 2023-10-05T21:15:15.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.050+0000 7fe3e9550700 1 -- 172.21.15.153:0/550618120 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc019040 con 0x7fe3e001a070 2023-10-05T21:15:15.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.050+0000 7fe3e9550700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820279a0 con 0x559981ff2bb0 2023-10-05T21:15:15.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.050+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.050+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820279a0 con 0x7fe3dc007030 2023-10-05T21:15:15.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.050+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e400a570 con 0x7fe3dc007030 2023-10-05T21:15:15.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.050+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820279a0 con 0x559982022fb0 2023-10-05T21:15:15.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.050+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e0043040 con 0x559982022fb0 2023-10-05T21:15:15.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.050+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820279a0 con 0x7fe3dc007030 2023-10-05T21:15:15.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.051+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e400a570 con 0x7fe3dc007030 2023-10-05T21:15:15.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.051+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820279a0 con 0x7fe3e001a070 2023-10-05T21:15:15.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.051+0000 7fe3e9550700 1 -- 172.21.15.153:0/550618120 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc019040 con 0x7fe3e001a070 2023-10-05T21:15:15.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.051+0000 7fe3e9550700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820279a0 con 0x559982022fb0 2023-10-05T21:15:15.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.051+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e0043040 con 0x559982022fb0 2023-10-05T21:15:15.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.052+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820279a0 con 0x7fe3dc007030 2023-10-05T21:15:15.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.052+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3e400a570 con 0x7fe3dc007030 2023-10-05T21:15:15.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.052+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820279a0 con 0x559981ff2bb0 2023-10-05T21:15:15.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.052+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.052+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820279a0 con 0x7fe3e001a070 2023-10-05T21:15:15.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.052+0000 7fe3e9550700 1 -- 172.21.15.153:0/550618120 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe3dc019040 con 0x7fe3e001a070 2023-10-05T21:15:15.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.052+0000 7fe3f6c79680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:15.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.052+0000 7fe3f6c79680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:15.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.052+0000 7fe3f6c79680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:15.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.052+0000 7fe3f6c79680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:15.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.052+0000 7fe3f6c79680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.052+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982028100 con 0x559981ff2bb0 2023-10-05T21:15:15.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.052+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.052+0000 7fe3f6c79680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:15.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.052+0000 7fe3f6c79680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.052+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982028500 con 0x559982022fb0 2023-10-05T21:15:15.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.053+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fe3e0043040 con 0x559982022fb0 2023-10-05T21:15:15.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.053+0000 7fe3f6c79680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:15.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.053+0000 7fe3f6c79680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.053+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982028df0 con 0x559981ff2bb0 2023-10-05T21:15:15.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.053+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.053+0000 7fe3f6c79680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:15.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.053+0000 7fe3f6c79680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.053+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982028df0 con 0x559981ff2bb0 2023-10-05T21:15:15.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.053+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.053+0000 7fe3f6c79680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:15.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.053+0000 7fe3f6c79680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.053+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982028df0 con 0x7fe3dc007030 2023-10-05T21:15:15.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.054+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fe3e400a570 con 0x7fe3dc007030 2023-10-05T21:15:15.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.054+0000 7fe3f6c79680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.054+0000 7fe3f6c79680 20 zone default found 2023-10-05T21:15:15.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.054+0000 7fe3f6c79680 4 Realm: () 2023-10-05T21:15:15.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.054+0000 7fe3f6c79680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:15.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.054+0000 7fe3f6c79680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:15.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.054+0000 7fe3f6c79680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:15.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.054+0000 7fe3f6c79680 20 zonegroup default 2023-10-05T21:15:15.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.054+0000 7fe3f6c79680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.054+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982028df0 con 0x7fe3dc007030 2023-10-05T21:15:15.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.054+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe3e400a570 con 0x7fe3dc007030 2023-10-05T21:15:15.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.054+0000 7fe3f6c79680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.054+0000 7fe3f6c79680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.054+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982028df0 con 0x559982022fb0 2023-10-05T21:15:15.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.054+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe3e0043040 con 0x559982022fb0 2023-10-05T21:15:15.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.054+0000 7fe3f6c79680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.054+0000 7fe3f6c79680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.054+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55998202acb0 con 0x559982022fb0 2023-10-05T21:15:15.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.054+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe3e0043040 con 0x559982022fb0 2023-10-05T21:15:15.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.054+0000 7fe3f6c79680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.054+0000 7fe3f6c79680 20 started sync module instance, tier type = 2023-10-05T21:15:15.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.054+0000 7fe3f6c79680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:15.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.054+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55998202a370 con 0x7fe3e001a070 2023-10-05T21:15:15.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.055+0000 7fe3e9550700 1 -- 172.21.15.153:0/550618120 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3dc019040 con 0x7fe3e001a070 2023-10-05T21:15:15.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.055+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94117799569264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55998202b550 con 0x7fe3e001a070 2023-10-05T21:15:15.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.055+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55998202bdf0 con 0x559981ff2bb0 2023-10-05T21:15:15.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.056+0000 7fe3e9550700 1 -- 172.21.15.153:0/550618120 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94117799569264] v29'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3dc019040 con 0x7fe3e001a070 2023-10-05T21:15:15.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.056+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.056+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94117799571552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55998202bdf0 con 0x559981ff2bb0 2023-10-05T21:15:15.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.056+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55998202c990 con 0x559982022fb0 2023-10-05T21:15:15.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.057+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94117799571552] v29'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.057+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e0043040 con 0x559982022fb0 2023-10-05T21:15:15.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.057+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94117799573760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55998202bd50 con 0x559982022fb0 2023-10-05T21:15:15.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.057+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55998202d770 con 0x7fe3e001a070 2023-10-05T21:15:15.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.057+0000 7fe3e9550700 1 -- 172.21.15.153:0/550618120 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3dc019040 con 0x7fe3e001a070 2023-10-05T21:15:15.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.058+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94117799582496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55998202e460 con 0x7fe3e001a070 2023-10-05T21:15:15.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.058+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55998202ee70 con 0x559981ff2bb0 2023-10-05T21:15:15.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.058+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94117799573760] v29'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e0043040 con 0x559982022fb0 2023-10-05T21:15:15.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.058+0000 7fe3e9550700 1 -- 172.21.15.153:0/550618120 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94117799582496] v29'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3dc019040 con 0x7fe3e001a070 2023-10-05T21:15:15.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.058+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.058+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94117799579024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55998202ee70 con 0x559981ff2bb0 2023-10-05T21:15:15.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.058+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55998202f760 con 0x7fe3dc007030 2023-10-05T21:15:15.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.059+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94117799579024] v29'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.059+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e400a570 con 0x7fe3dc007030 2023-10-05T21:15:15.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.059+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94117799586736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55998202f5b0 con 0x7fe3dc007030 2023-10-05T21:15:15.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.059+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982030140 con 0x7fe3dc007030 2023-10-05T21:15:15.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.060+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94117799586736] v29'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e400a570 con 0x7fe3dc007030 2023-10-05T21:15:15.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.060+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e400a570 con 0x7fe3dc007030 2023-10-05T21:15:15.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.060+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94117799590896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982030100 con 0x7fe3dc007030 2023-10-05T21:15:15.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.060+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982030bd0 con 0x7fe3dc007030 2023-10-05T21:15:15.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.060+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94117799590896] v29'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e400a570 con 0x7fe3dc007030 2023-10-05T21:15:15.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.061+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e400a570 con 0x7fe3dc007030 2023-10-05T21:15:15.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.061+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94117799593600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982030b90 con 0x7fe3dc007030 2023-10-05T21:15:15.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.061+0000 7fe3f6c79680 20 add_watcher() i=0 2023-10-05T21:15:15.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.061+0000 7fe3f6c79680 20 add_watcher() i=1 2023-10-05T21:15:15.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.061+0000 7fe3f6c79680 20 add_watcher() i=2 2023-10-05T21:15:15.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.061+0000 7fe3f6c79680 20 add_watcher() i=3 2023-10-05T21:15:15.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.061+0000 7fe3f6c79680 20 add_watcher() i=4 2023-10-05T21:15:15.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.061+0000 7fe3f6c79680 20 add_watcher() i=5 2023-10-05T21:15:15.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.061+0000 7fe3f6c79680 20 add_watcher() i=6 2023-10-05T21:15:15.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.061+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94117799593600] v29'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e400a570 con 0x7fe3dc007030 2023-10-05T21:15:15.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.061+0000 7fe3f6c79680 20 add_watcher() i=7 2023-10-05T21:15:15.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.061+0000 7fe3f6c79680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:15.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.061+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982033fd0 con 0x559981ff2bb0 2023-10-05T21:15:15.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.061+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.062+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94117799587840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982031490 con 0x559981ff2bb0 2023-10-05T21:15:15.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.062+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94117799587840] v29'84 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.062+0000 7fe3bafe5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:15.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.062+0000 7fe3f6c79680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:15.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.062+0000 7fe3f6c79680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:15.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.062+0000 7fe3f6c79680 1 Processor -- start 2023-10-05T21:15:15.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.063+0000 7fe3f6c79680 1 -- start start 2023-10-05T21:15:15.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.063+0000 7fe3f6c79680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55998203dbe0 0x55998203dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.063+0000 7fe3f6c79680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55998203e600 con 0x55998203dbe0 2023-10-05T21:15:15.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.063+0000 7fe3e9550700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55998203dbe0 0x55998203dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.063+0000 7fe3e9550700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55998203dbe0 0x55998203dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50106/0 (socket says 172.21.15.153:50106) 2023-10-05T21:15:15.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.063+0000 7fe3e9550700 1 -- 172.21.15.153:0/2509496931 learned_addr learned my addr 172.21.15.153:0/2509496931 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:15.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.063+0000 7fe3e9550700 1 -- 172.21.15.153:0/2509496931 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55998203eae0 con 0x55998203dbe0 2023-10-05T21:15:15.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.063+0000 7fe3e9550700 1 --2- 172.21.15.153:0/2509496931 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55998203dbe0 0x55998203dff0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x559981fecf50 tx=0x7fe3dc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2795ec212955ded server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.063+0000 7fe3ba7e4700 1 -- 172.21.15.153:0/2509496931 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3dc01ddc0 con 0x55998203dbe0 2023-10-05T21:15:15.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.063+0000 7fe3ba7e4700 1 -- 172.21.15.153:0/2509496931 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3dc02b440 con 0x55998203dbe0 2023-10-05T21:15:15.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.063+0000 7fe3ba7e4700 1 -- 172.21.15.153:0/2509496931 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3dc02b5f0 con 0x55998203dbe0 2023-10-05T21:15:15.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.064+0000 7fe3f6c79680 1 -- 172.21.15.153:0/2509496931 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55998203dbe0 msgr2=0x55998203dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.064+0000 7fe3f6c79680 1 --2- 172.21.15.153:0/2509496931 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55998203dbe0 0x55998203dff0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x559981fecf50 tx=0x7fe3dc012000 comp rx=0 tx=0).stop 2023-10-05T21:15:15.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.064+0000 7fe3f6c79680 1 -- 172.21.15.153:0/2509496931 shutdown_connections 2023-10-05T21:15:15.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.064+0000 7fe3f6c79680 1 --2- 172.21.15.153:0/2509496931 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55998203dbe0 0x55998203dff0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.064+0000 7fe3f6c79680 1 -- 172.21.15.153:0/2509496931 >> 172.21.15.153:0/2509496931 conn(0x559982039ee0 msgr2=0x559982037fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:15.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.064+0000 7fe3f6c79680 1 -- 172.21.15.153:0/2509496931 shutdown_connections 2023-10-05T21:15:15.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.064+0000 7fe3f6c79680 1 -- 172.21.15.153:0/2509496931 wait complete. 2023-10-05T21:15:15.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.064+0000 7fe3f6c79680 1 Processor -- start 2023-10-05T21:15:15.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.065+0000 7fe3f6c79680 1 -- start start 2023-10-05T21:15:15.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.065+0000 7fe3f6c79680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55998203dbe0 0x5599820448f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.065+0000 7fe3f6c79680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x559982044e30 con 0x55998203dbe0 2023-10-05T21:15:15.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.065+0000 7fe3e9550700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55998203dbe0 0x5599820448f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.065+0000 7fe3e9550700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55998203dbe0 0x5599820448f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50120/0 (socket says 172.21.15.153:50120) 2023-10-05T21:15:15.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.065+0000 7fe3e9550700 1 -- 172.21.15.153:0/3354520083 learned_addr learned my addr 172.21.15.153:0/3354520083 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:15.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.065+0000 7fe3e9550700 1 -- 172.21.15.153:0/3354520083 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559981ff64e0 con 0x55998203dbe0 2023-10-05T21:15:15.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.065+0000 7fe3e9550700 1 --2- 172.21.15.153:0/3354520083 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55998203dbe0 0x5599820448f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x559982039450 tx=0x7fe3dc030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.065+0000 7fe3b8fe1700 1 -- 172.21.15.153:0/3354520083 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3dc01de70 con 0x55998203dbe0 2023-10-05T21:15:15.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.065+0000 7fe3b8fe1700 1 -- 172.21.15.153:0/3354520083 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3dc009640 con 0x55998203dbe0 2023-10-05T21:15:15.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.065+0000 7fe3f6c79680 1 -- 172.21.15.153:0/3354520083 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559982045030 con 0x55998203dbe0 2023-10-05T21:15:15.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.065+0000 7fe3b8fe1700 1 -- 172.21.15.153:0/3354520083 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe3dc0097f0 con 0x55998203dbe0 2023-10-05T21:15:15.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.066+0000 7fe3f6c79680 1 -- 172.21.15.153:0/3354520083 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5599820454e0 con 0x55998203dbe0 2023-10-05T21:15:15.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.066+0000 7fe3b8fe1700 1 -- 172.21.15.153:0/3354520083 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fe3dc009950 con 0x55998203dbe0 2023-10-05T21:15:15.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.066+0000 7fe3b8fe1700 1 --2- 172.21.15.153:0/3354520083 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fe330034140 0x7fe3300365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.066+0000 7fe3b8fe1700 1 -- 172.21.15.153:0/3354520083 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fe3dc030070 con 0x55998203dbe0 2023-10-05T21:15:15.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.066+0000 7fe3f6c79680 5 note: GC not initialized 2023-10-05T21:15:15.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.066+0000 7fe3ea552700 1 --2- 172.21.15.153:0/3354520083 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fe330034140 0x7fe3300365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.067+0000 7fe3ea552700 1 --2- 172.21.15.153:0/3354520083 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fe330034140 0x7fe3300365f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x559982030320 tx=0x7fe3e4037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.067+0000 7fe329ffb700 20 reqs_thread_entry: start 2023-10-05T21:15:15.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.067+0000 7fe31b7fe700 20 reqs_thread_entry: start 2023-10-05T21:15:15.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.067+0000 7fe3f6c79680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:15.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.068+0000 7fe3f6c79680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:15.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.068+0000 7fe319ffb700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:45 2023 2023-10-05T21:15:15.115 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:15.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.068+0000 7fe3197fa700 20 reqs_thread_entry: start 2023-10-05T21:15:15.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.068+0000 7fe3f6c79680 20 get_system_obj_state: rctx=0x7ffc71e27298 obj=default.rgw.meta:users.uid:foo state=0x559981e9f240 s->prefetch_data=0 2023-10-05T21:15:15.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.068+0000 7fe3f6c79680 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T21:15:15.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.068+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820aa2e0 con 0x559981ff2bb0 2023-10-05T21:15:15.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.068+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv9 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.068+0000 7fe3f6c79680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T21:15:15.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.068+0000 7fe3f6c79680 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:15.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.068+0000 7fe3f6c79680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:15.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.068+0000 7fe3f6c79680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:15.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.068+0000 7fe3f6c79680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:15.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.068+0000 7fe3f6c79680 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:15.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.068+0000 7fe3f6c79680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.068+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820ac5b0 con 0x559981ff2bb0 2023-10-05T21:15:15.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.069+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~539 out=539b,getxattrs out=75b] v0'0 uv9 ondisk = 0) v8 ==== 273+0+662 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.069+0000 7fe3f6c79680 20 rados_obj.operate() r=0 bl.length=539 2023-10-05T21:15:15.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.069+0000 7fe3f6c79680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T21:15:15.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.069+0000 7fe3f6c79680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:15.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.069+0000 7fe3f6c79680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:15.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.069+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:104 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~513 in=513b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820ae110 con 0x559981ff2bb0 2023-10-05T21:15:15.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.069+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(104 foo [delete,create,call,writefull 0~513] v29'10 uv10 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.069+0000 7fe3f6c79680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T21:15:15.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.069+0000 7fe3f6c79680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:15.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.069+0000 7fe3f6c79680 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T21:15:15.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.069+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [notify cookie 94117800087008 in=701b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5599820a9230 con 0x559981ff2bb0 2023-10-05T21:15:15.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.070+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== watch-notify(notify (1) cookie 94117799579024 notify 124554051593 ret 0) v3 ==== 731+0+0 (crc 0 0 0) 0x7fe3e40292a0 con 0x559981ff2bb0 2023-10-05T21:15:15.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.070+0000 7fe3db7fe700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051593 cookie 94117799579024 notifier 4376 bl.length()=689 2023-10-05T21:15:15.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.070+0000 7fe3db7fe700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T21:15:15.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.070+0000 7fe3db7fe700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:15.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.070+0000 7fe3db7fe700 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fe3c8003d90 con 0x559981ff2bb0 2023-10-05T21:15:15.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.070+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(105 notify.4 [notify cookie 94117800087008 out=8b] v0'0 uv75 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.070+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(106 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.070+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== watch-notify(notify_complete (2) cookie 94117800087008 notify 124554051593 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fe3e402d040 con 0x559981ff2bb0 2023-10-05T21:15:15.118 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:15.118 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "foo", 2023-10-05T21:15:15.118 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Foo", 2023-10-05T21:15:15.118 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "foo@foo.com", 2023-10-05T21:15:15.118 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2023-10-05T21:15:15.118 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 4, 2023-10-05T21:15:15.119 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [ 2023-10-05T21:15:15.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:15.119 INFO:teuthology.orchestra.run.smithi153.stdout: "id": "foo:foo2", 2023-10-05T21:15:15.119 INFO:teuthology.orchestra.run.smithi153.stdout: "permissions": "" 2023-10-05T21:15:15.119 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:15.119 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:15.119 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2023-10-05T21:15:15.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:15.119 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:15.119 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:15.119 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T21:15:15.119 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:15.120 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:15.120 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [ 2023-10-05T21:15:15.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:15.120 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo:foo2", 2023-10-05T21:15:15.120 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy" 2023-10-05T21:15:15.120 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:15.120 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:15.120 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2023-10-05T21:15:15.120 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2023-10-05T21:15:15.120 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2023-10-05T21:15:15.120 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2023-10-05T21:15:15.120 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2023-10-05T21:15:15.121 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:15:15.121 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:15.121 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:15.121 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:15.121 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:15.121 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:15.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:15.121 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2023-10-05T21:15:15.121 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:15.121 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:15.121 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:15.121 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:15.121 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:15.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:15.122 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2023-10-05T21:15:15.122 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2023-10-05T21:15:15.122 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [] 2023-10-05T21:15:15.122 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:15.122 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:15:15.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.070+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:107 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94117799569264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559982068970 con 0x7fe3e001a070 2023-10-05T21:15:15.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.071+0000 7fe3e9550700 1 -- 172.21.15.153:0/550618120 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(107 notify.0 [watch unwatch cookie 94117799569264] v29'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3dc033040 con 0x7fe3e001a070 2023-10-05T21:15:15.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.071+0000 7fe3f6c79680 20 remove_watcher() i=0 2023-10-05T21:15:15.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.071+0000 7fe3f6c79680 2 removed watcher, disabling cache 2023-10-05T21:15:15.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.071+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:108 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94117799571552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55998202a770 con 0x559981ff2bb0 2023-10-05T21:15:15.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.072+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 42 ==== osd_op_reply(108 notify.1 [watch unwatch cookie 94117799571552] v29'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.072+0000 7fe3f6c79680 20 remove_watcher() i=1 2023-10-05T21:15:15.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.072+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:109 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94117799573760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55998202a770 con 0x559982022fb0 2023-10-05T21:15:15.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.073+0000 7fe3e9d51700 1 -- 172.21.15.153:0/550618120 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(109 notify.2 [watch unwatch cookie 94117799573760] v29'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e0043040 con 0x559982022fb0 2023-10-05T21:15:15.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.073+0000 7fe3f6c79680 20 remove_watcher() i=2 2023-10-05T21:15:15.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.073+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:110 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94117799582496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55998202a770 con 0x7fe3e001a070 2023-10-05T21:15:15.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.074+0000 7fe3e9550700 1 -- 172.21.15.153:0/550618120 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(110 notify.3 [watch unwatch cookie 94117799582496] v29'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3dc033040 con 0x7fe3e001a070 2023-10-05T21:15:15.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.074+0000 7fe3f6c79680 20 remove_watcher() i=3 2023-10-05T21:15:15.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.074+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:111 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94117799579024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55998202db20 con 0x559981ff2bb0 2023-10-05T21:15:15.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.075+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 43 ==== osd_op_reply(111 notify.4 [watch unwatch cookie 94117799579024] v29'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.075+0000 7fe3f6c79680 20 remove_watcher() i=4 2023-10-05T21:15:15.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.075+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94117799586736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55998202a770 con 0x7fe3dc007030 2023-10-05T21:15:15.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.075+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(112 notify.5 [watch unwatch cookie 94117799586736] v29'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e400a570 con 0x7fe3dc007030 2023-10-05T21:15:15.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.075+0000 7fe3f6c79680 20 remove_watcher() i=5 2023-10-05T21:15:15.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.075+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:113 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94117799590896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55998202db20 con 0x7fe3dc007030 2023-10-05T21:15:15.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.076+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(113 notify.6 [watch unwatch cookie 94117799590896] v29'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e400a570 con 0x7fe3dc007030 2023-10-05T21:15:15.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.076+0000 7fe3f6c79680 20 remove_watcher() i=6 2023-10-05T21:15:15.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.076+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:114 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94117799593600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55998202ebb0 con 0x7fe3dc007030 2023-10-05T21:15:15.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.077+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(114 notify.7 [watch unwatch cookie 94117799593600] v29'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe3e400a570 con 0x7fe3dc007030 2023-10-05T21:15:15.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.077+0000 7fe3f6c79680 20 remove_watcher() i=7 2023-10-05T21:15:15.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.077+0000 7fe3bafe5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:15.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.078+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:115 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94117799587840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55998202a770 con 0x559981ff2bb0 2023-10-05T21:15:15.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.078+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 <== osd.1 v2:172.21.15.153:6816/140456 44 ==== osd_op_reply(115 data_loggenerations_metadata [watch unwatch cookie 94117799587840] v29'85 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe3e400a570 con 0x559981ff2bb0 2023-10-05T21:15:15.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.078+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fe3dc007030 msgr2=0x7fe3dc01d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.078+0000 7fe3f6c79680 1 --2- 172.21.15.153:0/550618120 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fe3dc007030 0x7fe3dc01d420 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.078+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x559981ff2bb0 msgr2=0x559982020b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.078+0000 7fe3f6c79680 1 --2- 172.21.15.153:0/550618120 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x559981ff2bb0 0x559982020b90 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.078+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fe3e001a070 msgr2=0x7fe3e0046320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.078+0000 7fe3f6c79680 1 --2- 172.21.15.153:0/550618120 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fe3e001a070 0x7fe3e0046320 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.078+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x559982022fb0 msgr2=0x559982025390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.078+0000 7fe3f6c79680 1 --2- 172.21.15.153:0/550618120 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x559982022fb0 0x559982025390 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.078+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fe3cc034140 msgr2=0x7fe3cc0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.078+0000 7fe3f6c79680 1 --2- 172.21.15.153:0/550618120 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fe3cc034140 0x7fe3cc0365f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc000c00 tx=0x7fe3dc015000 comp rx=0 tx=0).stop 2023-10-05T21:15:15.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.078+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559981f600a0 msgr2=0x559982014de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.078+0000 7fe3ea552700 1 -- 172.21.15.153:0/550618120 reap_dead start 2023-10-05T21:15:15.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.078+0000 7fe3f6c79680 1 --2- 172.21.15.153:0/550618120 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559981f600a0 0x559982014de0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0000fb0 tx=0x7fe3e0016000 comp rx=0 tx=0).stop 2023-10-05T21:15:15.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.079+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 shutdown_connections 2023-10-05T21:15:15.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.079+0000 7fe3f6c79680 1 --2- 172.21.15.153:0/550618120 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559981f600a0 0x559982014de0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.079+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 >> 172.21.15.153:0/550618120 conn(0x559981fe6b80 msgr2=0x559982007c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:15.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.079+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 shutdown_connections 2023-10-05T21:15:15.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.079+0000 7fe3f6c79680 1 -- 172.21.15.153:0/550618120 wait complete. 2023-10-05T21:15:15.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.079+0000 7fe3f6c79680 1 -- 172.21.15.153:0/3354520083 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fe330034140 msgr2=0x7fe3300365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.079+0000 7fe3f6c79680 1 --2- 172.21.15.153:0/3354520083 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fe330034140 0x7fe3300365f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x559982030320 tx=0x7fe3e4037450 comp rx=0 tx=0).stop 2023-10-05T21:15:15.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.079+0000 7fe3f6c79680 1 -- 172.21.15.153:0/3354520083 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55998203dbe0 msgr2=0x5599820448f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.079+0000 7fe3f6c79680 1 --2- 172.21.15.153:0/3354520083 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55998203dbe0 0x5599820448f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x559982039450 tx=0x7fe3dc030000 comp rx=0 tx=0).stop 2023-10-05T21:15:15.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.079+0000 7fe3f6c79680 1 -- 172.21.15.153:0/3354520083 shutdown_connections 2023-10-05T21:15:15.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.079+0000 7fe3f6c79680 1 --2- 172.21.15.153:0/3354520083 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fe330034140 0x7fe3300365f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.079+0000 7fe3f6c79680 1 --2- 172.21.15.153:0/3354520083 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55998203dbe0 0x5599820448f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.079+0000 7fe3f6c79680 1 -- 172.21.15.153:0/3354520083 >> 172.21.15.153:0/3354520083 conn(0x559982039ee0 msgr2=0x559982037fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:15.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.079+0000 7fe3f6c79680 1 -- 172.21.15.153:0/3354520083 shutdown_connections 2023-10-05T21:15:15.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.079+0000 7fe3f6c79680 1 -- 172.21.15.153:0/3354520083 wait complete. 2023-10-05T21:15:15.133 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:15:15.133 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2023-10-05T21:15:15.133 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2023-10-05T21:15:15.133 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2023-10-05T21:15:15.180 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:15.180 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:15.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.179+0000 7f4875fc5680 1 Processor -- start 2023-10-05T21:15:15.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.180+0000 7f4875fc5680 1 -- start start 2023-10-05T21:15:15.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.180+0000 7f4875fc5680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55aa55915b50 0x55aa55917f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.180+0000 7f4875fc5680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55aa5585c930 con 0x55aa55883040 2023-10-05T21:15:15.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.180+0000 7f4875fc5680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55aa5581cdb0 con 0x55aa55915b50 2023-10-05T21:15:15.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.180+0000 7f486889c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55aa55915b50 0x55aa55917f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.180+0000 7f486909d700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55aa55883040 0x55aa55914430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56340/0 (socket says 172.21.15.153:56340) 2023-10-05T21:15:15.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.180+0000 7f486909d700 1 -- 172.21.15.153:0/3020626213 learned_addr learned my addr 172.21.15.153:0/3020626213 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:15.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.180+0000 7f486889c700 1 -- 172.21.15.153:0/3020626213 >> v1:172.21.15.111:6789/0 conn(0x55aa55883040 legacy=0x55aa55914430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.180+0000 7f485bfff700 1 -- 172.21.15.153:0/3020626213 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2784094743 0 0) 0x55aa5585c930 con 0x55aa55883040 2023-10-05T21:15:15.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.180+0000 7f486889c700 1 -- 172.21.15.153:0/3020626213 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa55919480 con 0x55aa55915b50 2023-10-05T21:15:15.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.180+0000 7f486889c700 1 --2- 172.21.15.153:0/3020626213 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55aa55915b50 0x55aa55917f30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f485c00a5d0 tx=0x7f485c005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d221274334b00a65 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.181+0000 7f485bfff700 1 -- 172.21.15.153:0/3020626213 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f485c0086a0 con 0x55aa55915b50 2023-10-05T21:15:15.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.181+0000 7f485bfff700 1 -- 172.21.15.153:0/3020626213 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485c008800 con 0x55aa55915b50 2023-10-05T21:15:15.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.181+0000 7f485bfff700 1 -- 172.21.15.153:0/3020626213 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f485c008ad0 con 0x55aa55915b50 2023-10-05T21:15:15.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.181+0000 7f4875fc5680 1 -- 172.21.15.153:0/3020626213 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55aa55915b50 msgr2=0x55aa55917f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.181+0000 7f4875fc5680 1 --2- 172.21.15.153:0/3020626213 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55aa55915b50 0x55aa55917f30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f485c00a5d0 tx=0x7f485c005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:15.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.181+0000 7f4875fc5680 1 -- 172.21.15.153:0/3020626213 shutdown_connections 2023-10-05T21:15:15.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.181+0000 7f4875fc5680 1 --2- 172.21.15.153:0/3020626213 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55aa55915b50 0x55aa55917f30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.181+0000 7f4875fc5680 1 -- 172.21.15.153:0/3020626213 >> 172.21.15.153:0/3020626213 conn(0x55aa55909b20 msgr2=0x55aa5590bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:15.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.181+0000 7f4875fc5680 1 -- 172.21.15.153:0/3020626213 shutdown_connections 2023-10-05T21:15:15.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.181+0000 7f4875fc5680 1 -- 172.21.15.153:0/3020626213 wait complete. 2023-10-05T21:15:15.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.182+0000 7f4875fc5680 1 Processor -- start 2023-10-05T21:15:15.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.182+0000 7f4875fc5680 1 -- start start 2023-10-05T21:15:15.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.182+0000 7f4875fc5680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55aa55883040 0x55aa559308e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.182+0000 7f4875fc5680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa557bcea0 con 0x55aa55883040 2023-10-05T21:15:15.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.182+0000 7f486909d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55aa55883040 0x55aa559308e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.182+0000 7f486909d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55aa55883040 0x55aa559308e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50140/0 (socket says 172.21.15.153:50140) 2023-10-05T21:15:15.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.182+0000 7f486909d700 1 -- 172.21.15.153:0/3469025348 learned_addr learned my addr 172.21.15.153:0/3469025348 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:15.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.182+0000 7f486909d700 1 -- 172.21.15.153:0/3469025348 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485c005cf0 con 0x55aa55883040 2023-10-05T21:15:15.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.183+0000 7f486909d700 1 --2- 172.21.15.153:0/3469025348 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55aa55883040 0x55aa559308e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4860001d70 tx=0x7f4860001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538feeabcebe5e08 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.183+0000 7f485affd700 1 -- 172.21.15.153:0/3469025348 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f486000bcc0 con 0x55aa55883040 2023-10-05T21:15:15.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.183+0000 7f485affd700 1 -- 172.21.15.153:0/3469025348 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486000be20 con 0x55aa55883040 2023-10-05T21:15:15.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.183+0000 7f485affd700 1 -- 172.21.15.153:0/3469025348 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f486000e5f0 con 0x55aa55883040 2023-10-05T21:15:15.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.183+0000 7f4875fc5680 1 -- 172.21.15.153:0/3469025348 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55aa55883040 msgr2=0x55aa559308e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.183+0000 7f4875fc5680 1 --2- 172.21.15.153:0/3469025348 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55aa55883040 0x55aa559308e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4860001d70 tx=0x7f4860001770 comp rx=0 tx=0).stop 2023-10-05T21:15:15.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.183+0000 7f4875fc5680 1 -- 172.21.15.153:0/3469025348 shutdown_connections 2023-10-05T21:15:15.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.183+0000 7f4875fc5680 1 --2- 172.21.15.153:0/3469025348 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55aa55883040 0x55aa559308e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.183+0000 7f4875fc5680 1 -- 172.21.15.153:0/3469025348 >> 172.21.15.153:0/3469025348 conn(0x55aa55909b20 msgr2=0x55aa5592c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:15.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.183+0000 7f4875fc5680 1 -- 172.21.15.153:0/3469025348 shutdown_connections 2023-10-05T21:15:15.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.183+0000 7f4875fc5680 1 -- 172.21.15.153:0/3469025348 wait complete. 2023-10-05T21:15:15.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.184+0000 7f4875fc5680 1 Processor -- start 2023-10-05T21:15:15.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.184+0000 7f4875fc5680 1 -- start start 2023-10-05T21:15:15.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.184+0000 7f4875fc5680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55aa55883040 0x55aa55937d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.184+0000 7f4875fc5680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa557b3c80 con 0x55aa55883040 2023-10-05T21:15:15.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.184+0000 7f486909d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55aa55883040 0x55aa55937d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.184+0000 7f486909d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55aa55883040 0x55aa55937d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50150/0 (socket says 172.21.15.153:50150) 2023-10-05T21:15:15.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.184+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 learned_addr learned my addr 172.21.15.153:0/2721004854 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:15.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.184+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4860001a50 con 0x55aa55883040 2023-10-05T21:15:15.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.184+0000 7f486909d700 1 --2- 172.21.15.153:0/2721004854 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55aa55883040 0x55aa55937d80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f48600017b0 tx=0x7f4860016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.184+0000 7f48597fa700 1 -- 172.21.15.153:0/2721004854 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f486001f070 con 0x55aa55883040 2023-10-05T21:15:15.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.184+0000 7f48597fa700 1 -- 172.21.15.153:0/2721004854 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486001a2e0 con 0x55aa55883040 2023-10-05T21:15:15.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.184+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55aa559382c0 con 0x55aa55883040 2023-10-05T21:15:15.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.184+0000 7f48597fa700 1 -- 172.21.15.153:0/2721004854 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f486001a650 con 0x55aa55883040 2023-10-05T21:15:15.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.185+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aa55938790 con 0x55aa55883040 2023-10-05T21:15:15.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.185+0000 7f48597fa700 1 -- 172.21.15.153:0/2721004854 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f486001a7b0 con 0x55aa55883040 2023-10-05T21:15:15.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.185+0000 7f4875fc5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.185+0000 7f48597fa700 1 --2- 172.21.15.153:0/2721004854 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f484c034140 0x7f484c0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.185+0000 7f48597fa700 1 -- 172.21.15.153:0/2721004854 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f4860048ec0 con 0x55aa55883040 2023-10-05T21:15:15.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.185+0000 7f486889c700 1 --2- 172.21.15.153:0/2721004854 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f484c034140 0x7f484c0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.186+0000 7f4875fc5680 1 --2- 172.21.15.153:0/2721004854 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55aa55915b50 0x55aa55943b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.186+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa559442f0 con 0x55aa55915b50 2023-10-05T21:15:15.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.186+0000 7f486989e700 1 --2- 172.21.15.153:0/2721004854 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55aa55915b50 0x55aa55943b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.186+0000 7f486889c700 1 --2- 172.21.15.153:0/2721004854 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f484c034140 0x7f484c0365f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f485c003080 tx=0x7f485c015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.186+0000 7f486989e700 1 --2- 172.21.15.153:0/2721004854 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55aa55915b50 0x55aa55943b60 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.186+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.186+0000 7f4875fc5680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.186+0000 7f4875fc5680 20 realm 2023-10-05T21:15:15.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.186+0000 7f4875fc5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.186+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa55941180 con 0x55aa55915b50 2023-10-05T21:15:15.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.187+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.187+0000 7f4875fc5680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.187+0000 7f4875fc5680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:15.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.187+0000 7f4875fc5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.187+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa55944df0 con 0x55aa55915b50 2023-10-05T21:15:15.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.187+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.187+0000 7f4875fc5680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.187+0000 7f4875fc5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.187+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa55945710 con 0x55aa55915b50 2023-10-05T21:15:15.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.187+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.187+0000 7f4875fc5680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:15.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.187+0000 7f4875fc5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.187+0000 7f4875fc5680 1 --2- 172.21.15.153:0/2721004854 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55aa55945fd0 0x55aa559483b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.187+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa55948a00 con 0x55aa55945fd0 2023-10-05T21:15:15.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.187+0000 7f486909d700 1 --2- 172.21.15.153:0/2721004854 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55aa55945fd0 0x55aa559483b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.187+0000 7f486909d700 1 --2- 172.21.15.153:0/2721004854 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55aa55945fd0 0x55aa559483b0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.188+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f4860014070 con 0x55aa55945fd0 2023-10-05T21:15:15.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.188+0000 7f4875fc5680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:15.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.188+0000 7f4875fc5680 20 searching for the correct realm 2023-10-05T21:15:15.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.188+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594a570 con 0x55aa55945fd0 2023-10-05T21:15:15.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.188+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4860014070 con 0x55aa55945fd0 2023-10-05T21:15:15.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.188+0000 7f486909d700 1 --2- 172.21.15.153:0/2721004854 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f486000d750 0x7f4860017430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.188+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f486003e040 con 0x7f486000d750 2023-10-05T21:15:15.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.188+0000 7f486889c700 1 --2- 172.21.15.153:0/2721004854 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f486000d750 0x7f4860017430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.188+0000 7f486889c700 1 --2- 172.21.15.153:0/2721004854 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f486000d750 0x7f4860017430 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.188+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f485c019040 con 0x7f486000d750 2023-10-05T21:15:15.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.189+0000 7f486889c700 1 --2- 172.21.15.153:0/2721004854 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f485c007030 0x7f485c01d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.189+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f486003e040 con 0x7f485c007030 2023-10-05T21:15:15.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.189+0000 7f486989e700 1 --2- 172.21.15.153:0/2721004854 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f485c007030 0x7f485c01d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.189+0000 7f486989e700 1 --2- 172.21.15.153:0/2721004854 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f485c007030 0x7f485c01d420 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.189+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f486400a570 con 0x7f485c007030 2023-10-05T21:15:15.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.189+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f486003e040 con 0x55aa55915b50 2023-10-05T21:15:15.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.190+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.190+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f486003e040 con 0x55aa55915b50 2023-10-05T21:15:15.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.190+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.190+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f486003e040 con 0x7f485c007030 2023-10-05T21:15:15.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.190+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f486400a570 con 0x7f485c007030 2023-10-05T21:15:15.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.190+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f486003e040 con 0x7f485c007030 2023-10-05T21:15:15.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.190+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f486400a570 con 0x7f485c007030 2023-10-05T21:15:15.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.190+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f486003e040 con 0x7f486000d750 2023-10-05T21:15:15.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.191+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f485c019040 con 0x7f486000d750 2023-10-05T21:15:15.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.191+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f486003e040 con 0x55aa55945fd0 2023-10-05T21:15:15.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.191+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4860014070 con 0x55aa55945fd0 2023-10-05T21:15:15.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.191+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f486003e040 con 0x55aa55915b50 2023-10-05T21:15:15.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.191+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.191+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f486003e040 con 0x7f485c007030 2023-10-05T21:15:15.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.191+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f486400a570 con 0x7f485c007030 2023-10-05T21:15:15.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.191+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f486003e040 con 0x55aa55915b50 2023-10-05T21:15:15.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.191+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.191+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f486003e040 con 0x7f486000d750 2023-10-05T21:15:15.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.192+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f485c019040 con 0x7f486000d750 2023-10-05T21:15:15.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.192+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f486003e040 con 0x55aa55945fd0 2023-10-05T21:15:15.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.192+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4860014070 con 0x55aa55945fd0 2023-10-05T21:15:15.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.192+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f486003e040 con 0x55aa55945fd0 2023-10-05T21:15:15.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.192+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4860014070 con 0x55aa55945fd0 2023-10-05T21:15:15.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.192+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f486003e040 con 0x7f485c007030 2023-10-05T21:15:15.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.192+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f486400a570 con 0x7f485c007030 2023-10-05T21:15:15.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.192+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f486003e040 con 0x55aa55945fd0 2023-10-05T21:15:15.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.192+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4860014070 con 0x55aa55945fd0 2023-10-05T21:15:15.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.192+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f486003e040 con 0x55aa55945fd0 2023-10-05T21:15:15.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.193+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4860014070 con 0x55aa55945fd0 2023-10-05T21:15:15.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.193+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f486003e040 con 0x55aa55915b50 2023-10-05T21:15:15.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.193+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.193+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f486003e040 con 0x55aa55915b50 2023-10-05T21:15:15.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.193+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.193+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f486003e040 con 0x7f485c007030 2023-10-05T21:15:15.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.193+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f486400a570 con 0x7f485c007030 2023-10-05T21:15:15.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.193+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f486003e040 con 0x55aa55945fd0 2023-10-05T21:15:15.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.193+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4860014070 con 0x55aa55945fd0 2023-10-05T21:15:15.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.193+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f486003e040 con 0x7f486000d750 2023-10-05T21:15:15.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.194+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f485c019040 con 0x7f486000d750 2023-10-05T21:15:15.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.194+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f486003e040 con 0x55aa55915b50 2023-10-05T21:15:15.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.194+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.194+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f486003e040 con 0x7f485c007030 2023-10-05T21:15:15.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.194+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f486400a570 con 0x7f485c007030 2023-10-05T21:15:15.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.194+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f486003e040 con 0x55aa55945fd0 2023-10-05T21:15:15.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.195+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4860014070 con 0x55aa55945fd0 2023-10-05T21:15:15.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.195+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f486003e040 con 0x7f485c007030 2023-10-05T21:15:15.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.195+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f486400a570 con 0x7f485c007030 2023-10-05T21:15:15.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.195+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f486003e040 con 0x7f486000d750 2023-10-05T21:15:15.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.195+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f485c019040 con 0x7f486000d750 2023-10-05T21:15:15.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.195+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f486003e040 con 0x55aa55945fd0 2023-10-05T21:15:15.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.195+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4860014070 con 0x55aa55945fd0 2023-10-05T21:15:15.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.195+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f486003e040 con 0x7f485c007030 2023-10-05T21:15:15.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.196+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f486400a570 con 0x7f485c007030 2023-10-05T21:15:15.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.196+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f486003e040 con 0x55aa55915b50 2023-10-05T21:15:15.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.196+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.196+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f486003e040 con 0x7f486000d750 2023-10-05T21:15:15.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.196+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f485c019040 con 0x7f486000d750 2023-10-05T21:15:15.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.196+0000 7f4875fc5680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:15.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.196+0000 7f4875fc5680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:15.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.196+0000 7f4875fc5680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:15.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.196+0000 7f4875fc5680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:15.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.196+0000 7f4875fc5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.196+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa559494c0 con 0x55aa55915b50 2023-10-05T21:15:15.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.196+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.196+0000 7f4875fc5680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.196+0000 7f4875fc5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.196+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa559498c0 con 0x55aa55915b50 2023-10-05T21:15:15.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.196+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.197+0000 7f4875fc5680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:15.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.197+0000 7f4875fc5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.197+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594aa00 con 0x55aa55915b50 2023-10-05T21:15:15.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.197+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.197+0000 7f4875fc5680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:15.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.197+0000 7f4875fc5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.197+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594adb0 con 0x55aa55945fd0 2023-10-05T21:15:15.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.197+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f4860014070 con 0x55aa55945fd0 2023-10-05T21:15:15.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.197+0000 7f4875fc5680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.197+0000 7f4875fc5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.197+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594b160 con 0x55aa55915b50 2023-10-05T21:15:15.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.197+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.197+0000 7f4875fc5680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.197+0000 7f4875fc5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.197+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594b160 con 0x55aa55915b50 2023-10-05T21:15:15.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.197+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.197+0000 7f4875fc5680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:15.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.197+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594c170 con 0x55aa55945fd0 2023-10-05T21:15:15.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.198+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4860014070 con 0x55aa55945fd0 2023-10-05T21:15:15.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.198+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594c170 con 0x7f486000d750 2023-10-05T21:15:15.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.198+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f485c019040 con 0x7f486000d750 2023-10-05T21:15:15.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.198+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594c170 con 0x7f485c007030 2023-10-05T21:15:15.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.198+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f486400a570 con 0x7f485c007030 2023-10-05T21:15:15.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.198+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594aa00 con 0x55aa55915b50 2023-10-05T21:15:15.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.198+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.198+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594aa00 con 0x55aa55915b50 2023-10-05T21:15:15.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.198+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.199+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594aa00 con 0x7f485c007030 2023-10-05T21:15:15.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.199+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f486400a570 con 0x7f485c007030 2023-10-05T21:15:15.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.199+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594aa00 con 0x7f485c007030 2023-10-05T21:15:15.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.199+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f486400a570 con 0x7f485c007030 2023-10-05T21:15:15.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.199+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594aa00 con 0x7f486000d750 2023-10-05T21:15:15.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.199+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f485c019040 con 0x7f486000d750 2023-10-05T21:15:15.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.199+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594aa00 con 0x55aa55945fd0 2023-10-05T21:15:15.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.200+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4860014070 con 0x55aa55945fd0 2023-10-05T21:15:15.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.200+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594aa00 con 0x55aa55915b50 2023-10-05T21:15:15.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.200+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.200+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594aa00 con 0x7f485c007030 2023-10-05T21:15:15.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.200+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f486400a570 con 0x7f485c007030 2023-10-05T21:15:15.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.200+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594aa00 con 0x55aa55915b50 2023-10-05T21:15:15.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.200+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.200+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594aa00 con 0x7f486000d750 2023-10-05T21:15:15.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.200+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f485c019040 con 0x7f486000d750 2023-10-05T21:15:15.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.200+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594aa00 con 0x55aa55945fd0 2023-10-05T21:15:15.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.201+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4860014070 con 0x55aa55945fd0 2023-10-05T21:15:15.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.201+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594aa00 con 0x55aa55945fd0 2023-10-05T21:15:15.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.201+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4860014070 con 0x55aa55945fd0 2023-10-05T21:15:15.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.201+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594aa00 con 0x7f485c007030 2023-10-05T21:15:15.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.201+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f486400a570 con 0x7f485c007030 2023-10-05T21:15:15.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.201+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594aa00 con 0x55aa55945fd0 2023-10-05T21:15:15.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.201+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4860014070 con 0x55aa55945fd0 2023-10-05T21:15:15.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.201+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594aa00 con 0x55aa55945fd0 2023-10-05T21:15:15.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.201+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4860014070 con 0x55aa55945fd0 2023-10-05T21:15:15.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.201+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594aa00 con 0x55aa55915b50 2023-10-05T21:15:15.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.202+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.202+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594aa00 con 0x55aa55915b50 2023-10-05T21:15:15.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.202+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.202+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594aa00 con 0x7f485c007030 2023-10-05T21:15:15.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.202+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f486400a570 con 0x7f485c007030 2023-10-05T21:15:15.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.202+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594aa00 con 0x55aa55945fd0 2023-10-05T21:15:15.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.202+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4860014070 con 0x55aa55945fd0 2023-10-05T21:15:15.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.202+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594aa00 con 0x7f486000d750 2023-10-05T21:15:15.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.202+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f485c019040 con 0x7f486000d750 2023-10-05T21:15:15.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.202+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594aa00 con 0x55aa55915b50 2023-10-05T21:15:15.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.203+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.203+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594aa00 con 0x7f485c007030 2023-10-05T21:15:15.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.203+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f486400a570 con 0x7f485c007030 2023-10-05T21:15:15.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.203+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594aa00 con 0x55aa55945fd0 2023-10-05T21:15:15.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.203+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4860014070 con 0x55aa55945fd0 2023-10-05T21:15:15.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.203+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594aa00 con 0x7f485c007030 2023-10-05T21:15:15.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.203+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f486400a570 con 0x7f485c007030 2023-10-05T21:15:15.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.203+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594aa00 con 0x7f486000d750 2023-10-05T21:15:15.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.204+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f485c019040 con 0x7f486000d750 2023-10-05T21:15:15.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.204+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594aa00 con 0x55aa55945fd0 2023-10-05T21:15:15.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.204+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4860014070 con 0x55aa55945fd0 2023-10-05T21:15:15.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.204+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594aa00 con 0x7f485c007030 2023-10-05T21:15:15.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.204+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f486400a570 con 0x7f485c007030 2023-10-05T21:15:15.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.204+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594aa00 con 0x55aa55915b50 2023-10-05T21:15:15.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.204+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.204+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594aa00 con 0x7f486000d750 2023-10-05T21:15:15.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.204+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f485c019040 con 0x7f486000d750 2023-10-05T21:15:15.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.204+0000 7f4875fc5680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:15.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.204+0000 7f4875fc5680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:15.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.204+0000 7f4875fc5680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:15.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.204+0000 7f4875fc5680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:15.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.204+0000 7f4875fc5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.204+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594b160 con 0x55aa55915b50 2023-10-05T21:15:15.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.205+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.205+0000 7f4875fc5680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:15.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.205+0000 7f4875fc5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.205+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594b560 con 0x55aa55945fd0 2023-10-05T21:15:15.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.205+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f4860014070 con 0x55aa55945fd0 2023-10-05T21:15:15.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.205+0000 7f4875fc5680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:15.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.205+0000 7f4875fc5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.205+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa559490f0 con 0x55aa55915b50 2023-10-05T21:15:15.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.205+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.205+0000 7f4875fc5680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:15.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.205+0000 7f4875fc5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.205+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa559490d0 con 0x55aa55915b50 2023-10-05T21:15:15.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.205+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.205+0000 7f4875fc5680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:15.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.205+0000 7f4875fc5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.205+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594bf20 con 0x7f485c007030 2023-10-05T21:15:15.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.206+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f486400a570 con 0x7f485c007030 2023-10-05T21:15:15.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.206+0000 7f4875fc5680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.206+0000 7f4875fc5680 20 zone default found 2023-10-05T21:15:15.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.206+0000 7f4875fc5680 4 Realm: () 2023-10-05T21:15:15.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.206+0000 7f4875fc5680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:15.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.206+0000 7f4875fc5680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:15.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.206+0000 7f4875fc5680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:15.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.206+0000 7f4875fc5680 20 zonegroup default 2023-10-05T21:15:15.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.206+0000 7f4875fc5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.206+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594bf20 con 0x7f485c007030 2023-10-05T21:15:15.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.206+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f486400a570 con 0x7f485c007030 2023-10-05T21:15:15.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.206+0000 7f4875fc5680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.206+0000 7f4875fc5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.206+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594d820 con 0x55aa55945fd0 2023-10-05T21:15:15.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.206+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4860014070 con 0x55aa55945fd0 2023-10-05T21:15:15.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.206+0000 7f4875fc5680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.206+0000 7f4875fc5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.206+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594dbd0 con 0x55aa55945fd0 2023-10-05T21:15:15.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.206+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4860014070 con 0x55aa55945fd0 2023-10-05T21:15:15.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.207+0000 7f4875fc5680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.207+0000 7f4875fc5680 20 started sync module instance, tier type = 2023-10-05T21:15:15.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.207+0000 7f4875fc5680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:15.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.207+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594cee0 con 0x7f486000d750 2023-10-05T21:15:15.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.207+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f485c019040 con 0x7f486000d750 2023-10-05T21:15:15.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.207+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94190068617952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594e470 con 0x7f486000d750 2023-10-05T21:15:15.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.207+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594ed10 con 0x55aa55915b50 2023-10-05T21:15:15.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.208+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94190068617952] v29'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f485c019040 con 0x7f486000d750 2023-10-05T21:15:15.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.208+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.208+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94190068621184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594ed10 con 0x55aa55915b50 2023-10-05T21:15:15.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.208+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594f8b0 con 0x55aa55945fd0 2023-10-05T21:15:15.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.209+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94190068621184] v29'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.209+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4860014070 con 0x55aa55945fd0 2023-10-05T21:15:15.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.209+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94190068623392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa5594ec70 con 0x55aa55945fd0 2023-10-05T21:15:15.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.209+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa55950690 con 0x7f486000d750 2023-10-05T21:15:15.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.210+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94190068623392] v29'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4860014070 con 0x55aa55945fd0 2023-10-05T21:15:15.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.210+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f485c019040 con 0x7f486000d750 2023-10-05T21:15:15.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.210+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94190068628656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa55950a40 con 0x7f486000d750 2023-10-05T21:15:15.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.210+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa55951450 con 0x55aa55915b50 2023-10-05T21:15:15.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.210+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94190068628656] v29'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f485c019040 con 0x7f486000d750 2023-10-05T21:15:15.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.210+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.210+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94190068633440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa559518a0 con 0x55aa55915b50 2023-10-05T21:15:15.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.210+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa559522b0 con 0x7f485c007030 2023-10-05T21:15:15.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.211+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94190068633440] v29'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.211+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f486400a570 con 0x7f485c007030 2023-10-05T21:15:15.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.211+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94190068635136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa559522b0 con 0x7f485c007030 2023-10-05T21:15:15.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.211+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa55952cc0 con 0x7f485c007030 2023-10-05T21:15:15.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.212+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(96 notify.6 [create] v29'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f486400a570 con 0x7f485c007030 2023-10-05T21:15:15.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.212+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94190068639696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa55953110 con 0x7f485c007030 2023-10-05T21:15:15.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.212+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa55953cb0 con 0x7f485c007030 2023-10-05T21:15:15.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.212+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(95 notify.5 [watch watch cookie 94190068635136] v29'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f486400a570 con 0x7f485c007030 2023-10-05T21:15:15.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.213+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94190068639696] v29'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f486400a570 con 0x7f485c007030 2023-10-05T21:15:15.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.213+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f486400a570 con 0x7f485c007030 2023-10-05T21:15:15.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.213+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94190068637120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa55953110 con 0x7f485c007030 2023-10-05T21:15:15.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.213+0000 7f4875fc5680 20 add_watcher() i=0 2023-10-05T21:15:15.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.213+0000 7f4875fc5680 20 add_watcher() i=1 2023-10-05T21:15:15.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.213+0000 7f4875fc5680 20 add_watcher() i=2 2023-10-05T21:15:15.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.213+0000 7f4875fc5680 20 add_watcher() i=3 2023-10-05T21:15:15.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.213+0000 7f4875fc5680 20 add_watcher() i=4 2023-10-05T21:15:15.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.213+0000 7f4875fc5680 20 add_watcher() i=5 2023-10-05T21:15:15.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.213+0000 7f4875fc5680 20 add_watcher() i=6 2023-10-05T21:15:15.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.213+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94190068637120] v29'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f486400a570 con 0x7f485c007030 2023-10-05T21:15:15.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.213+0000 7f4875fc5680 20 add_watcher() i=7 2023-10-05T21:15:15.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.213+0000 7f4875fc5680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:15.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.213+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa55956ce0 con 0x55aa55915b50 2023-10-05T21:15:15.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.214+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.214+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94190068640800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa559541a0 con 0x55aa55915b50 2023-10-05T21:15:15.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.214+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94190068640800] v29'86 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.214+0000 7f483a7e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:15.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.214+0000 7f4875fc5680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:15.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.215+0000 7f4875fc5680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:15.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.215+0000 7f4875fc5680 1 Processor -- start 2023-10-05T21:15:15.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.215+0000 7f4875fc5680 1 -- start start 2023-10-05T21:15:15.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.215+0000 7f4875fc5680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55aa55960770 0x55aa55960b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.215+0000 7f4875fc5680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa55961190 con 0x55aa55960770 2023-10-05T21:15:15.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.215+0000 7f486889c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55aa55960770 0x55aa55960b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.215+0000 7f486889c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55aa55960770 0x55aa55960b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50160/0 (socket says 172.21.15.153:50160) 2023-10-05T21:15:15.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.215+0000 7f486889c700 1 -- 172.21.15.153:0/2387319112 learned_addr learned my addr 172.21.15.153:0/2387319112 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:15.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.215+0000 7f486889c700 1 -- 172.21.15.153:0/2387319112 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa55961670 con 0x55aa55960770 2023-10-05T21:15:15.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.215+0000 7f486889c700 1 --2- 172.21.15.153:0/2387319112 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55aa55960770 0x55aa55960b80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55aa5590fef0 tx=0x7f485c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c954c786949edf62 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.216+0000 7f4839fe3700 1 -- 172.21.15.153:0/2387319112 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f485c01ddc0 con 0x55aa55960770 2023-10-05T21:15:15.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.216+0000 7f4839fe3700 1 -- 172.21.15.153:0/2387319112 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485c02b450 con 0x55aa55960770 2023-10-05T21:15:15.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.216+0000 7f4839fe3700 1 -- 172.21.15.153:0/2387319112 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f485c02b5e0 con 0x55aa55960770 2023-10-05T21:15:15.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.216+0000 7f4875fc5680 1 -- 172.21.15.153:0/2387319112 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55aa55960770 msgr2=0x55aa55960b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.216+0000 7f4875fc5680 1 --2- 172.21.15.153:0/2387319112 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55aa55960770 0x55aa55960b80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55aa5590fef0 tx=0x7f485c012000 comp rx=0 tx=0).stop 2023-10-05T21:15:15.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.216+0000 7f4875fc5680 1 -- 172.21.15.153:0/2387319112 shutdown_connections 2023-10-05T21:15:15.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.216+0000 7f4875fc5680 1 --2- 172.21.15.153:0/2387319112 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55aa55960770 0x55aa55960b80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.216+0000 7f4875fc5680 1 -- 172.21.15.153:0/2387319112 >> 172.21.15.153:0/2387319112 conn(0x55aa5595ca70 msgr2=0x55aa5595ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:15.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.216+0000 7f4875fc5680 1 -- 172.21.15.153:0/2387319112 shutdown_connections 2023-10-05T21:15:15.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.216+0000 7f4875fc5680 1 -- 172.21.15.153:0/2387319112 wait complete. 2023-10-05T21:15:15.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.217+0000 7f4875fc5680 1 Processor -- start 2023-10-05T21:15:15.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.217+0000 7f4875fc5680 1 -- start start 2023-10-05T21:15:15.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.217+0000 7f4875fc5680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55aa55960770 0x55aa559674c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.217+0000 7f4875fc5680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa55967a00 con 0x55aa55960770 2023-10-05T21:15:15.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.217+0000 7f486889c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55aa55960770 0x55aa559674c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.217+0000 7f486889c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55aa55960770 0x55aa559674c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50176/0 (socket says 172.21.15.153:50176) 2023-10-05T21:15:15.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.217+0000 7f486889c700 1 -- 172.21.15.153:0/2778650518 learned_addr learned my addr 172.21.15.153:0/2778650518 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:15.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.217+0000 7f486889c700 1 -- 172.21.15.153:0/2778650518 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa55919480 con 0x55aa55960770 2023-10-05T21:15:15.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.217+0000 7f486889c700 1 --2- 172.21.15.153:0/2778650518 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55aa55960770 0x55aa559674c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x55aa5595bfe0 tx=0x7f485c031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.218+0000 7f47abfff700 1 -- 172.21.15.153:0/2778650518 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f485c037910 con 0x55aa55960770 2023-10-05T21:15:15.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.218+0000 7f47abfff700 1 -- 172.21.15.153:0/2778650518 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485c037a70 con 0x55aa55960770 2023-10-05T21:15:15.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.218+0000 7f4875fc5680 1 -- 172.21.15.153:0/2778650518 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55aa55967c00 con 0x55aa55960770 2023-10-05T21:15:15.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.218+0000 7f47abfff700 1 -- 172.21.15.153:0/2778650518 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f485c037d20 con 0x55aa55960770 2023-10-05T21:15:15.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.218+0000 7f4875fc5680 1 -- 172.21.15.153:0/2778650518 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aa55968050 con 0x55aa55960770 2023-10-05T21:15:15.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.218+0000 7f47abfff700 1 -- 172.21.15.153:0/2778650518 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f485c026040 con 0x55aa55960770 2023-10-05T21:15:15.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.218+0000 7f47abfff700 1 --2- 172.21.15.153:0/2778650518 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f47b0034140 0x7f47b00365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.218+0000 7f47abfff700 1 -- 172.21.15.153:0/2778650518 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f485c045020 con 0x55aa55960770 2023-10-05T21:15:15.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.219+0000 7f4875fc5680 5 note: GC not initialized 2023-10-05T21:15:15.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.219+0000 7f486989e700 1 --2- 172.21.15.153:0/2778650518 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f47b0034140 0x7f47b00365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.219+0000 7f486989e700 1 --2- 172.21.15.153:0/2778650518 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f47b0034140 0x7f47b00365f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x55aa559531d0 tx=0x7f4864037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.219+0000 7f47a97fa700 20 reqs_thread_entry: start 2023-10-05T21:15:15.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.220+0000 7f47a2ffd700 20 reqs_thread_entry: start 2023-10-05T21:15:15.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.220+0000 7f4875fc5680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:15.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.220+0000 7f4875fc5680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:15.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.220+0000 7f47a17fa700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:45 2023 2023-10-05T21:15:15.258 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:15.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.220+0000 7f47a0ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:15.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.220+0000 7f4875fc5680 20 get_system_obj_state: rctx=0x7ffd85cdb758 obj=default.rgw.meta:users.uid:foo state=0x55aa557c2240 s->prefetch_data=0 2023-10-05T21:15:15.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.220+0000 7f4875fc5680 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T21:15:15.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.220+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa559ccea0 con 0x55aa55915b50 2023-10-05T21:15:15.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.220+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.220+0000 7f4875fc5680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T21:15:15.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.220+0000 7f4875fc5680 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:15.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.220+0000 7f4875fc5680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:15.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.220+0000 7f4875fc5680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:15.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.220+0000 7f4875fc5680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:15.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.220+0000 7f4875fc5680 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:15.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.220+0000 7f4875fc5680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.220+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa559cf130 con 0x55aa55915b50 2023-10-05T21:15:15.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.221+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv10 ondisk = 0) v8 ==== 273+0+636 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.221+0000 7f4875fc5680 20 rados_obj.operate() r=0 bl.length=513 2023-10-05T21:15:15.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.221+0000 7f4875fc5680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T21:15:15.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.221+0000 7f4875fc5680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:15.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.221+0000 7f4875fc5680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:15.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.221+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:104 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa559d0c90 con 0x55aa55915b50 2023-10-05T21:15:15.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.222+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(104 foo [delete,create,call,writefull 0~357] v29'11 uv11 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.222+0000 7f4875fc5680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T21:15:15.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.222+0000 7f4875fc5680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:15.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.222+0000 7f4875fc5680 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T21:15:15.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.222+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [notify cookie 94190069135776 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa559cbdf0 con 0x55aa55915b50 2023-10-05T21:15:15.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.222+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== watch-notify(notify (1) cookie 94190068633440 notify 124554051594 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x7f4864029290 con 0x55aa55915b50 2023-10-05T21:15:15.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.222+0000 7f485affd700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051594 cookie 94190068633440 notifier 4382 bl.length()=533 2023-10-05T21:15:15.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.222+0000 7f485affd700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T21:15:15.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.222+0000 7f485affd700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:15.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.222+0000 7f485affd700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f4848003d90 con 0x55aa55915b50 2023-10-05T21:15:15.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.222+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(105 notify.4 [notify cookie 94190069135776 out=8b] v0'0 uv78 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.222+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(106 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.222+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== watch-notify(notify_complete (2) cookie 94190069135776 notify 124554051594 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f486402d040 con 0x55aa55915b50 2023-10-05T21:15:15.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.222+0000 7f4875fc5680 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2023-10-05T21:15:15.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.222+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:107 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94190069156224 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa559cb9a0 con 0x7f486000d750 2023-10-05T21:15:15.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.222+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== watch-notify(notify (1) cookie 94190068617952 notify 124554051589 ret 0) v3 ==== 201+0+0 (crc 0 0 0) 0x55aa55968050 con 0x7f486000d750 2023-10-05T21:15:15.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.222+0000 7f485a7fc700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051589 cookie 94190068617952 notifier 4382 bl.length()=159 2023-10-05T21:15:15.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.222+0000 7f485a7fc700 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:108 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f47b80032d0 con 0x7f486000d750 2023-10-05T21:15:15.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.223+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(107 notify.0 [notify cookie 94190069156224 out=8b] v0'0 uv78 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f485c034040 con 0x7f486000d750 2023-10-05T21:15:15.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.223+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(108 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f485c034040 con 0x7f486000d750 2023-10-05T21:15:15.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.223+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== watch-notify(notify_complete (2) cookie 94190069156224 notify 124554051589 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55aa55967c00 con 0x7f486000d750 2023-10-05T21:15:15.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.223+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:109 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa559cb9a0 con 0x7f486000d750 2023-10-05T21:15:15.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.224+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== osd_op_reply(109 foo:foo2 [delete] v29'2 uv2 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f485c034040 con 0x7f486000d750 2023-10-05T21:15:15.262 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:15.262 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "foo", 2023-10-05T21:15:15.262 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Foo", 2023-10-05T21:15:15.262 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "foo@foo.com", 2023-10-05T21:15:15.262 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2023-10-05T21:15:15.263 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 4, 2023-10-05T21:15:15.263 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [], 2023-10-05T21:15:15.263 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2023-10-05T21:15:15.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:15.263 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:15.263 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:15.263 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T21:15:15.263 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:15.263 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:15.263 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [], 2023-10-05T21:15:15.263 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2023-10-05T21:15:15.263 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2023-10-05T21:15:15.264 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2023-10-05T21:15:15.264 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2023-10-05T21:15:15.264 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2023-10-05T21:15:15.264 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:15:15.264 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:15.264 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:15.264 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:15.264 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:15.264 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:15.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:15.264 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2023-10-05T21:15:15.264 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:15.264 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:15.265 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:15.265 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:15.265 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:15.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:15.265 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2023-10-05T21:15:15.265 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2023-10-05T21:15:15.265 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [] 2023-10-05T21:15:15.265 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:15.265 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:15:15.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.224+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:110 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94190068617952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa559cb9a0 con 0x7f486000d750 2023-10-05T21:15:15.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.225+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 <== osd.2 v2:172.21.15.153:6807/140454 22 ==== osd_op_reply(110 notify.0 [watch unwatch cookie 94190068617952] v29'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f485c034040 con 0x7f486000d750 2023-10-05T21:15:15.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.225+0000 7f4875fc5680 20 remove_watcher() i=0 2023-10-05T21:15:15.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.225+0000 7f4875fc5680 2 removed watcher, disabling cache 2023-10-05T21:15:15.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.225+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:111 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94190068621184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa559cb9a0 con 0x55aa55915b50 2023-10-05T21:15:15.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.225+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 42 ==== osd_op_reply(111 notify.1 [watch unwatch cookie 94190068621184] v29'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.225+0000 7f4875fc5680 20 remove_watcher() i=1 2023-10-05T21:15:15.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.225+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:112 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94190068623392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa559cb9a0 con 0x55aa55945fd0 2023-10-05T21:15:15.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.226+0000 7f486909d700 1 -- 172.21.15.153:0/2721004854 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(112 notify.2 [watch unwatch cookie 94190068623392] v29'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4860014070 con 0x55aa55945fd0 2023-10-05T21:15:15.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.226+0000 7f4875fc5680 20 remove_watcher() i=2 2023-10-05T21:15:15.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.226+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:113 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94190068628656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa559cb9a0 con 0x7f486000d750 2023-10-05T21:15:15.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.227+0000 7f486889c700 1 -- 172.21.15.153:0/2721004854 <== osd.2 v2:172.21.15.153:6807/140454 23 ==== osd_op_reply(113 notify.3 [watch unwatch cookie 94190068628656] v29'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f485c034040 con 0x7f486000d750 2023-10-05T21:15:15.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.227+0000 7f4875fc5680 20 remove_watcher() i=3 2023-10-05T21:15:15.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.227+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:114 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94190068633440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa559cb9a0 con 0x55aa55915b50 2023-10-05T21:15:15.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.228+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 43 ==== osd_op_reply(114 notify.4 [watch unwatch cookie 94190068633440] v29'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.228+0000 7f4875fc5680 20 remove_watcher() i=4 2023-10-05T21:15:15.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.228+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:115 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94190068635136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa559cb9a0 con 0x7f485c007030 2023-10-05T21:15:15.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.228+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(115 notify.5 [watch unwatch cookie 94190068635136] v29'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f486400a570 con 0x7f485c007030 2023-10-05T21:15:15.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.228+0000 7f4875fc5680 20 remove_watcher() i=5 2023-10-05T21:15:15.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.229+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:116 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94190068639696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa559cb9a0 con 0x7f485c007030 2023-10-05T21:15:15.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.229+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(116 notify.6 [watch unwatch cookie 94190068639696] v29'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f486400a570 con 0x7f485c007030 2023-10-05T21:15:15.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.229+0000 7f4875fc5680 20 remove_watcher() i=6 2023-10-05T21:15:15.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.229+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:117 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94190068637120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa559cb9a0 con 0x7f485c007030 2023-10-05T21:15:15.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.230+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(117 notify.7 [watch unwatch cookie 94190068637120] v29'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f486400a570 con 0x7f485c007030 2023-10-05T21:15:15.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.230+0000 7f4875fc5680 20 remove_watcher() i=7 2023-10-05T21:15:15.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.231+0000 7f483a7e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:15.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.231+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:118 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94190068640800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55aa559cb9a0 con 0x55aa55915b50 2023-10-05T21:15:15.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.231+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 <== osd.1 v2:172.21.15.153:6816/140456 44 ==== osd_op_reply(118 data_loggenerations_metadata [watch unwatch cookie 94190068640800] v29'87 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f486400a570 con 0x55aa55915b50 2023-10-05T21:15:15.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.231+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f485c007030 msgr2=0x7f485c01d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.231+0000 7f4875fc5680 1 --2- 172.21.15.153:0/2721004854 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f485c007030 0x7f485c01d420 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.231+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55aa55915b50 msgr2=0x55aa55943b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.231+0000 7f4875fc5680 1 --2- 172.21.15.153:0/2721004854 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55aa55915b50 0x55aa55943b60 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.231+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f486000d750 msgr2=0x7f4860017430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.231+0000 7f4875fc5680 1 --2- 172.21.15.153:0/2721004854 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f486000d750 0x7f4860017430 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.231+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55aa55945fd0 msgr2=0x55aa559483b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.231+0000 7f4875fc5680 1 --2- 172.21.15.153:0/2721004854 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55aa55945fd0 0x55aa559483b0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.232+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f484c034140 msgr2=0x7f484c0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.232+0000 7f4875fc5680 1 --2- 172.21.15.153:0/2721004854 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f484c034140 0x7f484c0365f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f485c003080 tx=0x7f485c015000 comp rx=0 tx=0).stop 2023-10-05T21:15:15.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.232+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55aa55883040 msgr2=0x55aa55937d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.232+0000 7f4875fc5680 1 --2- 172.21.15.153:0/2721004854 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55aa55883040 0x55aa55937d80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f48600017b0 tx=0x7f4860016000 comp rx=0 tx=0).stop 2023-10-05T21:15:15.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.232+0000 7f486989e700 1 -- 172.21.15.153:0/2721004854 reap_dead start 2023-10-05T21:15:15.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.232+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 shutdown_connections 2023-10-05T21:15:15.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.232+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 >> 172.21.15.153:0/2721004854 conn(0x55aa55909b20 msgr2=0x55aa5592ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:15.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.232+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 shutdown_connections 2023-10-05T21:15:15.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.232+0000 7f4875fc5680 1 -- 172.21.15.153:0/2721004854 wait complete. 2023-10-05T21:15:15.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.232+0000 7f4875fc5680 1 -- 172.21.15.153:0/2778650518 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f47b0034140 msgr2=0x7f47b00365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.232+0000 7f4875fc5680 1 --2- 172.21.15.153:0/2778650518 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f47b0034140 0x7f47b00365f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x55aa559531d0 tx=0x7f4864037450 comp rx=0 tx=0).stop 2023-10-05T21:15:15.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.232+0000 7f4875fc5680 1 -- 172.21.15.153:0/2778650518 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55aa55960770 msgr2=0x55aa559674c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.232+0000 7f4875fc5680 1 --2- 172.21.15.153:0/2778650518 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55aa55960770 0x55aa559674c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x55aa5595bfe0 tx=0x7f485c031000 comp rx=0 tx=0).stop 2023-10-05T21:15:15.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.232+0000 7f4875fc5680 1 -- 172.21.15.153:0/2778650518 shutdown_connections 2023-10-05T21:15:15.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.232+0000 7f4875fc5680 1 --2- 172.21.15.153:0/2778650518 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f47b0034140 0x7f47b00365f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.232+0000 7f4875fc5680 1 --2- 172.21.15.153:0/2778650518 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55aa55960770 0x55aa559674c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.232+0000 7f4875fc5680 1 -- 172.21.15.153:0/2778650518 >> 172.21.15.153:0/2778650518 conn(0x55aa5595ca70 msgr2=0x55aa5595ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:15.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.232+0000 7f4875fc5680 1 -- 172.21.15.153:0/2778650518 shutdown_connections 2023-10-05T21:15:15.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.232+0000 7f4875fc5680 1 -- 172.21.15.153:0/2778650518 wait complete. 2023-10-05T21:15:15.275 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:15:15.275 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2023-10-05T21:15:15.275 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2023-10-05T21:15:15.275 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2023-10-05T21:15:15.319 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:15.319 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:15.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.318+0000 7fbd221ae680 1 Processor -- start 2023-10-05T21:15:15.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.318+0000 7fbd221ae680 1 -- start start 2023-10-05T21:15:15.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.318+0000 7fbd221ae680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55d91c8097b0 0x55d91c809bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.318+0000 7fbd221ae680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d91c758990 con 0x55d91c80a100 2023-10-05T21:15:15.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.318+0000 7fbd221ae680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d91c718db0 con 0x55d91c8097b0 2023-10-05T21:15:15.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.319+0000 7fbd15286700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55d91c8097b0 0x55d91c809bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.319+0000 7fbd14a85700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55d91c80a100 0x55d91c80c9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56348/0 (socket says 172.21.15.153:56348) 2023-10-05T21:15:15.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.319+0000 7fbd14a85700 1 -- 172.21.15.153:0/832307876 learned_addr learned my addr 172.21.15.153:0/832307876 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:15.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.319+0000 7fbd15286700 1 -- 172.21.15.153:0/832307876 >> v1:172.21.15.111:6789/0 conn(0x55d91c80a100 legacy=0x55d91c80c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.319+0000 7fbd07fff700 1 -- 172.21.15.153:0/832307876 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2786022674 0 0) 0x55d91c758990 con 0x55d91c80a100 2023-10-05T21:15:15.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.319+0000 7fbd15286700 1 -- 172.21.15.153:0/832307876 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d91c80d1b0 con 0x55d91c8097b0 2023-10-05T21:15:15.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.319+0000 7fbd15286700 1 --2- 172.21.15.153:0/832307876 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c8097b0 0x55d91c809bc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00a5d0 tx=0x7fbd0c005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a55dbe61c587a37f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.319+0000 7fbd07fff700 1 -- 172.21.15.153:0/832307876 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd0c0086a0 con 0x55d91c8097b0 2023-10-05T21:15:15.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.319+0000 7fbd07fff700 1 -- 172.21.15.153:0/832307876 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0c008800 con 0x55d91c8097b0 2023-10-05T21:15:15.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.319+0000 7fbd07fff700 1 -- 172.21.15.153:0/832307876 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd0c008ad0 con 0x55d91c8097b0 2023-10-05T21:15:15.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.320+0000 7fbd221ae680 1 -- 172.21.15.153:0/832307876 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c8097b0 msgr2=0x55d91c809bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.320+0000 7fbd221ae680 1 --2- 172.21.15.153:0/832307876 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c8097b0 0x55d91c809bc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00a5d0 tx=0x7fbd0c005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:15.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.320+0000 7fbd221ae680 1 -- 172.21.15.153:0/832307876 shutdown_connections 2023-10-05T21:15:15.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.320+0000 7fbd221ae680 1 --2- 172.21.15.153:0/832307876 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c8097b0 0x55d91c809bc0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.320+0000 7fbd221ae680 1 -- 172.21.15.153:0/832307876 >> 172.21.15.153:0/832307876 conn(0x55d91c805300 msgr2=0x55d91c807710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:15.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.320+0000 7fbd221ae680 1 -- 172.21.15.153:0/832307876 shutdown_connections 2023-10-05T21:15:15.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.320+0000 7fbd221ae680 1 -- 172.21.15.153:0/832307876 wait complete. 2023-10-05T21:15:15.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.321+0000 7fbd221ae680 1 Processor -- start 2023-10-05T21:15:15.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.321+0000 7fbd221ae680 1 -- start start 2023-10-05T21:15:15.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.321+0000 7fbd221ae680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c8097b0 0x55d91c82a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.321+0000 7fbd221ae680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d91c6b8ea0 con 0x55d91c8097b0 2023-10-05T21:15:15.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.321+0000 7fbd15286700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c8097b0 0x55d91c82a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.321+0000 7fbd15286700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c8097b0 0x55d91c82a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50194/0 (socket says 172.21.15.153:50194) 2023-10-05T21:15:15.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.321+0000 7fbd15286700 1 -- 172.21.15.153:0/498150190 learned_addr learned my addr 172.21.15.153:0/498150190 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:15.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.321+0000 7fbd15286700 1 -- 172.21.15.153:0/498150190 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0c005cf0 con 0x55d91c8097b0 2023-10-05T21:15:15.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.322+0000 7fbd15286700 1 --2- 172.21.15.153:0/498150190 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c8097b0 0x55d91c82a880 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c005a90 tx=0x7fbd0c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c2dcb99f4acd12 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.322+0000 7fbd06ffd700 1 -- 172.21.15.153:0/498150190 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd0c008970 con 0x55d91c8097b0 2023-10-05T21:15:15.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.322+0000 7fbd06ffd700 1 -- 172.21.15.153:0/498150190 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0c008ad0 con 0x55d91c8097b0 2023-10-05T21:15:15.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.322+0000 7fbd06ffd700 1 -- 172.21.15.153:0/498150190 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd0c008d80 con 0x55d91c8097b0 2023-10-05T21:15:15.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.322+0000 7fbd221ae680 1 -- 172.21.15.153:0/498150190 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c8097b0 msgr2=0x55d91c82a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.322+0000 7fbd221ae680 1 --2- 172.21.15.153:0/498150190 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c8097b0 0x55d91c82a880 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c005a90 tx=0x7fbd0c015000 comp rx=0 tx=0).stop 2023-10-05T21:15:15.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.322+0000 7fbd221ae680 1 -- 172.21.15.153:0/498150190 shutdown_connections 2023-10-05T21:15:15.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.322+0000 7fbd221ae680 1 --2- 172.21.15.153:0/498150190 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c8097b0 0x55d91c82a880 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.322+0000 7fbd221ae680 1 -- 172.21.15.153:0/498150190 >> 172.21.15.153:0/498150190 conn(0x55d91c805300 msgr2=0x55d91c826350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:15.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.322+0000 7fbd221ae680 1 -- 172.21.15.153:0/498150190 shutdown_connections 2023-10-05T21:15:15.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.322+0000 7fbd221ae680 1 -- 172.21.15.153:0/498150190 wait complete. 2023-10-05T21:15:15.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.323+0000 7fbd221ae680 1 Processor -- start 2023-10-05T21:15:15.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.323+0000 7fbd221ae680 1 -- start start 2023-10-05T21:15:15.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.323+0000 7fbd221ae680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c8097b0 0x55d91c831c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.323+0000 7fbd221ae680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d91c6afc80 con 0x55d91c8097b0 2023-10-05T21:15:15.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.323+0000 7fbd15286700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c8097b0 0x55d91c831c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.323+0000 7fbd15286700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c8097b0 0x55d91c831c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50202/0 (socket says 172.21.15.153:50202) 2023-10-05T21:15:15.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.323+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 learned_addr learned my addr 172.21.15.153:0/511085022 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:15.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.323+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d91c80d1b0 con 0x55d91c8097b0 2023-10-05T21:15:15.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.324+0000 7fbd15286700 1 --2- 172.21.15.153:0/511085022 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c8097b0 0x55d91c831c90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00afd0 tx=0x7fbd0c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.324+0000 7fbd057fa700 1 -- 172.21.15.153:0/511085022 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd0c01d420 con 0x55d91c8097b0 2023-10-05T21:15:15.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.324+0000 7fbd057fa700 1 -- 172.21.15.153:0/511085022 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0c01d5a0 con 0x55d91c8097b0 2023-10-05T21:15:15.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.324+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d91c8321d0 con 0x55d91c8097b0 2023-10-05T21:15:15.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.324+0000 7fbd057fa700 1 -- 172.21.15.153:0/511085022 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd0c01d890 con 0x55d91c8097b0 2023-10-05T21:15:15.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.324+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d91c832680 con 0x55d91c8097b0 2023-10-05T21:15:15.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.324+0000 7fbd057fa700 1 -- 172.21.15.153:0/511085022 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fbd0c01dac0 con 0x55d91c8097b0 2023-10-05T21:15:15.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.325+0000 7fbd057fa700 1 --2- 172.21.15.153:0/511085022 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbcf8034140 0x7fbcf80365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.325+0000 7fbd057fa700 1 -- 172.21.15.153:0/511085022 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fbd0c04a170 con 0x55d91c8097b0 2023-10-05T21:15:15.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.325+0000 7fbd221ae680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.325+0000 7fbd14a85700 1 --2- 172.21.15.153:0/511085022 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbcf8034140 0x7fbcf80365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.325+0000 7fbd221ae680 1 --2- 172.21.15.153:0/511085022 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d91c80a100 0x55d91c83da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.325+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c83e1e0 con 0x55d91c80a100 2023-10-05T21:15:15.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.325+0000 7fbd15a87700 1 --2- 172.21.15.153:0/511085022 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d91c80a100 0x55d91c83da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.325+0000 7fbd14a85700 1 --2- 172.21.15.153:0/511085022 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbcf8034140 0x7fbcf80365f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbd080011e0 tx=0x7fbd08001340 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.325+0000 7fbd15a87700 1 --2- 172.21.15.153:0/511085022 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d91c80a100 0x55d91c83da50 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.326+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.326+0000 7fbd221ae680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.326+0000 7fbd221ae680 20 realm 2023-10-05T21:15:15.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.326+0000 7fbd221ae680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.326+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c83b030 con 0x55d91c80a100 2023-10-05T21:15:15.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.326+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.326+0000 7fbd221ae680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.326+0000 7fbd221ae680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:15.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.326+0000 7fbd221ae680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.326+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c83ece0 con 0x55d91c80a100 2023-10-05T21:15:15.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.326+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.326+0000 7fbd221ae680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.326+0000 7fbd221ae680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.326+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c83e900 con 0x55d91c80a100 2023-10-05T21:15:15.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.326+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.326+0000 7fbd221ae680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:15.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.326+0000 7fbd221ae680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.326+0000 7fbd221ae680 1 --2- 172.21.15.153:0/511085022 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d91c840080 0x55d91c842460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.326+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c8429a0 con 0x55d91c840080 2023-10-05T21:15:15.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.326+0000 7fbd15286700 1 --2- 172.21.15.153:0/511085022 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d91c840080 0x55d91c842460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.327+0000 7fbd15286700 1 --2- 172.21.15.153:0/511085022 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d91c840080 0x55d91c842460 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.327+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fbd0c019040 con 0x55d91c840080 2023-10-05T21:15:15.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.327+0000 7fbd221ae680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:15.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.327+0000 7fbd221ae680 20 searching for the correct realm 2023-10-05T21:15:15.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.327+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x55d91c840080 2023-10-05T21:15:15.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.327+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd0c019040 con 0x55d91c840080 2023-10-05T21:15:15.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.327+0000 7fbd15286700 1 --2- 172.21.15.153:0/511085022 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fbd0c02f030 0x7fbd0c0373e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.327+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x7fbd0c02f030 2023-10-05T21:15:15.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.327+0000 7fbd14a85700 1 --2- 172.21.15.153:0/511085022 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fbd0c02f030 0x7fbd0c0373e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.328+0000 7fbd14a85700 1 --2- 172.21.15.153:0/511085022 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fbd0c02f030 0x7fbd0c0373e0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.328+0000 7fbd14a85700 1 -- 172.21.15.153:0/511085022 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd08006070 con 0x7fbd0c02f030 2023-10-05T21:15:15.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.328+0000 7fbd14a85700 1 --2- 172.21.15.153:0/511085022 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fbd0800d8e0 0x7fbd0800c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.328+0000 7fbd14a85700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x7fbd0800d8e0 2023-10-05T21:15:15.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.328+0000 7fbd15a87700 1 --2- 172.21.15.153:0/511085022 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fbd0800d8e0 0x7fbd0800c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.328+0000 7fbd15a87700 1 --2- 172.21.15.153:0/511085022 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fbd0800d8e0 0x7fbd0800c360 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.329+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd1000a570 con 0x7fbd0800d8e0 2023-10-05T21:15:15.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.329+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x55d91c80a100 2023-10-05T21:15:15.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.329+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.329+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x55d91c80a100 2023-10-05T21:15:15.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.329+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.329+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x7fbd0800d8e0 2023-10-05T21:15:15.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.329+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd1000a570 con 0x7fbd0800d8e0 2023-10-05T21:15:15.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.329+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x7fbd0800d8e0 2023-10-05T21:15:15.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.329+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd1000a570 con 0x7fbd0800d8e0 2023-10-05T21:15:15.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.329+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x7fbd0c02f030 2023-10-05T21:15:15.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.330+0000 7fbd14a85700 1 -- 172.21.15.153:0/511085022 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd08006070 con 0x7fbd0c02f030 2023-10-05T21:15:15.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.330+0000 7fbd14a85700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x55d91c840080 2023-10-05T21:15:15.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.330+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fbd0c019040 con 0x55d91c840080 2023-10-05T21:15:15.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.330+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x55d91c80a100 2023-10-05T21:15:15.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.330+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.330+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x7fbd0800d8e0 2023-10-05T21:15:15.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.330+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd1000a570 con 0x7fbd0800d8e0 2023-10-05T21:15:15.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.330+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x55d91c80a100 2023-10-05T21:15:15.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.331+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.331+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x7fbd0c02f030 2023-10-05T21:15:15.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.331+0000 7fbd14a85700 1 -- 172.21.15.153:0/511085022 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd08006070 con 0x7fbd0c02f030 2023-10-05T21:15:15.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.331+0000 7fbd14a85700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x55d91c840080 2023-10-05T21:15:15.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.331+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd0c019040 con 0x55d91c840080 2023-10-05T21:15:15.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.331+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x55d91c840080 2023-10-05T21:15:15.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.331+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd0c019040 con 0x55d91c840080 2023-10-05T21:15:15.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.331+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x7fbd0800d8e0 2023-10-05T21:15:15.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.332+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd1000a570 con 0x7fbd0800d8e0 2023-10-05T21:15:15.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.332+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x55d91c840080 2023-10-05T21:15:15.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.332+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd0c019040 con 0x55d91c840080 2023-10-05T21:15:15.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.332+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x55d91c840080 2023-10-05T21:15:15.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.332+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd0c019040 con 0x55d91c840080 2023-10-05T21:15:15.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.332+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x55d91c80a100 2023-10-05T21:15:15.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.332+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.332+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x55d91c80a100 2023-10-05T21:15:15.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.333+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.333+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x7fbd0800d8e0 2023-10-05T21:15:15.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.333+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd1000a570 con 0x7fbd0800d8e0 2023-10-05T21:15:15.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.333+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x55d91c840080 2023-10-05T21:15:15.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.333+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd0c019040 con 0x55d91c840080 2023-10-05T21:15:15.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.333+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x7fbd0c02f030 2023-10-05T21:15:15.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.333+0000 7fbd14a85700 1 -- 172.21.15.153:0/511085022 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd08006070 con 0x7fbd0c02f030 2023-10-05T21:15:15.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.333+0000 7fbd14a85700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x55d91c80a100 2023-10-05T21:15:15.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.334+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.334+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x7fbd0800d8e0 2023-10-05T21:15:15.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.334+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd1000a570 con 0x7fbd0800d8e0 2023-10-05T21:15:15.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.334+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x55d91c840080 2023-10-05T21:15:15.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.334+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd0c019040 con 0x55d91c840080 2023-10-05T21:15:15.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.334+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x7fbd0800d8e0 2023-10-05T21:15:15.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.334+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd1000a570 con 0x7fbd0800d8e0 2023-10-05T21:15:15.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.334+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x7fbd0c02f030 2023-10-05T21:15:15.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.335+0000 7fbd14a85700 1 -- 172.21.15.153:0/511085022 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd08006070 con 0x7fbd0c02f030 2023-10-05T21:15:15.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.335+0000 7fbd14a85700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x55d91c840080 2023-10-05T21:15:15.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.335+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd0c019040 con 0x55d91c840080 2023-10-05T21:15:15.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.335+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x7fbd0800d8e0 2023-10-05T21:15:15.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.335+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd1000a570 con 0x7fbd0800d8e0 2023-10-05T21:15:15.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.335+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x55d91c80a100 2023-10-05T21:15:15.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.335+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.335+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844250 con 0x7fbd0c02f030 2023-10-05T21:15:15.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.336+0000 7fbd14a85700 1 -- 172.21.15.153:0/511085022 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd08006070 con 0x7fbd0c02f030 2023-10-05T21:15:15.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.336+0000 7fbd221ae680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:15.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.336+0000 7fbd221ae680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:15.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.336+0000 7fbd221ae680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:15.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.336+0000 7fbd221ae680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:15.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.336+0000 7fbd221ae680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.336+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843370 con 0x55d91c80a100 2023-10-05T21:15:15.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.336+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.336+0000 7fbd221ae680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.336+0000 7fbd221ae680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.336+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843800 con 0x55d91c80a100 2023-10-05T21:15:15.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.336+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.336+0000 7fbd221ae680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:15.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.336+0000 7fbd221ae680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.336+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843c30 con 0x55d91c80a100 2023-10-05T21:15:15.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.336+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.336+0000 7fbd221ae680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:15.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.336+0000 7fbd221ae680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.336+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844600 con 0x55d91c840080 2023-10-05T21:15:15.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.337+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fbd0c019040 con 0x55d91c840080 2023-10-05T21:15:15.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.337+0000 7fbd221ae680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.337+0000 7fbd221ae680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.337+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c8449b0 con 0x55d91c80a100 2023-10-05T21:15:15.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.337+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.337+0000 7fbd221ae680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.337+0000 7fbd221ae680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.337+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844de0 con 0x55d91c80a100 2023-10-05T21:15:15.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.337+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.337+0000 7fbd221ae680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:15.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.337+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c845df0 con 0x55d91c840080 2023-10-05T21:15:15.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.337+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd0c019040 con 0x55d91c840080 2023-10-05T21:15:15.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.337+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c845df0 con 0x7fbd0c02f030 2023-10-05T21:15:15.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.337+0000 7fbd14a85700 1 -- 172.21.15.153:0/511085022 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd08006070 con 0x7fbd0c02f030 2023-10-05T21:15:15.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.337+0000 7fbd14a85700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c845df0 con 0x7fbd0800d8e0 2023-10-05T21:15:15.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.338+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd1000a570 con 0x7fbd0800d8e0 2023-10-05T21:15:15.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.338+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843c30 con 0x55d91c80a100 2023-10-05T21:15:15.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.338+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.338+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843c30 con 0x55d91c80a100 2023-10-05T21:15:15.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.338+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.338+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843c30 con 0x7fbd0800d8e0 2023-10-05T21:15:15.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.339+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd1000a570 con 0x7fbd0800d8e0 2023-10-05T21:15:15.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.339+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843c30 con 0x7fbd0800d8e0 2023-10-05T21:15:15.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.339+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd1000a570 con 0x7fbd0800d8e0 2023-10-05T21:15:15.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.339+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843c30 con 0x7fbd0c02f030 2023-10-05T21:15:15.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.339+0000 7fbd14a85700 1 -- 172.21.15.153:0/511085022 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd08006070 con 0x7fbd0c02f030 2023-10-05T21:15:15.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.339+0000 7fbd14a85700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843c30 con 0x55d91c840080 2023-10-05T21:15:15.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.339+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fbd0c019040 con 0x55d91c840080 2023-10-05T21:15:15.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.339+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843c30 con 0x55d91c80a100 2023-10-05T21:15:15.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.339+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.339+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843c30 con 0x7fbd0800d8e0 2023-10-05T21:15:15.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.340+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd1000a570 con 0x7fbd0800d8e0 2023-10-05T21:15:15.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.340+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843c30 con 0x55d91c80a100 2023-10-05T21:15:15.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.340+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.340+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843c30 con 0x7fbd0c02f030 2023-10-05T21:15:15.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.340+0000 7fbd14a85700 1 -- 172.21.15.153:0/511085022 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd08006070 con 0x7fbd0c02f030 2023-10-05T21:15:15.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.340+0000 7fbd14a85700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843c30 con 0x55d91c840080 2023-10-05T21:15:15.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.340+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd0c019040 con 0x55d91c840080 2023-10-05T21:15:15.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.340+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843c30 con 0x55d91c840080 2023-10-05T21:15:15.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.340+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd0c019040 con 0x55d91c840080 2023-10-05T21:15:15.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.340+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843c30 con 0x7fbd0800d8e0 2023-10-05T21:15:15.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.341+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd1000a570 con 0x7fbd0800d8e0 2023-10-05T21:15:15.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.341+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843c30 con 0x55d91c840080 2023-10-05T21:15:15.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.341+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd0c019040 con 0x55d91c840080 2023-10-05T21:15:15.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.341+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843c30 con 0x55d91c840080 2023-10-05T21:15:15.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.341+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd0c019040 con 0x55d91c840080 2023-10-05T21:15:15.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.341+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843c30 con 0x55d91c80a100 2023-10-05T21:15:15.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.341+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.341+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843c30 con 0x55d91c80a100 2023-10-05T21:15:15.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.342+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.342+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843c30 con 0x7fbd0800d8e0 2023-10-05T21:15:15.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.342+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd1000a570 con 0x7fbd0800d8e0 2023-10-05T21:15:15.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.342+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843c30 con 0x55d91c840080 2023-10-05T21:15:15.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.342+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd0c019040 con 0x55d91c840080 2023-10-05T21:15:15.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.342+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843c30 con 0x7fbd0c02f030 2023-10-05T21:15:15.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.343+0000 7fbd14a85700 1 -- 172.21.15.153:0/511085022 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd08006070 con 0x7fbd0c02f030 2023-10-05T21:15:15.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.343+0000 7fbd14a85700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843c30 con 0x55d91c80a100 2023-10-05T21:15:15.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.343+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.343+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843c30 con 0x7fbd0800d8e0 2023-10-05T21:15:15.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.343+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd1000a570 con 0x7fbd0800d8e0 2023-10-05T21:15:15.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.343+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843c30 con 0x55d91c840080 2023-10-05T21:15:15.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.343+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd0c019040 con 0x55d91c840080 2023-10-05T21:15:15.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.343+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843c30 con 0x7fbd0800d8e0 2023-10-05T21:15:15.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.343+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd1000a570 con 0x7fbd0800d8e0 2023-10-05T21:15:15.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.343+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843c30 con 0x7fbd0c02f030 2023-10-05T21:15:15.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.344+0000 7fbd14a85700 1 -- 172.21.15.153:0/511085022 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd08006070 con 0x7fbd0c02f030 2023-10-05T21:15:15.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.344+0000 7fbd14a85700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843c30 con 0x55d91c840080 2023-10-05T21:15:15.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.344+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd0c019040 con 0x55d91c840080 2023-10-05T21:15:15.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.344+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843c30 con 0x7fbd0800d8e0 2023-10-05T21:15:15.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.344+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd1000a570 con 0x7fbd0800d8e0 2023-10-05T21:15:15.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.344+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843c30 con 0x55d91c80a100 2023-10-05T21:15:15.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.344+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.344+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c843c30 con 0x7fbd0c02f030 2023-10-05T21:15:15.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.345+0000 7fbd14a85700 1 -- 172.21.15.153:0/511085022 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbd08006070 con 0x7fbd0c02f030 2023-10-05T21:15:15.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.345+0000 7fbd221ae680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:15.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.345+0000 7fbd221ae680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:15.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.345+0000 7fbd221ae680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:15.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.345+0000 7fbd221ae680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:15.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.345+0000 7fbd221ae680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.345+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c844de0 con 0x55d91c80a100 2023-10-05T21:15:15.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.345+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.345+0000 7fbd221ae680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:15.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.345+0000 7fbd221ae680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.345+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c845190 con 0x55d91c840080 2023-10-05T21:15:15.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.345+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fbd0c019040 con 0x55d91c840080 2023-10-05T21:15:15.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.345+0000 7fbd221ae680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:15.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.345+0000 7fbd221ae680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.345+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c842f40 con 0x55d91c80a100 2023-10-05T21:15:15.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.345+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.345+0000 7fbd221ae680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:15.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.345+0000 7fbd221ae680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.345+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c842f40 con 0x55d91c80a100 2023-10-05T21:15:15.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.346+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.346+0000 7fbd221ae680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:15.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.346+0000 7fbd221ae680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.346+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c845a80 con 0x7fbd0800d8e0 2023-10-05T21:15:15.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.346+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fbd1000a570 con 0x7fbd0800d8e0 2023-10-05T21:15:15.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.346+0000 7fbd221ae680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.346+0000 7fbd221ae680 20 zone default found 2023-10-05T21:15:15.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.346+0000 7fbd221ae680 4 Realm: () 2023-10-05T21:15:15.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.346+0000 7fbd221ae680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:15.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.346+0000 7fbd221ae680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:15.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.346+0000 7fbd221ae680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:15.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.346+0000 7fbd221ae680 20 zonegroup default 2023-10-05T21:15:15.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.346+0000 7fbd221ae680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.346+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c845a80 con 0x7fbd0800d8e0 2023-10-05T21:15:15.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.346+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fbd1000a570 con 0x7fbd0800d8e0 2023-10-05T21:15:15.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.346+0000 7fbd221ae680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.346+0000 7fbd221ae680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.346+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c8473b0 con 0x55d91c840080 2023-10-05T21:15:15.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.346+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbd0c019040 con 0x55d91c840080 2023-10-05T21:15:15.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.346+0000 7fbd221ae680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.346+0000 7fbd221ae680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.346+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c847760 con 0x55d91c840080 2023-10-05T21:15:15.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.347+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbd0c019040 con 0x55d91c840080 2023-10-05T21:15:15.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.347+0000 7fbd221ae680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.347+0000 7fbd221ae680 20 started sync module instance, tier type = 2023-10-05T21:15:15.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.347+0000 7fbd221ae680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:15.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.347+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c846a70 con 0x7fbd0c02f030 2023-10-05T21:15:15.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.347+0000 7fbd14a85700 1 -- 172.21.15.153:0/511085022 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd08006070 con 0x7fbd0c02f030 2023-10-05T21:15:15.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.347+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94390974702976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c846fd0 con 0x7fbd0c02f030 2023-10-05T21:15:15.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.347+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c848690 con 0x55d91c80a100 2023-10-05T21:15:15.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.348+0000 7fbd14a85700 1 -- 172.21.15.153:0/511085022 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94390974702976] v29'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd08006070 con 0x7fbd0c02f030 2023-10-05T21:15:15.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.348+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.348+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94390974710080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c848a90 con 0x55d91c80a100 2023-10-05T21:15:15.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.348+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c8494a0 con 0x55d91c840080 2023-10-05T21:15:15.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.349+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd0c019040 con 0x55d91c840080 2023-10-05T21:15:15.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.349+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94390974710080] v29'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.349+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94390974708496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c8498a0 con 0x55d91c840080 2023-10-05T21:15:15.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.349+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c84a2b0 con 0x7fbd0c02f030 2023-10-05T21:15:15.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.350+0000 7fbd14a85700 1 -- 172.21.15.153:0/511085022 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd08006070 con 0x7fbd0c02f030 2023-10-05T21:15:15.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.350+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94390974717376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c84aba0 con 0x7fbd0c02f030 2023-10-05T21:15:15.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.350+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c84b5b0 con 0x55d91c80a100 2023-10-05T21:15:15.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.350+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94390974708496] v29'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd0c019040 con 0x55d91c840080 2023-10-05T21:15:15.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.350+0000 7fbd14a85700 1 -- 172.21.15.153:0/511085022 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94390974717376] v29'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd08006070 con 0x7fbd0c02f030 2023-10-05T21:15:15.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.351+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.351+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94390974713776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c84b5b0 con 0x55d91c80a100 2023-10-05T21:15:15.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.351+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c84bea0 con 0x7fbd0800d8e0 2023-10-05T21:15:15.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.351+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94390974713776] v29'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.351+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd1000a570 con 0x7fbd0800d8e0 2023-10-05T21:15:15.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.352+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94390974725088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c84b5b0 con 0x7fbd0800d8e0 2023-10-05T21:15:15.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.352+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c84c900 con 0x7fbd0800d8e0 2023-10-05T21:15:15.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.352+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(96 notify.6 [create] v29'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd1000a570 con 0x7fbd0800d8e0 2023-10-05T21:15:15.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.352+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94390974727184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c84cd90 con 0x7fbd0800d8e0 2023-10-05T21:15:15.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.352+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c84d960 con 0x7fbd0800d8e0 2023-10-05T21:15:15.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.352+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(95 notify.5 [watch watch cookie 94390974725088] v29'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd1000a570 con 0x7fbd0800d8e0 2023-10-05T21:15:15.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.353+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94390974727184] v29'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd1000a570 con 0x7fbd0800d8e0 2023-10-05T21:15:15.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.353+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd1000a570 con 0x7fbd0800d8e0 2023-10-05T21:15:15.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.353+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94390974731248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c84d920 con 0x7fbd0800d8e0 2023-10-05T21:15:15.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.353+0000 7fbd221ae680 20 add_watcher() i=0 2023-10-05T21:15:15.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.353+0000 7fbd221ae680 20 add_watcher() i=1 2023-10-05T21:15:15.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.353+0000 7fbd221ae680 20 add_watcher() i=2 2023-10-05T21:15:15.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.353+0000 7fbd221ae680 20 add_watcher() i=3 2023-10-05T21:15:15.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.353+0000 7fbd221ae680 20 add_watcher() i=4 2023-10-05T21:15:15.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.353+0000 7fbd221ae680 20 add_watcher() i=5 2023-10-05T21:15:15.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.353+0000 7fbd221ae680 20 add_watcher() i=6 2023-10-05T21:15:15.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.354+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94390974731248] v29'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd1000a570 con 0x7fbd0800d8e0 2023-10-05T21:15:15.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.354+0000 7fbd221ae680 20 add_watcher() i=7 2023-10-05T21:15:15.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.354+0000 7fbd221ae680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:15.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.354+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c84c860 con 0x55d91c80a100 2023-10-05T21:15:15.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.354+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.354+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94390974722240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c84c860 con 0x55d91c80a100 2023-10-05T21:15:15.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.355+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94390974722240] v29'88 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.355+0000 7fbce67e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:15.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.355+0000 7fbd221ae680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:15.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.355+0000 7fbd221ae680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:15.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.355+0000 7fbd221ae680 1 Processor -- start 2023-10-05T21:15:15.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.355+0000 7fbd221ae680 1 -- start start 2023-10-05T21:15:15.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.355+0000 7fbd221ae680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c80be40 0x55d91c80c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.355+0000 7fbd221ae680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d91c80c790 con 0x55d91c80be40 2023-10-05T21:15:15.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.355+0000 7fbd14a85700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c80be40 0x55d91c80c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.355+0000 7fbd14a85700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c80be40 0x55d91c80c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50204/0 (socket says 172.21.15.153:50204) 2023-10-05T21:15:15.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.355+0000 7fbd14a85700 1 -- 172.21.15.153:0/2590198154 learned_addr learned my addr 172.21.15.153:0/2590198154 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:15.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.356+0000 7fbd14a85700 1 -- 172.21.15.153:0/2590198154 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d91c80a6c0 con 0x55d91c80be40 2023-10-05T21:15:15.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.356+0000 7fbd14a85700 1 --2- 172.21.15.153:0/2590198154 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c80be40 0x55d91c80c250 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbd08000fb0 tx=0x7fbd08006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd30e24af3f13e0e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.356+0000 7fbce5fe3700 1 -- 172.21.15.153:0/2590198154 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd08023040 con 0x55d91c80be40 2023-10-05T21:15:15.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.356+0000 7fbce5fe3700 1 -- 172.21.15.153:0/2590198154 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd08024040 con 0x55d91c80be40 2023-10-05T21:15:15.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.356+0000 7fbce5fe3700 1 -- 172.21.15.153:0/2590198154 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd08013040 con 0x55d91c80be40 2023-10-05T21:15:15.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.357+0000 7fbd221ae680 1 -- 172.21.15.153:0/2590198154 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c80be40 msgr2=0x55d91c80c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.357+0000 7fbd221ae680 1 --2- 172.21.15.153:0/2590198154 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c80be40 0x55d91c80c250 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbd08000fb0 tx=0x7fbd08006000 comp rx=0 tx=0).stop 2023-10-05T21:15:15.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.357+0000 7fbd221ae680 1 -- 172.21.15.153:0/2590198154 shutdown_connections 2023-10-05T21:15:15.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.357+0000 7fbd221ae680 1 --2- 172.21.15.153:0/2590198154 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c80be40 0x55d91c80c250 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.357+0000 7fbd221ae680 1 -- 172.21.15.153:0/2590198154 >> 172.21.15.153:0/2590198154 conn(0x55d91c8563c0 msgr2=0x55d91c854520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:15.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.357+0000 7fbd221ae680 1 -- 172.21.15.153:0/2590198154 shutdown_connections 2023-10-05T21:15:15.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.357+0000 7fbd221ae680 1 -- 172.21.15.153:0/2590198154 wait complete. 2023-10-05T21:15:15.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.357+0000 7fbd221ae680 1 Processor -- start 2023-10-05T21:15:15.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.357+0000 7fbd221ae680 1 -- start start 2023-10-05T21:15:15.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.357+0000 7fbd221ae680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c80be40 0x55d91c862fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.357+0000 7fbd221ae680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d91c863520 con 0x55d91c80be40 2023-10-05T21:15:15.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.357+0000 7fbd14a85700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c80be40 0x55d91c862fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.357+0000 7fbd14a85700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c80be40 0x55d91c862fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50210/0 (socket says 172.21.15.153:50210) 2023-10-05T21:15:15.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.357+0000 7fbd14a85700 1 -- 172.21.15.153:0/265591729 learned_addr learned my addr 172.21.15.153:0/265591729 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:15.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.358+0000 7fbd14a85700 1 -- 172.21.15.153:0/265591729 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0800ed60 con 0x55d91c80be40 2023-10-05T21:15:15.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.358+0000 7fbd14a85700 1 --2- 172.21.15.153:0/265591729 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c80be40 0x55d91c862fe0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbd0800efd0 tx=0x7fbd08030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.358+0000 7fbc57fff700 1 -- 172.21.15.153:0/265591729 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd08023040 con 0x55d91c80be40 2023-10-05T21:15:15.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.358+0000 7fbc57fff700 1 -- 172.21.15.153:0/265591729 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0803b5d0 con 0x55d91c80be40 2023-10-05T21:15:15.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.358+0000 7fbd221ae680 1 -- 172.21.15.153:0/265591729 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d91c863720 con 0x55d91c80be40 2023-10-05T21:15:15.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.358+0000 7fbc57fff700 1 -- 172.21.15.153:0/265591729 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd0803b760 con 0x55d91c80be40 2023-10-05T21:15:15.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.358+0000 7fbd221ae680 1 -- 172.21.15.153:0/265591729 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d91c863b70 con 0x55d91c80be40 2023-10-05T21:15:15.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.359+0000 7fbc57fff700 1 -- 172.21.15.153:0/265591729 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fbd0803b8c0 con 0x55d91c80be40 2023-10-05T21:15:15.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.359+0000 7fbc57fff700 1 --2- 172.21.15.153:0/265591729 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbc5c034140 0x7fbc5c0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.359+0000 7fbc57fff700 1 -- 172.21.15.153:0/265591729 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fbd0804eb00 con 0x55d91c80be40 2023-10-05T21:15:15.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.359+0000 7fbd15a87700 1 --2- 172.21.15.153:0/265591729 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbc5c034140 0x7fbc5c0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.359+0000 7fbd221ae680 5 note: GC not initialized 2023-10-05T21:15:15.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.359+0000 7fbd15a87700 1 --2- 172.21.15.153:0/265591729 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbc5c034140 0x7fbc5c0365f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x55d91c84daf0 tx=0x7fbd1000af50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.360+0000 7fbc557fa700 20 reqs_thread_entry: start 2023-10-05T21:15:15.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.360+0000 7fbc4effd700 20 reqs_thread_entry: start 2023-10-05T21:15:15.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.360+0000 7fbd221ae680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:15.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.360+0000 7fbd221ae680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:15.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.360+0000 7fbc4d7fa700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:45 2023 2023-10-05T21:15:15.391 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:15.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.360+0000 7fbc4cff9700 20 reqs_thread_entry: start 2023-10-05T21:15:15.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.360+0000 7fbd221ae680 20 get_system_obj_state: rctx=0x7ffdf4e26998 obj=default.rgw.meta:users.uid:foo state=0x55d91c77e330 s->prefetch_data=0 2023-10-05T21:15:15.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.360+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c8c88c0 con 0x55d91c80a100 2023-10-05T21:15:15.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.361+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.361+0000 7fbd221ae680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:15.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.361+0000 7fbd221ae680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:15.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.361+0000 7fbd221ae680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.361+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c8cab50 con 0x55d91c80a100 2023-10-05T21:15:15.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.361+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.361+0000 7fbd221ae680 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T21:15:15.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.361+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:104 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c8cab50 con 0x7fbd0c02f030 2023-10-05T21:15:15.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.361+0000 7fbd14a85700 1 -- 172.21.15.153:0/511085022 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(104 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7fbd08006070 con 0x7fbd0c02f030 2023-10-05T21:15:15.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.362+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94390974702976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c8870b0 con 0x7fbd0c02f030 2023-10-05T21:15:15.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.362+0000 7fbd14a85700 1 -- 172.21.15.153:0/511085022 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(105 notify.0 [watch unwatch cookie 94390974702976] v29'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd08006070 con 0x7fbd0c02f030 2023-10-05T21:15:15.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.362+0000 7fbd221ae680 20 remove_watcher() i=0 2023-10-05T21:15:15.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.363+0000 7fbd221ae680 2 removed watcher, disabling cache 2023-10-05T21:15:15.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.363+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94390974710080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c846580 con 0x55d91c80a100 2023-10-05T21:15:15.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.364+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(106 notify.1 [watch unwatch cookie 94390974710080] v29'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.364+0000 7fbd221ae680 20 remove_watcher() i=1 2023-10-05T21:15:15.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.364+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94390974708496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c848140 con 0x55d91c840080 2023-10-05T21:15:15.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.364+0000 7fbd15286700 1 -- 172.21.15.153:0/511085022 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(107 notify.2 [watch unwatch cookie 94390974708496] v29'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd0c019040 con 0x55d91c840080 2023-10-05T21:15:15.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.364+0000 7fbd221ae680 20 remove_watcher() i=2 2023-10-05T21:15:15.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.364+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94390974717376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c848140 con 0x7fbd0c02f030 2023-10-05T21:15:15.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.365+0000 7fbd14a85700 1 -- 172.21.15.153:0/511085022 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(108 notify.3 [watch unwatch cookie 94390974717376] v29'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd08006070 con 0x7fbd0c02f030 2023-10-05T21:15:15.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.365+0000 7fbd221ae680 20 remove_watcher() i=3 2023-10-05T21:15:15.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.365+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94390974713776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c849dc0 con 0x55d91c80a100 2023-10-05T21:15:15.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.366+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(109 notify.4 [watch unwatch cookie 94390974713776] v29'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.366+0000 7fbd221ae680 20 remove_watcher() i=4 2023-10-05T21:15:15.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.366+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94390974725088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c848140 con 0x7fbd0800d8e0 2023-10-05T21:15:15.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.366+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(110 notify.5 [watch unwatch cookie 94390974725088] v29'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd1000a570 con 0x7fbd0800d8e0 2023-10-05T21:15:15.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.367+0000 7fbd221ae680 20 remove_watcher() i=5 2023-10-05T21:15:15.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.367+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:111 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94390974727184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c84bbe0 con 0x7fbd0800d8e0 2023-10-05T21:15:15.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.367+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(111 notify.6 [watch unwatch cookie 94390974727184] v29'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd1000a570 con 0x7fbd0800d8e0 2023-10-05T21:15:15.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.367+0000 7fbd221ae680 20 remove_watcher() i=6 2023-10-05T21:15:15.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.367+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94390974731248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c84c410 con 0x7fbd0800d8e0 2023-10-05T21:15:15.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.368+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(112 notify.7 [watch unwatch cookie 94390974731248] v29'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbd1000a570 con 0x7fbd0800d8e0 2023-10-05T21:15:15.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.368+0000 7fbd221ae680 20 remove_watcher() i=7 2023-10-05T21:15:15.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.369+0000 7fbce67e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:15.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.369+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:113 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94390974722240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d91c84bbe0 con 0x55d91c80a100 2023-10-05T21:15:15.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.369+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(113 data_loggenerations_metadata [watch unwatch cookie 94390974722240] v29'89 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbd1000a570 con 0x55d91c80a100 2023-10-05T21:15:15.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.369+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fbd0800d8e0 msgr2=0x7fbd0800c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.369+0000 7fbd221ae680 1 --2- 172.21.15.153:0/511085022 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fbd0800d8e0 0x7fbd0800c360 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.369+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d91c80a100 msgr2=0x55d91c83da50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.369+0000 7fbd221ae680 1 --2- 172.21.15.153:0/511085022 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d91c80a100 0x55d91c83da50 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.369+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fbd0c02f030 msgr2=0x7fbd0c0373e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.369+0000 7fbd221ae680 1 --2- 172.21.15.153:0/511085022 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fbd0c02f030 0x7fbd0c0373e0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.369+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d91c840080 msgr2=0x55d91c842460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.369+0000 7fbd221ae680 1 --2- 172.21.15.153:0/511085022 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d91c840080 0x55d91c842460 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.369+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbcf8034140 msgr2=0x7fbcf80365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.369+0000 7fbd221ae680 1 --2- 172.21.15.153:0/511085022 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbcf8034140 0x7fbcf80365f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbd080011e0 tx=0x7fbd08001340 comp rx=0 tx=0).stop 2023-10-05T21:15:15.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.370+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c8097b0 msgr2=0x55d91c831c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.370+0000 7fbd15a87700 1 -- 172.21.15.153:0/511085022 reap_dead start 2023-10-05T21:15:15.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.370+0000 7fbd221ae680 1 --2- 172.21.15.153:0/511085022 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c8097b0 0x55d91c831c90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00afd0 tx=0x7fbd0c01d000 comp rx=0 tx=0).stop 2023-10-05T21:15:15.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.370+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 shutdown_connections 2023-10-05T21:15:15.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.370+0000 7fbd221ae680 1 --2- 172.21.15.153:0/511085022 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c8097b0 0x55d91c831c90 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.370+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 >> 172.21.15.153:0/511085022 conn(0x55d91c805300 msgr2=0x55d91c824b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:15.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.370+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 shutdown_connections 2023-10-05T21:15:15.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.370+0000 7fbd221ae680 1 -- 172.21.15.153:0/511085022 wait complete. 2023-10-05T21:15:15.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.370+0000 7fbd221ae680 1 -- 172.21.15.153:0/265591729 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbc5c034140 msgr2=0x7fbc5c0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.370+0000 7fbd221ae680 1 --2- 172.21.15.153:0/265591729 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbc5c034140 0x7fbc5c0365f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x55d91c84daf0 tx=0x7fbd1000af50 comp rx=0 tx=0).stop 2023-10-05T21:15:15.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.370+0000 7fbd221ae680 1 -- 172.21.15.153:0/265591729 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c80be40 msgr2=0x55d91c862fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.370+0000 7fbd221ae680 1 --2- 172.21.15.153:0/265591729 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c80be40 0x55d91c862fe0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbd0800efd0 tx=0x7fbd08030000 comp rx=0 tx=0).stop 2023-10-05T21:15:15.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.370+0000 7fbd221ae680 1 -- 172.21.15.153:0/265591729 shutdown_connections 2023-10-05T21:15:15.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.370+0000 7fbd221ae680 1 --2- 172.21.15.153:0/265591729 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbc5c034140 0x7fbc5c0365f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.370+0000 7fbd221ae680 1 --2- 172.21.15.153:0/265591729 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d91c80be40 0x55d91c862fe0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.370+0000 7fbd221ae680 1 -- 172.21.15.153:0/265591729 >> 172.21.15.153:0/265591729 conn(0x55d91c8563c0 msgr2=0x55d91c8544f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:15.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.370+0000 7fbd221ae680 1 -- 172.21.15.153:0/265591729 shutdown_connections 2023-10-05T21:15:15.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.370+0000 7fbd221ae680 1 -- 172.21.15.153:0/265591729 wait complete. 2023-10-05T21:15:15.398 INFO:teuthology.orchestra.run.smithi153.stdout:[] 2023-10-05T21:15:15.398 DEBUG:tasks.util.rgw: json result: [] 2023-10-05T21:15:15.398 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2023-10-05T21:15:15.398 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2023-10-05T21:15:15.398 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2023-10-05T21:15:15.443 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:15.443 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:15.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.442+0000 7fc0ba0be680 1 Processor -- start 2023-10-05T21:15:15.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.442+0000 7fc0ba0be680 1 -- start start 2023-10-05T21:15:15.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.442+0000 7fc0ba0be680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55e526f5dbe0 0x55e526f5ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.442+0000 7fc0ba0be680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e526ea6990 con 0x55e526f577b0 2023-10-05T21:15:15.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.442+0000 7fc0ba0be680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e526e66db0 con 0x55e526f5dbe0 2023-10-05T21:15:15.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.442+0000 7fc0ac995700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55e526f5dbe0 0x55e526f5ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.442+0000 7fc0ad196700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55e526f577b0 0x55e526f57bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56364/0 (socket says 172.21.15.153:56364) 2023-10-05T21:15:15.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.442+0000 7fc0ad196700 1 -- 172.21.15.153:0/3772604684 learned_addr learned my addr 172.21.15.153:0/3772604684 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:15.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.442+0000 7fc09ffff700 1 -- 172.21.15.153:0/3772604684 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1168363661 0 0) 0x55e526ea6990 con 0x55e526f577b0 2023-10-05T21:15:15.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.442+0000 7fc09ffff700 1 -- 172.21.15.153:0/3772604684 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc098001e10 con 0x55e526f577b0 2023-10-05T21:15:15.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.442+0000 7fc0ac995700 1 -- 172.21.15.153:0/3772604684 >> v1:172.21.15.111:6789/0 conn(0x55e526f577b0 legacy=0x55e526f57bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.442+0000 7fc0ac995700 1 -- 172.21.15.153:0/3772604684 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e526f61510 con 0x55e526f5dbe0 2023-10-05T21:15:15.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.443+0000 7fc0ac995700 1 --2- 172.21.15.153:0/3772604684 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f5dbe0 0x55e526f5ffc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400a5d0 tx=0x7fc0a4005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91e3df35c743d8d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.443+0000 7fc09ffff700 1 -- 172.21.15.153:0/3772604684 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0a4007610 con 0x55e526f5dbe0 2023-10-05T21:15:15.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.443+0000 7fc09ffff700 1 -- 172.21.15.153:0/3772604684 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a4007770 con 0x55e526f5dbe0 2023-10-05T21:15:15.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.443+0000 7fc09ffff700 1 -- 172.21.15.153:0/3772604684 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0a4007a40 con 0x55e526f5dbe0 2023-10-05T21:15:15.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.443+0000 7fc0ba0be680 1 -- 172.21.15.153:0/3772604684 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f5dbe0 msgr2=0x55e526f5ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.443+0000 7fc0ba0be680 1 --2- 172.21.15.153:0/3772604684 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f5dbe0 0x55e526f5ffc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400a5d0 tx=0x7fc0a4005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:15.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.443+0000 7fc0ba0be680 1 -- 172.21.15.153:0/3772604684 shutdown_connections 2023-10-05T21:15:15.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.443+0000 7fc0ba0be680 1 --2- 172.21.15.153:0/3772604684 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f5dbe0 0x55e526f5ffc0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.443+0000 7fc0ba0be680 1 -- 172.21.15.153:0/3772604684 >> 172.21.15.153:0/3772604684 conn(0x55e526f53300 msgr2=0x55e526f55710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:15.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.443+0000 7fc0ba0be680 1 -- 172.21.15.153:0/3772604684 shutdown_connections 2023-10-05T21:15:15.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.443+0000 7fc0ba0be680 1 -- 172.21.15.153:0/3772604684 wait complete. 2023-10-05T21:15:15.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.444+0000 7fc0ba0be680 1 Processor -- start 2023-10-05T21:15:15.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.444+0000 7fc0ba0be680 1 -- start start 2023-10-05T21:15:15.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.444+0000 7fc0ba0be680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f577b0 0x55e526f788c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.444+0000 7fc0ba0be680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e526e06ea0 con 0x55e526f577b0 2023-10-05T21:15:15.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.444+0000 7fc0ad196700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f577b0 0x55e526f788c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.444+0000 7fc0ad196700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f577b0 0x55e526f788c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50222/0 (socket says 172.21.15.153:50222) 2023-10-05T21:15:15.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.444+0000 7fc0ad196700 1 -- 172.21.15.153:0/1553637716 learned_addr learned my addr 172.21.15.153:0/1553637716 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:15.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.445+0000 7fc0ad196700 1 -- 172.21.15.153:0/1553637716 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a4005cf0 con 0x55e526f577b0 2023-10-05T21:15:15.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.445+0000 7fc0ad196700 1 --2- 172.21.15.153:0/1553637716 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f577b0 0x55e526f788c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0001c70 tx=0x7fc0a0001820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdda30c7a80b93cf server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.445+0000 7fc09effd700 1 -- 172.21.15.153:0/1553637716 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0a000bbf0 con 0x55e526f577b0 2023-10-05T21:15:15.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.445+0000 7fc09effd700 1 -- 172.21.15.153:0/1553637716 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a000bd70 con 0x55e526f577b0 2023-10-05T21:15:15.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.445+0000 7fc09effd700 1 -- 172.21.15.153:0/1553637716 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0a000e5f0 con 0x55e526f577b0 2023-10-05T21:15:15.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.445+0000 7fc0ba0be680 1 -- 172.21.15.153:0/1553637716 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f577b0 msgr2=0x55e526f788c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.445+0000 7fc0ba0be680 1 --2- 172.21.15.153:0/1553637716 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f577b0 0x55e526f788c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0001c70 tx=0x7fc0a0001820 comp rx=0 tx=0).stop 2023-10-05T21:15:15.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.445+0000 7fc0ba0be680 1 -- 172.21.15.153:0/1553637716 shutdown_connections 2023-10-05T21:15:15.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.445+0000 7fc0ba0be680 1 --2- 172.21.15.153:0/1553637716 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f577b0 0x55e526f788c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.445+0000 7fc0ba0be680 1 -- 172.21.15.153:0/1553637716 >> 172.21.15.153:0/1553637716 conn(0x55e526f53300 msgr2=0x55e526f74390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:15.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.445+0000 7fc0ba0be680 1 -- 172.21.15.153:0/1553637716 shutdown_connections 2023-10-05T21:15:15.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.446+0000 7fc0ba0be680 1 -- 172.21.15.153:0/1553637716 wait complete. 2023-10-05T21:15:15.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.446+0000 7fc0ba0be680 1 Processor -- start 2023-10-05T21:15:15.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.446+0000 7fc0ba0be680 1 -- start start 2023-10-05T21:15:15.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.446+0000 7fc0ba0be680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f577b0 0x55e526f7fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.446+0000 7fc0ba0be680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e526dfdc80 con 0x55e526f577b0 2023-10-05T21:15:15.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.446+0000 7fc0ad196700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f577b0 0x55e526f7fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.446+0000 7fc0ad196700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f577b0 0x55e526f7fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50234/0 (socket says 172.21.15.153:50234) 2023-10-05T21:15:15.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.446+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 learned_addr learned my addr 172.21.15.153:0/417704723 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:15.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.446+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc098001e10 con 0x55e526f577b0 2023-10-05T21:15:15.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.447+0000 7fc0ad196700 1 --2- 172.21.15.153:0/417704723 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f577b0 0x55e526f7fdc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0010000 tx=0x7fc0a0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.447+0000 7fc09d7fa700 1 -- 172.21.15.153:0/417704723 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0a001f070 con 0x55e526f577b0 2023-10-05T21:15:15.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.447+0000 7fc09d7fa700 1 -- 172.21.15.153:0/417704723 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a0018640 con 0x55e526f577b0 2023-10-05T21:15:15.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.447+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e526f80300 con 0x55e526f577b0 2023-10-05T21:15:15.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.447+0000 7fc09d7fa700 1 -- 172.21.15.153:0/417704723 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0a0018910 con 0x55e526f577b0 2023-10-05T21:15:15.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.447+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e526f80750 con 0x55e526f577b0 2023-10-05T21:15:15.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.448+0000 7fc09d7fa700 1 -- 172.21.15.153:0/417704723 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fc0a0018a70 con 0x55e526f577b0 2023-10-05T21:15:15.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.448+0000 7fc0ba0be680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.448+0000 7fc09d7fa700 1 --2- 172.21.15.153:0/417704723 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc090034140 0x7fc0900365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.448+0000 7fc09d7fa700 1 -- 172.21.15.153:0/417704723 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fc0a0048dc0 con 0x55e526f577b0 2023-10-05T21:15:15.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.448+0000 7fc0ac995700 1 --2- 172.21.15.153:0/417704723 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc090034140 0x7fc0900365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.448+0000 7fc0ba0be680 1 --2- 172.21.15.153:0/417704723 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55e526f5dbe0 0x55e526f8bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.448+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f8c270 con 0x55e526f5dbe0 2023-10-05T21:15:15.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.448+0000 7fc0ad997700 1 --2- 172.21.15.153:0/417704723 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55e526f5dbe0 0x55e526f8bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.448+0000 7fc0ac995700 1 --2- 172.21.15.153:0/417704723 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc090034140 0x7fc0900365f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400afd0 tx=0x7fc0a4014000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.449+0000 7fc0ad997700 1 --2- 172.21.15.153:0/417704723 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55e526f5dbe0 0x55e526f8bae0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.449+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.449+0000 7fc0ba0be680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.449+0000 7fc0ba0be680 20 realm 2023-10-05T21:15:15.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.449+0000 7fc0ba0be680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.449+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f89100 con 0x55e526f5dbe0 2023-10-05T21:15:15.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.449+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.449+0000 7fc0ba0be680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.449+0000 7fc0ba0be680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:15.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.449+0000 7fc0ba0be680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.449+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f8cd70 con 0x55e526f5dbe0 2023-10-05T21:15:15.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.449+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.449+0000 7fc0ba0be680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.449+0000 7fc0ba0be680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.449+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f8d690 con 0x55e526f5dbe0 2023-10-05T21:15:15.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.450+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.450+0000 7fc0ba0be680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:15.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.450+0000 7fc0ba0be680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.450+0000 7fc0ba0be680 1 --2- 172.21.15.153:0/417704723 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55e526f8df50 0x55e526f90330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.450+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f90900 con 0x55e526f8df50 2023-10-05T21:15:15.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.450+0000 7fc0ad196700 1 --2- 172.21.15.153:0/417704723 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55e526f8df50 0x55e526f90330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.450+0000 7fc0ad196700 1 --2- 172.21.15.153:0/417704723 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55e526f8df50 0x55e526f90330 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.450+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc0a0014070 con 0x55e526f8df50 2023-10-05T21:15:15.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.450+0000 7fc0ba0be680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:15.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.450+0000 7fc0ba0be680 20 searching for the correct realm 2023-10-05T21:15:15.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.450+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x55e526f8df50 2023-10-05T21:15:15.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.450+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a0014070 con 0x55e526f8df50 2023-10-05T21:15:15.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.450+0000 7fc0ad196700 1 --2- 172.21.15.153:0/417704723 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc0a0016730 0x7fc0a0041670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.450+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x7fc0a0016730 2023-10-05T21:15:15.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.451+0000 7fc0ac995700 1 --2- 172.21.15.153:0/417704723 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc0a0016730 0x7fc0a0041670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.451+0000 7fc0ac995700 1 --2- 172.21.15.153:0/417704723 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc0a0016730 0x7fc0a0041670 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.451+0000 7fc0ac995700 1 -- 172.21.15.153:0/417704723 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a4007ce0 con 0x7fc0a0016730 2023-10-05T21:15:15.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.451+0000 7fc0ac995700 1 --2- 172.21.15.153:0/417704723 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc0a4007030 0x7fc0a401d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.451+0000 7fc0ac995700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x7fc0a4007030 2023-10-05T21:15:15.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.451+0000 7fc0ad997700 1 --2- 172.21.15.153:0/417704723 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc0a4007030 0x7fc0a401d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.452+0000 7fc0ad997700 1 --2- 172.21.15.153:0/417704723 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc0a4007030 0x7fc0a401d430 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.452+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a800a570 con 0x7fc0a4007030 2023-10-05T21:15:15.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.452+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x55e526f5dbe0 2023-10-05T21:15:15.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.452+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.452+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x55e526f5dbe0 2023-10-05T21:15:15.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.452+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.452+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x7fc0a4007030 2023-10-05T21:15:15.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.452+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a800a570 con 0x7fc0a4007030 2023-10-05T21:15:15.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.452+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x7fc0a4007030 2023-10-05T21:15:15.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.453+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a800a570 con 0x7fc0a4007030 2023-10-05T21:15:15.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.453+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x7fc0a0016730 2023-10-05T21:15:15.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.453+0000 7fc0ac995700 1 -- 172.21.15.153:0/417704723 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a4029040 con 0x7fc0a0016730 2023-10-05T21:15:15.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.453+0000 7fc0ac995700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x55e526f8df50 2023-10-05T21:15:15.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.453+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc0a0014070 con 0x55e526f8df50 2023-10-05T21:15:15.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.453+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x55e526f5dbe0 2023-10-05T21:15:15.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.453+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.453+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x7fc0a4007030 2023-10-05T21:15:15.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.454+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a800a570 con 0x7fc0a4007030 2023-10-05T21:15:15.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.454+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x55e526f5dbe0 2023-10-05T21:15:15.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.454+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.454+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x7fc0a0016730 2023-10-05T21:15:15.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.454+0000 7fc0ac995700 1 -- 172.21.15.153:0/417704723 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a4029040 con 0x7fc0a0016730 2023-10-05T21:15:15.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.454+0000 7fc0ac995700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x55e526f8df50 2023-10-05T21:15:15.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.454+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a0014070 con 0x55e526f8df50 2023-10-05T21:15:15.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.454+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x55e526f8df50 2023-10-05T21:15:15.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.454+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a0014070 con 0x55e526f8df50 2023-10-05T21:15:15.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.454+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x7fc0a4007030 2023-10-05T21:15:15.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.455+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a800a570 con 0x7fc0a4007030 2023-10-05T21:15:15.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.455+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x55e526f8df50 2023-10-05T21:15:15.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.455+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a0014070 con 0x55e526f8df50 2023-10-05T21:15:15.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.455+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x55e526f8df50 2023-10-05T21:15:15.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.455+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a0014070 con 0x55e526f8df50 2023-10-05T21:15:15.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.455+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x55e526f5dbe0 2023-10-05T21:15:15.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.456+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.456+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x55e526f5dbe0 2023-10-05T21:15:15.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.456+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.456+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x7fc0a4007030 2023-10-05T21:15:15.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.456+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a800a570 con 0x7fc0a4007030 2023-10-05T21:15:15.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.456+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x55e526f8df50 2023-10-05T21:15:15.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.456+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a0014070 con 0x55e526f8df50 2023-10-05T21:15:15.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.456+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x7fc0a0016730 2023-10-05T21:15:15.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.456+0000 7fc0ac995700 1 -- 172.21.15.153:0/417704723 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a4029040 con 0x7fc0a0016730 2023-10-05T21:15:15.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.456+0000 7fc0ac995700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x55e526f5dbe0 2023-10-05T21:15:15.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.457+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.457+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x7fc0a4007030 2023-10-05T21:15:15.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.457+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a800a570 con 0x7fc0a4007030 2023-10-05T21:15:15.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.457+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x55e526f8df50 2023-10-05T21:15:15.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.457+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a0014070 con 0x55e526f8df50 2023-10-05T21:15:15.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.457+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x7fc0a4007030 2023-10-05T21:15:15.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.457+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a800a570 con 0x7fc0a4007030 2023-10-05T21:15:15.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.457+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x7fc0a0016730 2023-10-05T21:15:15.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.458+0000 7fc0ac995700 1 -- 172.21.15.153:0/417704723 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a4029040 con 0x7fc0a0016730 2023-10-05T21:15:15.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.458+0000 7fc0ac995700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x55e526f8df50 2023-10-05T21:15:15.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.458+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a0014070 con 0x55e526f8df50 2023-10-05T21:15:15.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.458+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x7fc0a4007030 2023-10-05T21:15:15.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.458+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a800a570 con 0x7fc0a4007030 2023-10-05T21:15:15.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.458+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x55e526f5dbe0 2023-10-05T21:15:15.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.458+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.458+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92220 con 0x7fc0a0016730 2023-10-05T21:15:15.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.458+0000 7fc0ac995700 1 -- 172.21.15.153:0/417704723 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a4029040 con 0x7fc0a0016730 2023-10-05T21:15:15.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.458+0000 7fc0ba0be680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:15.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.459+0000 7fc0ba0be680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:15.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.459+0000 7fc0ba0be680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:15.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.459+0000 7fc0ba0be680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:15.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.459+0000 7fc0ba0be680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.459+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f91390 con 0x55e526f5dbe0 2023-10-05T21:15:15.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.459+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.459+0000 7fc0ba0be680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.459+0000 7fc0ba0be680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.459+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f91820 con 0x55e526f5dbe0 2023-10-05T21:15:15.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.459+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.459+0000 7fc0ba0be680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:15.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.459+0000 7fc0ba0be680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.459+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f91c50 con 0x55e526f5dbe0 2023-10-05T21:15:15.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.459+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.459+0000 7fc0ba0be680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:15.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.459+0000 7fc0ba0be680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.459+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f925d0 con 0x55e526f8df50 2023-10-05T21:15:15.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.459+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fc0a0014070 con 0x55e526f8df50 2023-10-05T21:15:15.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.459+0000 7fc0ba0be680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.459+0000 7fc0ba0be680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.459+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f90ed0 con 0x55e526f5dbe0 2023-10-05T21:15:15.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.460+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.460+0000 7fc0ba0be680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.460+0000 7fc0ba0be680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.460+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92ec0 con 0x55e526f5dbe0 2023-10-05T21:15:15.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.460+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.460+0000 7fc0ba0be680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:15.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.460+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f93ed0 con 0x55e526f8df50 2023-10-05T21:15:15.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.460+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a0014070 con 0x55e526f8df50 2023-10-05T21:15:15.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.460+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f93ed0 con 0x7fc0a0016730 2023-10-05T21:15:15.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.460+0000 7fc0ac995700 1 -- 172.21.15.153:0/417704723 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a4029040 con 0x7fc0a0016730 2023-10-05T21:15:15.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.460+0000 7fc0ac995700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f93ed0 con 0x7fc0a4007030 2023-10-05T21:15:15.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.461+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a800a570 con 0x7fc0a4007030 2023-10-05T21:15:15.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.461+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f91c50 con 0x55e526f5dbe0 2023-10-05T21:15:15.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.461+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.461+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f91c50 con 0x55e526f5dbe0 2023-10-05T21:15:15.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.461+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.461+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f91c50 con 0x7fc0a4007030 2023-10-05T21:15:15.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.462+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a800a570 con 0x7fc0a4007030 2023-10-05T21:15:15.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.462+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f91c50 con 0x7fc0a4007030 2023-10-05T21:15:15.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.462+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a800a570 con 0x7fc0a4007030 2023-10-05T21:15:15.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.462+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f91c50 con 0x7fc0a0016730 2023-10-05T21:15:15.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.462+0000 7fc0ac995700 1 -- 172.21.15.153:0/417704723 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a4029040 con 0x7fc0a0016730 2023-10-05T21:15:15.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.462+0000 7fc0ac995700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f91c50 con 0x55e526f8df50 2023-10-05T21:15:15.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.462+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc0a0014070 con 0x55e526f8df50 2023-10-05T21:15:15.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.462+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f91c50 con 0x55e526f5dbe0 2023-10-05T21:15:15.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.463+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.463+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f91c50 con 0x7fc0a4007030 2023-10-05T21:15:15.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.463+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a800a570 con 0x7fc0a4007030 2023-10-05T21:15:15.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.463+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f91c50 con 0x55e526f5dbe0 2023-10-05T21:15:15.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.463+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.463+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f91c50 con 0x7fc0a0016730 2023-10-05T21:15:15.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.463+0000 7fc0ac995700 1 -- 172.21.15.153:0/417704723 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a4029040 con 0x7fc0a0016730 2023-10-05T21:15:15.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.463+0000 7fc0ac995700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f91c50 con 0x55e526f8df50 2023-10-05T21:15:15.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.463+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a0014070 con 0x55e526f8df50 2023-10-05T21:15:15.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.463+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f91c50 con 0x55e526f8df50 2023-10-05T21:15:15.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.464+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a0014070 con 0x55e526f8df50 2023-10-05T21:15:15.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.464+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f91c50 con 0x7fc0a4007030 2023-10-05T21:15:15.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.464+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a800a570 con 0x7fc0a4007030 2023-10-05T21:15:15.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.464+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f91c50 con 0x55e526f8df50 2023-10-05T21:15:15.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.464+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a0014070 con 0x55e526f8df50 2023-10-05T21:15:15.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.464+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc0a0050040 con 0x55e526f8df50 2023-10-05T21:15:15.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.464+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a0014070 con 0x55e526f8df50 2023-10-05T21:15:15.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.464+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc0a0050040 con 0x55e526f5dbe0 2023-10-05T21:15:15.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.464+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.464+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc0a0050040 con 0x55e526f5dbe0 2023-10-05T21:15:15.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.465+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.465+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc0a0050040 con 0x7fc0a4007030 2023-10-05T21:15:15.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.465+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a800a570 con 0x7fc0a4007030 2023-10-05T21:15:15.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.465+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc0a0050040 con 0x55e526f8df50 2023-10-05T21:15:15.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.465+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a0014070 con 0x55e526f8df50 2023-10-05T21:15:15.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.465+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc0a0050040 con 0x7fc0a0016730 2023-10-05T21:15:15.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.465+0000 7fc0ac995700 1 -- 172.21.15.153:0/417704723 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a4029040 con 0x7fc0a0016730 2023-10-05T21:15:15.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.465+0000 7fc0ac995700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc0a0050040 con 0x55e526f5dbe0 2023-10-05T21:15:15.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.466+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.466+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc0a0050040 con 0x7fc0a4007030 2023-10-05T21:15:15.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.466+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a800a570 con 0x7fc0a4007030 2023-10-05T21:15:15.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.466+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc0a0050040 con 0x55e526f8df50 2023-10-05T21:15:15.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.466+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a0014070 con 0x55e526f8df50 2023-10-05T21:15:15.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.466+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc0a0050040 con 0x7fc0a4007030 2023-10-05T21:15:15.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.466+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a800a570 con 0x7fc0a4007030 2023-10-05T21:15:15.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.466+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc0a0050040 con 0x7fc0a0016730 2023-10-05T21:15:15.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.467+0000 7fc0ac995700 1 -- 172.21.15.153:0/417704723 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a4029040 con 0x7fc0a0016730 2023-10-05T21:15:15.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.467+0000 7fc0ac995700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc0a0050040 con 0x55e526f8df50 2023-10-05T21:15:15.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.467+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a0014070 con 0x55e526f8df50 2023-10-05T21:15:15.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.467+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc0a0050040 con 0x7fc0a4007030 2023-10-05T21:15:15.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.467+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a800a570 con 0x7fc0a4007030 2023-10-05T21:15:15.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.467+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc0a0050040 con 0x55e526f5dbe0 2023-10-05T21:15:15.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.467+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.467+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc0a0050040 con 0x7fc0a0016730 2023-10-05T21:15:15.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.467+0000 7fc0ac995700 1 -- 172.21.15.153:0/417704723 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0a4029040 con 0x7fc0a0016730 2023-10-05T21:15:15.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.467+0000 7fc0ba0be680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:15.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.467+0000 7fc0ba0be680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:15.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.467+0000 7fc0ba0be680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:15.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.467+0000 7fc0ba0be680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:15.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.467+0000 7fc0ba0be680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.467+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f92ec0 con 0x55e526f5dbe0 2023-10-05T21:15:15.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.468+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.468+0000 7fc0ba0be680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:15.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.468+0000 7fc0ba0be680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.468+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f93270 con 0x55e526f8df50 2023-10-05T21:15:15.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.468+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc0a0014070 con 0x55e526f8df50 2023-10-05T21:15:15.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.468+0000 7fc0ba0be680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:15.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.468+0000 7fc0ba0be680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.468+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f93620 con 0x55e526f5dbe0 2023-10-05T21:15:15.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.468+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.468+0000 7fc0ba0be680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:15.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.468+0000 7fc0ba0be680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.468+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f93620 con 0x55e526f5dbe0 2023-10-05T21:15:15.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.468+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.468+0000 7fc0ba0be680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:15.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.468+0000 7fc0ba0be680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.468+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f93a70 con 0x7fc0a4007030 2023-10-05T21:15:15.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.469+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fc0a800a570 con 0x7fc0a4007030 2023-10-05T21:15:15.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.469+0000 7fc0ba0be680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.469+0000 7fc0ba0be680 20 zone default found 2023-10-05T21:15:15.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.469+0000 7fc0ba0be680 4 Realm: () 2023-10-05T21:15:15.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.469+0000 7fc0ba0be680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:15.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.469+0000 7fc0ba0be680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:15.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.469+0000 7fc0ba0be680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:15.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.469+0000 7fc0ba0be680 20 zonegroup default 2023-10-05T21:15:15.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.469+0000 7fc0ba0be680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.469+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f93a70 con 0x7fc0a4007030 2023-10-05T21:15:15.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.469+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc0a800a570 con 0x7fc0a4007030 2023-10-05T21:15:15.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.469+0000 7fc0ba0be680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.469+0000 7fc0ba0be680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.469+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f951e0 con 0x55e526f8df50 2023-10-05T21:15:15.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.469+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc0a0014070 con 0x55e526f8df50 2023-10-05T21:15:15.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.469+0000 7fc0ba0be680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.469+0000 7fc0ba0be680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.469+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f95590 con 0x55e526f8df50 2023-10-05T21:15:15.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.469+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc0a0014070 con 0x55e526f8df50 2023-10-05T21:15:15.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.470+0000 7fc0ba0be680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.470+0000 7fc0ba0be680 20 started sync module instance, tier type = 2023-10-05T21:15:15.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.470+0000 7fc0ba0be680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:15.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.470+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f94d90 con 0x7fc0a0016730 2023-10-05T21:15:15.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.470+0000 7fc0ac995700 1 -- 172.21.15.153:0/417704723 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a4029040 con 0x7fc0a0016730 2023-10-05T21:15:15.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.470+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94442689743008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f95e80 con 0x7fc0a0016730 2023-10-05T21:15:15.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.470+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f96720 con 0x55e526f5dbe0 2023-10-05T21:15:15.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.471+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.471+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94442689749840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f96d90 con 0x55e526f5dbe0 2023-10-05T21:15:15.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.471+0000 7fc0ac995700 1 -- 172.21.15.153:0/417704723 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94442689743008] v29'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a4029040 con 0x7fc0a0016730 2023-10-05T21:15:15.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.471+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f97990 con 0x55e526f8df50 2023-10-05T21:15:15.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.472+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a0014070 con 0x55e526f8df50 2023-10-05T21:15:15.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.472+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94442689754144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f97d90 con 0x55e526f8df50 2023-10-05T21:15:15.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.472+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f987a0 con 0x7fc0a0016730 2023-10-05T21:15:15.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.472+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94442689749840] v29'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.473+0000 7fc0ac995700 1 -- 172.21.15.153:0/417704723 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a4029040 con 0x7fc0a0016730 2023-10-05T21:15:15.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.473+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94442689757872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f98b50 con 0x7fc0a0016730 2023-10-05T21:15:15.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.473+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94442689754144] v29'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a0014070 con 0x55e526f8df50 2023-10-05T21:15:15.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.473+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f95990 con 0x55e526f5dbe0 2023-10-05T21:15:15.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.473+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.473+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94442689761392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f999b0 con 0x55e526f5dbe0 2023-10-05T21:15:15.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.473+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f9a3c0 con 0x7fc0a4007030 2023-10-05T21:15:15.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.473+0000 7fc0ac995700 1 -- 172.21.15.153:0/417704723 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94442689757872] v29'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a4029040 con 0x7fc0a0016730 2023-10-05T21:15:15.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.474+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94442689761392] v29'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.474+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a800a570 con 0x7fc0a4007030 2023-10-05T21:15:15.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.474+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94442689765072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f999b0 con 0x7fc0a4007030 2023-10-05T21:15:15.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.474+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f9a360 con 0x7fc0a4007030 2023-10-05T21:15:15.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.475+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(96 notify.6 [create] v29'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a800a570 con 0x7fc0a4007030 2023-10-05T21:15:15.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.475+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(95 notify.5 [watch watch cookie 94442689765072] v29'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a800a570 con 0x7fc0a4007030 2023-10-05T21:15:15.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.475+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94442689767280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f9b0b0 con 0x7fc0a4007030 2023-10-05T21:15:15.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.475+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f9b460 con 0x7fc0a4007030 2023-10-05T21:15:15.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.476+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94442689767280] v29'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a800a570 con 0x7fc0a4007030 2023-10-05T21:15:15.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.476+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a800a570 con 0x7fc0a4007030 2023-10-05T21:15:15.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.476+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94442689768384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f9b500 con 0x7fc0a4007030 2023-10-05T21:15:15.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.476+0000 7fc0ba0be680 20 add_watcher() i=0 2023-10-05T21:15:15.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.476+0000 7fc0ba0be680 20 add_watcher() i=1 2023-10-05T21:15:15.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.476+0000 7fc0ba0be680 20 add_watcher() i=2 2023-10-05T21:15:15.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.476+0000 7fc0ba0be680 20 add_watcher() i=3 2023-10-05T21:15:15.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.476+0000 7fc0ba0be680 20 add_watcher() i=4 2023-10-05T21:15:15.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.476+0000 7fc0ba0be680 20 add_watcher() i=5 2023-10-05T21:15:15.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.476+0000 7fc0ba0be680 20 add_watcher() i=6 2023-10-05T21:15:15.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.476+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94442689768384] v29'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a800a570 con 0x7fc0a4007030 2023-10-05T21:15:15.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.476+0000 7fc0ba0be680 20 add_watcher() i=7 2023-10-05T21:15:15.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.476+0000 7fc0ba0be680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:15.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.476+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f9e6a0 con 0x55e526f5dbe0 2023-10-05T21:15:15.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.477+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.477+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94442689769856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f9bbd0 con 0x55e526f5dbe0 2023-10-05T21:15:15.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.477+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94442689769856] v29'90 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.477+0000 7fc07e7e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:15.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.478+0000 7fc0ba0be680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:15.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.478+0000 7fc0ba0be680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:15.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.478+0000 7fc0ba0be680 1 Processor -- start 2023-10-05T21:15:15.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.478+0000 7fc0ba0be680 1 -- start start 2023-10-05T21:15:15.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.478+0000 7fc0ba0be680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f59e40 0x55e526f5a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.478+0000 7fc0ba0be680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e526f5a790 con 0x55e526f59e40 2023-10-05T21:15:15.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.478+0000 7fc0ac995700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f59e40 0x55e526f5a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.478+0000 7fc0ac995700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f59e40 0x55e526f5a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50236/0 (socket says 172.21.15.153:50236) 2023-10-05T21:15:15.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.478+0000 7fc0ac995700 1 -- 172.21.15.153:0/2253132943 learned_addr learned my addr 172.21.15.153:0/2253132943 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:15.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.478+0000 7fc0ac995700 1 -- 172.21.15.153:0/2253132943 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e526f586c0 con 0x55e526f59e40 2023-10-05T21:15:15.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.479+0000 7fc0ac995700 1 --2- 172.21.15.153:0/2253132943 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f59e40 0x55e526f5a250 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55e526f58480 tx=0x7fc0a4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22639e01eaa71781 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.479+0000 7fc07dfe3700 1 -- 172.21.15.153:0/2253132943 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0a4025040 con 0x55e526f59e40 2023-10-05T21:15:15.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.479+0000 7fc07dfe3700 1 -- 172.21.15.153:0/2253132943 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a4039450 con 0x55e526f59e40 2023-10-05T21:15:15.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.479+0000 7fc07dfe3700 1 -- 172.21.15.153:0/2253132943 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0a4039740 con 0x55e526f59e40 2023-10-05T21:15:15.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.479+0000 7fc0ba0be680 1 -- 172.21.15.153:0/2253132943 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f59e40 msgr2=0x55e526f5a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.479+0000 7fc0ba0be680 1 --2- 172.21.15.153:0/2253132943 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f59e40 0x55e526f5a250 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55e526f58480 tx=0x7fc0a4011000 comp rx=0 tx=0).stop 2023-10-05T21:15:15.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.479+0000 7fc0ba0be680 1 -- 172.21.15.153:0/2253132943 shutdown_connections 2023-10-05T21:15:15.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.479+0000 7fc0ba0be680 1 --2- 172.21.15.153:0/2253132943 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f59e40 0x55e526f5a250 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.479+0000 7fc0ba0be680 1 -- 172.21.15.153:0/2253132943 >> 172.21.15.153:0/2253132943 conn(0x55e526fa4300 msgr2=0x55e526fa2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:15.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.479+0000 7fc0ba0be680 1 -- 172.21.15.153:0/2253132943 shutdown_connections 2023-10-05T21:15:15.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.479+0000 7fc0ba0be680 1 -- 172.21.15.153:0/2253132943 wait complete. 2023-10-05T21:15:15.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.480+0000 7fc0ba0be680 1 Processor -- start 2023-10-05T21:15:15.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.480+0000 7fc0ba0be680 1 -- start start 2023-10-05T21:15:15.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.480+0000 7fc0ba0be680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f59e40 0x55e526fb0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.480+0000 7fc0ba0be680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e526fb1310 con 0x55e526f59e40 2023-10-05T21:15:15.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.480+0000 7fc0ac995700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f59e40 0x55e526fb0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.480+0000 7fc0ac995700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f59e40 0x55e526fb0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50238/0 (socket says 172.21.15.153:50238) 2023-10-05T21:15:15.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.480+0000 7fc0ac995700 1 -- 172.21.15.153:0/2264567000 learned_addr learned my addr 172.21.15.153:0/2264567000 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:15.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.480+0000 7fc0ac995700 1 -- 172.21.15.153:0/2264567000 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e526f61510 con 0x55e526f59e40 2023-10-05T21:15:15.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.480+0000 7fc0ac995700 1 --2- 172.21.15.153:0/2264567000 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f59e40 0x55e526fb0dd0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc0a403b040 tx=0x7fc0a4039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.481+0000 7fbfeffff700 1 -- 172.21.15.153:0/2264567000 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0a4025070 con 0x55e526f59e40 2023-10-05T21:15:15.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.481+0000 7fbfeffff700 1 -- 172.21.15.153:0/2264567000 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a402d660 con 0x55e526f59e40 2023-10-05T21:15:15.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.481+0000 7fbfeffff700 1 -- 172.21.15.153:0/2264567000 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0a402d950 con 0x55e526f59e40 2023-10-05T21:15:15.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.481+0000 7fc0ba0be680 1 -- 172.21.15.153:0/2264567000 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e526fb1510 con 0x55e526f59e40 2023-10-05T21:15:15.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.481+0000 7fc0ba0be680 1 -- 172.21.15.153:0/2264567000 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e526fb19c0 con 0x55e526f59e40 2023-10-05T21:15:15.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.481+0000 7fbfeffff700 1 -- 172.21.15.153:0/2264567000 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fc0a402dbc0 con 0x55e526f59e40 2023-10-05T21:15:15.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.481+0000 7fbfeffff700 1 --2- 172.21.15.153:0/2264567000 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbff40340a0 0x7fbff4036550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.482+0000 7fbfeffff700 1 -- 172.21.15.153:0/2264567000 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fc0a4032030 con 0x55e526f59e40 2023-10-05T21:15:15.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.482+0000 7fc0ad997700 1 --2- 172.21.15.153:0/2264567000 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbff40340a0 0x7fbff4036550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.482+0000 7fc0ba0be680 5 note: GC not initialized 2023-10-05T21:15:15.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.482+0000 7fc0ad997700 1 --2- 172.21.15.153:0/2264567000 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbff40340a0 0x7fbff4036550 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55e526f9bb30 tx=0x7fc0a800aec0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.483+0000 7fbfed7fa700 20 reqs_thread_entry: start 2023-10-05T21:15:15.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.483+0000 7fbfe6ffd700 20 reqs_thread_entry: start 2023-10-05T21:15:15.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.483+0000 7fc0ba0be680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:15.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.483+0000 7fc0ba0be680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:15.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.483+0000 7fbfe57fa700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:45 2023 2023-10-05T21:15:15.553 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:15.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.483+0000 7fbfe4ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:15.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.483+0000 7fc0ba0be680 20 get_system_obj_state: rctx=0x7fffb47a5da8 obj=default.rgw.meta:users.uid:foo state=0x55e526ecc330 s->prefetch_data=0 2023-10-05T21:15:15.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.483+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e5270167a0 con 0x55e526f5dbe0 2023-10-05T21:15:15.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.483+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.483+0000 7fc0ba0be680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:15.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.483+0000 7fc0ba0be680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:15.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.483+0000 7fc0ba0be680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.483+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e527018a30 con 0x55e526f5dbe0 2023-10-05T21:15:15.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.484+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.484+0000 7fc0ba0be680 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T21:15:15.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.484+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:104 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e527018a30 con 0x7fc0a0016730 2023-10-05T21:15:15.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.484+0000 7fc0ac995700 1 -- 172.21.15.153:0/417704723 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(104 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7fc0a4048070 con 0x7fc0a0016730 2023-10-05T21:15:15.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.484+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94442689743008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e527018a30 con 0x7fc0a0016730 2023-10-05T21:15:15.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.485+0000 7fc0ac995700 1 -- 172.21.15.153:0/417704723 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(105 notify.0 [watch unwatch cookie 94442689743008] v29'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a4048070 con 0x7fc0a0016730 2023-10-05T21:15:15.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.485+0000 7fc0ba0be680 20 remove_watcher() i=0 2023-10-05T21:15:15.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.485+0000 7fc0ba0be680 2 removed watcher, disabling cache 2023-10-05T21:15:15.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.485+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94442689749840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e527018a30 con 0x55e526f5dbe0 2023-10-05T21:15:15.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.486+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(106 notify.1 [watch unwatch cookie 94442689749840] v29'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.486+0000 7fc0ba0be680 20 remove_watcher() i=1 2023-10-05T21:15:15.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.486+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94442689754144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e527018a30 con 0x55e526f8df50 2023-10-05T21:15:15.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.486+0000 7fc0ad196700 1 -- 172.21.15.153:0/417704723 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(107 notify.2 [watch unwatch cookie 94442689754144] v29'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a0014070 con 0x55e526f8df50 2023-10-05T21:15:15.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.486+0000 7fc0ba0be680 20 remove_watcher() i=2 2023-10-05T21:15:15.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.486+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94442689757872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e527018a30 con 0x7fc0a0016730 2023-10-05T21:15:15.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.487+0000 7fc0ac995700 1 -- 172.21.15.153:0/417704723 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(108 notify.3 [watch unwatch cookie 94442689757872] v29'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a4048070 con 0x7fc0a0016730 2023-10-05T21:15:15.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.487+0000 7fc0ba0be680 20 remove_watcher() i=3 2023-10-05T21:15:15.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.487+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94442689761392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e527018a30 con 0x55e526f5dbe0 2023-10-05T21:15:15.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.488+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(109 notify.4 [watch unwatch cookie 94442689761392] v29'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.488+0000 7fc0ba0be680 20 remove_watcher() i=4 2023-10-05T21:15:15.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.488+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94442689765072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e527018a30 con 0x7fc0a4007030 2023-10-05T21:15:15.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.489+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(110 notify.5 [watch unwatch cookie 94442689765072] v29'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a800a570 con 0x7fc0a4007030 2023-10-05T21:15:15.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.489+0000 7fc0ba0be680 20 remove_watcher() i=5 2023-10-05T21:15:15.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.489+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:111 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94442689767280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e527018a30 con 0x7fc0a4007030 2023-10-05T21:15:15.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.489+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(111 notify.6 [watch unwatch cookie 94442689767280] v29'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a800a570 con 0x7fc0a4007030 2023-10-05T21:15:15.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.489+0000 7fc0ba0be680 20 remove_watcher() i=6 2023-10-05T21:15:15.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.489+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94442689768384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e527018a30 con 0x7fc0a4007030 2023-10-05T21:15:15.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.490+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(112 notify.7 [watch unwatch cookie 94442689768384] v29'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0a800a570 con 0x7fc0a4007030 2023-10-05T21:15:15.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.490+0000 7fc0ba0be680 20 remove_watcher() i=7 2023-10-05T21:15:15.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.491+0000 7fc07e7e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:15.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.491+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:113 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94442689769856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e526f96350 con 0x55e526f5dbe0 2023-10-05T21:15:15.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.492+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(113 data_loggenerations_metadata [watch unwatch cookie 94442689769856] v29'91 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc0a800a570 con 0x55e526f5dbe0 2023-10-05T21:15:15.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.492+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc0a4007030 msgr2=0x7fc0a401d430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.492+0000 7fc0ba0be680 1 --2- 172.21.15.153:0/417704723 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc0a4007030 0x7fc0a401d430 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.492+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55e526f5dbe0 msgr2=0x55e526f8bae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.492+0000 7fc0ba0be680 1 --2- 172.21.15.153:0/417704723 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55e526f5dbe0 0x55e526f8bae0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.492+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc0a0016730 msgr2=0x7fc0a0041670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.492+0000 7fc0ba0be680 1 --2- 172.21.15.153:0/417704723 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc0a0016730 0x7fc0a0041670 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.492+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55e526f8df50 msgr2=0x55e526f90330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.492+0000 7fc0ba0be680 1 --2- 172.21.15.153:0/417704723 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55e526f8df50 0x55e526f90330 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.492+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc090034140 msgr2=0x7fc0900365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.492+0000 7fc0ba0be680 1 --2- 172.21.15.153:0/417704723 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc090034140 0x7fc0900365f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400afd0 tx=0x7fc0a4014000 comp rx=0 tx=0).stop 2023-10-05T21:15:15.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.492+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f577b0 msgr2=0x55e526f7fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.492+0000 7fc0ba0be680 1 --2- 172.21.15.153:0/417704723 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f577b0 0x55e526f7fdc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0010000 tx=0x7fc0a0016000 comp rx=0 tx=0).stop 2023-10-05T21:15:15.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.492+0000 7fc0ad997700 1 -- 172.21.15.153:0/417704723 reap_dead start 2023-10-05T21:15:15.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.492+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 shutdown_connections 2023-10-05T21:15:15.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.492+0000 7fc0ba0be680 1 --2- 172.21.15.153:0/417704723 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f577b0 0x55e526f7fdc0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.492+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 >> 172.21.15.153:0/417704723 conn(0x55e526f53300 msgr2=0x55e526f72c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:15.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.492+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 shutdown_connections 2023-10-05T21:15:15.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.492+0000 7fc0ba0be680 1 -- 172.21.15.153:0/417704723 wait complete. 2023-10-05T21:15:15.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.492+0000 7fc0ba0be680 1 -- 172.21.15.153:0/2264567000 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbff40340a0 msgr2=0x7fbff4036550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.492+0000 7fc0ba0be680 1 --2- 172.21.15.153:0/2264567000 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbff40340a0 0x7fbff4036550 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55e526f9bb30 tx=0x7fc0a800aec0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.492+0000 7fc0ba0be680 1 -- 172.21.15.153:0/2264567000 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f59e40 msgr2=0x55e526fb0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.492+0000 7fc0ba0be680 1 --2- 172.21.15.153:0/2264567000 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f59e40 0x55e526fb0dd0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc0a403b040 tx=0x7fc0a4039000 comp rx=0 tx=0).stop 2023-10-05T21:15:15.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.492+0000 7fc0ba0be680 1 -- 172.21.15.153:0/2264567000 shutdown_connections 2023-10-05T21:15:15.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.492+0000 7fc0ba0be680 1 --2- 172.21.15.153:0/2264567000 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbff40340a0 0x7fbff4036550 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.492+0000 7fc0ba0be680 1 --2- 172.21.15.153:0/2264567000 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e526f59e40 0x55e526fb0dd0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.492+0000 7fc0ba0be680 1 -- 172.21.15.153:0/2264567000 >> 172.21.15.153:0/2264567000 conn(0x55e526fa4300 msgr2=0x55e526fa2430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:15.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.492+0000 7fc0ba0be680 1 -- 172.21.15.153:0/2264567000 shutdown_connections 2023-10-05T21:15:15.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.492+0000 7fc0ba0be680 1 -- 172.21.15.153:0/2264567000 wait complete. 2023-10-05T21:15:15.567 INFO:teuthology.orchestra.run.smithi153.stdout:[] 2023-10-05T21:15:15.568 DEBUG:tasks.util.rgw: json result: [] 2023-10-05T21:15:15.582 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T21:15:15.583 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2023-10-05T21:15:15.583 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2023-10-05T21:15:15.583 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2023-10-05T21:15:15.627 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:15.628 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:15.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.626+0000 7f189c660680 1 Processor -- start 2023-10-05T21:15:15.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.626+0000 7f189c660680 1 -- start start 2023-10-05T21:15:15.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.627+0000 7f189c660680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5653908afbb0 0x5653908b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.627+0000 7f189c660680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5653907f6990 con 0x56539081d930 2023-10-05T21:15:15.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.627+0000 7f189c660680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x5653907b6db0 con 0x5653908afbb0 2023-10-05T21:15:15.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.627+0000 7f188f738700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x56539081d930 0x5653908ae490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56378/0 (socket says 172.21.15.153:56378) 2023-10-05T21:15:15.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.627+0000 7f188ef37700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5653908afbb0 0x5653908b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.627+0000 7f188f738700 1 -- 172.21.15.153:0/180763372 learned_addr learned my addr 172.21.15.153:0/180763372 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:15.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.627+0000 7f188ef37700 1 -- 172.21.15.153:0/180763372 >> v1:172.21.15.111:6789/0 conn(0x56539081d930 legacy=0x5653908ae490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.627+0000 7f188ef37700 1 -- 172.21.15.153:0/180763372 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653908b34e0 con 0x5653908afbb0 2023-10-05T21:15:15.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.627+0000 7f188e736700 1 -- 172.21.15.153:0/180763372 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 325820419 0 0) 0x5653907f6990 con 0x56539081d930 2023-10-05T21:15:15.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.627+0000 7f188ef37700 1 --2- 172.21.15.153:0/180763372 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653908afbb0 0x5653908b1f90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f188000a5d0 tx=0x7f1880005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a14ffeca1083b70c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.627+0000 7f188e736700 1 -- 172.21.15.153:0/180763372 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18800086a0 con 0x5653908afbb0 2023-10-05T21:15:15.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.628+0000 7f188e736700 1 -- 172.21.15.153:0/180763372 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1880008800 con 0x5653908afbb0 2023-10-05T21:15:15.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.628+0000 7f188e736700 1 -- 172.21.15.153:0/180763372 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1880008ad0 con 0x5653908afbb0 2023-10-05T21:15:15.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.628+0000 7f189c660680 1 -- 172.21.15.153:0/180763372 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653908afbb0 msgr2=0x5653908b1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.628+0000 7f189c660680 1 --2- 172.21.15.153:0/180763372 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653908afbb0 0x5653908b1f90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f188000a5d0 tx=0x7f1880005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:15.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.628+0000 7f189c660680 1 -- 172.21.15.153:0/180763372 shutdown_connections 2023-10-05T21:15:15.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.628+0000 7f189c660680 1 --2- 172.21.15.153:0/180763372 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653908afbb0 0x5653908b1f90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.628+0000 7f189c660680 1 -- 172.21.15.153:0/180763372 >> 172.21.15.153:0/180763372 conn(0x5653908a3b80 msgr2=0x5653908a5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:15.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.628+0000 7f189c660680 1 -- 172.21.15.153:0/180763372 shutdown_connections 2023-10-05T21:15:15.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.628+0000 7f189c660680 1 -- 172.21.15.153:0/180763372 wait complete. 2023-10-05T21:15:15.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.629+0000 7f189c660680 1 Processor -- start 2023-10-05T21:15:15.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.629+0000 7f189c660680 1 -- start start 2023-10-05T21:15:15.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.629+0000 7f189c660680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56539081d930 0x5653908ca910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.629+0000 7f189c660680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x565390756ea0 con 0x56539081d930 2023-10-05T21:15:15.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.629+0000 7f188f738700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56539081d930 0x5653908ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.629+0000 7f188f738700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56539081d930 0x5653908ca910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50264/0 (socket says 172.21.15.153:50264) 2023-10-05T21:15:15.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.629+0000 7f188f738700 1 -- 172.21.15.153:0/923224708 learned_addr learned my addr 172.21.15.153:0/923224708 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:15.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.629+0000 7f188f738700 1 -- 172.21.15.153:0/923224708 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1880005cf0 con 0x56539081d930 2023-10-05T21:15:15.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.630+0000 7f188f738700 1 --2- 172.21.15.153:0/923224708 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56539081d930 0x5653908ca910 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1884001d70 tx=0x7f1884001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a8bb4f1aa1f6e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.630+0000 7f188d734700 1 -- 172.21.15.153:0/923224708 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f188400bcc0 con 0x56539081d930 2023-10-05T21:15:15.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.630+0000 7f188d734700 1 -- 172.21.15.153:0/923224708 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188400be20 con 0x56539081d930 2023-10-05T21:15:15.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.630+0000 7f188d734700 1 -- 172.21.15.153:0/923224708 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f188400e5f0 con 0x56539081d930 2023-10-05T21:15:15.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.630+0000 7f189c660680 1 -- 172.21.15.153:0/923224708 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56539081d930 msgr2=0x5653908ca910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.630+0000 7f189c660680 1 --2- 172.21.15.153:0/923224708 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56539081d930 0x5653908ca910 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1884001d70 tx=0x7f1884001770 comp rx=0 tx=0).stop 2023-10-05T21:15:15.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.630+0000 7f189c660680 1 -- 172.21.15.153:0/923224708 shutdown_connections 2023-10-05T21:15:15.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.630+0000 7f189c660680 1 --2- 172.21.15.153:0/923224708 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56539081d930 0x5653908ca910 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.630+0000 7f189c660680 1 -- 172.21.15.153:0/923224708 >> 172.21.15.153:0/923224708 conn(0x5653908a3b80 msgr2=0x5653908c63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.630+0000 7f189c660680 1 -- 172.21.15.153:0/923224708 shutdown_connections 2023-10-05T21:15:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.630+0000 7f189c660680 1 -- 172.21.15.153:0/923224708 wait complete. 2023-10-05T21:15:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.630+0000 7f189c660680 1 Processor -- start 2023-10-05T21:15:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.631+0000 7f189c660680 1 -- start start 2023-10-05T21:15:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.631+0000 7f189c660680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56539081d930 0x5653908d1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.631+0000 7f189c660680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x56539074dc80 con 0x56539081d930 2023-10-05T21:15:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.631+0000 7f188f738700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56539081d930 0x5653908d1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.631+0000 7f188f738700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56539081d930 0x5653908d1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50266/0 (socket says 172.21.15.153:50266) 2023-10-05T21:15:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.631+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 learned_addr learned my addr 172.21.15.153:0/2137204039 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.631+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1884001a50 con 0x56539081d930 2023-10-05T21:15:15.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.631+0000 7f188f738700 1 --2- 172.21.15.153:0/2137204039 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56539081d930 0x5653908d1db0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f18840017b0 tx=0x7f1884016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.631+0000 7f187f7fe700 1 -- 172.21.15.153:0/2137204039 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f188401f070 con 0x56539081d930 2023-10-05T21:15:15.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.631+0000 7f187f7fe700 1 -- 172.21.15.153:0/2137204039 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188401a2e0 con 0x56539081d930 2023-10-05T21:15:15.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.631+0000 7f187f7fe700 1 -- 172.21.15.153:0/2137204039 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f188401a650 con 0x56539081d930 2023-10-05T21:15:15.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.631+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5653908d22f0 con 0x56539081d930 2023-10-05T21:15:15.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.631+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5653908d2740 con 0x56539081d930 2023-10-05T21:15:15.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.632+0000 7f187f7fe700 1 -- 172.21.15.153:0/2137204039 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f188401a7b0 con 0x56539081d930 2023-10-05T21:15:15.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.632+0000 7f189c660680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.632+0000 7f187f7fe700 1 --2- 172.21.15.153:0/2137204039 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1874034140 0x7f18740365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.632+0000 7f187f7fe700 1 -- 172.21.15.153:0/2137204039 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f1884048f80 con 0x56539081d930 2023-10-05T21:15:15.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.633+0000 7f188ef37700 1 --2- 172.21.15.153:0/2137204039 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1874034140 0x7f18740365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.633+0000 7f189c660680 1 --2- 172.21.15.153:0/2137204039 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5653908afbb0 0x5653908ddad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.633+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908de260 con 0x5653908afbb0 2023-10-05T21:15:15.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.633+0000 7f188ff39700 1 --2- 172.21.15.153:0/2137204039 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5653908afbb0 0x5653908ddad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.633+0000 7f188ef37700 1 --2- 172.21.15.153:0/2137204039 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1874034140 0x7f18740365f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1880003080 tx=0x7f1880015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.633+0000 7f188ff39700 1 --2- 172.21.15.153:0/2137204039 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5653908afbb0 0x5653908ddad0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.633+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.633+0000 7f189c660680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.633+0000 7f189c660680 20 realm 2023-10-05T21:15:15.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.633+0000 7f189c660680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.633+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908db0f0 con 0x5653908afbb0 2023-10-05T21:15:15.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.634+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.634+0000 7f189c660680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.634+0000 7f189c660680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:15.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.634+0000 7f189c660680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.634+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908ded60 con 0x5653908afbb0 2023-10-05T21:15:15.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.634+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.634+0000 7f189c660680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.634+0000 7f189c660680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.634+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908df680 con 0x5653908afbb0 2023-10-05T21:15:15.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.634+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.634+0000 7f189c660680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:15.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.634+0000 7f189c660680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.634+0000 7f189c660680 1 --2- 172.21.15.153:0/2137204039 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5653908dff40 0x5653908e2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.634+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e28f0 con 0x5653908dff40 2023-10-05T21:15:15.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.634+0000 7f188f738700 1 --2- 172.21.15.153:0/2137204039 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5653908dff40 0x5653908e2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.635+0000 7f188f738700 1 --2- 172.21.15.153:0/2137204039 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5653908dff40 0x5653908e2320 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.635+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f1884014070 con 0x5653908dff40 2023-10-05T21:15:15.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.635+0000 7f189c660680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:15.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.635+0000 7f189c660680 20 searching for the correct realm 2023-10-05T21:15:15.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.635+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x5653908dff40 2023-10-05T21:15:15.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.635+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1884014070 con 0x5653908dff40 2023-10-05T21:15:15.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.635+0000 7f188f738700 1 --2- 172.21.15.153:0/2137204039 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f188400d750 0x7f1884041830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.635+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x7f188400d750 2023-10-05T21:15:15.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.635+0000 7f188ef37700 1 --2- 172.21.15.153:0/2137204039 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f188400d750 0x7f1884041830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.636+0000 7f188ef37700 1 --2- 172.21.15.153:0/2137204039 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f188400d750 0x7f1884041830 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.636+0000 7f188ef37700 1 -- 172.21.15.153:0/2137204039 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1880019040 con 0x7f188400d750 2023-10-05T21:15:15.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.636+0000 7f188ef37700 1 --2- 172.21.15.153:0/2137204039 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f1880007030 0x7f188001d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.636+0000 7f188ef37700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x7f1880007030 2023-10-05T21:15:15.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.636+0000 7f188ff39700 1 --2- 172.21.15.153:0/2137204039 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f1880007030 0x7f188001d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.636+0000 7f188ff39700 1 --2- 172.21.15.153:0/2137204039 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f1880007030 0x7f188001d420 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.637+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188800a570 con 0x7f1880007030 2023-10-05T21:15:15.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.637+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x5653908afbb0 2023-10-05T21:15:15.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.637+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.637+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x5653908afbb0 2023-10-05T21:15:15.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.637+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.637+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x7f1880007030 2023-10-05T21:15:15.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.637+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188800a570 con 0x7f1880007030 2023-10-05T21:15:15.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.637+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x7f1880007030 2023-10-05T21:15:15.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.637+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188800a570 con 0x7f1880007030 2023-10-05T21:15:15.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.637+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x7f188400d750 2023-10-05T21:15:15.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.638+0000 7f188ef37700 1 -- 172.21.15.153:0/2137204039 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1880019040 con 0x7f188400d750 2023-10-05T21:15:15.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.638+0000 7f188ef37700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x5653908dff40 2023-10-05T21:15:15.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.638+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1884014070 con 0x5653908dff40 2023-10-05T21:15:15.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.638+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x5653908afbb0 2023-10-05T21:15:15.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.638+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.638+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x7f1880007030 2023-10-05T21:15:15.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.638+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188800a570 con 0x7f1880007030 2023-10-05T21:15:15.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.638+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x5653908afbb0 2023-10-05T21:15:15.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.638+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.639+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x7f188400d750 2023-10-05T21:15:15.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.639+0000 7f188ef37700 1 -- 172.21.15.153:0/2137204039 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1880019040 con 0x7f188400d750 2023-10-05T21:15:15.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.639+0000 7f188ef37700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x5653908dff40 2023-10-05T21:15:15.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.639+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1884014070 con 0x5653908dff40 2023-10-05T21:15:15.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.639+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x5653908dff40 2023-10-05T21:15:15.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.639+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1884014070 con 0x5653908dff40 2023-10-05T21:15:15.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.639+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x7f1880007030 2023-10-05T21:15:15.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.639+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188800a570 con 0x7f1880007030 2023-10-05T21:15:15.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.639+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x5653908dff40 2023-10-05T21:15:15.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.640+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1884014070 con 0x5653908dff40 2023-10-05T21:15:15.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.640+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x5653908dff40 2023-10-05T21:15:15.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.640+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1884014070 con 0x5653908dff40 2023-10-05T21:15:15.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.640+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x5653908afbb0 2023-10-05T21:15:15.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.640+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.640+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x5653908afbb0 2023-10-05T21:15:15.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.640+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.640+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x7f1880007030 2023-10-05T21:15:15.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.641+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188800a570 con 0x7f1880007030 2023-10-05T21:15:15.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.641+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x5653908dff40 2023-10-05T21:15:15.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.641+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1884014070 con 0x5653908dff40 2023-10-05T21:15:15.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.641+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x7f188400d750 2023-10-05T21:15:15.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.641+0000 7f188ef37700 1 -- 172.21.15.153:0/2137204039 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1880019040 con 0x7f188400d750 2023-10-05T21:15:15.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.641+0000 7f188ef37700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x5653908afbb0 2023-10-05T21:15:15.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.641+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.641+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x7f1880007030 2023-10-05T21:15:15.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.642+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188800a570 con 0x7f1880007030 2023-10-05T21:15:15.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.642+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x5653908dff40 2023-10-05T21:15:15.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.642+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1884014070 con 0x5653908dff40 2023-10-05T21:15:15.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.642+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x7f1880007030 2023-10-05T21:15:15.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.642+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188800a570 con 0x7f1880007030 2023-10-05T21:15:15.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.642+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x7f188400d750 2023-10-05T21:15:15.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.643+0000 7f188ef37700 1 -- 172.21.15.153:0/2137204039 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1880019040 con 0x7f188400d750 2023-10-05T21:15:15.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.643+0000 7f188ef37700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x5653908dff40 2023-10-05T21:15:15.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.643+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1884014070 con 0x5653908dff40 2023-10-05T21:15:15.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.643+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x7f1880007030 2023-10-05T21:15:15.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.643+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188800a570 con 0x7f1880007030 2023-10-05T21:15:15.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.643+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x5653908afbb0 2023-10-05T21:15:15.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.644+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.644+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4210 con 0x7f188400d750 2023-10-05T21:15:15.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.644+0000 7f188ef37700 1 -- 172.21.15.153:0/2137204039 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1880019040 con 0x7f188400d750 2023-10-05T21:15:15.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.644+0000 7f189c660680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:15.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.644+0000 7f189c660680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:15.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.644+0000 7f189c660680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:15.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.644+0000 7f189c660680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:15.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.644+0000 7f189c660680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.644+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3430 con 0x5653908afbb0 2023-10-05T21:15:15.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.644+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.644+0000 7f189c660680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.644+0000 7f189c660680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.644+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3860 con 0x5653908afbb0 2023-10-05T21:15:15.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.644+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.644+0000 7f189c660680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:15.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.644+0000 7f189c660680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.644+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3c90 con 0x5653908afbb0 2023-10-05T21:15:15.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.644+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.644+0000 7f189c660680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:15.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.644+0000 7f189c660680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.644+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e45c0 con 0x5653908dff40 2023-10-05T21:15:15.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.645+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f1884014070 con 0x5653908dff40 2023-10-05T21:15:15.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.645+0000 7f189c660680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.645+0000 7f189c660680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.645+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e49c0 con 0x5653908afbb0 2023-10-05T21:15:15.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.645+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.645+0000 7f189c660680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.645+0000 7f189c660680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.645+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4df0 con 0x5653908afbb0 2023-10-05T21:15:15.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.645+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.645+0000 7f189c660680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:15.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.645+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e5e00 con 0x5653908dff40 2023-10-05T21:15:15.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.645+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1884014070 con 0x5653908dff40 2023-10-05T21:15:15.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.645+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e5e00 con 0x7f188400d750 2023-10-05T21:15:15.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.646+0000 7f188ef37700 1 -- 172.21.15.153:0/2137204039 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1880019040 con 0x7f188400d750 2023-10-05T21:15:15.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.646+0000 7f188ef37700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e5e00 con 0x7f1880007030 2023-10-05T21:15:15.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.646+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188800a570 con 0x7f1880007030 2023-10-05T21:15:15.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.646+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3c90 con 0x5653908afbb0 2023-10-05T21:15:15.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.646+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.646+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3c90 con 0x5653908afbb0 2023-10-05T21:15:15.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.647+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.647+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3c90 con 0x7f1880007030 2023-10-05T21:15:15.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.647+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188800a570 con 0x7f1880007030 2023-10-05T21:15:15.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.647+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3c90 con 0x7f1880007030 2023-10-05T21:15:15.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.647+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188800a570 con 0x7f1880007030 2023-10-05T21:15:15.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.647+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3c90 con 0x7f188400d750 2023-10-05T21:15:15.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.647+0000 7f188ef37700 1 -- 172.21.15.153:0/2137204039 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1880019040 con 0x7f188400d750 2023-10-05T21:15:15.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.647+0000 7f188ef37700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3c90 con 0x5653908dff40 2023-10-05T21:15:15.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.647+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1884014070 con 0x5653908dff40 2023-10-05T21:15:15.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.647+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3c90 con 0x5653908afbb0 2023-10-05T21:15:15.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.648+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.648+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3c90 con 0x7f1880007030 2023-10-05T21:15:15.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.648+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188800a570 con 0x7f1880007030 2023-10-05T21:15:15.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.648+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3c90 con 0x5653908afbb0 2023-10-05T21:15:15.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.648+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.648+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3c90 con 0x7f188400d750 2023-10-05T21:15:15.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.648+0000 7f188ef37700 1 -- 172.21.15.153:0/2137204039 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1880019040 con 0x7f188400d750 2023-10-05T21:15:15.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.648+0000 7f188ef37700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3c90 con 0x5653908dff40 2023-10-05T21:15:15.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.649+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1884014070 con 0x5653908dff40 2023-10-05T21:15:15.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.649+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3c90 con 0x5653908dff40 2023-10-05T21:15:15.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.649+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1884014070 con 0x5653908dff40 2023-10-05T21:15:15.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.649+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3c90 con 0x7f1880007030 2023-10-05T21:15:15.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.649+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188800a570 con 0x7f1880007030 2023-10-05T21:15:15.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.649+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3c90 con 0x5653908dff40 2023-10-05T21:15:15.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.649+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1884014070 con 0x5653908dff40 2023-10-05T21:15:15.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.649+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3c90 con 0x5653908dff40 2023-10-05T21:15:15.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.649+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1884014070 con 0x5653908dff40 2023-10-05T21:15:15.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.649+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3c90 con 0x5653908afbb0 2023-10-05T21:15:15.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.650+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.650+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3c90 con 0x5653908afbb0 2023-10-05T21:15:15.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.650+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.650+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3c90 con 0x7f1880007030 2023-10-05T21:15:15.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.650+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188800a570 con 0x7f1880007030 2023-10-05T21:15:15.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.650+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3c90 con 0x5653908dff40 2023-10-05T21:15:15.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.650+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1884014070 con 0x5653908dff40 2023-10-05T21:15:15.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.650+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3c90 con 0x7f188400d750 2023-10-05T21:15:15.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.650+0000 7f188ef37700 1 -- 172.21.15.153:0/2137204039 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1880019040 con 0x7f188400d750 2023-10-05T21:15:15.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.651+0000 7f188ef37700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3c90 con 0x5653908afbb0 2023-10-05T21:15:15.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.651+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.651+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3c90 con 0x7f1880007030 2023-10-05T21:15:15.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.651+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188800a570 con 0x7f1880007030 2023-10-05T21:15:15.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.651+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3c90 con 0x5653908dff40 2023-10-05T21:15:15.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.651+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1884014070 con 0x5653908dff40 2023-10-05T21:15:15.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.651+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3c90 con 0x7f1880007030 2023-10-05T21:15:15.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.651+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188800a570 con 0x7f1880007030 2023-10-05T21:15:15.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.651+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3c90 con 0x7f188400d750 2023-10-05T21:15:15.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.652+0000 7f188ef37700 1 -- 172.21.15.153:0/2137204039 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1880019040 con 0x7f188400d750 2023-10-05T21:15:15.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.652+0000 7f188ef37700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3c90 con 0x5653908dff40 2023-10-05T21:15:15.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.652+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1884014070 con 0x5653908dff40 2023-10-05T21:15:15.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.652+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3c90 con 0x7f1880007030 2023-10-05T21:15:15.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.652+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f188800a570 con 0x7f1880007030 2023-10-05T21:15:15.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.652+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3c90 con 0x5653908afbb0 2023-10-05T21:15:15.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.652+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.652+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e3c90 con 0x7f188400d750 2023-10-05T21:15:15.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.652+0000 7f188ef37700 1 -- 172.21.15.153:0/2137204039 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1880019040 con 0x7f188400d750 2023-10-05T21:15:15.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.652+0000 7f189c660680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:15.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.652+0000 7f189c660680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:15.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.652+0000 7f189c660680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:15.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.652+0000 7f189c660680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:15.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.653+0000 7f189c660680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.653+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e4df0 con 0x5653908afbb0 2023-10-05T21:15:15.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.653+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.653+0000 7f189c660680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:15.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.653+0000 7f189c660680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.653+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e51a0 con 0x5653908dff40 2023-10-05T21:15:15.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.653+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f1884014070 con 0x5653908dff40 2023-10-05T21:15:15.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.653+0000 7f189c660680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:15.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.653+0000 7f189c660680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.653+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e5550 con 0x5653908afbb0 2023-10-05T21:15:15.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.653+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.653+0000 7f189c660680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:15.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.653+0000 7f189c660680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.653+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e5550 con 0x5653908afbb0 2023-10-05T21:15:15.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.653+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.653+0000 7f189c660680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:15.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.653+0000 7f189c660680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.653+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e59e0 con 0x7f1880007030 2023-10-05T21:15:15.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.654+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f188800a570 con 0x7f1880007030 2023-10-05T21:15:15.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.654+0000 7f189c660680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.654+0000 7f189c660680 20 zone default found 2023-10-05T21:15:15.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.654+0000 7f189c660680 4 Realm: () 2023-10-05T21:15:15.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.654+0000 7f189c660680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:15.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.654+0000 7f189c660680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:15.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.654+0000 7f189c660680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:15.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.654+0000 7f189c660680 20 zonegroup default 2023-10-05T21:15:15.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.654+0000 7f189c660680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.654+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e59e0 con 0x7f1880007030 2023-10-05T21:15:15.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.654+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f188800a570 con 0x7f1880007030 2023-10-05T21:15:15.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.654+0000 7f189c660680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.654+0000 7f189c660680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.654+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e72d0 con 0x5653908dff40 2023-10-05T21:15:15.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.654+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1884014070 con 0x5653908dff40 2023-10-05T21:15:15.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.654+0000 7f189c660680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.654+0000 7f189c660680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.654+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e7680 con 0x5653908dff40 2023-10-05T21:15:15.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.654+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1884014070 con 0x5653908dff40 2023-10-05T21:15:15.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.654+0000 7f189c660680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.654+0000 7f189c660680 20 started sync module instance, tier type = 2023-10-05T21:15:15.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.654+0000 7f189c660680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:15.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.654+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e6990 con 0x7f188400d750 2023-10-05T21:15:15.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.655+0000 7f188ef37700 1 -- 172.21.15.153:0/2137204039 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1880019040 con 0x7f188400d750 2023-10-05T21:15:15.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.655+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94916907527568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e7f20 con 0x7f188400d750 2023-10-05T21:15:15.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.655+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e87c0 con 0x5653908afbb0 2023-10-05T21:15:15.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.656+0000 7f188ef37700 1 -- 172.21.15.153:0/2137204039 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94916907527568] v29'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1880019040 con 0x7f188400d750 2023-10-05T21:15:15.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.656+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.656+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94916907530800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e87c0 con 0x5653908afbb0 2023-10-05T21:15:15.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.656+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e93a0 con 0x5653908dff40 2023-10-05T21:15:15.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.657+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94916907530800] v29'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.657+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1884014070 con 0x5653908dff40 2023-10-05T21:15:15.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.657+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94916907533008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e8720 con 0x5653908dff40 2023-10-05T21:15:15.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.657+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908ea180 con 0x7f188400d750 2023-10-05T21:15:15.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.658+0000 7f188ef37700 1 -- 172.21.15.153:0/2137204039 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1880019040 con 0x7f188400d750 2023-10-05T21:15:15.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.658+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94916907539600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908eaa70 con 0x7f188400d750 2023-10-05T21:15:15.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.658+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908eb510 con 0x5653908afbb0 2023-10-05T21:15:15.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.658+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94916907533008] v29'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1884014070 con 0x5653908dff40 2023-10-05T21:15:15.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.658+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.658+0000 7f188ef37700 1 -- 172.21.15.153:0/2137204039 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94916907539600] v29'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1880019040 con 0x7f188400d750 2023-10-05T21:15:15.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.658+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94916907544512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e97a0 con 0x5653908afbb0 2023-10-05T21:15:15.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.658+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908ebf70 con 0x7f1880007030 2023-10-05T21:15:15.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.659+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94916907544512] v29'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.659+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f188800a570 con 0x7f1880007030 2023-10-05T21:15:15.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.659+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94916907541888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908ebf70 con 0x7f1880007030 2023-10-05T21:15:15.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.659+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908ec810 con 0x7f1880007030 2023-10-05T21:15:15.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.660+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94916907541888] v29'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f188800a570 con 0x7f1880007030 2023-10-05T21:15:15.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.660+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f188800a570 con 0x7f1880007030 2023-10-05T21:15:15.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.660+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94916907547824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908ec690 con 0x7f1880007030 2023-10-05T21:15:15.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.660+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908ed270 con 0x7f1880007030 2023-10-05T21:15:15.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.660+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94916907547824] v29'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f188800a570 con 0x7f1880007030 2023-10-05T21:15:15.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.660+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f188800a570 con 0x7f1880007030 2023-10-05T21:15:15.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.660+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94916907552032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908ed230 con 0x7f1880007030 2023-10-05T21:15:15.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.660+0000 7f189c660680 20 add_watcher() i=0 2023-10-05T21:15:15.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.660+0000 7f189c660680 20 add_watcher() i=1 2023-10-05T21:15:15.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.660+0000 7f189c660680 20 add_watcher() i=2 2023-10-05T21:15:15.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.660+0000 7f189c660680 20 add_watcher() i=3 2023-10-05T21:15:15.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.660+0000 7f189c660680 20 add_watcher() i=4 2023-10-05T21:15:15.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.660+0000 7f189c660680 20 add_watcher() i=5 2023-10-05T21:15:15.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.660+0000 7f189c660680 20 add_watcher() i=6 2023-10-05T21:15:15.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.661+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94916907552032] v29'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f188800a570 con 0x7f1880007030 2023-10-05T21:15:15.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.661+0000 7f189c660680 20 add_watcher() i=7 2023-10-05T21:15:15.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.661+0000 7f189c660680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:15.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.661+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908f0670 con 0x5653908afbb0 2023-10-05T21:15:15.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.661+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.661+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94916907548928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908edb30 con 0x5653908afbb0 2023-10-05T21:15:15.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.662+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94916907548928] v29'92 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.662+0000 7f17dbfff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:15.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.662+0000 7f189c660680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:15.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.662+0000 7f189c660680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:15.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.662+0000 7f189c660680 1 Processor -- start 2023-10-05T21:15:15.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.662+0000 7f189c660680 1 -- start start 2023-10-05T21:15:15.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.663+0000 7f189c660680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653908fb050 0x5653908fb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.663+0000 7f189c660680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653908fba30 con 0x5653908fb050 2023-10-05T21:15:15.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.663+0000 7f188ef37700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653908fb050 0x5653908fb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.663+0000 7f188ef37700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653908fb050 0x5653908fb460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50270/0 (socket says 172.21.15.153:50270) 2023-10-05T21:15:15.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.663+0000 7f188ef37700 1 -- 172.21.15.153:0/1995158634 learned_addr learned my addr 172.21.15.153:0/1995158634 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:15.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.663+0000 7f188ef37700 1 -- 172.21.15.153:0/1995158634 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653908fbb70 con 0x5653908fb050 2023-10-05T21:15:15.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.663+0000 7f188ef37700 1 --2- 172.21.15.153:0/1995158634 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653908fb050 0x5653908fb460 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x5653908a9f50 tx=0x7f1880012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a0a01efa618545 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.663+0000 7f17db7fe700 1 -- 172.21.15.153:0/1995158634 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f188001ddc0 con 0x5653908fb050 2023-10-05T21:15:15.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.663+0000 7f17db7fe700 1 -- 172.21.15.153:0/1995158634 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188002b450 con 0x5653908fb050 2023-10-05T21:15:15.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.663+0000 7f17db7fe700 1 -- 172.21.15.153:0/1995158634 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f188002b5e0 con 0x5653908fb050 2023-10-05T21:15:15.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.664+0000 7f189c660680 1 -- 172.21.15.153:0/1995158634 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653908fb050 msgr2=0x5653908fb460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.664+0000 7f189c660680 1 --2- 172.21.15.153:0/1995158634 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653908fb050 0x5653908fb460 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x5653908a9f50 tx=0x7f1880012000 comp rx=0 tx=0).stop 2023-10-05T21:15:15.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.664+0000 7f189c660680 1 -- 172.21.15.153:0/1995158634 shutdown_connections 2023-10-05T21:15:15.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.664+0000 7f189c660680 1 --2- 172.21.15.153:0/1995158634 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653908fb050 0x5653908fb460 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.664+0000 7f189c660680 1 -- 172.21.15.153:0/1995158634 >> 172.21.15.153:0/1995158634 conn(0x5653908f6250 msgr2=0x5653908f43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:15.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.664+0000 7f189c660680 1 -- 172.21.15.153:0/1995158634 shutdown_connections 2023-10-05T21:15:15.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.664+0000 7f189c660680 1 -- 172.21.15.153:0/1995158634 wait complete. 2023-10-05T21:15:15.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.664+0000 7f189c660680 1 Processor -- start 2023-10-05T21:15:15.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.665+0000 7f189c660680 1 -- start start 2023-10-05T21:15:15.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.665+0000 7f189c660680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653908fb050 0x565390900c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.665+0000 7f189c660680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x565390901170 con 0x5653908fb050 2023-10-05T21:15:15.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.665+0000 7f188ef37700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653908fb050 0x565390900c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.665+0000 7f188ef37700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653908fb050 0x565390900c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50280/0 (socket says 172.21.15.153:50280) 2023-10-05T21:15:15.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.665+0000 7f188ef37700 1 -- 172.21.15.153:0/2591919158 learned_addr learned my addr 172.21.15.153:0/2591919158 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:15.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.665+0000 7f188ef37700 1 -- 172.21.15.153:0/2591919158 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653908b34e0 con 0x5653908fb050 2023-10-05T21:15:15.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.665+0000 7f188ef37700 1 --2- 172.21.15.153:0/2591919158 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653908fb050 0x565390900c30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f188003b040 tx=0x7f1880031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.665+0000 7f17d9ffb700 1 -- 172.21.15.153:0/2591919158 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1880037840 con 0x5653908fb050 2023-10-05T21:15:15.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.666+0000 7f17d9ffb700 1 -- 172.21.15.153:0/2591919158 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18800379e0 con 0x5653908fb050 2023-10-05T21:15:15.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.666+0000 7f189c660680 1 -- 172.21.15.153:0/2591919158 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x565390901370 con 0x5653908fb050 2023-10-05T21:15:15.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.666+0000 7f17d9ffb700 1 -- 172.21.15.153:0/2591919158 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1880037cd0 con 0x5653908fb050 2023-10-05T21:15:15.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.666+0000 7f189c660680 1 -- 172.21.15.153:0/2591919158 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5653909017c0 con 0x5653908fb050 2023-10-05T21:15:15.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.666+0000 7f17d9ffb700 1 -- 172.21.15.153:0/2591919158 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f1880026040 con 0x5653908fb050 2023-10-05T21:15:15.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.666+0000 7f17d9ffb700 1 --2- 172.21.15.153:0/2591919158 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f17cc034140 0x7f17cc0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.666+0000 7f17d9ffb700 1 -- 172.21.15.153:0/2591919158 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f1880031070 con 0x5653908fb050 2023-10-05T21:15:15.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.666+0000 7f188ff39700 1 --2- 172.21.15.153:0/2591919158 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f17cc034140 0x7f17cc0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.667+0000 7f189c660680 5 note: GC not initialized 2023-10-05T21:15:15.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.667+0000 7f188ff39700 1 --2- 172.21.15.153:0/2591919158 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f17cc034140 0x7f17cc0365f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x5653908ed4c0 tx=0x7f188800aee0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.667+0000 7f17d2ffd700 20 reqs_thread_entry: start 2023-10-05T21:15:15.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.668+0000 7f17d0ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:15.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.668+0000 7f189c660680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:15.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.668+0000 7f189c660680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:15.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.668+0000 7f17beffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:45 2023 2023-10-05T21:15:15.703 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:15.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.668+0000 7f17be7fc700 20 reqs_thread_entry: start 2023-10-05T21:15:15.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.668+0000 7f189c660680 20 get_system_obj_state: rctx=0x7ffe29f8e1e8 obj=default.rgw.meta:users.uid:foo state=0x56539075c240 s->prefetch_data=0 2023-10-05T21:15:15.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.668+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x565390966610 con 0x5653908afbb0 2023-10-05T21:15:15.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.668+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.668+0000 7f189c660680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:15.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.668+0000 7f189c660680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:15.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.668+0000 7f189c660680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.668+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653909688a0 con 0x5653908afbb0 2023-10-05T21:15:15.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.669+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.669+0000 7f189c660680 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T21:15:15.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.669+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:104 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653909688a0 con 0x7f188400d750 2023-10-05T21:15:15.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.669+0000 7f188ef37700 1 -- 172.21.15.153:0/2137204039 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(104 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f1880046070 con 0x7f188400d750 2023-10-05T21:15:15.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.669+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94916907527568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653909688a0 con 0x7f188400d750 2023-10-05T21:15:15.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.670+0000 7f188ef37700 1 -- 172.21.15.153:0/2137204039 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(105 notify.0 [watch unwatch cookie 94916907527568] v29'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1880046070 con 0x7f188400d750 2023-10-05T21:15:15.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.670+0000 7f189c660680 20 remove_watcher() i=0 2023-10-05T21:15:15.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.670+0000 7f189c660680 2 removed watcher, disabling cache 2023-10-05T21:15:15.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.670+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94916907530800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653909688a0 con 0x5653908afbb0 2023-10-05T21:15:15.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.671+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(106 notify.1 [watch unwatch cookie 94916907530800] v29'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.671+0000 7f189c660680 20 remove_watcher() i=1 2023-10-05T21:15:15.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.671+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94916907533008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653909688a0 con 0x5653908dff40 2023-10-05T21:15:15.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.672+0000 7f188f738700 1 -- 172.21.15.153:0/2137204039 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(107 notify.2 [watch unwatch cookie 94916907533008] v29'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1884014070 con 0x5653908dff40 2023-10-05T21:15:15.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.672+0000 7f189c660680 20 remove_watcher() i=2 2023-10-05T21:15:15.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.672+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94916907539600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653909688a0 con 0x7f188400d750 2023-10-05T21:15:15.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.672+0000 7f188ef37700 1 -- 172.21.15.153:0/2137204039 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(108 notify.3 [watch unwatch cookie 94916907539600] v29'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1880046070 con 0x7f188400d750 2023-10-05T21:15:15.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.672+0000 7f189c660680 20 remove_watcher() i=3 2023-10-05T21:15:15.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.672+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94916907544512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653909688a0 con 0x5653908afbb0 2023-10-05T21:15:15.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.673+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(109 notify.4 [watch unwatch cookie 94916907544512] v29'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.673+0000 7f189c660680 20 remove_watcher() i=4 2023-10-05T21:15:15.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.673+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94916907541888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653909688a0 con 0x7f1880007030 2023-10-05T21:15:15.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.674+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(110 notify.5 [watch unwatch cookie 94916907541888] v29'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f188800a570 con 0x7f1880007030 2023-10-05T21:15:15.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.674+0000 7f189c660680 20 remove_watcher() i=5 2023-10-05T21:15:15.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.674+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:111 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94916907547824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653909688a0 con 0x7f1880007030 2023-10-05T21:15:15.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.675+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(111 notify.6 [watch unwatch cookie 94916907547824] v29'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f188800a570 con 0x7f1880007030 2023-10-05T21:15:15.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.675+0000 7f189c660680 20 remove_watcher() i=6 2023-10-05T21:15:15.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.675+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94916907552032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653909688a0 con 0x7f1880007030 2023-10-05T21:15:15.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.675+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(112 notify.7 [watch unwatch cookie 94916907552032] v29'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f188800a570 con 0x7f1880007030 2023-10-05T21:15:15.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.675+0000 7f189c660680 20 remove_watcher() i=7 2023-10-05T21:15:15.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.676+0000 7f17dbfff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:15.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.676+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:113 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94916907548928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5653908e82d0 con 0x5653908afbb0 2023-10-05T21:15:15.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.677+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(113 data_loggenerations_metadata [watch unwatch cookie 94916907548928] v29'93 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f188800a570 con 0x5653908afbb0 2023-10-05T21:15:15.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.677+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f1880007030 msgr2=0x7f188001d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.677+0000 7f189c660680 1 --2- 172.21.15.153:0/2137204039 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f1880007030 0x7f188001d420 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.677+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5653908afbb0 msgr2=0x5653908ddad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.677+0000 7f189c660680 1 --2- 172.21.15.153:0/2137204039 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5653908afbb0 0x5653908ddad0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.677+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f188400d750 msgr2=0x7f1884041830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.677+0000 7f189c660680 1 --2- 172.21.15.153:0/2137204039 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f188400d750 0x7f1884041830 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.677+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5653908dff40 msgr2=0x5653908e2320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.677+0000 7f189c660680 1 --2- 172.21.15.153:0/2137204039 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5653908dff40 0x5653908e2320 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.677+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1874034140 msgr2=0x7f18740365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.677+0000 7f189c660680 1 --2- 172.21.15.153:0/2137204039 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1874034140 0x7f18740365f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1880003080 tx=0x7f1880015000 comp rx=0 tx=0).stop 2023-10-05T21:15:15.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.677+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56539081d930 msgr2=0x5653908d1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.677+0000 7f188ff39700 1 -- 172.21.15.153:0/2137204039 reap_dead start 2023-10-05T21:15:15.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.677+0000 7f189c660680 1 --2- 172.21.15.153:0/2137204039 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56539081d930 0x5653908d1db0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f18840017b0 tx=0x7f1884016000 comp rx=0 tx=0).stop 2023-10-05T21:15:15.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.677+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 shutdown_connections 2023-10-05T21:15:15.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.677+0000 7f189c660680 1 --2- 172.21.15.153:0/2137204039 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56539081d930 0x5653908d1db0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.677+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 >> 172.21.15.153:0/2137204039 conn(0x5653908a3b80 msgr2=0x5653908c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:15.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.677+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 shutdown_connections 2023-10-05T21:15:15.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.677+0000 7f189c660680 1 -- 172.21.15.153:0/2137204039 wait complete. 2023-10-05T21:15:15.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.677+0000 7f189c660680 1 -- 172.21.15.153:0/2591919158 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f17cc034140 msgr2=0x7f17cc0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.677+0000 7f189c660680 1 --2- 172.21.15.153:0/2591919158 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f17cc034140 0x7f17cc0365f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x5653908ed4c0 tx=0x7f188800aee0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.677+0000 7f189c660680 1 -- 172.21.15.153:0/2591919158 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653908fb050 msgr2=0x565390900c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.677+0000 7f189c660680 1 --2- 172.21.15.153:0/2591919158 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653908fb050 0x565390900c30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f188003b040 tx=0x7f1880031000 comp rx=0 tx=0).stop 2023-10-05T21:15:15.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.678+0000 7f189c660680 1 -- 172.21.15.153:0/2591919158 shutdown_connections 2023-10-05T21:15:15.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.678+0000 7f189c660680 1 --2- 172.21.15.153:0/2591919158 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f17cc034140 0x7f17cc0365f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.678+0000 7f189c660680 1 --2- 172.21.15.153:0/2591919158 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653908fb050 0x565390900c30 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.678+0000 7f189c660680 1 -- 172.21.15.153:0/2591919158 >> 172.21.15.153:0/2591919158 conn(0x5653908f6250 msgr2=0x5653908f4380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:15.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.678+0000 7f189c660680 1 -- 172.21.15.153:0/2591919158 shutdown_connections 2023-10-05T21:15:15.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.678+0000 7f189c660680 1 -- 172.21.15.153:0/2591919158 wait complete. 2023-10-05T21:15:15.711 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2023-10-05T21:15:15.711 INFO:teuthology.orchestra.run.smithi153.stdout: "myfoo" 2023-10-05T21:15:15.711 INFO:teuthology.orchestra.run.smithi153.stdout:] 2023-10-05T21:15:15.711 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2023-10-05T21:15:15.714 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T21:15:15.714 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2023-10-05T21:15:15.715 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2023-10-05T21:15:15.715 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2023-10-05T21:15:15.757 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:15.757 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:15.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.756+0000 7fc317efd680 1 Processor -- start 2023-10-05T21:15:15.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.757+0000 7fc317efd680 1 -- start start 2023-10-05T21:15:15.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.757+0000 7fc317efd680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x559ff87e9080 0x559ff887a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.757+0000 7fc317efd680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559ff87c2970 con 0x559ff887a9b0 2023-10-05T21:15:15.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.757+0000 7fc317efd680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x559ff8782db0 con 0x559ff87e9080 2023-10-05T21:15:15.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.757+0000 7fc30a7d4700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x559ff887a9b0 0x559ff887cd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56386/0 (socket says 172.21.15.153:56386) 2023-10-05T21:15:15.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.757+0000 7fc30afd5700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x559ff87e9080 0x559ff887a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.757+0000 7fc30a7d4700 1 -- 172.21.15.153:0/653888441 learned_addr learned my addr 172.21.15.153:0/653888441 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:15.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.757+0000 7fc30afd5700 1 -- 172.21.15.153:0/653888441 >> v1:172.21.15.111:6789/0 conn(0x559ff887a9b0 legacy=0x559ff887cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.757+0000 7fc309fd3700 1 -- 172.21.15.153:0/653888441 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 659094445 0 0) 0x559ff87c2970 con 0x559ff887a9b0 2023-10-05T21:15:15.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.757+0000 7fc30afd5700 1 -- 172.21.15.153:0/653888441 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ff887f4c0 con 0x559ff87e9080 2023-10-05T21:15:15.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.757+0000 7fc30afd5700 1 --2- 172.21.15.153:0/653888441 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff87e9080 0x559ff887a470 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc30000a5d0 tx=0x7fc300005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5403a2fca575af43 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.758+0000 7fc309fd3700 1 -- 172.21.15.153:0/653888441 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3000086a0 con 0x559ff87e9080 2023-10-05T21:15:15.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.758+0000 7fc309fd3700 1 -- 172.21.15.153:0/653888441 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc300008800 con 0x559ff87e9080 2023-10-05T21:15:15.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.758+0000 7fc309fd3700 1 -- 172.21.15.153:0/653888441 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc300008ad0 con 0x559ff87e9080 2023-10-05T21:15:15.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.758+0000 7fc317efd680 1 -- 172.21.15.153:0/653888441 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff87e9080 msgr2=0x559ff887a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.758+0000 7fc317efd680 1 --2- 172.21.15.153:0/653888441 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff87e9080 0x559ff887a470 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc30000a5d0 tx=0x7fc300005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:15.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.758+0000 7fc317efd680 1 -- 172.21.15.153:0/653888441 shutdown_connections 2023-10-05T21:15:15.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.758+0000 7fc317efd680 1 --2- 172.21.15.153:0/653888441 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff87e9080 0x559ff887a470 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.758+0000 7fc317efd680 1 -- 172.21.15.153:0/653888441 >> 172.21.15.153:0/653888441 conn(0x559ff886fb60 msgr2=0x559ff8871f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:15.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.758+0000 7fc317efd680 1 -- 172.21.15.153:0/653888441 shutdown_connections 2023-10-05T21:15:15.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.758+0000 7fc317efd680 1 -- 172.21.15.153:0/653888441 wait complete. 2023-10-05T21:15:15.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.759+0000 7fc317efd680 1 Processor -- start 2023-10-05T21:15:15.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.759+0000 7fc317efd680 1 -- start start 2023-10-05T21:15:15.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.759+0000 7fc317efd680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff87e9080 0x559ff8896900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.759+0000 7fc317efd680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ff8722ea0 con 0x559ff87e9080 2023-10-05T21:15:15.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.759+0000 7fc30afd5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff87e9080 0x559ff8896900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.759+0000 7fc30afd5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff87e9080 0x559ff8896900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50310/0 (socket says 172.21.15.153:50310) 2023-10-05T21:15:15.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.759+0000 7fc30afd5700 1 -- 172.21.15.153:0/1208901151 learned_addr learned my addr 172.21.15.153:0/1208901151 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:15.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.759+0000 7fc30afd5700 1 -- 172.21.15.153:0/1208901151 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc300005cf0 con 0x559ff87e9080 2023-10-05T21:15:15.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.759+0000 7fc30afd5700 1 --2- 172.21.15.153:0/1208901151 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff87e9080 0x559ff8896900 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc300000c00 tx=0x7fc300015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4207f194a6ec1cc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.760+0000 7fc308fd1700 1 -- 172.21.15.153:0/1208901151 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3000086a0 con 0x559ff87e9080 2023-10-05T21:15:15.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.760+0000 7fc308fd1700 1 -- 172.21.15.153:0/1208901151 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc300008970 con 0x559ff87e9080 2023-10-05T21:15:15.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.760+0000 7fc308fd1700 1 -- 172.21.15.153:0/1208901151 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc300008b20 con 0x559ff87e9080 2023-10-05T21:15:15.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.760+0000 7fc317efd680 1 -- 172.21.15.153:0/1208901151 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff87e9080 msgr2=0x559ff8896900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.760+0000 7fc317efd680 1 --2- 172.21.15.153:0/1208901151 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff87e9080 0x559ff8896900 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc300000c00 tx=0x7fc300015000 comp rx=0 tx=0).stop 2023-10-05T21:15:15.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.760+0000 7fc317efd680 1 -- 172.21.15.153:0/1208901151 shutdown_connections 2023-10-05T21:15:15.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.760+0000 7fc317efd680 1 --2- 172.21.15.153:0/1208901151 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff87e9080 0x559ff8896900 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.760+0000 7fc317efd680 1 -- 172.21.15.153:0/1208901151 >> 172.21.15.153:0/1208901151 conn(0x559ff886fb60 msgr2=0x559ff88923d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:15.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.760+0000 7fc317efd680 1 -- 172.21.15.153:0/1208901151 shutdown_connections 2023-10-05T21:15:15.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.760+0000 7fc317efd680 1 -- 172.21.15.153:0/1208901151 wait complete. 2023-10-05T21:15:15.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.760+0000 7fc317efd680 1 Processor -- start 2023-10-05T21:15:15.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.760+0000 7fc317efd680 1 -- start start 2023-10-05T21:15:15.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.760+0000 7fc317efd680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff87e9080 0x559ff889dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.761+0000 7fc317efd680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ff8719c80 con 0x559ff87e9080 2023-10-05T21:15:15.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.761+0000 7fc30afd5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff87e9080 0x559ff889dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.761+0000 7fc30afd5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff87e9080 0x559ff889dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50326/0 (socket says 172.21.15.153:50326) 2023-10-05T21:15:15.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.761+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 learned_addr learned my addr 172.21.15.153:0/1987012736 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:15.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.761+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ff887f4c0 con 0x559ff87e9080 2023-10-05T21:15:15.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.761+0000 7fc30afd5700 1 --2- 172.21.15.153:0/1987012736 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff87e9080 0x559ff889dc70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc30000a520 tx=0x7fc30001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.761+0000 7fc2faffd700 1 -- 172.21.15.153:0/1987012736 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc30001d420 con 0x559ff87e9080 2023-10-05T21:15:15.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.761+0000 7fc2faffd700 1 -- 172.21.15.153:0/1987012736 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30001d580 con 0x559ff87e9080 2023-10-05T21:15:15.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.761+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559ff889e1b0 con 0x559ff87e9080 2023-10-05T21:15:15.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.761+0000 7fc2faffd700 1 -- 172.21.15.153:0/1987012736 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc30001d730 con 0x559ff87e9080 2023-10-05T21:15:15.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.761+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559ff889e5a0 con 0x559ff87e9080 2023-10-05T21:15:15.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.762+0000 7fc2faffd700 1 -- 172.21.15.153:0/1987012736 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fc30001d9a0 con 0x559ff87e9080 2023-10-05T21:15:15.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.762+0000 7fc2faffd700 1 --2- 172.21.15.153:0/1987012736 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc2f0034140 0x7fc2f00365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.762+0000 7fc2faffd700 1 -- 172.21.15.153:0/1987012736 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fc30004a3b0 con 0x559ff87e9080 2023-10-05T21:15:15.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.762+0000 7fc30a7d4700 1 --2- 172.21.15.153:0/1987012736 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc2f0034140 0x7fc2f00365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.762+0000 7fc317efd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.762+0000 7fc317efd680 1 --2- 172.21.15.153:0/1987012736 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x559ff887a9b0 0x559ff88a99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.762+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88aa180 con 0x559ff887a9b0 2023-10-05T21:15:15.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.763+0000 7fc30b7d6700 1 --2- 172.21.15.153:0/1987012736 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x559ff887a9b0 0x559ff88a99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.763+0000 7fc30a7d4700 1 --2- 172.21.15.153:0/1987012736 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc2f0034140 0x7fc2f00365f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc0011e0 tx=0x7fc2fc0013a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.763+0000 7fc30b7d6700 1 --2- 172.21.15.153:0/1987012736 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x559ff887a9b0 0x559ff88a99f0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.763+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.763+0000 7fc317efd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.763+0000 7fc317efd680 20 realm 2023-10-05T21:15:15.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.763+0000 7fc317efd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.763+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88a6f10 con 0x559ff887a9b0 2023-10-05T21:15:15.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.763+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.764+0000 7fc317efd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.764+0000 7fc317efd680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:15.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.764+0000 7fc317efd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.764+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88aac30 con 0x559ff887a9b0 2023-10-05T21:15:15.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.764+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.764+0000 7fc317efd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.764+0000 7fc317efd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.764+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88aa850 con 0x559ff887a9b0 2023-10-05T21:15:15.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.764+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.764+0000 7fc317efd680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:15.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.764+0000 7fc317efd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.764+0000 7fc317efd680 1 --2- 172.21.15.153:0/1987012736 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x559ff88abfd0 0x559ff88ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.764+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88ae8f0 con 0x559ff88abfd0 2023-10-05T21:15:15.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.764+0000 7fc30afd5700 1 --2- 172.21.15.153:0/1987012736 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x559ff88abfd0 0x559ff88ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.764+0000 7fc30afd5700 1 --2- 172.21.15.153:0/1987012736 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x559ff88abfd0 0x559ff88ae3b0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.765+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.765+0000 7fc317efd680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:15.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.765+0000 7fc317efd680 20 searching for the correct realm 2023-10-05T21:15:15.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.765+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x559ff88abfd0 2023-10-05T21:15:15.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.765+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.765+0000 7fc30afd5700 1 --2- 172.21.15.153:0/1987012736 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc300039030 0x7fc3000063a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.765+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x7fc300039030 2023-10-05T21:15:15.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.765+0000 7fc30a7d4700 1 --2- 172.21.15.153:0/1987012736 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc300039030 0x7fc3000063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.765+0000 7fc30a7d4700 1 --2- 172.21.15.153:0/1987012736 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc300039030 0x7fc3000063a0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.766+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2fc006070 con 0x7fc300039030 2023-10-05T21:15:15.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.766+0000 7fc30a7d4700 1 --2- 172.21.15.153:0/1987012736 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc2fc00d8e0 0x7fc2fc00c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.766+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.766+0000 7fc30b7d6700 1 --2- 172.21.15.153:0/1987012736 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc2fc00d8e0 0x7fc2fc00c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.766+0000 7fc30b7d6700 1 --2- 172.21.15.153:0/1987012736 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc2fc00d8e0 0x7fc2fc00c360 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.767+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.767+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x559ff887a9b0 2023-10-05T21:15:15.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.767+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.767+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x559ff887a9b0 2023-10-05T21:15:15.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.767+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.767+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.767+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.767+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.767+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.767+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x7fc300039030 2023-10-05T21:15:15.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.768+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2fc006070 con 0x7fc300039030 2023-10-05T21:15:15.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.768+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x559ff88abfd0 2023-10-05T21:15:15.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.768+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.768+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x559ff887a9b0 2023-10-05T21:15:15.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.768+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.768+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.768+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.768+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x559ff887a9b0 2023-10-05T21:15:15.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.768+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.768+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x7fc300039030 2023-10-05T21:15:15.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.769+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2fc006070 con 0x7fc300039030 2023-10-05T21:15:15.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.769+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x559ff88abfd0 2023-10-05T21:15:15.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.769+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.769+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x559ff88abfd0 2023-10-05T21:15:15.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.769+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.769+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.770+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.770+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x559ff88abfd0 2023-10-05T21:15:15.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.770+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.770+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x559ff88abfd0 2023-10-05T21:15:15.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.770+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.770+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x559ff887a9b0 2023-10-05T21:15:15.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.770+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.770+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x559ff887a9b0 2023-10-05T21:15:15.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.770+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.770+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.771+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.771+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x559ff88abfd0 2023-10-05T21:15:15.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.771+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.771+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x7fc300039030 2023-10-05T21:15:15.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.771+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2fc006070 con 0x7fc300039030 2023-10-05T21:15:15.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.771+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x559ff887a9b0 2023-10-05T21:15:15.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.771+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.771+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.772+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.772+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x559ff88abfd0 2023-10-05T21:15:15.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.772+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.772+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.772+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.772+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x7fc300039030 2023-10-05T21:15:15.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.773+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2fc006070 con 0x7fc300039030 2023-10-05T21:15:15.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.773+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x559ff88abfd0 2023-10-05T21:15:15.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.773+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.773+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.773+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.773+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x559ff887a9b0 2023-10-05T21:15:15.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.773+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.773+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b01a0 con 0x7fc300039030 2023-10-05T21:15:15.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.774+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2fc006070 con 0x7fc300039030 2023-10-05T21:15:15.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.774+0000 7fc317efd680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:15.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.774+0000 7fc317efd680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:15.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.774+0000 7fc317efd680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:15.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.774+0000 7fc317efd680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:15.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.774+0000 7fc317efd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.774+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af190 con 0x559ff887a9b0 2023-10-05T21:15:15.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.774+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.774+0000 7fc317efd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.774+0000 7fc317efd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.774+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88aedc0 con 0x559ff887a9b0 2023-10-05T21:15:15.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.774+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.774+0000 7fc317efd680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:15.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.774+0000 7fc317efd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.774+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88afb00 con 0x559ff887a9b0 2023-10-05T21:15:15.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.774+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.774+0000 7fc317efd680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:15.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.774+0000 7fc317efd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.774+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b0550 con 0x559ff88abfd0 2023-10-05T21:15:15.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.774+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.774+0000 7fc317efd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.774+0000 7fc317efd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.774+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b0900 con 0x559ff887a9b0 2023-10-05T21:15:15.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.775+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.775+0000 7fc317efd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.775+0000 7fc317efd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.775+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af680 con 0x559ff887a9b0 2023-10-05T21:15:15.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.775+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.775+0000 7fc317efd680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:15.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.775+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x559ff88abfd0 2023-10-05T21:15:15.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.775+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.775+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x7fc300039030 2023-10-05T21:15:15.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.775+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2fc006070 con 0x7fc300039030 2023-10-05T21:15:15.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.775+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.776+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.776+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88afb00 con 0x559ff887a9b0 2023-10-05T21:15:15.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.776+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.776+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88afb00 con 0x559ff887a9b0 2023-10-05T21:15:15.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.776+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.776+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88afb00 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.776+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.776+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88afb00 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.777+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.777+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88afb00 con 0x7fc300039030 2023-10-05T21:15:15.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.777+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2fc006070 con 0x7fc300039030 2023-10-05T21:15:15.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.777+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88afb00 con 0x559ff88abfd0 2023-10-05T21:15:15.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.777+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.777+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88afb00 con 0x559ff887a9b0 2023-10-05T21:15:15.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.777+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.777+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88afb00 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.777+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.777+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88afb00 con 0x559ff887a9b0 2023-10-05T21:15:15.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.778+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.778+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88afb00 con 0x7fc300039030 2023-10-05T21:15:15.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.778+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2fc006070 con 0x7fc300039030 2023-10-05T21:15:15.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.778+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88afb00 con 0x559ff88abfd0 2023-10-05T21:15:15.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.778+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.778+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88afb00 con 0x559ff88abfd0 2023-10-05T21:15:15.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.778+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.778+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88afb00 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.779+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.779+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88afb00 con 0x559ff88abfd0 2023-10-05T21:15:15.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.779+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.779+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88afb00 con 0x559ff88abfd0 2023-10-05T21:15:15.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.779+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.779+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88afb00 con 0x559ff887a9b0 2023-10-05T21:15:15.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.779+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.779+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88afb00 con 0x559ff887a9b0 2023-10-05T21:15:15.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.779+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.779+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88afb00 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.780+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.780+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88afb00 con 0x559ff88abfd0 2023-10-05T21:15:15.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.780+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.780+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88afb00 con 0x7fc300039030 2023-10-05T21:15:15.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.780+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2fc006070 con 0x7fc300039030 2023-10-05T21:15:15.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.780+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88afb00 con 0x559ff887a9b0 2023-10-05T21:15:15.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.780+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.780+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88afb00 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.781+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.781+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88afb00 con 0x559ff88abfd0 2023-10-05T21:15:15.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.781+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.781+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88afb00 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.781+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.781+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88afb00 con 0x7fc300039030 2023-10-05T21:15:15.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.781+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2fc006070 con 0x7fc300039030 2023-10-05T21:15:15.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.781+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88afb00 con 0x559ff88abfd0 2023-10-05T21:15:15.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.782+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.782+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88afb00 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.782+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.782+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88afb00 con 0x559ff887a9b0 2023-10-05T21:15:15.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.782+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.782+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88afb00 con 0x7fc300039030 2023-10-05T21:15:15.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.782+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2fc006070 con 0x7fc300039030 2023-10-05T21:15:15.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.782+0000 7fc317efd680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:15.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.782+0000 7fc317efd680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:15.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.782+0000 7fc317efd680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:15.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.782+0000 7fc317efd680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:15.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.782+0000 7fc317efd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.782+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x559ff887a9b0 2023-10-05T21:15:15.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.783+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.783+0000 7fc317efd680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:15.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.783+0000 7fc317efd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.783+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b0e40 con 0x559ff88abfd0 2023-10-05T21:15:15.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.783+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.783+0000 7fc317efd680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:15.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.783+0000 7fc317efd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.783+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b16e0 con 0x559ff887a9b0 2023-10-05T21:15:15.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.783+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.783+0000 7fc317efd680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:15.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.783+0000 7fc317efd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.783+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b16e0 con 0x559ff887a9b0 2023-10-05T21:15:15.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.783+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.783+0000 7fc317efd680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:15.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.783+0000 7fc317efd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.783+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b1840 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.784+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.784+0000 7fc317efd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.784+0000 7fc317efd680 20 zone default found 2023-10-05T21:15:15.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.784+0000 7fc317efd680 4 Realm: () 2023-10-05T21:15:15.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.784+0000 7fc317efd680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:15.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.784+0000 7fc317efd680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:15.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.784+0000 7fc317efd680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:15.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.784+0000 7fc317efd680 20 zonegroup default 2023-10-05T21:15:15.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.784+0000 7fc317efd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.784+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b1840 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.784+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.784+0000 7fc317efd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.784+0000 7fc317efd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.784+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b31c0 con 0x559ff88abfd0 2023-10-05T21:15:15.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.784+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.784+0000 7fc317efd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.784+0000 7fc317efd680 20 rados->read ofs=0 len=0 2023-10-05T21:15:15.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.784+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b3570 con 0x559ff88abfd0 2023-10-05T21:15:15.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.785+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.785+0000 7fc317efd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:15.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.785+0000 7fc317efd680 20 started sync module instance, tier type = 2023-10-05T21:15:15.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.785+0000 7fc317efd680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:15.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.785+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b2880 con 0x7fc300039030 2023-10-05T21:15:15.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.785+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2fc006070 con 0x7fc300039030 2023-10-05T21:15:15.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.785+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94145558031488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b3e10 con 0x7fc300039030 2023-10-05T21:15:15.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.785+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b46b0 con 0x559ff887a9b0 2023-10-05T21:15:15.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.786+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.786+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94145558031488] v29'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2fc006070 con 0x7fc300039030 2023-10-05T21:15:15.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.786+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94145558037216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b4d80 con 0x559ff887a9b0 2023-10-05T21:15:15.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.786+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b5790 con 0x559ff88abfd0 2023-10-05T21:15:15.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.787+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.787+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94145558037216] v29'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.787+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94145558041248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b4d80 con 0x559ff88abfd0 2023-10-05T21:15:15.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.787+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b6200 con 0x7fc300039030 2023-10-05T21:15:15.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.788+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94145558041248] v29'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.788+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2fc006070 con 0x7fc300039030 2023-10-05T21:15:15.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.788+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94145558043456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b65b0 con 0x7fc300039030 2023-10-05T21:15:15.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.788+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b6fc0 con 0x559ff887a9b0 2023-10-05T21:15:15.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.789+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94145558043456] v29'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2fc006070 con 0x7fc300039030 2023-10-05T21:15:15.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.789+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.789+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94145558047440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b7410 con 0x559ff887a9b0 2023-10-05T21:15:15.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.789+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b7cf0 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.789+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94145558047440] v29'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.789+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.789+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94145558049104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b7bb0 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.789+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b8790 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.790+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94145558049104] v29'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.790+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.790+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94145558053440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b8750 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.790+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b9280 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.791+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94145558053440] v29'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.791+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.791+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94145558056240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b9240 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.791+0000 7fc317efd680 20 add_watcher() i=0 2023-10-05T21:15:15.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.791+0000 7fc317efd680 20 add_watcher() i=1 2023-10-05T21:15:15.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.791+0000 7fc317efd680 20 add_watcher() i=2 2023-10-05T21:15:15.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.791+0000 7fc317efd680 20 add_watcher() i=3 2023-10-05T21:15:15.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.791+0000 7fc317efd680 20 add_watcher() i=4 2023-10-05T21:15:15.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.791+0000 7fc317efd680 20 add_watcher() i=5 2023-10-05T21:15:15.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.791+0000 7fc317efd680 20 add_watcher() i=6 2023-10-05T21:15:15.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.791+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94145558056240] v29'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.791+0000 7fc317efd680 20 add_watcher() i=7 2023-10-05T21:15:15.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.791+0000 7fc317efd680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:15.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.791+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88bc680 con 0x559ff887a9b0 2023-10-05T21:15:15.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.792+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.792+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94145558050272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b9b40 con 0x559ff887a9b0 2023-10-05T21:15:15.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.792+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94145558050272] v29'94 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.793+0000 7fc2dbfe7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:15.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.793+0000 7fc317efd680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:15.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.793+0000 7fc317efd680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:15.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.793+0000 7fc317efd680 1 Processor -- start 2023-10-05T21:15:15.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.793+0000 7fc317efd680 1 -- start start 2023-10-05T21:15:15.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.793+0000 7fc317efd680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff88c7040 0x559ff88c7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.793+0000 7fc317efd680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ff88c7a20 con 0x559ff88c7040 2023-10-05T21:15:15.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.793+0000 7fc30a7d4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff88c7040 0x559ff88c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.793+0000 7fc30a7d4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff88c7040 0x559ff88c7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50342/0 (socket says 172.21.15.153:50342) 2023-10-05T21:15:15.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.793+0000 7fc30a7d4700 1 -- 172.21.15.153:0/2747181254 learned_addr learned my addr 172.21.15.153:0/2747181254 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:15.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.793+0000 7fc30a7d4700 1 -- 172.21.15.153:0/2747181254 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ff88c7b60 con 0x559ff88c7040 2023-10-05T21:15:15.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.794+0000 7fc30a7d4700 1 --2- 172.21.15.153:0/2747181254 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff88c7040 0x559ff88c7450 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x559ff88ab720 tx=0x7fc2fc006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24638c61759d214f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.794+0000 7fc2db7e6700 1 -- 172.21.15.153:0/2747181254 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2fc023040 con 0x559ff88c7040 2023-10-05T21:15:15.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.794+0000 7fc2db7e6700 1 -- 172.21.15.153:0/2747181254 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2fc024040 con 0x559ff88c7040 2023-10-05T21:15:15.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.794+0000 7fc2db7e6700 1 -- 172.21.15.153:0/2747181254 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2fc013040 con 0x559ff88c7040 2023-10-05T21:15:15.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.794+0000 7fc317efd680 1 -- 172.21.15.153:0/2747181254 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff88c7040 msgr2=0x559ff88c7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.794+0000 7fc317efd680 1 --2- 172.21.15.153:0/2747181254 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff88c7040 0x559ff88c7450 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x559ff88ab720 tx=0x7fc2fc006000 comp rx=0 tx=0).stop 2023-10-05T21:15:15.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.795+0000 7fc317efd680 1 -- 172.21.15.153:0/2747181254 shutdown_connections 2023-10-05T21:15:15.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.795+0000 7fc317efd680 1 --2- 172.21.15.153:0/2747181254 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff88c7040 0x559ff88c7450 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.795+0000 7fc317efd680 1 -- 172.21.15.153:0/2747181254 >> 172.21.15.153:0/2747181254 conn(0x559ff88c2240 msgr2=0x559ff88c03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:15.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.795+0000 7fc317efd680 1 -- 172.21.15.153:0/2747181254 shutdown_connections 2023-10-05T21:15:15.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.795+0000 7fc317efd680 1 -- 172.21.15.153:0/2747181254 wait complete. 2023-10-05T21:15:15.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.795+0000 7fc317efd680 1 Processor -- start 2023-10-05T21:15:15.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.795+0000 7fc317efd680 1 -- start start 2023-10-05T21:15:15.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.795+0000 7fc317efd680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff88c7040 0x559ff88ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.795+0000 7fc317efd680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ff88cd090 con 0x559ff88c7040 2023-10-05T21:15:15.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.795+0000 7fc30a7d4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff88c7040 0x559ff88ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.795+0000 7fc30a7d4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff88c7040 0x559ff88ccb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50352/0 (socket says 172.21.15.153:50352) 2023-10-05T21:15:15.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.795+0000 7fc30a7d4700 1 -- 172.21.15.153:0/2084931551 learned_addr learned my addr 172.21.15.153:0/2084931551 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:15.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.795+0000 7fc30a7d4700 1 -- 172.21.15.153:0/2084931551 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2fc00ece0 con 0x559ff88c7040 2023-10-05T21:15:15.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.796+0000 7fc30a7d4700 1 --2- 172.21.15.153:0/2084931551 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff88c7040 0x559ff88ccb50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc00dfd0 tx=0x7fc2fc030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.796+0000 7fc2d9fe3700 1 -- 172.21.15.153:0/2084931551 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2fc023040 con 0x559ff88c7040 2023-10-05T21:15:15.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.796+0000 7fc317efd680 1 -- 172.21.15.153:0/2084931551 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559ff88cd290 con 0x559ff88c7040 2023-10-05T21:15:15.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.796+0000 7fc2d9fe3700 1 -- 172.21.15.153:0/2084931551 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2fc01e5a0 con 0x559ff88c7040 2023-10-05T21:15:15.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.796+0000 7fc317efd680 1 -- 172.21.15.153:0/2084931551 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559ff88cd6e0 con 0x559ff88c7040 2023-10-05T21:15:15.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.796+0000 7fc2d9fe3700 1 -- 172.21.15.153:0/2084931551 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2fc01e710 con 0x559ff88c7040 2023-10-05T21:15:15.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.797+0000 7fc2d9fe3700 1 -- 172.21.15.153:0/2084931551 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fc2fc01e870 con 0x559ff88c7040 2023-10-05T21:15:15.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.797+0000 7fc2d9fe3700 1 --2- 172.21.15.153:0/2084931551 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc2500340f0 0x7fc2500365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:15.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.797+0000 7fc2d9fe3700 1 -- 172.21.15.153:0/2084931551 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fc2fc04fb00 con 0x559ff88c7040 2023-10-05T21:15:15.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.797+0000 7fc30b7d6700 1 --2- 172.21.15.153:0/2084931551 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc2500340f0 0x7fc2500365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:15.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.797+0000 7fc317efd680 5 note: GC not initialized 2023-10-05T21:15:15.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.797+0000 7fc30b7d6700 1 --2- 172.21.15.153:0/2084931551 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc2500340f0 0x7fc2500365a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x559ff88b8700 tx=0x7fc30400afd0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:15.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.798+0000 7fc24affd700 20 reqs_thread_entry: start 2023-10-05T21:15:15.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.798+0000 7fc248ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:15.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.798+0000 7fc317efd680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:15.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.798+0000 7fc317efd680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:15.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.798+0000 7fc23affd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:46 2023 2023-10-05T21:15:15.832 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:15.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.798+0000 7fc23a7fc700 20 reqs_thread_entry: start 2023-10-05T21:15:15.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.799+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:102 8.0 8:00000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff8932040 con 0x559ff88abfd0 2023-10-05T21:15:15.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.799+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(102 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.799+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:103 8.10 8:08000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b5790 con 0x559ff88abfd0 2023-10-05T21:15:15.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.799+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(103 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.799+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:104 8.8 8:10000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b5790 con 0x559ff887a9b0 2023-10-05T21:15:15.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.799+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(104 [pgnls start_epoch 29 out=49b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.799+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:105 8.18 8:18000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x559ff887a9b0 2023-10-05T21:15:15.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.799+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(105 [pgnls start_epoch 29 out=49b] v29'11 uv11 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.799+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:106 8.4 8:20000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x7fc300039030 2023-10-05T21:15:15.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.800+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(106 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2fc006070 con 0x7fc300039030 2023-10-05T21:15:15.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.800+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 8.14 8:28000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x559ff88abfd0 2023-10-05T21:15:15.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.800+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(107 [pgnls start_epoch 29 out=127b] v29'1 uv1 ondisk = 1) v8 ==== 144+0+127 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.800+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:108 8.c 8:30000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x559ff887a9b0 2023-10-05T21:15:15.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.800+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(108 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.800+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:109 8.1c 8:38000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x559ff88abfd0 2023-10-05T21:15:15.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.800+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== osd_op_reply(109 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.800+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:110 8.2 8:40000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x7fc300039030 2023-10-05T21:15:15.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.801+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(110 [pgnls start_epoch 29 out=49b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2fc006070 con 0x7fc300039030 2023-10-05T21:15:15.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.801+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:111 8.12 8:48000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x559ff88abfd0 2023-10-05T21:15:15.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.801+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(111 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.801+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:112 8.a 8:50000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x559ff887a9b0 2023-10-05T21:15:15.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.801+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(112 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.801+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:113 8.1a 8:58000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.801+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(113 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.801+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:114 8.6 8:60000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.802+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(114 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.802+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:115 8.16 8:68000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x559ff88abfd0 2023-10-05T21:15:15.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.802+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 31 ==== osd_op_reply(115 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.802+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:116 8.e 8:70000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.802+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(116 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.802+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:117 8.1e 8:78000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.802+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(117 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.802+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:118 8.1 8:80000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.802+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 31 ==== osd_op_reply(118 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.802+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:119 8.11 8:88000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x559ff88abfd0 2023-10-05T21:15:15.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.803+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 32 ==== osd_op_reply(119 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.803+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:120 8.9 8:90000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x7fc300039030 2023-10-05T21:15:15.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.803+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(120 [pgnls start_epoch 29 out=70b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+70 (crc 0 0 0) 0x7fc2fc006070 con 0x7fc300039030 2023-10-05T21:15:15.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.803+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:121 8.19 8:98000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x559ff887a9b0 2023-10-05T21:15:15.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.803+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(121 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.803+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:122 8.5 8:a0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x559ff887a9b0 2023-10-05T21:15:15.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.803+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(122 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.803+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:123 8.15 8:a8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x559ff88abfd0 2023-10-05T21:15:15.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.803+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 33 ==== osd_op_reply(123 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.803+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:124 8.d 8:b0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x7fc300039030 2023-10-05T21:15:15.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.804+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(124 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2fc006070 con 0x7fc300039030 2023-10-05T21:15:15.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.804+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:125 8.1d 8:b8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.804+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 32 ==== osd_op_reply(125 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.804+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:126 8.3 8:c0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x559ff887a9b0 2023-10-05T21:15:15.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.804+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== osd_op_reply(126 [pgnls start_epoch 29 out=49b] v29'1 uv1 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.804+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:127 8.13 8:c8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.804+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 33 ==== osd_op_reply(127 [pgnls start_epoch 29 out=49b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.804+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:128 8.b 8:d0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x559ff88abfd0 2023-10-05T21:15:15.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.805+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 34 ==== osd_op_reply(128 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.805+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:129 8.1b 8:d8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x7fc300039030 2023-10-05T21:15:15.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.805+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== osd_op_reply(129 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2fc006070 con 0x7fc300039030 2023-10-05T21:15:15.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.805+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:130 8.7 8:e0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.805+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 34 ==== osd_op_reply(130 [pgnls start_epoch 29 out=49b] v29'1 uv1 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.805+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:131 8.17 8:e8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x559ff887a9b0 2023-10-05T21:15:15.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.805+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 42 ==== osd_op_reply(131 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.805+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:132 8.f 8:f0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x559ff88abfd0 2023-10-05T21:15:15.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.806+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 35 ==== osd_op_reply(132 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.806+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:133 8.1f 8:f8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x7fc300039030 2023-10-05T21:15:15.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.806+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 <== osd.2 v2:172.21.15.153:6807/140454 22 ==== osd_op_reply(133 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2fc006070 con 0x7fc300039030 2023-10-05T21:15:15.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.806+0000 7fc317efd680 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 2023-10-05T21:15:15.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.806+0000 7fc317efd680 20 RGWRados::pool_iterate: got myfoo 2023-10-05T21:15:15.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.806+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:134 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94145558031488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b5790 con 0x7fc300039030 2023-10-05T21:15:15.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.807+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 <== osd.2 v2:172.21.15.153:6807/140454 23 ==== osd_op_reply(134 notify.0 [watch unwatch cookie 94145558031488] v29'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2fc006070 con 0x7fc300039030 2023-10-05T21:15:15.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.807+0000 7fc317efd680 20 remove_watcher() i=0 2023-10-05T21:15:15.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.807+0000 7fc317efd680 2 removed watcher, disabling cache 2023-10-05T21:15:15.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.807+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:135 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94145558037216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88af650 con 0x559ff887a9b0 2023-10-05T21:15:15.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.807+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 43 ==== osd_op_reply(135 notify.1 [watch unwatch cookie 94145558037216] v29'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.807+0000 7fc317efd680 20 remove_watcher() i=1 2023-10-05T21:15:15.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.807+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:136 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94145558041248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b5790 con 0x559ff88abfd0 2023-10-05T21:15:15.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.808+0000 7fc30afd5700 1 -- 172.21.15.153:0/1987012736 <== osd.3 v2:172.21.15.153:6800/140455 36 ==== osd_op_reply(136 notify.2 [watch unwatch cookie 94145558041248] v29'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc300036070 con 0x559ff88abfd0 2023-10-05T21:15:15.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.808+0000 7fc317efd680 20 remove_watcher() i=2 2023-10-05T21:15:15.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.808+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94145558043456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b52a0 con 0x7fc300039030 2023-10-05T21:15:15.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.809+0000 7fc30a7d4700 1 -- 172.21.15.153:0/1987012736 <== osd.2 v2:172.21.15.153:6807/140454 24 ==== osd_op_reply(137 notify.3 [watch unwatch cookie 94145558043456] v29'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2fc006070 con 0x7fc300039030 2023-10-05T21:15:15.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.809+0000 7fc317efd680 20 remove_watcher() i=3 2023-10-05T21:15:15.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.809+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:138 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94145558047440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b5b40 con 0x559ff887a9b0 2023-10-05T21:15:15.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.809+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 44 ==== osd_op_reply(138 notify.4 [watch unwatch cookie 94145558047440] v29'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.810+0000 7fc317efd680 20 remove_watcher() i=4 2023-10-05T21:15:15.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.810+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:139 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94145558049104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b52a0 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.810+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 35 ==== osd_op_reply(139 notify.5 [watch unwatch cookie 94145558049104] v29'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.810+0000 7fc317efd680 20 remove_watcher() i=5 2023-10-05T21:15:15.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.810+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:140 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94145558053440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b6ad0 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.811+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 36 ==== osd_op_reply(140 notify.6 [watch unwatch cookie 94145558053440] v29'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.811+0000 7fc317efd680 20 remove_watcher() i=6 2023-10-05T21:15:15.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.811+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:141 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94145558056240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b52a0 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.812+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.0 v2:172.21.15.111:6800/111394 37 ==== osd_op_reply(141 notify.7 [watch unwatch cookie 94145558056240] v29'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc30400a570 con 0x7fc2fc00d8e0 2023-10-05T21:15:15.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.812+0000 7fc317efd680 20 remove_watcher() i=7 2023-10-05T21:15:15.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.812+0000 7fc2dbfe7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:15.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.812+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:142 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94145558050272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559ff88b6ad0 con 0x559ff887a9b0 2023-10-05T21:15:15.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.813+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 <== osd.1 v2:172.21.15.153:6816/140456 45 ==== osd_op_reply(142 data_loggenerations_metadata [watch unwatch cookie 94145558050272] v29'95 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc30400a570 con 0x559ff887a9b0 2023-10-05T21:15:15.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.813+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc2fc00d8e0 msgr2=0x7fc2fc00c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.813+0000 7fc317efd680 1 --2- 172.21.15.153:0/1987012736 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc2fc00d8e0 0x7fc2fc00c360 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.813+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x559ff887a9b0 msgr2=0x559ff88a99f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.813+0000 7fc317efd680 1 --2- 172.21.15.153:0/1987012736 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x559ff887a9b0 0x559ff88a99f0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.813+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc300039030 msgr2=0x7fc3000063a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.813+0000 7fc317efd680 1 --2- 172.21.15.153:0/1987012736 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc300039030 0x7fc3000063a0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.813+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x559ff88abfd0 msgr2=0x559ff88ae3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.813+0000 7fc317efd680 1 --2- 172.21.15.153:0/1987012736 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x559ff88abfd0 0x559ff88ae3b0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.813+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc2f0034140 msgr2=0x7fc2f00365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.813+0000 7fc317efd680 1 --2- 172.21.15.153:0/1987012736 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc2f0034140 0x7fc2f00365f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc0011e0 tx=0x7fc2fc0013a0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.813+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff87e9080 msgr2=0x559ff889dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.813+0000 7fc30b7d6700 1 -- 172.21.15.153:0/1987012736 reap_dead start 2023-10-05T21:15:15.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.813+0000 7fc317efd680 1 --2- 172.21.15.153:0/1987012736 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff87e9080 0x559ff889dc70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc30000a520 tx=0x7fc30001d000 comp rx=0 tx=0).stop 2023-10-05T21:15:15.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.813+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 shutdown_connections 2023-10-05T21:15:15.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.813+0000 7fc317efd680 1 --2- 172.21.15.153:0/1987012736 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff87e9080 0x559ff889dc70 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.813+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 >> 172.21.15.153:0/1987012736 conn(0x559ff886fb60 msgr2=0x559ff8890c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:15.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.813+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 shutdown_connections 2023-10-05T21:15:15.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.813+0000 7fc317efd680 1 -- 172.21.15.153:0/1987012736 wait complete. 2023-10-05T21:15:15.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.814+0000 7fc317efd680 1 -- 172.21.15.153:0/2084931551 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc2500340f0 msgr2=0x7fc2500365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.814+0000 7fc317efd680 1 --2- 172.21.15.153:0/2084931551 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc2500340f0 0x7fc2500365a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x559ff88b8700 tx=0x7fc30400afd0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.814+0000 7fc317efd680 1 -- 172.21.15.153:0/2084931551 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff88c7040 msgr2=0x559ff88ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:15.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.814+0000 7fc317efd680 1 --2- 172.21.15.153:0/2084931551 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff88c7040 0x559ff88ccb50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc00dfd0 tx=0x7fc2fc030000 comp rx=0 tx=0).stop 2023-10-05T21:15:15.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.814+0000 7fc317efd680 1 -- 172.21.15.153:0/2084931551 shutdown_connections 2023-10-05T21:15:15.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.814+0000 7fc317efd680 1 --2- 172.21.15.153:0/2084931551 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc2500340f0 0x7fc2500365a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.814+0000 7fc317efd680 1 --2- 172.21.15.153:0/2084931551 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ff88c7040 0x559ff88ccb50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:15.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.814+0000 7fc317efd680 1 -- 172.21.15.153:0/2084931551 >> 172.21.15.153:0/2084931551 conn(0x559ff88c2240 msgr2=0x559ff88c0370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:15.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.814+0000 7fc317efd680 1 -- 172.21.15.153:0/2084931551 shutdown_connections 2023-10-05T21:15:15.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:15.814+0000 7fc317efd680 1 -- 172.21.15.153:0/2084931551 wait complete. 2023-10-05T21:15:15.847 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2023-10-05T21:15:15.847 INFO:teuthology.orchestra.run.smithi153.stdout: "myfoo" 2023-10-05T21:15:15.848 INFO:teuthology.orchestra.run.smithi153.stdout:] 2023-10-05T21:15:15.848 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2023-10-05T21:15:15.856 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T21:15:15.864 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T21:15:15.872 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T21:15:15.915 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=218 failed=True 2023-10-05T21:15:15.943 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T21:15:15.971 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T21:15:15.999 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T21:15:16.000 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2023-10-05T21:15:16.000 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2023-10-05T21:15:16.000 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2023-10-05T21:15:16.044 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:16.044 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:16.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.043+0000 7fd85d47e680 1 Processor -- start 2023-10-05T21:15:16.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.044+0000 7fd85d47e680 1 -- start start 2023-10-05T21:15:16.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.044+0000 7fd85d47e680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x557c5ff4e7e0 0x557c5ff50bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.044+0000 7fd85d47e680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557c5fe98990 con 0x557c5ff4a2b0 2023-10-05T21:15:16.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.044+0000 7fd85d47e680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x557c5fe58db0 con 0x557c5ff4e7e0 2023-10-05T21:15:16.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.044+0000 7fd84fd55700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x557c5ff4e7e0 0x557c5ff50bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.044+0000 7fd850556700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x557c5ff4a2b0 0x557c5ff4a6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56402/0 (socket says 172.21.15.153:56402) 2023-10-05T21:15:16.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.044+0000 7fd850556700 1 -- 172.21.15.153:0/426773263 learned_addr learned my addr 172.21.15.153:0/426773263 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:16.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.044+0000 7fd84f554700 1 -- 172.21.15.153:0/426773263 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3190816784 0 0) 0x557c5fe98990 con 0x557c5ff4a2b0 2023-10-05T21:15:16.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.044+0000 7fd84f554700 1 -- 172.21.15.153:0/426773263 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd838001e10 con 0x557c5ff4a2b0 2023-10-05T21:15:16.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.044+0000 7fd84fd55700 1 -- 172.21.15.153:0/426773263 >> v1:172.21.15.111:6789/0 conn(0x557c5ff4a2b0 legacy=0x557c5ff4a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.044+0000 7fd84fd55700 1 -- 172.21.15.153:0/426773263 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c5ff52110 con 0x557c5ff4e7e0 2023-10-05T21:15:16.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.044+0000 7fd84fd55700 1 --2- 172.21.15.153:0/426773263 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff4e7e0 0x557c5ff50bc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd84000a5d0 tx=0x7fd840005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614409c8eeae1978 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.045+0000 7fd84f554700 1 -- 172.21.15.153:0/426773263 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd840007610 con 0x557c5ff4e7e0 2023-10-05T21:15:16.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.045+0000 7fd84f554700 1 -- 172.21.15.153:0/426773263 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd840007770 con 0x557c5ff4e7e0 2023-10-05T21:15:16.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.045+0000 7fd84f554700 1 -- 172.21.15.153:0/426773263 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd840007a20 con 0x557c5ff4e7e0 2023-10-05T21:15:16.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.045+0000 7fd85d47e680 1 -- 172.21.15.153:0/426773263 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff4e7e0 msgr2=0x557c5ff50bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.045+0000 7fd85d47e680 1 --2- 172.21.15.153:0/426773263 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff4e7e0 0x557c5ff50bc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd84000a5d0 tx=0x7fd840005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:16.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.045+0000 7fd85d47e680 1 -- 172.21.15.153:0/426773263 shutdown_connections 2023-10-05T21:15:16.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.045+0000 7fd85d47e680 1 --2- 172.21.15.153:0/426773263 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff4e7e0 0x557c5ff50bc0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.045+0000 7fd85d47e680 1 -- 172.21.15.153:0/426773263 >> 172.21.15.153:0/426773263 conn(0x557c5ff45b80 msgr2=0x557c5ff47f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.045+0000 7fd85d47e680 1 -- 172.21.15.153:0/426773263 shutdown_connections 2023-10-05T21:15:16.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.045+0000 7fd85d47e680 1 -- 172.21.15.153:0/426773263 wait complete. 2023-10-05T21:15:16.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.046+0000 7fd85d47e680 1 Processor -- start 2023-10-05T21:15:16.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.046+0000 7fd85d47e680 1 -- start start 2023-10-05T21:15:16.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.046+0000 7fd85d47e680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff4a2b0 0x557c5febefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.046+0000 7fd85d47e680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c5fdf8ea0 con 0x557c5ff4a2b0 2023-10-05T21:15:16.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.046+0000 7fd850556700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff4a2b0 0x557c5febefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.046+0000 7fd850556700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff4a2b0 0x557c5febefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50374/0 (socket says 172.21.15.153:50374) 2023-10-05T21:15:16.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.046+0000 7fd850556700 1 -- 172.21.15.153:0/2346969317 learned_addr learned my addr 172.21.15.153:0/2346969317 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:16.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.046+0000 7fd850556700 1 -- 172.21.15.153:0/2346969317 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd840005cf0 con 0x557c5ff4a2b0 2023-10-05T21:15:16.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.046+0000 7fd850556700 1 --2- 172.21.15.153:0/2346969317 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff4a2b0 0x557c5febefe0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd844001c30 tx=0x7fd844001810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55ab6ea6fd2ecfbf server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.047+0000 7fd84e552700 1 -- 172.21.15.153:0/2346969317 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd84400bc80 con 0x557c5ff4a2b0 2023-10-05T21:15:16.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.047+0000 7fd84e552700 1 -- 172.21.15.153:0/2346969317 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84400bde0 con 0x557c5ff4a2b0 2023-10-05T21:15:16.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.047+0000 7fd84e552700 1 -- 172.21.15.153:0/2346969317 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd84400e5f0 con 0x557c5ff4a2b0 2023-10-05T21:15:16.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.047+0000 7fd85d47e680 1 -- 172.21.15.153:0/2346969317 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff4a2b0 msgr2=0x557c5febefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.047+0000 7fd85d47e680 1 --2- 172.21.15.153:0/2346969317 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff4a2b0 0x557c5febefe0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd844001c30 tx=0x7fd844001810 comp rx=0 tx=0).stop 2023-10-05T21:15:16.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.047+0000 7fd85d47e680 1 -- 172.21.15.153:0/2346969317 shutdown_connections 2023-10-05T21:15:16.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.047+0000 7fd85d47e680 1 --2- 172.21.15.153:0/2346969317 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff4a2b0 0x557c5febefe0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.047+0000 7fd85d47e680 1 -- 172.21.15.153:0/2346969317 >> 172.21.15.153:0/2346969317 conn(0x557c5ff45b80 msgr2=0x557c5ff65070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.047+0000 7fd85d47e680 1 -- 172.21.15.153:0/2346969317 shutdown_connections 2023-10-05T21:15:16.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.047+0000 7fd85d47e680 1 -- 172.21.15.153:0/2346969317 wait complete. 2023-10-05T21:15:16.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.047+0000 7fd85d47e680 1 Processor -- start 2023-10-05T21:15:16.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.048+0000 7fd85d47e680 1 -- start start 2023-10-05T21:15:16.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.048+0000 7fd85d47e680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff4a2b0 0x557c5ff71be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.048+0000 7fd85d47e680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c5fdefc80 con 0x557c5ff4a2b0 2023-10-05T21:15:16.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.048+0000 7fd850556700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff4a2b0 0x557c5ff71be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.048+0000 7fd850556700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff4a2b0 0x557c5ff71be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50380/0 (socket says 172.21.15.153:50380) 2023-10-05T21:15:16.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.048+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 learned_addr learned my addr 172.21.15.153:0/950114270 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:16.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.048+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd838001e10 con 0x557c5ff4a2b0 2023-10-05T21:15:16.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.048+0000 7fd850556700 1 --2- 172.21.15.153:0/950114270 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff4a2b0 0x557c5ff71be0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd844010000 tx=0x7fd844014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.049+0000 7fd84cd4f700 1 -- 172.21.15.153:0/950114270 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd84401f070 con 0x557c5ff4a2b0 2023-10-05T21:15:16.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.049+0000 7fd84cd4f700 1 -- 172.21.15.153:0/950114270 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84401a2e0 con 0x557c5ff4a2b0 2023-10-05T21:15:16.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.049+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557c5ff72120 con 0x557c5ff4a2b0 2023-10-05T21:15:16.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.049+0000 7fd84cd4f700 1 -- 172.21.15.153:0/950114270 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd84401a610 con 0x557c5ff4a2b0 2023-10-05T21:15:16.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.049+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557c5ff72570 con 0x557c5ff4a2b0 2023-10-05T21:15:16.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.049+0000 7fd85d47e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.050+0000 7fd84cd4f700 1 -- 172.21.15.153:0/950114270 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fd84401a770 con 0x557c5ff4a2b0 2023-10-05T21:15:16.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.050+0000 7fd84cd4f700 1 --2- 172.21.15.153:0/950114270 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd83c034130 0x7fd83c0365e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.050+0000 7fd84cd4f700 1 -- 172.21.15.153:0/950114270 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fd844048d10 con 0x557c5ff4a2b0 2023-10-05T21:15:16.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.050+0000 7fd84fd55700 1 --2- 172.21.15.153:0/950114270 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd83c034130 0x7fd83c0365e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.050+0000 7fd85d47e680 1 --2- 172.21.15.153:0/950114270 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x557c5ff4e7e0 0x557c5ff7d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.050+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff7e0d0 con 0x557c5ff4e7e0 2023-10-05T21:15:16.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.050+0000 7fd850d57700 1 --2- 172.21.15.153:0/950114270 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x557c5ff4e7e0 0x557c5ff7d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.050+0000 7fd84fd55700 1 --2- 172.21.15.153:0/950114270 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd83c034130 0x7fd83c0365e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd840005a90 tx=0x7fd840014000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.050+0000 7fd850d57700 1 --2- 172.21.15.153:0/950114270 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x557c5ff4e7e0 0x557c5ff7d940 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.051+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.051+0000 7fd85d47e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.051+0000 7fd85d47e680 20 realm 2023-10-05T21:15:16.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.051+0000 7fd85d47e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.051+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff7af20 con 0x557c5ff4e7e0 2023-10-05T21:15:16.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.051+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.051+0000 7fd85d47e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.051+0000 7fd85d47e680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:16.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.051+0000 7fd85d47e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.051+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff7ebd0 con 0x557c5ff4e7e0 2023-10-05T21:15:16.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.051+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.051+0000 7fd85d47e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.051+0000 7fd85d47e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.051+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff7e810 con 0x557c5ff4e7e0 2023-10-05T21:15:16.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.051+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.051+0000 7fd85d47e680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.051+0000 7fd85d47e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.051+0000 7fd85d47e680 1 --2- 172.21.15.153:0/950114270 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x557c5ff7ff90 0x557c5ff82370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.051+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff828b0 con 0x557c5ff7ff90 2023-10-05T21:15:16.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.051+0000 7fd850556700 1 --2- 172.21.15.153:0/950114270 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x557c5ff7ff90 0x557c5ff82370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.052+0000 7fd850556700 1 --2- 172.21.15.153:0/950114270 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x557c5ff7ff90 0x557c5ff82370 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.052+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.052+0000 7fd85d47e680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:16.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.052+0000 7fd85d47e680 20 searching for the correct realm 2023-10-05T21:15:16.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.052+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x557c5ff7ff90 2023-10-05T21:15:16.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.052+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.052+0000 7fd850556700 1 --2- 172.21.15.153:0/950114270 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fd844016730 0x7fd844041050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.052+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x7fd844016730 2023-10-05T21:15:16.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.052+0000 7fd84fd55700 1 --2- 172.21.15.153:0/950114270 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fd844016730 0x7fd844041050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.053+0000 7fd84fd55700 1 --2- 172.21.15.153:0/950114270 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fd844016730 0x7fd844041050 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.053+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd840007cc0 con 0x7fd844016730 2023-10-05T21:15:16.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.053+0000 7fd84fd55700 1 --2- 172.21.15.153:0/950114270 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fd840007030 0x7fd84001d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.053+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x7fd840007030 2023-10-05T21:15:16.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.053+0000 7fd850d57700 1 --2- 172.21.15.153:0/950114270 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fd840007030 0x7fd84001d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.053+0000 7fd850d57700 1 --2- 172.21.15.153:0/950114270 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fd840007030 0x7fd84001d430 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.054+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd84800a570 con 0x7fd840007030 2023-10-05T21:15:16.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.054+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x557c5ff4e7e0 2023-10-05T21:15:16.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.054+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.054+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x557c5ff4e7e0 2023-10-05T21:15:16.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.054+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.054+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x7fd840007030 2023-10-05T21:15:16.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.054+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd84800a570 con 0x7fd840007030 2023-10-05T21:15:16.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.054+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x7fd840007030 2023-10-05T21:15:16.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.055+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd84800a570 con 0x7fd840007030 2023-10-05T21:15:16.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.055+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x7fd844016730 2023-10-05T21:15:16.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.055+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd840029040 con 0x7fd844016730 2023-10-05T21:15:16.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.055+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x557c5ff7ff90 2023-10-05T21:15:16.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.055+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.055+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x557c5ff4e7e0 2023-10-05T21:15:16.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.055+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.055+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x7fd840007030 2023-10-05T21:15:16.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.056+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd84800a570 con 0x7fd840007030 2023-10-05T21:15:16.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.056+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x557c5ff4e7e0 2023-10-05T21:15:16.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.056+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.056+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x7fd844016730 2023-10-05T21:15:16.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.056+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd840029040 con 0x7fd844016730 2023-10-05T21:15:16.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.056+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x557c5ff7ff90 2023-10-05T21:15:16.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.056+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.056+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x557c5ff7ff90 2023-10-05T21:15:16.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.056+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.056+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x7fd840007030 2023-10-05T21:15:16.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.057+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd84800a570 con 0x7fd840007030 2023-10-05T21:15:16.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.057+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x557c5ff7ff90 2023-10-05T21:15:16.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.057+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.057+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x557c5ff7ff90 2023-10-05T21:15:16.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.057+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.057+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x557c5ff4e7e0 2023-10-05T21:15:16.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.057+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.057+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x557c5ff4e7e0 2023-10-05T21:15:16.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.057+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.058+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x7fd840007030 2023-10-05T21:15:16.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.058+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd84800a570 con 0x7fd840007030 2023-10-05T21:15:16.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.058+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x557c5ff7ff90 2023-10-05T21:15:16.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.058+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.058+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x7fd844016730 2023-10-05T21:15:16.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.059+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd840029040 con 0x7fd844016730 2023-10-05T21:15:16.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.059+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x557c5ff4e7e0 2023-10-05T21:15:16.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.059+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.059+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x7fd840007030 2023-10-05T21:15:16.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.059+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd84800a570 con 0x7fd840007030 2023-10-05T21:15:16.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.059+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x557c5ff7ff90 2023-10-05T21:15:16.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.059+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.059+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x7fd840007030 2023-10-05T21:15:16.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.060+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd84800a570 con 0x7fd840007030 2023-10-05T21:15:16.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.060+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x7fd844016730 2023-10-05T21:15:16.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.060+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd840029040 con 0x7fd844016730 2023-10-05T21:15:16.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.060+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x557c5ff7ff90 2023-10-05T21:15:16.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.060+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.060+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x7fd840007030 2023-10-05T21:15:16.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.061+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd84800a570 con 0x7fd840007030 2023-10-05T21:15:16.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.061+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x557c5ff4e7e0 2023-10-05T21:15:16.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.061+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.061+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84160 con 0x7fd844016730 2023-10-05T21:15:16.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.061+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd840029040 con 0x7fd844016730 2023-10-05T21:15:16.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.061+0000 7fd85d47e680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:16.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.061+0000 7fd85d47e680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:16.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.061+0000 7fd85d47e680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:16.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.061+0000 7fd85d47e680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:16.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.061+0000 7fd85d47e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.061+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff83200 con 0x557c5ff4e7e0 2023-10-05T21:15:16.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.061+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.061+0000 7fd85d47e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.061+0000 7fd85d47e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.061+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff82e00 con 0x557c5ff4e7e0 2023-10-05T21:15:16.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.062+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.062+0000 7fd85d47e680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.062+0000 7fd85d47e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.062+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff83b40 con 0x557c5ff4e7e0 2023-10-05T21:15:16.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.062+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.062+0000 7fd85d47e680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:16.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.062+0000 7fd85d47e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.062+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff84510 con 0x557c5ff7ff90 2023-10-05T21:15:16.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.062+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.062+0000 7fd85d47e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.062+0000 7fd85d47e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.062+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff848c0 con 0x557c5ff4e7e0 2023-10-05T21:15:16.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.062+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.062+0000 7fd85d47e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.062+0000 7fd85d47e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.062+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff836f0 con 0x557c5ff4e7e0 2023-10-05T21:15:16.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.062+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.062+0000 7fd85d47e680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.063+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff836c0 con 0x557c5ff7ff90 2023-10-05T21:15:16.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.063+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.063+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff836c0 con 0x7fd844016730 2023-10-05T21:15:16.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.063+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd840029040 con 0x7fd844016730 2023-10-05T21:15:16.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.063+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff836c0 con 0x7fd840007030 2023-10-05T21:15:16.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.063+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd84800a570 con 0x7fd840007030 2023-10-05T21:15:16.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.063+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff848c0 con 0x557c5ff4e7e0 2023-10-05T21:15:16.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.063+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.063+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff848c0 con 0x557c5ff4e7e0 2023-10-05T21:15:16.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.064+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.064+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff848c0 con 0x7fd840007030 2023-10-05T21:15:16.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.064+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd84800a570 con 0x7fd840007030 2023-10-05T21:15:16.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.064+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff848c0 con 0x7fd840007030 2023-10-05T21:15:16.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.064+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd84800a570 con 0x7fd840007030 2023-10-05T21:15:16.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.064+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff848c0 con 0x7fd844016730 2023-10-05T21:15:16.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.064+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd840029040 con 0x7fd844016730 2023-10-05T21:15:16.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.064+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff848c0 con 0x557c5ff7ff90 2023-10-05T21:15:16.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.065+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.065+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff848c0 con 0x557c5ff4e7e0 2023-10-05T21:15:16.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.065+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.065+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff848c0 con 0x7fd840007030 2023-10-05T21:15:16.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.065+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd84800a570 con 0x7fd840007030 2023-10-05T21:15:16.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.065+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff848c0 con 0x557c5ff4e7e0 2023-10-05T21:15:16.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.065+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.065+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff848c0 con 0x7fd844016730 2023-10-05T21:15:16.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.065+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd840029040 con 0x7fd844016730 2023-10-05T21:15:16.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.065+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff848c0 con 0x557c5ff7ff90 2023-10-05T21:15:16.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.066+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.066+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff848c0 con 0x557c5ff7ff90 2023-10-05T21:15:16.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.066+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.066+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff848c0 con 0x7fd840007030 2023-10-05T21:15:16.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.066+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd84800a570 con 0x7fd840007030 2023-10-05T21:15:16.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.066+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff848c0 con 0x557c5ff7ff90 2023-10-05T21:15:16.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.066+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.066+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff848c0 con 0x557c5ff7ff90 2023-10-05T21:15:16.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.066+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.066+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff848c0 con 0x557c5ff4e7e0 2023-10-05T21:15:16.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.067+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.067+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff848c0 con 0x557c5ff4e7e0 2023-10-05T21:15:16.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.067+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.067+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff848c0 con 0x7fd840007030 2023-10-05T21:15:16.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.067+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd84800a570 con 0x7fd840007030 2023-10-05T21:15:16.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.067+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff848c0 con 0x557c5ff7ff90 2023-10-05T21:15:16.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.067+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.067+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff848c0 con 0x7fd844016730 2023-10-05T21:15:16.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.067+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd840029040 con 0x7fd844016730 2023-10-05T21:15:16.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.067+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff848c0 con 0x557c5ff4e7e0 2023-10-05T21:15:16.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.068+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.068+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff848c0 con 0x7fd840007030 2023-10-05T21:15:16.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.068+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd84800a570 con 0x7fd840007030 2023-10-05T21:15:16.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.068+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff848c0 con 0x557c5ff7ff90 2023-10-05T21:15:16.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.068+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.068+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff848c0 con 0x7fd840007030 2023-10-05T21:15:16.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.068+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd84800a570 con 0x7fd840007030 2023-10-05T21:15:16.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.068+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff848c0 con 0x7fd844016730 2023-10-05T21:15:16.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.069+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd840029040 con 0x7fd844016730 2023-10-05T21:15:16.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.069+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff848c0 con 0x557c5ff7ff90 2023-10-05T21:15:16.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.069+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.069+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff848c0 con 0x7fd840007030 2023-10-05T21:15:16.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.069+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd84800a570 con 0x7fd840007030 2023-10-05T21:15:16.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.069+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff848c0 con 0x557c5ff4e7e0 2023-10-05T21:15:16.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.069+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.069+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff848c0 con 0x7fd844016730 2023-10-05T21:15:16.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.069+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd840029040 con 0x7fd844016730 2023-10-05T21:15:16.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.069+0000 7fd85d47e680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:16.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.069+0000 7fd85d47e680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:16.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.069+0000 7fd85d47e680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:16.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.069+0000 7fd85d47e680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:16.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.069+0000 7fd85d47e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.069+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff836c0 con 0x557c5ff4e7e0 2023-10-05T21:15:16.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.070+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.070+0000 7fd85d47e680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.070+0000 7fd85d47e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.070+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff85230 con 0x557c5ff7ff90 2023-10-05T21:15:16.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.070+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.070+0000 7fd85d47e680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:16.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.070+0000 7fd85d47e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.070+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff85ad0 con 0x557c5ff4e7e0 2023-10-05T21:15:16.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.070+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.070+0000 7fd85d47e680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.070+0000 7fd85d47e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.070+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff85ad0 con 0x557c5ff4e7e0 2023-10-05T21:15:16.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.070+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.070+0000 7fd85d47e680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:16.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.070+0000 7fd85d47e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.070+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff85b30 con 0x7fd840007030 2023-10-05T21:15:16.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.071+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fd84800a570 con 0x7fd840007030 2023-10-05T21:15:16.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.071+0000 7fd85d47e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.071+0000 7fd85d47e680 20 zone default found 2023-10-05T21:15:16.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.071+0000 7fd85d47e680 4 Realm: () 2023-10-05T21:15:16.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.071+0000 7fd85d47e680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:16.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.071+0000 7fd85d47e680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:16.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.071+0000 7fd85d47e680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:16.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.071+0000 7fd85d47e680 20 zonegroup default 2023-10-05T21:15:16.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.071+0000 7fd85d47e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.071+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff85b30 con 0x7fd840007030 2023-10-05T21:15:16.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.071+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd84800a570 con 0x7fd840007030 2023-10-05T21:15:16.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.071+0000 7fd85d47e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.071+0000 7fd85d47e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.071+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff874b0 con 0x557c5ff7ff90 2023-10-05T21:15:16.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.071+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.071+0000 7fd85d47e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.071+0000 7fd85d47e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.071+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff87860 con 0x557c5ff7ff90 2023-10-05T21:15:16.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.072+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.072+0000 7fd85d47e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.072+0000 7fd85d47e680 20 started sync module instance, tier type = 2023-10-05T21:15:16.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.072+0000 7fd85d47e680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:16.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.072+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff86bc0 con 0x7fd844016730 2023-10-05T21:15:16.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.072+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd840029040 con 0x7fd844016730 2023-10-05T21:15:16.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.072+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93992674422720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff88100 con 0x7fd844016730 2023-10-05T21:15:16.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.072+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff889a0 con 0x557c5ff4e7e0 2023-10-05T21:15:16.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.073+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 93992674422720] v29'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd840029040 con 0x7fd844016730 2023-10-05T21:15:16.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.073+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.073+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93992674428080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff88df0 con 0x557c5ff4e7e0 2023-10-05T21:15:16.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.073+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff89690 con 0x557c5ff7ff90 2023-10-05T21:15:16.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.074+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 93992674428080] v29'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.074+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.074+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93992674429504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff89a90 con 0x557c5ff7ff90 2023-10-05T21:15:16.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.074+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff8a4a0 con 0x7fd844016730 2023-10-05T21:15:16.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.075+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd840029040 con 0x7fd844016730 2023-10-05T21:15:16.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.075+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 93992674437200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff8b190 con 0x7fd844016730 2023-10-05T21:15:16.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.075+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff8bba0 con 0x557c5ff4e7e0 2023-10-05T21:15:16.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.075+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 93992674429504] v29'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.076+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 93992674437200] v29'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd840029040 con 0x7fd844016730 2023-10-05T21:15:16.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.076+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.076+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 93992674430608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff8adc0 con 0x557c5ff4e7e0 2023-10-05T21:15:16.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.076+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff8c280 con 0x7fd840007030 2023-10-05T21:15:16.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.077+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 93992674430608] v29'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.077+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd84800a570 con 0x7fd840007030 2023-10-05T21:15:16.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.077+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 93992674442608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff8c280 con 0x7fd840007030 2023-10-05T21:15:16.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.077+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff8cc90 con 0x7fd840007030 2023-10-05T21:15:16.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.077+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 93992674442608] v29'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd84800a570 con 0x7fd840007030 2023-10-05T21:15:16.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.077+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd84800a570 con 0x7fd840007030 2023-10-05T21:15:16.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.077+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93992674440880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff8cc90 con 0x7fd840007030 2023-10-05T21:15:16.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.077+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff8d730 con 0x7fd840007030 2023-10-05T21:15:16.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.078+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 93992674440880] v29'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd84800a570 con 0x7fd840007030 2023-10-05T21:15:16.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.078+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd84800a570 con 0x7fd840007030 2023-10-05T21:15:16.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.078+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93992674447840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff8cc90 con 0x7fd840007030 2023-10-05T21:15:16.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.078+0000 7fd85d47e680 20 add_watcher() i=0 2023-10-05T21:15:16.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.078+0000 7fd85d47e680 20 add_watcher() i=1 2023-10-05T21:15:16.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.078+0000 7fd85d47e680 20 add_watcher() i=2 2023-10-05T21:15:16.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.078+0000 7fd85d47e680 20 add_watcher() i=3 2023-10-05T21:15:16.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.078+0000 7fd85d47e680 20 add_watcher() i=4 2023-10-05T21:15:16.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.078+0000 7fd85d47e680 20 add_watcher() i=5 2023-10-05T21:15:16.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.078+0000 7fd85d47e680 20 add_watcher() i=6 2023-10-05T21:15:16.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.079+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 93992674447840] v29'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd84800a570 con 0x7fd840007030 2023-10-05T21:15:16.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.079+0000 7fd85d47e680 20 add_watcher() i=7 2023-10-05T21:15:16.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.079+0000 7fd85d47e680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:16.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.079+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff90b90 con 0x557c5ff4e7e0 2023-10-05T21:15:16.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.079+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.079+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93992674445680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff8e050 con 0x557c5ff4e7e0 2023-10-05T21:15:16.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.080+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 93992674445680] v29'96 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.080+0000 7fd821fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:16.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.080+0000 7fd85d47e680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:16.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.080+0000 7fd85d47e680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:16.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.080+0000 7fd85d47e680 1 Processor -- start 2023-10-05T21:15:16.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.080+0000 7fd85d47e680 1 -- start start 2023-10-05T21:15:16.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.081+0000 7fd85d47e680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff9b6a0 0x557c5ff9bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.081+0000 7fd85d47e680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c5ff9c080 con 0x557c5ff9b6a0 2023-10-05T21:15:16.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.081+0000 7fd84fd55700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff9b6a0 0x557c5ff9bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.081+0000 7fd84fd55700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff9b6a0 0x557c5ff9bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50390/0 (socket says 172.21.15.153:50390) 2023-10-05T21:15:16.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.081+0000 7fd84fd55700 1 -- 172.21.15.153:0/3327301658 learned_addr learned my addr 172.21.15.153:0/3327301658 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:16.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.081+0000 7fd84fd55700 1 -- 172.21.15.153:0/3327301658 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c5ff9c1c0 con 0x557c5ff9b6a0 2023-10-05T21:15:16.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.081+0000 7fd84fd55700 1 --2- 172.21.15.153:0/3327301658 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff9b6a0 0x557c5ff9bab0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd840002000 tx=0x7fd840030040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=318c9c2b46901d33 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.081+0000 7fd8217e2700 1 -- 172.21.15.153:0/3327301658 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd840025040 con 0x557c5ff9b6a0 2023-10-05T21:15:16.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.081+0000 7fd8217e2700 1 -- 172.21.15.153:0/3327301658 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd840034070 con 0x557c5ff9b6a0 2023-10-05T21:15:16.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.081+0000 7fd8217e2700 1 -- 172.21.15.153:0/3327301658 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd84001de80 con 0x557c5ff9b6a0 2023-10-05T21:15:16.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.082+0000 7fd85d47e680 1 -- 172.21.15.153:0/3327301658 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff9b6a0 msgr2=0x557c5ff9bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.082+0000 7fd85d47e680 1 --2- 172.21.15.153:0/3327301658 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff9b6a0 0x557c5ff9bab0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd840002000 tx=0x7fd840030040 comp rx=0 tx=0).stop 2023-10-05T21:15:16.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.082+0000 7fd85d47e680 1 -- 172.21.15.153:0/3327301658 shutdown_connections 2023-10-05T21:15:16.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.082+0000 7fd85d47e680 1 --2- 172.21.15.153:0/3327301658 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff9b6a0 0x557c5ff9bab0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.082+0000 7fd85d47e680 1 -- 172.21.15.153:0/3327301658 >> 172.21.15.153:0/3327301658 conn(0x557c5ff968a0 msgr2=0x557c5ff94a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.082+0000 7fd85d47e680 1 -- 172.21.15.153:0/3327301658 shutdown_connections 2023-10-05T21:15:16.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.082+0000 7fd85d47e680 1 -- 172.21.15.153:0/3327301658 wait complete. 2023-10-05T21:15:16.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.082+0000 7fd85d47e680 1 Processor -- start 2023-10-05T21:15:16.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.082+0000 7fd85d47e680 1 -- start start 2023-10-05T21:15:16.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.083+0000 7fd85d47e680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff9b6a0 0x557c5ffa1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.083+0000 7fd85d47e680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c5ffa1750 con 0x557c5ff9b6a0 2023-10-05T21:15:16.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.083+0000 7fd84fd55700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff9b6a0 0x557c5ffa1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.083+0000 7fd84fd55700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff9b6a0 0x557c5ffa1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50398/0 (socket says 172.21.15.153:50398) 2023-10-05T21:15:16.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.083+0000 7fd84fd55700 1 -- 172.21.15.153:0/2766636855 learned_addr learned my addr 172.21.15.153:0/2766636855 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:16.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.083+0000 7fd84fd55700 1 -- 172.21.15.153:0/2766636855 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c5ff52110 con 0x557c5ff9b6a0 2023-10-05T21:15:16.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.083+0000 7fd84fd55700 1 --2- 172.21.15.153:0/2766636855 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff9b6a0 0x557c5ffa1210 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x557c5ff95e10 tx=0x7fd840034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.083+0000 7fd79b7fe700 1 -- 172.21.15.153:0/2766636855 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd840025040 con 0x557c5ff9b6a0 2023-10-05T21:15:16.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.083+0000 7fd79b7fe700 1 -- 172.21.15.153:0/2766636855 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84002d6e0 con 0x557c5ff9b6a0 2023-10-05T21:15:16.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.083+0000 7fd85d47e680 1 -- 172.21.15.153:0/2766636855 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557c5ffa1950 con 0x557c5ff9b6a0 2023-10-05T21:15:16.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.083+0000 7fd79b7fe700 1 -- 172.21.15.153:0/2766636855 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd84002d8b0 con 0x557c5ff9b6a0 2023-10-05T21:15:16.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.083+0000 7fd85d47e680 1 -- 172.21.15.153:0/2766636855 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557c5ffa1da0 con 0x557c5ff9b6a0 2023-10-05T21:15:16.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.084+0000 7fd79b7fe700 1 -- 172.21.15.153:0/2766636855 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fd840041050 con 0x557c5ff9b6a0 2023-10-05T21:15:16.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.084+0000 7fd79b7fe700 1 --2- 172.21.15.153:0/2766636855 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd790034140 0x7fd7900365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.084+0000 7fd79b7fe700 1 -- 172.21.15.153:0/2766636855 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fd84004eb20 con 0x557c5ff9b6a0 2023-10-05T21:15:16.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.084+0000 7fd850d57700 1 --2- 172.21.15.153:0/2766636855 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd790034140 0x7fd7900365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.084+0000 7fd85d47e680 5 note: GC not initialized 2023-10-05T21:15:16.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.085+0000 7fd850d57700 1 --2- 172.21.15.153:0/2766636855 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd790034140 0x7fd7900365f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x557c5ff8cec0 tx=0x7fd84800aea0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.085+0000 7fd798ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:16.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.085+0000 7fd78e7fc700 20 reqs_thread_entry: start 2023-10-05T21:15:16.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.086+0000 7fd85d47e680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:16.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.086+0000 7fd85d47e680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:16.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.086+0000 7fd78cff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:46 2023 2023-10-05T21:15:16.124 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:16.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.086+0000 7fd773fff700 20 reqs_thread_entry: start 2023-10-05T21:15:16.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.086+0000 7fd85d47e680 20 get_system_obj_state: rctx=0x7ffcc5a009c0 obj=default.rgw.meta:root:myfoo state=0x557c5fdfe240 s->prefetch_data=0 2023-10-05T21:15:16.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.086+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:102 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c60007470 con 0x7fd844016730 2023-10-05T21:15:16.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.086+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(102 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7fd840029040 con 0x7fd844016730 2023-10-05T21:15:16.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.086+0000 7fd85d47e680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:16.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.086+0000 7fd85d47e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.086+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:103 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c60009840 con 0x7fd844016730 2023-10-05T21:15:16.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.086+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(103 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7fd840029040 con 0x7fd844016730 2023-10-05T21:15:16.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.087+0000 7fd85d47e680 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T21:15:16.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.087+0000 7fd85d47e680 20 get_system_obj_state: rctx=0x7ffcc5a009c0 obj=default.rgw.meta:root:.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 state=0x557c5fdfe500 s->prefetch_data=0 2023-10-05T21:15:16.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.087+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:104 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c60007d10 con 0x557c5ff7ff90 2023-10-05T21:15:16.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.087+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(104 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.087+0000 7fd85d47e680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:16.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.087+0000 7fd85d47e680 20 Read xattr: user.rgw.acl 2023-10-05T21:15:16.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.087+0000 7fd85d47e680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:16.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.087+0000 7fd85d47e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.087+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:105 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c6000a830 con 0x557c5ff7ff90 2023-10-05T21:15:16.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.087+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(105 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.087+0000 7fd85d47e680 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T21:15:16.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.087+0000 7fd85d47e680 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T21:15:16.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.087+0000 7fd85d47e680 20 get_system_obj_state: rctx=0x7ffcc5a00910 obj=default.rgw.meta:root:myfoo state=0x557c5fdfe500 s->prefetch_data=0 2023-10-05T21:15:16.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.087+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:106 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c60009b50 con 0x7fd844016730 2023-10-05T21:15:16.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.088+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(106 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7fd840029040 con 0x7fd844016730 2023-10-05T21:15:16.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.088+0000 7fd85d47e680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:16.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.088+0000 7fd85d47e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.088+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:107 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c6000a100 con 0x7fd844016730 2023-10-05T21:15:16.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.088+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(107 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7fd840029040 con 0x7fd844016730 2023-10-05T21:15:16.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.088+0000 7fd85d47e680 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T21:15:16.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.088+0000 7fd85d47e680 20 get_system_obj_state: rctx=0x7ffcc5a00910 obj=default.rgw.meta:root:.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 state=0x557c5fdfe240 s->prefetch_data=0 2023-10-05T21:15:16.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.088+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:108 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c6000a700 con 0x557c5ff7ff90 2023-10-05T21:15:16.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.088+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(108 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.088+0000 7fd85d47e680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:16.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.088+0000 7fd85d47e680 20 Read xattr: user.rgw.acl 2023-10-05T21:15:16.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.088+0000 7fd85d47e680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:16.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.088+0000 7fd85d47e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.088+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:109 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c6000ce70 con 0x557c5ff7ff90 2023-10-05T21:15:16.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.089+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== osd_op_reply(109 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.089+0000 7fd85d47e680 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T21:15:16.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.089+0000 7fd85d47e680 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T21:15:16.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.089+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:110 4.6 4:63e054bc:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c60009280 con 0x557c5ff7ff90 2023-10-05T21:15:16.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.089+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:111 4.18 4:1a996cea:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c6000f7c0 con 0x7fd844016730 2023-10-05T21:15:16.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.089+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:112 4.18 4:198ebb7d:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c60009280 con 0x7fd844016730 2023-10-05T21:15:16.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.089+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:113 4.1e 4:7ac3851f:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c60014590 con 0x7fd840007030 2023-10-05T21:15:16.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.089+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:114 4.20 4:0486cb16:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c60017120 con 0x557c5ff4e7e0 2023-10-05T21:15:16.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.089+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:115 4.1a 4:5b58f5c0:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c60019d10 con 0x7fd844016730 2023-10-05T21:15:16.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.089+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:116 4.14 4:2bb8f6a0:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c6001cc20 con 0x557c5ff7ff90 2023-10-05T21:15:16.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.089+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:117 4.3f 4:fc00c6e8:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c6001f5c0 con 0x7fd844016730 2023-10-05T21:15:16.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.089+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:118 4.35 4:afba4511:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c60022090 con 0x557c5ff4e7e0 2023-10-05T21:15:16.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.089+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:119 4.5 4:a0455ddf:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c60024950 con 0x557c5ff7ff90 2023-10-05T21:15:16.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.089+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:120 4.a 4:50c49731:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c600276b0 con 0x7fd844016730 2023-10-05T21:15:16.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.089+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(110 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.089+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== osd_op_reply(111 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd84005a040 con 0x7fd844016730 2023-10-05T21:15:16.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.089+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 <== osd.2 v2:172.21.15.153:6807/140454 22 ==== osd_op_reply(115 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd84005a040 con 0x7fd844016730 2023-10-05T21:15:16.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.089+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 <== osd.2 v2:172.21.15.153:6807/140454 23 ==== osd_op_reply(117 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd84005a040 con 0x7fd844016730 2023-10-05T21:15:16.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.089+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(113 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd84800a570 con 0x7fd840007030 2023-10-05T21:15:16.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.089+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(114 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.089+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(118 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.090+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 31 ==== osd_op_reply(119 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.090+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 <== osd.2 v2:172.21.15.153:6807/140454 24 ==== osd_op_reply(120 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd84005a040 con 0x7fd844016730 2023-10-05T21:15:16.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.090+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 <== osd.2 v2:172.21.15.153:6807/140454 25 ==== osd_op_reply(112 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.2 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd84005a040 con 0x7fd844016730 2023-10-05T21:15:16.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.090+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 32 ==== osd_op_reply(116 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.090+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:121 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93992674422720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c60019640 con 0x7fd844016730 2023-10-05T21:15:16.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.091+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 <== osd.2 v2:172.21.15.153:6807/140454 26 ==== osd_op_reply(121 notify.0 [watch unwatch cookie 93992674422720] v29'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd84005a040 con 0x7fd844016730 2023-10-05T21:15:16.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.091+0000 7fd85d47e680 20 remove_watcher() i=0 2023-10-05T21:15:16.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.091+0000 7fd85d47e680 2 removed watcher, disabling cache 2023-10-05T21:15:16.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.091+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:122 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93992674428080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff86fc0 con 0x557c5ff4e7e0 2023-10-05T21:15:16.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.091+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(122 notify.1 [watch unwatch cookie 93992674428080] v29'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.091+0000 7fd85d47e680 20 remove_watcher() i=1 2023-10-05T21:15:16.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.091+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:123 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93992674429504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff86fc0 con 0x557c5ff7ff90 2023-10-05T21:15:16.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.092+0000 7fd850556700 1 -- 172.21.15.153:0/950114270 <== osd.3 v2:172.21.15.153:6800/140455 33 ==== osd_op_reply(123 notify.2 [watch unwatch cookie 93992674429504] v29'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd844014070 con 0x557c5ff7ff90 2023-10-05T21:15:16.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.092+0000 7fd85d47e680 20 remove_watcher() i=2 2023-10-05T21:15:16.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.092+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:124 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93992674437200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff88a40 con 0x7fd844016730 2023-10-05T21:15:16.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.093+0000 7fd84fd55700 1 -- 172.21.15.153:0/950114270 <== osd.2 v2:172.21.15.153:6807/140454 27 ==== osd_op_reply(124 notify.3 [watch unwatch cookie 93992674437200] v29'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd84005a040 con 0x7fd844016730 2023-10-05T21:15:16.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.093+0000 7fd85d47e680 20 remove_watcher() i=3 2023-10-05T21:15:16.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.093+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:125 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93992674430608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff86fc0 con 0x557c5ff4e7e0 2023-10-05T21:15:16.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.094+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(125 notify.4 [watch unwatch cookie 93992674430608] v29'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.094+0000 7fd85d47e680 20 remove_watcher() i=4 2023-10-05T21:15:16.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.094+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:126 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93992674442608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff8a850 con 0x7fd840007030 2023-10-05T21:15:16.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.094+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(126 notify.5 [watch unwatch cookie 93992674442608] v29'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd84800a570 con 0x7fd840007030 2023-10-05T21:15:16.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.095+0000 7fd85d47e680 20 remove_watcher() i=5 2023-10-05T21:15:16.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.095+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:127 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93992674440880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff86fc0 con 0x7fd840007030 2023-10-05T21:15:16.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.095+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(127 notify.6 [watch unwatch cookie 93992674440880] v29'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd84800a570 con 0x7fd840007030 2023-10-05T21:15:16.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.095+0000 7fd85d47e680 20 remove_watcher() i=6 2023-10-05T21:15:16.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.095+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:128 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93992674447840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ff8bd70 con 0x7fd840007030 2023-10-05T21:15:16.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.096+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(128 notify.7 [watch unwatch cookie 93992674447840] v29'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd84800a570 con 0x7fd840007030 2023-10-05T21:15:16.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.096+0000 7fd85d47e680 20 remove_watcher() i=7 2023-10-05T21:15:16.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.097+0000 7fd821fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:16.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.097+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:129 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93992674445680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557c5ffc8f50 con 0x557c5ff4e7e0 2023-10-05T21:15:16.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.097+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(129 data_loggenerations_metadata [watch unwatch cookie 93992674445680] v29'97 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd84800a570 con 0x557c5ff4e7e0 2023-10-05T21:15:16.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.097+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fd840007030 msgr2=0x7fd84001d430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.097+0000 7fd85d47e680 1 --2- 172.21.15.153:0/950114270 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fd840007030 0x7fd84001d430 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.097+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x557c5ff4e7e0 msgr2=0x557c5ff7d940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.097+0000 7fd85d47e680 1 --2- 172.21.15.153:0/950114270 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x557c5ff4e7e0 0x557c5ff7d940 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.097+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fd844016730 msgr2=0x7fd844041050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.097+0000 7fd85d47e680 1 --2- 172.21.15.153:0/950114270 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fd844016730 0x7fd844041050 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.097+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x557c5ff7ff90 msgr2=0x557c5ff82370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.097+0000 7fd85d47e680 1 --2- 172.21.15.153:0/950114270 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x557c5ff7ff90 0x557c5ff82370 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.098+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd83c034130 msgr2=0x7fd83c0365e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.098+0000 7fd85d47e680 1 --2- 172.21.15.153:0/950114270 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd83c034130 0x7fd83c0365e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd840005a90 tx=0x7fd840014000 comp rx=0 tx=0).stop 2023-10-05T21:15:16.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.098+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff4a2b0 msgr2=0x557c5ff71be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.098+0000 7fd850d57700 1 -- 172.21.15.153:0/950114270 reap_dead start 2023-10-05T21:15:16.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.098+0000 7fd85d47e680 1 --2- 172.21.15.153:0/950114270 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff4a2b0 0x557c5ff71be0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd844010000 tx=0x7fd844014000 comp rx=0 tx=0).stop 2023-10-05T21:15:16.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.098+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 shutdown_connections 2023-10-05T21:15:16.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.098+0000 7fd85d47e680 1 --2- 172.21.15.153:0/950114270 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff4a2b0 0x557c5ff71be0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.098+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 >> 172.21.15.153:0/950114270 conn(0x557c5ff45b80 msgr2=0x557c5ff63910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.098+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 shutdown_connections 2023-10-05T21:15:16.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.098+0000 7fd85d47e680 1 -- 172.21.15.153:0/950114270 wait complete. 2023-10-05T21:15:16.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.098+0000 7fd85d47e680 1 -- 172.21.15.153:0/2766636855 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd790034140 msgr2=0x7fd7900365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.098+0000 7fd85d47e680 1 --2- 172.21.15.153:0/2766636855 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd790034140 0x7fd7900365f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x557c5ff8cec0 tx=0x7fd84800aea0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.098+0000 7fd85d47e680 1 -- 172.21.15.153:0/2766636855 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff9b6a0 msgr2=0x557c5ffa1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.098+0000 7fd85d47e680 1 --2- 172.21.15.153:0/2766636855 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff9b6a0 0x557c5ffa1210 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x557c5ff95e10 tx=0x7fd840034000 comp rx=0 tx=0).stop 2023-10-05T21:15:16.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.098+0000 7fd85d47e680 1 -- 172.21.15.153:0/2766636855 shutdown_connections 2023-10-05T21:15:16.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.098+0000 7fd85d47e680 1 --2- 172.21.15.153:0/2766636855 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd790034140 0x7fd7900365f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.098+0000 7fd85d47e680 1 --2- 172.21.15.153:0/2766636855 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557c5ff9b6a0 0x557c5ffa1210 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.098+0000 7fd85d47e680 1 -- 172.21.15.153:0/2766636855 >> 172.21.15.153:0/2766636855 conn(0x557c5ff968a0 msgr2=0x557c5ff949d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.098+0000 7fd85d47e680 1 -- 172.21.15.153:0/2766636855 shutdown_connections 2023-10-05T21:15:16.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.098+0000 7fd85d47e680 1 -- 172.21.15.153:0/2766636855 wait complete. 2023-10-05T21:15:16.136 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:16.136 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo", 2023-10-05T21:15:16.136 INFO:teuthology.orchestra.run.smithi153.stdout: "num_shards": 11, 2023-10-05T21:15:16.136 INFO:teuthology.orchestra.run.smithi153.stdout: "tenant": "", 2023-10-05T21:15:16.136 INFO:teuthology.orchestra.run.smithi153.stdout: "zonegroup": "371967c9-8a2e-480a-9a00-92e7f0730f89", 2023-10-05T21:15:16.137 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_rule": "default-placement", 2023-10-05T21:15:16.137 INFO:teuthology.orchestra.run.smithi153.stdout: "explicit_placement": { 2023-10-05T21:15:16.137 INFO:teuthology.orchestra.run.smithi153.stdout: "data_pool": "", 2023-10-05T21:15:16.137 INFO:teuthology.orchestra.run.smithi153.stdout: "data_extra_pool": "", 2023-10-05T21:15:16.137 INFO:teuthology.orchestra.run.smithi153.stdout: "index_pool": "" 2023-10-05T21:15:16.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:16.137 INFO:teuthology.orchestra.run.smithi153.stdout: "id": "193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1", 2023-10-05T21:15:16.137 INFO:teuthology.orchestra.run.smithi153.stdout: "marker": "193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1", 2023-10-05T21:15:16.137 INFO:teuthology.orchestra.run.smithi153.stdout: "index_type": "Normal", 2023-10-05T21:15:16.137 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:15:16.137 INFO:teuthology.orchestra.run.smithi153.stdout: "ver": "0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1", 2023-10-05T21:15:16.138 INFO:teuthology.orchestra.run.smithi153.stdout: "master_ver": "0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0", 2023-10-05T21:15:16.138 INFO:teuthology.orchestra.run.smithi153.stdout: "mtime": "2023-10-05T21:15:15.578691Z", 2023-10-05T21:15:16.138 INFO:teuthology.orchestra.run.smithi153.stdout: "creation_time": "2023-10-05T21:15:15.576323Z", 2023-10-05T21:15:16.138 INFO:teuthology.orchestra.run.smithi153.stdout: "max_marker": "0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#", 2023-10-05T21:15:16.138 INFO:teuthology.orchestra.run.smithi153.stdout: "usage": {}, 2023-10-05T21:15:16.138 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:15:16.138 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:16.138 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:16.138 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:16.138 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:16.138 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:16.139 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:16.139 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:16.139 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '371967c9-8a2e-480a-9a00-92e7f0730f89', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1', 'marker': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1', 'index_type': 'Normal', 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2023-10-05T21:15:15.578691Z', 'creation_time': '2023-10-05T21:15:15.576323Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2023-10-05T21:15:16.139 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2023-10-05T21:15:16.139 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2023-10-05T21:15:16.139 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2023-10-05T21:15:16.183 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:16.183 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:16.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.182+0000 7f068b7e4680 1 Processor -- start 2023-10-05T21:15:16.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.182+0000 7f068b7e4680 1 -- start start 2023-10-05T21:15:16.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.182+0000 7f068b7e4680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5622870fcbb0 0x5622870fef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.182+0000 7f068b7e4680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562287043990 con 0x56228706a0a0 2023-10-05T21:15:16.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.182+0000 7f068b7e4680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x562287003db0 con 0x5622870fcbb0 2023-10-05T21:15:16.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.183+0000 7f067e8bc700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x56228706a0a0 0x5622870fb490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56412/0 (socket says 172.21.15.153:56412) 2023-10-05T21:15:16.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.183+0000 7f067e0bb700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5622870fcbb0 0x5622870fef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.183+0000 7f067e8bc700 1 -- 172.21.15.153:0/3635348293 learned_addr learned my addr 172.21.15.153:0/3635348293 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:16.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.183+0000 7f067e0bb700 1 -- 172.21.15.153:0/3635348293 >> v1:172.21.15.111:6789/0 conn(0x56228706a0a0 legacy=0x5622870fb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.183+0000 7f067d8ba700 1 -- 172.21.15.153:0/3635348293 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4127196104 0 0) 0x562287043990 con 0x56228706a0a0 2023-10-05T21:15:16.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.183+0000 7f067e0bb700 1 -- 172.21.15.153:0/3635348293 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622871004e0 con 0x5622870fcbb0 2023-10-05T21:15:16.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.183+0000 7f067e0bb700 1 --2- 172.21.15.153:0/3635348293 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5622870fcbb0 0x5622870fef90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f067000a5d0 tx=0x7f0670005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce402aa27460de86 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.183+0000 7f067d8ba700 1 -- 172.21.15.153:0/3635348293 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06700086a0 con 0x5622870fcbb0 2023-10-05T21:15:16.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.183+0000 7f067d8ba700 1 -- 172.21.15.153:0/3635348293 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0670008800 con 0x5622870fcbb0 2023-10-05T21:15:16.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.183+0000 7f067d8ba700 1 -- 172.21.15.153:0/3635348293 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0670008ad0 con 0x5622870fcbb0 2023-10-05T21:15:16.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.184+0000 7f068b7e4680 1 -- 172.21.15.153:0/3635348293 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5622870fcbb0 msgr2=0x5622870fef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.184+0000 7f068b7e4680 1 --2- 172.21.15.153:0/3635348293 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5622870fcbb0 0x5622870fef90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f067000a5d0 tx=0x7f0670005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:16.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.184+0000 7f068b7e4680 1 -- 172.21.15.153:0/3635348293 shutdown_connections 2023-10-05T21:15:16.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.184+0000 7f068b7e4680 1 --2- 172.21.15.153:0/3635348293 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5622870fcbb0 0x5622870fef90 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.184+0000 7f068b7e4680 1 -- 172.21.15.153:0/3635348293 >> 172.21.15.153:0/3635348293 conn(0x5622870f0b80 msgr2=0x5622870f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.184+0000 7f068b7e4680 1 -- 172.21.15.153:0/3635348293 shutdown_connections 2023-10-05T21:15:16.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.184+0000 7f068b7e4680 1 -- 172.21.15.153:0/3635348293 wait complete. 2023-10-05T21:15:16.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.184+0000 7f068b7e4680 1 Processor -- start 2023-10-05T21:15:16.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.184+0000 7f068b7e4680 1 -- start start 2023-10-05T21:15:16.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.185+0000 7f068b7e4680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56228706a0a0 0x562287117920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.185+0000 7f068b7e4680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x562286fa3ea0 con 0x56228706a0a0 2023-10-05T21:15:16.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.185+0000 7f067e8bc700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56228706a0a0 0x562287117920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.185+0000 7f067e8bc700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56228706a0a0 0x562287117920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50410/0 (socket says 172.21.15.153:50410) 2023-10-05T21:15:16.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.185+0000 7f067e8bc700 1 -- 172.21.15.153:0/3628811699 learned_addr learned my addr 172.21.15.153:0/3628811699 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:16.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.185+0000 7f067e8bc700 1 -- 172.21.15.153:0/3628811699 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0670005cf0 con 0x56228706a0a0 2023-10-05T21:15:16.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.185+0000 7f067e8bc700 1 --2- 172.21.15.153:0/3628811699 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56228706a0a0 0x562287117920 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0674001d70 tx=0x7f0674001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8100c52eaf221acf server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.185+0000 7f067c8b8700 1 -- 172.21.15.153:0/3628811699 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f067400bcc0 con 0x56228706a0a0 2023-10-05T21:15:16.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.185+0000 7f067c8b8700 1 -- 172.21.15.153:0/3628811699 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067400be20 con 0x56228706a0a0 2023-10-05T21:15:16.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.185+0000 7f067c8b8700 1 -- 172.21.15.153:0/3628811699 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f067400e5f0 con 0x56228706a0a0 2023-10-05T21:15:16.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.186+0000 7f068b7e4680 1 -- 172.21.15.153:0/3628811699 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56228706a0a0 msgr2=0x562287117920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.186+0000 7f068b7e4680 1 --2- 172.21.15.153:0/3628811699 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56228706a0a0 0x562287117920 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0674001d70 tx=0x7f0674001770 comp rx=0 tx=0).stop 2023-10-05T21:15:16.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.186+0000 7f068b7e4680 1 -- 172.21.15.153:0/3628811699 shutdown_connections 2023-10-05T21:15:16.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.186+0000 7f068b7e4680 1 --2- 172.21.15.153:0/3628811699 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56228706a0a0 0x562287117920 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.186+0000 7f068b7e4680 1 -- 172.21.15.153:0/3628811699 >> 172.21.15.153:0/3628811699 conn(0x5622870f0b80 msgr2=0x5622871133f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.186+0000 7f068b7e4680 1 -- 172.21.15.153:0/3628811699 shutdown_connections 2023-10-05T21:15:16.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.186+0000 7f068b7e4680 1 -- 172.21.15.153:0/3628811699 wait complete. 2023-10-05T21:15:16.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.186+0000 7f068b7e4680 1 Processor -- start 2023-10-05T21:15:16.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.186+0000 7f068b7e4680 1 -- start start 2023-10-05T21:15:16.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.186+0000 7f068b7e4680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56228706a0a0 0x56228711edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.186+0000 7f068b7e4680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x562286f9ac80 con 0x56228706a0a0 2023-10-05T21:15:16.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.186+0000 7f067e8bc700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56228706a0a0 0x56228711edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.186+0000 7f067e8bc700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56228706a0a0 0x56228711edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50414/0 (socket says 172.21.15.153:50414) 2023-10-05T21:15:16.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.186+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 learned_addr learned my addr 172.21.15.153:0/2020217476 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:16.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.187+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0674001a50 con 0x56228706a0a0 2023-10-05T21:15:16.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.187+0000 7f067e8bc700 1 --2- 172.21.15.153:0/2020217476 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56228706a0a0 0x56228711edc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f06740017b0 tx=0x7f0674016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.187+0000 7f066effd700 1 -- 172.21.15.153:0/2020217476 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f067401f070 con 0x56228706a0a0 2023-10-05T21:15:16.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.187+0000 7f066effd700 1 -- 172.21.15.153:0/2020217476 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067401a2e0 con 0x56228706a0a0 2023-10-05T21:15:16.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.187+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56228711f300 con 0x56228706a0a0 2023-10-05T21:15:16.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.187+0000 7f066effd700 1 -- 172.21.15.153:0/2020217476 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f067401a650 con 0x56228706a0a0 2023-10-05T21:15:16.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.187+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56228711f750 con 0x56228706a0a0 2023-10-05T21:15:16.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.188+0000 7f068b7e4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.188+0000 7f066effd700 1 -- 172.21.15.153:0/2020217476 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f067401a7b0 con 0x56228706a0a0 2023-10-05T21:15:16.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.188+0000 7f066effd700 1 --2- 172.21.15.153:0/2020217476 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0664034140 0x7f06640365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.188+0000 7f066effd700 1 -- 172.21.15.153:0/2020217476 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f0674048ec0 con 0x56228706a0a0 2023-10-05T21:15:16.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.188+0000 7f067e0bb700 1 --2- 172.21.15.153:0/2020217476 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0664034140 0x7f06640365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.188+0000 7f068b7e4680 1 --2- 172.21.15.153:0/2020217476 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5622870fcbb0 0x56228712aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.188+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56228712b270 con 0x5622870fcbb0 2023-10-05T21:15:16.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.189+0000 7f067f0bd700 1 --2- 172.21.15.153:0/2020217476 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5622870fcbb0 0x56228712aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.189+0000 7f067e0bb700 1 --2- 172.21.15.153:0/2020217476 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0664034140 0x7f06640365f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0670003080 tx=0x7f0670015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.189+0000 7f067f0bd700 1 --2- 172.21.15.153:0/2020217476 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5622870fcbb0 0x56228712aae0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.189+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.189+0000 7f068b7e4680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.189+0000 7f068b7e4680 20 realm 2023-10-05T21:15:16.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.189+0000 7f068b7e4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.189+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287128100 con 0x5622870fcbb0 2023-10-05T21:15:16.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.189+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.189+0000 7f068b7e4680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.189+0000 7f068b7e4680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:16.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.189+0000 7f068b7e4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.189+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56228712bd70 con 0x5622870fcbb0 2023-10-05T21:15:16.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.190+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.190+0000 7f068b7e4680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.190+0000 7f068b7e4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.190+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56228712c690 con 0x5622870fcbb0 2023-10-05T21:15:16.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.190+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.190+0000 7f068b7e4680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.190+0000 7f068b7e4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.190+0000 7f068b7e4680 1 --2- 172.21.15.153:0/2020217476 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x56228712cf50 0x56228712f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.190+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56228712f900 con 0x56228712cf50 2023-10-05T21:15:16.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.190+0000 7f067e8bc700 1 --2- 172.21.15.153:0/2020217476 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x56228712cf50 0x56228712f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.190+0000 7f067e8bc700 1 --2- 172.21.15.153:0/2020217476 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x56228712cf50 0x56228712f330 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.191+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f0674014070 con 0x56228712cf50 2023-10-05T21:15:16.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.191+0000 7f068b7e4680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:16.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.191+0000 7f068b7e4680 20 searching for the correct realm 2023-10-05T21:15:16.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.191+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287131220 con 0x56228712cf50 2023-10-05T21:15:16.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.191+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0674014070 con 0x56228712cf50 2023-10-05T21:15:16.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.191+0000 7f067e8bc700 1 --2- 172.21.15.153:0/2020217476 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f067400d750 0x7f0674017430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.191+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f067403e040 con 0x7f067400d750 2023-10-05T21:15:16.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.191+0000 7f067e0bb700 1 --2- 172.21.15.153:0/2020217476 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f067400d750 0x7f0674017430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.191+0000 7f067e0bb700 1 --2- 172.21.15.153:0/2020217476 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f067400d750 0x7f0674017430 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.192+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0670019040 con 0x7f067400d750 2023-10-05T21:15:16.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.192+0000 7f067e0bb700 1 --2- 172.21.15.153:0/2020217476 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f0670007030 0x7f067001d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.192+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f067403e040 con 0x7f0670007030 2023-10-05T21:15:16.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.192+0000 7f067f0bd700 1 --2- 172.21.15.153:0/2020217476 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f0670007030 0x7f067001d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.192+0000 7f067f0bd700 1 --2- 172.21.15.153:0/2020217476 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f0670007030 0x7f067001d420 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.192+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f067800a570 con 0x7f0670007030 2023-10-05T21:15:16.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.192+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f067403e040 con 0x5622870fcbb0 2023-10-05T21:15:16.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.192+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.192+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f067403e040 con 0x5622870fcbb0 2023-10-05T21:15:16.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.193+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.193+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f067403e040 con 0x7f0670007030 2023-10-05T21:15:16.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.193+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f067800a570 con 0x7f0670007030 2023-10-05T21:15:16.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.193+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f067403e040 con 0x7f0670007030 2023-10-05T21:15:16.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.193+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f067800a570 con 0x7f0670007030 2023-10-05T21:15:16.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.193+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f067403e040 con 0x7f067400d750 2023-10-05T21:15:16.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.193+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0670019040 con 0x7f067400d750 2023-10-05T21:15:16.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.193+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f067403e040 con 0x56228712cf50 2023-10-05T21:15:16.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.194+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0674014070 con 0x56228712cf50 2023-10-05T21:15:16.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.194+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f067403e040 con 0x5622870fcbb0 2023-10-05T21:15:16.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.194+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.194+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f067403e040 con 0x7f0670007030 2023-10-05T21:15:16.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.194+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f067800a570 con 0x7f0670007030 2023-10-05T21:15:16.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.194+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f067403e040 con 0x5622870fcbb0 2023-10-05T21:15:16.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.194+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.194+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f067403e040 con 0x7f067400d750 2023-10-05T21:15:16.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.195+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0670019040 con 0x7f067400d750 2023-10-05T21:15:16.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.195+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f067403e040 con 0x56228712cf50 2023-10-05T21:15:16.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.195+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0674014070 con 0x56228712cf50 2023-10-05T21:15:16.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.195+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f067403e040 con 0x56228712cf50 2023-10-05T21:15:16.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.195+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0674014070 con 0x56228712cf50 2023-10-05T21:15:16.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.195+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f067403e040 con 0x7f0670007030 2023-10-05T21:15:16.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.195+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f067800a570 con 0x7f0670007030 2023-10-05T21:15:16.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.195+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f067403e040 con 0x56228712cf50 2023-10-05T21:15:16.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.195+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0674014070 con 0x56228712cf50 2023-10-05T21:15:16.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.195+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f067403e040 con 0x56228712cf50 2023-10-05T21:15:16.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.196+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0674014070 con 0x56228712cf50 2023-10-05T21:15:16.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.196+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f067403e040 con 0x5622870fcbb0 2023-10-05T21:15:16.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.196+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.196+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f067403e040 con 0x5622870fcbb0 2023-10-05T21:15:16.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.196+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.196+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f067403e040 con 0x7f0670007030 2023-10-05T21:15:16.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.196+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f067800a570 con 0x7f0670007030 2023-10-05T21:15:16.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.196+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f067403e040 con 0x56228712cf50 2023-10-05T21:15:16.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.196+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0674014070 con 0x56228712cf50 2023-10-05T21:15:16.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.196+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f067403e040 con 0x7f067400d750 2023-10-05T21:15:16.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.197+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0670019040 con 0x7f067400d750 2023-10-05T21:15:16.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.197+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f067403e040 con 0x5622870fcbb0 2023-10-05T21:15:16.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.197+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.197+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f067403e040 con 0x7f0670007030 2023-10-05T21:15:16.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.197+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f067800a570 con 0x7f0670007030 2023-10-05T21:15:16.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.197+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f067403e040 con 0x56228712cf50 2023-10-05T21:15:16.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.197+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0674014070 con 0x56228712cf50 2023-10-05T21:15:16.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.197+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f067403e040 con 0x7f0670007030 2023-10-05T21:15:16.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.197+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f067800a570 con 0x7f0670007030 2023-10-05T21:15:16.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.198+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f067403e040 con 0x7f067400d750 2023-10-05T21:15:16.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.198+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0670019040 con 0x7f067400d750 2023-10-05T21:15:16.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.198+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f067403e040 con 0x56228712cf50 2023-10-05T21:15:16.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.198+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0674014070 con 0x56228712cf50 2023-10-05T21:15:16.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.198+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f067403e040 con 0x7f0670007030 2023-10-05T21:15:16.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.198+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f067800a570 con 0x7f0670007030 2023-10-05T21:15:16.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.198+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f067403e040 con 0x5622870fcbb0 2023-10-05T21:15:16.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.198+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.198+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f067403e040 con 0x7f067400d750 2023-10-05T21:15:16.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.199+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0670019040 con 0x7f067400d750 2023-10-05T21:15:16.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.199+0000 7f068b7e4680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:16.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.199+0000 7f068b7e4680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:16.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.199+0000 7f068b7e4680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:16.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.199+0000 7f068b7e4680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:16.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.199+0000 7f068b7e4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.199+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130440 con 0x5622870fcbb0 2023-10-05T21:15:16.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.199+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.199+0000 7f068b7e4680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.199+0000 7f068b7e4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.199+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130870 con 0x5622870fcbb0 2023-10-05T21:15:16.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.199+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.199+0000 7f068b7e4680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.199+0000 7f068b7e4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.199+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130ca0 con 0x5622870fcbb0 2023-10-05T21:15:16.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.199+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.199+0000 7f068b7e4680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:16.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.199+0000 7f068b7e4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.199+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871315d0 con 0x56228712cf50 2023-10-05T21:15:16.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.200+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f0674014070 con 0x56228712cf50 2023-10-05T21:15:16.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.200+0000 7f068b7e4680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.200+0000 7f068b7e4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.200+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56228712ff80 con 0x5622870fcbb0 2023-10-05T21:15:16.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.200+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.200+0000 7f068b7e4680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.200+0000 7f068b7e4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.200+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287131ec0 con 0x5622870fcbb0 2023-10-05T21:15:16.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.200+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.200+0000 7f068b7e4680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.200+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287132ed0 con 0x56228712cf50 2023-10-05T21:15:16.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.200+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0674014070 con 0x56228712cf50 2023-10-05T21:15:16.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.200+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287132ed0 con 0x7f067400d750 2023-10-05T21:15:16.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.200+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0670019040 con 0x7f067400d750 2023-10-05T21:15:16.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.200+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287132ed0 con 0x7f0670007030 2023-10-05T21:15:16.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.201+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f067800a570 con 0x7f0670007030 2023-10-05T21:15:16.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.201+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130ca0 con 0x5622870fcbb0 2023-10-05T21:15:16.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.201+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.201+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130ca0 con 0x5622870fcbb0 2023-10-05T21:15:16.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.201+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.201+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130ca0 con 0x7f0670007030 2023-10-05T21:15:16.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.201+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f067800a570 con 0x7f0670007030 2023-10-05T21:15:16.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.201+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130ca0 con 0x7f0670007030 2023-10-05T21:15:16.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.202+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f067800a570 con 0x7f0670007030 2023-10-05T21:15:16.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.202+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130ca0 con 0x7f067400d750 2023-10-05T21:15:16.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.202+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0670019040 con 0x7f067400d750 2023-10-05T21:15:16.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.202+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130ca0 con 0x56228712cf50 2023-10-05T21:15:16.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.202+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0674014070 con 0x56228712cf50 2023-10-05T21:15:16.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.202+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130ca0 con 0x5622870fcbb0 2023-10-05T21:15:16.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.202+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.202+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130ca0 con 0x7f0670007030 2023-10-05T21:15:16.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.203+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f067800a570 con 0x7f0670007030 2023-10-05T21:15:16.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.203+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130ca0 con 0x5622870fcbb0 2023-10-05T21:15:16.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.203+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.203+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130ca0 con 0x7f067400d750 2023-10-05T21:15:16.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.203+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0670019040 con 0x7f067400d750 2023-10-05T21:15:16.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.203+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130ca0 con 0x56228712cf50 2023-10-05T21:15:16.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.203+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0674014070 con 0x56228712cf50 2023-10-05T21:15:16.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.203+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130ca0 con 0x56228712cf50 2023-10-05T21:15:16.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.203+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0674014070 con 0x56228712cf50 2023-10-05T21:15:16.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.204+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130ca0 con 0x7f0670007030 2023-10-05T21:15:16.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.204+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f067800a570 con 0x7f0670007030 2023-10-05T21:15:16.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.204+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130ca0 con 0x56228712cf50 2023-10-05T21:15:16.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.204+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0674014070 con 0x56228712cf50 2023-10-05T21:15:16.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.204+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130ca0 con 0x56228712cf50 2023-10-05T21:15:16.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.204+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0674014070 con 0x56228712cf50 2023-10-05T21:15:16.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.204+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130ca0 con 0x5622870fcbb0 2023-10-05T21:15:16.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.205+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.205+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130ca0 con 0x5622870fcbb0 2023-10-05T21:15:16.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.205+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.205+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130ca0 con 0x7f0670007030 2023-10-05T21:15:16.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.205+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f067800a570 con 0x7f0670007030 2023-10-05T21:15:16.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.205+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130ca0 con 0x56228712cf50 2023-10-05T21:15:16.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.205+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0674014070 con 0x56228712cf50 2023-10-05T21:15:16.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.205+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130ca0 con 0x7f067400d750 2023-10-05T21:15:16.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.205+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0670019040 con 0x7f067400d750 2023-10-05T21:15:16.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.205+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130ca0 con 0x5622870fcbb0 2023-10-05T21:15:16.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.206+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.206+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130ca0 con 0x7f0670007030 2023-10-05T21:15:16.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.206+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f067800a570 con 0x7f0670007030 2023-10-05T21:15:16.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.206+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130ca0 con 0x56228712cf50 2023-10-05T21:15:16.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.206+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0674014070 con 0x56228712cf50 2023-10-05T21:15:16.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.206+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130ca0 con 0x7f0670007030 2023-10-05T21:15:16.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.207+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f067800a570 con 0x7f0670007030 2023-10-05T21:15:16.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.207+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130ca0 con 0x7f067400d750 2023-10-05T21:15:16.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.207+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0670019040 con 0x7f067400d750 2023-10-05T21:15:16.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.207+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130ca0 con 0x56228712cf50 2023-10-05T21:15:16.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.207+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0674014070 con 0x56228712cf50 2023-10-05T21:15:16.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.207+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130ca0 con 0x7f0670007030 2023-10-05T21:15:16.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.207+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f067800a570 con 0x7f0670007030 2023-10-05T21:15:16.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.207+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130ca0 con 0x5622870fcbb0 2023-10-05T21:15:16.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.208+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.208+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287130ca0 con 0x7f067400d750 2023-10-05T21:15:16.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.208+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0670019040 con 0x7f067400d750 2023-10-05T21:15:16.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.208+0000 7f068b7e4680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:16.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.208+0000 7f068b7e4680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:16.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.208+0000 7f068b7e4680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:16.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.208+0000 7f068b7e4680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:16.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.208+0000 7f068b7e4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.208+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287131ec0 con 0x5622870fcbb0 2023-10-05T21:15:16.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.208+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.208+0000 7f068b7e4680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.208+0000 7f068b7e4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.208+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287132270 con 0x56228712cf50 2023-10-05T21:15:16.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.208+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f0674014070 con 0x56228712cf50 2023-10-05T21:15:16.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.208+0000 7f068b7e4680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:16.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.208+0000 7f068b7e4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.208+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287132620 con 0x5622870fcbb0 2023-10-05T21:15:16.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.209+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.209+0000 7f068b7e4680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.209+0000 7f068b7e4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.209+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287132620 con 0x5622870fcbb0 2023-10-05T21:15:16.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.209+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.209+0000 7f068b7e4680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:16.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.209+0000 7f068b7e4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.209+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287132b10 con 0x7f0670007030 2023-10-05T21:15:16.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.209+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f067800a570 con 0x7f0670007030 2023-10-05T21:15:16.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.209+0000 7f068b7e4680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.209+0000 7f068b7e4680 20 zone default found 2023-10-05T21:15:16.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.209+0000 7f068b7e4680 4 Realm: () 2023-10-05T21:15:16.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.209+0000 7f068b7e4680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:16.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.209+0000 7f068b7e4680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:16.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.209+0000 7f068b7e4680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:16.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.209+0000 7f068b7e4680 20 zonegroup default 2023-10-05T21:15:16.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.209+0000 7f068b7e4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.209+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287132b10 con 0x7f0670007030 2023-10-05T21:15:16.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.209+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f067800a570 con 0x7f0670007030 2023-10-05T21:15:16.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.209+0000 7f068b7e4680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.209+0000 7f068b7e4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.209+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287134490 con 0x56228712cf50 2023-10-05T21:15:16.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.210+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0674014070 con 0x56228712cf50 2023-10-05T21:15:16.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.210+0000 7f068b7e4680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.210+0000 7f068b7e4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.210+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287134840 con 0x56228712cf50 2023-10-05T21:15:16.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.210+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0674014070 con 0x56228712cf50 2023-10-05T21:15:16.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.210+0000 7f068b7e4680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.210+0000 7f068b7e4680 20 started sync module instance, tier type = 2023-10-05T21:15:16.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.210+0000 7f068b7e4680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:16.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.210+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287133b50 con 0x7f067400d750 2023-10-05T21:15:16.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.211+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0670019040 con 0x7f067400d750 2023-10-05T21:15:16.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.211+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94706295060064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287134bf0 con 0x7f067400d750 2023-10-05T21:15:16.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.211+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871355a0 con 0x5622870fcbb0 2023-10-05T21:15:16.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.211+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.211+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94706295060064] v29'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0670019040 con 0x7f067400d750 2023-10-05T21:15:16.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.211+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94706295066672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287135e90 con 0x5622870fcbb0 2023-10-05T21:15:16.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.211+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287133f50 con 0x56228712cf50 2023-10-05T21:15:16.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.212+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94706295066672] v29'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.212+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0674014070 con 0x56228712cf50 2023-10-05T21:15:16.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.212+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94706295069376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871368d0 con 0x56228712cf50 2023-10-05T21:15:16.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.212+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287137170 con 0x7f067400d750 2023-10-05T21:15:16.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.213+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94706295069376] v29'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0674014070 con 0x56228712cf50 2023-10-05T21:15:16.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.213+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0670019040 con 0x7f067400d750 2023-10-05T21:15:16.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.213+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94706295072032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287137520 con 0x7f067400d750 2023-10-05T21:15:16.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.213+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287137f30 con 0x5622870fcbb0 2023-10-05T21:15:16.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.214+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94706295072032] v29'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0670019040 con 0x7f067400d750 2023-10-05T21:15:16.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.214+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.214+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94706295077440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287138380 con 0x5622870fcbb0 2023-10-05T21:15:16.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.214+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287138d90 con 0x7f0670007030 2023-10-05T21:15:16.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.214+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94706295077440] v29'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.214+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f067800a570 con 0x7f0670007030 2023-10-05T21:15:16.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.214+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94706295079104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x562287138d90 con 0x7f0670007030 2023-10-05T21:15:16.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.214+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871397a0 con 0x7f0670007030 2023-10-05T21:15:16.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.215+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94706295079104] v29'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f067800a570 con 0x7f0670007030 2023-10-05T21:15:16.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.215+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f067800a570 con 0x7f0670007030 2023-10-05T21:15:16.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.215+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94706295081680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871397a0 con 0x7f0670007030 2023-10-05T21:15:16.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.215+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56228713a1b0 con 0x7f0670007030 2023-10-05T21:15:16.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.216+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94706295081680] v29'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f067800a570 con 0x7f0670007030 2023-10-05T21:15:16.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.216+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f067800a570 con 0x7f0670007030 2023-10-05T21:15:16.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.216+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94706295084256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56228713a1b0 con 0x7f0670007030 2023-10-05T21:15:16.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.216+0000 7f068b7e4680 20 add_watcher() i=0 2023-10-05T21:15:16.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.216+0000 7f068b7e4680 20 add_watcher() i=1 2023-10-05T21:15:16.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.216+0000 7f068b7e4680 20 add_watcher() i=2 2023-10-05T21:15:16.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.216+0000 7f068b7e4680 20 add_watcher() i=3 2023-10-05T21:15:16.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.216+0000 7f068b7e4680 20 add_watcher() i=4 2023-10-05T21:15:16.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.216+0000 7f068b7e4680 20 add_watcher() i=5 2023-10-05T21:15:16.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.216+0000 7f068b7e4680 20 add_watcher() i=6 2023-10-05T21:15:16.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.217+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94706295084256] v29'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f067800a570 con 0x7f0670007030 2023-10-05T21:15:16.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.217+0000 7f068b7e4680 20 add_watcher() i=7 2023-10-05T21:15:16.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.217+0000 7f068b7e4680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:16.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.217+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56228713d420 con 0x5622870fcbb0 2023-10-05T21:15:16.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.217+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.217+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94706295086640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56228713a770 con 0x5622870fcbb0 2023-10-05T21:15:16.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.218+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94706295086640] v29'98 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.218+0000 7f064ffe7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:16.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.218+0000 7f068b7e4680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:16.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.218+0000 7f068b7e4680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:16.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.218+0000 7f068b7e4680 1 Processor -- start 2023-10-05T21:15:16.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.218+0000 7f068b7e4680 1 -- start start 2023-10-05T21:15:16.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.218+0000 7f068b7e4680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562287147f50 0x562287148360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.218+0000 7f068b7e4680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x562287148930 con 0x562287147f50 2023-10-05T21:15:16.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.218+0000 7f067e0bb700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562287147f50 0x562287148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.218+0000 7f067e0bb700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562287147f50 0x562287148360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50422/0 (socket says 172.21.15.153:50422) 2023-10-05T21:15:16.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.218+0000 7f067e0bb700 1 -- 172.21.15.153:0/694463736 learned_addr learned my addr 172.21.15.153:0/694463736 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:16.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.219+0000 7f067e0bb700 1 -- 172.21.15.153:0/694463736 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562287148a70 con 0x562287147f50 2023-10-05T21:15:16.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.219+0000 7f067e0bb700 1 --2- 172.21.15.153:0/694463736 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562287147f50 0x562287148360 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x5622870f6f50 tx=0x7f0670012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c58a0ab43d648f25 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.219+0000 7f064f7e6700 1 -- 172.21.15.153:0/694463736 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f067001ddc0 con 0x562287147f50 2023-10-05T21:15:16.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.219+0000 7f064f7e6700 1 -- 172.21.15.153:0/694463736 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067002b450 con 0x562287147f50 2023-10-05T21:15:16.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.219+0000 7f064f7e6700 1 -- 172.21.15.153:0/694463736 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f067002b600 con 0x562287147f50 2023-10-05T21:15:16.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.220+0000 7f068b7e4680 1 -- 172.21.15.153:0/694463736 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562287147f50 msgr2=0x562287148360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.220+0000 7f068b7e4680 1 --2- 172.21.15.153:0/694463736 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562287147f50 0x562287148360 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x5622870f6f50 tx=0x7f0670012000 comp rx=0 tx=0).stop 2023-10-05T21:15:16.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.220+0000 7f068b7e4680 1 -- 172.21.15.153:0/694463736 shutdown_connections 2023-10-05T21:15:16.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.220+0000 7f068b7e4680 1 --2- 172.21.15.153:0/694463736 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562287147f50 0x562287148360 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.220+0000 7f068b7e4680 1 -- 172.21.15.153:0/694463736 >> 172.21.15.153:0/694463736 conn(0x562287143150 msgr2=0x5622871412b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.220+0000 7f068b7e4680 1 -- 172.21.15.153:0/694463736 shutdown_connections 2023-10-05T21:15:16.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.220+0000 7f068b7e4680 1 -- 172.21.15.153:0/694463736 wait complete. 2023-10-05T21:15:16.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.220+0000 7f068b7e4680 1 Processor -- start 2023-10-05T21:15:16.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.220+0000 7f068b7e4680 1 -- start start 2023-10-05T21:15:16.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.220+0000 7f068b7e4680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562287147f50 0x56228714db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.220+0000 7f068b7e4680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x56228714e040 con 0x562287147f50 2023-10-05T21:15:16.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.220+0000 7f067e0bb700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562287147f50 0x56228714db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.220+0000 7f067e0bb700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562287147f50 0x56228714db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50428/0 (socket says 172.21.15.153:50428) 2023-10-05T21:15:16.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.220+0000 7f067e0bb700 1 -- 172.21.15.153:0/3831071403 learned_addr learned my addr 172.21.15.153:0/3831071403 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:16.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.221+0000 7f067e0bb700 1 -- 172.21.15.153:0/3831071403 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622871004e0 con 0x562287147f50 2023-10-05T21:15:16.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.221+0000 7f067e0bb700 1 --2- 172.21.15.153:0/3831071403 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562287147f50 0x56228714db00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x5622871426c0 tx=0x7f0670031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.221+0000 7f064dfe3700 1 -- 172.21.15.153:0/3831071403 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0670041660 con 0x562287147f50 2023-10-05T21:15:16.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.221+0000 7f064dfe3700 1 -- 172.21.15.153:0/3831071403 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06700417c0 con 0x562287147f50 2023-10-05T21:15:16.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.221+0000 7f068b7e4680 1 -- 172.21.15.153:0/3831071403 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56228714e240 con 0x562287147f50 2023-10-05T21:15:16.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.221+0000 7f064dfe3700 1 -- 172.21.15.153:0/3831071403 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0670041ad0 con 0x562287147f50 2023-10-05T21:15:16.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.221+0000 7f068b7e4680 1 -- 172.21.15.153:0/3831071403 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56228714e690 con 0x562287147f50 2023-10-05T21:15:16.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.222+0000 7f064dfe3700 1 -- 172.21.15.153:0/3831071403 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f0670026040 con 0x562287147f50 2023-10-05T21:15:16.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.222+0000 7f064dfe3700 1 --2- 172.21.15.153:0/3831071403 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f05c4034140 0x7f05c40365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.222+0000 7f064dfe3700 1 -- 172.21.15.153:0/3831071403 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f0670031070 con 0x562287147f50 2023-10-05T21:15:16.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.222+0000 7f067f0bd700 1 --2- 172.21.15.153:0/3831071403 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f05c4034140 0x7f05c40365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.222+0000 7f068b7e4680 5 note: GC not initialized 2023-10-05T21:15:16.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.222+0000 7f067f0bd700 1 --2- 172.21.15.153:0/3831071403 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f05c4034140 0x7f05c40365f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x56228713d4a0 tx=0x7f067800aee0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.223+0000 7f05beffd700 20 reqs_thread_entry: start 2023-10-05T21:15:16.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.223+0000 7f05bcff9700 20 reqs_thread_entry: start 2023-10-05T21:15:16.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.223+0000 7f068b7e4680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:16.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.223+0000 7f068b7e4680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:16.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.223+0000 7f05aeffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:46 2023 2023-10-05T21:15:16.257 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:16.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.223+0000 7f05ae7fc700 20 reqs_thread_entry: start 2023-10-05T21:15:16.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.223+0000 7f068b7e4680 20 get_system_obj_state: rctx=0x7fff88bf6028 obj=default.rgw.meta:users.uid:foo state=0x562286fa9240 s->prefetch_data=0 2023-10-05T21:15:16.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.223+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871b33e0 con 0x5622870fcbb0 2023-10-05T21:15:16.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.224+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.224+0000 7f068b7e4680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:16.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.224+0000 7f068b7e4680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:16.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.224+0000 7f068b7e4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.224+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871b5670 con 0x5622870fcbb0 2023-10-05T21:15:16.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.224+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.224+0000 7f068b7e4680 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T21:15:16.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.224+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:104 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871b5670 con 0x7f067400d750 2023-10-05T21:15:16.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.225+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(104 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f0670034040 con 0x7f067400d750 2023-10-05T21:15:16.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.225+0000 7f068b7e4680 20 get_system_obj_state: rctx=0x7fff88bf5ee0 obj=default.rgw.meta:root:myfoo state=0x562286fa9240 s->prefetch_data=0 2023-10-05T21:15:16.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.225+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871b3d20 con 0x7f067400d750 2023-10-05T21:15:16.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.225+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(105 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f0670034040 con 0x7f067400d750 2023-10-05T21:15:16.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.225+0000 7f068b7e4680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:16.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.225+0000 7f068b7e4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.225+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:106 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871b4360 con 0x7f067400d750 2023-10-05T21:15:16.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.225+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(106 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7f06700510e0 con 0x7f067400d750 2023-10-05T21:15:16.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.225+0000 7f068b7e4680 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T21:15:16.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.225+0000 7f068b7e4680 20 get_system_obj_state: rctx=0x7fff88bf5ee0 obj=default.rgw.meta:root:.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 state=0x562286fa9500 s->prefetch_data=0 2023-10-05T21:15:16.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.225+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871b5c90 con 0x56228712cf50 2023-10-05T21:15:16.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.226+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(107 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f0674014070 con 0x56228712cf50 2023-10-05T21:15:16.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.226+0000 7f068b7e4680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:16.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.226+0000 7f068b7e4680 20 Read xattr: user.rgw.acl 2023-10-05T21:15:16.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.226+0000 7f068b7e4680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:16.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.226+0000 7f068b7e4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.226+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:108 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871b8240 con 0x56228712cf50 2023-10-05T21:15:16.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.226+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(108 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f0674014070 con 0x56228712cf50 2023-10-05T21:15:16.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.226+0000 7f068b7e4680 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T21:15:16.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.226+0000 7f068b7e4680 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T21:15:16.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.226+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:109 4.6 4:63e054bc:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871b2b40 con 0x56228712cf50 2023-10-05T21:15:16.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.226+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:110 4.18 4:1a996cea:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871baa30 con 0x7f067400d750 2023-10-05T21:15:16.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.226+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:111 4.18 4:198ebb7d:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871bd330 con 0x7f067400d750 2023-10-05T21:15:16.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.226+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 4.1e 4:7ac3851f:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871bffe0 con 0x7f0670007030 2023-10-05T21:15:16.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.226+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:113 4.20 4:0486cb16:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871bd330 con 0x5622870fcbb0 2023-10-05T21:15:16.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.226+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:114 4.1a 4:5b58f5c0:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871c5240 con 0x7f067400d750 2023-10-05T21:15:16.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.226+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:115 4.14 4:2bb8f6a0:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871c7cc0 con 0x56228712cf50 2023-10-05T21:15:16.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.226+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:116 4.3f 4:fc00c6e8:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871ca970 con 0x7f067400d750 2023-10-05T21:15:16.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.226+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:117 4.35 4:afba4511:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871cd8f0 con 0x5622870fcbb0 2023-10-05T21:15:16.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.226+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:118 4.5 4:a0455ddf:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871d0370 con 0x56228712cf50 2023-10-05T21:15:16.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.227+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:119 4.a 4:50c49731:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871d2dd0 con 0x7f067400d750 2023-10-05T21:15:16.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.227+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(109 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f0674014070 con 0x56228712cf50 2023-10-05T21:15:16.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.227+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(110 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f06700510e0 con 0x7f067400d750 2023-10-05T21:15:16.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.227+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== osd_op_reply(114 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f06700510e0 con 0x7f067400d750 2023-10-05T21:15:16.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.227+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(112 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f067800a570 con 0x7f0670007030 2023-10-05T21:15:16.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.227+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 <== osd.2 v2:172.21.15.153:6807/140454 22 ==== osd_op_reply(116 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f06700510e0 con 0x7f067400d750 2023-10-05T21:15:16.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.227+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 <== osd.2 v2:172.21.15.153:6807/140454 23 ==== osd_op_reply(111 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.2 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f06700510e0 con 0x7f067400d750 2023-10-05T21:15:16.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.227+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(117 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.227+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(113 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.227+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 <== osd.2 v2:172.21.15.153:6807/140454 24 ==== osd_op_reply(119 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f06700510e0 con 0x7f067400d750 2023-10-05T21:15:16.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.227+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== osd_op_reply(115 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f0674014070 con 0x56228712cf50 2023-10-05T21:15:16.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.227+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(118 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f0674014070 con 0x56228712cf50 2023-10-05T21:15:16.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.227+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:120 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94706295060064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871b29b0 con 0x7f067400d750 2023-10-05T21:15:16.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.228+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 <== osd.2 v2:172.21.15.153:6807/140454 25 ==== osd_op_reply(120 notify.0 [watch unwatch cookie 94706295060064] v29'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f06700510e0 con 0x7f067400d750 2023-10-05T21:15:16.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.228+0000 7f068b7e4680 20 remove_watcher() i=0 2023-10-05T21:15:16.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.228+0000 7f068b7e4680 2 removed watcher, disabling cache 2023-10-05T21:15:16.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.228+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:121 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94706295066672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871b29b0 con 0x5622870fcbb0 2023-10-05T21:15:16.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.229+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(121 notify.1 [watch unwatch cookie 94706295066672] v29'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.229+0000 7f068b7e4680 20 remove_watcher() i=1 2023-10-05T21:15:16.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.229+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:122 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94706295069376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871b29b0 con 0x56228712cf50 2023-10-05T21:15:16.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.230+0000 7f067e8bc700 1 -- 172.21.15.153:0/2020217476 <== osd.3 v2:172.21.15.153:6800/140455 31 ==== osd_op_reply(122 notify.2 [watch unwatch cookie 94706295069376] v29'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0674014070 con 0x56228712cf50 2023-10-05T21:15:16.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.230+0000 7f068b7e4680 20 remove_watcher() i=2 2023-10-05T21:15:16.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.230+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:123 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94706295072032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871b29b0 con 0x7f067400d750 2023-10-05T21:15:16.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.231+0000 7f067e0bb700 1 -- 172.21.15.153:0/2020217476 <== osd.2 v2:172.21.15.153:6807/140454 26 ==== osd_op_reply(123 notify.3 [watch unwatch cookie 94706295072032] v29'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f06700510e0 con 0x7f067400d750 2023-10-05T21:15:16.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.231+0000 7f068b7e4680 20 remove_watcher() i=3 2023-10-05T21:15:16.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.231+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:124 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94706295077440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871b29b0 con 0x5622870fcbb0 2023-10-05T21:15:16.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.232+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(124 notify.4 [watch unwatch cookie 94706295077440] v29'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.232+0000 7f068b7e4680 20 remove_watcher() i=4 2023-10-05T21:15:16.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.232+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:125 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94706295079104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871b29b0 con 0x7f0670007030 2023-10-05T21:15:16.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.233+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(125 notify.5 [watch unwatch cookie 94706295079104] v29'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f067800a570 con 0x7f0670007030 2023-10-05T21:15:16.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.233+0000 7f068b7e4680 20 remove_watcher() i=5 2023-10-05T21:15:16.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.233+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:126 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94706295081680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871b29b0 con 0x7f0670007030 2023-10-05T21:15:16.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.233+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(126 notify.6 [watch unwatch cookie 94706295081680] v29'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f067800a570 con 0x7f0670007030 2023-10-05T21:15:16.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.233+0000 7f068b7e4680 20 remove_watcher() i=6 2023-10-05T21:15:16.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.233+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:127 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94706295084256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871b29b0 con 0x7f0670007030 2023-10-05T21:15:16.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.234+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(127 notify.7 [watch unwatch cookie 94706295084256] v29'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f067800a570 con 0x7f0670007030 2023-10-05T21:15:16.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.234+0000 7f068b7e4680 20 remove_watcher() i=7 2023-10-05T21:15:16.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.235+0000 7f064ffe7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:16.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.235+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:128 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94706295086640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5622871b29b0 con 0x5622870fcbb0 2023-10-05T21:15:16.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.236+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== osd_op_reply(128 data_loggenerations_metadata [watch unwatch cookie 94706295086640] v29'99 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f067800a570 con 0x5622870fcbb0 2023-10-05T21:15:16.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.236+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f0670007030 msgr2=0x7f067001d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.236+0000 7f068b7e4680 1 --2- 172.21.15.153:0/2020217476 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f0670007030 0x7f067001d420 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.236+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5622870fcbb0 msgr2=0x56228712aae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.236+0000 7f068b7e4680 1 --2- 172.21.15.153:0/2020217476 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5622870fcbb0 0x56228712aae0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.236+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f067400d750 msgr2=0x7f0674017430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.236+0000 7f068b7e4680 1 --2- 172.21.15.153:0/2020217476 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f067400d750 0x7f0674017430 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.236+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x56228712cf50 msgr2=0x56228712f330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.236+0000 7f068b7e4680 1 --2- 172.21.15.153:0/2020217476 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x56228712cf50 0x56228712f330 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.236+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0664034140 msgr2=0x7f06640365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.236+0000 7f068b7e4680 1 --2- 172.21.15.153:0/2020217476 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0664034140 0x7f06640365f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0670003080 tx=0x7f0670015000 comp rx=0 tx=0).stop 2023-10-05T21:15:16.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.236+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56228706a0a0 msgr2=0x56228711edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.236+0000 7f067f0bd700 1 -- 172.21.15.153:0/2020217476 reap_dead start 2023-10-05T21:15:16.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.236+0000 7f068b7e4680 1 --2- 172.21.15.153:0/2020217476 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56228706a0a0 0x56228711edc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f06740017b0 tx=0x7f0674016000 comp rx=0 tx=0).stop 2023-10-05T21:15:16.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.236+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 shutdown_connections 2023-10-05T21:15:16.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.236+0000 7f068b7e4680 1 --2- 172.21.15.153:0/2020217476 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56228706a0a0 0x56228711edc0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.236+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 >> 172.21.15.153:0/2020217476 conn(0x5622870f0b80 msgr2=0x562287111c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.236+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 shutdown_connections 2023-10-05T21:15:16.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.236+0000 7f068b7e4680 1 -- 172.21.15.153:0/2020217476 wait complete. 2023-10-05T21:15:16.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.236+0000 7f068b7e4680 1 -- 172.21.15.153:0/3831071403 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f05c4034140 msgr2=0x7f05c40365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.236+0000 7f068b7e4680 1 --2- 172.21.15.153:0/3831071403 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f05c4034140 0x7f05c40365f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x56228713d4a0 tx=0x7f067800aee0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.236+0000 7f068b7e4680 1 -- 172.21.15.153:0/3831071403 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562287147f50 msgr2=0x56228714db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.236+0000 7f068b7e4680 1 --2- 172.21.15.153:0/3831071403 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562287147f50 0x56228714db00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x5622871426c0 tx=0x7f0670031000 comp rx=0 tx=0).stop 2023-10-05T21:15:16.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.236+0000 7f068b7e4680 1 -- 172.21.15.153:0/3831071403 shutdown_connections 2023-10-05T21:15:16.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.236+0000 7f068b7e4680 1 --2- 172.21.15.153:0/3831071403 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f05c4034140 0x7f05c40365f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.236+0000 7f068b7e4680 1 --2- 172.21.15.153:0/3831071403 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562287147f50 0x56228714db00 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.236+0000 7f068b7e4680 1 -- 172.21.15.153:0/3831071403 >> 172.21.15.153:0/3831071403 conn(0x562287143150 msgr2=0x562287141280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.236+0000 7f068b7e4680 1 -- 172.21.15.153:0/3831071403 shutdown_connections 2023-10-05T21:15:16.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.236+0000 7f068b7e4680 1 -- 172.21.15.153:0/3831071403 wait complete. 2023-10-05T21:15:16.268 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2023-10-05T21:15:16.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:16.268 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo", 2023-10-05T21:15:16.268 INFO:teuthology.orchestra.run.smithi153.stdout: "num_shards": 11, 2023-10-05T21:15:16.268 INFO:teuthology.orchestra.run.smithi153.stdout: "tenant": "", 2023-10-05T21:15:16.268 INFO:teuthology.orchestra.run.smithi153.stdout: "zonegroup": "371967c9-8a2e-480a-9a00-92e7f0730f89", 2023-10-05T21:15:16.268 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_rule": "default-placement", 2023-10-05T21:15:16.268 INFO:teuthology.orchestra.run.smithi153.stdout: "explicit_placement": { 2023-10-05T21:15:16.269 INFO:teuthology.orchestra.run.smithi153.stdout: "data_pool": "", 2023-10-05T21:15:16.269 INFO:teuthology.orchestra.run.smithi153.stdout: "data_extra_pool": "", 2023-10-05T21:15:16.269 INFO:teuthology.orchestra.run.smithi153.stdout: "index_pool": "" 2023-10-05T21:15:16.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:16.269 INFO:teuthology.orchestra.run.smithi153.stdout: "id": "193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1", 2023-10-05T21:15:16.269 INFO:teuthology.orchestra.run.smithi153.stdout: "marker": "193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1", 2023-10-05T21:15:16.269 INFO:teuthology.orchestra.run.smithi153.stdout: "index_type": "Normal", 2023-10-05T21:15:16.269 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:15:16.269 INFO:teuthology.orchestra.run.smithi153.stdout: "ver": "0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1", 2023-10-05T21:15:16.269 INFO:teuthology.orchestra.run.smithi153.stdout: "master_ver": "0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0", 2023-10-05T21:15:16.269 INFO:teuthology.orchestra.run.smithi153.stdout: "mtime": "2023-10-05T21:15:15.578691Z", 2023-10-05T21:15:16.270 INFO:teuthology.orchestra.run.smithi153.stdout: "creation_time": "2023-10-05T21:15:15.576323Z", 2023-10-05T21:15:16.270 INFO:teuthology.orchestra.run.smithi153.stdout: "max_marker": "0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#", 2023-10-05T21:15:16.270 INFO:teuthology.orchestra.run.smithi153.stdout: "usage": {}, 2023-10-05T21:15:16.270 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:15:16.270 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:16.270 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:16.270 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:16.270 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:16.270 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:16.270 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:16.270 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:16.271 INFO:teuthology.orchestra.run.smithi153.stdout:] 2023-10-05T21:15:16.271 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '371967c9-8a2e-480a-9a00-92e7f0730f89', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1', 'marker': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1', 'index_type': 'Normal', 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2023-10-05T21:15:15.578691Z', 'creation_time': '2023-10-05T21:15:15.576323Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2023-10-05T21:15:16.276 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2023-10-05T21:15:16.276 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2023-10-05T21:15:16.276 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2023-10-05T21:15:16.276 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2023-10-05T21:15:16.320 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:16.320 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:16.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.319+0000 7f0230bd2680 1 Processor -- start 2023-10-05T21:15:16.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.319+0000 7f0230bd2680 1 -- start start 2023-10-05T21:15:16.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.319+0000 7f0230bd2680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x564d650b4930 0x564d65143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.319+0000 7f0230bd2680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564d6508d990 con 0x564d651435d0 2023-10-05T21:15:16.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.319+0000 7f0230bd2680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x564d6504ddb0 con 0x564d650b4930 2023-10-05T21:15:16.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.320+0000 7f0223caa700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x564d650b4930 0x564d65143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.320+0000 7f02234a9700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x564d651435d0 0x564d651459b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56424/0 (socket says 172.21.15.153:56424) 2023-10-05T21:15:16.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.320+0000 7f02234a9700 1 -- 172.21.15.153:0/1011087933 learned_addr learned my addr 172.21.15.153:0/1011087933 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:16.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.320+0000 7f0222ca8700 1 -- 172.21.15.153:0/1011087933 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2856262524 0 0) 0x564d6508d990 con 0x564d651435d0 2023-10-05T21:15:16.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.320+0000 7f0222ca8700 1 -- 172.21.15.153:0/1011087933 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f020c001e10 con 0x564d651435d0 2023-10-05T21:15:16.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.320+0000 7f0223caa700 1 -- 172.21.15.153:0/1011087933 >> v1:172.21.15.111:6789/0 conn(0x564d651435d0 legacy=0x564d651459b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.320+0000 7f0223caa700 1 -- 172.21.15.153:0/1011087933 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d651481e0 con 0x564d650b4930 2023-10-05T21:15:16.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.320+0000 7f0223caa700 1 --2- 172.21.15.153:0/1011087933 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564d650b4930 0x564d65143090 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f021800a5d0 tx=0x7f0218005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a2912cb94b7e26 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.320+0000 7f0222ca8700 1 -- 172.21.15.153:0/1011087933 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0218007610 con 0x564d650b4930 2023-10-05T21:15:16.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.320+0000 7f0222ca8700 1 -- 172.21.15.153:0/1011087933 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0218007770 con 0x564d650b4930 2023-10-05T21:15:16.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.320+0000 7f0222ca8700 1 -- 172.21.15.153:0/1011087933 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0218007a40 con 0x564d650b4930 2023-10-05T21:15:16.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.321+0000 7f0230bd2680 1 -- 172.21.15.153:0/1011087933 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564d650b4930 msgr2=0x564d65143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.321+0000 7f0230bd2680 1 --2- 172.21.15.153:0/1011087933 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564d650b4930 0x564d65143090 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f021800a5d0 tx=0x7f0218005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:16.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.321+0000 7f0230bd2680 1 -- 172.21.15.153:0/1011087933 shutdown_connections 2023-10-05T21:15:16.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.321+0000 7f0230bd2680 1 --2- 172.21.15.153:0/1011087933 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564d650b4930 0x564d65143090 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.321+0000 7f0230bd2680 1 -- 172.21.15.153:0/1011087933 >> 172.21.15.153:0/1011087933 conn(0x564d6513ab80 msgr2=0x564d6513cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.321+0000 7f0230bd2680 1 -- 172.21.15.153:0/1011087933 shutdown_connections 2023-10-05T21:15:16.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.321+0000 7f0230bd2680 1 -- 172.21.15.153:0/1011087933 wait complete. 2023-10-05T21:15:16.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.322+0000 7f0230bd2680 1 Processor -- start 2023-10-05T21:15:16.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.322+0000 7f0230bd2680 1 -- start start 2023-10-05T21:15:16.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.322+0000 7f0230bd2680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564d650b4930 0x564d6515f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.322+0000 7f0230bd2680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d64fedea0 con 0x564d650b4930 2023-10-05T21:15:16.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.322+0000 7f0223caa700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564d650b4930 0x564d6515f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.322+0000 7f0223caa700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564d650b4930 0x564d6515f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50456/0 (socket says 172.21.15.153:50456) 2023-10-05T21:15:16.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.322+0000 7f0223caa700 1 -- 172.21.15.153:0/1296969654 learned_addr learned my addr 172.21.15.153:0/1296969654 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:16.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.322+0000 7f0223caa700 1 -- 172.21.15.153:0/1296969654 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0218005cf0 con 0x564d650b4930 2023-10-05T21:15:16.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.323+0000 7f0223caa700 1 --2- 172.21.15.153:0/1296969654 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564d650b4930 0x564d6515f6b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f021800afd0 tx=0x7f0218014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8fa15c1916fad13 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.323+0000 7f0221ca6700 1 -- 172.21.15.153:0/1296969654 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02180078e0 con 0x564d650b4930 2023-10-05T21:15:16.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.323+0000 7f0221ca6700 1 -- 172.21.15.153:0/1296969654 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0218007a40 con 0x564d650b4930 2023-10-05T21:15:16.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.323+0000 7f0221ca6700 1 -- 172.21.15.153:0/1296969654 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0218007bd0 con 0x564d650b4930 2023-10-05T21:15:16.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.323+0000 7f0230bd2680 1 -- 172.21.15.153:0/1296969654 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564d650b4930 msgr2=0x564d6515f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.323+0000 7f0230bd2680 1 --2- 172.21.15.153:0/1296969654 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564d650b4930 0x564d6515f6b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f021800afd0 tx=0x7f0218014000 comp rx=0 tx=0).stop 2023-10-05T21:15:16.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.323+0000 7f0230bd2680 1 -- 172.21.15.153:0/1296969654 shutdown_connections 2023-10-05T21:15:16.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.323+0000 7f0230bd2680 1 --2- 172.21.15.153:0/1296969654 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564d650b4930 0x564d6515f6b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.323+0000 7f0230bd2680 1 -- 172.21.15.153:0/1296969654 >> 172.21.15.153:0/1296969654 conn(0x564d6513ab80 msgr2=0x564d6515b180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.323+0000 7f0230bd2680 1 -- 172.21.15.153:0/1296969654 shutdown_connections 2023-10-05T21:15:16.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.323+0000 7f0230bd2680 1 -- 172.21.15.153:0/1296969654 wait complete. 2023-10-05T21:15:16.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.324+0000 7f0230bd2680 1 Processor -- start 2023-10-05T21:15:16.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.324+0000 7f0230bd2680 1 -- start start 2023-10-05T21:15:16.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.324+0000 7f0230bd2680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564d650b4930 0x564d651409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.324+0000 7f0230bd2680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d64fe4c80 con 0x564d650b4930 2023-10-05T21:15:16.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.324+0000 7f0223caa700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564d650b4930 0x564d651409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.324+0000 7f0223caa700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564d650b4930 0x564d651409f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50468/0 (socket says 172.21.15.153:50468) 2023-10-05T21:15:16.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.324+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 learned_addr learned my addr 172.21.15.153:0/4232035854 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:16.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.324+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d651481e0 con 0x564d650b4930 2023-10-05T21:15:16.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.324+0000 7f0223caa700 1 --2- 172.21.15.153:0/4232035854 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564d650b4930 0x564d651409f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f021800afd0 tx=0x7f021801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.325+0000 7f020bfff700 1 -- 172.21.15.153:0/4232035854 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f021801ee30 con 0x564d650b4930 2023-10-05T21:15:16.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.325+0000 7f020bfff700 1 -- 172.21.15.153:0/4232035854 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021802f460 con 0x564d650b4930 2023-10-05T21:15:16.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.325+0000 7f020bfff700 1 -- 172.21.15.153:0/4232035854 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f021802f610 con 0x564d650b4930 2023-10-05T21:15:16.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.325+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564d6513f010 con 0x564d650b4930 2023-10-05T21:15:16.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.325+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564d6513f4c0 con 0x564d650b4930 2023-10-05T21:15:16.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.325+0000 7f0230bd2680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.325+0000 7f020bfff700 1 -- 172.21.15.153:0/4232035854 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f0218026430 con 0x564d650b4930 2023-10-05T21:15:16.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.326+0000 7f020bfff700 1 --2- 172.21.15.153:0/4232035854 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0210034140 0x7f02100365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.326+0000 7f020bfff700 1 -- 172.21.15.153:0/4232035854 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f021804a750 con 0x564d650b4930 2023-10-05T21:15:16.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.326+0000 7f02234a9700 1 --2- 172.21.15.153:0/4232035854 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0210034140 0x7f02100365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.326+0000 7f0230bd2680 1 --2- 172.21.15.153:0/4232035854 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x564d651435d0 0x564d65174a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.326+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d651751f0 con 0x564d651435d0 2023-10-05T21:15:16.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.326+0000 7f02244ab700 1 --2- 172.21.15.153:0/4232035854 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x564d651435d0 0x564d65174a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.326+0000 7f02234a9700 1 --2- 172.21.15.153:0/4232035854 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0210034140 0x7f02100365f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0214004170 tx=0x7f0214001400 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.326+0000 7f02244ab700 1 --2- 172.21.15.153:0/4232035854 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x564d651435d0 0x564d65174a60 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.327+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.327+0000 7f0230bd2680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.327+0000 7f0230bd2680 20 realm 2023-10-05T21:15:16.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.327+0000 7f0230bd2680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.327+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d65172020 con 0x564d651435d0 2023-10-05T21:15:16.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.327+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.327+0000 7f0230bd2680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.327+0000 7f0230bd2680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:16.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.327+0000 7f0230bd2680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.327+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d65175cf0 con 0x564d651435d0 2023-10-05T21:15:16.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.327+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.327+0000 7f0230bd2680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.327+0000 7f0230bd2680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.327+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d65175930 con 0x564d651435d0 2023-10-05T21:15:16.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.327+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.327+0000 7f0230bd2680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.327+0000 7f0230bd2680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.327+0000 7f0230bd2680 1 --2- 172.21.15.153:0/4232035854 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x564d651770b0 0x564d65179490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.327+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d651799d0 con 0x564d651770b0 2023-10-05T21:15:16.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.327+0000 7f0223caa700 1 --2- 172.21.15.153:0/4232035854 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x564d651770b0 0x564d65179490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.328+0000 7f0223caa700 1 --2- 172.21.15.153:0/4232035854 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x564d651770b0 0x564d65179490 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.328+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.328+0000 7f0230bd2680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:16.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.328+0000 7f0230bd2680 20 searching for the correct realm 2023-10-05T21:15:16.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.328+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x564d651770b0 2023-10-05T21:15:16.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.328+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.328+0000 7f0223caa700 1 --2- 172.21.15.153:0/4232035854 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f0218038060 0x7f02180266e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.328+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x7f0218038060 2023-10-05T21:15:16.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.328+0000 7f02234a9700 1 --2- 172.21.15.153:0/4232035854 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f0218038060 0x7f02180266e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.329+0000 7f02234a9700 1 --2- 172.21.15.153:0/4232035854 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f0218038060 0x7f02180266e0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.329+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0214006070 con 0x7f0218038060 2023-10-05T21:15:16.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.329+0000 7f02234a9700 1 --2- 172.21.15.153:0/4232035854 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f021400eb60 0x7f021400d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.329+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x7f021400eb60 2023-10-05T21:15:16.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.329+0000 7f02244ab700 1 --2- 172.21.15.153:0/4232035854 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f021400eb60 0x7f021400d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.330+0000 7f02244ab700 1 --2- 172.21.15.153:0/4232035854 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f021400eb60 0x7f021400d8e0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.330+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021c00a570 con 0x7f021400eb60 2023-10-05T21:15:16.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.330+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x564d651435d0 2023-10-05T21:15:16.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.330+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.330+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x564d651435d0 2023-10-05T21:15:16.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.330+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.330+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x7f021400eb60 2023-10-05T21:15:16.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.330+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021c00a570 con 0x7f021400eb60 2023-10-05T21:15:16.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.331+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x7f021400eb60 2023-10-05T21:15:16.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.331+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021c00a570 con 0x7f021400eb60 2023-10-05T21:15:16.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.331+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x7f0218038060 2023-10-05T21:15:16.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.331+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0214006070 con 0x7f0218038060 2023-10-05T21:15:16.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.331+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x564d651770b0 2023-10-05T21:15:16.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.331+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.331+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x564d651435d0 2023-10-05T21:15:16.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.331+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.331+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x7f021400eb60 2023-10-05T21:15:16.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.332+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021c00a570 con 0x7f021400eb60 2023-10-05T21:15:16.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.332+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x564d651435d0 2023-10-05T21:15:16.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.332+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.332+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x7f0218038060 2023-10-05T21:15:16.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.332+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0214006070 con 0x7f0218038060 2023-10-05T21:15:16.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.332+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x564d651770b0 2023-10-05T21:15:16.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.332+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.332+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x564d651770b0 2023-10-05T21:15:16.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.332+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.332+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x7f021400eb60 2023-10-05T21:15:16.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.333+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021c00a570 con 0x7f021400eb60 2023-10-05T21:15:16.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.333+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x564d651770b0 2023-10-05T21:15:16.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.333+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.333+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x564d651770b0 2023-10-05T21:15:16.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.333+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.333+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x564d651435d0 2023-10-05T21:15:16.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.334+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.334+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x564d651435d0 2023-10-05T21:15:16.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.334+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.334+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x7f021400eb60 2023-10-05T21:15:16.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.334+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021c00a570 con 0x7f021400eb60 2023-10-05T21:15:16.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.334+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x564d651770b0 2023-10-05T21:15:16.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.334+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.334+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x7f0218038060 2023-10-05T21:15:16.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.335+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0214006070 con 0x7f0218038060 2023-10-05T21:15:16.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.335+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x564d651435d0 2023-10-05T21:15:16.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.335+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.335+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x7f021400eb60 2023-10-05T21:15:16.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.335+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021c00a570 con 0x7f021400eb60 2023-10-05T21:15:16.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.335+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x564d651770b0 2023-10-05T21:15:16.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.335+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.335+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x7f021400eb60 2023-10-05T21:15:16.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.336+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021c00a570 con 0x7f021400eb60 2023-10-05T21:15:16.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.336+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x7f0218038060 2023-10-05T21:15:16.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.336+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0214006070 con 0x7f0218038060 2023-10-05T21:15:16.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.336+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x564d651770b0 2023-10-05T21:15:16.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.336+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.336+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x7f021400eb60 2023-10-05T21:15:16.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.336+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021c00a570 con 0x7f021400eb60 2023-10-05T21:15:16.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.336+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x564d651435d0 2023-10-05T21:15:16.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.336+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.336+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b280 con 0x7f0218038060 2023-10-05T21:15:16.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.337+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0214006070 con 0x7f0218038060 2023-10-05T21:15:16.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.337+0000 7f0230bd2680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:16.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.337+0000 7f0230bd2680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:16.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.337+0000 7f0230bd2680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:16.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.337+0000 7f0230bd2680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:16.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.337+0000 7f0230bd2680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.337+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517a3a0 con 0x564d651435d0 2023-10-05T21:15:16.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.337+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.337+0000 7f0230bd2680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.337+0000 7f0230bd2680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.337+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517a830 con 0x564d651435d0 2023-10-05T21:15:16.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.337+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.337+0000 7f0230bd2680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.337+0000 7f0230bd2680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.337+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517ac60 con 0x564d651435d0 2023-10-05T21:15:16.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.337+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.337+0000 7f0230bd2680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:16.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.337+0000 7f0230bd2680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.337+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b630 con 0x564d651770b0 2023-10-05T21:15:16.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.338+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.338+0000 7f0230bd2680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.338+0000 7f0230bd2680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.338+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b9e0 con 0x564d651435d0 2023-10-05T21:15:16.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.338+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.338+0000 7f0230bd2680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.338+0000 7f0230bd2680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.338+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d65179fa0 con 0x564d651435d0 2023-10-05T21:15:16.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.338+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.338+0000 7f0230bd2680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.338+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d65179f70 con 0x564d651770b0 2023-10-05T21:15:16.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.338+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.338+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d65179f70 con 0x7f0218038060 2023-10-05T21:15:16.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.338+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0214006070 con 0x7f0218038060 2023-10-05T21:15:16.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.338+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d65179f70 con 0x7f021400eb60 2023-10-05T21:15:16.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.339+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021c00a570 con 0x7f021400eb60 2023-10-05T21:15:16.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.339+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b9e0 con 0x564d651435d0 2023-10-05T21:15:16.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.339+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.339+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b9e0 con 0x564d651435d0 2023-10-05T21:15:16.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.339+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.339+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b9e0 con 0x7f021400eb60 2023-10-05T21:15:16.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.340+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021c00a570 con 0x7f021400eb60 2023-10-05T21:15:16.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.340+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b9e0 con 0x7f021400eb60 2023-10-05T21:15:16.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.340+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021c00a570 con 0x7f021400eb60 2023-10-05T21:15:16.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.340+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b9e0 con 0x7f0218038060 2023-10-05T21:15:16.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.340+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0214006070 con 0x7f0218038060 2023-10-05T21:15:16.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.340+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b9e0 con 0x564d651770b0 2023-10-05T21:15:16.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.340+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.340+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b9e0 con 0x564d651435d0 2023-10-05T21:15:16.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.340+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.341+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b9e0 con 0x7f021400eb60 2023-10-05T21:15:16.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.341+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021c00a570 con 0x7f021400eb60 2023-10-05T21:15:16.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.341+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b9e0 con 0x564d651435d0 2023-10-05T21:15:16.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.341+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.341+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b9e0 con 0x7f0218038060 2023-10-05T21:15:16.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.341+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0214006070 con 0x7f0218038060 2023-10-05T21:15:16.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.341+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b9e0 con 0x564d651770b0 2023-10-05T21:15:16.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.341+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.341+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b9e0 con 0x564d651770b0 2023-10-05T21:15:16.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.342+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.342+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b9e0 con 0x7f021400eb60 2023-10-05T21:15:16.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.342+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021c00a570 con 0x7f021400eb60 2023-10-05T21:15:16.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.342+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b9e0 con 0x564d651770b0 2023-10-05T21:15:16.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.342+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.342+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b9e0 con 0x564d651770b0 2023-10-05T21:15:16.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.342+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.342+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b9e0 con 0x564d651435d0 2023-10-05T21:15:16.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.342+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.342+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b9e0 con 0x564d651435d0 2023-10-05T21:15:16.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.343+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.343+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b9e0 con 0x7f021400eb60 2023-10-05T21:15:16.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.343+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021c00a570 con 0x7f021400eb60 2023-10-05T21:15:16.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.343+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b9e0 con 0x564d651770b0 2023-10-05T21:15:16.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.343+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.343+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b9e0 con 0x7f0218038060 2023-10-05T21:15:16.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.343+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0214006070 con 0x7f0218038060 2023-10-05T21:15:16.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.343+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b9e0 con 0x564d651435d0 2023-10-05T21:15:16.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.344+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.344+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b9e0 con 0x7f021400eb60 2023-10-05T21:15:16.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.344+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021c00a570 con 0x7f021400eb60 2023-10-05T21:15:16.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.344+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b9e0 con 0x564d651770b0 2023-10-05T21:15:16.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.344+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.344+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b9e0 con 0x7f021400eb60 2023-10-05T21:15:16.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.344+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021c00a570 con 0x7f021400eb60 2023-10-05T21:15:16.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.344+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b9e0 con 0x7f0218038060 2023-10-05T21:15:16.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.345+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0214006070 con 0x7f0218038060 2023-10-05T21:15:16.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.345+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b9e0 con 0x564d651770b0 2023-10-05T21:15:16.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.345+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.345+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b9e0 con 0x7f021400eb60 2023-10-05T21:15:16.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.345+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021c00a570 con 0x7f021400eb60 2023-10-05T21:15:16.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.345+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b9e0 con 0x564d651435d0 2023-10-05T21:15:16.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.345+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.345+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517b9e0 con 0x7f0218038060 2023-10-05T21:15:16.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.346+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0214006070 con 0x7f0218038060 2023-10-05T21:15:16.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.346+0000 7f0230bd2680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:16.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.346+0000 7f0230bd2680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:16.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.346+0000 7f0230bd2680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:16.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.346+0000 7f0230bd2680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:16.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.346+0000 7f0230bd2680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.346+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d65179f70 con 0x564d651435d0 2023-10-05T21:15:16.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.346+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.346+0000 7f0230bd2680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.346+0000 7f0230bd2680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.346+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517c350 con 0x564d651770b0 2023-10-05T21:15:16.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.346+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.346+0000 7f0230bd2680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:16.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.346+0000 7f0230bd2680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.346+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517cbf0 con 0x564d651435d0 2023-10-05T21:15:16.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.346+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.346+0000 7f0230bd2680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.346+0000 7f0230bd2680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.346+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517cbf0 con 0x564d651435d0 2023-10-05T21:15:16.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.346+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.347+0000 7f0230bd2680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:16.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.347+0000 7f0230bd2680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.347+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517ccf0 con 0x7f021400eb60 2023-10-05T21:15:16.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.347+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f021c00a570 con 0x7f021400eb60 2023-10-05T21:15:16.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.347+0000 7f0230bd2680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.347+0000 7f0230bd2680 20 zone default found 2023-10-05T21:15:16.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.347+0000 7f0230bd2680 4 Realm: () 2023-10-05T21:15:16.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.347+0000 7f0230bd2680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:16.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.347+0000 7f0230bd2680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:16.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.347+0000 7f0230bd2680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:16.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.347+0000 7f0230bd2680 20 zonegroup default 2023-10-05T21:15:16.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.347+0000 7f0230bd2680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.347+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517ccf0 con 0x7f021400eb60 2023-10-05T21:15:16.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.347+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f021c00a570 con 0x7f021400eb60 2023-10-05T21:15:16.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.347+0000 7f0230bd2680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.347+0000 7f0230bd2680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.347+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517e670 con 0x564d651770b0 2023-10-05T21:15:16.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.347+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.347+0000 7f0230bd2680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.347+0000 7f0230bd2680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.347+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517ea20 con 0x564d651770b0 2023-10-05T21:15:16.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.348+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.348+0000 7f0230bd2680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.348+0000 7f0230bd2680 20 started sync module instance, tier type = 2023-10-05T21:15:16.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.348+0000 7f0230bd2680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:16.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.348+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517dd30 con 0x7f0218038060 2023-10-05T21:15:16.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.348+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0214006070 con 0x7f0218038060 2023-10-05T21:15:16.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.348+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94890408534320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517f2c0 con 0x7f0218038060 2023-10-05T21:15:16.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.348+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517fb60 con 0x564d651435d0 2023-10-05T21:15:16.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.349+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94890408534320] v29'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0214006070 con 0x7f0218038060 2023-10-05T21:15:16.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.349+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.349+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94890408539760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6517ef10 con 0x564d651435d0 2023-10-05T21:15:16.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.349+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d651807c0 con 0x564d651770b0 2023-10-05T21:15:16.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.350+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.350+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94890408539760] v29'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.350+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94890408542864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d651810b0 con 0x564d651770b0 2023-10-05T21:15:16.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.350+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d651815d0 con 0x7f0218038060 2023-10-05T21:15:16.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.351+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0214006070 con 0x7f0218038060 2023-10-05T21:15:16.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.351+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94890408548736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d651822c0 con 0x7f0218038060 2023-10-05T21:15:16.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.351+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94890408542864] v29'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.351+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d65180bc0 con 0x564d651435d0 2023-10-05T21:15:16.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.352+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.352+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94890408548736] v29'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0214006070 con 0x7f0218038060 2023-10-05T21:15:16.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.352+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94890408552416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d65182c30 con 0x564d651435d0 2023-10-05T21:15:16.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.352+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d651834d0 con 0x7f021400eb60 2023-10-05T21:15:16.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.352+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94890408552416] v29'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.353+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021c00a570 con 0x7f021400eb60 2023-10-05T21:15:16.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.353+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94890408553520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d651838d0 con 0x7f021400eb60 2023-10-05T21:15:16.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.353+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d65184170 con 0x7f021400eb60 2023-10-05T21:15:16.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.353+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(96 notify.6 [create] v29'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021c00a570 con 0x7f021400eb60 2023-10-05T21:15:16.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.353+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94890408556816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d651843d0 con 0x7f021400eb60 2023-10-05T21:15:16.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.353+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(95 notify.5 [watch watch cookie 94890408553520] v29'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021c00a570 con 0x7f021400eb60 2023-10-05T21:15:16.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.353+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d65184fd0 con 0x7f021400eb60 2023-10-05T21:15:16.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.354+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(98 notify.7 [create] v29'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021c00a570 con 0x7f021400eb60 2023-10-05T21:15:16.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.354+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(97 notify.6 [watch watch cookie 94890408556816] v29'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021c00a570 con 0x7f021400eb60 2023-10-05T21:15:16.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.354+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94890408561248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d65184f90 con 0x7f021400eb60 2023-10-05T21:15:16.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.354+0000 7f0230bd2680 20 add_watcher() i=0 2023-10-05T21:15:16.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.354+0000 7f0230bd2680 20 add_watcher() i=1 2023-10-05T21:15:16.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.354+0000 7f0230bd2680 20 add_watcher() i=2 2023-10-05T21:15:16.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.354+0000 7f0230bd2680 20 add_watcher() i=3 2023-10-05T21:15:16.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.354+0000 7f0230bd2680 20 add_watcher() i=4 2023-10-05T21:15:16.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.354+0000 7f0230bd2680 20 add_watcher() i=5 2023-10-05T21:15:16.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.354+0000 7f0230bd2680 20 add_watcher() i=6 2023-10-05T21:15:16.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.355+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94890408561248] v29'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021c00a570 con 0x7f021400eb60 2023-10-05T21:15:16.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.355+0000 7f0230bd2680 20 add_watcher() i=7 2023-10-05T21:15:16.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.355+0000 7f0230bd2680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:16.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.355+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d65183e50 con 0x564d651435d0 2023-10-05T21:15:16.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.355+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.355+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94890408554624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d65183e50 con 0x564d651435d0 2023-10-05T21:15:16.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.356+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94890408554624] v29'100 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.356+0000 7f01f57e2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:16.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.356+0000 7f0230bd2680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:16.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.356+0000 7f0230bd2680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:16.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.356+0000 7f0230bd2680 1 Processor -- start 2023-10-05T21:15:16.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.356+0000 7f0230bd2680 1 -- start start 2023-10-05T21:15:16.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.356+0000 7f0230bd2680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564d651927c0 0x564d65192bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.356+0000 7f0230bd2680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d651931a0 con 0x564d651927c0 2023-10-05T21:15:16.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.357+0000 7f02234a9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564d651927c0 0x564d65192bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.357+0000 7f02234a9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564d651927c0 0x564d65192bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50484/0 (socket says 172.21.15.153:50484) 2023-10-05T21:15:16.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.357+0000 7f02234a9700 1 -- 172.21.15.153:0/4107958939 learned_addr learned my addr 172.21.15.153:0/4107958939 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:16.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.357+0000 7f02234a9700 1 -- 172.21.15.153:0/4107958939 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d651932e0 con 0x564d651927c0 2023-10-05T21:15:16.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.357+0000 7f02234a9700 1 --2- 172.21.15.153:0/4107958939 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564d651927c0 0x564d65192bd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x564d65171fb0 tx=0x7f0214006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b96d278a74f2d1e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.357+0000 7f01f4fe1700 1 -- 172.21.15.153:0/4107958939 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0214023040 con 0x564d651927c0 2023-10-05T21:15:16.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.357+0000 7f01f4fe1700 1 -- 172.21.15.153:0/4107958939 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0214024040 con 0x564d651927c0 2023-10-05T21:15:16.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.357+0000 7f01f4fe1700 1 -- 172.21.15.153:0/4107958939 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0214013040 con 0x564d651927c0 2023-10-05T21:15:16.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.358+0000 7f0230bd2680 1 -- 172.21.15.153:0/4107958939 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564d651927c0 msgr2=0x564d65192bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.358+0000 7f0230bd2680 1 --2- 172.21.15.153:0/4107958939 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564d651927c0 0x564d65192bd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x564d65171fb0 tx=0x7f0214006000 comp rx=0 tx=0).stop 2023-10-05T21:15:16.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.358+0000 7f0230bd2680 1 -- 172.21.15.153:0/4107958939 shutdown_connections 2023-10-05T21:15:16.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.358+0000 7f0230bd2680 1 --2- 172.21.15.153:0/4107958939 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564d651927c0 0x564d65192bd0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.358+0000 7f0230bd2680 1 -- 172.21.15.153:0/4107958939 >> 172.21.15.153:0/4107958939 conn(0x564d6518d9c0 msgr2=0x564d6518bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.358+0000 7f0230bd2680 1 -- 172.21.15.153:0/4107958939 shutdown_connections 2023-10-05T21:15:16.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.358+0000 7f0230bd2680 1 -- 172.21.15.153:0/4107958939 wait complete. 2023-10-05T21:15:16.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.358+0000 7f0230bd2680 1 Processor -- start 2023-10-05T21:15:16.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.358+0000 7f0230bd2680 1 -- start start 2023-10-05T21:15:16.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.359+0000 7f0230bd2680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564d651927c0 0x564d65198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.359+0000 7f0230bd2680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d65198940 con 0x564d651927c0 2023-10-05T21:15:16.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.359+0000 7f02234a9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564d651927c0 0x564d65198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.359+0000 7f02234a9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564d651927c0 0x564d65198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50490/0 (socket says 172.21.15.153:50490) 2023-10-05T21:15:16.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.359+0000 7f02234a9700 1 -- 172.21.15.153:0/3435540017 learned_addr learned my addr 172.21.15.153:0/3435540017 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:16.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.359+0000 7f02234a9700 1 -- 172.21.15.153:0/3435540017 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020c001e10 con 0x564d651927c0 2023-10-05T21:15:16.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.359+0000 7f02234a9700 1 --2- 172.21.15.153:0/3435540017 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564d651927c0 0x564d65198400 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f021403b040 tx=0x7f0214030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.359+0000 7f016effd700 1 -- 172.21.15.153:0/3435540017 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0214023070 con 0x564d651927c0 2023-10-05T21:15:16.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.359+0000 7f016effd700 1 -- 172.21.15.153:0/3435540017 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021402d030 con 0x564d651927c0 2023-10-05T21:15:16.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.359+0000 7f016effd700 1 -- 172.21.15.153:0/3435540017 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f021402d1c0 con 0x564d651927c0 2023-10-05T21:15:16.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.359+0000 7f0230bd2680 1 -- 172.21.15.153:0/3435540017 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564d65198b40 con 0x564d651927c0 2023-10-05T21:15:16.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.359+0000 7f0230bd2680 1 -- 172.21.15.153:0/3435540017 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564d65198f90 con 0x564d651927c0 2023-10-05T21:15:16.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.360+0000 7f016effd700 1 -- 172.21.15.153:0/3435540017 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f021401e700 con 0x564d651927c0 2023-10-05T21:15:16.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.360+0000 7f016effd700 1 --2- 172.21.15.153:0/3435540017 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0164034140 0x7f01640365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.360+0000 7f016effd700 1 -- 172.21.15.153:0/3435540017 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f0214043b00 con 0x564d651927c0 2023-10-05T21:15:16.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.360+0000 7f02244ab700 1 --2- 172.21.15.153:0/3435540017 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0164034140 0x7f01640365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.360+0000 7f0230bd2680 5 note: GC not initialized 2023-10-05T21:15:16.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.361+0000 7f02244ab700 1 --2- 172.21.15.153:0/3435540017 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0164034140 0x7f01640365f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x564d65183540 tx=0x7f021c00aee0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.361+0000 7f0163fff700 20 reqs_thread_entry: start 2023-10-05T21:15:16.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.362+0000 7f0161ffb700 20 reqs_thread_entry: start 2023-10-05T21:15:16.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.362+0000 7f0230bd2680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:16.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.362+0000 7f0230bd2680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:16.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.362+0000 7f014ffff700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:46 2023 2023-10-05T21:15:16.396 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:16.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.362+0000 7f014f7fe700 20 reqs_thread_entry: start 2023-10-05T21:15:16.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.362+0000 7f0230bd2680 20 get_system_obj_state: rctx=0x7ffdf9bec5a0 obj=default.rgw.meta:root:myfoo state=0x564d64ff3240 s->prefetch_data=0 2023-10-05T21:15:16.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.362+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:102 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d651fe460 con 0x7f0218038060 2023-10-05T21:15:16.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.362+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(102 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f021403f040 con 0x7f0218038060 2023-10-05T21:15:16.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.362+0000 7f0230bd2680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:16.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.362+0000 7f0230bd2680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.362+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:103 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d65200830 con 0x7f0218038060 2023-10-05T21:15:16.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.363+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(103 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7f021403f040 con 0x7f0218038060 2023-10-05T21:15:16.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.363+0000 7f0230bd2680 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T21:15:16.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.363+0000 7f0230bd2680 20 get_system_obj_state: rctx=0x7ffdf9bec5a0 obj=default.rgw.meta:root:.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 state=0x564d64ff3500 s->prefetch_data=0 2023-10-05T21:15:16.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.363+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:104 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d651fed50 con 0x564d651770b0 2023-10-05T21:15:16.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.363+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(104 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.363+0000 7f0230bd2680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:16.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.363+0000 7f0230bd2680 20 Read xattr: user.rgw.acl 2023-10-05T21:15:16.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.363+0000 7f0230bd2680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:16.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.363+0000 7f0230bd2680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.363+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:105 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d65201dc0 con 0x564d651770b0 2023-10-05T21:15:16.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.364+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(105 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.364+0000 7f0230bd2680 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T21:15:16.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.364+0000 7f0230bd2680 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T21:15:16.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.364+0000 7f0230bd2680 20 get_system_obj_state: rctx=0x7ffdf9bec4f0 obj=default.rgw.meta:root:myfoo state=0x564d64ff3500 s->prefetch_data=0 2023-10-05T21:15:16.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.364+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:106 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d651ffc10 con 0x7f0218038060 2023-10-05T21:15:16.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.364+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(106 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f02140520a0 con 0x7f0218038060 2023-10-05T21:15:16.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.364+0000 7f0230bd2680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:16.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.364+0000 7f0230bd2680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.364+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:107 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d651fd8c0 con 0x7f0218038060 2023-10-05T21:15:16.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.364+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(107 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7f02140520a0 con 0x7f0218038060 2023-10-05T21:15:16.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.364+0000 7f0230bd2680 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T21:15:16.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.364+0000 7f0230bd2680 20 get_system_obj_state: rctx=0x7ffdf9bec4f0 obj=default.rgw.meta:root:.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 state=0x564d64ff3240 s->prefetch_data=0 2023-10-05T21:15:16.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.364+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:108 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d651fd8c0 con 0x564d651770b0 2023-10-05T21:15:16.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.365+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(108 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.365+0000 7f0230bd2680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:16.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.365+0000 7f0230bd2680 20 Read xattr: user.rgw.acl 2023-10-05T21:15:16.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.365+0000 7f0230bd2680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:16.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.365+0000 7f0230bd2680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.365+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:109 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d652042d0 con 0x564d651770b0 2023-10-05T21:15:16.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.365+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== osd_op_reply(109 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.365+0000 7f0230bd2680 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T21:15:16.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.365+0000 7f0230bd2680 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T21:15:16.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.365+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:110 4.6 4:63e054bc:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d65203790 con 0x564d651770b0 2023-10-05T21:15:16.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.365+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:111 4.18 4:1a996cea:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d65206910 con 0x7f0218038060 2023-10-05T21:15:16.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.365+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:112 4.18 4:198ebb7d:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d652091d0 con 0x7f0218038060 2023-10-05T21:15:16.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.365+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:113 4.1e 4:7ac3851f:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6520bc70 con 0x7f021400eb60 2023-10-05T21:15:16.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.365+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:114 4.20 4:0486cb16:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d652091d0 con 0x564d651435d0 2023-10-05T21:15:16.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.365+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:115 4.1a 4:5b58f5c0:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d65210f10 con 0x7f0218038060 2023-10-05T21:15:16.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.365+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:116 4.14 4:2bb8f6a0:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d65213af0 con 0x564d651770b0 2023-10-05T21:15:16.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.365+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:117 4.3f 4:fc00c6e8:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d65216430 con 0x7f0218038060 2023-10-05T21:15:16.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.365+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:118 4.35 4:afba4511:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d65218cf0 con 0x564d651435d0 2023-10-05T21:15:16.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.365+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:119 4.5 4:a0455ddf:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6521bb60 con 0x564d651770b0 2023-10-05T21:15:16.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.365+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:120 4.a 4:50c49731:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6521eaa0 con 0x7f0218038060 2023-10-05T21:15:16.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.365+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(110 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.366+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(113 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f021c00a570 con 0x7f021400eb60 2023-10-05T21:15:16.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.366+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 31 ==== osd_op_reply(116 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.366+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(114 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.366+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== osd_op_reply(111 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f02140520a0 con 0x7f0218038060 2023-10-05T21:15:16.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.366+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 32 ==== osd_op_reply(119 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.366+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 <== osd.2 v2:172.21.15.153:6807/140454 22 ==== osd_op_reply(115 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.5 [call out=124b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f02140520a0 con 0x7f0218038060 2023-10-05T21:15:16.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.366+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 <== osd.2 v2:172.21.15.153:6807/140454 23 ==== osd_op_reply(112 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.2 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f02140520a0 con 0x7f0218038060 2023-10-05T21:15:16.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.366+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(118 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.366+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 <== osd.2 v2:172.21.15.153:6807/140454 24 ==== osd_op_reply(117 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f0214059040 con 0x7f0218038060 2023-10-05T21:15:16.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.366+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 <== osd.2 v2:172.21.15.153:6807/140454 25 ==== osd_op_reply(120 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0214059040 con 0x7f0218038060 2023-10-05T21:15:16.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.366+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:121 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94890408534320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6521bb60 con 0x7f0218038060 2023-10-05T21:15:16.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.367+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 <== osd.2 v2:172.21.15.153:6807/140454 26 ==== osd_op_reply(121 notify.0 [watch unwatch cookie 94890408534320] v29'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0214059040 con 0x7f0218038060 2023-10-05T21:15:16.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.367+0000 7f0230bd2680 20 remove_watcher() i=0 2023-10-05T21:15:16.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.367+0000 7f0230bd2680 2 removed watcher, disabling cache 2023-10-05T21:15:16.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.367+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:122 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94890408539760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6521bb60 con 0x564d651435d0 2023-10-05T21:15:16.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.368+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(122 notify.1 [watch unwatch cookie 94890408539760] v29'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.368+0000 7f0230bd2680 20 remove_watcher() i=1 2023-10-05T21:15:16.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.368+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:123 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94890408542864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6521bb60 con 0x564d651770b0 2023-10-05T21:15:16.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.369+0000 7f0223caa700 1 -- 172.21.15.153:0/4232035854 <== osd.3 v2:172.21.15.153:6800/140455 33 ==== osd_op_reply(123 notify.2 [watch unwatch cookie 94890408542864] v29'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0218024800 con 0x564d651770b0 2023-10-05T21:15:16.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.369+0000 7f0230bd2680 20 remove_watcher() i=2 2023-10-05T21:15:16.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.369+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:124 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94890408548736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6521bb60 con 0x7f0218038060 2023-10-05T21:15:16.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.369+0000 7f02234a9700 1 -- 172.21.15.153:0/4232035854 <== osd.2 v2:172.21.15.153:6807/140454 27 ==== osd_op_reply(124 notify.3 [watch unwatch cookie 94890408548736] v29'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0214059040 con 0x7f0218038060 2023-10-05T21:15:16.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.369+0000 7f0230bd2680 20 remove_watcher() i=3 2023-10-05T21:15:16.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.369+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:125 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94890408552416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6521bb60 con 0x564d651435d0 2023-10-05T21:15:16.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.370+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(125 notify.4 [watch unwatch cookie 94890408552416] v29'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.370+0000 7f0230bd2680 20 remove_watcher() i=4 2023-10-05T21:15:16.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.370+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:126 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94890408553520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6521bb60 con 0x7f021400eb60 2023-10-05T21:15:16.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.371+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(126 notify.5 [watch unwatch cookie 94890408553520] v29'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021c00a570 con 0x7f021400eb60 2023-10-05T21:15:16.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.371+0000 7f0230bd2680 20 remove_watcher() i=5 2023-10-05T21:15:16.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.371+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:127 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94890408556816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6521bb60 con 0x7f021400eb60 2023-10-05T21:15:16.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.372+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(127 notify.6 [watch unwatch cookie 94890408556816] v29'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021c00a570 con 0x7f021400eb60 2023-10-05T21:15:16.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.372+0000 7f0230bd2680 20 remove_watcher() i=6 2023-10-05T21:15:16.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.372+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:128 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94890408561248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6521bb60 con 0x7f021400eb60 2023-10-05T21:15:16.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.372+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(128 notify.7 [watch unwatch cookie 94890408561248] v29'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021c00a570 con 0x7f021400eb60 2023-10-05T21:15:16.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.372+0000 7f0230bd2680 20 remove_watcher() i=7 2023-10-05T21:15:16.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.373+0000 7f01f57e2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:16.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.373+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:129 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94890408554624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x564d6521bb60 con 0x564d651435d0 2023-10-05T21:15:16.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.374+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(129 data_loggenerations_metadata [watch unwatch cookie 94890408554624] v29'101 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f021c00a570 con 0x564d651435d0 2023-10-05T21:15:16.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.374+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f021400eb60 msgr2=0x7f021400d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.374+0000 7f0230bd2680 1 --2- 172.21.15.153:0/4232035854 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f021400eb60 0x7f021400d8e0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.374+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x564d651435d0 msgr2=0x564d65174a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.374+0000 7f0230bd2680 1 --2- 172.21.15.153:0/4232035854 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x564d651435d0 0x564d65174a60 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.374+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f0218038060 msgr2=0x7f02180266e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.374+0000 7f0230bd2680 1 --2- 172.21.15.153:0/4232035854 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f0218038060 0x7f02180266e0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.374+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x564d651770b0 msgr2=0x564d65179490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.374+0000 7f0230bd2680 1 --2- 172.21.15.153:0/4232035854 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x564d651770b0 0x564d65179490 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.374+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0210034140 msgr2=0x7f02100365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.374+0000 7f0230bd2680 1 --2- 172.21.15.153:0/4232035854 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0210034140 0x7f02100365f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0214004170 tx=0x7f0214001400 comp rx=0 tx=0).stop 2023-10-05T21:15:16.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.374+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564d650b4930 msgr2=0x564d651409f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.374+0000 7f0230bd2680 1 --2- 172.21.15.153:0/4232035854 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564d650b4930 0x564d651409f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f021800afd0 tx=0x7f021801c000 comp rx=0 tx=0).stop 2023-10-05T21:15:16.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.374+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 reap_dead start 2023-10-05T21:15:16.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.374+0000 7f02244ab700 1 -- 172.21.15.153:0/4232035854 reap_dead start 2023-10-05T21:15:16.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.374+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 shutdown_connections 2023-10-05T21:15:16.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.374+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 >> 172.21.15.153:0/4232035854 conn(0x564d6513ab80 msgr2=0x564d65159a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.374+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 shutdown_connections 2023-10-05T21:15:16.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.374+0000 7f0230bd2680 1 -- 172.21.15.153:0/4232035854 wait complete. 2023-10-05T21:15:16.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.375+0000 7f0230bd2680 1 -- 172.21.15.153:0/3435540017 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0164034140 msgr2=0x7f01640365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.375+0000 7f0230bd2680 1 --2- 172.21.15.153:0/3435540017 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0164034140 0x7f01640365f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x564d65183540 tx=0x7f021c00aee0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.375+0000 7f0230bd2680 1 -- 172.21.15.153:0/3435540017 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564d651927c0 msgr2=0x564d65198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.375+0000 7f0230bd2680 1 --2- 172.21.15.153:0/3435540017 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564d651927c0 0x564d65198400 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f021403b040 tx=0x7f0214030000 comp rx=0 tx=0).stop 2023-10-05T21:15:16.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.375+0000 7f0230bd2680 1 -- 172.21.15.153:0/3435540017 shutdown_connections 2023-10-05T21:15:16.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.375+0000 7f0230bd2680 1 --2- 172.21.15.153:0/3435540017 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0164034140 0x7f01640365f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.375+0000 7f0230bd2680 1 --2- 172.21.15.153:0/3435540017 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564d651927c0 0x564d65198400 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.375+0000 7f0230bd2680 1 -- 172.21.15.153:0/3435540017 >> 172.21.15.153:0/3435540017 conn(0x564d6518d9c0 msgr2=0x564d6518baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.375+0000 7f0230bd2680 1 -- 172.21.15.153:0/3435540017 shutdown_connections 2023-10-05T21:15:16.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.375+0000 7f0230bd2680 1 -- 172.21.15.153:0/3435540017 wait complete. 2023-10-05T21:15:16.407 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:16.408 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo", 2023-10-05T21:15:16.408 INFO:teuthology.orchestra.run.smithi153.stdout: "num_shards": 11, 2023-10-05T21:15:16.408 INFO:teuthology.orchestra.run.smithi153.stdout: "tenant": "", 2023-10-05T21:15:16.408 INFO:teuthology.orchestra.run.smithi153.stdout: "zonegroup": "371967c9-8a2e-480a-9a00-92e7f0730f89", 2023-10-05T21:15:16.408 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_rule": "default-placement", 2023-10-05T21:15:16.408 INFO:teuthology.orchestra.run.smithi153.stdout: "explicit_placement": { 2023-10-05T21:15:16.408 INFO:teuthology.orchestra.run.smithi153.stdout: "data_pool": "", 2023-10-05T21:15:16.408 INFO:teuthology.orchestra.run.smithi153.stdout: "data_extra_pool": "", 2023-10-05T21:15:16.408 INFO:teuthology.orchestra.run.smithi153.stdout: "index_pool": "" 2023-10-05T21:15:16.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:16.409 INFO:teuthology.orchestra.run.smithi153.stdout: "id": "193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1", 2023-10-05T21:15:16.409 INFO:teuthology.orchestra.run.smithi153.stdout: "marker": "193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1", 2023-10-05T21:15:16.409 INFO:teuthology.orchestra.run.smithi153.stdout: "index_type": "Normal", 2023-10-05T21:15:16.409 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:15:16.409 INFO:teuthology.orchestra.run.smithi153.stdout: "ver": "0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1", 2023-10-05T21:15:16.409 INFO:teuthology.orchestra.run.smithi153.stdout: "master_ver": "0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0", 2023-10-05T21:15:16.409 INFO:teuthology.orchestra.run.smithi153.stdout: "mtime": "2023-10-05T21:15:15.578691Z", 2023-10-05T21:15:16.409 INFO:teuthology.orchestra.run.smithi153.stdout: "creation_time": "2023-10-05T21:15:15.576323Z", 2023-10-05T21:15:16.409 INFO:teuthology.orchestra.run.smithi153.stdout: "max_marker": "0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#", 2023-10-05T21:15:16.409 INFO:teuthology.orchestra.run.smithi153.stdout: "usage": { 2023-10-05T21:15:16.409 INFO:teuthology.orchestra.run.smithi153.stdout: "rgw.main": { 2023-10-05T21:15:16.409 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 3, 2023-10-05T21:15:16.410 INFO:teuthology.orchestra.run.smithi153.stdout: "size_actual": 4096, 2023-10-05T21:15:16.410 INFO:teuthology.orchestra.run.smithi153.stdout: "size_utilized": 3, 2023-10-05T21:15:16.410 INFO:teuthology.orchestra.run.smithi153.stdout: "size_kb": 1, 2023-10-05T21:15:16.410 INFO:teuthology.orchestra.run.smithi153.stdout: "size_kb_actual": 4, 2023-10-05T21:15:16.410 INFO:teuthology.orchestra.run.smithi153.stdout: "size_kb_utilized": 1, 2023-10-05T21:15:16.410 INFO:teuthology.orchestra.run.smithi153.stdout: "num_objects": 1 2023-10-05T21:15:16.410 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:16.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:16.410 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:15:16.410 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:16.410 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:16.410 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:16.411 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:16.411 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:16.411 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:16.411 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:16.411 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '371967c9-8a2e-480a-9a00-92e7f0730f89', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1', 'marker': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1', 'index_type': 'Normal', 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2023-10-05T21:15:15.578691Z', 'creation_time': '2023-10-05T21:15:15.576323Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2023-10-05T21:15:16.411 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2023-10-05T21:15:16.411 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2023-10-05T21:15:16.411 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2023-10-05T21:15:16.456 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:16.456 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:16.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.455+0000 7f5e09c6d680 1 Processor -- start 2023-10-05T21:15:16.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.455+0000 7f5e09c6d680 1 -- start start 2023-10-05T21:15:16.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.456+0000 7f5e09c6d680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x563843a9e7f0 0x563843aa0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.456+0000 7f5e09c6d680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5638439e8930 con 0x563843a9a2c0 2023-10-05T21:15:16.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.456+0000 7f5e09c6d680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x5638439a8db0 con 0x563843a9e7f0 2023-10-05T21:15:16.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.456+0000 7f5df7fff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x563843a9e7f0 0x563843aa0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.456+0000 7f5dfcd45700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x563843a9a2c0 0x563843a9a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56440/0 (socket says 172.21.15.153:56440) 2023-10-05T21:15:16.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.456+0000 7f5dfcd45700 1 -- 172.21.15.153:0/2227630905 learned_addr learned my addr 172.21.15.153:0/2227630905 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:16.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.456+0000 7f5df7fff700 1 -- 172.21.15.153:0/2227630905 >> v1:172.21.15.111:6789/0 conn(0x563843a9a2c0 legacy=0x563843a9a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.456+0000 7f5df77fe700 1 -- 172.21.15.153:0/2227630905 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291076234 0 0) 0x5638439e8930 con 0x563843a9a2c0 2023-10-05T21:15:16.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.456+0000 7f5df7fff700 1 -- 172.21.15.153:0/2227630905 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563843aa2120 con 0x563843a9e7f0 2023-10-05T21:15:16.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.456+0000 7f5df7fff700 1 --2- 172.21.15.153:0/2227630905 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563843a9e7f0 0x563843aa0bd0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5df000a6a0 tx=0x7f5df0005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7faeed386bf6470c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.457+0000 7f5df77fe700 1 -- 172.21.15.153:0/2227630905 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5df000f070 con 0x563843a9e7f0 2023-10-05T21:15:16.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.457+0000 7f5df77fe700 1 -- 172.21.15.153:0/2227630905 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df000a2e0 con 0x563843a9e7f0 2023-10-05T21:15:16.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.457+0000 7f5df77fe700 1 -- 172.21.15.153:0/2227630905 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5df00085b0 con 0x563843a9e7f0 2023-10-05T21:15:16.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.457+0000 7f5e09c6d680 1 -- 172.21.15.153:0/2227630905 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563843a9e7f0 msgr2=0x563843aa0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.457+0000 7f5e09c6d680 1 --2- 172.21.15.153:0/2227630905 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563843a9e7f0 0x563843aa0bd0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5df000a6a0 tx=0x7f5df0005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:16.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.457+0000 7f5e09c6d680 1 -- 172.21.15.153:0/2227630905 shutdown_connections 2023-10-05T21:15:16.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.457+0000 7f5e09c6d680 1 --2- 172.21.15.153:0/2227630905 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563843a9e7f0 0x563843aa0bd0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.457+0000 7f5e09c6d680 1 -- 172.21.15.153:0/2227630905 >> 172.21.15.153:0/2227630905 conn(0x563843a95b90 msgr2=0x563843a97fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.457+0000 7f5e09c6d680 1 -- 172.21.15.153:0/2227630905 shutdown_connections 2023-10-05T21:15:16.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.457+0000 7f5e09c6d680 1 -- 172.21.15.153:0/2227630905 wait complete. 2023-10-05T21:15:16.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.458+0000 7f5e09c6d680 1 Processor -- start 2023-10-05T21:15:16.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.458+0000 7f5e09c6d680 1 -- start start 2023-10-05T21:15:16.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.458+0000 7f5e09c6d680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563843a9a2c0 0x563843abc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.458+0000 7f5e09c6d680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x563843948ea0 con 0x563843a9a2c0 2023-10-05T21:15:16.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.458+0000 7f5dfcd45700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563843a9a2c0 0x563843abc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.458+0000 7f5dfcd45700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563843a9a2c0 0x563843abc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50508/0 (socket says 172.21.15.153:50508) 2023-10-05T21:15:16.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.458+0000 7f5dfcd45700 1 -- 172.21.15.153:0/2942178487 learned_addr learned my addr 172.21.15.153:0/2942178487 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:16.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.458+0000 7f5dfcd45700 1 -- 172.21.15.153:0/2942178487 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df0005cf0 con 0x563843a9a2c0 2023-10-05T21:15:16.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.458+0000 7f5dfcd45700 1 --2- 172.21.15.153:0/2942178487 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563843a9a2c0 0x563843abc900 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5de8001dc0 tx=0x7f5de8001790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02331d36caf6a18 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.459+0000 7f5df67fc700 1 -- 172.21.15.153:0/2942178487 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5de800bce0 con 0x563843a9a2c0 2023-10-05T21:15:16.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.459+0000 7f5df67fc700 1 -- 172.21.15.153:0/2942178487 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de800be40 con 0x563843a9a2c0 2023-10-05T21:15:16.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.459+0000 7f5df67fc700 1 -- 172.21.15.153:0/2942178487 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5de800e5d0 con 0x563843a9a2c0 2023-10-05T21:15:16.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.459+0000 7f5e09c6d680 1 -- 172.21.15.153:0/2942178487 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563843a9a2c0 msgr2=0x563843abc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.459+0000 7f5e09c6d680 1 --2- 172.21.15.153:0/2942178487 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563843a9a2c0 0x563843abc900 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5de8001dc0 tx=0x7f5de8001790 comp rx=0 tx=0).stop 2023-10-05T21:15:16.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.459+0000 7f5e09c6d680 1 -- 172.21.15.153:0/2942178487 shutdown_connections 2023-10-05T21:15:16.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.459+0000 7f5e09c6d680 1 --2- 172.21.15.153:0/2942178487 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563843a9a2c0 0x563843abc900 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.459+0000 7f5e09c6d680 1 -- 172.21.15.153:0/2942178487 >> 172.21.15.153:0/2942178487 conn(0x563843a95b90 msgr2=0x563843ab3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.459+0000 7f5e09c6d680 1 -- 172.21.15.153:0/2942178487 shutdown_connections 2023-10-05T21:15:16.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.459+0000 7f5e09c6d680 1 -- 172.21.15.153:0/2942178487 wait complete. 2023-10-05T21:15:16.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.459+0000 7f5e09c6d680 1 Processor -- start 2023-10-05T21:15:16.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.459+0000 7f5e09c6d680 1 -- start start 2023-10-05T21:15:16.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.460+0000 7f5e09c6d680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563843a9a2c0 0x563843ac3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.460+0000 7f5e09c6d680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x56384393fc80 con 0x563843a9a2c0 2023-10-05T21:15:16.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.460+0000 7f5dfcd45700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563843a9a2c0 0x563843ac3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.460+0000 7f5dfcd45700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563843a9a2c0 0x563843ac3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50514/0 (socket says 172.21.15.153:50514) 2023-10-05T21:15:16.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.460+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 learned_addr learned my addr 172.21.15.153:0/916914014 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:16.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.460+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de8001a70 con 0x563843a9a2c0 2023-10-05T21:15:16.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.460+0000 7f5dfcd45700 1 --2- 172.21.15.153:0/916914014 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563843a9a2c0 0x563843ac3dc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5de80017d0 tx=0x7f5de8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.460+0000 7f5df4ff9700 1 -- 172.21.15.153:0/916914014 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5de801f070 con 0x563843a9a2c0 2023-10-05T21:15:16.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.460+0000 7f5df4ff9700 1 -- 172.21.15.153:0/916914014 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de801a4d0 con 0x563843a9a2c0 2023-10-05T21:15:16.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.460+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563843ac4300 con 0x563843a9a2c0 2023-10-05T21:15:16.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.460+0000 7f5df4ff9700 1 -- 172.21.15.153:0/916914014 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5de801a7a0 con 0x563843a9a2c0 2023-10-05T21:15:16.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.460+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563843ac4750 con 0x563843a9a2c0 2023-10-05T21:15:16.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.461+0000 7f5df4ff9700 1 -- 172.21.15.153:0/916914014 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f5de801a900 con 0x563843a9a2c0 2023-10-05T21:15:16.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.461+0000 7f5e09c6d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.461+0000 7f5df4ff9700 1 --2- 172.21.15.153:0/916914014 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5de00340f0 0x7f5de00365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.461+0000 7f5df4ff9700 1 -- 172.21.15.153:0/916914014 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f5de8048fc0 con 0x563843a9a2c0 2023-10-05T21:15:16.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.461+0000 7f5df7fff700 1 --2- 172.21.15.153:0/916914014 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5de00340f0 0x7f5de00365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.461+0000 7f5e09c6d680 1 --2- 172.21.15.153:0/916914014 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x563843a9e7f0 0x563843acfb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.461+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad02b0 con 0x563843a9e7f0 2023-10-05T21:15:16.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.462+0000 7f5dfd546700 1 --2- 172.21.15.153:0/916914014 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x563843a9e7f0 0x563843acfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.462+0000 7f5df7fff700 1 --2- 172.21.15.153:0/916914014 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5de00340f0 0x7f5de00365a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5df0005a90 tx=0x7f5df0018000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.462+0000 7f5dfd546700 1 --2- 172.21.15.153:0/916914014 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x563843a9e7f0 0x563843acfb20 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.462+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.462+0000 7f5e09c6d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.462+0000 7f5e09c6d680 20 realm 2023-10-05T21:15:16.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.462+0000 7f5e09c6d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.462+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843acd100 con 0x563843a9e7f0 2023-10-05T21:15:16.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.462+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.463+0000 7f5e09c6d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.463+0000 7f5e09c6d680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:16.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.463+0000 7f5e09c6d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.463+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad0db0 con 0x563843a9e7f0 2023-10-05T21:15:16.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.463+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.463+0000 7f5e09c6d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.463+0000 7f5e09c6d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.463+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad16d0 con 0x563843a9e7f0 2023-10-05T21:15:16.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.463+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.463+0000 7f5e09c6d680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.463+0000 7f5e09c6d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.463+0000 7f5e09c6d680 1 --2- 172.21.15.153:0/916914014 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x563843ad1f90 0x563843ad4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.463+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad4940 con 0x563843ad1f90 2023-10-05T21:15:16.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.463+0000 7f5dfcd45700 1 --2- 172.21.15.153:0/916914014 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x563843ad1f90 0x563843ad4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.463+0000 7f5dfcd45700 1 --2- 172.21.15.153:0/916914014 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x563843ad1f90 0x563843ad4370 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.464+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f5de8014070 con 0x563843ad1f90 2023-10-05T21:15:16.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.464+0000 7f5e09c6d680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:16.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.464+0000 7f5e09c6d680 20 searching for the correct realm 2023-10-05T21:15:16.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.464+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x563843ad1f90 2023-10-05T21:15:16.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.464+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de8014070 con 0x563843ad1f90 2023-10-05T21:15:16.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.464+0000 7f5dfcd45700 1 --2- 172.21.15.153:0/916914014 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f5de802d020 0x7f5de802c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.464+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x7f5de802d020 2023-10-05T21:15:16.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.464+0000 7f5df7fff700 1 --2- 172.21.15.153:0/916914014 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f5de802d020 0x7f5de802c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.464+0000 7f5df7fff700 1 --2- 172.21.15.153:0/916914014 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f5de802d020 0x7f5de802c5d0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.465+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df001a040 con 0x7f5de802d020 2023-10-05T21:15:16.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.465+0000 7f5df7fff700 1 --2- 172.21.15.153:0/916914014 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f5df001d030 0x7f5df001f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.465+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x7f5df001d030 2023-10-05T21:15:16.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.465+0000 7f5dfd546700 1 --2- 172.21.15.153:0/916914014 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f5df001d030 0x7f5df001f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.465+0000 7f5dfd546700 1 --2- 172.21.15.153:0/916914014 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f5df001d030 0x7f5df001f960 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.466+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df800a570 con 0x7f5df001d030 2023-10-05T21:15:16.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.466+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x563843a9e7f0 2023-10-05T21:15:16.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.466+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.466+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x563843a9e7f0 2023-10-05T21:15:16.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.466+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.466+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x7f5df001d030 2023-10-05T21:15:16.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.466+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df800a570 con 0x7f5df001d030 2023-10-05T21:15:16.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.466+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x7f5df001d030 2023-10-05T21:15:16.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.467+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df800a570 con 0x7f5df001d030 2023-10-05T21:15:16.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.467+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x7f5de802d020 2023-10-05T21:15:16.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.467+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df0029040 con 0x7f5de802d020 2023-10-05T21:15:16.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.467+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x563843ad1f90 2023-10-05T21:15:16.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.467+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5de8014070 con 0x563843ad1f90 2023-10-05T21:15:16.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.467+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x563843a9e7f0 2023-10-05T21:15:16.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.467+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.467+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x7f5df001d030 2023-10-05T21:15:16.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.468+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df800a570 con 0x7f5df001d030 2023-10-05T21:15:16.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.468+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x563843a9e7f0 2023-10-05T21:15:16.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.468+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.468+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x7f5de802d020 2023-10-05T21:15:16.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.468+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df0029040 con 0x7f5de802d020 2023-10-05T21:15:16.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.468+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x563843ad1f90 2023-10-05T21:15:16.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.468+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de8014070 con 0x563843ad1f90 2023-10-05T21:15:16.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.468+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x563843ad1f90 2023-10-05T21:15:16.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.468+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de8014070 con 0x563843ad1f90 2023-10-05T21:15:16.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.468+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x7f5df001d030 2023-10-05T21:15:16.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.469+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df800a570 con 0x7f5df001d030 2023-10-05T21:15:16.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.469+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x563843ad1f90 2023-10-05T21:15:16.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.469+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de8014070 con 0x563843ad1f90 2023-10-05T21:15:16.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.469+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x563843ad1f90 2023-10-05T21:15:16.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.469+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de8014070 con 0x563843ad1f90 2023-10-05T21:15:16.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.469+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x563843a9e7f0 2023-10-05T21:15:16.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.469+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.469+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x563843a9e7f0 2023-10-05T21:15:16.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.469+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.469+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x7f5df001d030 2023-10-05T21:15:16.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.470+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df800a570 con 0x7f5df001d030 2023-10-05T21:15:16.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.470+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x563843ad1f90 2023-10-05T21:15:16.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.470+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de8014070 con 0x563843ad1f90 2023-10-05T21:15:16.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.470+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x7f5de802d020 2023-10-05T21:15:16.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.470+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df0029040 con 0x7f5de802d020 2023-10-05T21:15:16.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.470+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x563843a9e7f0 2023-10-05T21:15:16.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.470+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.470+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x7f5df001d030 2023-10-05T21:15:16.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.471+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df800a570 con 0x7f5df001d030 2023-10-05T21:15:16.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.471+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x563843ad1f90 2023-10-05T21:15:16.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.471+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de8014070 con 0x563843ad1f90 2023-10-05T21:15:16.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.471+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x7f5df001d030 2023-10-05T21:15:16.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.471+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df800a570 con 0x7f5df001d030 2023-10-05T21:15:16.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.471+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x7f5de802d020 2023-10-05T21:15:16.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.472+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df0029040 con 0x7f5de802d020 2023-10-05T21:15:16.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.472+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x563843ad1f90 2023-10-05T21:15:16.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.472+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de8014070 con 0x563843ad1f90 2023-10-05T21:15:16.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.472+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x7f5df001d030 2023-10-05T21:15:16.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.472+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df800a570 con 0x7f5df001d030 2023-10-05T21:15:16.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.472+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x563843a9e7f0 2023-10-05T21:15:16.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.472+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.472+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6260 con 0x7f5de802d020 2023-10-05T21:15:16.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.472+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df0029040 con 0x7f5de802d020 2023-10-05T21:15:16.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.472+0000 7f5e09c6d680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:16.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.472+0000 7f5e09c6d680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:16.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.472+0000 7f5e09c6d680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:16.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.472+0000 7f5e09c6d680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:16.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.473+0000 7f5e09c6d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.473+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad53d0 con 0x563843a9e7f0 2023-10-05T21:15:16.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.473+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.473+0000 7f5e09c6d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.473+0000 7f5e09c6d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.473+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad4fd0 con 0x563843a9e7f0 2023-10-05T21:15:16.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.473+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.473+0000 7f5e09c6d680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.473+0000 7f5e09c6d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.473+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad5d10 con 0x563843a9e7f0 2023-10-05T21:15:16.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.473+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.473+0000 7f5e09c6d680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:16.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.473+0000 7f5e09c6d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.473+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6b00 con 0x563843ad1f90 2023-10-05T21:15:16.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.473+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f5de8014070 con 0x563843ad1f90 2023-10-05T21:15:16.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.473+0000 7f5e09c6d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.473+0000 7f5e09c6d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.473+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6eb0 con 0x563843a9e7f0 2023-10-05T21:15:16.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.474+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.474+0000 7f5e09c6d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.474+0000 7f5e09c6d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.474+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6eb0 con 0x563843a9e7f0 2023-10-05T21:15:16.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.474+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.474+0000 7f5e09c6d680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.474+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad7ec0 con 0x563843ad1f90 2023-10-05T21:15:16.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.474+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de8014070 con 0x563843ad1f90 2023-10-05T21:15:16.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.474+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad7ec0 con 0x7f5de802d020 2023-10-05T21:15:16.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.474+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df0029040 con 0x7f5de802d020 2023-10-05T21:15:16.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.474+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad7ec0 con 0x7f5df001d030 2023-10-05T21:15:16.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.475+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df800a570 con 0x7f5df001d030 2023-10-05T21:15:16.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.475+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad5d10 con 0x563843a9e7f0 2023-10-05T21:15:16.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.475+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.475+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad5d10 con 0x563843a9e7f0 2023-10-05T21:15:16.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.475+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.475+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad5d10 con 0x7f5df001d030 2023-10-05T21:15:16.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.475+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df800a570 con 0x7f5df001d030 2023-10-05T21:15:16.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.475+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad5d10 con 0x7f5df001d030 2023-10-05T21:15:16.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.476+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df800a570 con 0x7f5df001d030 2023-10-05T21:15:16.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.476+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad5d10 con 0x7f5de802d020 2023-10-05T21:15:16.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.476+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df0029040 con 0x7f5de802d020 2023-10-05T21:15:16.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.476+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad5d10 con 0x563843ad1f90 2023-10-05T21:15:16.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.476+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5de8014070 con 0x563843ad1f90 2023-10-05T21:15:16.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.476+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad5d10 con 0x563843a9e7f0 2023-10-05T21:15:16.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.476+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.476+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad5d10 con 0x7f5df001d030 2023-10-05T21:15:16.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.476+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df800a570 con 0x7f5df001d030 2023-10-05T21:15:16.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.476+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad5d10 con 0x563843a9e7f0 2023-10-05T21:15:16.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.477+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.477+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad5d10 con 0x7f5de802d020 2023-10-05T21:15:16.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.477+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df0029040 con 0x7f5de802d020 2023-10-05T21:15:16.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.477+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad5d10 con 0x563843ad1f90 2023-10-05T21:15:16.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.477+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de8014070 con 0x563843ad1f90 2023-10-05T21:15:16.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.477+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad5d10 con 0x563843ad1f90 2023-10-05T21:15:16.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.477+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de8014070 con 0x563843ad1f90 2023-10-05T21:15:16.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.477+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad5d10 con 0x7f5df001d030 2023-10-05T21:15:16.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.478+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df800a570 con 0x7f5df001d030 2023-10-05T21:15:16.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.478+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad5d10 con 0x563843ad1f90 2023-10-05T21:15:16.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.478+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de8014070 con 0x563843ad1f90 2023-10-05T21:15:16.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.478+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad5d10 con 0x563843ad1f90 2023-10-05T21:15:16.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.478+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de8014070 con 0x563843ad1f90 2023-10-05T21:15:16.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.478+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad5d10 con 0x563843a9e7f0 2023-10-05T21:15:16.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.478+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.478+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad5d10 con 0x563843a9e7f0 2023-10-05T21:15:16.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.478+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.478+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad5d10 con 0x7f5df001d030 2023-10-05T21:15:16.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.479+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df800a570 con 0x7f5df001d030 2023-10-05T21:15:16.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.479+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad5d10 con 0x563843ad1f90 2023-10-05T21:15:16.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.479+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de8014070 con 0x563843ad1f90 2023-10-05T21:15:16.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.479+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad5d10 con 0x7f5de802d020 2023-10-05T21:15:16.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.479+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df0029040 con 0x7f5de802d020 2023-10-05T21:15:16.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.479+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad5d10 con 0x563843a9e7f0 2023-10-05T21:15:16.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.479+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.479+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad5d10 con 0x7f5df001d030 2023-10-05T21:15:16.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.480+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df800a570 con 0x7f5df001d030 2023-10-05T21:15:16.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.480+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad5d10 con 0x563843ad1f90 2023-10-05T21:15:16.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.480+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de8014070 con 0x563843ad1f90 2023-10-05T21:15:16.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.480+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad5d10 con 0x7f5df001d030 2023-10-05T21:15:16.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.480+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df800a570 con 0x7f5df001d030 2023-10-05T21:15:16.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.480+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad5d10 con 0x7f5de802d020 2023-10-05T21:15:16.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.480+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df0029040 con 0x7f5de802d020 2023-10-05T21:15:16.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.480+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad5d10 con 0x563843ad1f90 2023-10-05T21:15:16.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.481+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5de8014070 con 0x563843ad1f90 2023-10-05T21:15:16.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.481+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad5d10 con 0x7f5df001d030 2023-10-05T21:15:16.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.481+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df800a570 con 0x7f5df001d030 2023-10-05T21:15:16.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.481+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad5d10 con 0x563843a9e7f0 2023-10-05T21:15:16.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.481+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.481+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad5d10 con 0x7f5de802d020 2023-10-05T21:15:16.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.481+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5df0029040 con 0x7f5de802d020 2023-10-05T21:15:16.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.481+0000 7f5e09c6d680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:16.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.481+0000 7f5e09c6d680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:16.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.481+0000 7f5e09c6d680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:16.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.481+0000 7f5e09c6d680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:16.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.481+0000 7f5e09c6d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.481+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6eb0 con 0x563843a9e7f0 2023-10-05T21:15:16.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.481+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.481+0000 7f5e09c6d680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.481+0000 7f5e09c6d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.481+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad7260 con 0x563843ad1f90 2023-10-05T21:15:16.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.482+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f5de8014070 con 0x563843ad1f90 2023-10-05T21:15:16.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.482+0000 7f5e09c6d680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:16.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.482+0000 7f5e09c6d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.482+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6670 con 0x563843a9e7f0 2023-10-05T21:15:16.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.482+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.482+0000 7f5e09c6d680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.482+0000 7f5e09c6d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.482+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad6640 con 0x563843a9e7f0 2023-10-05T21:15:16.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.482+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.482+0000 7f5e09c6d680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:16.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.482+0000 7f5e09c6d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.482+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad7b00 con 0x7f5df001d030 2023-10-05T21:15:16.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.483+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f5df800a570 con 0x7f5df001d030 2023-10-05T21:15:16.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.483+0000 7f5e09c6d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.483+0000 7f5e09c6d680 20 zone default found 2023-10-05T21:15:16.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.483+0000 7f5e09c6d680 4 Realm: () 2023-10-05T21:15:16.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.483+0000 7f5e09c6d680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:16.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.483+0000 7f5e09c6d680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:16.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.483+0000 7f5e09c6d680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:16.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.483+0000 7f5e09c6d680 20 zonegroup default 2023-10-05T21:15:16.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.483+0000 7f5e09c6d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.483+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad7b00 con 0x7f5df001d030 2023-10-05T21:15:16.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.483+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f5df800a570 con 0x7f5df001d030 2023-10-05T21:15:16.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.483+0000 7f5e09c6d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.483+0000 7f5e09c6d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.483+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad9480 con 0x563843ad1f90 2023-10-05T21:15:16.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.483+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5de8014070 con 0x563843ad1f90 2023-10-05T21:15:16.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.483+0000 7f5e09c6d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.483+0000 7f5e09c6d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.483+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad9830 con 0x563843ad1f90 2023-10-05T21:15:16.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.484+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5de8014070 con 0x563843ad1f90 2023-10-05T21:15:16.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.484+0000 7f5e09c6d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.484+0000 7f5e09c6d680 20 started sync module instance, tier type = 2023-10-05T21:15:16.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.484+0000 7f5e09c6d680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:16.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.484+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad8b40 con 0x7f5de802d020 2023-10-05T21:15:16.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.484+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5df0029040 con 0x7f5de802d020 2023-10-05T21:15:16.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.484+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94799653602896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ad9c40 con 0x7f5de802d020 2023-10-05T21:15:16.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.484+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ada6a0 con 0x563843a9e7f0 2023-10-05T21:15:16.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.485+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94799653602896] v29'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5df0029040 con 0x7f5de802d020 2023-10-05T21:15:16.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.485+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.485+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94799653609776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843adaaa0 con 0x563843a9e7f0 2023-10-05T21:15:16.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.485+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843adb4b0 con 0x563843ad1f90 2023-10-05T21:15:16.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.486+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94799653609776] v29'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.486+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5de8014070 con 0x563843ad1f90 2023-10-05T21:15:16.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.486+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94799653613504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843adb860 con 0x563843ad1f90 2023-10-05T21:15:16.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.486+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843adc270 con 0x7f5de802d020 2023-10-05T21:15:16.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.487+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94799653613504] v29'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5de8014070 con 0x563843ad1f90 2023-10-05T21:15:16.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.487+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5df0029040 con 0x7f5de802d020 2023-10-05T21:15:16.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.487+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94799653605184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843adcb10 con 0x7f5de802d020 2023-10-05T21:15:16.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.487+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843add3b0 con 0x563843a9e7f0 2023-10-05T21:15:16.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.488+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94799653605184] v29'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5df0029040 con 0x7f5de802d020 2023-10-05T21:15:16.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.488+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.488+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94799653621440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843add310 con 0x563843a9e7f0 2023-10-05T21:15:16.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.488+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ade190 con 0x7f5df001d030 2023-10-05T21:15:16.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.488+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94799653621440] v29'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.488+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5df800a570 con 0x7f5df001d030 2023-10-05T21:15:16.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.488+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94799653623536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ade030 con 0x7f5df001d030 2023-10-05T21:15:16.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.488+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843adec00 con 0x7f5df001d030 2023-10-05T21:15:16.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.489+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(96 notify.6 [create] v29'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5df800a570 con 0x7f5df001d030 2023-10-05T21:15:16.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.489+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94799653627536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843adf0b0 con 0x7f5df001d030 2023-10-05T21:15:16.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.489+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843adfc70 con 0x7f5df001d030 2023-10-05T21:15:16.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.489+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(95 notify.5 [watch watch cookie 94799653623536] v29'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5df800a570 con 0x7f5df001d030 2023-10-05T21:15:16.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.490+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(98 notify.7 [create] v29'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5df800a570 con 0x7f5df001d030 2023-10-05T21:15:16.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.490+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(97 notify.6 [watch watch cookie 94799653627536] v29'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5df800a570 con 0x7f5df001d030 2023-10-05T21:15:16.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.490+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94799653631808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843adfc70 con 0x7f5df001d030 2023-10-05T21:15:16.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.490+0000 7f5e09c6d680 20 add_watcher() i=0 2023-10-05T21:15:16.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.490+0000 7f5e09c6d680 20 add_watcher() i=1 2023-10-05T21:15:16.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.490+0000 7f5e09c6d680 20 add_watcher() i=2 2023-10-05T21:15:16.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.490+0000 7f5e09c6d680 20 add_watcher() i=3 2023-10-05T21:15:16.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.490+0000 7f5e09c6d680 20 add_watcher() i=4 2023-10-05T21:15:16.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.490+0000 7f5e09c6d680 20 add_watcher() i=5 2023-10-05T21:15:16.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.490+0000 7f5e09c6d680 20 add_watcher() i=6 2023-10-05T21:15:16.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.491+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94799653631808] v29'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5df800a570 con 0x7f5df001d030 2023-10-05T21:15:16.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.491+0000 7f5e09c6d680 20 add_watcher() i=7 2023-10-05T21:15:16.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.491+0000 7f5e09c6d680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:16.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.491+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ae2ca0 con 0x563843a9e7f0 2023-10-05T21:15:16.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.491+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.491+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94799653628864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843ae0160 con 0x563843a9e7f0 2023-10-05T21:15:16.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.492+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94799653628864] v29'102 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.492+0000 7f5dcdfe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:16.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.492+0000 7f5e09c6d680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:16.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.492+0000 7f5e09c6d680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:16.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.492+0000 7f5e09c6d680 1 Processor -- start 2023-10-05T21:15:16.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.492+0000 7f5e09c6d680 1 -- start start 2023-10-05T21:15:16.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.492+0000 7f5e09c6d680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563843aed420 0x563843aed830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.492+0000 7f5e09c6d680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x563843aede00 con 0x563843aed420 2023-10-05T21:15:16.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.493+0000 7f5df7fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563843aed420 0x563843aed830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.493+0000 7f5df7fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563843aed420 0x563843aed830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50526/0 (socket says 172.21.15.153:50526) 2023-10-05T21:15:16.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.493+0000 7f5df7fff700 1 -- 172.21.15.153:0/2567498371 learned_addr learned my addr 172.21.15.153:0/2567498371 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:16.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.493+0000 7f5df7fff700 1 -- 172.21.15.153:0/2567498371 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563843aedf40 con 0x563843aed420 2023-10-05T21:15:16.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.493+0000 7f5df7fff700 1 --2- 172.21.15.153:0/2567498371 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563843aed420 0x563843aed830 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x563843a9af90 tx=0x7f5df0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=745b73d6eeb840bf server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.493+0000 7f5dcd7e2700 1 -- 172.21.15.153:0/2567498371 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5df0025040 con 0x563843aed420 2023-10-05T21:15:16.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.493+0000 7f5dcd7e2700 1 -- 172.21.15.153:0/2567498371 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df0009e90 con 0x563843aed420 2023-10-05T21:15:16.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.493+0000 7f5dcd7e2700 1 -- 172.21.15.153:0/2567498371 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5df002da10 con 0x563843aed420 2023-10-05T21:15:16.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.494+0000 7f5e09c6d680 1 -- 172.21.15.153:0/2567498371 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563843aed420 msgr2=0x563843aed830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.494+0000 7f5e09c6d680 1 --2- 172.21.15.153:0/2567498371 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563843aed420 0x563843aed830 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x563843a9af90 tx=0x7f5df0016000 comp rx=0 tx=0).stop 2023-10-05T21:15:16.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.494+0000 7f5e09c6d680 1 -- 172.21.15.153:0/2567498371 shutdown_connections 2023-10-05T21:15:16.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.494+0000 7f5e09c6d680 1 --2- 172.21.15.153:0/2567498371 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563843aed420 0x563843aed830 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.494+0000 7f5e09c6d680 1 -- 172.21.15.153:0/2567498371 >> 172.21.15.153:0/2567498371 conn(0x563843ae8620 msgr2=0x563843ae6780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.494+0000 7f5e09c6d680 1 -- 172.21.15.153:0/2567498371 shutdown_connections 2023-10-05T21:15:16.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.494+0000 7f5e09c6d680 1 -- 172.21.15.153:0/2567498371 wait complete. 2023-10-05T21:15:16.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.494+0000 7f5e09c6d680 1 Processor -- start 2023-10-05T21:15:16.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.494+0000 7f5e09c6d680 1 -- start start 2023-10-05T21:15:16.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.494+0000 7f5e09c6d680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563843aed420 0x563843af2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.494+0000 7f5e09c6d680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x563843af3500 con 0x563843aed420 2023-10-05T21:15:16.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.495+0000 7f5df7fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563843aed420 0x563843af2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.495+0000 7f5df7fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563843aed420 0x563843af2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50530/0 (socket says 172.21.15.153:50530) 2023-10-05T21:15:16.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.495+0000 7f5df7fff700 1 -- 172.21.15.153:0/737590447 learned_addr learned my addr 172.21.15.153:0/737590447 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:16.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.495+0000 7f5df7fff700 1 -- 172.21.15.153:0/737590447 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563843aa2120 con 0x563843aed420 2023-10-05T21:15:16.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.495+0000 7f5df7fff700 1 --2- 172.21.15.153:0/737590447 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563843aed420 0x563843af2fc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5df0016040 tx=0x7f5df0039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.495+0000 7f5d477fe700 1 -- 172.21.15.153:0/737590447 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5df0025040 con 0x563843aed420 2023-10-05T21:15:16.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.495+0000 7f5d477fe700 1 -- 172.21.15.153:0/737590447 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df0039980 con 0x563843aed420 2023-10-05T21:15:16.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.495+0000 7f5e09c6d680 1 -- 172.21.15.153:0/737590447 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563843af3700 con 0x563843aed420 2023-10-05T21:15:16.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.495+0000 7f5d477fe700 1 -- 172.21.15.153:0/737590447 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5df0039c50 con 0x563843aed420 2023-10-05T21:15:16.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.495+0000 7f5e09c6d680 1 -- 172.21.15.153:0/737590447 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563843af3bb0 con 0x563843aed420 2023-10-05T21:15:16.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.496+0000 7f5d477fe700 1 -- 172.21.15.153:0/737590447 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f5df0008430 con 0x563843aed420 2023-10-05T21:15:16.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.496+0000 7f5d477fe700 1 --2- 172.21.15.153:0/737590447 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5d3c034190 0x7f5d3c036640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.496+0000 7f5d477fe700 1 -- 172.21.15.153:0/737590447 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f5df0032030 con 0x563843aed420 2023-10-05T21:15:16.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.496+0000 7f5dfd546700 1 --2- 172.21.15.153:0/737590447 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5d3c034190 0x7f5d3c036640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.496+0000 7f5e09c6d680 5 note: GC not initialized 2023-10-05T21:15:16.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.497+0000 7f5dfd546700 1 --2- 172.21.15.153:0/737590447 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5d3c034190 0x7f5d3c036640 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x563843adf040 tx=0x7f5df8036460 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.497+0000 7f5d44ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:16.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.497+0000 7f5d3a7fc700 20 reqs_thread_entry: start 2023-10-05T21:15:16.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.497+0000 7f5e09c6d680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:16.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.498+0000 7f5e09c6d680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:16.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.498+0000 7f5d38ff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:46 2023 2023-10-05T21:15:16.530 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:16.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.498+0000 7f5d1ffff700 20 reqs_thread_entry: start 2023-10-05T21:15:16.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.498+0000 7f5e09c6d680 20 get_system_obj_state: rctx=0x7ffd78baf508 obj=default.rgw.meta:users.uid:foo state=0x56384394e240 s->prefetch_data=0 2023-10-05T21:15:16.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.498+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843b58830 con 0x563843a9e7f0 2023-10-05T21:15:16.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.498+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.498+0000 7f5e09c6d680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:16.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.498+0000 7f5e09c6d680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:16.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.498+0000 7f5e09c6d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.498+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843b5aac0 con 0x563843a9e7f0 2023-10-05T21:15:16.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.499+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.499+0000 7f5e09c6d680 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T21:15:16.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.499+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:104 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843b5aac0 con 0x7f5de802d020 2023-10-05T21:15:16.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.499+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(104 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f5df0049070 con 0x7f5de802d020 2023-10-05T21:15:16.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.499+0000 7f5e09c6d680 20 get_system_obj_state: rctx=0x7ffd78baf860 obj=default.rgw.meta:root:.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 state=0x56384394e240 s->prefetch_data=0 2023-10-05T21:15:16.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.499+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:105 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843b58ce0 con 0x563843ad1f90 2023-10-05T21:15:16.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.499+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(105 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f5de8014070 con 0x563843ad1f90 2023-10-05T21:15:16.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.499+0000 7f5e09c6d680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:16.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.499+0000 7f5e09c6d680 20 Read xattr: user.rgw.acl 2023-10-05T21:15:16.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.499+0000 7f5e09c6d680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:16.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.499+0000 7f5e09c6d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.499+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:106 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843b5c350 con 0x563843ad1f90 2023-10-05T21:15:16.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.500+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(106 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f5de8014070 con 0x563843ad1f90 2023-10-05T21:15:16.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.500+0000 7f5e09c6d680 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T21:15:16.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.500+0000 7f5e09c6d680 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T21:15:16.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.500+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 4.6 4:63e054bc:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843b5ca80 con 0x563843ad1f90 2023-10-05T21:15:16.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.500+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:108 4.18 4:1a996cea:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843b5f340 con 0x7f5de802d020 2023-10-05T21:15:16.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.500+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:109 4.18 4:198ebb7d:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843b61c00 con 0x7f5de802d020 2023-10-05T21:15:16.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.500+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 4.1e 4:7ac3851f:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843b5f340 con 0x7f5df001d030 2023-10-05T21:15:16.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.500+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:111 4.20 4:0486cb16:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843b66a90 con 0x563843a9e7f0 2023-10-05T21:15:16.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.500+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:112 4.1a 4:5b58f5c0:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843b69890 con 0x7f5de802d020 2023-10-05T21:15:16.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.500+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:113 4.14 4:2bb8f6a0:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843b6c690 con 0x563843ad1f90 2023-10-05T21:15:16.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.500+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:114 4.3f 4:fc00c6e8:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843b6f2e0 con 0x7f5de802d020 2023-10-05T21:15:16.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.500+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:115 4.35 4:afba4511:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843b71df0 con 0x563843a9e7f0 2023-10-05T21:15:16.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.500+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:116 4.5 4:a0455ddf:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843b74bb0 con 0x563843ad1f90 2023-10-05T21:15:16.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.500+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:117 4.a 4:50c49731:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843b77960 con 0x7f5de802d020 2023-10-05T21:15:16.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.500+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(108 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5df0049070 con 0x7f5de802d020 2023-10-05T21:15:16.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.500+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(112 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.5 [call out=124b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f5df0049070 con 0x7f5de802d020 2023-10-05T21:15:16.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.500+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(107 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5de8014070 con 0x563843ad1f90 2023-10-05T21:15:16.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.501+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(111 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.501+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(114 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5df0049070 con 0x7f5de802d020 2023-10-05T21:15:16.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.501+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(115 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.501+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== osd_op_reply(116 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5de8014070 con 0x563843ad1f90 2023-10-05T21:15:16.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.501+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== osd_op_reply(117 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f5df0049070 con 0x7f5de802d020 2023-10-05T21:15:16.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.501+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(113 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5de8014070 con 0x563843ad1f90 2023-10-05T21:15:16.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.501+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 <== osd.2 v2:172.21.15.153:6807/140454 22 ==== osd_op_reply(109 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.2 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5df0049070 con 0x7f5de802d020 2023-10-05T21:15:16.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.501+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(110 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5df800a570 con 0x7f5df001d030 2023-10-05T21:15:16.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.501+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:118 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843b71df0 con 0x7f5de802d020 2023-10-05T21:15:16.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.502+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 <== osd.2 v2:172.21.15.153:6807/140454 23 ==== osd_op_reply(118 foo.buckets [call] v29'15 uv15 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f5df0049070 con 0x7f5de802d020 2023-10-05T21:15:16.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.502+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:119 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843b71df0 con 0x7f5de802d020 2023-10-05T21:15:16.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.502+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 <== osd.2 v2:172.21.15.153:6807/140454 24 ==== osd_op_reply(119 foo.buckets [call] v29'16 uv16 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f5df0049070 con 0x7f5de802d020 2023-10-05T21:15:16.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.502+0000 7f5e09c6d680 20 get_system_obj_state: rctx=0x7ffd78baf738 obj=default.rgw.meta:users.uid:foo state=0x56384394e240 s->prefetch_data=0 2023-10-05T21:15:16.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.502+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:120 8.18 8:1e6ca5ed:users.uid::foo:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843b71df0 con 0x563843a9e7f0 2023-10-05T21:15:16.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.503+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(120 foo [getxattrs out=75b,stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 189+0+91 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.503+0000 7f5e09c6d680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:16.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.503+0000 7f5e09c6d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.503+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:121 8.18 8:1e6ca5ed:users.uid::foo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843b71df0 con 0x563843a9e7f0 2023-10-05T21:15:16.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.503+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(121 foo [read 0~357 out=357b] v0'0 uv11 ondisk = 0) v8 ==== 147+0+357 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.503+0000 7f5e09c6d680 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T21:15:16.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.503+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:122 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843b71df0 con 0x7f5de802d020 2023-10-05T21:15:16.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.503+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 <== osd.2 v2:172.21.15.153:6807/140454 25 ==== osd_op_reply(122 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) v8 ==== 155+0+58 (crc 0 0 0) 0x7f5df0049070 con 0x7f5de802d020 2023-10-05T21:15:16.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.504+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:123 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94799653602896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843b71df0 con 0x7f5de802d020 2023-10-05T21:15:16.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.504+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 <== osd.2 v2:172.21.15.153:6807/140454 26 ==== osd_op_reply(123 notify.0 [watch unwatch cookie 94799653602896] v29'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5df0049070 con 0x7f5de802d020 2023-10-05T21:15:16.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.504+0000 7f5e09c6d680 20 remove_watcher() i=0 2023-10-05T21:15:16.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.504+0000 7f5e09c6d680 2 removed watcher, disabling cache 2023-10-05T21:15:16.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.504+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:124 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94799653609776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843b71df0 con 0x563843a9e7f0 2023-10-05T21:15:16.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.505+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== osd_op_reply(124 notify.1 [watch unwatch cookie 94799653609776] v29'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.505+0000 7f5e09c6d680 20 remove_watcher() i=1 2023-10-05T21:15:16.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.505+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:125 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94799653613504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843b71df0 con 0x563843ad1f90 2023-10-05T21:15:16.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.506+0000 7f5dfcd45700 1 -- 172.21.15.153:0/916914014 <== osd.3 v2:172.21.15.153:6800/140455 31 ==== osd_op_reply(125 notify.2 [watch unwatch cookie 94799653613504] v29'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5de8014070 con 0x563843ad1f90 2023-10-05T21:15:16.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.506+0000 7f5e09c6d680 20 remove_watcher() i=2 2023-10-05T21:15:16.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.506+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:126 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94799653605184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843b71df0 con 0x7f5de802d020 2023-10-05T21:15:16.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.507+0000 7f5df7fff700 1 -- 172.21.15.153:0/916914014 <== osd.2 v2:172.21.15.153:6807/140454 27 ==== osd_op_reply(126 notify.3 [watch unwatch cookie 94799653605184] v29'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5df0049070 con 0x7f5de802d020 2023-10-05T21:15:16.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.507+0000 7f5e09c6d680 20 remove_watcher() i=3 2023-10-05T21:15:16.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.507+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:127 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94799653621440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843b71df0 con 0x563843a9e7f0 2023-10-05T21:15:16.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.507+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 42 ==== osd_op_reply(127 notify.4 [watch unwatch cookie 94799653621440] v29'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.508+0000 7f5e09c6d680 20 remove_watcher() i=4 2023-10-05T21:15:16.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.508+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:128 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94799653623536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843b71df0 con 0x7f5df001d030 2023-10-05T21:15:16.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.508+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(128 notify.5 [watch unwatch cookie 94799653623536] v29'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5df800a570 con 0x7f5df001d030 2023-10-05T21:15:16.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.508+0000 7f5e09c6d680 20 remove_watcher() i=5 2023-10-05T21:15:16.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.508+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:129 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94799653627536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843b71df0 con 0x7f5df001d030 2023-10-05T21:15:16.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.509+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(129 notify.6 [watch unwatch cookie 94799653627536] v29'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5df800a570 con 0x7f5df001d030 2023-10-05T21:15:16.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.509+0000 7f5e09c6d680 20 remove_watcher() i=6 2023-10-05T21:15:16.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.509+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:130 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94799653631808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843b71df0 con 0x7f5df001d030 2023-10-05T21:15:16.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.510+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(130 notify.7 [watch unwatch cookie 94799653631808] v29'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5df800a570 con 0x7f5df001d030 2023-10-05T21:15:16.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.510+0000 7f5e09c6d680 20 remove_watcher() i=7 2023-10-05T21:15:16.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.510+0000 7f5dcdfe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:16.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.510+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:131 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94799653628864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563843b71df0 con 0x563843a9e7f0 2023-10-05T21:15:16.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.511+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 <== osd.1 v2:172.21.15.153:6816/140456 43 ==== osd_op_reply(131 data_loggenerations_metadata [watch unwatch cookie 94799653628864] v29'103 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5df800a570 con 0x563843a9e7f0 2023-10-05T21:15:16.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.511+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f5df001d030 msgr2=0x7f5df001f960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.511+0000 7f5e09c6d680 1 --2- 172.21.15.153:0/916914014 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f5df001d030 0x7f5df001f960 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.511+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x563843a9e7f0 msgr2=0x563843acfb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.511+0000 7f5e09c6d680 1 --2- 172.21.15.153:0/916914014 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x563843a9e7f0 0x563843acfb20 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.511+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f5de802d020 msgr2=0x7f5de802c5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.511+0000 7f5e09c6d680 1 --2- 172.21.15.153:0/916914014 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f5de802d020 0x7f5de802c5d0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.511+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x563843ad1f90 msgr2=0x563843ad4370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.511+0000 7f5e09c6d680 1 --2- 172.21.15.153:0/916914014 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x563843ad1f90 0x563843ad4370 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.511+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5de00340f0 msgr2=0x7f5de00365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.511+0000 7f5e09c6d680 1 --2- 172.21.15.153:0/916914014 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5de00340f0 0x7f5de00365a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5df0005a90 tx=0x7f5df0018000 comp rx=0 tx=0).stop 2023-10-05T21:15:16.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.511+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563843a9a2c0 msgr2=0x563843ac3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.511+0000 7f5e09c6d680 1 --2- 172.21.15.153:0/916914014 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563843a9a2c0 0x563843ac3dc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5de80017d0 tx=0x7f5de8016000 comp rx=0 tx=0).stop 2023-10-05T21:15:16.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.511+0000 7f5dfd546700 1 -- 172.21.15.153:0/916914014 reap_dead start 2023-10-05T21:15:16.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.511+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 shutdown_connections 2023-10-05T21:15:16.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.511+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 >> 172.21.15.153:0/916914014 conn(0x563843a95b90 msgr2=0x563843ab2880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.511+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 shutdown_connections 2023-10-05T21:15:16.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.511+0000 7f5e09c6d680 1 -- 172.21.15.153:0/916914014 wait complete. 2023-10-05T21:15:16.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.512+0000 7f5e09c6d680 1 -- 172.21.15.153:0/737590447 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5d3c034190 msgr2=0x7f5d3c036640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.512+0000 7f5e09c6d680 1 --2- 172.21.15.153:0/737590447 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5d3c034190 0x7f5d3c036640 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x563843adf040 tx=0x7f5df8036460 comp rx=0 tx=0).stop 2023-10-05T21:15:16.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.512+0000 7f5e09c6d680 1 -- 172.21.15.153:0/737590447 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563843aed420 msgr2=0x563843af2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.512+0000 7f5e09c6d680 1 --2- 172.21.15.153:0/737590447 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563843aed420 0x563843af2fc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5df0016040 tx=0x7f5df0039000 comp rx=0 tx=0).stop 2023-10-05T21:15:16.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.512+0000 7f5e09c6d680 1 -- 172.21.15.153:0/737590447 shutdown_connections 2023-10-05T21:15:16.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.512+0000 7f5e09c6d680 1 --2- 172.21.15.153:0/737590447 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5d3c034190 0x7f5d3c036640 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.512+0000 7f5e09c6d680 1 --2- 172.21.15.153:0/737590447 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563843aed420 0x563843af2fc0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.512+0000 7f5e09c6d680 1 -- 172.21.15.153:0/737590447 >> 172.21.15.153:0/737590447 conn(0x563843ae8620 msgr2=0x563843ae6750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.512+0000 7f5e09c6d680 1 -- 172.21.15.153:0/737590447 shutdown_connections 2023-10-05T21:15:16.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.512+0000 7f5e09c6d680 1 -- 172.21.15.153:0/737590447 wait complete. 2023-10-05T21:15:16.541 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:16.541 INFO:teuthology.orchestra.run.smithi153.stdout: "stats": { 2023-10-05T21:15:16.541 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 3, 2023-10-05T21:15:16.541 INFO:teuthology.orchestra.run.smithi153.stdout: "size_actual": 4096, 2023-10-05T21:15:16.541 INFO:teuthology.orchestra.run.smithi153.stdout: "size_kb": 1, 2023-10-05T21:15:16.541 INFO:teuthology.orchestra.run.smithi153.stdout: "size_kb_actual": 4, 2023-10-05T21:15:16.541 INFO:teuthology.orchestra.run.smithi153.stdout: "num_objects": 1 2023-10-05T21:15:16.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:16.541 INFO:teuthology.orchestra.run.smithi153.stdout: "last_stats_sync": "2023-10-05T21:15:16.503057Z", 2023-10-05T21:15:16.541 INFO:teuthology.orchestra.run.smithi153.stdout: "last_stats_update": "2023-10-05T21:15:16.502188Z" 2023-10-05T21:15:16.542 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:16.542 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2023-10-05T21:15:16.503057Z', 'last_stats_update': '2023-10-05T21:15:16.502188Z'} 2023-10-05T21:15:16.546 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T21:15:16.546 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2023-10-05T21:15:16.547 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2023-10-05T21:15:16.547 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2023-10-05T21:15:16.592 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:16.593 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:16.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.592+0000 7f9f28190680 1 Processor -- start 2023-10-05T21:15:16.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.592+0000 7f9f28190680 1 -- start start 2023-10-05T21:15:16.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.592+0000 7f9f28190680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x561158e4b2c0 0x561158e4b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.592+0000 7f9f28190680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x561158d99930 con 0x561158e4bc10 2023-10-05T21:15:16.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.592+0000 7f9f28190680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x561158d59db0 con 0x561158e4b2c0 2023-10-05T21:15:16.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.592+0000 7f9f1b268700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x561158e4b2c0 0x561158e4b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.592+0000 7f9f1b268700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x561158e4b2c0 0x561158e4b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50532/0 (socket says 172.21.15.153:50532) 2023-10-05T21:15:16.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.592+0000 7f9f1b268700 1 -- 172.21.15.153:0/4103489968 learned_addr learned my addr 172.21.15.153:0/4103489968 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:16.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.592+0000 7f9f1aa67700 1 --1- 172.21.15.153:0/4103489968 >> v1:172.21.15.111:6789/0 conn(0x561158e4bc10 0x561158e4c600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56456/0 (socket says 172.21.15.153:56456) 2023-10-05T21:15:16.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.593+0000 7f9f1b268700 1 -- 172.21.15.153:0/4103489968 >> v1:172.21.15.111:6789/0 conn(0x561158e4bc10 legacy=0x561158e4c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.593+0000 7f9f1b268700 1 -- 172.21.15.153:0/4103489968 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561158e4ceb0 con 0x561158e4b2c0 2023-10-05T21:15:16.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.593+0000 7f9f1a266700 1 -- 172.21.15.153:0/4103489968 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2655466625 0 0) 0x561158d99930 con 0x561158e4bc10 2023-10-05T21:15:16.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.593+0000 7f9f1b268700 1 --2- 172.21.15.153:0/4103489968 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e4b2c0 0x561158e4b6d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9f1000a650 tx=0x7f9f10005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=297f42661dc41159 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.593+0000 7f9f1a266700 1 -- 172.21.15.153:0/4103489968 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f10008760 con 0x561158e4b2c0 2023-10-05T21:15:16.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.593+0000 7f9f1a266700 1 -- 172.21.15.153:0/4103489968 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f100088c0 con 0x561158e4b2c0 2023-10-05T21:15:16.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.593+0000 7f9f1a266700 1 -- 172.21.15.153:0/4103489968 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f10008bb0 con 0x561158e4b2c0 2023-10-05T21:15:16.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.593+0000 7f9f28190680 1 -- 172.21.15.153:0/4103489968 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e4b2c0 msgr2=0x561158e4b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.593+0000 7f9f28190680 1 --2- 172.21.15.153:0/4103489968 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e4b2c0 0x561158e4b6d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9f1000a650 tx=0x7f9f10005b10 comp rx=0 tx=0).stop 2023-10-05T21:15:16.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.593+0000 7f9f28190680 1 -- 172.21.15.153:0/4103489968 shutdown_connections 2023-10-05T21:15:16.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.593+0000 7f9f28190680 1 --2- 172.21.15.153:0/4103489968 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e4b2c0 0x561158e4b6d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.593+0000 7f9f28190680 1 -- 172.21.15.153:0/4103489968 >> 172.21.15.153:0/4103489968 conn(0x561158e46b90 msgr2=0x561158e48fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.594+0000 7f9f28190680 1 -- 172.21.15.153:0/4103489968 shutdown_connections 2023-10-05T21:15:16.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.594+0000 7f9f28190680 1 -- 172.21.15.153:0/4103489968 wait complete. 2023-10-05T21:15:16.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.594+0000 7f9f28190680 1 Processor -- start 2023-10-05T21:15:16.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.594+0000 7f9f28190680 1 -- start start 2023-10-05T21:15:16.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.594+0000 7f9f28190680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e4b2c0 0x561158e6d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.594+0000 7f9f28190680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x561158cf9ea0 con 0x561158e4b2c0 2023-10-05T21:15:16.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.595+0000 7f9f1b268700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e4b2c0 0x561158e6d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.595+0000 7f9f1b268700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e4b2c0 0x561158e6d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50542/0 (socket says 172.21.15.153:50542) 2023-10-05T21:15:16.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.595+0000 7f9f1b268700 1 -- 172.21.15.153:0/703220847 learned_addr learned my addr 172.21.15.153:0/703220847 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:16.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.595+0000 7f9f1b268700 1 -- 172.21.15.153:0/703220847 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f10005db0 con 0x561158e4b2c0 2023-10-05T21:15:16.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.595+0000 7f9f1b268700 1 --2- 172.21.15.153:0/703220847 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e4b2c0 0x561158e6d920 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9f1000a5a0 tx=0x7f9f10015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e577a5dc0e79431b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.595+0000 7f9f19264700 1 -- 172.21.15.153:0/703220847 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f100055f0 con 0x561158e4b2c0 2023-10-05T21:15:16.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.595+0000 7f9f19264700 1 -- 172.21.15.153:0/703220847 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f10008a30 con 0x561158e4b2c0 2023-10-05T21:15:16.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.595+0000 7f9f19264700 1 -- 172.21.15.153:0/703220847 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f10008d00 con 0x561158e4b2c0 2023-10-05T21:15:16.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.596+0000 7f9f28190680 1 -- 172.21.15.153:0/703220847 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e4b2c0 msgr2=0x561158e6d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.596+0000 7f9f28190680 1 --2- 172.21.15.153:0/703220847 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e4b2c0 0x561158e6d920 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9f1000a5a0 tx=0x7f9f10015000 comp rx=0 tx=0).stop 2023-10-05T21:15:16.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.596+0000 7f9f28190680 1 -- 172.21.15.153:0/703220847 shutdown_connections 2023-10-05T21:15:16.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.596+0000 7f9f28190680 1 --2- 172.21.15.153:0/703220847 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e4b2c0 0x561158e6d920 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.596+0000 7f9f28190680 1 -- 172.21.15.153:0/703220847 >> 172.21.15.153:0/703220847 conn(0x561158e46b90 msgr2=0x561158e64fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.596+0000 7f9f28190680 1 -- 172.21.15.153:0/703220847 shutdown_connections 2023-10-05T21:15:16.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.596+0000 7f9f28190680 1 -- 172.21.15.153:0/703220847 wait complete. 2023-10-05T21:15:16.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.596+0000 7f9f28190680 1 Processor -- start 2023-10-05T21:15:16.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.596+0000 7f9f28190680 1 -- start start 2023-10-05T21:15:16.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.596+0000 7f9f28190680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e4b2c0 0x561158e74c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.596+0000 7f9f28190680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x561158cf0c80 con 0x561158e4b2c0 2023-10-05T21:15:16.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.597+0000 7f9f1b268700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e4b2c0 0x561158e74c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.597+0000 7f9f1b268700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e4b2c0 0x561158e74c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50548/0 (socket says 172.21.15.153:50548) 2023-10-05T21:15:16.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.597+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 learned_addr learned my addr 172.21.15.153:0/4018481508 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:16.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.597+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561158e4ceb0 con 0x561158e4b2c0 2023-10-05T21:15:16.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.597+0000 7f9f1b268700 1 --2- 172.21.15.153:0/4018481508 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e4b2c0 0x561158e74c80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9f1000a650 tx=0x7f9f1001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.597+0000 7f9f0b7fe700 1 -- 172.21.15.153:0/4018481508 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f10026a90 con 0x561158e4b2c0 2023-10-05T21:15:16.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.597+0000 7f9f0b7fe700 1 -- 172.21.15.153:0/4018481508 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f10026bf0 con 0x561158e4b2c0 2023-10-05T21:15:16.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.597+0000 7f9f0b7fe700 1 -- 172.21.15.153:0/4018481508 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f10012450 con 0x561158e4b2c0 2023-10-05T21:15:16.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.597+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561158e751c0 con 0x561158e4b2c0 2023-10-05T21:15:16.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.597+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561158e75670 con 0x561158e4b2c0 2023-10-05T21:15:16.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.598+0000 7f9f0b7fe700 1 -- 172.21.15.153:0/4018481508 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f9f100125b0 con 0x561158e4b2c0 2023-10-05T21:15:16.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.598+0000 7f9f28190680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.598+0000 7f9f0b7fe700 1 --2- 172.21.15.153:0/4018481508 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9f00034140 0x7f9f000365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.598+0000 7f9f0b7fe700 1 -- 172.21.15.153:0/4018481508 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f9f1004a340 con 0x561158e4b2c0 2023-10-05T21:15:16.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.598+0000 7f9f1aa67700 1 --2- 172.21.15.153:0/4018481508 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9f00034140 0x7f9f000365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.599+0000 7f9f28190680 1 --2- 172.21.15.153:0/4018481508 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x561158e7e9e0 0x561158e80de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.599+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e81570 con 0x561158e7e9e0 2023-10-05T21:15:16.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.599+0000 7f9f1ba69700 1 --2- 172.21.15.153:0/4018481508 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x561158e7e9e0 0x561158e80de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.599+0000 7f9f1aa67700 1 --2- 172.21.15.153:0/4018481508 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9f00034140 0x7f9f000365f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c0011e0 tx=0x7f9f0c0013c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.599+0000 7f9f1ba69700 1 --2- 172.21.15.153:0/4018481508 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x561158e7e9e0 0x561158e80de0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.599+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.599+0000 7f9f28190680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.599+0000 7f9f28190680 20 realm 2023-10-05T21:15:16.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.599+0000 7f9f28190680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.599+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e7e050 con 0x561158e7e9e0 2023-10-05T21:15:16.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.600+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.600+0000 7f9f28190680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.600+0000 7f9f28190680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:16.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.600+0000 7f9f28190680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.600+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e82020 con 0x561158e7e9e0 2023-10-05T21:15:16.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.600+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.600+0000 7f9f28190680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.600+0000 7f9f28190680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.600+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e81c70 con 0x561158e7e9e0 2023-10-05T21:15:16.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.600+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.600+0000 7f9f28190680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.600+0000 7f9f28190680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.600+0000 7f9f28190680 1 --2- 172.21.15.153:0/4018481508 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x561158e833e0 0x561158e857c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.600+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e85d00 con 0x561158e833e0 2023-10-05T21:15:16.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.600+0000 7f9f1b268700 1 --2- 172.21.15.153:0/4018481508 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x561158e833e0 0x561158e857c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.600+0000 7f9f1b268700 1 --2- 172.21.15.153:0/4018481508 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x561158e833e0 0x561158e857c0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.601+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f9f10019040 con 0x561158e833e0 2023-10-05T21:15:16.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.601+0000 7f9f28190680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:16.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.601+0000 7f9f28190680 20 searching for the correct realm 2023-10-05T21:15:16.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.601+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e875b0 con 0x561158e833e0 2023-10-05T21:15:16.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.601+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1003e040 con 0x561158e833e0 2023-10-05T21:15:16.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.601+0000 7f9f1b268700 1 --2- 172.21.15.153:0/4018481508 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f9f10007030 0x7f9f10037810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.601+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e875b0 con 0x7f9f10007030 2023-10-05T21:15:16.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.601+0000 7f9f1aa67700 1 --2- 172.21.15.153:0/4018481508 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f9f10007030 0x7f9f10037810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.601+0000 7f9f1aa67700 1 --2- 172.21.15.153:0/4018481508 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f9f10007030 0x7f9f10037810 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.602+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f0c00f620 con 0x7f9f10007030 2023-10-05T21:15:16.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.602+0000 7f9f1aa67700 1 --2- 172.21.15.153:0/4018481508 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f9f0c00e8c0 0x7f9f0c00d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.602+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e875b0 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.602+0000 7f9f1ba69700 1 --2- 172.21.15.153:0/4018481508 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f9f0c00e8c0 0x7f9f0c00d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.602+0000 7f9f1ba69700 1 --2- 172.21.15.153:0/4018481508 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f9f0c00e8c0 0x7f9f0c00d310 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.603+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1400a570 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.603+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e875b0 con 0x561158e7e9e0 2023-10-05T21:15:16.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.603+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.603+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e875b0 con 0x561158e7e9e0 2023-10-05T21:15:16.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.603+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.603+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e875b0 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.603+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1400a570 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.603+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e875b0 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.603+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1400a570 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.603+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e875b0 con 0x7f9f10007030 2023-10-05T21:15:16.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.604+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f0c00f620 con 0x7f9f10007030 2023-10-05T21:15:16.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.604+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e875b0 con 0x561158e833e0 2023-10-05T21:15:16.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.604+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9f1003e040 con 0x561158e833e0 2023-10-05T21:15:16.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.604+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e875b0 con 0x561158e7e9e0 2023-10-05T21:15:16.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.604+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.604+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e875b0 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.604+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1400a570 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.604+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e875b0 con 0x561158e7e9e0 2023-10-05T21:15:16.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.604+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.604+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e875b0 con 0x7f9f10007030 2023-10-05T21:15:16.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.605+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f0c00f620 con 0x7f9f10007030 2023-10-05T21:15:16.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.605+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f0c01f040 con 0x561158e833e0 2023-10-05T21:15:16.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.605+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1003e040 con 0x561158e833e0 2023-10-05T21:15:16.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.605+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f0c01f040 con 0x561158e833e0 2023-10-05T21:15:16.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.605+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1003e040 con 0x561158e833e0 2023-10-05T21:15:16.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.605+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f0c01f040 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.605+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1400a570 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.605+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f0c01f040 con 0x561158e833e0 2023-10-05T21:15:16.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.606+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1003e040 con 0x561158e833e0 2023-10-05T21:15:16.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.606+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f0c01f040 con 0x561158e833e0 2023-10-05T21:15:16.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.606+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1003e040 con 0x561158e833e0 2023-10-05T21:15:16.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.606+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f0c01f040 con 0x561158e7e9e0 2023-10-05T21:15:16.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.606+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.606+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f0c01f040 con 0x561158e7e9e0 2023-10-05T21:15:16.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.606+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.606+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f0c01f040 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.606+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1400a570 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.607+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f0c01f040 con 0x561158e833e0 2023-10-05T21:15:16.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.607+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1003e040 con 0x561158e833e0 2023-10-05T21:15:16.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.607+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f0c01f040 con 0x7f9f10007030 2023-10-05T21:15:16.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.607+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f0c00f620 con 0x7f9f10007030 2023-10-05T21:15:16.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.607+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f0c01f040 con 0x561158e7e9e0 2023-10-05T21:15:16.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.607+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.607+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f0c01f040 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.607+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1400a570 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.607+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f0c01f040 con 0x561158e833e0 2023-10-05T21:15:16.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.608+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1003e040 con 0x561158e833e0 2023-10-05T21:15:16.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.608+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f0c01f040 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.608+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1400a570 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.608+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f0c01f040 con 0x7f9f10007030 2023-10-05T21:15:16.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.608+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f0c00f620 con 0x7f9f10007030 2023-10-05T21:15:16.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.608+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f0c01f040 con 0x561158e833e0 2023-10-05T21:15:16.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.608+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1003e040 con 0x561158e833e0 2023-10-05T21:15:16.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.608+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f0c01f040 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.609+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1400a570 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.609+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f0c01f040 con 0x561158e7e9e0 2023-10-05T21:15:16.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.609+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.609+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f0c01f040 con 0x7f9f10007030 2023-10-05T21:15:16.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.609+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f0c00f620 con 0x7f9f10007030 2023-10-05T21:15:16.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.609+0000 7f9f28190680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:16.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.609+0000 7f9f28190680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:16.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.609+0000 7f9f28190680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:16.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.609+0000 7f9f28190680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:16.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.609+0000 7f9f28190680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.609+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e865d0 con 0x561158e7e9e0 2023-10-05T21:15:16.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.609+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.609+0000 7f9f28190680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.609+0000 7f9f28190680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.609+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86200 con 0x561158e7e9e0 2023-10-05T21:15:16.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.609+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.609+0000 7f9f28190680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.610+0000 7f9f28190680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.610+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86a70 con 0x561158e7e9e0 2023-10-05T21:15:16.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.610+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.610+0000 7f9f28190680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:16.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.610+0000 7f9f28190680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.610+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e87960 con 0x561158e833e0 2023-10-05T21:15:16.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.610+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f9f1003e040 con 0x561158e833e0 2023-10-05T21:15:16.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.610+0000 7f9f28190680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.610+0000 7f9f28190680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.610+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86f70 con 0x561158e7e9e0 2023-10-05T21:15:16.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.610+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.610+0000 7f9f28190680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.610+0000 7f9f28190680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.610+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e88200 con 0x561158e7e9e0 2023-10-05T21:15:16.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.610+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.610+0000 7f9f28190680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.610+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e89210 con 0x561158e833e0 2023-10-05T21:15:16.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.611+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1003e040 con 0x561158e833e0 2023-10-05T21:15:16.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.611+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e89210 con 0x7f9f10007030 2023-10-05T21:15:16.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.611+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f0c00f620 con 0x7f9f10007030 2023-10-05T21:15:16.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.611+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e89210 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.611+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1400a570 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.611+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86a70 con 0x561158e7e9e0 2023-10-05T21:15:16.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.611+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.611+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86a70 con 0x561158e7e9e0 2023-10-05T21:15:16.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.612+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.612+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86a70 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.612+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1400a570 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.612+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86a70 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.612+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1400a570 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.612+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86a70 con 0x7f9f10007030 2023-10-05T21:15:16.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.612+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f0c00f620 con 0x7f9f10007030 2023-10-05T21:15:16.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.612+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86a70 con 0x561158e833e0 2023-10-05T21:15:16.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.613+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9f1003e040 con 0x561158e833e0 2023-10-05T21:15:16.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.613+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86a70 con 0x561158e7e9e0 2023-10-05T21:15:16.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.613+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.613+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86a70 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.613+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1400a570 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.613+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86a70 con 0x561158e7e9e0 2023-10-05T21:15:16.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.613+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.613+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86a70 con 0x7f9f10007030 2023-10-05T21:15:16.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.613+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f0c00f620 con 0x7f9f10007030 2023-10-05T21:15:16.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.613+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86a70 con 0x561158e833e0 2023-10-05T21:15:16.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.614+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1003e040 con 0x561158e833e0 2023-10-05T21:15:16.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.614+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86a70 con 0x561158e833e0 2023-10-05T21:15:16.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.614+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1003e040 con 0x561158e833e0 2023-10-05T21:15:16.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.614+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86a70 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.614+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1400a570 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.614+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86a70 con 0x561158e833e0 2023-10-05T21:15:16.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.614+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1003e040 con 0x561158e833e0 2023-10-05T21:15:16.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.614+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86a70 con 0x561158e833e0 2023-10-05T21:15:16.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.614+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1003e040 con 0x561158e833e0 2023-10-05T21:15:16.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.615+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86a70 con 0x561158e7e9e0 2023-10-05T21:15:16.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.615+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.615+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86a70 con 0x561158e7e9e0 2023-10-05T21:15:16.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.615+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.615+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86a70 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.615+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1400a570 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.615+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86a70 con 0x561158e833e0 2023-10-05T21:15:16.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.615+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1003e040 con 0x561158e833e0 2023-10-05T21:15:16.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.615+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86a70 con 0x7f9f10007030 2023-10-05T21:15:16.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.616+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f0c00f620 con 0x7f9f10007030 2023-10-05T21:15:16.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.616+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86a70 con 0x561158e7e9e0 2023-10-05T21:15:16.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.616+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.616+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86a70 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.616+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1400a570 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.616+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86a70 con 0x561158e833e0 2023-10-05T21:15:16.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.616+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1003e040 con 0x561158e833e0 2023-10-05T21:15:16.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.616+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86a70 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.616+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1400a570 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.616+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86a70 con 0x7f9f10007030 2023-10-05T21:15:16.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.617+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f0c00f620 con 0x7f9f10007030 2023-10-05T21:15:16.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.617+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86a70 con 0x561158e833e0 2023-10-05T21:15:16.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.617+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1003e040 con 0x561158e833e0 2023-10-05T21:15:16.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.617+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86a70 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.617+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f1400a570 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.617+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86a70 con 0x561158e7e9e0 2023-10-05T21:15:16.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.617+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.617+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e86a70 con 0x7f9f10007030 2023-10-05T21:15:16.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.618+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f0c00f620 con 0x7f9f10007030 2023-10-05T21:15:16.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.618+0000 7f9f28190680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:16.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.618+0000 7f9f28190680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:16.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.618+0000 7f9f28190680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:16.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.618+0000 7f9f28190680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:16.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.618+0000 7f9f28190680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.618+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e88200 con 0x561158e7e9e0 2023-10-05T21:15:16.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.618+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.618+0000 7f9f28190680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.618+0000 7f9f28190680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.618+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e885b0 con 0x561158e833e0 2023-10-05T21:15:16.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.618+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f9f1003e040 con 0x561158e833e0 2023-10-05T21:15:16.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.618+0000 7f9f28190680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:16.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.618+0000 7f9f28190680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.618+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e87dd0 con 0x561158e7e9e0 2023-10-05T21:15:16.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.618+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.618+0000 7f9f28190680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.618+0000 7f9f28190680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.618+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e87da0 con 0x561158e7e9e0 2023-10-05T21:15:16.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.619+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.619+0000 7f9f28190680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:16.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.619+0000 7f9f28190680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.619+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e88e50 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.619+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f9f1400a570 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.619+0000 7f9f28190680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.619+0000 7f9f28190680 20 zone default found 2023-10-05T21:15:16.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.619+0000 7f9f28190680 4 Realm: () 2023-10-05T21:15:16.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.619+0000 7f9f28190680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:16.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.619+0000 7f9f28190680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:16.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.619+0000 7f9f28190680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:16.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.619+0000 7f9f28190680 20 zonegroup default 2023-10-05T21:15:16.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.619+0000 7f9f28190680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.619+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e88e50 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.619+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f9f1400a570 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.619+0000 7f9f28190680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.619+0000 7f9f28190680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.619+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e8a7d0 con 0x561158e833e0 2023-10-05T21:15:16.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.619+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9f1003e040 con 0x561158e833e0 2023-10-05T21:15:16.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.619+0000 7f9f28190680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.619+0000 7f9f28190680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.619+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e8ab80 con 0x561158e833e0 2023-10-05T21:15:16.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.620+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9f1003e040 con 0x561158e833e0 2023-10-05T21:15:16.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.620+0000 7f9f28190680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.620+0000 7f9f28190680 20 started sync module instance, tier type = 2023-10-05T21:15:16.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.620+0000 7f9f28190680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:16.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.620+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e89e90 con 0x7f9f10007030 2023-10-05T21:15:16.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.620+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f0c00f620 con 0x7f9f10007030 2023-10-05T21:15:16.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.620+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94632506073744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e8b420 con 0x7f9f10007030 2023-10-05T21:15:16.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.620+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e8bcc0 con 0x561158e7e9e0 2023-10-05T21:15:16.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.621+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94632506073744] v29'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f0c00f620 con 0x7f9f10007030 2023-10-05T21:15:16.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.621+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.621+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94632506076976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e8bcc0 con 0x561158e7e9e0 2023-10-05T21:15:16.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.621+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e8c780 con 0x561158e833e0 2023-10-05T21:15:16.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.622+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f1003e040 con 0x561158e833e0 2023-10-05T21:15:16.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.622+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94632506076976] v29'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.622+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94632506081904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e8d070 con 0x561158e833e0 2023-10-05T21:15:16.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.622+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e8d940 con 0x7f9f10007030 2023-10-05T21:15:16.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.623+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94632506081904] v29'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f1003e040 con 0x561158e833e0 2023-10-05T21:15:16.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.623+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f0c00f620 con 0x7f9f10007030 2023-10-05T21:15:16.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.623+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94632506086480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e8d070 con 0x7f9f10007030 2023-10-05T21:15:16.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.623+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e8e350 con 0x561158e7e9e0 2023-10-05T21:15:16.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.623+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.623+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94632506089616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e8eb80 con 0x561158e7e9e0 2023-10-05T21:15:16.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.623+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94632506086480] v29'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f0c00f620 con 0x7f9f10007030 2023-10-05T21:15:16.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.623+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e8f780 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.624+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94632506089616] v29'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.624+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f1400a570 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.624+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94632506094096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e8e5b0 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.624+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e8fc30 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.625+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(96 notify.6 [create] v29'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f1400a570 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.625+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94632506095424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e90080 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.625+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(95 notify.5 [watch watch cookie 94632506094096] v29'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f1400a570 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.625+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e90c60 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.626+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94632506095424] v29'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f1400a570 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.626+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f1400a570 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.626+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94632506099472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e8fb90 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.626+0000 7f9f28190680 20 add_watcher() i=0 2023-10-05T21:15:16.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.626+0000 7f9f28190680 20 add_watcher() i=1 2023-10-05T21:15:16.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.626+0000 7f9f28190680 20 add_watcher() i=2 2023-10-05T21:15:16.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.626+0000 7f9f28190680 20 add_watcher() i=3 2023-10-05T21:15:16.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.626+0000 7f9f28190680 20 add_watcher() i=4 2023-10-05T21:15:16.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.626+0000 7f9f28190680 20 add_watcher() i=5 2023-10-05T21:15:16.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.626+0000 7f9f28190680 20 add_watcher() i=6 2023-10-05T21:15:16.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.626+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94632506099472] v29'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f1400a570 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.626+0000 7f9f28190680 20 add_watcher() i=7 2023-10-05T21:15:16.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.626+0000 7f9f28190680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:16.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.626+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e90080 con 0x561158e7e9e0 2023-10-05T21:15:16.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.627+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.627+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94632506084224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e90080 con 0x561158e7e9e0 2023-10-05T21:15:16.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.627+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94632506084224] v29'104 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.627+0000 7f9e67fff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:16.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.628+0000 7f9f28190680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:16.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.628+0000 7f9f28190680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:16.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.628+0000 7f9f28190680 1 Processor -- start 2023-10-05T21:15:16.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.628+0000 7f9f28190680 1 -- start start 2023-10-05T21:15:16.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.628+0000 7f9f28190680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e9d6a0 0x561158e9dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.628+0000 7f9f28190680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x561158e9e0c0 con 0x561158e9d6a0 2023-10-05T21:15:16.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.628+0000 7f9f1aa67700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e9d6a0 0x561158e9dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.628+0000 7f9f1aa67700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e9d6a0 0x561158e9dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50554/0 (socket says 172.21.15.153:50554) 2023-10-05T21:15:16.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.628+0000 7f9f1aa67700 1 -- 172.21.15.153:0/3215723279 learned_addr learned my addr 172.21.15.153:0/3215723279 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:16.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.628+0000 7f9f1aa67700 1 -- 172.21.15.153:0/3215723279 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561158e9e5a0 con 0x561158e9d6a0 2023-10-05T21:15:16.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.629+0000 7f9f1aa67700 1 --2- 172.21.15.153:0/3215723279 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e9d6a0 0x561158e9dab0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x561158e823d0 tx=0x7f9f0c006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a73af9a904d05e94 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.629+0000 7f9e677fe700 1 -- 172.21.15.153:0/3215723279 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f0c00dae0 con 0x561158e9d6a0 2023-10-05T21:15:16.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.629+0000 7f9e677fe700 1 -- 172.21.15.153:0/3215723279 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0c00dc40 con 0x561158e9d6a0 2023-10-05T21:15:16.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.629+0000 7f9e677fe700 1 -- 172.21.15.153:0/3215723279 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f0c00ddf0 con 0x561158e9d6a0 2023-10-05T21:15:16.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.629+0000 7f9f28190680 1 -- 172.21.15.153:0/3215723279 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e9d6a0 msgr2=0x561158e9dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.629+0000 7f9f28190680 1 --2- 172.21.15.153:0/3215723279 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e9d6a0 0x561158e9dab0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x561158e823d0 tx=0x7f9f0c006000 comp rx=0 tx=0).stop 2023-10-05T21:15:16.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.629+0000 7f9f28190680 1 -- 172.21.15.153:0/3215723279 shutdown_connections 2023-10-05T21:15:16.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.629+0000 7f9f28190680 1 --2- 172.21.15.153:0/3215723279 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e9d6a0 0x561158e9dab0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.629+0000 7f9f28190680 1 -- 172.21.15.153:0/3215723279 >> 172.21.15.153:0/3215723279 conn(0x561158e999a0 msgr2=0x561158e97aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.629+0000 7f9f28190680 1 -- 172.21.15.153:0/3215723279 shutdown_connections 2023-10-05T21:15:16.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.629+0000 7f9f28190680 1 -- 172.21.15.153:0/3215723279 wait complete. 2023-10-05T21:15:16.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.630+0000 7f9f28190680 1 Processor -- start 2023-10-05T21:15:16.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.630+0000 7f9f28190680 1 -- start start 2023-10-05T21:15:16.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.630+0000 7f9f28190680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e9d6a0 0x561158ea43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.630+0000 7f9f28190680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x561158ea4910 con 0x561158e9d6a0 2023-10-05T21:15:16.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.630+0000 7f9f1aa67700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e9d6a0 0x561158ea43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.630+0000 7f9f1aa67700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e9d6a0 0x561158ea43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50560/0 (socket says 172.21.15.153:50560) 2023-10-05T21:15:16.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.630+0000 7f9f1aa67700 1 -- 172.21.15.153:0/1638123099 learned_addr learned my addr 172.21.15.153:0/1638123099 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:16.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.631+0000 7f9f1aa67700 1 -- 172.21.15.153:0/1638123099 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0c006070 con 0x561158e9d6a0 2023-10-05T21:15:16.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.631+0000 7f9f1aa67700 1 --2- 172.21.15.153:0/1638123099 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e9d6a0 0x561158ea43d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c00bfe0 tx=0x7f9f0c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.631+0000 7f9e65ffb700 1 -- 172.21.15.153:0/1638123099 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f0c00de30 con 0x561158e9d6a0 2023-10-05T21:15:16.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.631+0000 7f9e65ffb700 1 -- 172.21.15.153:0/1638123099 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0c03dcc0 con 0x561158e9d6a0 2023-10-05T21:15:16.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.631+0000 7f9f28190680 1 -- 172.21.15.153:0/1638123099 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561158ea4b10 con 0x561158e9d6a0 2023-10-05T21:15:16.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.631+0000 7f9e65ffb700 1 -- 172.21.15.153:0/1638123099 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f0c03de30 con 0x561158e9d6a0 2023-10-05T21:15:16.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.631+0000 7f9f28190680 1 -- 172.21.15.153:0/1638123099 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561158ea4f60 con 0x561158e9d6a0 2023-10-05T21:15:16.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.632+0000 7f9e65ffb700 1 -- 172.21.15.153:0/1638123099 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f9f0c01a040 con 0x561158e9d6a0 2023-10-05T21:15:16.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.632+0000 7f9e65ffb700 1 --2- 172.21.15.153:0/1638123099 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9e580340f0 0x7f9e580365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.632+0000 7f9e65ffb700 1 -- 172.21.15.153:0/1638123099 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f9f0c048b30 con 0x561158e9d6a0 2023-10-05T21:15:16.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.632+0000 7f9f28190680 5 note: GC not initialized 2023-10-05T21:15:16.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.632+0000 7f9f1ba69700 1 --2- 172.21.15.153:0/1638123099 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9e580340f0 0x7f9e580365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.632+0000 7f9f1ba69700 1 --2- 172.21.15.153:0/1638123099 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9e580340f0 0x7f9e580365a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x561158e8fc30 tx=0x7f9f14037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.633+0000 7f9e5effd700 20 reqs_thread_entry: start 2023-10-05T21:15:16.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.633+0000 7f9e5cff9700 20 reqs_thread_entry: start 2023-10-05T21:15:16.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.633+0000 7f9f28190680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:16.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.633+0000 7f9f28190680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:16.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.633+0000 7f9e4affd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:47 2023 2023-10-05T21:15:16.685 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:16.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.633+0000 7f9e4a7fc700 20 reqs_thread_entry: start 2023-10-05T21:15:16.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.633+0000 7f9f28190680 20 get_system_obj_state: rctx=0x7ffcf43308d8 obj=default.rgw.meta:users.uid:foo state=0x561158cff240 s->prefetch_data=0 2023-10-05T21:15:16.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.633+0000 7f9f28190680 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T21:15:16.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.633+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158f09c50 con 0x561158e7e9e0 2023-10-05T21:15:16.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.634+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.634+0000 7f9f28190680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T21:15:16.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.634+0000 7f9f28190680 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:16.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.634+0000 7f9f28190680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:16.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.634+0000 7f9f28190680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:16.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.634+0000 7f9f28190680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:16.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.634+0000 7f9f28190680 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:16.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.634+0000 7f9f28190680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.634+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158f0c180 con 0x561158e7e9e0 2023-10-05T21:15:16.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.634+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.634+0000 7f9f28190680 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T21:15:16.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.634+0000 7f9f28190680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T21:15:16.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.634+0000 7f9f28190680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:16.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.634+0000 7f9f28190680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:16.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.634+0000 7f9f28190680 20 get_system_obj_state: rctx=0x7ffcf4330930 obj=default.rgw.meta:root:myfoo state=0x561158cff240 s->prefetch_data=0 2023-10-05T21:15:16.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.634+0000 7f9f28190680 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-10-05T21:15:16.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.634+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:104 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158f0af90 con 0x7f9f10007030 2023-10-05T21:15:16.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.634+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(104 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f9f0c00f620 con 0x7f9f10007030 2023-10-05T21:15:16.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.634+0000 7f9f28190680 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x16 2023-10-05T21:15:16.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.634+0000 7f9f28190680 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:16.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.634+0000 7f9f28190680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:16.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.634+0000 7f9f28190680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:16.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.634+0000 7f9f28190680 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x11, cached=0x16) 2023-10-05T21:15:16.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.634+0000 7f9f28190680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.634+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158f0af90 con 0x7f9f10007030 2023-10-05T21:15:16.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.635+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(105 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7f9f0c00f620 con 0x7f9f10007030 2023-10-05T21:15:16.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.635+0000 7f9f28190680 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T21:15:16.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.635+0000 7f9f28190680 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2023-10-05T21:15:16.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.635+0000 7f9f28190680 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:16.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.635+0000 7f9f28190680 20 get_system_obj_state: rctx=0x7ffcf4330930 obj=default.rgw.meta:root:.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 state=0x561158cff500 s->prefetch_data=0 2023-10-05T21:15:16.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.635+0000 7f9f28190680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 : miss 2023-10-05T21:15:16.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.635+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:106 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158f0dd70 con 0x561158e833e0 2023-10-05T21:15:16.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.635+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(106 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f9f1003e040 con 0x561158e833e0 2023-10-05T21:15:16.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.635+0000 7f9f28190680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 info.flags=0x16 2023-10-05T21:15:16.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.635+0000 7f9f28190680 10 adding default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 to cache LRU end 2023-10-05T21:15:16.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.635+0000 7f9f28190680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:16.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.635+0000 7f9f28190680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:16.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.635+0000 7f9f28190680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:16.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.635+0000 7f9f28190680 20 Read xattr: user.rgw.acl 2023-10-05T21:15:16.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.635+0000 7f9f28190680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:16.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.635+0000 7f9f28190680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:16.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.635+0000 7f9f28190680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.635+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158f10f60 con 0x561158e833e0 2023-10-05T21:15:16.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.635+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(107 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f9f1003e040 con 0x561158e833e0 2023-10-05T21:15:16.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.635+0000 7f9f28190680 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T21:15:16.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.635+0000 7f9f28190680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 info.flags=0x13 2023-10-05T21:15:16.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.635+0000 7f9f28190680 10 moving default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 to cache LRU end 2023-10-05T21:15:16.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.635+0000 7f9f28190680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:16.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.635+0000 7f9f28190680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:16.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.635+0000 7f9f28190680 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 2023-10-05T21:15:16.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.635+0000 7f9f28190680 20 get_system_obj_state: rctx=0x7ffcf43308b8 obj=default.rgw.meta:users.uid:foo state=0x561158cff500 s->prefetch_data=0 2023-10-05T21:15:16.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.635+0000 7f9f28190680 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x16, cached=0x13) 2023-10-05T21:15:16.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.635+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:108 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158f10c80 con 0x561158e7e9e0 2023-10-05T21:15:16.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.636+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(108 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.636+0000 7f9f28190680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T21:15:16.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.636+0000 7f9f28190680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:16.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.636+0000 7f9f28190680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:16.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.636+0000 7f9f28190680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:16.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.636+0000 7f9f28190680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:16.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.636+0000 7f9f28190680 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x17) 2023-10-05T21:15:16.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.636+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:109 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158f10c80 con 0x7f9f10007030 2023-10-05T21:15:16.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.637+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(109 foo.buckets [call] v29'17 uv17 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f9f0c00f620 con 0x7f9f10007030 2023-10-05T21:15:16.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.637+0000 7f9f28190680 20 get_system_obj_state: rctx=0x7ffcf43309e8 obj=default.rgw.meta:root:myfoo state=0x561158cff500 s->prefetch_data=0 2023-10-05T21:15:16.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.637+0000 7f9f28190680 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x16, cached=0x13) 2023-10-05T21:15:16.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.637+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:110 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158f11580 con 0x7f9f10007030 2023-10-05T21:15:16.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.637+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(110 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f9f0c00f620 con 0x7f9f10007030 2023-10-05T21:15:16.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.637+0000 7f9f28190680 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x16 2023-10-05T21:15:16.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.637+0000 7f9f28190680 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:16.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.637+0000 7f9f28190680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:16.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.637+0000 7f9f28190680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:16.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.637+0000 7f9f28190680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:16.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.637+0000 7f9f28190680 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x13, cached=0x17) 2023-10-05T21:15:16.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.637+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:111 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158f15e90 con 0x7f9f10007030 2023-10-05T21:15:16.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.638+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== osd_op_reply(111 myfoo [delete,create,call,call,writefull 0~165] v29'18 uv18 ondisk = 0) v8 ==== 317+0+0 (crc 0 0 0) 0x7f9f0c00f620 con 0x7f9f10007030 2023-10-05T21:15:16.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.638+0000 7f9f28190680 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2023-10-05T21:15:16.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.638+0000 7f9f28190680 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:16.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.638+0000 7f9f28190680 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2023-10-05T21:15:16.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.638+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94632506644832 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158f12a80 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.638+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== watch-notify(notify (1) cookie 94632506095424 notify 124554051594 ret 0) v3 ==== 380+0+0 (crc 0 0 0) 0x7f9f140291f0 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.638+0000 7f9f19264700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051594 cookie 94632506095424 notifier 4436 bl.length()=338 2023-10-05T21:15:16.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.638+0000 7f9f19264700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2023-10-05T21:15:16.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.638+0000 7f9f19264700 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:16.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.638+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(112 notify.6 [notify cookie 94632506644832 out=8b] v0'0 uv105 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f9f1400a570 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.638+0000 7f9f19264700 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:113 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9ef8003d90 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.638+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(113 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f1400a570 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.638+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== watch-notify(notify_complete (2) cookie 94632506644832 notify 124554051594 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f9f1402d040 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.639+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:114 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94632506073744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158f15960 con 0x7f9f10007030 2023-10-05T21:15:16.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.639+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 <== osd.2 v2:172.21.15.153:6807/140454 22 ==== osd_op_reply(114 notify.0 [watch unwatch cookie 94632506073744] v29'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f0c00f620 con 0x7f9f10007030 2023-10-05T21:15:16.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.639+0000 7f9f28190680 20 remove_watcher() i=0 2023-10-05T21:15:16.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.639+0000 7f9f28190680 2 removed watcher, disabling cache 2023-10-05T21:15:16.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.639+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:115 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94632506076976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e8a290 con 0x561158e7e9e0 2023-10-05T21:15:16.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.640+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(115 notify.1 [watch unwatch cookie 94632506076976] v29'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.640+0000 7f9f28190680 20 remove_watcher() i=1 2023-10-05T21:15:16.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.640+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:116 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94632506081904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e8a290 con 0x561158e833e0 2023-10-05T21:15:16.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.641+0000 7f9f1b268700 1 -- 172.21.15.153:0/4018481508 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(116 notify.2 [watch unwatch cookie 94632506081904] v29'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f1003e040 con 0x561158e833e0 2023-10-05T21:15:16.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.641+0000 7f9f28190680 20 remove_watcher() i=2 2023-10-05T21:15:16.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.641+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:117 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94632506086480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e8c270 con 0x7f9f10007030 2023-10-05T21:15:16.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.642+0000 7f9f1aa67700 1 -- 172.21.15.153:0/4018481508 <== osd.2 v2:172.21.15.153:6807/140454 23 ==== osd_op_reply(117 notify.3 [watch unwatch cookie 94632506086480] v29'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f0c00f620 con 0x7f9f10007030 2023-10-05T21:15:16.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.642+0000 7f9f28190680 20 remove_watcher() i=3 2023-10-05T21:15:16.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.642+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:118 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94632506089616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e8a290 con 0x561158e7e9e0 2023-10-05T21:15:16.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.643+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(118 notify.4 [watch unwatch cookie 94632506089616] v29'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.643+0000 7f9f28190680 20 remove_watcher() i=4 2023-10-05T21:15:16.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.643+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:119 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94632506094096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e8d450 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.643+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 31 ==== osd_op_reply(119 notify.5 [watch unwatch cookie 94632506094096] v29'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f1400a570 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.643+0000 7f9f28190680 20 remove_watcher() i=5 2023-10-05T21:15:16.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.643+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:120 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94632506095424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e8a290 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.644+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 32 ==== osd_op_reply(120 notify.6 [watch unwatch cookie 94632506095424] v29'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f1400a570 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.644+0000 7f9f28190680 20 remove_watcher() i=6 2023-10-05T21:15:16.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.644+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:121 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94632506099472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e8f210 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.645+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.0 v2:172.21.15.111:6800/111394 33 ==== osd_op_reply(121 notify.7 [watch unwatch cookie 94632506099472] v29'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f1400a570 con 0x7f9f0c00e8c0 2023-10-05T21:15:16.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.645+0000 7f9f28190680 20 remove_watcher() i=7 2023-10-05T21:15:16.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.646+0000 7f9e67fff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:16.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.646+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:122 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94632506084224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x561158e8f740 con 0x561158e7e9e0 2023-10-05T21:15:16.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.646+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(122 data_loggenerations_metadata [watch unwatch cookie 94632506084224] v29'105 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9f1400a570 con 0x561158e7e9e0 2023-10-05T21:15:16.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.646+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f9f0c00e8c0 msgr2=0x7f9f0c00d310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.646+0000 7f9f28190680 1 --2- 172.21.15.153:0/4018481508 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f9f0c00e8c0 0x7f9f0c00d310 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.646+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x561158e7e9e0 msgr2=0x561158e80de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.646+0000 7f9f28190680 1 --2- 172.21.15.153:0/4018481508 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x561158e7e9e0 0x561158e80de0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.646+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f9f10007030 msgr2=0x7f9f10037810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.646+0000 7f9f28190680 1 --2- 172.21.15.153:0/4018481508 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f9f10007030 0x7f9f10037810 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.646+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x561158e833e0 msgr2=0x561158e857c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.646+0000 7f9f28190680 1 --2- 172.21.15.153:0/4018481508 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x561158e833e0 0x561158e857c0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.647+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9f00034140 msgr2=0x7f9f000365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.647+0000 7f9f28190680 1 --2- 172.21.15.153:0/4018481508 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9f00034140 0x7f9f000365f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c0011e0 tx=0x7f9f0c0013c0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.647+0000 7f9f1ba69700 1 -- 172.21.15.153:0/4018481508 reap_dead start 2023-10-05T21:15:16.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.647+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e4b2c0 msgr2=0x561158e74c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.647+0000 7f9f28190680 1 --2- 172.21.15.153:0/4018481508 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e4b2c0 0x561158e74c80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9f1000a650 tx=0x7f9f1001d000 comp rx=0 tx=0).stop 2023-10-05T21:15:16.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.647+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 shutdown_connections 2023-10-05T21:15:16.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.647+0000 7f9f28190680 1 --2- 172.21.15.153:0/4018481508 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e4b2c0 0x561158e74c80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.647+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 >> 172.21.15.153:0/4018481508 conn(0x561158e46b90 msgr2=0x561158e63840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.647+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 shutdown_connections 2023-10-05T21:15:16.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.647+0000 7f9f28190680 1 -- 172.21.15.153:0/4018481508 wait complete. 2023-10-05T21:15:16.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.647+0000 7f9f28190680 1 -- 172.21.15.153:0/1638123099 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9e580340f0 msgr2=0x7f9e580365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.647+0000 7f9f28190680 1 --2- 172.21.15.153:0/1638123099 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9e580340f0 0x7f9e580365a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x561158e8fc30 tx=0x7f9f14037450 comp rx=0 tx=0).stop 2023-10-05T21:15:16.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.647+0000 7f9f28190680 1 -- 172.21.15.153:0/1638123099 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e9d6a0 msgr2=0x561158ea43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.647+0000 7f9f28190680 1 --2- 172.21.15.153:0/1638123099 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e9d6a0 0x561158ea43d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c00bfe0 tx=0x7f9f0c032000 comp rx=0 tx=0).stop 2023-10-05T21:15:16.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.647+0000 7f9f28190680 1 -- 172.21.15.153:0/1638123099 shutdown_connections 2023-10-05T21:15:16.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.647+0000 7f9f28190680 1 --2- 172.21.15.153:0/1638123099 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9e580340f0 0x7f9e580365a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.647+0000 7f9f28190680 1 --2- 172.21.15.153:0/1638123099 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561158e9d6a0 0x561158ea43d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.647+0000 7f9f28190680 1 -- 172.21.15.153:0/1638123099 >> 172.21.15.153:0/1638123099 conn(0x561158e999a0 msgr2=0x561158e97a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.647+0000 7f9f28190680 1 -- 172.21.15.153:0/1638123099 shutdown_connections 2023-10-05T21:15:16.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.647+0000 7f9f28190680 1 -- 172.21.15.153:0/1638123099 wait complete. 2023-10-05T21:15:16.705 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2023-10-05T21:15:16.705 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2023-10-05T21:15:16.705 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2023-10-05T21:15:16.758 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:16.758 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:16.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.757+0000 7fc334c09680 1 Processor -- start 2023-10-05T21:15:16.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.757+0000 7fc334c09680 1 -- start start 2023-10-05T21:15:16.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.757+0000 7fc334c09680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55d06108dd70 0x55d061090150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.757+0000 7fc334c09680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d060fd4930 con 0x55d061087a80 2023-10-05T21:15:16.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.757+0000 7fc334c09680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d060f94db0 con 0x55d06108dd70 2023-10-05T21:15:16.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.758+0000 7fc3274e0700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55d06108dd70 0x55d061090150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.758+0000 7fc327ce1700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55d061087a80 0x55d061087e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56466/0 (socket says 172.21.15.153:56466) 2023-10-05T21:15:16.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.758+0000 7fc327ce1700 1 -- 172.21.15.153:0/1083688153 learned_addr learned my addr 172.21.15.153:0/1083688153 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:16.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.758+0000 7fc3274e0700 1 -- 172.21.15.153:0/1083688153 >> v1:172.21.15.111:6789/0 conn(0x55d061087a80 legacy=0x55d061087e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.758+0000 7fc3274e0700 1 -- 172.21.15.153:0/1083688153 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d061088660 con 0x55d06108dd70 2023-10-05T21:15:16.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.758+0000 7fc326cdf700 1 -- 172.21.15.153:0/1083688153 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 65968972 0 0) 0x55d060fd4930 con 0x55d061087a80 2023-10-05T21:15:16.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.758+0000 7fc3274e0700 1 --2- 172.21.15.153:0/1083688153 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d06108dd70 0x55d061090150 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc31000a5d0 tx=0x7fc310005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddcbdd1f6f1a493 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.758+0000 7fc326cdf700 1 -- 172.21.15.153:0/1083688153 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3100086a0 con 0x55d06108dd70 2023-10-05T21:15:16.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.758+0000 7fc326cdf700 1 -- 172.21.15.153:0/1083688153 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc310008800 con 0x55d06108dd70 2023-10-05T21:15:16.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.758+0000 7fc326cdf700 1 -- 172.21.15.153:0/1083688153 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc310008ad0 con 0x55d06108dd70 2023-10-05T21:15:16.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.759+0000 7fc334c09680 1 -- 172.21.15.153:0/1083688153 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d06108dd70 msgr2=0x55d061090150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.759+0000 7fc334c09680 1 --2- 172.21.15.153:0/1083688153 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d06108dd70 0x55d061090150 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc31000a5d0 tx=0x7fc310005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:16.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.759+0000 7fc334c09680 1 -- 172.21.15.153:0/1083688153 shutdown_connections 2023-10-05T21:15:16.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.759+0000 7fc334c09680 1 --2- 172.21.15.153:0/1083688153 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d06108dd70 0x55d061090150 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.759+0000 7fc334c09680 1 -- 172.21.15.153:0/1083688153 >> 172.21.15.153:0/1083688153 conn(0x55d061081340 msgr2=0x55d061083750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.759+0000 7fc334c09680 1 -- 172.21.15.153:0/1083688153 shutdown_connections 2023-10-05T21:15:16.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.759+0000 7fc334c09680 1 -- 172.21.15.153:0/1083688153 wait complete. 2023-10-05T21:15:16.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.759+0000 7fc334c09680 1 Processor -- start 2023-10-05T21:15:16.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.759+0000 7fc334c09680 1 -- start start 2023-10-05T21:15:16.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.760+0000 7fc334c09680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d061087a80 0x55d0610a89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.760+0000 7fc334c09680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d060f34ea0 con 0x55d061087a80 2023-10-05T21:15:16.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.760+0000 7fc327ce1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d061087a80 0x55d0610a89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.760+0000 7fc327ce1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d061087a80 0x55d0610a89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50586/0 (socket says 172.21.15.153:50586) 2023-10-05T21:15:16.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.760+0000 7fc327ce1700 1 -- 172.21.15.153:0/3059244406 learned_addr learned my addr 172.21.15.153:0/3059244406 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:16.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.760+0000 7fc327ce1700 1 -- 172.21.15.153:0/3059244406 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc310005cf0 con 0x55d061087a80 2023-10-05T21:15:16.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.760+0000 7fc327ce1700 1 --2- 172.21.15.153:0/3059244406 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d061087a80 0x55d0610a89f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc320001dc0 tx=0x7fc320001790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c780782e68bfcc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.760+0000 7fc325cdd700 1 -- 172.21.15.153:0/3059244406 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc32000bce0 con 0x55d061087a80 2023-10-05T21:15:16.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.760+0000 7fc325cdd700 1 -- 172.21.15.153:0/3059244406 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32000be40 con 0x55d061087a80 2023-10-05T21:15:16.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.760+0000 7fc325cdd700 1 -- 172.21.15.153:0/3059244406 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc32000e5d0 con 0x55d061087a80 2023-10-05T21:15:16.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.761+0000 7fc334c09680 1 -- 172.21.15.153:0/3059244406 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d061087a80 msgr2=0x55d0610a89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.761+0000 7fc334c09680 1 --2- 172.21.15.153:0/3059244406 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d061087a80 0x55d0610a89f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc320001dc0 tx=0x7fc320001790 comp rx=0 tx=0).stop 2023-10-05T21:15:16.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.761+0000 7fc334c09680 1 -- 172.21.15.153:0/3059244406 shutdown_connections 2023-10-05T21:15:16.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.761+0000 7fc334c09680 1 --2- 172.21.15.153:0/3059244406 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d061087a80 0x55d0610a89f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.761+0000 7fc334c09680 1 -- 172.21.15.153:0/3059244406 >> 172.21.15.153:0/3059244406 conn(0x55d061081340 msgr2=0x55d0610a44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.761+0000 7fc334c09680 1 -- 172.21.15.153:0/3059244406 shutdown_connections 2023-10-05T21:15:16.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.761+0000 7fc334c09680 1 -- 172.21.15.153:0/3059244406 wait complete. 2023-10-05T21:15:16.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.761+0000 7fc334c09680 1 Processor -- start 2023-10-05T21:15:16.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.761+0000 7fc334c09680 1 -- start start 2023-10-05T21:15:16.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.761+0000 7fc334c09680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d061087a80 0x55d0610afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.761+0000 7fc334c09680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d060f2bc80 con 0x55d061087a80 2023-10-05T21:15:16.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.761+0000 7fc327ce1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d061087a80 0x55d0610afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.761+0000 7fc327ce1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d061087a80 0x55d0610afeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50602/0 (socket says 172.21.15.153:50602) 2023-10-05T21:15:16.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.761+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 learned_addr learned my addr 172.21.15.153:0/3870124329 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:16.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.762+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc320001a70 con 0x55d061087a80 2023-10-05T21:15:16.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.762+0000 7fc327ce1700 1 --2- 172.21.15.153:0/3870124329 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d061087a80 0x55d0610afeb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc3200017d0 tx=0x7fc320016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.762+0000 7fc31ffff700 1 -- 172.21.15.153:0/3870124329 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc32001f070 con 0x55d061087a80 2023-10-05T21:15:16.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.762+0000 7fc31ffff700 1 -- 172.21.15.153:0/3870124329 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32001a4d0 con 0x55d061087a80 2023-10-05T21:15:16.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.762+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d0610b03f0 con 0x55d061087a80 2023-10-05T21:15:16.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.762+0000 7fc31ffff700 1 -- 172.21.15.153:0/3870124329 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc32001a7a0 con 0x55d061087a80 2023-10-05T21:15:16.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.762+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d0610b0840 con 0x55d061087a80 2023-10-05T21:15:16.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.763+0000 7fc31ffff700 1 -- 172.21.15.153:0/3870124329 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fc32001a900 con 0x55d061087a80 2023-10-05T21:15:16.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.763+0000 7fc334c09680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.763+0000 7fc31ffff700 1 --2- 172.21.15.153:0/3870124329 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc308034140 0x7fc3080365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.763+0000 7fc31ffff700 1 -- 172.21.15.153:0/3870124329 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fc320048e90 con 0x55d061087a80 2023-10-05T21:15:16.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.763+0000 7fc3274e0700 1 --2- 172.21.15.153:0/3870124329 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc308034140 0x7fc3080365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.763+0000 7fc334c09680 1 --2- 172.21.15.153:0/3870124329 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d06108dd70 0x55d0610bbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.763+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610bc390 con 0x55d06108dd70 2023-10-05T21:15:16.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.763+0000 7fc3284e2700 1 --2- 172.21.15.153:0/3870124329 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d06108dd70 0x55d0610bbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.764+0000 7fc3274e0700 1 --2- 172.21.15.153:0/3870124329 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc308034140 0x7fc3080365f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc310003080 tx=0x7fc310015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.764+0000 7fc3284e2700 1 --2- 172.21.15.153:0/3870124329 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d06108dd70 0x55d0610bbc00 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.764+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.764+0000 7fc334c09680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.764+0000 7fc334c09680 20 realm 2023-10-05T21:15:16.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.764+0000 7fc334c09680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.764+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610b9220 con 0x55d06108dd70 2023-10-05T21:15:16.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.764+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.764+0000 7fc334c09680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.764+0000 7fc334c09680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:16.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.764+0000 7fc334c09680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.764+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610bce90 con 0x55d06108dd70 2023-10-05T21:15:16.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.764+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.764+0000 7fc334c09680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.764+0000 7fc334c09680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.764+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610bd7b0 con 0x55d06108dd70 2023-10-05T21:15:16.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.765+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.765+0000 7fc334c09680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.765+0000 7fc334c09680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.765+0000 7fc334c09680 1 --2- 172.21.15.153:0/3870124329 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d0610be070 0x55d0610c0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.765+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c0aa0 con 0x55d0610be070 2023-10-05T21:15:16.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.765+0000 7fc327ce1700 1 --2- 172.21.15.153:0/3870124329 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d0610be070 0x55d0610c0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.765+0000 7fc327ce1700 1 --2- 172.21.15.153:0/3870124329 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d0610be070 0x55d0610c0450 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.765+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc320014070 con 0x55d0610be070 2023-10-05T21:15:16.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.765+0000 7fc334c09680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:16.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.765+0000 7fc334c09680 20 searching for the correct realm 2023-10-05T21:15:16.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.765+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x55d0610be070 2023-10-05T21:15:16.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.766+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc320014070 con 0x55d0610be070 2023-10-05T21:15:16.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.766+0000 7fc327ce1700 1 --2- 172.21.15.153:0/3870124329 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc320016730 0x7fc3200235f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.766+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x7fc320016730 2023-10-05T21:15:16.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.766+0000 7fc3274e0700 1 --2- 172.21.15.153:0/3870124329 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc320016730 0x7fc3200235f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.766+0000 7fc3274e0700 1 --2- 172.21.15.153:0/3870124329 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc320016730 0x7fc3200235f0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.766+0000 7fc3274e0700 1 -- 172.21.15.153:0/3870124329 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc310019040 con 0x7fc320016730 2023-10-05T21:15:16.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.766+0000 7fc3274e0700 1 --2- 172.21.15.153:0/3870124329 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc310007030 0x7fc31001d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.766+0000 7fc3274e0700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x7fc310007030 2023-10-05T21:15:16.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.767+0000 7fc3284e2700 1 --2- 172.21.15.153:0/3870124329 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc310007030 0x7fc31001d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.767+0000 7fc3284e2700 1 --2- 172.21.15.153:0/3870124329 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc310007030 0x7fc31001d420 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.767+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.767+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x55d06108dd70 2023-10-05T21:15:16.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.767+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.767+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x55d06108dd70 2023-10-05T21:15:16.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.768+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.768+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x7fc310007030 2023-10-05T21:15:16.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.768+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.768+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x7fc310007030 2023-10-05T21:15:16.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.768+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.768+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x7fc320016730 2023-10-05T21:15:16.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.768+0000 7fc3274e0700 1 -- 172.21.15.153:0/3870124329 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc310019040 con 0x7fc320016730 2023-10-05T21:15:16.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.768+0000 7fc3274e0700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x55d0610be070 2023-10-05T21:15:16.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.768+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc320014070 con 0x55d0610be070 2023-10-05T21:15:16.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.768+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x55d06108dd70 2023-10-05T21:15:16.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.769+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.769+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x7fc310007030 2023-10-05T21:15:16.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.769+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.769+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x55d06108dd70 2023-10-05T21:15:16.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.769+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.769+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x7fc320016730 2023-10-05T21:15:16.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.769+0000 7fc3274e0700 1 -- 172.21.15.153:0/3870124329 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc310019040 con 0x7fc320016730 2023-10-05T21:15:16.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.769+0000 7fc3274e0700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x55d0610be070 2023-10-05T21:15:16.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.770+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc320014070 con 0x55d0610be070 2023-10-05T21:15:16.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.770+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x55d0610be070 2023-10-05T21:15:16.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.770+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc320014070 con 0x55d0610be070 2023-10-05T21:15:16.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.770+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x7fc310007030 2023-10-05T21:15:16.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.770+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.770+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x55d0610be070 2023-10-05T21:15:16.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.770+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc320014070 con 0x55d0610be070 2023-10-05T21:15:16.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.770+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x55d0610be070 2023-10-05T21:15:16.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.770+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc320014070 con 0x55d0610be070 2023-10-05T21:15:16.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.770+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x55d06108dd70 2023-10-05T21:15:16.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.771+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.771+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x55d06108dd70 2023-10-05T21:15:16.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.771+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.771+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x7fc310007030 2023-10-05T21:15:16.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.771+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.771+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x55d0610be070 2023-10-05T21:15:16.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.771+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc320014070 con 0x55d0610be070 2023-10-05T21:15:16.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.771+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x7fc320016730 2023-10-05T21:15:16.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.772+0000 7fc3274e0700 1 -- 172.21.15.153:0/3870124329 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc310019040 con 0x7fc320016730 2023-10-05T21:15:16.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.772+0000 7fc3274e0700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x55d06108dd70 2023-10-05T21:15:16.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.772+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.772+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x7fc310007030 2023-10-05T21:15:16.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.772+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.772+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x55d0610be070 2023-10-05T21:15:16.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.772+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc320014070 con 0x55d0610be070 2023-10-05T21:15:16.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.772+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x7fc310007030 2023-10-05T21:15:16.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.772+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.772+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x7fc320016730 2023-10-05T21:15:16.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.773+0000 7fc3274e0700 1 -- 172.21.15.153:0/3870124329 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc310019040 con 0x7fc320016730 2023-10-05T21:15:16.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.773+0000 7fc3274e0700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x55d0610be070 2023-10-05T21:15:16.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.773+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc320014070 con 0x55d0610be070 2023-10-05T21:15:16.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.773+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x7fc310007030 2023-10-05T21:15:16.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.773+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.773+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x55d06108dd70 2023-10-05T21:15:16.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.773+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.773+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2610 con 0x7fc320016730 2023-10-05T21:15:16.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.773+0000 7fc3274e0700 1 -- 172.21.15.153:0/3870124329 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc310019040 con 0x7fc320016730 2023-10-05T21:15:16.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.773+0000 7fc334c09680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:16.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.774+0000 7fc334c09680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:16.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.774+0000 7fc334c09680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:16.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.774+0000 7fc334c09680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:16.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.774+0000 7fc334c09680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.774+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c1560 con 0x55d06108dd70 2023-10-05T21:15:16.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.774+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.774+0000 7fc334c09680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.774+0000 7fc334c09680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.774+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c1960 con 0x55d06108dd70 2023-10-05T21:15:16.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.774+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.774+0000 7fc334c09680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.774+0000 7fc334c09680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.774+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2aa0 con 0x55d06108dd70 2023-10-05T21:15:16.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.774+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.774+0000 7fc334c09680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:16.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.774+0000 7fc334c09680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.774+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2e50 con 0x55d0610be070 2023-10-05T21:15:16.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.774+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fc320014070 con 0x55d0610be070 2023-10-05T21:15:16.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.774+0000 7fc334c09680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.774+0000 7fc334c09680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.774+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c3200 con 0x55d06108dd70 2023-10-05T21:15:16.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.775+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.775+0000 7fc334c09680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.775+0000 7fc334c09680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.775+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c3200 con 0x55d06108dd70 2023-10-05T21:15:16.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.775+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.775+0000 7fc334c09680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.775+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c3200 con 0x55d0610be070 2023-10-05T21:15:16.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.775+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc320014070 con 0x55d0610be070 2023-10-05T21:15:16.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.775+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c3200 con 0x7fc320016730 2023-10-05T21:15:16.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.775+0000 7fc3274e0700 1 -- 172.21.15.153:0/3870124329 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc310019040 con 0x7fc320016730 2023-10-05T21:15:16.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.775+0000 7fc3274e0700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c3200 con 0x7fc310007030 2023-10-05T21:15:16.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.776+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.776+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2aa0 con 0x55d06108dd70 2023-10-05T21:15:16.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.776+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.776+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2aa0 con 0x55d06108dd70 2023-10-05T21:15:16.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.776+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.776+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2aa0 con 0x7fc310007030 2023-10-05T21:15:16.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.776+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.776+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2aa0 con 0x7fc310007030 2023-10-05T21:15:16.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.776+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.776+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2aa0 con 0x7fc320016730 2023-10-05T21:15:16.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.777+0000 7fc3274e0700 1 -- 172.21.15.153:0/3870124329 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc310019040 con 0x7fc320016730 2023-10-05T21:15:16.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.777+0000 7fc3274e0700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2aa0 con 0x55d0610be070 2023-10-05T21:15:16.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.777+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc320014070 con 0x55d0610be070 2023-10-05T21:15:16.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.777+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2aa0 con 0x55d06108dd70 2023-10-05T21:15:16.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.777+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.777+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2aa0 con 0x7fc310007030 2023-10-05T21:15:16.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.777+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.777+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2aa0 con 0x55d06108dd70 2023-10-05T21:15:16.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.777+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.777+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2aa0 con 0x7fc320016730 2023-10-05T21:15:16.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.778+0000 7fc3274e0700 1 -- 172.21.15.153:0/3870124329 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc310019040 con 0x7fc320016730 2023-10-05T21:15:16.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.778+0000 7fc3274e0700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2aa0 con 0x55d0610be070 2023-10-05T21:15:16.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.778+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc320014070 con 0x55d0610be070 2023-10-05T21:15:16.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.778+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c2aa0 con 0x55d0610be070 2023-10-05T21:15:16.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.778+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc320014070 con 0x55d0610be070 2023-10-05T21:15:16.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.778+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc32004d040 con 0x7fc310007030 2023-10-05T21:15:16.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.778+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.778+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc32004d040 con 0x55d0610be070 2023-10-05T21:15:16.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.779+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc320014070 con 0x55d0610be070 2023-10-05T21:15:16.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.779+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc32004d040 con 0x55d0610be070 2023-10-05T21:15:16.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.779+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc320014070 con 0x55d0610be070 2023-10-05T21:15:16.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.779+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc32004d040 con 0x55d06108dd70 2023-10-05T21:15:16.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.779+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.779+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc32004d040 con 0x55d06108dd70 2023-10-05T21:15:16.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.779+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.779+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc32004d040 con 0x7fc310007030 2023-10-05T21:15:16.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.780+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.780+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc32004d040 con 0x55d0610be070 2023-10-05T21:15:16.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.780+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc320014070 con 0x55d0610be070 2023-10-05T21:15:16.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.780+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc32004d040 con 0x7fc320016730 2023-10-05T21:15:16.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.780+0000 7fc3274e0700 1 -- 172.21.15.153:0/3870124329 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc310019040 con 0x7fc320016730 2023-10-05T21:15:16.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.780+0000 7fc3274e0700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc32004d040 con 0x55d06108dd70 2023-10-05T21:15:16.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.780+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.780+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc32004d040 con 0x7fc310007030 2023-10-05T21:15:16.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.781+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.781+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc32004d040 con 0x55d0610be070 2023-10-05T21:15:16.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.781+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc320014070 con 0x55d0610be070 2023-10-05T21:15:16.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.781+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc32004d040 con 0x7fc310007030 2023-10-05T21:15:16.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.781+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.781+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc32004d040 con 0x7fc320016730 2023-10-05T21:15:16.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.781+0000 7fc3274e0700 1 -- 172.21.15.153:0/3870124329 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc310019040 con 0x7fc320016730 2023-10-05T21:15:16.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.781+0000 7fc3274e0700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc32004d040 con 0x55d0610be070 2023-10-05T21:15:16.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.782+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc320014070 con 0x55d0610be070 2023-10-05T21:15:16.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.782+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc32004d040 con 0x7fc310007030 2023-10-05T21:15:16.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.782+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.782+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc32004d040 con 0x55d06108dd70 2023-10-05T21:15:16.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.782+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.782+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc32004d040 con 0x7fc320016730 2023-10-05T21:15:16.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.782+0000 7fc3274e0700 1 -- 172.21.15.153:0/3870124329 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc310019040 con 0x7fc320016730 2023-10-05T21:15:16.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.782+0000 7fc334c09680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:16.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.782+0000 7fc334c09680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:16.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.782+0000 7fc334c09680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:16.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.782+0000 7fc334c09680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:16.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.782+0000 7fc334c09680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.782+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c3200 con 0x55d06108dd70 2023-10-05T21:15:16.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.782+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.782+0000 7fc334c09680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.782+0000 7fc334c09680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.782+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c3600 con 0x55d0610be070 2023-10-05T21:15:16.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.783+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc320014070 con 0x55d0610be070 2023-10-05T21:15:16.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.783+0000 7fc334c09680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:16.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.783+0000 7fc334c09680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.783+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c3ea0 con 0x55d06108dd70 2023-10-05T21:15:16.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.783+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.783+0000 7fc334c09680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.783+0000 7fc334c09680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.783+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c3ea0 con 0x55d06108dd70 2023-10-05T21:15:16.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.783+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.783+0000 7fc334c09680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:16.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.783+0000 7fc334c09680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.783+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c3fa0 con 0x7fc310007030 2023-10-05T21:15:16.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.784+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.784+0000 7fc334c09680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.784+0000 7fc334c09680 20 zone default found 2023-10-05T21:15:16.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.784+0000 7fc334c09680 4 Realm: () 2023-10-05T21:15:16.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.784+0000 7fc334c09680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:16.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.784+0000 7fc334c09680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:16.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.784+0000 7fc334c09680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:16.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.784+0000 7fc334c09680 20 zonegroup default 2023-10-05T21:15:16.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.784+0000 7fc334c09680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.784+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c3fa0 con 0x7fc310007030 2023-10-05T21:15:16.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.784+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.784+0000 7fc334c09680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.784+0000 7fc334c09680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.784+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c5920 con 0x55d0610be070 2023-10-05T21:15:16.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.784+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc320014070 con 0x55d0610be070 2023-10-05T21:15:16.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.784+0000 7fc334c09680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.784+0000 7fc334c09680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.784+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c5cd0 con 0x55d0610be070 2023-10-05T21:15:16.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.784+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc320014070 con 0x55d0610be070 2023-10-05T21:15:16.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.784+0000 7fc334c09680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.784+0000 7fc334c09680 20 started sync module instance, tier type = 2023-10-05T21:15:16.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.784+0000 7fc334c09680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:16.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.784+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c4fe0 con 0x7fc320016730 2023-10-05T21:15:16.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.785+0000 7fc3274e0700 1 -- 172.21.15.153:0/3870124329 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc310019040 con 0x7fc320016730 2023-10-05T21:15:16.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.785+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94353469756384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c6570 con 0x7fc320016730 2023-10-05T21:15:16.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.785+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c6e10 con 0x55d06108dd70 2023-10-05T21:15:16.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.786+0000 7fc3274e0700 1 -- 172.21.15.153:0/3870124329 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94353469756384] v29'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc310019040 con 0x7fc320016730 2023-10-05T21:15:16.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.786+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.786+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94353469759616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c6e10 con 0x55d06108dd70 2023-10-05T21:15:16.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.786+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c79a0 con 0x55d0610be070 2023-10-05T21:15:16.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.787+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc320014070 con 0x55d0610be070 2023-10-05T21:15:16.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.787+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94353469759616] v29'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.787+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94353469764720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c8290 con 0x55d0610be070 2023-10-05T21:15:16.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.787+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c87e0 con 0x7fc320016730 2023-10-05T21:15:16.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.787+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94353469764720] v29'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc320014070 con 0x55d0610be070 2023-10-05T21:15:16.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.788+0000 7fc3274e0700 1 -- 172.21.15.153:0/3870124329 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc310019040 con 0x7fc320016730 2023-10-05T21:15:16.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.788+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94353469767072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c81f0 con 0x7fc320016730 2023-10-05T21:15:16.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.788+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c9570 con 0x55d06108dd70 2023-10-05T21:15:16.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.788+0000 7fc3274e0700 1 -- 172.21.15.153:0/3870124329 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94353469767072] v29'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc310019040 con 0x7fc320016730 2023-10-05T21:15:16.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.788+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.788+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94353469771200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c9970 con 0x55d06108dd70 2023-10-05T21:15:16.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.788+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610ca3c0 con 0x7fc310007030 2023-10-05T21:15:16.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.789+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94353469771200] v29'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.789+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.789+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94353469772304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610ca380 con 0x7fc310007030 2023-10-05T21:15:16.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.789+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610cae50 con 0x7fc310007030 2023-10-05T21:15:16.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.790+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(96 notify.6 [create] v29'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.790+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94353469778272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610cadb0 con 0x7fc310007030 2023-10-05T21:15:16.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.790+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(95 notify.5 [watch watch cookie 94353469772304] v29'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.790+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610cbed0 con 0x7fc310007030 2023-10-05T21:15:16.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.790+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94353469778272] v29'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.790+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.791+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94353469775504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610cb9a0 con 0x7fc310007030 2023-10-05T21:15:16.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.791+0000 7fc334c09680 20 add_watcher() i=0 2023-10-05T21:15:16.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.791+0000 7fc334c09680 20 add_watcher() i=1 2023-10-05T21:15:16.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.791+0000 7fc334c09680 20 add_watcher() i=2 2023-10-05T21:15:16.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.791+0000 7fc334c09680 20 add_watcher() i=3 2023-10-05T21:15:16.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.791+0000 7fc334c09680 20 add_watcher() i=4 2023-10-05T21:15:16.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.791+0000 7fc334c09680 20 add_watcher() i=5 2023-10-05T21:15:16.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.791+0000 7fc334c09680 20 add_watcher() i=6 2023-10-05T21:15:16.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.791+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94353469775504] v29'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.791+0000 7fc334c09680 20 add_watcher() i=7 2023-10-05T21:15:16.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.791+0000 7fc334c09680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:16.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.791+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610cb9a0 con 0x55d06108dd70 2023-10-05T21:15:16.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.791+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.792+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94353469780560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610cb9a0 con 0x55d06108dd70 2023-10-05T21:15:16.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.792+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94353469780560] v29'106 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.792+0000 7fc2f97e2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:16.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.792+0000 7fc334c09680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:16.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.792+0000 7fc334c09680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:16.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.792+0000 7fc334c09680 1 Processor -- start 2023-10-05T21:15:16.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.793+0000 7fc334c09680 1 -- start start 2023-10-05T21:15:16.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.793+0000 7fc334c09680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d0610d88f0 0x55d0610d8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.793+0000 7fc334c09680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0610d9310 con 0x55d0610d88f0 2023-10-05T21:15:16.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.793+0000 7fc3274e0700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d0610d88f0 0x55d0610d8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.793+0000 7fc3274e0700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d0610d88f0 0x55d0610d8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50618/0 (socket says 172.21.15.153:50618) 2023-10-05T21:15:16.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.793+0000 7fc3274e0700 1 -- 172.21.15.153:0/3164498490 learned_addr learned my addr 172.21.15.153:0/3164498490 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:16.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.793+0000 7fc3274e0700 1 -- 172.21.15.153:0/3164498490 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d0610d97f0 con 0x55d0610d88f0 2023-10-05T21:15:16.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.793+0000 7fc3274e0700 1 --2- 172.21.15.153:0/3164498490 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d0610d88f0 0x55d0610d8d00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x55d061088630 tx=0x7fc310012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a1194ffe8566b2b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.793+0000 7fc2f8fe1700 1 -- 172.21.15.153:0/3164498490 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc31001de90 con 0x55d0610d88f0 2023-10-05T21:15:16.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.794+0000 7fc2f8fe1700 1 -- 172.21.15.153:0/3164498490 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31002b440 con 0x55d0610d88f0 2023-10-05T21:15:16.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.794+0000 7fc2f8fe1700 1 -- 172.21.15.153:0/3164498490 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc31002b630 con 0x55d0610d88f0 2023-10-05T21:15:16.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.794+0000 7fc334c09680 1 -- 172.21.15.153:0/3164498490 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d0610d88f0 msgr2=0x55d0610d8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.794+0000 7fc334c09680 1 --2- 172.21.15.153:0/3164498490 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d0610d88f0 0x55d0610d8d00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x55d061088630 tx=0x7fc310012000 comp rx=0 tx=0).stop 2023-10-05T21:15:16.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.794+0000 7fc334c09680 1 -- 172.21.15.153:0/3164498490 shutdown_connections 2023-10-05T21:15:16.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.794+0000 7fc334c09680 1 --2- 172.21.15.153:0/3164498490 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d0610d88f0 0x55d0610d8d00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.794+0000 7fc334c09680 1 -- 172.21.15.153:0/3164498490 >> 172.21.15.153:0/3164498490 conn(0x55d0610d4bf0 msgr2=0x55d0610d2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.794+0000 7fc334c09680 1 -- 172.21.15.153:0/3164498490 shutdown_connections 2023-10-05T21:15:16.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.794+0000 7fc334c09680 1 -- 172.21.15.153:0/3164498490 wait complete. 2023-10-05T21:15:16.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.794+0000 7fc334c09680 1 Processor -- start 2023-10-05T21:15:16.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.795+0000 7fc334c09680 1 -- start start 2023-10-05T21:15:16.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.795+0000 7fc334c09680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d0610d88f0 0x55d0610df5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.795+0000 7fc334c09680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0610dfaf0 con 0x55d0610d88f0 2023-10-05T21:15:16.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.795+0000 7fc3274e0700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d0610d88f0 0x55d0610df5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.795+0000 7fc3274e0700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d0610d88f0 0x55d0610df5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50622/0 (socket says 172.21.15.153:50622) 2023-10-05T21:15:16.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.795+0000 7fc3274e0700 1 -- 172.21.15.153:0/2361641126 learned_addr learned my addr 172.21.15.153:0/2361641126 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:16.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.795+0000 7fc3274e0700 1 -- 172.21.15.153:0/2361641126 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d061088660 con 0x55d0610d88f0 2023-10-05T21:15:16.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.795+0000 7fc3274e0700 1 --2- 172.21.15.153:0/2361641126 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d0610d88f0 0x55d0610df5b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x55d0610d4160 tx=0x7fc310030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.795+0000 7fc272ffd700 1 -- 172.21.15.153:0/2361641126 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc31003f650 con 0x55d0610d88f0 2023-10-05T21:15:16.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.795+0000 7fc272ffd700 1 -- 172.21.15.153:0/2361641126 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31003f7d0 con 0x55d0610d88f0 2023-10-05T21:15:16.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.795+0000 7fc334c09680 1 -- 172.21.15.153:0/2361641126 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d0610dfcf0 con 0x55d0610d88f0 2023-10-05T21:15:16.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.795+0000 7fc272ffd700 1 -- 172.21.15.153:0/2361641126 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc31003f980 con 0x55d0610d88f0 2023-10-05T21:15:16.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.796+0000 7fc334c09680 1 -- 172.21.15.153:0/2361641126 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d0610e01a0 con 0x55d0610d88f0 2023-10-05T21:15:16.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.796+0000 7fc272ffd700 1 -- 172.21.15.153:0/2361641126 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fc310047070 con 0x55d0610d88f0 2023-10-05T21:15:16.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.796+0000 7fc272ffd700 1 --2- 172.21.15.153:0/2361641126 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc2680340f0 0x7fc2680365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.796+0000 7fc272ffd700 1 -- 172.21.15.153:0/2361641126 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fc310030070 con 0x55d0610d88f0 2023-10-05T21:15:16.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.796+0000 7fc3284e2700 1 --2- 172.21.15.153:0/2361641126 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc2680340f0 0x7fc2680365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.796+0000 7fc334c09680 5 note: GC not initialized 2023-10-05T21:15:16.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.797+0000 7fc3284e2700 1 --2- 172.21.15.153:0/2361641126 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc2680340f0 0x7fc2680365a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x55d0610cbf40 tx=0x7fc318037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.797+0000 7fc267fff700 20 reqs_thread_entry: start 2023-10-05T21:15:16.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.798+0000 7fc265ffb700 20 reqs_thread_entry: start 2023-10-05T21:15:16.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.798+0000 7fc334c09680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:16.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.798+0000 7fc334c09680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:16.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.798+0000 7fc253fff700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:47 2023 2023-10-05T21:15:16.833 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:16.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.798+0000 7fc2537fe700 20 reqs_thread_entry: start 2023-10-05T21:15:16.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.798+0000 7fc334c09680 20 get_system_obj_state: rctx=0x7ffd073ad2e8 obj=default.rgw.meta:users.uid:fud state=0x55d060f3a240 s->prefetch_data=0 2023-10-05T21:15:16.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.798+0000 7fc334c09680 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2023-10-05T21:15:16.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.798+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d061144e70 con 0x7fc310007030 2023-10-05T21:15:16.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.798+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(102 fud [call,getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.798+0000 7fc334c09680 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2023-10-05T21:15:16.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.798+0000 7fc334c09680 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T21:15:16.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.798+0000 7fc334c09680 20 get_system_obj_state: rctx=0x7ffd073acfd8 obj=default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ state=0x55d060f3a240 s->prefetch_data=0 2023-10-05T21:15:16.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.798+0000 7fc334c09680 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2023-10-05T21:15:16.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.798+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:103 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d061143e60 con 0x7fc310007030 2023-10-05T21:15:16.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.798+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(103 p5YnriCv1nAtykxBrupQ [getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.798+0000 7fc334c09680 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2023-10-05T21:15:16.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.798+0000 7fc334c09680 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-10-05T21:15:16.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.798+0000 7fc334c09680 20 get_system_obj_state: rctx=0x7ffd073ac868 obj=default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ state=0x55d060f3a240 s->prefetch_data=0 2023-10-05T21:15:16.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.798+0000 7fc334c09680 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2023-10-05T21:15:16.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.799+0000 7fc334c09680 20 get_system_obj_state: rctx=0x7ffd073acf18 obj=default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ state=0x55d060f3a240 s->prefetch_data=0 2023-10-05T21:15:16.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.799+0000 7fc334c09680 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2023-10-05T21:15:16.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.799+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:104 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0611476e0 con 0x7fc310007030 2023-10-05T21:15:16.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.799+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(104 fud [delete,create,call,writefull 0~346] v29'1 uv1 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.799+0000 7fc334c09680 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2023-10-05T21:15:16.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.799+0000 7fc334c09680 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T21:15:16.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.799+0000 7fc334c09680 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2023-10-05T21:15:16.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.799+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:105 7.3 7:c609908c:::notify.5:head [notify cookie 94353470288080 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0611483c0 con 0x7fc310007030 2023-10-05T21:15:16.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.800+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== watch-notify(notify (1) cookie 94353469772304 notify 124554051595 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x7fc31802d040 con 0x7fc310007030 2023-10-05T21:15:16.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.800+0000 7fc325cdd700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051595 cookie 94353469772304 notifier 4442 bl.length()=522 2023-10-05T21:15:16.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.800+0000 7fc325cdd700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2023-10-05T21:15:16.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.800+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 31 ==== osd_op_reply(105 notify.5 [notify cookie 94353470288080 out=8b] v0'0 uv108 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.800+0000 7fc325cdd700 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T21:15:16.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.800+0000 7fc325cdd700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc30c003d90 con 0x7fc310007030 2023-10-05T21:15:16.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.800+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 32 ==== osd_op_reply(106 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.800+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 33 ==== watch-notify(notify_complete (2) cookie 94353470288080 notify 124554051595 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fc318015430 con 0x7fc310007030 2023-10-05T21:15:16.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.800+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:107 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0611470d0 con 0x7fc310007030 2023-10-05T21:15:16.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.801+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 34 ==== osd_op_reply(107 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v29'3 uv3 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.801+0000 7fc334c09680 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2023-10-05T21:15:16.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.801+0000 7fc334c09680 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-10-05T21:15:16.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.801+0000 7fc334c09680 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2023-10-05T21:15:16.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.801+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [notify cookie 94353470288080 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d061148800 con 0x55d0610be070 2023-10-05T21:15:16.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.801+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== watch-notify(notify (1) cookie 94353469764720 notify 124554051587 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x55d0610b0840 con 0x55d0610be070 2023-10-05T21:15:16.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.801+0000 7fc325cdd700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051587 cookie 94353469764720 notifier 4442 bl.length()=177 2023-10-05T21:15:16.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.801+0000 7fc325cdd700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2023-10-05T21:15:16.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.801+0000 7fc325cdd700 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-10-05T21:15:16.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.801+0000 7fc325cdd700 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:109 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc30c003d90 con 0x55d0610be070 2023-10-05T21:15:16.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.801+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(108 notify.2 [notify cookie 94353470288080 out=8b] v0'0 uv108 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc320014070 con 0x55d0610be070 2023-10-05T21:15:16.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.801+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(109 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc320014070 con 0x55d0610be070 2023-10-05T21:15:16.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.801+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== watch-notify(notify_complete (2) cookie 94353470288080 notify 124554051587 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d0610b03f0 con 0x55d0610be070 2023-10-05T21:15:16.838 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:16.838 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "fud", 2023-10-05T21:15:16.839 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Fud", 2023-10-05T21:15:16.839 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "", 2023-10-05T21:15:16.839 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2023-10-05T21:15:16.839 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 1, 2023-10-05T21:15:16.839 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [], 2023-10-05T21:15:16.839 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2023-10-05T21:15:16.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:16.840 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "fud", 2023-10-05T21:15:16.840 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "p5YnriCv1nAtykxBrupQ", 2023-10-05T21:15:16.840 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh" 2023-10-05T21:15:16.840 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:16.840 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:16.840 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [], 2023-10-05T21:15:16.840 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2023-10-05T21:15:16.841 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2023-10-05T21:15:16.841 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2023-10-05T21:15:16.841 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2023-10-05T21:15:16.841 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2023-10-05T21:15:16.841 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:15:16.841 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:16.841 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:16.841 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:16.842 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:16.842 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:16.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:16.842 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2023-10-05T21:15:16.842 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:16.842 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:16.842 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:16.843 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:16.843 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:16.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:16.843 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2023-10-05T21:15:16.843 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2023-10-05T21:15:16.843 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [] 2023-10-05T21:15:16.843 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:16.843 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:15:16.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.802+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:110 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94353469756384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d061103660 con 0x7fc320016730 2023-10-05T21:15:16.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.802+0000 7fc3274e0700 1 -- 172.21.15.153:0/3870124329 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(110 notify.0 [watch unwatch cookie 94353469756384] v29'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc310033040 con 0x7fc320016730 2023-10-05T21:15:16.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.802+0000 7fc334c09680 20 remove_watcher() i=0 2023-10-05T21:15:16.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.802+0000 7fc334c09680 2 removed watcher, disabling cache 2023-10-05T21:15:16.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.802+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:111 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94353469759616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c53e0 con 0x55d06108dd70 2023-10-05T21:15:16.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.803+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(111 notify.1 [watch unwatch cookie 94353469759616] v29'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.803+0000 7fc334c09680 20 remove_watcher() i=1 2023-10-05T21:15:16.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.803+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:112 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94353469764720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c6080 con 0x55d0610be070 2023-10-05T21:15:16.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.804+0000 7fc327ce1700 1 -- 172.21.15.153:0/3870124329 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(112 notify.2 [watch unwatch cookie 94353469764720] v29'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc320014070 con 0x55d0610be070 2023-10-05T21:15:16.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.804+0000 7fc334c09680 20 remove_watcher() i=2 2023-10-05T21:15:16.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.804+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:113 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94353469767072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c6080 con 0x7fc320016730 2023-10-05T21:15:16.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.805+0000 7fc3274e0700 1 -- 172.21.15.153:0/3870124329 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(113 notify.3 [watch unwatch cookie 94353469767072] v29'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc310033040 con 0x7fc320016730 2023-10-05T21:15:16.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.805+0000 7fc334c09680 20 remove_watcher() i=3 2023-10-05T21:15:16.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.805+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:114 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94353469771200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c6080 con 0x55d06108dd70 2023-10-05T21:15:16.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.806+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(114 notify.4 [watch unwatch cookie 94353469771200] v29'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.806+0000 7fc334c09680 20 remove_watcher() i=4 2023-10-05T21:15:16.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.806+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:115 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94353469772304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c8dc0 con 0x7fc310007030 2023-10-05T21:15:16.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.806+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 35 ==== osd_op_reply(115 notify.5 [watch unwatch cookie 94353469772304] v29'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.806+0000 7fc334c09680 20 remove_watcher() i=5 2023-10-05T21:15:16.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.806+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:116 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94353469778272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c6080 con 0x7fc310007030 2023-10-05T21:15:16.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.807+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 36 ==== osd_op_reply(116 notify.6 [watch unwatch cookie 94353469778272] v29'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.807+0000 7fc334c09680 20 remove_watcher() i=6 2023-10-05T21:15:16.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.807+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:117 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94353469775504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610ca960 con 0x7fc310007030 2023-10-05T21:15:16.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.808+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.0 v2:172.21.15.111:6800/111394 37 ==== osd_op_reply(117 notify.7 [watch unwatch cookie 94353469775504] v29'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc31800a570 con 0x7fc310007030 2023-10-05T21:15:16.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.808+0000 7fc334c09680 20 remove_watcher() i=7 2023-10-05T21:15:16.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.808+0000 7fc2f97e2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:16.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.808+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:118 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94353469780560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d0610c9e90 con 0x55d06108dd70 2023-10-05T21:15:16.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.809+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(118 data_loggenerations_metadata [watch unwatch cookie 94353469780560] v29'107 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc31800a570 con 0x55d06108dd70 2023-10-05T21:15:16.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.809+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc310007030 msgr2=0x7fc31001d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.809+0000 7fc334c09680 1 --2- 172.21.15.153:0/3870124329 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc310007030 0x7fc31001d420 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.809+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d06108dd70 msgr2=0x55d0610bbc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.809+0000 7fc334c09680 1 --2- 172.21.15.153:0/3870124329 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d06108dd70 0x55d0610bbc00 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.809+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc320016730 msgr2=0x7fc3200235f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.809+0000 7fc334c09680 1 --2- 172.21.15.153:0/3870124329 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc320016730 0x7fc3200235f0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.809+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d0610be070 msgr2=0x55d0610c0450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.809+0000 7fc334c09680 1 --2- 172.21.15.153:0/3870124329 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d0610be070 0x55d0610c0450 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.809+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc308034140 msgr2=0x7fc3080365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.809+0000 7fc334c09680 1 --2- 172.21.15.153:0/3870124329 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc308034140 0x7fc3080365f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc310003080 tx=0x7fc310015000 comp rx=0 tx=0).stop 2023-10-05T21:15:16.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.809+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d061087a80 msgr2=0x55d0610afeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.809+0000 7fc3284e2700 1 -- 172.21.15.153:0/3870124329 reap_dead start 2023-10-05T21:15:16.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.809+0000 7fc334c09680 1 --2- 172.21.15.153:0/3870124329 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d061087a80 0x55d0610afeb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc3200017d0 tx=0x7fc320016000 comp rx=0 tx=0).stop 2023-10-05T21:15:16.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.809+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 shutdown_connections 2023-10-05T21:15:16.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.809+0000 7fc334c09680 1 --2- 172.21.15.153:0/3870124329 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d061087a80 0x55d0610afeb0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.809+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 >> 172.21.15.153:0/3870124329 conn(0x55d061081340 msgr2=0x55d0610a2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.810+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 shutdown_connections 2023-10-05T21:15:16.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.810+0000 7fc334c09680 1 -- 172.21.15.153:0/3870124329 wait complete. 2023-10-05T21:15:16.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.810+0000 7fc334c09680 1 -- 172.21.15.153:0/2361641126 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc2680340f0 msgr2=0x7fc2680365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.810+0000 7fc334c09680 1 --2- 172.21.15.153:0/2361641126 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc2680340f0 0x7fc2680365a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x55d0610cbf40 tx=0x7fc318037450 comp rx=0 tx=0).stop 2023-10-05T21:15:16.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.810+0000 7fc334c09680 1 -- 172.21.15.153:0/2361641126 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d0610d88f0 msgr2=0x55d0610df5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.810+0000 7fc334c09680 1 --2- 172.21.15.153:0/2361641126 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d0610d88f0 0x55d0610df5b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x55d0610d4160 tx=0x7fc310030000 comp rx=0 tx=0).stop 2023-10-05T21:15:16.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.810+0000 7fc334c09680 1 -- 172.21.15.153:0/2361641126 shutdown_connections 2023-10-05T21:15:16.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.810+0000 7fc334c09680 1 --2- 172.21.15.153:0/2361641126 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc2680340f0 0x7fc2680365a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.810+0000 7fc334c09680 1 --2- 172.21.15.153:0/2361641126 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d0610d88f0 0x55d0610df5b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.810+0000 7fc334c09680 1 -- 172.21.15.153:0/2361641126 >> 172.21.15.153:0/2361641126 conn(0x55d0610d4bf0 msgr2=0x55d0610d2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.810+0000 7fc334c09680 1 -- 172.21.15.153:0/2361641126 shutdown_connections 2023-10-05T21:15:16.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.810+0000 7fc334c09680 1 -- 172.21.15.153:0/2361641126 wait complete. 2023-10-05T21:15:16.856 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:15:16.861 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2023-10-05T21:15:16.864 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T21:15:16.864 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2023-10-05T21:15:16.865 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2023-10-05T21:15:16.865 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2023-10-05T21:15:16.908 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:16.908 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:16.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.907+0000 7f872f9f9680 1 Processor -- start 2023-10-05T21:15:16.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.907+0000 7f872f9f9680 1 -- start start 2023-10-05T21:15:16.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.908+0000 7f872f9f9680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5633990467e0 0x563399048bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.908+0000 7f872f9f9680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563398f90990 con 0x5633990422b0 2023-10-05T21:15:16.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.908+0000 7f872f9f9680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x563398f50db0 con 0x5633990467e0 2023-10-05T21:15:16.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.908+0000 7f87222d0700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5633990467e0 0x563399048bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.908+0000 7f8722ad1700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x5633990422b0 0x5633990426c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56472/0 (socket says 172.21.15.153:56472) 2023-10-05T21:15:16.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.908+0000 7f8722ad1700 1 -- 172.21.15.153:0/3760243745 learned_addr learned my addr 172.21.15.153:0/3760243745 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:16.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.908+0000 7f8721acf700 1 -- 172.21.15.153:0/3760243745 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2084396708 0 0) 0x563398f90990 con 0x5633990422b0 2023-10-05T21:15:16.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.908+0000 7f8721acf700 1 -- 172.21.15.153:0/3760243745 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f870c001e10 con 0x5633990422b0 2023-10-05T21:15:16.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.908+0000 7f87222d0700 1 -- 172.21.15.153:0/3760243745 >> v1:172.21.15.111:6789/0 conn(0x5633990422b0 legacy=0x5633990426c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.908+0000 7f87222d0700 1 -- 172.21.15.153:0/3760243745 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56339904a110 con 0x5633990467e0 2023-10-05T21:15:16.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.908+0000 7f87222d0700 1 --2- 172.21.15.153:0/3760243745 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5633990467e0 0x563399048bc0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f871800a5d0 tx=0x7f8718005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd06128d3f786eb server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.908+0000 7f8721acf700 1 -- 172.21.15.153:0/3760243745 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8718007610 con 0x5633990467e0 2023-10-05T21:15:16.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.909+0000 7f8721acf700 1 -- 172.21.15.153:0/3760243745 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8718007770 con 0x5633990467e0 2023-10-05T21:15:16.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.909+0000 7f8721acf700 1 -- 172.21.15.153:0/3760243745 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8718007a40 con 0x5633990467e0 2023-10-05T21:15:16.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.909+0000 7f872f9f9680 1 -- 172.21.15.153:0/3760243745 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5633990467e0 msgr2=0x563399048bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.909+0000 7f872f9f9680 1 --2- 172.21.15.153:0/3760243745 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5633990467e0 0x563399048bc0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f871800a5d0 tx=0x7f8718005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:16.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.909+0000 7f872f9f9680 1 -- 172.21.15.153:0/3760243745 shutdown_connections 2023-10-05T21:15:16.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.909+0000 7f872f9f9680 1 --2- 172.21.15.153:0/3760243745 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5633990467e0 0x563399048bc0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.909+0000 7f872f9f9680 1 -- 172.21.15.153:0/3760243745 >> 172.21.15.153:0/3760243745 conn(0x56339903db80 msgr2=0x56339903ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.909+0000 7f872f9f9680 1 -- 172.21.15.153:0/3760243745 shutdown_connections 2023-10-05T21:15:16.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.909+0000 7f872f9f9680 1 -- 172.21.15.153:0/3760243745 wait complete. 2023-10-05T21:15:16.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.910+0000 7f872f9f9680 1 Processor -- start 2023-10-05T21:15:16.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.910+0000 7f872f9f9680 1 -- start start 2023-10-05T21:15:16.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.910+0000 7f872f9f9680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5633990422b0 0x5633990615d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.910+0000 7f872f9f9680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x563398ef0ea0 con 0x5633990422b0 2023-10-05T21:15:16.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.910+0000 7f8722ad1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5633990422b0 0x5633990615d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.910+0000 7f8722ad1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5633990422b0 0x5633990615d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50636/0 (socket says 172.21.15.153:50636) 2023-10-05T21:15:16.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.910+0000 7f8722ad1700 1 -- 172.21.15.153:0/2493067079 learned_addr learned my addr 172.21.15.153:0/2493067079 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:16.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.910+0000 7f8722ad1700 1 -- 172.21.15.153:0/2493067079 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8718005cf0 con 0x5633990422b0 2023-10-05T21:15:16.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.910+0000 7f8722ad1700 1 --2- 172.21.15.153:0/2493067079 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5633990422b0 0x5633990615d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8714001bf0 tx=0x7f8714001820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf126989a78f5bc server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.911+0000 7f8720acd700 1 -- 172.21.15.153:0/2493067079 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8714010070 con 0x5633990422b0 2023-10-05T21:15:16.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.911+0000 7f8720acd700 1 -- 172.21.15.153:0/2493067079 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871400bd80 con 0x5633990422b0 2023-10-05T21:15:16.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.911+0000 7f8720acd700 1 -- 172.21.15.153:0/2493067079 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f871400b2b0 con 0x5633990422b0 2023-10-05T21:15:16.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.911+0000 7f872f9f9680 1 -- 172.21.15.153:0/2493067079 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5633990422b0 msgr2=0x5633990615d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.911+0000 7f872f9f9680 1 --2- 172.21.15.153:0/2493067079 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5633990422b0 0x5633990615d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8714001bf0 tx=0x7f8714001820 comp rx=0 tx=0).stop 2023-10-05T21:15:16.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.911+0000 7f872f9f9680 1 -- 172.21.15.153:0/2493067079 shutdown_connections 2023-10-05T21:15:16.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.911+0000 7f872f9f9680 1 --2- 172.21.15.153:0/2493067079 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5633990422b0 0x5633990615d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.911+0000 7f872f9f9680 1 -- 172.21.15.153:0/2493067079 >> 172.21.15.153:0/2493067079 conn(0x56339903db80 msgr2=0x56339905d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.911+0000 7f872f9f9680 1 -- 172.21.15.153:0/2493067079 shutdown_connections 2023-10-05T21:15:16.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.911+0000 7f872f9f9680 1 -- 172.21.15.153:0/2493067079 wait complete. 2023-10-05T21:15:16.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.911+0000 7f872f9f9680 1 Processor -- start 2023-10-05T21:15:16.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.911+0000 7f872f9f9680 1 -- start start 2023-10-05T21:15:16.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.912+0000 7f872f9f9680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5633990422b0 0x5633990679e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.912+0000 7f872f9f9680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x563398ee7c80 con 0x5633990422b0 2023-10-05T21:15:16.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.912+0000 7f8722ad1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5633990422b0 0x5633990679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.912+0000 7f8722ad1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5633990422b0 0x5633990679e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50642/0 (socket says 172.21.15.153:50642) 2023-10-05T21:15:16.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.912+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 learned_addr learned my addr 172.21.15.153:0/3946603443 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:16.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.912+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c001e10 con 0x5633990422b0 2023-10-05T21:15:16.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.912+0000 7f8722ad1700 1 --2- 172.21.15.153:0/3946603443 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5633990422b0 0x5633990679e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8714011000 tx=0x7f8714016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.912+0000 7f8712ffd700 1 -- 172.21.15.153:0/3946603443 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f871401d070 con 0x5633990422b0 2023-10-05T21:15:16.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.912+0000 7f8712ffd700 1 -- 172.21.15.153:0/3946603443 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871401b030 con 0x5633990422b0 2023-10-05T21:15:16.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.912+0000 7f8712ffd700 1 -- 172.21.15.153:0/3946603443 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8714009d10 con 0x5633990422b0 2023-10-05T21:15:16.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.912+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563399067f20 con 0x5633990422b0 2023-10-05T21:15:16.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.913+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563399068370 con 0x5633990422b0 2023-10-05T21:15:16.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.913+0000 7f8712ffd700 1 -- 172.21.15.153:0/3946603443 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f8714016430 con 0x5633990422b0 2023-10-05T21:15:16.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.913+0000 7f872f9f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.913+0000 7f8712ffd700 1 --2- 172.21.15.153:0/3946603443 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f87080340f0 0x7f87080365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.914+0000 7f8712ffd700 1 -- 172.21.15.153:0/3946603443 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f8714049a00 con 0x5633990422b0 2023-10-05T21:15:16.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.914+0000 7f87222d0700 1 --2- 172.21.15.153:0/3946603443 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f87080340f0 0x7f87080365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.914+0000 7f872f9f9680 1 --2- 172.21.15.153:0/3946603443 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5633990467e0 0x563399073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.914+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399073ea0 con 0x5633990467e0 2023-10-05T21:15:16.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.914+0000 7f87232d2700 1 --2- 172.21.15.153:0/3946603443 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5633990467e0 0x563399073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.914+0000 7f87222d0700 1 --2- 172.21.15.153:0/3946603443 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f87080340f0 0x7f87080365a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f871800afd0 tx=0x7f8718014000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.914+0000 7f87232d2700 1 --2- 172.21.15.153:0/3946603443 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5633990467e0 0x563399073710 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.914+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.914+0000 7f872f9f9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.914+0000 7f872f9f9680 20 realm 2023-10-05T21:15:16.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.914+0000 7f872f9f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.914+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399070cf0 con 0x5633990467e0 2023-10-05T21:15:16.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.915+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.915+0000 7f872f9f9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.915+0000 7f872f9f9680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:16.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.915+0000 7f872f9f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.915+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5633990749a0 con 0x5633990467e0 2023-10-05T21:15:16.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.915+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.915+0000 7f872f9f9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.915+0000 7f872f9f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.915+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5633990752c0 con 0x5633990467e0 2023-10-05T21:15:16.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.915+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.915+0000 7f872f9f9680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.915+0000 7f872f9f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.915+0000 7f872f9f9680 1 --2- 172.21.15.153:0/3946603443 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x563399075b80 0x563399077f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.915+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399078530 con 0x563399075b80 2023-10-05T21:15:16.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.915+0000 7f8722ad1700 1 --2- 172.21.15.153:0/3946603443 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x563399075b80 0x563399077f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.916+0000 7f8722ad1700 1 --2- 172.21.15.153:0/3946603443 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x563399075b80 0x563399077f60 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.916+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f8714020070 con 0x563399075b80 2023-10-05T21:15:16.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.916+0000 7f872f9f9680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:16.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.916+0000 7f872f9f9680 20 searching for the correct realm 2023-10-05T21:15:16.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.916+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x563399075b80 2023-10-05T21:15:16.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.916+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8714020070 con 0x563399075b80 2023-10-05T21:15:16.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.916+0000 7f8722ad1700 1 --2- 172.21.15.153:0/3946603443 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f8714013350 0x7f8714049350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.916+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x7f8714013350 2023-10-05T21:15:16.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.916+0000 7f87222d0700 1 --2- 172.21.15.153:0/3946603443 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f8714013350 0x7f8714049350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.916+0000 7f87222d0700 1 --2- 172.21.15.153:0/3946603443 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f8714013350 0x7f8714049350 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.917+0000 7f87222d0700 1 -- 172.21.15.153:0/3946603443 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8718007ce0 con 0x7f8714013350 2023-10-05T21:15:16.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.917+0000 7f87222d0700 1 --2- 172.21.15.153:0/3946603443 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f8718007030 0x7f871801d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.917+0000 7f87222d0700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x7f8718007030 2023-10-05T21:15:16.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.917+0000 7f87232d2700 1 --2- 172.21.15.153:0/3946603443 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f8718007030 0x7f871801d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.917+0000 7f87232d2700 1 --2- 172.21.15.153:0/3946603443 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f8718007030 0x7f871801d430 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.918+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f871c00a570 con 0x7f8718007030 2023-10-05T21:15:16.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.918+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x5633990467e0 2023-10-05T21:15:16.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.918+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.918+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x5633990467e0 2023-10-05T21:15:16.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.918+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.918+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x7f8718007030 2023-10-05T21:15:16.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.918+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f871c00a570 con 0x7f8718007030 2023-10-05T21:15:16.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.918+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x7f8718007030 2023-10-05T21:15:16.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.918+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f871c00a570 con 0x7f8718007030 2023-10-05T21:15:16.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.918+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x7f8714013350 2023-10-05T21:15:16.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.919+0000 7f87222d0700 1 -- 172.21.15.153:0/3946603443 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8718029040 con 0x7f8714013350 2023-10-05T21:15:16.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.919+0000 7f87222d0700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x563399075b80 2023-10-05T21:15:16.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.919+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f8714020070 con 0x563399075b80 2023-10-05T21:15:16.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.919+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x5633990467e0 2023-10-05T21:15:16.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.919+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.919+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x7f8718007030 2023-10-05T21:15:16.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.920+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f871c00a570 con 0x7f8718007030 2023-10-05T21:15:16.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.920+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x5633990467e0 2023-10-05T21:15:16.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.920+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.920+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x7f8714013350 2023-10-05T21:15:16.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.920+0000 7f87222d0700 1 -- 172.21.15.153:0/3946603443 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8718029040 con 0x7f8714013350 2023-10-05T21:15:16.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.920+0000 7f87222d0700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x563399075b80 2023-10-05T21:15:16.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.920+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8714020070 con 0x563399075b80 2023-10-05T21:15:16.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.920+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x563399075b80 2023-10-05T21:15:16.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.920+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8714020070 con 0x563399075b80 2023-10-05T21:15:16.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.921+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x7f8718007030 2023-10-05T21:15:16.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.921+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f871c00a570 con 0x7f8718007030 2023-10-05T21:15:16.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.921+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x563399075b80 2023-10-05T21:15:16.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.921+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8714020070 con 0x563399075b80 2023-10-05T21:15:16.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.921+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x563399075b80 2023-10-05T21:15:16.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.921+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8714020070 con 0x563399075b80 2023-10-05T21:15:16.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.921+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x5633990467e0 2023-10-05T21:15:16.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.921+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.921+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x5633990467e0 2023-10-05T21:15:16.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.922+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.922+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x7f8718007030 2023-10-05T21:15:16.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.922+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f871c00a570 con 0x7f8718007030 2023-10-05T21:15:16.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.922+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x563399075b80 2023-10-05T21:15:16.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.922+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8714020070 con 0x563399075b80 2023-10-05T21:15:16.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.922+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x7f8714013350 2023-10-05T21:15:16.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.923+0000 7f87222d0700 1 -- 172.21.15.153:0/3946603443 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8718029040 con 0x7f8714013350 2023-10-05T21:15:16.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.923+0000 7f87222d0700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x5633990467e0 2023-10-05T21:15:16.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.923+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.923+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x7f8718007030 2023-10-05T21:15:16.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.923+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f871c00a570 con 0x7f8718007030 2023-10-05T21:15:16.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.923+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x563399075b80 2023-10-05T21:15:16.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.923+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8714020070 con 0x563399075b80 2023-10-05T21:15:16.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.923+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x7f8718007030 2023-10-05T21:15:16.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.924+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f871c00a570 con 0x7f8718007030 2023-10-05T21:15:16.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.924+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x7f8714013350 2023-10-05T21:15:16.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.924+0000 7f87222d0700 1 -- 172.21.15.153:0/3946603443 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8718029040 con 0x7f8714013350 2023-10-05T21:15:16.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.924+0000 7f87222d0700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x563399075b80 2023-10-05T21:15:16.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.924+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8714020070 con 0x563399075b80 2023-10-05T21:15:16.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.924+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x7f8718007030 2023-10-05T21:15:16.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.924+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f871c00a570 con 0x7f8718007030 2023-10-05T21:15:16.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.924+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x5633990467e0 2023-10-05T21:15:16.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.925+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.925+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079e50 con 0x7f8714013350 2023-10-05T21:15:16.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.925+0000 7f87222d0700 1 -- 172.21.15.153:0/3946603443 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8718029040 con 0x7f8714013350 2023-10-05T21:15:16.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.925+0000 7f872f9f9680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:16.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.925+0000 7f872f9f9680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:16.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.925+0000 7f872f9f9680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:16.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.925+0000 7f872f9f9680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:16.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.925+0000 7f872f9f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.925+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399078fc0 con 0x5633990467e0 2023-10-05T21:15:16.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.925+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.925+0000 7f872f9f9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.925+0000 7f872f9f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.925+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079450 con 0x5633990467e0 2023-10-05T21:15:16.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.925+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.925+0000 7f872f9f9680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.925+0000 7f872f9f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.925+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079880 con 0x5633990467e0 2023-10-05T21:15:16.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.926+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.926+0000 7f872f9f9680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:16.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.926+0000 7f872f9f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.926+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56339907a200 con 0x563399075b80 2023-10-05T21:15:16.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.926+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f8714020070 con 0x563399075b80 2023-10-05T21:15:16.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.926+0000 7f872f9f9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.926+0000 7f872f9f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.926+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399078b00 con 0x5633990467e0 2023-10-05T21:15:16.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.926+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.926+0000 7f872f9f9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.926+0000 7f872f9f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.926+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56339907aaf0 con 0x5633990467e0 2023-10-05T21:15:16.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.926+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.926+0000 7f872f9f9680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.926+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56339907bb00 con 0x563399075b80 2023-10-05T21:15:16.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.926+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8714020070 con 0x563399075b80 2023-10-05T21:15:16.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.926+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56339907bb00 con 0x7f8714013350 2023-10-05T21:15:16.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.927+0000 7f87222d0700 1 -- 172.21.15.153:0/3946603443 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8718029040 con 0x7f8714013350 2023-10-05T21:15:16.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.927+0000 7f87222d0700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56339907bb00 con 0x7f8718007030 2023-10-05T21:15:16.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.927+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f871c00a570 con 0x7f8718007030 2023-10-05T21:15:16.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.927+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079880 con 0x5633990467e0 2023-10-05T21:15:16.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.927+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.927+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079880 con 0x5633990467e0 2023-10-05T21:15:16.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.927+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.927+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079880 con 0x7f8718007030 2023-10-05T21:15:16.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.928+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f871c00a570 con 0x7f8718007030 2023-10-05T21:15:16.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.928+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079880 con 0x7f8718007030 2023-10-05T21:15:16.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.928+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f871c00a570 con 0x7f8718007030 2023-10-05T21:15:16.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.928+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079880 con 0x7f8714013350 2023-10-05T21:15:16.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.928+0000 7f87222d0700 1 -- 172.21.15.153:0/3946603443 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8718029040 con 0x7f8714013350 2023-10-05T21:15:16.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.928+0000 7f87222d0700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079880 con 0x563399075b80 2023-10-05T21:15:16.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.929+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f8714020070 con 0x563399075b80 2023-10-05T21:15:16.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.929+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079880 con 0x5633990467e0 2023-10-05T21:15:16.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.929+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.929+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079880 con 0x7f8718007030 2023-10-05T21:15:16.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.929+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f871c00a570 con 0x7f8718007030 2023-10-05T21:15:16.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.929+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079880 con 0x5633990467e0 2023-10-05T21:15:16.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.929+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.929+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079880 con 0x7f8714013350 2023-10-05T21:15:16.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.929+0000 7f87222d0700 1 -- 172.21.15.153:0/3946603443 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8718029040 con 0x7f8714013350 2023-10-05T21:15:16.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.929+0000 7f87222d0700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079880 con 0x563399075b80 2023-10-05T21:15:16.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.930+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8714020070 con 0x563399075b80 2023-10-05T21:15:16.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.930+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079880 con 0x563399075b80 2023-10-05T21:15:16.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.930+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8714020070 con 0x563399075b80 2023-10-05T21:15:16.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.930+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079880 con 0x7f8718007030 2023-10-05T21:15:16.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.930+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f871c00a570 con 0x7f8718007030 2023-10-05T21:15:16.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.930+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079880 con 0x563399075b80 2023-10-05T21:15:16.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.930+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8714020070 con 0x563399075b80 2023-10-05T21:15:16.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.930+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079880 con 0x563399075b80 2023-10-05T21:15:16.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.930+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8714051040 con 0x563399075b80 2023-10-05T21:15:16.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.930+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079880 con 0x5633990467e0 2023-10-05T21:15:16.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.931+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.931+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079880 con 0x5633990467e0 2023-10-05T21:15:16.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.931+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.931+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079880 con 0x7f8718007030 2023-10-05T21:15:16.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.931+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f871c00a570 con 0x7f8718007030 2023-10-05T21:15:16.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.931+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079880 con 0x563399075b80 2023-10-05T21:15:16.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.931+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8714051040 con 0x563399075b80 2023-10-05T21:15:16.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.931+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079880 con 0x7f8714013350 2023-10-05T21:15:16.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.931+0000 7f87222d0700 1 -- 172.21.15.153:0/3946603443 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8718029040 con 0x7f8714013350 2023-10-05T21:15:16.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.931+0000 7f87222d0700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079880 con 0x5633990467e0 2023-10-05T21:15:16.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.932+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.932+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079880 con 0x7f8718007030 2023-10-05T21:15:16.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.932+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f871c00a570 con 0x7f8718007030 2023-10-05T21:15:16.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.932+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079880 con 0x563399075b80 2023-10-05T21:15:16.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.932+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8714051040 con 0x563399075b80 2023-10-05T21:15:16.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.932+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079880 con 0x7f8718007030 2023-10-05T21:15:16.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.932+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f871c00a570 con 0x7f8718007030 2023-10-05T21:15:16.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.932+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079880 con 0x7f8714013350 2023-10-05T21:15:16.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.933+0000 7f87222d0700 1 -- 172.21.15.153:0/3946603443 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8718029040 con 0x7f8714013350 2023-10-05T21:15:16.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.933+0000 7f87222d0700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079880 con 0x563399075b80 2023-10-05T21:15:16.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.933+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8714051040 con 0x563399075b80 2023-10-05T21:15:16.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.933+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079880 con 0x7f8718007030 2023-10-05T21:15:16.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.933+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f871c00a570 con 0x7f8718007030 2023-10-05T21:15:16.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.933+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079880 con 0x5633990467e0 2023-10-05T21:15:16.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.933+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.933+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399079880 con 0x7f8714013350 2023-10-05T21:15:16.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.933+0000 7f87222d0700 1 -- 172.21.15.153:0/3946603443 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8718029040 con 0x7f8714013350 2023-10-05T21:15:16.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.934+0000 7f872f9f9680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:16.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.934+0000 7f872f9f9680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:16.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.934+0000 7f872f9f9680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:16.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.934+0000 7f872f9f9680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:16.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.934+0000 7f872f9f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.934+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56339907aaf0 con 0x5633990467e0 2023-10-05T21:15:16.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.934+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.934+0000 7f872f9f9680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.934+0000 7f872f9f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.934+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56339907aea0 con 0x563399075b80 2023-10-05T21:15:16.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.934+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f8714051040 con 0x563399075b80 2023-10-05T21:15:16.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.934+0000 7f872f9f9680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:16.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.934+0000 7f872f9f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.934+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56339907b250 con 0x5633990467e0 2023-10-05T21:15:16.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.934+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.934+0000 7f872f9f9680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:16.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.934+0000 7f872f9f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.934+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56339907b250 con 0x5633990467e0 2023-10-05T21:15:16.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.935+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.935+0000 7f872f9f9680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:16.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.935+0000 7f872f9f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.935+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56339907b690 con 0x7f8718007030 2023-10-05T21:15:16.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.935+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f871c00a570 con 0x7f8718007030 2023-10-05T21:15:16.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.935+0000 7f872f9f9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.935+0000 7f872f9f9680 20 zone default found 2023-10-05T21:15:16.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.935+0000 7f872f9f9680 4 Realm: () 2023-10-05T21:15:16.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.935+0000 7f872f9f9680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:16.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.935+0000 7f872f9f9680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:16.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.935+0000 7f872f9f9680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:16.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.935+0000 7f872f9f9680 20 zonegroup default 2023-10-05T21:15:16.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.935+0000 7f872f9f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.935+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56339907b690 con 0x7f8718007030 2023-10-05T21:15:16.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.935+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f871c00a570 con 0x7f8718007030 2023-10-05T21:15:16.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.935+0000 7f872f9f9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.935+0000 7f872f9f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.935+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56339907cdf0 con 0x563399075b80 2023-10-05T21:15:16.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.936+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8714051040 con 0x563399075b80 2023-10-05T21:15:16.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.936+0000 7f872f9f9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.936+0000 7f872f9f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.936+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56339907d1a0 con 0x563399075b80 2023-10-05T21:15:16.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.936+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8714051040 con 0x563399075b80 2023-10-05T21:15:16.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.936+0000 7f872f9f9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:16.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.936+0000 7f872f9f9680 20 started sync module instance, tier type = 2023-10-05T21:15:16.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.936+0000 7f872f9f9680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:16.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.936+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56339907c9a0 con 0x7f8714013350 2023-10-05T21:15:16.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.937+0000 7f87222d0700 1 -- 172.21.15.153:0/3946603443 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8718029040 con 0x7f8714013350 2023-10-05T21:15:16.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.937+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94779610743984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56339907dab0 con 0x7f8714013350 2023-10-05T21:15:16.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.937+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56339907e350 con 0x5633990467e0 2023-10-05T21:15:16.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.937+0000 7f87222d0700 1 -- 172.21.15.153:0/3946603443 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94779610743984] v29'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8718029040 con 0x7f8714013350 2023-10-05T21:15:16.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.937+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.937+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94779610750560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56339907e7a0 con 0x5633990467e0 2023-10-05T21:15:16.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.937+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56339907f040 con 0x563399075b80 2023-10-05T21:15:16.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.938+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94779610750560] v29'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.938+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8714051040 con 0x563399075b80 2023-10-05T21:15:16.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.938+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94779610751984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56339907f440 con 0x563399075b80 2023-10-05T21:15:16.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.938+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56339907fe50 con 0x7f8714013350 2023-10-05T21:15:16.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.939+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94779610751984] v29'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8714051040 con 0x563399075b80 2023-10-05T21:15:16.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.939+0000 7f87222d0700 1 -- 172.21.15.153:0/3946603443 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8718029040 con 0x7f8714013350 2023-10-05T21:15:16.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.939+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94779610753088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5633990806f0 con 0x7f8714013350 2023-10-05T21:15:16.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.939+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399080f90 con 0x5633990467e0 2023-10-05T21:15:16.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.940+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.940+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94779610762480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399081750 con 0x5633990467e0 2023-10-05T21:15:16.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.940+0000 7f87222d0700 1 -- 172.21.15.153:0/3946603443 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94779610753088] v29'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8718029040 con 0x7f8714013350 2023-10-05T21:15:16.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.940+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399082350 con 0x7f8718007030 2023-10-05T21:15:16.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.940+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94779610762480] v29'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.940+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f871c00a570 con 0x7f8718007030 2023-10-05T21:15:16.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.940+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94779610766816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399081180 con 0x7f8718007030 2023-10-05T21:15:16.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.941+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399082840 con 0x7f8718007030 2023-10-05T21:15:16.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.941+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94779610766816] v29'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f871c00a570 con 0x7f8718007030 2023-10-05T21:15:16.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.941+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f871c00a570 con 0x7f8718007030 2023-10-05T21:15:16.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.941+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94779610759680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399082800 con 0x7f8718007030 2023-10-05T21:15:16.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.941+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5633990832b0 con 0x7f8718007030 2023-10-05T21:15:16.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.942+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94779610759680] v29'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f871c00a570 con 0x7f8718007030 2023-10-05T21:15:16.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.942+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f871c00a570 con 0x7f8718007030 2023-10-05T21:15:16.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.942+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94779610768144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5633990834c0 con 0x7f8718007030 2023-10-05T21:15:16.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.942+0000 7f872f9f9680 20 add_watcher() i=0 2023-10-05T21:15:16.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.942+0000 7f872f9f9680 20 add_watcher() i=1 2023-10-05T21:15:16.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.942+0000 7f872f9f9680 20 add_watcher() i=2 2023-10-05T21:15:16.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.942+0000 7f872f9f9680 20 add_watcher() i=3 2023-10-05T21:15:16.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.942+0000 7f872f9f9680 20 add_watcher() i=4 2023-10-05T21:15:16.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.942+0000 7f872f9f9680 20 add_watcher() i=5 2023-10-05T21:15:16.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.942+0000 7f872f9f9680 20 add_watcher() i=6 2023-10-05T21:15:16.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.943+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94779610768144] v29'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f871c00a570 con 0x7f8718007030 2023-10-05T21:15:16.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.943+0000 7f872f9f9680 20 add_watcher() i=7 2023-10-05T21:15:16.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.943+0000 7f872f9f9680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:16.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.943+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399086610 con 0x5633990467e0 2023-10-05T21:15:16.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.943+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.943+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94779610771280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399083890 con 0x5633990467e0 2023-10-05T21:15:16.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.944+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94779610771280] v29'108 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.944+0000 7f86f3fe7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:16.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.944+0000 7f872f9f9680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:16.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.944+0000 7f872f9f9680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:16.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.944+0000 7f872f9f9680 1 Processor -- start 2023-10-05T21:15:16.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.944+0000 7f872f9f9680 1 -- start start 2023-10-05T21:15:16.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.944+0000 7f872f9f9680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563399091140 0x563399091550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.944+0000 7f872f9f9680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x563399091b20 con 0x563399091140 2023-10-05T21:15:16.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.945+0000 7f87222d0700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563399091140 0x563399091550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.945+0000 7f87222d0700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563399091140 0x563399091550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50652/0 (socket says 172.21.15.153:50652) 2023-10-05T21:15:16.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.945+0000 7f87222d0700 1 -- 172.21.15.153:0/398510098 learned_addr learned my addr 172.21.15.153:0/398510098 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:16.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.945+0000 7f87222d0700 1 -- 172.21.15.153:0/398510098 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563399091c60 con 0x563399091140 2023-10-05T21:15:16.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.945+0000 7f87222d0700 1 --2- 172.21.15.153:0/398510098 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563399091140 0x563399091550 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x563399042f80 tx=0x7f8718011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da2a97f2dc35889 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.945+0000 7f86f37e6700 1 -- 172.21.15.153:0/398510098 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8718025040 con 0x563399091140 2023-10-05T21:15:16.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.945+0000 7f86f37e6700 1 -- 172.21.15.153:0/398510098 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8718039450 con 0x563399091140 2023-10-05T21:15:16.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.945+0000 7f86f37e6700 1 -- 172.21.15.153:0/398510098 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8718039780 con 0x563399091140 2023-10-05T21:15:16.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.946+0000 7f872f9f9680 1 -- 172.21.15.153:0/398510098 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563399091140 msgr2=0x563399091550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.946+0000 7f872f9f9680 1 --2- 172.21.15.153:0/398510098 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563399091140 0x563399091550 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x563399042f80 tx=0x7f8718011000 comp rx=0 tx=0).stop 2023-10-05T21:15:16.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.946+0000 7f872f9f9680 1 -- 172.21.15.153:0/398510098 shutdown_connections 2023-10-05T21:15:16.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.946+0000 7f872f9f9680 1 --2- 172.21.15.153:0/398510098 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563399091140 0x563399091550 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.946+0000 7f872f9f9680 1 -- 172.21.15.153:0/398510098 >> 172.21.15.153:0/398510098 conn(0x56339908c340 msgr2=0x56339908a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.946+0000 7f872f9f9680 1 -- 172.21.15.153:0/398510098 shutdown_connections 2023-10-05T21:15:16.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.946+0000 7f872f9f9680 1 -- 172.21.15.153:0/398510098 wait complete. 2023-10-05T21:15:16.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.946+0000 7f872f9f9680 1 Processor -- start 2023-10-05T21:15:16.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.946+0000 7f872f9f9680 1 -- start start 2023-10-05T21:15:16.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.947+0000 7f872f9f9680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563399091140 0x56339909b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.947+0000 7f872f9f9680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x56339909b540 con 0x563399091140 2023-10-05T21:15:16.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.947+0000 7f87222d0700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563399091140 0x56339909b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.947+0000 7f87222d0700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563399091140 0x56339909b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50656/0 (socket says 172.21.15.153:50656) 2023-10-05T21:15:16.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.947+0000 7f87222d0700 1 -- 172.21.15.153:0/995642860 learned_addr learned my addr 172.21.15.153:0/995642860 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:16.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.947+0000 7f87222d0700 1 -- 172.21.15.153:0/995642860 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56339904a110 con 0x563399091140 2023-10-05T21:15:16.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.947+0000 7f87222d0700 1 --2- 172.21.15.153:0/995642860 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563399091140 0x56339909b000 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f871803b040 tx=0x7f8718039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.947+0000 7f86f1fe3700 1 -- 172.21.15.153:0/995642860 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8718025070 con 0x563399091140 2023-10-05T21:15:16.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.947+0000 7f86f1fe3700 1 -- 172.21.15.153:0/995642860 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871802d660 con 0x563399091140 2023-10-05T21:15:16.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.947+0000 7f86f1fe3700 1 -- 172.21.15.153:0/995642860 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f871802d930 con 0x563399091140 2023-10-05T21:15:16.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.947+0000 7f872f9f9680 1 -- 172.21.15.153:0/995642860 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56339909b740 con 0x563399091140 2023-10-05T21:15:16.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.947+0000 7f872f9f9680 1 -- 172.21.15.153:0/995642860 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56339909bbf0 con 0x563399091140 2023-10-05T21:15:16.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.948+0000 7f86f1fe3700 1 -- 172.21.15.153:0/995642860 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f871802da90 con 0x563399091140 2023-10-05T21:15:16.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.948+0000 7f86f1fe3700 1 --2- 172.21.15.153:0/995642860 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8668034140 0x7f86680365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:16.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.948+0000 7f86f1fe3700 1 -- 172.21.15.153:0/995642860 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f8718032030 con 0x563399091140 2023-10-05T21:15:16.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.948+0000 7f872f9f9680 5 note: GC not initialized 2023-10-05T21:15:16.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.948+0000 7f87232d2700 1 --2- 172.21.15.153:0/995642860 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8668034140 0x7f86680365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:16.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.949+0000 7f87232d2700 1 --2- 172.21.15.153:0/995642860 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8668034140 0x7f86680365f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x563399086680 tx=0x7f871c00aaf0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:16.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.949+0000 7f8662ffd700 20 reqs_thread_entry: start 2023-10-05T21:15:16.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.949+0000 7f8660ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:16.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.950+0000 7f872f9f9680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:16.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.950+0000 7f872f9f9680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:16.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.950+0000 7f8656ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:47 2023 2023-10-05T21:15:16.991 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:16.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.950+0000 7f86567fc700 20 reqs_thread_entry: start 2023-10-05T21:15:16.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.950+0000 7f872f9f9680 20 get_system_obj_state: rctx=0x7ffd283a9a98 obj=default.rgw.meta:root:myfoo state=0x563398ef6240 s->prefetch_data=0 2023-10-05T21:15:16.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.950+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:102 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399100350 con 0x7f8714013350 2023-10-05T21:15:16.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.950+0000 7f87222d0700 1 -- 172.21.15.153:0/3946603443 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(102 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv18 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f8718048070 con 0x7f8714013350 2023-10-05T21:15:16.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.950+0000 7f872f9f9680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:16.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.950+0000 7f872f9f9680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:16.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.950+0000 7f872f9f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:16.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.950+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:103 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5633991027f0 con 0x7f8714013350 2023-10-05T21:15:16.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.951+0000 7f87222d0700 1 -- 172.21.15.153:0/3946603443 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(103 myfoo [call,call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) v8 ==== 275+0+288 (crc 0 0 0) 0x7f8718048070 con 0x7f8714013350 2023-10-05T21:15:16.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.951+0000 7f872f9f9680 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T21:15:16.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.951+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94779610743984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5633990bf060 con 0x7f8714013350 2023-10-05T21:15:16.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.952+0000 7f87222d0700 1 -- 172.21.15.153:0/3946603443 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94779610743984] v29'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8718048070 con 0x7f8714013350 2023-10-05T21:15:16.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.952+0000 7f872f9f9680 20 remove_watcher() i=0 2023-10-05T21:15:16.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.952+0000 7f872f9f9680 2 removed watcher, disabling cache 2023-10-05T21:15:16.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.952+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94779610750560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56339907c4b0 con 0x5633990467e0 2023-10-05T21:15:16.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.953+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94779610750560] v29'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.953+0000 7f872f9f9680 20 remove_watcher() i=1 2023-10-05T21:15:16.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.953+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94779610751984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56339907c4b0 con 0x563399075b80 2023-10-05T21:15:16.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.953+0000 7f8722ad1700 1 -- 172.21.15.153:0/3946603443 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94779610751984] v29'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8714051040 con 0x563399075b80 2023-10-05T21:15:16.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.953+0000 7f872f9f9680 20 remove_watcher() i=2 2023-10-05T21:15:16.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.953+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94779610753088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56339907e3f0 con 0x7f8714013350 2023-10-05T21:15:16.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.954+0000 7f87222d0700 1 -- 172.21.15.153:0/3946603443 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94779610753088] v29'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8718048070 con 0x7f8714013350 2023-10-05T21:15:16.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.954+0000 7f872f9f9680 20 remove_watcher() i=3 2023-10-05T21:15:16.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.954+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94779610762480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56339907c4b0 con 0x5633990467e0 2023-10-05T21:15:16.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.955+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94779610762480] v29'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.955+0000 7f872f9f9680 20 remove_watcher() i=4 2023-10-05T21:15:16.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.955+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94779610766816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563399080cf0 con 0x7f8718007030 2023-10-05T21:15:16.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.956+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94779610766816] v29'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f871c00a570 con 0x7f8718007030 2023-10-05T21:15:16.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.956+0000 7f872f9f9680 20 remove_watcher() i=5 2023-10-05T21:15:16.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.956+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94779610759680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56339907c4b0 con 0x7f8718007030 2023-10-05T21:15:16.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.956+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94779610759680] v29'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f871c00a570 con 0x7f8718007030 2023-10-05T21:15:16.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.956+0000 7f872f9f9680 20 remove_watcher() i=6 2023-10-05T21:15:16.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.956+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94779610768144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56339907c4b0 con 0x7f8718007030 2023-10-05T21:15:16.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.957+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94779610768144] v29'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f871c00a570 con 0x7f8718007030 2023-10-05T21:15:16.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.957+0000 7f872f9f9680 20 remove_watcher() i=7 2023-10-05T21:15:16.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.958+0000 7f86f3fe7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:16.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.958+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:112 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94779610771280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56339907c4b0 con 0x5633990467e0 2023-10-05T21:15:16.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.959+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(112 data_loggenerations_metadata [watch unwatch cookie 94779610771280] v29'109 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f871c00a570 con 0x5633990467e0 2023-10-05T21:15:16.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.959+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f8718007030 msgr2=0x7f871801d430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.959+0000 7f872f9f9680 1 --2- 172.21.15.153:0/3946603443 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f8718007030 0x7f871801d430 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.959+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5633990467e0 msgr2=0x563399073710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.959+0000 7f872f9f9680 1 --2- 172.21.15.153:0/3946603443 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5633990467e0 0x563399073710 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.959+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f8714013350 msgr2=0x7f8714049350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.959+0000 7f872f9f9680 1 --2- 172.21.15.153:0/3946603443 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f8714013350 0x7f8714049350 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.959+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x563399075b80 msgr2=0x563399077f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.959+0000 7f872f9f9680 1 --2- 172.21.15.153:0/3946603443 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x563399075b80 0x563399077f60 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.959+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f87080340f0 msgr2=0x7f87080365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.959+0000 7f872f9f9680 1 --2- 172.21.15.153:0/3946603443 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f87080340f0 0x7f87080365a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f871800afd0 tx=0x7f8718014000 comp rx=0 tx=0).stop 2023-10-05T21:15:16.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.959+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5633990422b0 msgr2=0x5633990679e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.959+0000 7f87232d2700 1 -- 172.21.15.153:0/3946603443 reap_dead start 2023-10-05T21:15:16.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.959+0000 7f872f9f9680 1 --2- 172.21.15.153:0/3946603443 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5633990422b0 0x5633990679e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8714011000 tx=0x7f8714016000 comp rx=0 tx=0).stop 2023-10-05T21:15:16.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.959+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 shutdown_connections 2023-10-05T21:15:16.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.959+0000 7f872f9f9680 1 --2- 172.21.15.153:0/3946603443 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5633990422b0 0x5633990679e0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.959+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 >> 172.21.15.153:0/3946603443 conn(0x56339903db80 msgr2=0x56339905b940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.959+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 shutdown_connections 2023-10-05T21:15:16.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.959+0000 7f872f9f9680 1 -- 172.21.15.153:0/3946603443 wait complete. 2023-10-05T21:15:16.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.959+0000 7f872f9f9680 1 -- 172.21.15.153:0/995642860 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8668034140 msgr2=0x7f86680365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.959+0000 7f872f9f9680 1 --2- 172.21.15.153:0/995642860 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8668034140 0x7f86680365f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x563399086680 tx=0x7f871c00aaf0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.959+0000 7f872f9f9680 1 -- 172.21.15.153:0/995642860 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563399091140 msgr2=0x56339909b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:16.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.959+0000 7f872f9f9680 1 --2- 172.21.15.153:0/995642860 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563399091140 0x56339909b000 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f871803b040 tx=0x7f8718039000 comp rx=0 tx=0).stop 2023-10-05T21:15:16.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.959+0000 7f872f9f9680 1 -- 172.21.15.153:0/995642860 shutdown_connections 2023-10-05T21:15:16.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.959+0000 7f872f9f9680 1 --2- 172.21.15.153:0/995642860 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8668034140 0x7f86680365f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.959+0000 7f872f9f9680 1 --2- 172.21.15.153:0/995642860 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563399091140 0x56339909b000 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:16.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.959+0000 7f872f9f9680 1 -- 172.21.15.153:0/995642860 >> 172.21.15.153:0/995642860 conn(0x56339908c340 msgr2=0x56339908a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:16.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.959+0000 7f872f9f9680 1 -- 172.21.15.153:0/995642860 shutdown_connections 2023-10-05T21:15:17.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:16.959+0000 7f872f9f9680 1 -- 172.21.15.153:0/995642860 wait complete. 2023-10-05T21:15:17.000 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:17.000 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "bucket:myfoo", 2023-10-05T21:15:17.001 INFO:teuthology.orchestra.run.smithi153.stdout: "ver": { 2023-10-05T21:15:17.001 INFO:teuthology.orchestra.run.smithi153.stdout: "tag": "_pdhlH9bcmk3FaC2pohRRRM-", 2023-10-05T21:15:17.001 INFO:teuthology.orchestra.run.smithi153.stdout: "ver": 2 2023-10-05T21:15:17.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:17.001 INFO:teuthology.orchestra.run.smithi153.stdout: "mtime": "2023-10-05T21:15:16.638436Z", 2023-10-05T21:15:17.001 INFO:teuthology.orchestra.run.smithi153.stdout: "data": { 2023-10-05T21:15:17.001 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": { 2023-10-05T21:15:17.001 INFO:teuthology.orchestra.run.smithi153.stdout: "name": "myfoo", 2023-10-05T21:15:17.001 INFO:teuthology.orchestra.run.smithi153.stdout: "marker": "193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1", 2023-10-05T21:15:17.001 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_id": "193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1", 2023-10-05T21:15:17.001 INFO:teuthology.orchestra.run.smithi153.stdout: "tenant": "", 2023-10-05T21:15:17.001 INFO:teuthology.orchestra.run.smithi153.stdout: "explicit_placement": { 2023-10-05T21:15:17.002 INFO:teuthology.orchestra.run.smithi153.stdout: "data_pool": "", 2023-10-05T21:15:17.002 INFO:teuthology.orchestra.run.smithi153.stdout: "data_extra_pool": "", 2023-10-05T21:15:17.002 INFO:teuthology.orchestra.run.smithi153.stdout: "index_pool": "" 2023-10-05T21:15:17.002 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:17.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:17.002 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:15:17.002 INFO:teuthology.orchestra.run.smithi153.stdout: "creation_time": "2023-10-05T21:15:15.576323Z", 2023-10-05T21:15:17.002 INFO:teuthology.orchestra.run.smithi153.stdout: "linked": "false", 2023-10-05T21:15:17.002 INFO:teuthology.orchestra.run.smithi153.stdout: "has_bucket_info": "false" 2023-10-05T21:15:17.002 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:17.002 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:17.003 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_pdhlH9bcmk3FaC2pohRRRM-', 'ver': 2}, 'mtime': '2023-10-05T21:15:16.638436Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1', 'bucket_id': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2023-10-05T21:15:15.576323Z', 'linked': 'false', 'has_bucket_info': 'false'}} 2023-10-05T21:15:17.003 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1'] 2023-10-05T21:15:17.003 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1'] 2023-10-05T21:15:17.003 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 2023-10-05T21:15:17.051 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:17.051 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:17.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.050+0000 7f6057b5b680 1 Processor -- start 2023-10-05T21:15:17.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.050+0000 7f6057b5b680 1 -- start start 2023-10-05T21:15:17.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.050+0000 7f6057b5b680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55cb08ecc750 0x55cb08eceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.051+0000 7f6057b5b680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55cb08e15930 con 0x55cb08e3c040 2023-10-05T21:15:17.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.051+0000 7f6057b5b680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55cb08dd5db0 con 0x55cb08ecc750 2023-10-05T21:15:17.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.051+0000 7f604a432700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55cb08ecc750 0x55cb08eceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.051+0000 7f604ac33700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55cb08e3c040 0x55cb08ecb030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56488/0 (socket says 172.21.15.153:56488) 2023-10-05T21:15:17.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.051+0000 7f604ac33700 1 -- 172.21.15.153:0/602765284 learned_addr learned my addr 172.21.15.153:0/602765284 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:17.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.051+0000 7f6049c31700 1 -- 172.21.15.153:0/602765284 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2447613100 0 0) 0x55cb08e15930 con 0x55cb08e3c040 2023-10-05T21:15:17.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.051+0000 7f6049c31700 1 -- 172.21.15.153:0/602765284 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6034001e10 con 0x55cb08e3c040 2023-10-05T21:15:17.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.051+0000 7f604a432700 1 -- 172.21.15.153:0/602765284 >> v1:172.21.15.111:6789/0 conn(0x55cb08e3c040 legacy=0x55cb08ecb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.051+0000 7f604a432700 1 -- 172.21.15.153:0/602765284 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb08ed0180 con 0x55cb08ecc750 2023-10-05T21:15:17.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.051+0000 7f604a432700 1 --2- 172.21.15.153:0/602765284 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cb08ecc750 0x55cb08eceb30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f603c00a5d0 tx=0x7f603c005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f30a40027ffc34 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.052+0000 7f6049c31700 1 -- 172.21.15.153:0/602765284 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f603c007610 con 0x55cb08ecc750 2023-10-05T21:15:17.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.052+0000 7f6049c31700 1 -- 172.21.15.153:0/602765284 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603c007770 con 0x55cb08ecc750 2023-10-05T21:15:17.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.052+0000 7f6049c31700 1 -- 172.21.15.153:0/602765284 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f603c007a20 con 0x55cb08ecc750 2023-10-05T21:15:17.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.052+0000 7f6057b5b680 1 -- 172.21.15.153:0/602765284 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cb08ecc750 msgr2=0x55cb08eceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.052+0000 7f6057b5b680 1 --2- 172.21.15.153:0/602765284 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cb08ecc750 0x55cb08eceb30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f603c00a5d0 tx=0x7f603c005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:17.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.052+0000 7f6057b5b680 1 -- 172.21.15.153:0/602765284 shutdown_connections 2023-10-05T21:15:17.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.052+0000 7f6057b5b680 1 --2- 172.21.15.153:0/602765284 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cb08ecc750 0x55cb08eceb30 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.052+0000 7f6057b5b680 1 -- 172.21.15.153:0/602765284 >> 172.21.15.153:0/602765284 conn(0x55cb08ec2b20 msgr2=0x55cb08ec4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.052+0000 7f6057b5b680 1 -- 172.21.15.153:0/602765284 shutdown_connections 2023-10-05T21:15:17.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.052+0000 7f6057b5b680 1 -- 172.21.15.153:0/602765284 wait complete. 2023-10-05T21:15:17.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.053+0000 7f6057b5b680 1 Processor -- start 2023-10-05T21:15:17.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.053+0000 7f6057b5b680 1 -- start start 2023-10-05T21:15:17.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.053+0000 7f6057b5b680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cb08e3c040 0x55cb08ee7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.053+0000 7f6057b5b680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb08d75ea0 con 0x55cb08e3c040 2023-10-05T21:15:17.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.053+0000 7f604ac33700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cb08e3c040 0x55cb08ee7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.053+0000 7f604ac33700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cb08e3c040 0x55cb08ee7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50666/0 (socket says 172.21.15.153:50666) 2023-10-05T21:15:17.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.053+0000 7f604ac33700 1 -- 172.21.15.153:0/195783463 learned_addr learned my addr 172.21.15.153:0/195783463 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:17.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.053+0000 7f604ac33700 1 -- 172.21.15.153:0/195783463 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603c005cf0 con 0x55cb08e3c040 2023-10-05T21:15:17.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.053+0000 7f604ac33700 1 --2- 172.21.15.153:0/195783463 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cb08e3c040 0x55cb08ee7700 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6040001c00 tx=0x7f60400017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7dc930925037919 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.054+0000 7f6048c2f700 1 -- 172.21.15.153:0/195783463 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f604000bbf0 con 0x55cb08e3c040 2023-10-05T21:15:17.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.054+0000 7f6048c2f700 1 -- 172.21.15.153:0/195783463 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604000bd50 con 0x55cb08e3c040 2023-10-05T21:15:17.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.054+0000 7f6048c2f700 1 -- 172.21.15.153:0/195783463 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f604000e470 con 0x55cb08e3c040 2023-10-05T21:15:17.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.054+0000 7f6057b5b680 1 -- 172.21.15.153:0/195783463 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cb08e3c040 msgr2=0x55cb08ee7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.054+0000 7f6057b5b680 1 --2- 172.21.15.153:0/195783463 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cb08e3c040 0x55cb08ee7700 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6040001c00 tx=0x7f60400017b0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.054+0000 7f6057b5b680 1 -- 172.21.15.153:0/195783463 shutdown_connections 2023-10-05T21:15:17.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.054+0000 7f6057b5b680 1 --2- 172.21.15.153:0/195783463 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cb08e3c040 0x55cb08ee7700 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.054+0000 7f6057b5b680 1 -- 172.21.15.153:0/195783463 >> 172.21.15.153:0/195783463 conn(0x55cb08ec2b20 msgr2=0x55cb08ee31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.054+0000 7f6057b5b680 1 -- 172.21.15.153:0/195783463 shutdown_connections 2023-10-05T21:15:17.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.054+0000 7f6057b5b680 1 -- 172.21.15.153:0/195783463 wait complete. 2023-10-05T21:15:17.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.054+0000 7f6057b5b680 1 Processor -- start 2023-10-05T21:15:17.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.054+0000 7f6057b5b680 1 -- start start 2023-10-05T21:15:17.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.055+0000 7f6057b5b680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cb08e3c040 0x55cb08eeec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.055+0000 7f6057b5b680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb08d6cc80 con 0x55cb08e3c040 2023-10-05T21:15:17.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.055+0000 7f604ac33700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cb08e3c040 0x55cb08eeec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.055+0000 7f604ac33700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cb08e3c040 0x55cb08eeec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50670/0 (socket says 172.21.15.153:50670) 2023-10-05T21:15:17.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.055+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 learned_addr learned my addr 172.21.15.153:0/3903492157 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:17.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.055+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6034001e10 con 0x55cb08e3c040 2023-10-05T21:15:17.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.055+0000 7f604ac33700 1 --2- 172.21.15.153:0/3903492157 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cb08e3c040 0x55cb08eeec30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6040010000 tx=0x7f6040014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.055+0000 7f603affd700 1 -- 172.21.15.153:0/3903492157 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f604001f070 con 0x55cb08e3c040 2023-10-05T21:15:17.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.055+0000 7f603affd700 1 -- 172.21.15.153:0/3903492157 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604001a2e0 con 0x55cb08e3c040 2023-10-05T21:15:17.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.055+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cb08eef170 con 0x55cb08e3c040 2023-10-05T21:15:17.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.055+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cb08eef640 con 0x55cb08e3c040 2023-10-05T21:15:17.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.055+0000 7f603affd700 1 -- 172.21.15.153:0/3903492157 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f604000bec0 con 0x55cb08e3c040 2023-10-05T21:15:17.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.056+0000 7f603affd700 1 -- 172.21.15.153:0/3903492157 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f604001a9a0 con 0x55cb08e3c040 2023-10-05T21:15:17.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.056+0000 7f603affd700 1 --2- 172.21.15.153:0/3903492157 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f60300340e0 0x7f6030036590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.056+0000 7f6057b5b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.056+0000 7f603affd700 1 -- 172.21.15.153:0/3903492157 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f6040048ea0 con 0x55cb08e3c040 2023-10-05T21:15:17.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.056+0000 7f604a432700 1 --2- 172.21.15.153:0/3903492157 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f60300340e0 0x7f6030036590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.057+0000 7f6057b5b680 1 --2- 172.21.15.153:0/3903492157 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55cb08ecc750 0x55cb08efaa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.057+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08efb190 con 0x55cb08ecc750 2023-10-05T21:15:17.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.057+0000 7f604b434700 1 --2- 172.21.15.153:0/3903492157 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55cb08ecc750 0x55cb08efaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.057+0000 7f604a432700 1 --2- 172.21.15.153:0/3903492157 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f60300340e0 0x7f6030036590 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f603c005a90 tx=0x7f603c014000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.057+0000 7f604b434700 1 --2- 172.21.15.153:0/3903492157 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55cb08ecc750 0x55cb08efaa00 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.057+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.057+0000 7f6057b5b680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.057+0000 7f6057b5b680 20 realm 2023-10-05T21:15:17.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.057+0000 7f6057b5b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.057+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08ef8020 con 0x55cb08ecc750 2023-10-05T21:15:17.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.058+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.058+0000 7f6057b5b680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.058+0000 7f6057b5b680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:17.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.058+0000 7f6057b5b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.058+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08efbc90 con 0x55cb08ecc750 2023-10-05T21:15:17.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.058+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.058+0000 7f6057b5b680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.058+0000 7f6057b5b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.058+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08efc5b0 con 0x55cb08ecc750 2023-10-05T21:15:17.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.058+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.058+0000 7f6057b5b680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.058+0000 7f6057b5b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.058+0000 7f6057b5b680 1 --2- 172.21.15.153:0/3903492157 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55cb08efce70 0x55cb08eff250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.058+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08eff8a0 con 0x55cb08efce70 2023-10-05T21:15:17.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.058+0000 7f604ac33700 1 --2- 172.21.15.153:0/3903492157 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55cb08efce70 0x55cb08eff250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.058+0000 7f604ac33700 1 --2- 172.21.15.153:0/3903492157 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55cb08efce70 0x55cb08eff250 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.059+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f6040014070 con 0x55cb08efce70 2023-10-05T21:15:17.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.059+0000 7f6057b5b680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:17.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.059+0000 7f6057b5b680 20 searching for the correct realm 2023-10-05T21:15:17.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.059+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x55cb08efce70 2023-10-05T21:15:17.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.059+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6040014070 con 0x55cb08efce70 2023-10-05T21:15:17.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.059+0000 7f604ac33700 1 --2- 172.21.15.153:0/3903492157 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f604000d5b0 0x7f6040046130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.059+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x7f604000d5b0 2023-10-05T21:15:17.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.059+0000 7f604a432700 1 --2- 172.21.15.153:0/3903492157 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f604000d5b0 0x7f6040046130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.059+0000 7f604a432700 1 --2- 172.21.15.153:0/3903492157 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f604000d5b0 0x7f6040046130 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.060+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f603c007970 con 0x7f604000d5b0 2023-10-05T21:15:17.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.060+0000 7f604a432700 1 --2- 172.21.15.153:0/3903492157 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f603c007030 0x7f603c01d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.060+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x7f603c007030 2023-10-05T21:15:17.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.060+0000 7f604b434700 1 --2- 172.21.15.153:0/3903492157 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f603c007030 0x7f603c01d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.060+0000 7f604b434700 1 --2- 172.21.15.153:0/3903492157 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f603c007030 0x7f603c01d430 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.060+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.060+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x55cb08ecc750 2023-10-05T21:15:17.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.061+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.061+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x55cb08ecc750 2023-10-05T21:15:17.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.061+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.061+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x7f603c007030 2023-10-05T21:15:17.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.061+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.061+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x7f603c007030 2023-10-05T21:15:17.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.061+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.061+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x7f604000d5b0 2023-10-05T21:15:17.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.061+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f603c029040 con 0x7f604000d5b0 2023-10-05T21:15:17.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.061+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x55cb08efce70 2023-10-05T21:15:17.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.062+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f6040014070 con 0x55cb08efce70 2023-10-05T21:15:17.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.062+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x55cb08ecc750 2023-10-05T21:15:17.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.062+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.062+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x7f603c007030 2023-10-05T21:15:17.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.062+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.062+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x55cb08ecc750 2023-10-05T21:15:17.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.062+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.062+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x7f604000d5b0 2023-10-05T21:15:17.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.063+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f603c029040 con 0x7f604000d5b0 2023-10-05T21:15:17.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.063+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x55cb08efce70 2023-10-05T21:15:17.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.063+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6040014070 con 0x55cb08efce70 2023-10-05T21:15:17.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.063+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x55cb08efce70 2023-10-05T21:15:17.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.063+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6040014070 con 0x55cb08efce70 2023-10-05T21:15:17.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.063+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x7f603c007030 2023-10-05T21:15:17.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.063+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.063+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x55cb08efce70 2023-10-05T21:15:17.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.063+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6040014070 con 0x55cb08efce70 2023-10-05T21:15:17.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.063+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x55cb08efce70 2023-10-05T21:15:17.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.064+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6040014070 con 0x55cb08efce70 2023-10-05T21:15:17.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.064+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x55cb08ecc750 2023-10-05T21:15:17.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.064+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.064+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x55cb08ecc750 2023-10-05T21:15:17.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.064+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.064+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x7f603c007030 2023-10-05T21:15:17.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.064+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.064+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x55cb08efce70 2023-10-05T21:15:17.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.065+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6040014070 con 0x55cb08efce70 2023-10-05T21:15:17.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.065+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x7f604000d5b0 2023-10-05T21:15:17.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.065+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f603c029040 con 0x7f604000d5b0 2023-10-05T21:15:17.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.065+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x55cb08ecc750 2023-10-05T21:15:17.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.065+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.065+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x7f603c007030 2023-10-05T21:15:17.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.065+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.065+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x55cb08efce70 2023-10-05T21:15:17.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.065+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6040014070 con 0x55cb08efce70 2023-10-05T21:15:17.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.065+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x7f603c007030 2023-10-05T21:15:17.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.066+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.066+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x7f604000d5b0 2023-10-05T21:15:17.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.066+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f603c029040 con 0x7f604000d5b0 2023-10-05T21:15:17.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.066+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x55cb08efce70 2023-10-05T21:15:17.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.066+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6040014070 con 0x55cb08efce70 2023-10-05T21:15:17.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.066+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x7f603c007030 2023-10-05T21:15:17.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.066+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.066+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x55cb08ecc750 2023-10-05T21:15:17.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.067+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.067+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01410 con 0x7f604000d5b0 2023-10-05T21:15:17.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.067+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f603c029040 con 0x7f604000d5b0 2023-10-05T21:15:17.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.067+0000 7f6057b5b680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:17.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.067+0000 7f6057b5b680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:17.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.067+0000 7f6057b5b680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:17.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.067+0000 7f6057b5b680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:17.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.067+0000 7f6057b5b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.067+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f00360 con 0x55cb08ecc750 2023-10-05T21:15:17.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.067+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.067+0000 7f6057b5b680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.067+0000 7f6057b5b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.067+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f00760 con 0x55cb08ecc750 2023-10-05T21:15:17.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.067+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.067+0000 7f6057b5b680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.067+0000 7f6057b5b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.067+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f018a0 con 0x55cb08ecc750 2023-10-05T21:15:17.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.067+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.068+0000 7f6057b5b680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:17.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.068+0000 7f6057b5b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.068+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f01c50 con 0x55cb08efce70 2023-10-05T21:15:17.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.068+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f6040014070 con 0x55cb08efce70 2023-10-05T21:15:17.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.068+0000 7f6057b5b680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.068+0000 7f6057b5b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.068+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f02000 con 0x55cb08ecc750 2023-10-05T21:15:17.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.068+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.068+0000 7f6057b5b680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.068+0000 7f6057b5b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.068+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f02000 con 0x55cb08ecc750 2023-10-05T21:15:17.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.068+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.068+0000 7f6057b5b680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.068+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f03010 con 0x55cb08efce70 2023-10-05T21:15:17.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.068+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6040014070 con 0x55cb08efce70 2023-10-05T21:15:17.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.068+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f03010 con 0x7f604000d5b0 2023-10-05T21:15:17.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.069+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f603c029040 con 0x7f604000d5b0 2023-10-05T21:15:17.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.069+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f03010 con 0x7f603c007030 2023-10-05T21:15:17.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.069+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.069+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f018a0 con 0x55cb08ecc750 2023-10-05T21:15:17.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.069+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.069+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f018a0 con 0x55cb08ecc750 2023-10-05T21:15:17.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.069+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.069+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f018a0 con 0x7f603c007030 2023-10-05T21:15:17.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.070+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.070+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f018a0 con 0x7f603c007030 2023-10-05T21:15:17.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.070+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.070+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f018a0 con 0x7f604000d5b0 2023-10-05T21:15:17.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.070+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f603c029040 con 0x7f604000d5b0 2023-10-05T21:15:17.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.070+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f018a0 con 0x55cb08efce70 2023-10-05T21:15:17.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.070+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f6040014070 con 0x55cb08efce70 2023-10-05T21:15:17.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.070+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f018a0 con 0x55cb08ecc750 2023-10-05T21:15:17.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.070+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.070+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f018a0 con 0x7f603c007030 2023-10-05T21:15:17.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.071+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.071+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f018a0 con 0x55cb08ecc750 2023-10-05T21:15:17.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.071+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.071+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f018a0 con 0x7f604000d5b0 2023-10-05T21:15:17.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.071+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f603c029040 con 0x7f604000d5b0 2023-10-05T21:15:17.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.071+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f018a0 con 0x55cb08efce70 2023-10-05T21:15:17.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.071+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604004b040 con 0x55cb08efce70 2023-10-05T21:15:17.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.071+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f018a0 con 0x55cb08efce70 2023-10-05T21:15:17.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.072+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604004b040 con 0x55cb08efce70 2023-10-05T21:15:17.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.072+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f018a0 con 0x7f603c007030 2023-10-05T21:15:17.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.072+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.072+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f018a0 con 0x55cb08efce70 2023-10-05T21:15:17.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.072+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604004b040 con 0x55cb08efce70 2023-10-05T21:15:17.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.072+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f018a0 con 0x55cb08efce70 2023-10-05T21:15:17.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.072+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604004b040 con 0x55cb08efce70 2023-10-05T21:15:17.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.072+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f018a0 con 0x55cb08ecc750 2023-10-05T21:15:17.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.072+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.072+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f018a0 con 0x55cb08ecc750 2023-10-05T21:15:17.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.073+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.073+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f018a0 con 0x7f603c007030 2023-10-05T21:15:17.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.073+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.073+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f018a0 con 0x55cb08efce70 2023-10-05T21:15:17.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.073+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604004b040 con 0x55cb08efce70 2023-10-05T21:15:17.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.073+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f018a0 con 0x7f604000d5b0 2023-10-05T21:15:17.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.073+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f603c029040 con 0x7f604000d5b0 2023-10-05T21:15:17.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.073+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f018a0 con 0x55cb08ecc750 2023-10-05T21:15:17.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.073+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.074+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f018a0 con 0x7f603c007030 2023-10-05T21:15:17.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.074+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.074+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f018a0 con 0x55cb08efce70 2023-10-05T21:15:17.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.074+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604004b040 con 0x55cb08efce70 2023-10-05T21:15:17.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.074+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f018a0 con 0x7f603c007030 2023-10-05T21:15:17.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.074+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.074+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f018a0 con 0x7f604000d5b0 2023-10-05T21:15:17.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.075+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f603c029040 con 0x7f604000d5b0 2023-10-05T21:15:17.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.075+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f018a0 con 0x55cb08efce70 2023-10-05T21:15:17.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.075+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604004b040 con 0x55cb08efce70 2023-10-05T21:15:17.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.075+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f018a0 con 0x7f603c007030 2023-10-05T21:15:17.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.075+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.075+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f018a0 con 0x55cb08ecc750 2023-10-05T21:15:17.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.075+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.075+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f018a0 con 0x7f604000d5b0 2023-10-05T21:15:17.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.075+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f603c029040 con 0x7f604000d5b0 2023-10-05T21:15:17.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.075+0000 7f6057b5b680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:17.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.075+0000 7f6057b5b680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:17.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.075+0000 7f6057b5b680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:17.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.075+0000 7f6057b5b680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:17.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.075+0000 7f6057b5b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.076+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f02000 con 0x55cb08ecc750 2023-10-05T21:15:17.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.076+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.076+0000 7f6057b5b680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.076+0000 7f6057b5b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.076+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f023b0 con 0x55cb08efce70 2023-10-05T21:15:17.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.076+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f604004b040 con 0x55cb08efce70 2023-10-05T21:15:17.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.076+0000 7f6057b5b680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:17.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.076+0000 7f6057b5b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.076+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f02c50 con 0x55cb08ecc750 2023-10-05T21:15:17.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.076+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.076+0000 7f6057b5b680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.076+0000 7f6057b5b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.076+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f02c50 con 0x55cb08ecc750 2023-10-05T21:15:17.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.077+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.077+0000 7f6057b5b680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:17.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.077+0000 7f6057b5b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.077+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f02d50 con 0x7f603c007030 2023-10-05T21:15:17.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.077+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.077+0000 7f6057b5b680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.077+0000 7f6057b5b680 20 zone default found 2023-10-05T21:15:17.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.077+0000 7f6057b5b680 4 Realm: () 2023-10-05T21:15:17.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.077+0000 7f6057b5b680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:17.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.077+0000 7f6057b5b680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:17.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.077+0000 7f6057b5b680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:17.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.077+0000 7f6057b5b680 20 zonegroup default 2023-10-05T21:15:17.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.077+0000 7f6057b5b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.077+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f02d50 con 0x7f603c007030 2023-10-05T21:15:17.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.077+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.077+0000 7f6057b5b680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.077+0000 7f6057b5b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.077+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f046d0 con 0x55cb08efce70 2023-10-05T21:15:17.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.077+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f604004b040 con 0x55cb08efce70 2023-10-05T21:15:17.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.077+0000 7f6057b5b680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.077+0000 7f6057b5b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.077+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f04a80 con 0x55cb08efce70 2023-10-05T21:15:17.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.078+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f604004b040 con 0x55cb08efce70 2023-10-05T21:15:17.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.078+0000 7f6057b5b680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.078+0000 7f6057b5b680 20 started sync module instance, tier type = 2023-10-05T21:15:17.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.078+0000 7f6057b5b680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:17.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.078+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f03d90 con 0x7f604000d5b0 2023-10-05T21:15:17.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.078+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f603c029040 con 0x7f604000d5b0 2023-10-05T21:15:17.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.078+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94330516685120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f05320 con 0x7f604000d5b0 2023-10-05T21:15:17.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.078+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f05bc0 con 0x55cb08ecc750 2023-10-05T21:15:17.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.079+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94330516685120] v29'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f603c029040 con 0x7f604000d5b0 2023-10-05T21:15:17.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.079+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.079+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94330516688432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f05bc0 con 0x55cb08ecc750 2023-10-05T21:15:17.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.079+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f06770 con 0x55cb08efce70 2023-10-05T21:15:17.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.080+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94330516688432] v29'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.080+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f604004b040 con 0x55cb08efce70 2023-10-05T21:15:17.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.080+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94330516690640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f05b20 con 0x55cb08efce70 2023-10-05T21:15:17.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.080+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f07550 con 0x7f604000d5b0 2023-10-05T21:15:17.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.081+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94330516690640] v29'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f604004b040 con 0x55cb08efce70 2023-10-05T21:15:17.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.081+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f603c029040 con 0x7f604000d5b0 2023-10-05T21:15:17.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.081+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94330516696208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f07160 con 0x7f604000d5b0 2023-10-05T21:15:17.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.081+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f085e0 con 0x55cb08ecc750 2023-10-05T21:15:17.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.082+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94330516696208] v29'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f603c029040 con 0x7f604000d5b0 2023-10-05T21:15:17.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.082+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.082+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94330516701392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f089e0 con 0x55cb08ecc750 2023-10-05T21:15:17.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.082+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f09450 con 0x7f603c007030 2023-10-05T21:15:17.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.082+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94330516701392] v29'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.082+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.082+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94330516705024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f09410 con 0x7f603c007030 2023-10-05T21:15:17.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.083+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f09f10 con 0x7f603c007030 2023-10-05T21:15:17.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.083+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94330516705024] v29'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.083+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.083+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94330516699392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f09f10 con 0x7f603c007030 2023-10-05T21:15:17.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.083+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f0a980 con 0x7f603c007030 2023-10-05T21:15:17.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.084+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(98 notify.7 [create] v29'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.084+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(97 notify.6 [watch watch cookie 94330516699392] v29'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.084+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94330516710448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f0a940 con 0x7f603c007030 2023-10-05T21:15:17.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.084+0000 7f6057b5b680 20 add_watcher() i=0 2023-10-05T21:15:17.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.084+0000 7f6057b5b680 20 add_watcher() i=1 2023-10-05T21:15:17.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.084+0000 7f6057b5b680 20 add_watcher() i=2 2023-10-05T21:15:17.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.084+0000 7f6057b5b680 20 add_watcher() i=3 2023-10-05T21:15:17.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.084+0000 7f6057b5b680 20 add_watcher() i=4 2023-10-05T21:15:17.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.084+0000 7f6057b5b680 20 add_watcher() i=5 2023-10-05T21:15:17.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.084+0000 7f6057b5b680 20 add_watcher() i=6 2023-10-05T21:15:17.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.085+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94330516710448] v29'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.085+0000 7f6057b5b680 20 add_watcher() i=7 2023-10-05T21:15:17.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.085+0000 7f6057b5b680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:17.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.085+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f0de40 con 0x55cb08ecc750 2023-10-05T21:15:17.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.085+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.085+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94330516707872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f0b300 con 0x55cb08ecc750 2023-10-05T21:15:17.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.086+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94330516707872] v29'110 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.086+0000 7f601bfe7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:17.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.086+0000 7f6057b5b680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:17.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.086+0000 7f6057b5b680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:17.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.086+0000 7f6057b5b680 1 Processor -- start 2023-10-05T21:15:17.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.086+0000 7f6057b5b680 1 -- start start 2023-10-05T21:15:17.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.086+0000 7f6057b5b680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cb08f179f0 0x55cb08f17e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.086+0000 7f6057b5b680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb08f18410 con 0x55cb08f179f0 2023-10-05T21:15:17.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.087+0000 7f604a432700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cb08f179f0 0x55cb08f17e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.087+0000 7f604a432700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cb08f179f0 0x55cb08f17e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50674/0 (socket says 172.21.15.153:50674) 2023-10-05T21:15:17.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.087+0000 7f604a432700 1 -- 172.21.15.153:0/4098486214 learned_addr learned my addr 172.21.15.153:0/4098486214 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:17.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.087+0000 7f604a432700 1 -- 172.21.15.153:0/4098486214 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb08f188f0 con 0x55cb08f179f0 2023-10-05T21:15:17.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.087+0000 7f604a432700 1 --2- 172.21.15.153:0/4098486214 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cb08f179f0 0x55cb08f17e00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f603c002000 tx=0x7f603c030040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58fb4fc3d277bc87 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.087+0000 7f601b7e6700 1 -- 172.21.15.153:0/4098486214 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f603c025040 con 0x55cb08f179f0 2023-10-05T21:15:17.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.087+0000 7f601b7e6700 1 -- 172.21.15.153:0/4098486214 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603c034070 con 0x55cb08f179f0 2023-10-05T21:15:17.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.087+0000 7f601b7e6700 1 -- 172.21.15.153:0/4098486214 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f603c01f4c0 con 0x55cb08f179f0 2023-10-05T21:15:17.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.088+0000 7f6057b5b680 1 -- 172.21.15.153:0/4098486214 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cb08f179f0 msgr2=0x55cb08f17e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.088+0000 7f6057b5b680 1 --2- 172.21.15.153:0/4098486214 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cb08f179f0 0x55cb08f17e00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f603c002000 tx=0x7f603c030040 comp rx=0 tx=0).stop 2023-10-05T21:15:17.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.088+0000 7f6057b5b680 1 -- 172.21.15.153:0/4098486214 shutdown_connections 2023-10-05T21:15:17.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.088+0000 7f6057b5b680 1 --2- 172.21.15.153:0/4098486214 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cb08f179f0 0x55cb08f17e00 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.088+0000 7f6057b5b680 1 -- 172.21.15.153:0/4098486214 >> 172.21.15.153:0/4098486214 conn(0x55cb08f13cf0 msgr2=0x55cb08f11df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.088+0000 7f6057b5b680 1 -- 172.21.15.153:0/4098486214 shutdown_connections 2023-10-05T21:15:17.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.088+0000 7f6057b5b680 1 -- 172.21.15.153:0/4098486214 wait complete. 2023-10-05T21:15:17.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.088+0000 7f6057b5b680 1 Processor -- start 2023-10-05T21:15:17.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.088+0000 7f6057b5b680 1 -- start start 2023-10-05T21:15:17.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.088+0000 7f6057b5b680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cb08f179f0 0x55cb08ec8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.088+0000 7f6057b5b680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb08ec8ed0 con 0x55cb08f179f0 2023-10-05T21:15:17.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.089+0000 7f604a432700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cb08f179f0 0x55cb08ec8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.089+0000 7f604a432700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cb08f179f0 0x55cb08ec8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50686/0 (socket says 172.21.15.153:50686) 2023-10-05T21:15:17.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.089+0000 7f604a432700 1 -- 172.21.15.153:0/4095878530 learned_addr learned my addr 172.21.15.153:0/4095878530 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:17.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.089+0000 7f604a432700 1 -- 172.21.15.153:0/4095878530 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb08ed0180 con 0x55cb08f179f0 2023-10-05T21:15:17.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.089+0000 7f604a432700 1 --2- 172.21.15.153:0/4095878530 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cb08f179f0 0x55cb08ec8990 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x55cb08f13260 tx=0x7f603c034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.089+0000 7f6019fe3700 1 -- 172.21.15.153:0/4095878530 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f603c025040 con 0x55cb08f179f0 2023-10-05T21:15:17.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.089+0000 7f6019fe3700 1 -- 172.21.15.153:0/4095878530 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603c02d760 con 0x55cb08f179f0 2023-10-05T21:15:17.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.089+0000 7f6019fe3700 1 -- 172.21.15.153:0/4095878530 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f603c02da10 con 0x55cb08f179f0 2023-10-05T21:15:17.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.089+0000 7f6057b5b680 1 -- 172.21.15.153:0/4095878530 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cb08ec6fb0 con 0x55cb08f179f0 2023-10-05T21:15:17.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.089+0000 7f6057b5b680 1 -- 172.21.15.153:0/4095878530 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cb08ec7460 con 0x55cb08f179f0 2023-10-05T21:15:17.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.090+0000 7f6019fe3700 1 -- 172.21.15.153:0/4095878530 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f603c02db70 con 0x55cb08f179f0 2023-10-05T21:15:17.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.090+0000 7f6019fe3700 1 --2- 172.21.15.153:0/4095878530 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5f90034140 0x7f5f900365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.090+0000 7f6019fe3700 1 -- 172.21.15.153:0/4095878530 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f603c04fb00 con 0x55cb08f179f0 2023-10-05T21:15:17.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.090+0000 7f6057b5b680 5 note: GC not initialized 2023-10-05T21:15:17.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.090+0000 7f604b434700 1 --2- 172.21.15.153:0/4095878530 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5f90034140 0x7f5f900365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.091+0000 7f604b434700 1 --2- 172.21.15.153:0/4095878530 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5f90034140 0x7f5f900365f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x55cb08f09ea0 tx=0x7f6044037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.091+0000 7f5f8affd700 20 reqs_thread_entry: start 2023-10-05T21:15:17.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.091+0000 7f5f88ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:17.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.091+0000 7f6057b5b680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:17.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.091+0000 7f6057b5b680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:17.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.091+0000 7f5f7effd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:47 2023 2023-10-05T21:15:17.130 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:17.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.092+0000 7f5f7e7fc700 20 reqs_thread_entry: start 2023-10-05T21:15:17.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.092+0000 7f6057b5b680 20 get_system_obj_state: rctx=0x7ffc35ee3278 obj=default.rgw.meta:users.uid:fud state=0x55cb08d7b240 s->prefetch_data=0 2023-10-05T21:15:17.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.092+0000 7f6057b5b680 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2023-10-05T21:15:17.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.092+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f861c0 con 0x7f603c007030 2023-10-05T21:15:17.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.092+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(102 fud [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.092+0000 7f6057b5b680 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x16 2023-10-05T21:15:17.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.092+0000 7f6057b5b680 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T21:15:17.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.092+0000 7f6057b5b680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:17.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.092+0000 7f6057b5b680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:17.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.092+0000 7f6057b5b680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:17.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.092+0000 7f6057b5b680 10 cache get: name=default.rgw.meta+users.uid+fud : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:17.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.092+0000 7f6057b5b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.092+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:103 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f889a0 con 0x7f603c007030 2023-10-05T21:15:17.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.092+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(103 fud [call,call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 273+0+469 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.092+0000 7f6057b5b680 20 rados_obj.operate() r=0 bl.length=346 2023-10-05T21:15:17.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.092+0000 7f6057b5b680 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2023-10-05T21:15:17.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.092+0000 7f6057b5b680 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T21:15:17.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.092+0000 7f6057b5b680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:17.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.092+0000 7f6057b5b680 20 get_system_obj_state: rctx=0x7ffc35ee2680 obj=default.rgw.meta:root:myfoo state=0x55cb08d7b240 s->prefetch_data=0 2023-10-05T21:15:17.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.092+0000 7f6057b5b680 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-10-05T21:15:17.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.092+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:104 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f87500 con 0x7f604000d5b0 2023-10-05T21:15:17.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.093+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(104 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv18 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f603c041040 con 0x7f604000d5b0 2023-10-05T21:15:17.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.093+0000 7f6057b5b680 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x16 2023-10-05T21:15:17.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.093+0000 7f6057b5b680 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:17.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.093+0000 7f6057b5b680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:17.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.093+0000 7f6057b5b680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:17.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.093+0000 7f6057b5b680 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x11, cached=0x16) 2023-10-05T21:15:17.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.093+0000 7f6057b5b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.093+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f8b040 con 0x7f604000d5b0 2023-10-05T21:15:17.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.093+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(105 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7f603c041040 con 0x7f604000d5b0 2023-10-05T21:15:17.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.093+0000 7f6057b5b680 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T21:15:17.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.093+0000 7f6057b5b680 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2023-10-05T21:15:17.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.093+0000 7f6057b5b680 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:17.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.093+0000 7f6057b5b680 20 get_system_obj_state: rctx=0x7ffc35ee2680 obj=default.rgw.meta:root:.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 state=0x55cb08d7b500 s->prefetch_data=0 2023-10-05T21:15:17.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.093+0000 7f6057b5b680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 : miss 2023-10-05T21:15:17.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.093+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:106 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f8a910 con 0x55cb08efce70 2023-10-05T21:15:17.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.094+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(106 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f604004b040 con 0x55cb08efce70 2023-10-05T21:15:17.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.094+0000 7f6057b5b680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 info.flags=0x16 2023-10-05T21:15:17.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.094+0000 7f6057b5b680 10 adding default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 to cache LRU end 2023-10-05T21:15:17.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.094+0000 7f6057b5b680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:17.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.094+0000 7f6057b5b680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:17.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.094+0000 7f6057b5b680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:17.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.094+0000 7f6057b5b680 20 Read xattr: user.rgw.acl 2023-10-05T21:15:17.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.094+0000 7f6057b5b680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:17.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.094+0000 7f6057b5b680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:17.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.094+0000 7f6057b5b680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.094+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f8d700 con 0x55cb08efce70 2023-10-05T21:15:17.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.094+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(107 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f604004b040 con 0x55cb08efce70 2023-10-05T21:15:17.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.094+0000 7f6057b5b680 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T21:15:17.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.094+0000 7f6057b5b680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 info.flags=0x13 2023-10-05T21:15:17.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.094+0000 7f6057b5b680 10 moving default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 to cache LRU end 2023-10-05T21:15:17.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.094+0000 7f6057b5b680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:17.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.094+0000 7f6057b5b680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:17.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.094+0000 7f6057b5b680 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 2023-10-05T21:15:17.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.094+0000 7f6057b5b680 20 get_system_obj_state: rctx=0x7ffc35ee2608 obj=default.rgw.meta:users.uid:fud state=0x55cb08d7b500 s->prefetch_data=0 2023-10-05T21:15:17.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.094+0000 7f6057b5b680 10 cache get: name=default.rgw.meta+users.uid+fud : type miss (requested=0x16, cached=0x13) 2023-10-05T21:15:17.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.094+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:108 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f8de30 con 0x7f603c007030 2023-10-05T21:15:17.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.095+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(108 fud [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.095+0000 7f6057b5b680 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x16 2023-10-05T21:15:17.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.095+0000 7f6057b5b680 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T21:15:17.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.095+0000 7f6057b5b680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:17.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.095+0000 7f6057b5b680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:17.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.095+0000 7f6057b5b680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:17.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.095+0000 7f6057b5b680 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x17) 2023-10-05T21:15:17.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.095+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:109 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f90340 con 0x7f604000d5b0 2023-10-05T21:15:17.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.096+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(109 foo.buckets [call] v29'19 uv17 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f603c041040 con 0x7f604000d5b0 2023-10-05T21:15:17.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.096+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:110 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f96210 con 0x55cb08efce70 2023-10-05T21:15:17.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.096+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(110 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v29'2 uv2 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7f604004b040 con 0x55cb08efce70 2023-10-05T21:15:17.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.096+0000 7f6057b5b680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 info.flags=0x17 2023-10-05T21:15:17.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.096+0000 7f6057b5b680 10 moving default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 to cache LRU end 2023-10-05T21:15:17.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.096+0000 7f6057b5b680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:17.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.096+0000 7f6057b5b680 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1, ofs0, ns] 2023-10-05T21:15:17.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.096+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:111 7.15 7:a93a5511:::notify.2:head [notify cookie 94330517283200 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f923e0 con 0x55cb08efce70 2023-10-05T21:15:17.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.097+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== watch-notify(notify (1) cookie 94330516690640 notify 124554051588 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x55cb08eef640 con 0x55cb08efce70 2023-10-05T21:15:17.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.097+0000 7f6048c2f700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051588 cookie 94330516690640 notifier 4454 bl.length()=725 2023-10-05T21:15:17.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.097+0000 7f6048c2f700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 info.flags=0x17 2023-10-05T21:15:17.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.097+0000 7f6048c2f700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 to cache LRU end 2023-10-05T21:15:17.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.097+0000 7f6048c2f700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:17.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.097+0000 7f6048c2f700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:112 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f6028003d90 con 0x55cb08efce70 2023-10-05T21:15:17.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.097+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(111 notify.2 [notify cookie 94330517283200 out=8b] v0'0 uv114 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f604004b040 con 0x55cb08efce70 2023-10-05T21:15:17.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.097+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 31 ==== osd_op_reply(112 notify.2 [notify-ack] v0'0 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f604004b040 con 0x55cb08efce70 2023-10-05T21:15:17.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.097+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 32 ==== watch-notify(notify_complete (2) cookie 94330517283200 notify 124554051588 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55cb08eef170 con 0x55cb08efce70 2023-10-05T21:15:17.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.097+0000 7f6057b5b680 20 handle_bi_update(): bucket=:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1]): orig_sources= new_sources= 2023-10-05T21:15:17.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.097+0000 7f6057b5b680 20 handle_bi_update(): bucket=:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1]): potential sources added=[] removed=[] 2023-10-05T21:15:17.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.097+0000 7f6057b5b680 20 handle_bi_update(): bucket=:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1]): orig_dests= new_dests= 2023-10-05T21:15:17.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.097+0000 7f6057b5b680 20 handle_bi_update(): bucket=:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1]): potential dests added=[] removed=[] 2023-10-05T21:15:17.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.097+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:113 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f960f0 con 0x7f603c007030 2023-10-05T21:15:17.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.099+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(113 fud.buckets [call] v29'1 uv1 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.099+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:114 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f960f0 con 0x7f604000d5b0 2023-10-05T21:15:17.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.100+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(114 myfoo [delete,create,call,writefull 0~165] v29'20 uv20 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7f603c041040 con 0x7f604000d5b0 2023-10-05T21:15:17.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.100+0000 7f6057b5b680 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2023-10-05T21:15:17.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.100+0000 7f6057b5b680 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:17.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.100+0000 7f6057b5b680 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2023-10-05T21:15:17.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.100+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:115 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94330517272160 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f942b0 con 0x7f603c007030 2023-10-05T21:15:17.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.100+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 31 ==== watch-notify(notify (1) cookie 94330516699392 notify 124554051596 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x7f604402d040 con 0x7f603c007030 2023-10-05T21:15:17.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.100+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 32 ==== osd_op_reply(115 notify.6 [notify cookie 94330517272160 out=8b] v0'0 uv114 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.100+0000 7f603bfff700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051596 cookie 94330516699392 notifier 4454 bl.length()=314 2023-10-05T21:15:17.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.100+0000 7f603bfff700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2023-10-05T21:15:17.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.100+0000 7f603bfff700 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:17.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.100+0000 7f603bfff700 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:116 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f5f98003400 con 0x7f603c007030 2023-10-05T21:15:17.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.100+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 33 ==== watch-notify(notify_complete (2) cookie 94330517272160 notify 124554051596 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f6044037d20 con 0x7f603c007030 2023-10-05T21:15:17.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.100+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 34 ==== osd_op_reply(116 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.101+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:117 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94330516685120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f942b0 con 0x7f604000d5b0 2023-10-05T21:15:17.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.101+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== osd_op_reply(117 notify.0 [watch unwatch cookie 94330516685120] v29'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f603c041040 con 0x7f604000d5b0 2023-10-05T21:15:17.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.101+0000 7f6057b5b680 20 remove_watcher() i=0 2023-10-05T21:15:17.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.101+0000 7f6057b5b680 2 removed watcher, disabling cache 2023-10-05T21:15:17.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.101+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:118 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94330516688432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f942b0 con 0x55cb08ecc750 2023-10-05T21:15:17.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.102+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(118 notify.1 [watch unwatch cookie 94330516688432] v29'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.102+0000 7f6057b5b680 20 remove_watcher() i=1 2023-10-05T21:15:17.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.102+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:119 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94330516690640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f942b0 con 0x55cb08efce70 2023-10-05T21:15:17.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.103+0000 7f604ac33700 1 -- 172.21.15.153:0/3903492157 <== osd.3 v2:172.21.15.153:6800/140455 33 ==== osd_op_reply(119 notify.2 [watch unwatch cookie 94330516690640] v29'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f604004b040 con 0x55cb08efce70 2023-10-05T21:15:17.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.103+0000 7f6057b5b680 20 remove_watcher() i=2 2023-10-05T21:15:17.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.103+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:120 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94330516696208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f942b0 con 0x7f604000d5b0 2023-10-05T21:15:17.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.104+0000 7f604a432700 1 -- 172.21.15.153:0/3903492157 <== osd.2 v2:172.21.15.153:6807/140454 22 ==== osd_op_reply(120 notify.3 [watch unwatch cookie 94330516696208] v29'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f603c041040 con 0x7f604000d5b0 2023-10-05T21:15:17.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.104+0000 7f6057b5b680 20 remove_watcher() i=3 2023-10-05T21:15:17.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.104+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:121 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94330516701392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f942b0 con 0x55cb08ecc750 2023-10-05T21:15:17.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.104+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(121 notify.4 [watch unwatch cookie 94330516701392] v29'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.104+0000 7f6057b5b680 20 remove_watcher() i=4 2023-10-05T21:15:17.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.104+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:122 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94330516705024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f942b0 con 0x7f603c007030 2023-10-05T21:15:17.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.105+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 35 ==== osd_op_reply(122 notify.5 [watch unwatch cookie 94330516705024] v29'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.105+0000 7f6057b5b680 20 remove_watcher() i=5 2023-10-05T21:15:17.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.105+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:123 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94330516699392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f942b0 con 0x7f603c007030 2023-10-05T21:15:17.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.106+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 36 ==== osd_op_reply(123 notify.6 [watch unwatch cookie 94330516699392] v29'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.106+0000 7f6057b5b680 20 remove_watcher() i=6 2023-10-05T21:15:17.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.106+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:124 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94330516710448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f942b0 con 0x7f603c007030 2023-10-05T21:15:17.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.106+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.0 v2:172.21.15.111:6800/111394 37 ==== osd_op_reply(124 notify.7 [watch unwatch cookie 94330516710448] v29'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f604400a570 con 0x7f603c007030 2023-10-05T21:15:17.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.106+0000 7f6057b5b680 20 remove_watcher() i=7 2023-10-05T21:15:17.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.107+0000 7f601bfe7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:17.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.107+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:125 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94330516707872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cb08f04e30 con 0x55cb08ecc750 2023-10-05T21:15:17.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.108+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(125 data_loggenerations_metadata [watch unwatch cookie 94330516707872] v29'111 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f604400a570 con 0x55cb08ecc750 2023-10-05T21:15:17.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.108+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f603c007030 msgr2=0x7f603c01d430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.108+0000 7f6057b5b680 1 --2- 172.21.15.153:0/3903492157 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f603c007030 0x7f603c01d430 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.108+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55cb08ecc750 msgr2=0x55cb08efaa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.108+0000 7f6057b5b680 1 --2- 172.21.15.153:0/3903492157 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55cb08ecc750 0x55cb08efaa00 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.108+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f604000d5b0 msgr2=0x7f6040046130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.108+0000 7f6057b5b680 1 --2- 172.21.15.153:0/3903492157 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f604000d5b0 0x7f6040046130 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.108+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55cb08efce70 msgr2=0x55cb08eff250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.108+0000 7f6057b5b680 1 --2- 172.21.15.153:0/3903492157 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55cb08efce70 0x55cb08eff250 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.108+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f60300340e0 msgr2=0x7f6030036590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.108+0000 7f6057b5b680 1 --2- 172.21.15.153:0/3903492157 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f60300340e0 0x7f6030036590 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f603c005a90 tx=0x7f603c014000 comp rx=0 tx=0).stop 2023-10-05T21:15:17.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.108+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cb08e3c040 msgr2=0x55cb08eeec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.108+0000 7f6057b5b680 1 --2- 172.21.15.153:0/3903492157 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cb08e3c040 0x55cb08eeec30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6040010000 tx=0x7f6040014000 comp rx=0 tx=0).stop 2023-10-05T21:15:17.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.108+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 reap_dead start 2023-10-05T21:15:17.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.108+0000 7f604b434700 1 -- 172.21.15.153:0/3903492157 reap_dead start 2023-10-05T21:15:17.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.108+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 shutdown_connections 2023-10-05T21:15:17.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.108+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 >> 172.21.15.153:0/3903492157 conn(0x55cb08ec2b20 msgr2=0x55cb08ee1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.108+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 shutdown_connections 2023-10-05T21:15:17.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.108+0000 7f6057b5b680 1 -- 172.21.15.153:0/3903492157 wait complete. 2023-10-05T21:15:17.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.109+0000 7f6057b5b680 1 -- 172.21.15.153:0/4095878530 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5f90034140 msgr2=0x7f5f900365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.109+0000 7f6057b5b680 1 --2- 172.21.15.153:0/4095878530 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5f90034140 0x7f5f900365f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x55cb08f09ea0 tx=0x7f6044037450 comp rx=0 tx=0).stop 2023-10-05T21:15:17.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.109+0000 7f6057b5b680 1 -- 172.21.15.153:0/4095878530 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cb08f179f0 msgr2=0x55cb08ec8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.109+0000 7f6057b5b680 1 --2- 172.21.15.153:0/4095878530 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cb08f179f0 0x55cb08ec8990 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x55cb08f13260 tx=0x7f603c034000 comp rx=0 tx=0).stop 2023-10-05T21:15:17.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.109+0000 7f6057b5b680 1 -- 172.21.15.153:0/4095878530 shutdown_connections 2023-10-05T21:15:17.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.109+0000 7f6057b5b680 1 --2- 172.21.15.153:0/4095878530 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5f90034140 0x7f5f900365f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.109+0000 7f6057b5b680 1 --2- 172.21.15.153:0/4095878530 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cb08f179f0 0x55cb08ec8990 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.109+0000 7f6057b5b680 1 -- 172.21.15.153:0/4095878530 >> 172.21.15.153:0/4095878530 conn(0x55cb08f13cf0 msgr2=0x55cb08f11dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.109+0000 7f6057b5b680 1 -- 172.21.15.153:0/4095878530 shutdown_connections 2023-10-05T21:15:17.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.109+0000 7f6057b5b680 1 -- 172.21.15.153:0/4095878530 wait complete. 2023-10-05T21:15:17.144 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2023-10-05T21:15:17.144 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2023-10-05T21:15:17.144 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2023-10-05T21:15:17.188 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:17.188 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:17.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.187+0000 7f9267829680 1 Processor -- start 2023-10-05T21:15:17.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.187+0000 7f9267829680 1 -- start start 2023-10-05T21:15:17.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.187+0000 7f9267829680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x56247902c2b0 0x56247902c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.187+0000 7f9267829680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562478f7a990 con 0x56247902cc00 2023-10-05T21:15:17.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.187+0000 7f9267829680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x562478f3adb0 con 0x56247902c2b0 2023-10-05T21:15:17.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.188+0000 7f925a901700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x56247902c2b0 0x56247902c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.188+0000 7f925a100700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x56247902cc00 0x56247902d5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:56492/0 (socket says 172.21.15.153:56492) 2023-10-05T21:15:17.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.188+0000 7f925a100700 1 -- 172.21.15.153:0/1176438159 learned_addr learned my addr 172.21.15.153:0/1176438159 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:17.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.188+0000 7f92598ff700 1 -- 172.21.15.153:0/1176438159 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2108097533 0 0) 0x562478f7a990 con 0x56247902cc00 2023-10-05T21:15:17.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.188+0000 7f92598ff700 1 -- 172.21.15.153:0/1176438159 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9244001e10 con 0x56247902cc00 2023-10-05T21:15:17.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.188+0000 7f925a901700 1 -- 172.21.15.153:0/1176438159 >> v1:172.21.15.111:6789/0 conn(0x56247902cc00 legacy=0x56247902d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.188+0000 7f925a901700 1 -- 172.21.15.153:0/1176438159 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56247902dea0 con 0x56247902c2b0 2023-10-05T21:15:17.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.188+0000 7f925a901700 1 --2- 172.21.15.153:0/1176438159 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56247902c2b0 0x56247902c6c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f925000a5d0 tx=0x7f9250005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea831628de774e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.188+0000 7f92598ff700 1 -- 172.21.15.153:0/1176438159 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9250007610 con 0x56247902c2b0 2023-10-05T21:15:17.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.188+0000 7f92598ff700 1 -- 172.21.15.153:0/1176438159 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9250007770 con 0x56247902c2b0 2023-10-05T21:15:17.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.188+0000 7f92598ff700 1 -- 172.21.15.153:0/1176438159 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9250007a20 con 0x56247902c2b0 2023-10-05T21:15:17.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.189+0000 7f9267829680 1 -- 172.21.15.153:0/1176438159 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56247902c2b0 msgr2=0x56247902c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.189+0000 7f9267829680 1 --2- 172.21.15.153:0/1176438159 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56247902c2b0 0x56247902c6c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f925000a5d0 tx=0x7f9250005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:17.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.189+0000 7f9267829680 1 -- 172.21.15.153:0/1176438159 shutdown_connections 2023-10-05T21:15:17.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.189+0000 7f9267829680 1 --2- 172.21.15.153:0/1176438159 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56247902c2b0 0x56247902c6c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.189+0000 7f9267829680 1 -- 172.21.15.153:0/1176438159 >> 172.21.15.153:0/1176438159 conn(0x562479027b80 msgr2=0x562479029f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.189+0000 7f9267829680 1 -- 172.21.15.153:0/1176438159 shutdown_connections 2023-10-05T21:15:17.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.189+0000 7f9267829680 1 -- 172.21.15.153:0/1176438159 wait complete. 2023-10-05T21:15:17.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.190+0000 7f9267829680 1 Processor -- start 2023-10-05T21:15:17.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.190+0000 7f9267829680 1 -- start start 2023-10-05T21:15:17.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.190+0000 7f9267829680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56247902c2b0 0x562478fa0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.190+0000 7f9267829680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x562478edaea0 con 0x56247902c2b0 2023-10-05T21:15:17.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.190+0000 7f925a901700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56247902c2b0 0x562478fa0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.190+0000 7f925a901700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56247902c2b0 0x562478fa0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50718/0 (socket says 172.21.15.153:50718) 2023-10-05T21:15:17.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.190+0000 7f925a901700 1 -- 172.21.15.153:0/3779753460 learned_addr learned my addr 172.21.15.153:0/3779753460 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:17.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.190+0000 7f925a901700 1 -- 172.21.15.153:0/3779753460 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9250005cf0 con 0x56247902c2b0 2023-10-05T21:15:17.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.190+0000 7f925a901700 1 --2- 172.21.15.153:0/3779753460 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56247902c2b0 0x562478fa0fe0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f925000a520 tx=0x7f9250014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470ea9ba0b188d40 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.191+0000 7f92588fd700 1 -- 172.21.15.153:0/3779753460 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92500078e0 con 0x56247902c2b0 2023-10-05T21:15:17.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.191+0000 7f92588fd700 1 -- 172.21.15.153:0/3779753460 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9250007a40 con 0x56247902c2b0 2023-10-05T21:15:17.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.191+0000 7f92588fd700 1 -- 172.21.15.153:0/3779753460 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9250007bf0 con 0x56247902c2b0 2023-10-05T21:15:17.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.191+0000 7f9267829680 1 -- 172.21.15.153:0/3779753460 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56247902c2b0 msgr2=0x562478fa0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.191+0000 7f9267829680 1 --2- 172.21.15.153:0/3779753460 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56247902c2b0 0x562478fa0fe0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f925000a520 tx=0x7f9250014000 comp rx=0 tx=0).stop 2023-10-05T21:15:17.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.191+0000 7f9267829680 1 -- 172.21.15.153:0/3779753460 shutdown_connections 2023-10-05T21:15:17.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.191+0000 7f9267829680 1 --2- 172.21.15.153:0/3779753460 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56247902c2b0 0x562478fa0fe0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.191+0000 7f9267829680 1 -- 172.21.15.153:0/3779753460 >> 172.21.15.153:0/3779753460 conn(0x562479027b80 msgr2=0x562479047080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.191+0000 7f9267829680 1 -- 172.21.15.153:0/3779753460 shutdown_connections 2023-10-05T21:15:17.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.191+0000 7f9267829680 1 -- 172.21.15.153:0/3779753460 wait complete. 2023-10-05T21:15:17.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.191+0000 7f9267829680 1 Processor -- start 2023-10-05T21:15:17.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.191+0000 7f9267829680 1 -- start start 2023-10-05T21:15:17.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.192+0000 7f9267829680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56247902c2b0 0x562479053b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.192+0000 7f9267829680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x562478ed1c80 con 0x56247902c2b0 2023-10-05T21:15:17.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.192+0000 7f925a901700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56247902c2b0 0x562479053b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.192+0000 7f925a901700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56247902c2b0 0x562479053b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50724/0 (socket says 172.21.15.153:50724) 2023-10-05T21:15:17.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.192+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 learned_addr learned my addr 172.21.15.153:0/3542130596 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:17.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.192+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56247902dea0 con 0x56247902c2b0 2023-10-05T21:15:17.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.192+0000 7f925a901700 1 --2- 172.21.15.153:0/3542130596 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56247902c2b0 0x562479053b40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f925001f040 tx=0x7f925001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.192+0000 7f924affd700 1 -- 172.21.15.153:0/3542130596 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92500078e0 con 0x56247902c2b0 2023-10-05T21:15:17.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.192+0000 7f924affd700 1 -- 172.21.15.153:0/3542130596 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9250029070 con 0x56247902c2b0 2023-10-05T21:15:17.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.192+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562479054080 con 0x56247902c2b0 2023-10-05T21:15:17.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.192+0000 7f924affd700 1 -- 172.21.15.153:0/3542130596 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9250030480 con 0x56247902c2b0 2023-10-05T21:15:17.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.192+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5624790544d0 con 0x56247902c2b0 2023-10-05T21:15:17.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.193+0000 7f924affd700 1 -- 172.21.15.153:0/3542130596 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f9250012400 con 0x56247902c2b0 2023-10-05T21:15:17.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.193+0000 7f9267829680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.193+0000 7f924affd700 1 --2- 172.21.15.153:0/3542130596 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f92400340f0 0x7f92400365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.193+0000 7f924affd700 1 -- 172.21.15.153:0/3542130596 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f925002b070 con 0x56247902c2b0 2023-10-05T21:15:17.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.193+0000 7f925a100700 1 --2- 172.21.15.153:0/3542130596 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f92400340f0 0x7f92400365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.193+0000 7f9267829680 1 --2- 172.21.15.153:0/3542130596 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x56247905d840 0x56247905fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.194+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479060430 con 0x56247905d840 2023-10-05T21:15:17.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.194+0000 7f925b102700 1 --2- 172.21.15.153:0/3542130596 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x56247905d840 0x56247905fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.194+0000 7f925a100700 1 --2- 172.21.15.153:0/3542130596 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f92400340f0 0x7f92400365a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f924c004170 tx=0x7f924c001360 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.194+0000 7f925b102700 1 --2- 172.21.15.153:0/3542130596 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x56247905d840 0x56247905fca0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.194+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.194+0000 7f9267829680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.194+0000 7f9267829680 20 realm 2023-10-05T21:15:17.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.194+0000 7f9267829680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.194+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247905ceb0 con 0x56247905d840 2023-10-05T21:15:17.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.194+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.194+0000 7f9267829680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.194+0000 7f9267829680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:17.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.194+0000 7f9267829680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.194+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479060f30 con 0x56247905d840 2023-10-05T21:15:17.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.195+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.195+0000 7f9267829680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.195+0000 7f9267829680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.195+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479061850 con 0x56247905d840 2023-10-05T21:15:17.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.195+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.195+0000 7f9267829680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.195+0000 7f9267829680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.195+0000 7f9267829680 1 --2- 172.21.15.153:0/3542130596 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x562479062110 0x5624790644f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.195+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479064b40 con 0x562479062110 2023-10-05T21:15:17.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.195+0000 7f925a901700 1 --2- 172.21.15.153:0/3542130596 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x562479062110 0x5624790644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.195+0000 7f925a901700 1 --2- 172.21.15.153:0/3542130596 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x562479062110 0x5624790644f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.196+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f9250030db0 con 0x562479062110 2023-10-05T21:15:17.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.196+0000 7f9267829680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:17.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.196+0000 7f9267829680 20 searching for the correct realm 2023-10-05T21:15:17.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.196+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x562479062110 2023-10-05T21:15:17.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.196+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9250030db0 con 0x562479062110 2023-10-05T21:15:17.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.196+0000 7f925a901700 1 --2- 172.21.15.153:0/3542130596 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f9250007030 0x7f9250030650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.196+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x7f9250007030 2023-10-05T21:15:17.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.196+0000 7f925a100700 1 --2- 172.21.15.153:0/3542130596 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f9250007030 0x7f9250030650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.196+0000 7f925a100700 1 --2- 172.21.15.153:0/3542130596 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f9250007030 0x7f9250030650 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.197+0000 7f925a100700 1 -- 172.21.15.153:0/3542130596 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f924c006070 con 0x7f9250007030 2023-10-05T21:15:17.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.197+0000 7f925a100700 1 --2- 172.21.15.153:0/3542130596 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f924c00ebe0 0x7f924c00d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.197+0000 7f925a100700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x7f924c00ebe0 2023-10-05T21:15:17.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.197+0000 7f925b102700 1 --2- 172.21.15.153:0/3542130596 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f924c00ebe0 0x7f924c00d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.197+0000 7f925b102700 1 --2- 172.21.15.153:0/3542130596 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f924c00ebe0 0x7f924c00d8e0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.197+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.197+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x56247905d840 2023-10-05T21:15:17.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.198+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.198+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x56247905d840 2023-10-05T21:15:17.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.198+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.198+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x7f924c00ebe0 2023-10-05T21:15:17.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.198+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.198+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x7f924c00ebe0 2023-10-05T21:15:17.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.198+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.198+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x7f9250007030 2023-10-05T21:15:17.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.198+0000 7f925a100700 1 -- 172.21.15.153:0/3542130596 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f924c006070 con 0x7f9250007030 2023-10-05T21:15:17.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.198+0000 7f925a100700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x562479062110 2023-10-05T21:15:17.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.199+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9250030db0 con 0x562479062110 2023-10-05T21:15:17.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.199+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x56247905d840 2023-10-05T21:15:17.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.199+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.199+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x7f924c00ebe0 2023-10-05T21:15:17.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.199+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.199+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x56247905d840 2023-10-05T21:15:17.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.199+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.199+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x7f9250007030 2023-10-05T21:15:17.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.199+0000 7f925a100700 1 -- 172.21.15.153:0/3542130596 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f924c006070 con 0x7f9250007030 2023-10-05T21:15:17.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.200+0000 7f925a100700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x562479062110 2023-10-05T21:15:17.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.200+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9250030db0 con 0x562479062110 2023-10-05T21:15:17.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.200+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x562479062110 2023-10-05T21:15:17.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.200+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9250030db0 con 0x562479062110 2023-10-05T21:15:17.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.200+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x7f924c00ebe0 2023-10-05T21:15:17.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.200+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.200+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x562479062110 2023-10-05T21:15:17.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.200+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9250030db0 con 0x562479062110 2023-10-05T21:15:17.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.200+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x562479062110 2023-10-05T21:15:17.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.201+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9250030db0 con 0x562479062110 2023-10-05T21:15:17.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.201+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x56247905d840 2023-10-05T21:15:17.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.201+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.201+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x56247905d840 2023-10-05T21:15:17.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.201+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.201+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x7f924c00ebe0 2023-10-05T21:15:17.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.201+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.201+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x562479062110 2023-10-05T21:15:17.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.201+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9250030db0 con 0x562479062110 2023-10-05T21:15:17.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.201+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x7f9250007030 2023-10-05T21:15:17.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.202+0000 7f925a100700 1 -- 172.21.15.153:0/3542130596 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f924c006070 con 0x7f9250007030 2023-10-05T21:15:17.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.202+0000 7f925a100700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x56247905d840 2023-10-05T21:15:17.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.202+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.202+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x7f924c00ebe0 2023-10-05T21:15:17.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.202+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.202+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x562479062110 2023-10-05T21:15:17.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.202+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9250030db0 con 0x562479062110 2023-10-05T21:15:17.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.202+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x7f924c00ebe0 2023-10-05T21:15:17.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.203+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.203+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x7f9250007030 2023-10-05T21:15:17.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.203+0000 7f925a100700 1 -- 172.21.15.153:0/3542130596 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f924c006070 con 0x7f9250007030 2023-10-05T21:15:17.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.203+0000 7f925a100700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x562479062110 2023-10-05T21:15:17.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.203+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9250030db0 con 0x562479062110 2023-10-05T21:15:17.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.203+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x7f924c00ebe0 2023-10-05T21:15:17.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.203+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.203+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x56247905d840 2023-10-05T21:15:17.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.204+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.204+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066460 con 0x7f9250007030 2023-10-05T21:15:17.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.204+0000 7f925a100700 1 -- 172.21.15.153:0/3542130596 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f924c006070 con 0x7f9250007030 2023-10-05T21:15:17.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.204+0000 7f9267829680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:17.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.204+0000 7f9267829680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:17.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.204+0000 7f9267829680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:17.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.204+0000 7f9267829680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:17.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.204+0000 7f9267829680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.204+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479065550 con 0x56247905d840 2023-10-05T21:15:17.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.204+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.204+0000 7f9267829680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.204+0000 7f9267829680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.204+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479065e40 con 0x56247905d840 2023-10-05T21:15:17.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.204+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.204+0000 7f9267829680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.204+0000 7f9267829680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.204+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066810 con 0x56247905d840 2023-10-05T21:15:17.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.204+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.204+0000 7f9267829680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:17.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.204+0000 7f9267829680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.205+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066bc0 con 0x562479062110 2023-10-05T21:15:17.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.205+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f9250030db0 con 0x562479062110 2023-10-05T21:15:17.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.205+0000 7f9267829680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.205+0000 7f9267829680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.205+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066f70 con 0x56247905d840 2023-10-05T21:15:17.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.205+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.205+0000 7f9267829680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.205+0000 7f9267829680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.205+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066f70 con 0x56247905d840 2023-10-05T21:15:17.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.205+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.205+0000 7f9267829680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.205+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479067f80 con 0x562479062110 2023-10-05T21:15:17.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.205+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9250030db0 con 0x562479062110 2023-10-05T21:15:17.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.205+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479067f80 con 0x7f9250007030 2023-10-05T21:15:17.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.206+0000 7f925a100700 1 -- 172.21.15.153:0/3542130596 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f924c006070 con 0x7f9250007030 2023-10-05T21:15:17.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.206+0000 7f925a100700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479067f80 con 0x7f924c00ebe0 2023-10-05T21:15:17.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.206+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.206+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066810 con 0x56247905d840 2023-10-05T21:15:17.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.206+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.206+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066810 con 0x56247905d840 2023-10-05T21:15:17.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.206+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.206+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066810 con 0x7f924c00ebe0 2023-10-05T21:15:17.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.207+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.207+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066810 con 0x7f924c00ebe0 2023-10-05T21:15:17.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.207+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.207+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066810 con 0x7f9250007030 2023-10-05T21:15:17.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.207+0000 7f925a100700 1 -- 172.21.15.153:0/3542130596 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f924c006070 con 0x7f9250007030 2023-10-05T21:15:17.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.207+0000 7f925a100700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066810 con 0x562479062110 2023-10-05T21:15:17.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.207+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9250030db0 con 0x562479062110 2023-10-05T21:15:17.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.207+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066810 con 0x56247905d840 2023-10-05T21:15:17.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.208+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.208+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066810 con 0x7f924c00ebe0 2023-10-05T21:15:17.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.208+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.208+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066810 con 0x56247905d840 2023-10-05T21:15:17.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.208+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.208+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066810 con 0x7f9250007030 2023-10-05T21:15:17.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.208+0000 7f925a100700 1 -- 172.21.15.153:0/3542130596 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f924c006070 con 0x7f9250007030 2023-10-05T21:15:17.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.208+0000 7f925a100700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066810 con 0x562479062110 2023-10-05T21:15:17.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.209+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9250030db0 con 0x562479062110 2023-10-05T21:15:17.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.209+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066810 con 0x562479062110 2023-10-05T21:15:17.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.209+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9250030db0 con 0x562479062110 2023-10-05T21:15:17.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.209+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066810 con 0x7f924c00ebe0 2023-10-05T21:15:17.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.209+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.209+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066810 con 0x562479062110 2023-10-05T21:15:17.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.209+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9250030db0 con 0x562479062110 2023-10-05T21:15:17.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.209+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066810 con 0x562479062110 2023-10-05T21:15:17.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.209+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9250030db0 con 0x562479062110 2023-10-05T21:15:17.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.209+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066810 con 0x56247905d840 2023-10-05T21:15:17.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.210+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.210+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066810 con 0x56247905d840 2023-10-05T21:15:17.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.210+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.210+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066810 con 0x7f924c00ebe0 2023-10-05T21:15:17.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.210+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.210+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066810 con 0x562479062110 2023-10-05T21:15:17.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.210+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9250030db0 con 0x562479062110 2023-10-05T21:15:17.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.210+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066810 con 0x7f9250007030 2023-10-05T21:15:17.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.211+0000 7f925a100700 1 -- 172.21.15.153:0/3542130596 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f924c006070 con 0x7f9250007030 2023-10-05T21:15:17.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.211+0000 7f925a100700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066810 con 0x56247905d840 2023-10-05T21:15:17.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.211+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.211+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066810 con 0x7f924c00ebe0 2023-10-05T21:15:17.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.211+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.211+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066810 con 0x562479062110 2023-10-05T21:15:17.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.211+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9250030db0 con 0x562479062110 2023-10-05T21:15:17.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.211+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066810 con 0x7f924c00ebe0 2023-10-05T21:15:17.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.211+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.211+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066810 con 0x7f9250007030 2023-10-05T21:15:17.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.212+0000 7f925a100700 1 -- 172.21.15.153:0/3542130596 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f924c006070 con 0x7f9250007030 2023-10-05T21:15:17.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.212+0000 7f925a100700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066810 con 0x562479062110 2023-10-05T21:15:17.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.212+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9250030db0 con 0x562479062110 2023-10-05T21:15:17.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.212+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066810 con 0x7f924c00ebe0 2023-10-05T21:15:17.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.212+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.212+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066810 con 0x56247905d840 2023-10-05T21:15:17.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.212+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.212+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066810 con 0x7f9250007030 2023-10-05T21:15:17.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.212+0000 7f925a100700 1 -- 172.21.15.153:0/3542130596 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f924c006070 con 0x7f9250007030 2023-10-05T21:15:17.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.212+0000 7f9267829680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:17.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.212+0000 7f9267829680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:17.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.212+0000 7f9267829680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:17.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.212+0000 7f9267829680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:17.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.213+0000 7f9267829680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.213+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479066f70 con 0x56247905d840 2023-10-05T21:15:17.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.213+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.213+0000 7f9267829680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.213+0000 7f9267829680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.213+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479067320 con 0x562479062110 2023-10-05T21:15:17.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.213+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f9250030db0 con 0x562479062110 2023-10-05T21:15:17.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.213+0000 7f9267829680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:17.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.213+0000 7f9267829680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.213+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479067bc0 con 0x56247905d840 2023-10-05T21:15:17.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.213+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.213+0000 7f9267829680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.213+0000 7f9267829680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.213+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479067bc0 con 0x56247905d840 2023-10-05T21:15:17.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.213+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.213+0000 7f9267829680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:17.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.213+0000 7f9267829680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.213+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479067cc0 con 0x7f924c00ebe0 2023-10-05T21:15:17.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.214+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.214+0000 7f9267829680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.214+0000 7f9267829680 20 zone default found 2023-10-05T21:15:17.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.214+0000 7f9267829680 4 Realm: () 2023-10-05T21:15:17.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.214+0000 7f9267829680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:17.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.214+0000 7f9267829680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:17.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.214+0000 7f9267829680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:17.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.214+0000 7f9267829680 20 zonegroup default 2023-10-05T21:15:17.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.214+0000 7f9267829680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.214+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479067cc0 con 0x7f924c00ebe0 2023-10-05T21:15:17.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.214+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.214+0000 7f9267829680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.214+0000 7f9267829680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.214+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479069640 con 0x562479062110 2023-10-05T21:15:17.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.214+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9250030db0 con 0x562479062110 2023-10-05T21:15:17.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.214+0000 7f9267829680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.214+0000 7f9267829680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.214+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5624790699f0 con 0x562479062110 2023-10-05T21:15:17.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.215+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9250030db0 con 0x562479062110 2023-10-05T21:15:17.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.215+0000 7f9267829680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.215+0000 7f9267829680 20 started sync module instance, tier type = 2023-10-05T21:15:17.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.215+0000 7f9267829680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:17.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.215+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479068d50 con 0x7f9250007030 2023-10-05T21:15:17.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.215+0000 7f925a100700 1 -- 172.21.15.153:0/3542130596 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f924c006070 con 0x7f9250007030 2023-10-05T21:15:17.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.216+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94714649284944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247906a290 con 0x7f9250007030 2023-10-05T21:15:17.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.216+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247906ab30 con 0x56247905d840 2023-10-05T21:15:17.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.216+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.216+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94714649290592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247906b160 con 0x56247905d840 2023-10-05T21:15:17.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.216+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247906bd60 con 0x562479062110 2023-10-05T21:15:17.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.216+0000 7f925a100700 1 -- 172.21.15.153:0/3542130596 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94714649284944] v29'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f924c006070 con 0x7f9250007030 2023-10-05T21:15:17.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.217+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94714649290592] v29'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.217+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9250030db0 con 0x562479062110 2023-10-05T21:15:17.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.217+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94714649291696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479069da0 con 0x562479062110 2023-10-05T21:15:17.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.217+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247906c650 con 0x7f9250007030 2023-10-05T21:15:17.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.218+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94714649291696] v29'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9250030db0 con 0x562479062110 2023-10-05T21:15:17.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.218+0000 7f925a100700 1 -- 172.21.15.153:0/3542130596 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f924c006070 con 0x7f9250007030 2023-10-05T21:15:17.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.218+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94714649297248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247906ca00 con 0x7f9250007030 2023-10-05T21:15:17.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.218+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247906d2a0 con 0x56247905d840 2023-10-05T21:15:17.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.219+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.219+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94714649300992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247906db90 con 0x56247905d840 2023-10-05T21:15:17.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.219+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247906e740 con 0x7f924c00ebe0 2023-10-05T21:15:17.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.219+0000 7f925a100700 1 -- 172.21.15.153:0/3542130596 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94714649297248] v29'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f924c006070 con 0x7f9250007030 2023-10-05T21:15:17.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.219+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94714649300992] v29'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.219+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.219+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94714649305584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247906d650 con 0x7f924c00ebe0 2023-10-05T21:15:17.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.220+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247906d650 con 0x7f924c00ebe0 2023-10-05T21:15:17.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.220+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94714649305584] v29'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.220+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.220+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94714649294832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247906d650 con 0x7f924c00ebe0 2023-10-05T21:15:17.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.220+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247906f640 con 0x7f924c00ebe0 2023-10-05T21:15:17.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.221+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(98 notify.7 [create] v29'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.221+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(97 notify.6 [watch watch cookie 94714649294832] v29'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.221+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94714649309456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247906f560 con 0x7f924c00ebe0 2023-10-05T21:15:17.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.221+0000 7f9267829680 20 add_watcher() i=0 2023-10-05T21:15:17.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.221+0000 7f9267829680 20 add_watcher() i=1 2023-10-05T21:15:17.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.221+0000 7f9267829680 20 add_watcher() i=2 2023-10-05T21:15:17.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.221+0000 7f9267829680 20 add_watcher() i=3 2023-10-05T21:15:17.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.221+0000 7f9267829680 20 add_watcher() i=4 2023-10-05T21:15:17.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.221+0000 7f9267829680 20 add_watcher() i=5 2023-10-05T21:15:17.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.221+0000 7f9267829680 20 add_watcher() i=6 2023-10-05T21:15:17.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.222+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94714649309456] v29'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.222+0000 7f9267829680 20 add_watcher() i=7 2023-10-05T21:15:17.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.222+0000 7f9267829680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:17.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.222+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479072a00 con 0x56247905d840 2023-10-05T21:15:17.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.222+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.222+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94714649307504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247906fec0 con 0x56247905d840 2023-10-05T21:15:17.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.223+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94714649307504] v29'112 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.223+0000 7f922bfe7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:17.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.223+0000 7f9267829680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:17.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.223+0000 7f9267829680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:17.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.223+0000 7f9267829680 1 Processor -- start 2023-10-05T21:15:17.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.223+0000 7f9267829680 1 -- start start 2023-10-05T21:15:17.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.223+0000 7f9267829680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56247907c620 0x56247907ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.223+0000 7f9267829680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x56247907d040 con 0x56247907c620 2023-10-05T21:15:17.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.224+0000 7f925a100700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56247907c620 0x56247907ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.224+0000 7f925a100700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56247907c620 0x56247907ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50728/0 (socket says 172.21.15.153:50728) 2023-10-05T21:15:17.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.224+0000 7f925a100700 1 -- 172.21.15.153:0/1532945009 learned_addr learned my addr 172.21.15.153:0/1532945009 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:17.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.224+0000 7f925a100700 1 -- 172.21.15.153:0/1532945009 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56247907d520 con 0x56247907c620 2023-10-05T21:15:17.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.224+0000 7f925a100700 1 --2- 172.21.15.153:0/1532945009 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56247907c620 0x56247907ca30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x56247905ce40 tx=0x7f924c006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a18d2f64f212d373 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.224+0000 7f922b7e6700 1 -- 172.21.15.153:0/1532945009 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f924c023040 con 0x56247907c620 2023-10-05T21:15:17.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.224+0000 7f922b7e6700 1 -- 172.21.15.153:0/1532945009 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924c024040 con 0x56247907c620 2023-10-05T21:15:17.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.224+0000 7f922b7e6700 1 -- 172.21.15.153:0/1532945009 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f924c013040 con 0x56247907c620 2023-10-05T21:15:17.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.225+0000 7f9267829680 1 -- 172.21.15.153:0/1532945009 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56247907c620 msgr2=0x56247907ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.225+0000 7f9267829680 1 --2- 172.21.15.153:0/1532945009 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56247907c620 0x56247907ca30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x56247905ce40 tx=0x7f924c006000 comp rx=0 tx=0).stop 2023-10-05T21:15:17.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.225+0000 7f9267829680 1 -- 172.21.15.153:0/1532945009 shutdown_connections 2023-10-05T21:15:17.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.225+0000 7f9267829680 1 --2- 172.21.15.153:0/1532945009 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56247907c620 0x56247907ca30 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.225+0000 7f9267829680 1 -- 172.21.15.153:0/1532945009 >> 172.21.15.153:0/1532945009 conn(0x562479078920 msgr2=0x562479076a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.225+0000 7f9267829680 1 -- 172.21.15.153:0/1532945009 shutdown_connections 2023-10-05T21:15:17.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.225+0000 7f9267829680 1 -- 172.21.15.153:0/1532945009 wait complete. 2023-10-05T21:15:17.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.225+0000 7f9267829680 1 Processor -- start 2023-10-05T21:15:17.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.225+0000 7f9267829680 1 -- start start 2023-10-05T21:15:17.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.225+0000 7f9267829680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56247907c620 0x5624790833d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.225+0000 7f9267829680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x562479083910 con 0x56247907c620 2023-10-05T21:15:17.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.226+0000 7f925a100700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56247907c620 0x5624790833d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.226+0000 7f925a100700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56247907c620 0x5624790833d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:50736/0 (socket says 172.21.15.153:50736) 2023-10-05T21:15:17.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.226+0000 7f925a100700 1 -- 172.21.15.153:0/3981947077 learned_addr learned my addr 172.21.15.153:0/3981947077 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:17.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.226+0000 7f925a100700 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9244001e10 con 0x56247907c620 2023-10-05T21:15:17.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.226+0000 7f925a100700 1 --2- 172.21.15.153:0/3981947077 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56247907c620 0x5624790833d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x562479077e90 tx=0x7f924c030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.226+0000 7f9229fe3700 1 -- 172.21.15.153:0/3981947077 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f924c023070 con 0x56247907c620 2023-10-05T21:15:17.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.226+0000 7f9229fe3700 1 -- 172.21.15.153:0/3981947077 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924c02d030 con 0x56247907c620 2023-10-05T21:15:17.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.226+0000 7f9229fe3700 1 -- 172.21.15.153:0/3981947077 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f924c02d1c0 con 0x56247907c620 2023-10-05T21:15:17.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.226+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562479083b10 con 0x56247907c620 2023-10-05T21:15:17.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.226+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562479083f60 con 0x56247907c620 2023-10-05T21:15:17.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.227+0000 7f9229fe3700 1 -- 172.21.15.153:0/3981947077 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f924c01e630 con 0x56247907c620 2023-10-05T21:15:17.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.227+0000 7f9229fe3700 1 --2- 172.21.15.153:0/3981947077 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f91a0034140 0x7f91a00365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.227+0000 7f9229fe3700 1 -- 172.21.15.153:0/3981947077 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f924c04eb00 con 0x56247907c620 2023-10-05T21:15:17.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.227+0000 7f925b102700 1 --2- 172.21.15.153:0/3981947077 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f91a0034140 0x7f91a00365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.227+0000 7f9267829680 1 --2- 172.21.15.153:0/3981947077 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x56247908e210 0x5624790906c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.227+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479090d70 con 0x56247908e210 2023-10-05T21:15:17.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.227+0000 7f925a901700 1 --2- 172.21.15.153:0/3981947077 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x56247908e210 0x5624790906c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.228+0000 7f925b102700 1 --2- 172.21.15.153:0/3981947077 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f91a0034140 0x7f91a00365f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x56247906ee00 tx=0x7f9254037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.228+0000 7f925a901700 1 --2- 172.21.15.153:0/3981947077 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x56247908e210 0x5624790906c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.228+0000 7f925a901700 1 -- 172.21.15.153:0/3981947077 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v29'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9250030db0 con 0x56247908e210 2023-10-05T21:15:17.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.229+0000 7f9267829680 1 --2- 172.21.15.153:0/3981947077 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x562479091af0 0x562479093ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.229+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5624790945d0 con 0x562479091af0 2023-10-05T21:15:17.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.229+0000 7f925a100700 1 --2- 172.21.15.153:0/3981947077 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x562479091af0 0x562479093ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.229+0000 7f925a100700 1 --2- 172.21.15.153:0/3981947077 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x562479091af0 0x562479093ed0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.230+0000 7f925a100700 1 -- 172.21.15.153:0/3981947077 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v29'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f924c03f040 con 0x562479091af0 2023-10-05T21:15:17.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.230+0000 7f9267829680 1 --2- 172.21.15.153:0/3981947077 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x56247908bc90 0x562479097d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.230+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479098310 con 0x56247908bc90 2023-10-05T21:15:17.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.230+0000 7f925b102700 1 --2- 172.21.15.153:0/3981947077 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x56247908bc90 0x562479097d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.230+0000 7f925b102700 1 --2- 172.21.15.153:0/3981947077 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x56247908bc90 0x562479097d00 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.231+0000 7f925b102700 1 -- 172.21.15.153:0/3981947077 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v29'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f925400a570 con 0x56247908bc90 2023-10-05T21:15:17.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.231+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479098ac0 con 0x56247908e210 2023-10-05T21:15:17.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.231+0000 7f925a901700 1 -- 172.21.15.153:0/3981947077 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v29'113 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9250030db0 con 0x56247908e210 2023-10-05T21:15:17.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.232+0000 7f9267829680 1 --2- 172.21.15.153:0/3981947077 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x5624790996d0 0x56247909bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.232+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247909c210 con 0x5624790996d0 2023-10-05T21:15:17.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.232+0000 7f925a901700 1 --2- 172.21.15.153:0/3981947077 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x5624790996d0 0x56247909bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.232+0000 7f925a901700 1 --2- 172.21.15.153:0/3981947077 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x5624790996d0 0x56247909bb60 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.233+0000 7f925a901700 1 -- 172.21.15.153:0/3981947077 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v29'35 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9250030db0 con 0x5624790996d0 2023-10-05T21:15:17.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.233+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247909c940 con 0x56247908bc90 2023-10-05T21:15:17.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.233+0000 7f925b102700 1 -- 172.21.15.153:0/3981947077 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v29'21 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f925400a570 con 0x56247908bc90 2023-10-05T21:15:17.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.233+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247909d000 con 0x56247908e210 2023-10-05T21:15:17.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.234+0000 7f925a901700 1 -- 172.21.15.153:0/3981947077 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v29'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9250030db0 con 0x56247908e210 2023-10-05T21:15:17.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.234+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247909d000 con 0x562479091af0 2023-10-05T21:15:17.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.235+0000 7f925a100700 1 -- 172.21.15.153:0/3981947077 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v29'24 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f924c03f040 con 0x562479091af0 2023-10-05T21:15:17.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.235+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247909d680 con 0x5624790996d0 2023-10-05T21:15:17.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.236+0000 7f925a901700 1 -- 172.21.15.153:0/3981947077 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v29'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9250030db0 con 0x5624790996d0 2023-10-05T21:15:17.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.236+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247909d710 con 0x56247908bc90 2023-10-05T21:15:17.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.236+0000 7f925b102700 1 -- 172.21.15.153:0/3981947077 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v29'20 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f925400a570 con 0x56247908bc90 2023-10-05T21:15:17.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.236+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247909dd50 con 0x5624790996d0 2023-10-05T21:15:17.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.237+0000 7f925a901700 1 -- 172.21.15.153:0/3981947077 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v29'36 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9250030db0 con 0x5624790996d0 2023-10-05T21:15:17.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.237+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247909dcf0 con 0x562479091af0 2023-10-05T21:15:17.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.238+0000 7f925a100700 1 -- 172.21.15.153:0/3981947077 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v29'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f924c03f040 con 0x562479091af0 2023-10-05T21:15:17.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.238+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247909e330 con 0x5624790996d0 2023-10-05T21:15:17.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.239+0000 7f925a901700 1 -- 172.21.15.153:0/3981947077 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v29'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9250030db0 con 0x5624790996d0 2023-10-05T21:15:17.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.239+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247909e330 con 0x562479091af0 2023-10-05T21:15:17.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.240+0000 7f925a100700 1 -- 172.21.15.153:0/3981947077 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v29'27 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f924c03f040 con 0x562479091af0 2023-10-05T21:15:17.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.240+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247909e820 con 0x56247908e210 2023-10-05T21:15:17.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.240+0000 7f925a901700 1 -- 172.21.15.153:0/3981947077 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v29'114 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9250030db0 con 0x56247908e210 2023-10-05T21:15:17.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.240+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247909e820 con 0x56247908bc90 2023-10-05T21:15:17.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.241+0000 7f925b102700 1 -- 172.21.15.153:0/3981947077 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v29'26 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f925400a570 con 0x56247908bc90 2023-10-05T21:15:17.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.241+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247909e820 con 0x5624790996d0 2023-10-05T21:15:17.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.242+0000 7f925a901700 1 -- 172.21.15.153:0/3981947077 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v29'37 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9250030db0 con 0x5624790996d0 2023-10-05T21:15:17.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.242+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247909e820 con 0x56247908bc90 2023-10-05T21:15:17.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.243+0000 7f925b102700 1 -- 172.21.15.153:0/3981947077 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v29'14 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f925400a570 con 0x56247908bc90 2023-10-05T21:15:17.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.243+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247909e820 con 0x56247908e210 2023-10-05T21:15:17.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.243+0000 7f925a901700 1 -- 172.21.15.153:0/3981947077 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v29'24 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9250030db0 con 0x56247908e210 2023-10-05T21:15:17.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.244+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247909e820 con 0x56247908e210 2023-10-05T21:15:17.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.244+0000 7f925a901700 1 -- 172.21.15.153:0/3981947077 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v29'115 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9250030db0 con 0x56247908e210 2023-10-05T21:15:17.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.244+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247909e820 con 0x56247908bc90 2023-10-05T21:15:17.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.245+0000 7f925b102700 1 -- 172.21.15.153:0/3981947077 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v29'27 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f925400a570 con 0x56247908bc90 2023-10-05T21:15:17.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.245+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247909e820 con 0x5624790996d0 2023-10-05T21:15:17.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.246+0000 7f925a901700 1 -- 172.21.15.153:0/3981947077 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v29'29 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9250030db0 con 0x5624790996d0 2023-10-05T21:15:17.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.246+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247909e820 con 0x56247908bc90 2023-10-05T21:15:17.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.246+0000 7f925b102700 1 -- 172.21.15.153:0/3981947077 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v29'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f925400a570 con 0x56247908bc90 2023-10-05T21:15:17.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.246+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247909e820 con 0x56247908bc90 2023-10-05T21:15:17.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.247+0000 7f925b102700 1 -- 172.21.15.153:0/3981947077 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v29'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f925400a570 con 0x56247908bc90 2023-10-05T21:15:17.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.247+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247909e820 con 0x56247908bc90 2023-10-05T21:15:17.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.248+0000 7f925b102700 1 -- 172.21.15.153:0/3981947077 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v29'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f925400a570 con 0x56247908bc90 2023-10-05T21:15:17.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.248+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247909e820 con 0x56247908bc90 2023-10-05T21:15:17.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.248+0000 7f925b102700 1 -- 172.21.15.153:0/3981947077 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v29'22 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f925400a570 con 0x56247908bc90 2023-10-05T21:15:17.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.248+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247909e820 con 0x562479091af0 2023-10-05T21:15:17.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.249+0000 7f925a100700 1 -- 172.21.15.153:0/3981947077 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v29'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f924c03f040 con 0x562479091af0 2023-10-05T21:15:17.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.249+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247909e820 con 0x56247908bc90 2023-10-05T21:15:17.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.250+0000 7f925b102700 1 -- 172.21.15.153:0/3981947077 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v29'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f925400a570 con 0x56247908bc90 2023-10-05T21:15:17.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.250+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247909e820 con 0x562479091af0 2023-10-05T21:15:17.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.251+0000 7f925a100700 1 -- 172.21.15.153:0/3981947077 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v29'25 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f924c03f040 con 0x562479091af0 2023-10-05T21:15:17.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.251+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247909e820 con 0x56247908bc90 2023-10-05T21:15:17.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.251+0000 7f925b102700 1 -- 172.21.15.153:0/3981947077 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v29'28 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f925400a570 con 0x56247908bc90 2023-10-05T21:15:17.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.251+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247909e820 con 0x562479091af0 2023-10-05T21:15:17.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.252+0000 7f925a100700 1 -- 172.21.15.153:0/3981947077 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v29'28 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f924c03f040 con 0x562479091af0 2023-10-05T21:15:17.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.252+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247909e820 con 0x5624790996d0 2023-10-05T21:15:17.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.253+0000 7f925a901700 1 -- 172.21.15.153:0/3981947077 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v29'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9250030db0 con 0x5624790996d0 2023-10-05T21:15:17.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.254+0000 7f919affd700 20 reqs_thread_entry: start 2023-10-05T21:15:17.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.254+0000 7f9198ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:17.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.254+0000 7f9267829680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:17.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.254+0000 7f9267829680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:17.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.254+0000 7f918effd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:47 2023 2023-10-05T21:15:17.273 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:17.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.254+0000 7f918e7fc700 20 reqs_thread_entry: start 2023-10-05T21:15:17.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.255+0000 7f9267829680 20 get_system_obj_state: rctx=0x7ffcf8b33bf8 obj=default.rgw.meta:users.uid:fud state=0x562478ee0240 s->prefetch_data=0 2023-10-05T21:15:17.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.255+0000 7f9267829680 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2023-10-05T21:15:17.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.255+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5624790f9a90 con 0x7f924c00ebe0 2023-10-05T21:15:17.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.255+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(102 fud [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.255+0000 7f9267829680 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x16 2023-10-05T21:15:17.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.255+0000 7f9267829680 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T21:15:17.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.255+0000 7f9267829680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:17.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.255+0000 7f9267829680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:17.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.255+0000 7f9267829680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:17.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.255+0000 7f9267829680 10 cache get: name=default.rgw.meta+users.uid+fud : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:17.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.255+0000 7f9267829680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.255+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:103 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5624790fbd20 con 0x7f924c00ebe0 2023-10-05T21:15:17.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.255+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(103 fud [call,call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 273+0+469 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.256+0000 7f9267829680 20 rados_obj.operate() r=0 bl.length=346 2023-10-05T21:15:17.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.256+0000 7f9267829680 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2023-10-05T21:15:17.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.256+0000 7f9267829680 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T21:15:17.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.256+0000 7f9267829680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:17.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.256+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:104 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5624790fbd20 con 0x7f924c00ebe0 2023-10-05T21:15:17.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.256+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(104 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.275 INFO:teuthology.orchestra.run.smithi153.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2023-10-05T21:15:17.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.256+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94714649284944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5624790b85c0 con 0x7f9250007030 2023-10-05T21:15:17.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.257+0000 7f925a100700 1 -- 172.21.15.153:0/3542130596 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(105 notify.0 [watch unwatch cookie 94714649284944] v29'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f924c03f040 con 0x7f9250007030 2023-10-05T21:15:17.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.257+0000 7f9267829680 20 remove_watcher() i=0 2023-10-05T21:15:17.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.257+0000 7f9267829680 2 removed watcher, disabling cache 2023-10-05T21:15:17.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.257+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94714649290592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479069150 con 0x56247905d840 2023-10-05T21:15:17.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.258+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(106 notify.1 [watch unwatch cookie 94714649290592] v29'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.258+0000 7f9267829680 20 remove_watcher() i=1 2023-10-05T21:15:17.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.258+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94714649291696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x562479069150 con 0x562479062110 2023-10-05T21:15:17.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.259+0000 7f925a901700 1 -- 172.21.15.153:0/3542130596 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(107 notify.2 [watch unwatch cookie 94714649291696] v29'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9250030db0 con 0x562479062110 2023-10-05T21:15:17.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.259+0000 7f9267829680 20 remove_watcher() i=2 2023-10-05T21:15:17.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.259+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94714649297248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247906ac50 con 0x7f9250007030 2023-10-05T21:15:17.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.259+0000 7f925a100700 1 -- 172.21.15.153:0/3542130596 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(108 notify.3 [watch unwatch cookie 94714649297248] v29'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f924c03f040 con 0x7f9250007030 2023-10-05T21:15:17.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.260+0000 7f9267829680 20 remove_watcher() i=3 2023-10-05T21:15:17.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.260+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94714649300992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247906ac50 con 0x56247905d840 2023-10-05T21:15:17.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.261+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(109 notify.4 [watch unwatch cookie 94714649300992] v29'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.261+0000 7f9267829680 20 remove_watcher() i=4 2023-10-05T21:15:17.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.261+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94714649305584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247906ac50 con 0x7f924c00ebe0 2023-10-05T21:15:17.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.261+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(110 notify.5 [watch unwatch cookie 94714649305584] v29'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.261+0000 7f9267829680 20 remove_watcher() i=5 2023-10-05T21:15:17.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.261+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:111 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94714649294832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247906ac50 con 0x7f924c00ebe0 2023-10-05T21:15:17.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.262+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 31 ==== osd_op_reply(111 notify.6 [watch unwatch cookie 94714649294832] v29'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.262+0000 7f9267829680 20 remove_watcher() i=6 2023-10-05T21:15:17.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.262+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94714649309456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247906ac50 con 0x7f924c00ebe0 2023-10-05T21:15:17.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.263+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.0 v2:172.21.15.111:6800/111394 32 ==== osd_op_reply(112 notify.7 [watch unwatch cookie 94714649309456] v29'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f925400a570 con 0x7f924c00ebe0 2023-10-05T21:15:17.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.263+0000 7f9267829680 20 remove_watcher() i=7 2023-10-05T21:15:17.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.263+0000 7f922bfe7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:17.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.264+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:113 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94714649307504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56247906d000 con 0x56247905d840 2023-10-05T21:15:17.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.264+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(113 data_loggenerations_metadata [watch unwatch cookie 94714649307504] v29'116 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f925400a570 con 0x56247905d840 2023-10-05T21:15:17.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.264+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f924c00ebe0 msgr2=0x7f924c00d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.264+0000 7f9267829680 1 --2- 172.21.15.153:0/3542130596 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f924c00ebe0 0x7f924c00d8e0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.264+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x56247905d840 msgr2=0x56247905fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.264+0000 7f9267829680 1 --2- 172.21.15.153:0/3542130596 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x56247905d840 0x56247905fca0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.264+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f9250007030 msgr2=0x7f9250030650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.264+0000 7f9267829680 1 --2- 172.21.15.153:0/3542130596 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f9250007030 0x7f9250030650 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.264+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x562479062110 msgr2=0x5624790644f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.264+0000 7f9267829680 1 --2- 172.21.15.153:0/3542130596 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x562479062110 0x5624790644f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.264+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f92400340f0 msgr2=0x7f92400365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.264+0000 7f9267829680 1 --2- 172.21.15.153:0/3542130596 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f92400340f0 0x7f92400365a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f924c004170 tx=0x7f924c001360 comp rx=0 tx=0).stop 2023-10-05T21:15:17.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.264+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56247902c2b0 msgr2=0x562479053b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.264+0000 7f925b102700 1 -- 172.21.15.153:0/3542130596 reap_dead start 2023-10-05T21:15:17.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.264+0000 7f9267829680 1 --2- 172.21.15.153:0/3542130596 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56247902c2b0 0x562479053b40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f925001f040 tx=0x7f925001c000 comp rx=0 tx=0).stop 2023-10-05T21:15:17.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.265+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 shutdown_connections 2023-10-05T21:15:17.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.265+0000 7f9267829680 1 --2- 172.21.15.153:0/3542130596 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56247902c2b0 0x562479053b40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.265+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 >> 172.21.15.153:0/3542130596 conn(0x562479027b80 msgr2=0x5624790458e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.265+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 shutdown_connections 2023-10-05T21:15:17.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.265+0000 7f9267829680 1 -- 172.21.15.153:0/3542130596 wait complete. 2023-10-05T21:15:17.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.265+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x562479091af0 msgr2=0x562479093ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.265+0000 7f9267829680 1 --2- 172.21.15.153:0/3981947077 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x562479091af0 0x562479093ed0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.265+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x56247908e210 msgr2=0x5624790906c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.265+0000 7f9267829680 1 --2- 172.21.15.153:0/3981947077 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x56247908e210 0x5624790906c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.265+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x5624790996d0 msgr2=0x56247909bb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.265+0000 7f9267829680 1 --2- 172.21.15.153:0/3981947077 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x5624790996d0 0x56247909bb60 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.265+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x56247908bc90 msgr2=0x562479097d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.265+0000 7f9267829680 1 --2- 172.21.15.153:0/3981947077 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x56247908bc90 0x562479097d00 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.265+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f91a0034140 msgr2=0x7f91a00365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.265+0000 7f9267829680 1 --2- 172.21.15.153:0/3981947077 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f91a0034140 0x7f91a00365f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x56247906ee00 tx=0x7f9254037450 comp rx=0 tx=0).stop 2023-10-05T21:15:17.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.265+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56247907c620 msgr2=0x5624790833d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.265+0000 7f9267829680 1 --2- 172.21.15.153:0/3981947077 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56247907c620 0x5624790833d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x562479077e90 tx=0x7f924c030000 comp rx=0 tx=0).stop 2023-10-05T21:15:17.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.265+0000 7f925a901700 1 -- 172.21.15.153:0/3981947077 reap_dead start 2023-10-05T21:15:17.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.265+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 shutdown_connections 2023-10-05T21:15:17.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.265+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 >> 172.21.15.153:0/3981947077 conn(0x562479078920 msgr2=0x5624790769f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.265+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 shutdown_connections 2023-10-05T21:15:17.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.265+0000 7f9267829680 1 -- 172.21.15.153:0/3981947077 wait complete. 2023-10-05T21:15:17.281 DEBUG:teuthology.orchestra.run:got remote process result: 17 2023-10-05T21:15:17.282 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2023-10-05T21:15:17.282 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2023-10-05T21:15:17.282 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2023-10-05T21:15:17.328 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:17.328 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:17.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.327+0000 7ff3db0b6680 1 Processor -- start 2023-10-05T21:15:17.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.327+0000 7ff3db0b6680 1 -- start start 2023-10-05T21:15:17.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.327+0000 7ff3db0b6680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x560c7a0490b0 0x560c7a0da4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.327+0000 7ff3db0b6680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560c7a022930 con 0x560c7a0da9e0 2023-10-05T21:15:17.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.327+0000 7ff3db0b6680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x560c79fe2db0 con 0x560c7a0490b0 2023-10-05T21:15:17.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.328+0000 7ff3ce18e700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x560c7a0490b0 0x560c7a0da4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.328+0000 7ff3c7fff700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x560c7a0da9e0 0x560c7a0dcdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:55180/0 (socket says 172.21.15.153:55180) 2023-10-05T21:15:17.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.328+0000 7ff3c7fff700 1 -- 172.21.15.153:0/1077131565 learned_addr learned my addr 172.21.15.153:0/1077131565 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:17.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.328+0000 7ff3ce18e700 1 -- 172.21.15.153:0/1077131565 >> v1:172.21.15.111:6789/0 conn(0x560c7a0da9e0 legacy=0x560c7a0dcdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.328+0000 7ff3ce18e700 1 -- 172.21.15.153:0/1077131565 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c7a0df4f0 con 0x560c7a0490b0 2023-10-05T21:15:17.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.328+0000 7ff3ce18e700 1 --2- 172.21.15.153:0/1077131565 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a0490b0 0x560c7a0da4a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff3c000a5d0 tx=0x7ff3c0005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a9c58bf92d7b28 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.328+0000 7ff3cd98d700 1 -- 172.21.15.153:0/1077131565 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3c00086a0 con 0x560c7a0490b0 2023-10-05T21:15:17.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.328+0000 7ff3cd98d700 1 -- 172.21.15.153:0/1077131565 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c0008800 con 0x560c7a0490b0 2023-10-05T21:15:17.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.328+0000 7ff3cd98d700 1 -- 172.21.15.153:0/1077131565 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3c0008ad0 con 0x560c7a0490b0 2023-10-05T21:15:17.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.329+0000 7ff3db0b6680 1 -- 172.21.15.153:0/1077131565 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a0490b0 msgr2=0x560c7a0da4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.329+0000 7ff3db0b6680 1 --2- 172.21.15.153:0/1077131565 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a0490b0 0x560c7a0da4a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff3c000a5d0 tx=0x7ff3c0005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:17.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.329+0000 7ff3db0b6680 1 -- 172.21.15.153:0/1077131565 shutdown_connections 2023-10-05T21:15:17.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.329+0000 7ff3db0b6680 1 --2- 172.21.15.153:0/1077131565 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a0490b0 0x560c7a0da4a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.329+0000 7ff3db0b6680 1 -- 172.21.15.153:0/1077131565 >> 172.21.15.153:0/1077131565 conn(0x560c7a0cfb90 msgr2=0x560c7a0d1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.329+0000 7ff3db0b6680 1 -- 172.21.15.153:0/1077131565 shutdown_connections 2023-10-05T21:15:17.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.329+0000 7ff3db0b6680 1 -- 172.21.15.153:0/1077131565 wait complete. 2023-10-05T21:15:17.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.329+0000 7ff3db0b6680 1 Processor -- start 2023-10-05T21:15:17.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.329+0000 7ff3db0b6680 1 -- start start 2023-10-05T21:15:17.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.330+0000 7ff3db0b6680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a0490b0 0x560c7a0f6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.330+0000 7ff3db0b6680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c79f82ea0 con 0x560c7a0490b0 2023-10-05T21:15:17.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.330+0000 7ff3ce18e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a0490b0 0x560c7a0f6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.330+0000 7ff3ce18e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a0490b0 0x560c7a0f6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37552/0 (socket says 172.21.15.153:37552) 2023-10-05T21:15:17.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.330+0000 7ff3ce18e700 1 -- 172.21.15.153:0/3092889208 learned_addr learned my addr 172.21.15.153:0/3092889208 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:17.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.330+0000 7ff3ce18e700 1 -- 172.21.15.153:0/3092889208 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c0005cf0 con 0x560c7a0490b0 2023-10-05T21:15:17.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.330+0000 7ff3ce18e700 1 --2- 172.21.15.153:0/3092889208 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a0490b0 0x560c7a0f6ac0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0005a90 tx=0x7ff3c0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45aa2a883730afd server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.330+0000 7ff3cc98b700 1 -- 172.21.15.153:0/3092889208 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3c0008970 con 0x560c7a0490b0 2023-10-05T21:15:17.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.330+0000 7ff3cc98b700 1 -- 172.21.15.153:0/3092889208 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c0008ad0 con 0x560c7a0490b0 2023-10-05T21:15:17.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.330+0000 7ff3cc98b700 1 -- 172.21.15.153:0/3092889208 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3c0008dc0 con 0x560c7a0490b0 2023-10-05T21:15:17.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.331+0000 7ff3db0b6680 1 -- 172.21.15.153:0/3092889208 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a0490b0 msgr2=0x560c7a0f6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.331+0000 7ff3db0b6680 1 --2- 172.21.15.153:0/3092889208 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a0490b0 0x560c7a0f6ac0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0005a90 tx=0x7ff3c0015000 comp rx=0 tx=0).stop 2023-10-05T21:15:17.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.331+0000 7ff3db0b6680 1 -- 172.21.15.153:0/3092889208 shutdown_connections 2023-10-05T21:15:17.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.331+0000 7ff3db0b6680 1 --2- 172.21.15.153:0/3092889208 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a0490b0 0x560c7a0f6ac0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.331+0000 7ff3db0b6680 1 -- 172.21.15.153:0/3092889208 >> 172.21.15.153:0/3092889208 conn(0x560c7a0cfb90 msgr2=0x560c7a0f2590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.331+0000 7ff3db0b6680 1 -- 172.21.15.153:0/3092889208 shutdown_connections 2023-10-05T21:15:17.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.331+0000 7ff3db0b6680 1 -- 172.21.15.153:0/3092889208 wait complete. 2023-10-05T21:15:17.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.331+0000 7ff3db0b6680 1 Processor -- start 2023-10-05T21:15:17.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.331+0000 7ff3db0b6680 1 -- start start 2023-10-05T21:15:17.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.332+0000 7ff3db0b6680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a0490b0 0x560c7a0fddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.332+0000 7ff3db0b6680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c79f79c80 con 0x560c7a0490b0 2023-10-05T21:15:17.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.332+0000 7ff3ce18e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a0490b0 0x560c7a0fddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.332+0000 7ff3ce18e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a0490b0 0x560c7a0fddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37560/0 (socket says 172.21.15.153:37560) 2023-10-05T21:15:17.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.332+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 learned_addr learned my addr 172.21.15.153:0/4178802676 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:17.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.332+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c7a0df4f0 con 0x560c7a0490b0 2023-10-05T21:15:17.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.332+0000 7ff3ce18e700 1 --2- 172.21.15.153:0/4178802676 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a0490b0 0x560c7a0fddf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff3c001f040 tx=0x7ff3c001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.332+0000 7ff3c67fc700 1 -- 172.21.15.153:0/4178802676 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3c00086a0 con 0x560c7a0490b0 2023-10-05T21:15:17.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.332+0000 7ff3c67fc700 1 -- 172.21.15.153:0/4178802676 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c002a070 con 0x560c7a0490b0 2023-10-05T21:15:17.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.332+0000 7ff3c67fc700 1 -- 172.21.15.153:0/4178802676 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3c0026630 con 0x560c7a0490b0 2023-10-05T21:15:17.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.332+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560c7a0fe330 con 0x560c7a0490b0 2023-10-05T21:15:17.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.332+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560c7a0fe780 con 0x560c7a0490b0 2023-10-05T21:15:17.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.333+0000 7ff3c67fc700 1 -- 172.21.15.153:0/4178802676 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7ff3c00267e0 con 0x560c7a0490b0 2023-10-05T21:15:17.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.333+0000 7ff3c67fc700 1 --2- 172.21.15.153:0/4178802676 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff3b0034140 0x7ff3b00365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.333+0000 7ff3db0b6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.333+0000 7ff3c67fc700 1 -- 172.21.15.153:0/4178802676 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7ff3c004a060 con 0x560c7a0490b0 2023-10-05T21:15:17.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.333+0000 7ff3c7fff700 1 --2- 172.21.15.153:0/4178802676 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff3b0034140 0x7ff3b00365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.334+0000 7ff3db0b6680 1 --2- 172.21.15.153:0/4178802676 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x560c7a0da9e0 0x560c7a109be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.334+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a10a370 con 0x560c7a0da9e0 2023-10-05T21:15:17.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.334+0000 7ff3ce98f700 1 --2- 172.21.15.153:0/4178802676 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x560c7a0da9e0 0x560c7a109be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.334+0000 7ff3c7fff700 1 --2- 172.21.15.153:0/4178802676 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff3b0034140 0x7ff3b00365f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8004170 tx=0x7ff3b8001380 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.334+0000 7ff3ce98f700 1 --2- 172.21.15.153:0/4178802676 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x560c7a0da9e0 0x560c7a109be0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.334+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.334+0000 7ff3db0b6680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.334+0000 7ff3db0b6680 20 realm 2023-10-05T21:15:17.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.334+0000 7ff3db0b6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.334+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a1071c0 con 0x560c7a0da9e0 2023-10-05T21:15:17.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.335+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.335+0000 7ff3db0b6680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.335+0000 7ff3db0b6680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:17.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.335+0000 7ff3db0b6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.335+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a10ae70 con 0x560c7a0da9e0 2023-10-05T21:15:17.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.335+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.335+0000 7ff3db0b6680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.335+0000 7ff3db0b6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.335+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a10b790 con 0x560c7a0da9e0 2023-10-05T21:15:17.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.335+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.335+0000 7ff3db0b6680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.335+0000 7ff3db0b6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.335+0000 7ff3db0b6680 1 --2- 172.21.15.153:0/4178802676 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x560c7a10c050 0x560c7a10e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.335+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a10ea80 con 0x560c7a10c050 2023-10-05T21:15:17.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.335+0000 7ff3ce18e700 1 --2- 172.21.15.153:0/4178802676 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x560c7a10c050 0x560c7a10e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.335+0000 7ff3ce18e700 1 --2- 172.21.15.153:0/4178802676 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x560c7a10c050 0x560c7a10e430 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.336+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff3c0036070 con 0x560c7a10c050 2023-10-05T21:15:17.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.336+0000 7ff3db0b6680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:17.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.336+0000 7ff3db0b6680 20 searching for the correct realm 2023-10-05T21:15:17.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.336+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110590 con 0x560c7a10c050 2023-10-05T21:15:17.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.336+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c0036070 con 0x560c7a10c050 2023-10-05T21:15:17.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.336+0000 7ff3ce18e700 1 --2- 172.21.15.153:0/4178802676 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ff3c0007030 0x7ff3c0048940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.336+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110590 con 0x7ff3c0007030 2023-10-05T21:15:17.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.336+0000 7ff3c7fff700 1 --2- 172.21.15.153:0/4178802676 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ff3c0007030 0x7ff3c0048940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.336+0000 7ff3c7fff700 1 --2- 172.21.15.153:0/4178802676 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ff3c0007030 0x7ff3c0048940 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.337+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b8006070 con 0x7ff3c0007030 2023-10-05T21:15:17.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.337+0000 7ff3c7fff700 1 --2- 172.21.15.153:0/4178802676 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ff3b800d3d0 0x7ff3b800d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.337+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110590 con 0x7ff3b800d3d0 2023-10-05T21:15:17.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.337+0000 7ff3ce98f700 1 --2- 172.21.15.153:0/4178802676 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ff3b800d3d0 0x7ff3b800d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.337+0000 7ff3ce98f700 1 --2- 172.21.15.153:0/4178802676 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ff3b800d3d0 0x7ff3b800d820 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.337+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.337+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110590 con 0x560c7a0da9e0 2023-10-05T21:15:17.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.338+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.338+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110590 con 0x560c7a0da9e0 2023-10-05T21:15:17.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.338+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.338+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110590 con 0x7ff3b800d3d0 2023-10-05T21:15:17.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.338+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.338+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110590 con 0x7ff3b800d3d0 2023-10-05T21:15:17.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.338+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.338+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110590 con 0x7ff3c0007030 2023-10-05T21:15:17.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.338+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b8006070 con 0x7ff3c0007030 2023-10-05T21:15:17.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.338+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110590 con 0x560c7a10c050 2023-10-05T21:15:17.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.339+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff3c0036070 con 0x560c7a10c050 2023-10-05T21:15:17.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.339+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110590 con 0x560c7a0da9e0 2023-10-05T21:15:17.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.339+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.339+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110590 con 0x7ff3b800d3d0 2023-10-05T21:15:17.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.339+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.339+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110590 con 0x560c7a0da9e0 2023-10-05T21:15:17.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.339+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.339+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110590 con 0x7ff3c0007030 2023-10-05T21:15:17.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.340+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b8006070 con 0x7ff3c0007030 2023-10-05T21:15:17.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.340+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110590 con 0x560c7a10c050 2023-10-05T21:15:17.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.340+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c0036070 con 0x560c7a10c050 2023-10-05T21:15:17.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.340+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110590 con 0x560c7a10c050 2023-10-05T21:15:17.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.340+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c0036070 con 0x560c7a10c050 2023-10-05T21:15:17.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.340+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110590 con 0x7ff3b800d3d0 2023-10-05T21:15:17.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.340+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.340+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110590 con 0x560c7a10c050 2023-10-05T21:15:17.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.340+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c0036070 con 0x560c7a10c050 2023-10-05T21:15:17.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.340+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110590 con 0x560c7a10c050 2023-10-05T21:15:17.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.341+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c0036070 con 0x560c7a10c050 2023-10-05T21:15:17.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.341+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7ff3c004b040 con 0x560c7a0da9e0 2023-10-05T21:15:17.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.341+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.341+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7ff3c004b040 con 0x560c7a0da9e0 2023-10-05T21:15:17.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.341+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.341+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7ff3c004b040 con 0x7ff3b800d3d0 2023-10-05T21:15:17.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.341+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.341+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7ff3c004b040 con 0x560c7a10c050 2023-10-05T21:15:17.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.341+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c0036070 con 0x560c7a10c050 2023-10-05T21:15:17.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.341+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7ff3c004b040 con 0x7ff3c0007030 2023-10-05T21:15:17.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.342+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b8006070 con 0x7ff3c0007030 2023-10-05T21:15:17.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.342+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7ff3c004b040 con 0x560c7a0da9e0 2023-10-05T21:15:17.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.342+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.342+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7ff3c004b040 con 0x7ff3b800d3d0 2023-10-05T21:15:17.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.342+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.342+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7ff3c004b040 con 0x560c7a10c050 2023-10-05T21:15:17.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.342+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c0036070 con 0x560c7a10c050 2023-10-05T21:15:17.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.342+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7ff3c004b040 con 0x7ff3b800d3d0 2023-10-05T21:15:17.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.343+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.343+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7ff3c004b040 con 0x7ff3c0007030 2023-10-05T21:15:17.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.343+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b8006070 con 0x7ff3c0007030 2023-10-05T21:15:17.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.343+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7ff3c004b040 con 0x560c7a10c050 2023-10-05T21:15:17.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.343+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c0036070 con 0x560c7a10c050 2023-10-05T21:15:17.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.343+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7ff3c004b040 con 0x7ff3b800d3d0 2023-10-05T21:15:17.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.343+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.343+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7ff3c004b040 con 0x560c7a0da9e0 2023-10-05T21:15:17.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.344+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.344+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7ff3c004b040 con 0x7ff3c0007030 2023-10-05T21:15:17.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.344+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b8006070 con 0x7ff3c0007030 2023-10-05T21:15:17.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.344+0000 7ff3db0b6680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:17.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.344+0000 7ff3db0b6680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:17.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.344+0000 7ff3db0b6680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:17.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.344+0000 7ff3db0b6680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:17.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.344+0000 7ff3db0b6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.344+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a10f730 con 0x560c7a0da9e0 2023-10-05T21:15:17.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.344+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.344+0000 7ff3db0b6680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.344+0000 7ff3db0b6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.344+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a10f360 con 0x560c7a0da9e0 2023-10-05T21:15:17.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.344+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.344+0000 7ff3db0b6680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.344+0000 7ff3db0b6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.344+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110a20 con 0x560c7a0da9e0 2023-10-05T21:15:17.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.345+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.345+0000 7ff3db0b6680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:17.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.345+0000 7ff3db0b6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.345+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110dd0 con 0x560c7a10c050 2023-10-05T21:15:17.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.345+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7ff3c0036070 con 0x560c7a10c050 2023-10-05T21:15:17.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.345+0000 7ff3db0b6680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.345+0000 7ff3db0b6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.345+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a111180 con 0x560c7a0da9e0 2023-10-05T21:15:17.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.345+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.345+0000 7ff3db0b6680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.345+0000 7ff3db0b6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.345+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a111180 con 0x560c7a0da9e0 2023-10-05T21:15:17.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.345+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.345+0000 7ff3db0b6680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.345+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a111180 con 0x560c7a10c050 2023-10-05T21:15:17.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.345+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c0036070 con 0x560c7a10c050 2023-10-05T21:15:17.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.346+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a111180 con 0x7ff3c0007030 2023-10-05T21:15:17.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.346+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b8006070 con 0x7ff3c0007030 2023-10-05T21:15:17.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.346+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a111180 con 0x7ff3b800d3d0 2023-10-05T21:15:17.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.346+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.346+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110a20 con 0x560c7a0da9e0 2023-10-05T21:15:17.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.346+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.346+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110a20 con 0x560c7a0da9e0 2023-10-05T21:15:17.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.346+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.346+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110a20 con 0x7ff3b800d3d0 2023-10-05T21:15:17.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.347+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.347+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110a20 con 0x7ff3b800d3d0 2023-10-05T21:15:17.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.347+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.347+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110a20 con 0x7ff3c0007030 2023-10-05T21:15:17.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.347+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b8006070 con 0x7ff3c0007030 2023-10-05T21:15:17.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.347+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110a20 con 0x560c7a10c050 2023-10-05T21:15:17.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.347+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff3c0036070 con 0x560c7a10c050 2023-10-05T21:15:17.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.347+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110a20 con 0x560c7a0da9e0 2023-10-05T21:15:17.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.348+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.348+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110a20 con 0x7ff3b800d3d0 2023-10-05T21:15:17.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.348+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.348+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110a20 con 0x560c7a0da9e0 2023-10-05T21:15:17.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.348+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.348+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110a20 con 0x7ff3c0007030 2023-10-05T21:15:17.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.348+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b8006070 con 0x7ff3c0007030 2023-10-05T21:15:17.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.348+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110a20 con 0x560c7a10c050 2023-10-05T21:15:17.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.349+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c0036070 con 0x560c7a10c050 2023-10-05T21:15:17.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.349+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110a20 con 0x560c7a10c050 2023-10-05T21:15:17.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.349+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c0036070 con 0x560c7a10c050 2023-10-05T21:15:17.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.349+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110a20 con 0x7ff3b800d3d0 2023-10-05T21:15:17.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.349+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.349+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110a20 con 0x560c7a10c050 2023-10-05T21:15:17.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.349+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c0036070 con 0x560c7a10c050 2023-10-05T21:15:17.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.349+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110a20 con 0x560c7a10c050 2023-10-05T21:15:17.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.350+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c0036070 con 0x560c7a10c050 2023-10-05T21:15:17.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.350+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110a20 con 0x560c7a0da9e0 2023-10-05T21:15:17.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.350+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.350+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110a20 con 0x560c7a0da9e0 2023-10-05T21:15:17.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.350+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.350+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110a20 con 0x7ff3b800d3d0 2023-10-05T21:15:17.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.350+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.350+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110a20 con 0x560c7a10c050 2023-10-05T21:15:17.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.350+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c0036070 con 0x560c7a10c050 2023-10-05T21:15:17.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.351+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110a20 con 0x7ff3c0007030 2023-10-05T21:15:17.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.351+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b8006070 con 0x7ff3c0007030 2023-10-05T21:15:17.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.351+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110a20 con 0x560c7a0da9e0 2023-10-05T21:15:17.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.351+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.351+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110a20 con 0x7ff3b800d3d0 2023-10-05T21:15:17.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.351+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.351+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110a20 con 0x560c7a10c050 2023-10-05T21:15:17.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.351+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c0036070 con 0x560c7a10c050 2023-10-05T21:15:17.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.351+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110a20 con 0x7ff3b800d3d0 2023-10-05T21:15:17.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.352+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.352+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110a20 con 0x7ff3c0007030 2023-10-05T21:15:17.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.352+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b8006070 con 0x7ff3c0007030 2023-10-05T21:15:17.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.352+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110a20 con 0x560c7a10c050 2023-10-05T21:15:17.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.352+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c0036070 con 0x560c7a10c050 2023-10-05T21:15:17.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.352+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110a20 con 0x7ff3b800d3d0 2023-10-05T21:15:17.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.352+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.352+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110a20 con 0x560c7a0da9e0 2023-10-05T21:15:17.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.353+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.353+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a110a20 con 0x7ff3c0007030 2023-10-05T21:15:17.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.353+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff3b8006070 con 0x7ff3c0007030 2023-10-05T21:15:17.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.353+0000 7ff3db0b6680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:17.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.353+0000 7ff3db0b6680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:17.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.353+0000 7ff3db0b6680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:17.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.353+0000 7ff3db0b6680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:17.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.353+0000 7ff3db0b6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.353+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a111180 con 0x560c7a0da9e0 2023-10-05T21:15:17.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.353+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.353+0000 7ff3db0b6680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.353+0000 7ff3db0b6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.353+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a111580 con 0x560c7a10c050 2023-10-05T21:15:17.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.354+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff3c0036070 con 0x560c7a10c050 2023-10-05T21:15:17.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.354+0000 7ff3db0b6680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:17.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.354+0000 7ff3db0b6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.354+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a111e20 con 0x560c7a0da9e0 2023-10-05T21:15:17.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.354+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.354+0000 7ff3db0b6680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.354+0000 7ff3db0b6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.354+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a111e20 con 0x560c7a0da9e0 2023-10-05T21:15:17.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.354+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.354+0000 7ff3db0b6680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:17.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.354+0000 7ff3db0b6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.354+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a111f20 con 0x7ff3b800d3d0 2023-10-05T21:15:17.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.354+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.354+0000 7ff3db0b6680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.354+0000 7ff3db0b6680 20 zone default found 2023-10-05T21:15:17.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.354+0000 7ff3db0b6680 4 Realm: () 2023-10-05T21:15:17.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.354+0000 7ff3db0b6680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:17.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.354+0000 7ff3db0b6680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:17.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.354+0000 7ff3db0b6680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:17.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.354+0000 7ff3db0b6680 20 zonegroup default 2023-10-05T21:15:17.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.354+0000 7ff3db0b6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.354+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a111f20 con 0x7ff3b800d3d0 2023-10-05T21:15:17.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.355+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.355+0000 7ff3db0b6680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.355+0000 7ff3db0b6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.355+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a1138a0 con 0x560c7a10c050 2023-10-05T21:15:17.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.355+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff3c0036070 con 0x560c7a10c050 2023-10-05T21:15:17.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.355+0000 7ff3db0b6680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.355+0000 7ff3db0b6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.355+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a113c50 con 0x560c7a10c050 2023-10-05T21:15:17.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.355+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff3c0036070 con 0x560c7a10c050 2023-10-05T21:15:17.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.355+0000 7ff3db0b6680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.355+0000 7ff3db0b6680 20 started sync module instance, tier type = 2023-10-05T21:15:17.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.355+0000 7ff3db0b6680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:17.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.355+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a112fb0 con 0x7ff3c0007030 2023-10-05T21:15:17.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.356+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3b8006070 con 0x7ff3c0007030 2023-10-05T21:15:17.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.356+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94611587543984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a1144f0 con 0x7ff3c0007030 2023-10-05T21:15:17.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.356+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a114d90 con 0x560c7a0da9e0 2023-10-05T21:15:17.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.357+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94611587543984] v29'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3b8006070 con 0x7ff3c0007030 2023-10-05T21:15:17.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.357+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.357+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94611587549344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a1151e0 con 0x560c7a0da9e0 2023-10-05T21:15:17.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.357+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a115a80 con 0x560c7a10c050 2023-10-05T21:15:17.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.358+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94611587549344] v29'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.358+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3c0036070 con 0x560c7a10c050 2023-10-05T21:15:17.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.358+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94611587550736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a1157f0 con 0x560c7a10c050 2023-10-05T21:15:17.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.358+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a1164e0 con 0x7ff3c0007030 2023-10-05T21:15:17.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.358+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94611587550736] v29'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3c0036070 con 0x560c7a10c050 2023-10-05T21:15:17.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.358+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3b8006070 con 0x7ff3c0007030 2023-10-05T21:15:17.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.359+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94611587555312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a116890 con 0x7ff3c0007030 2023-10-05T21:15:17.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.359+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a1172a0 con 0x560c7a0da9e0 2023-10-05T21:15:17.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.359+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94611587555312] v29'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3b8006070 con 0x7ff3c0007030 2023-10-05T21:15:17.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.359+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.359+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94611587558832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a1176f0 con 0x560c7a0da9e0 2023-10-05T21:15:17.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.359+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a118100 con 0x7ff3b800d3d0 2023-10-05T21:15:17.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.360+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94611587558832] v29'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.360+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.360+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94611587560496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a118100 con 0x7ff3b800d3d0 2023-10-05T21:15:17.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.360+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a118b10 con 0x7ff3b800d3d0 2023-10-05T21:15:17.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.361+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(96 notify.6 [create] v29'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.361+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94611587565088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a118fa0 con 0x7ff3b800d3d0 2023-10-05T21:15:17.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.361+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a119b70 con 0x7ff3b800d3d0 2023-10-05T21:15:17.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.361+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(95 notify.5 [watch watch cookie 94611587560496] v29'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.361+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94611587565088] v29'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.361+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.361+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94611587569152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a118a70 con 0x7ff3b800d3d0 2023-10-05T21:15:17.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.361+0000 7ff3db0b6680 20 add_watcher() i=0 2023-10-05T21:15:17.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.361+0000 7ff3db0b6680 20 add_watcher() i=1 2023-10-05T21:15:17.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.361+0000 7ff3db0b6680 20 add_watcher() i=2 2023-10-05T21:15:17.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.361+0000 7ff3db0b6680 20 add_watcher() i=3 2023-10-05T21:15:17.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.361+0000 7ff3db0b6680 20 add_watcher() i=4 2023-10-05T21:15:17.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.361+0000 7ff3db0b6680 20 add_watcher() i=5 2023-10-05T21:15:17.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.361+0000 7ff3db0b6680 20 add_watcher() i=6 2023-10-05T21:15:17.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.362+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94611587569152] v29'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.362+0000 7ff3db0b6680 20 add_watcher() i=7 2023-10-05T21:15:17.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.362+0000 7ff3db0b6680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:17.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.362+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a11cb60 con 0x560c7a0da9e0 2023-10-05T21:15:17.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.362+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.363+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94611587562512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a11a020 con 0x560c7a0da9e0 2023-10-05T21:15:17.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.363+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94611587562512] v29'117 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.363+0000 7ff39ffdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:17.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.363+0000 7ff3db0b6680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:17.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.363+0000 7ff3db0b6680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:17.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.363+0000 7ff3db0b6680 1 Processor -- start 2023-10-05T21:15:17.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.364+0000 7ff3db0b6680 1 -- start start 2023-10-05T21:15:17.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.364+0000 7ff3db0b6680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a1265d0 0x560c7a1269e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.364+0000 7ff3db0b6680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c7a126ff0 con 0x560c7a1265d0 2023-10-05T21:15:17.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.364+0000 7ff3c7fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a1265d0 0x560c7a1269e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.364+0000 7ff3c7fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a1265d0 0x560c7a1269e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37574/0 (socket says 172.21.15.153:37574) 2023-10-05T21:15:17.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.364+0000 7ff3c7fff700 1 -- 172.21.15.153:0/2837219274 learned_addr learned my addr 172.21.15.153:0/2837219274 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:17.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.364+0000 7ff3c7fff700 1 -- 172.21.15.153:0/2837219274 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c7a1274d0 con 0x560c7a1265d0 2023-10-05T21:15:17.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.364+0000 7ff3c7fff700 1 --2- 172.21.15.153:0/2837219274 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a1265d0 0x560c7a1269e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8000fb0 tx=0x7ff3b8006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d91427771008bc8e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.364+0000 7ff39f7de700 1 -- 172.21.15.153:0/2837219274 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3b8023040 con 0x560c7a1265d0 2023-10-05T21:15:17.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.365+0000 7ff39f7de700 1 -- 172.21.15.153:0/2837219274 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b8024040 con 0x560c7a1265d0 2023-10-05T21:15:17.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.365+0000 7ff39f7de700 1 -- 172.21.15.153:0/2837219274 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3b8013040 con 0x560c7a1265d0 2023-10-05T21:15:17.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.365+0000 7ff3db0b6680 1 -- 172.21.15.153:0/2837219274 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a1265d0 msgr2=0x560c7a1269e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.365+0000 7ff3db0b6680 1 --2- 172.21.15.153:0/2837219274 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a1265d0 0x560c7a1269e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8000fb0 tx=0x7ff3b8006000 comp rx=0 tx=0).stop 2023-10-05T21:15:17.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.365+0000 7ff3db0b6680 1 -- 172.21.15.153:0/2837219274 shutdown_connections 2023-10-05T21:15:17.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.365+0000 7ff3db0b6680 1 --2- 172.21.15.153:0/2837219274 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a1265d0 0x560c7a1269e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.365+0000 7ff3db0b6680 1 -- 172.21.15.153:0/2837219274 >> 172.21.15.153:0/2837219274 conn(0x560c7a1228d0 msgr2=0x560c7a1209d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.365+0000 7ff3db0b6680 1 -- 172.21.15.153:0/2837219274 shutdown_connections 2023-10-05T21:15:17.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.365+0000 7ff3db0b6680 1 -- 172.21.15.153:0/2837219274 wait complete. 2023-10-05T21:15:17.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.365+0000 7ff3db0b6680 1 Processor -- start 2023-10-05T21:15:17.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.366+0000 7ff3db0b6680 1 -- start start 2023-10-05T21:15:17.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.366+0000 7ff3db0b6680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a1265d0 0x560c7a12d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.366+0000 7ff3db0b6680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c7a12d7f0 con 0x560c7a1265d0 2023-10-05T21:15:17.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.366+0000 7ff3c7fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a1265d0 0x560c7a12d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.366+0000 7ff3c7fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a1265d0 0x560c7a12d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37586/0 (socket says 172.21.15.153:37586) 2023-10-05T21:15:17.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.366+0000 7ff3c7fff700 1 -- 172.21.15.153:0/290117152 learned_addr learned my addr 172.21.15.153:0/290117152 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:17.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.366+0000 7ff3c7fff700 1 -- 172.21.15.153:0/290117152 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c7a022930 con 0x560c7a1265d0 2023-10-05T21:15:17.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.366+0000 7ff3c7fff700 1 --2- 172.21.15.153:0/290117152 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a1265d0 0x560c7a12d2b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x560c7a1075f0 tx=0x7ff3b8030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.366+0000 7ff39dfdb700 1 -- 172.21.15.153:0/290117152 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3b8023040 con 0x560c7a1265d0 2023-10-05T21:15:17.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.366+0000 7ff39dfdb700 1 -- 172.21.15.153:0/290117152 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b801e420 con 0x560c7a1265d0 2023-10-05T21:15:17.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.366+0000 7ff3db0b6680 1 -- 172.21.15.153:0/290117152 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560c7a12d9f0 con 0x560c7a1265d0 2023-10-05T21:15:17.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.366+0000 7ff39dfdb700 1 -- 172.21.15.153:0/290117152 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3b801e590 con 0x560c7a1265d0 2023-10-05T21:15:17.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.367+0000 7ff3db0b6680 1 -- 172.21.15.153:0/290117152 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560c7a12de40 con 0x560c7a1265d0 2023-10-05T21:15:17.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.367+0000 7ff39dfdb700 1 -- 172.21.15.153:0/290117152 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7ff3b801e6f0 con 0x560c7a1265d0 2023-10-05T21:15:17.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.367+0000 7ff39dfdb700 1 --2- 172.21.15.153:0/290117152 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff314034140 0x7ff3140365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.367+0000 7ff39dfdb700 1 -- 172.21.15.153:0/290117152 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7ff3b804fb00 con 0x560c7a1265d0 2023-10-05T21:15:17.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.367+0000 7ff3ce98f700 1 --2- 172.21.15.153:0/290117152 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff314034140 0x7ff3140365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.367+0000 7ff3db0b6680 5 note: GC not initialized 2023-10-05T21:15:17.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.368+0000 7ff3ce98f700 1 --2- 172.21.15.153:0/290117152 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff314034140 0x7ff3140365f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x560c7a119320 tx=0x7ff3c8037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.368+0000 7ff30effd700 20 reqs_thread_entry: start 2023-10-05T21:15:17.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.368+0000 7ff30cff9700 20 reqs_thread_entry: start 2023-10-05T21:15:17.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.369+0000 7ff3db0b6680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:17.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.369+0000 7ff3db0b6680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:17.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.369+0000 7ff2feffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:47 2023 2023-10-05T21:15:17.408 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:17.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.369+0000 7ff2fe7fc700 20 reqs_thread_entry: start 2023-10-05T21:15:17.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.369+0000 7ff3db0b6680 20 get_system_obj_state: rctx=0x7ffc9e49d618 obj=default.rgw.meta:users.uid:fud state=0x560c79f88240 s->prefetch_data=0 2023-10-05T21:15:17.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.369+0000 7ff3db0b6680 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2023-10-05T21:15:17.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.369+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a192b10 con 0x7ff3b800d3d0 2023-10-05T21:15:17.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.369+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(102 fud [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.369+0000 7ff3db0b6680 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x16 2023-10-05T21:15:17.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.369+0000 7ff3db0b6680 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T21:15:17.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.369+0000 7ff3db0b6680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:17.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.369+0000 7ff3db0b6680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:17.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.369+0000 7ff3db0b6680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:17.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.369+0000 7ff3db0b6680 10 cache get: name=default.rgw.meta+users.uid+fud : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:17.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.369+0000 7ff3db0b6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.369+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:103 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a195090 con 0x7ff3b800d3d0 2023-10-05T21:15:17.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.369+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(103 fud [call,call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 273+0+469 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.370+0000 7ff3db0b6680 20 rados_obj.operate() r=0 bl.length=346 2023-10-05T21:15:17.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.370+0000 7ff3db0b6680 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2023-10-05T21:15:17.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.370+0000 7ff3db0b6680 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T21:15:17.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.370+0000 7ff3db0b6680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:17.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.370+0000 7ff3db0b6680 20 get_system_obj_state: rctx=0x7ffc9e49d670 obj=default.rgw.meta:root:myfoo state=0x560c79f88240 s->prefetch_data=0 2023-10-05T21:15:17.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.370+0000 7ff3db0b6680 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-10-05T21:15:17.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.370+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:104 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a193e50 con 0x7ff3c0007030 2023-10-05T21:15:17.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.370+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(104 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv20 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7ff3b8006070 con 0x7ff3c0007030 2023-10-05T21:15:17.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.370+0000 7ff3db0b6680 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x16 2023-10-05T21:15:17.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.370+0000 7ff3db0b6680 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:17.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.370+0000 7ff3db0b6680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:17.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.370+0000 7ff3db0b6680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:17.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.370+0000 7ff3db0b6680 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x11, cached=0x16) 2023-10-05T21:15:17.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.370+0000 7ff3db0b6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.370+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a197750 con 0x7ff3c0007030 2023-10-05T21:15:17.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.370+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(105 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7ff3b8006070 con 0x7ff3c0007030 2023-10-05T21:15:17.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.370+0000 7ff3db0b6680 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T21:15:17.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.370+0000 7ff3db0b6680 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2023-10-05T21:15:17.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.370+0000 7ff3db0b6680 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:17.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.370+0000 7ff3db0b6680 20 get_system_obj_state: rctx=0x7ffc9e49d670 obj=default.rgw.meta:root:.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 state=0x560c79f88500 s->prefetch_data=0 2023-10-05T21:15:17.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.370+0000 7ff3db0b6680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 : miss 2023-10-05T21:15:17.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.370+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:106 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a196ff0 con 0x560c7a10c050 2023-10-05T21:15:17.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.371+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(106 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7ff3c0036070 con 0x560c7a10c050 2023-10-05T21:15:17.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.371+0000 7ff3db0b6680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 info.flags=0x16 2023-10-05T21:15:17.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.371+0000 7ff3db0b6680 10 adding default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 to cache LRU end 2023-10-05T21:15:17.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.371+0000 7ff3db0b6680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:17.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.371+0000 7ff3db0b6680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:17.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.371+0000 7ff3db0b6680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:17.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.371+0000 7ff3db0b6680 20 Read xattr: user.rgw.acl 2023-10-05T21:15:17.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.371+0000 7ff3db0b6680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:17.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.371+0000 7ff3db0b6680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:17.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.371+0000 7ff3db0b6680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.371+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a199e70 con 0x560c7a10c050 2023-10-05T21:15:17.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.371+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(107 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv2 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7ff3c0036070 con 0x560c7a10c050 2023-10-05T21:15:17.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.371+0000 7ff3db0b6680 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T21:15:17.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.371+0000 7ff3db0b6680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 info.flags=0x13 2023-10-05T21:15:17.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.371+0000 7ff3db0b6680 10 moving default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 to cache LRU end 2023-10-05T21:15:17.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.371+0000 7ff3db0b6680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:17.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.371+0000 7ff3db0b6680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:17.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.371+0000 7ff3db0b6680 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 2023-10-05T21:15:17.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.371+0000 7ff3db0b6680 20 get_system_obj_state: rctx=0x7ffc9e49d5f8 obj=default.rgw.meta:users.uid:fud state=0x560c79f88500 s->prefetch_data=0 2023-10-05T21:15:17.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.371+0000 7ff3db0b6680 10 cache get: name=default.rgw.meta+users.uid+fud : type miss (requested=0x16, cached=0x13) 2023-10-05T21:15:17.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.371+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:108 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a19a5a0 con 0x7ff3b800d3d0 2023-10-05T21:15:17.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.371+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(108 fud [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.371+0000 7ff3db0b6680 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x16 2023-10-05T21:15:17.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.371+0000 7ff3db0b6680 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T21:15:17.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.371+0000 7ff3db0b6680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:17.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.371+0000 7ff3db0b6680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:17.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.371+0000 7ff3db0b6680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:17.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.371+0000 7ff3db0b6680 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x17) 2023-10-05T21:15:17.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.371+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a19b5b0 con 0x7ff3b800d3d0 2023-10-05T21:15:17.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.372+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(109 fud.buckets [call] v29'2 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.372+0000 7ff3db0b6680 20 get_system_obj_state: rctx=0x7ffc9e49d728 obj=default.rgw.meta:root:myfoo state=0x560c79f88500 s->prefetch_data=0 2023-10-05T21:15:17.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.372+0000 7ff3db0b6680 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x16, cached=0x13) 2023-10-05T21:15:17.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.372+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:110 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a19aa90 con 0x7ff3c0007030 2023-10-05T21:15:17.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.373+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(110 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv20 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7ff3b8006070 con 0x7ff3c0007030 2023-10-05T21:15:17.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.373+0000 7ff3db0b6680 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x16 2023-10-05T21:15:17.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.373+0000 7ff3db0b6680 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:17.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.373+0000 7ff3db0b6680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:17.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.373+0000 7ff3db0b6680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:17.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.373+0000 7ff3db0b6680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:17.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.373+0000 7ff3db0b6680 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x13, cached=0x17) 2023-10-05T21:15:17.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.373+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:111 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a19f2b0 con 0x7ff3c0007030 2023-10-05T21:15:17.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.373+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(111 myfoo [delete,create,call,call,writefull 0~165] v29'21 uv21 ondisk = 0) v8 ==== 317+0+0 (crc 0 0 0) 0x7ff3b8006070 con 0x7ff3c0007030 2023-10-05T21:15:17.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.373+0000 7ff3db0b6680 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2023-10-05T21:15:17.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.373+0000 7ff3db0b6680 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:17.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.373+0000 7ff3db0b6680 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2023-10-05T21:15:17.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.373+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94611588115904 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a19df00 con 0x7ff3b800d3d0 2023-10-05T21:15:17.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.374+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 31 ==== watch-notify(notify (1) cookie 94611587565088 notify 124554051597 ret 0) v3 ==== 380+0+0 (crc 0 0 0) 0x7ff3c802d040 con 0x7ff3b800d3d0 2023-10-05T21:15:17.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.374+0000 7ff3cc98b700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051597 cookie 94611587565088 notifier 4466 bl.length()=338 2023-10-05T21:15:17.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.374+0000 7ff3cc98b700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2023-10-05T21:15:17.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.374+0000 7ff3cc98b700 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:17.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.374+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 32 ==== osd_op_reply(112 notify.6 [notify cookie 94611588115904 out=8b] v0'0 uv120 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.374+0000 7ff3cc98b700 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:113 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7ff3b4003d90 con 0x7ff3b800d3d0 2023-10-05T21:15:17.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.374+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 33 ==== watch-notify(notify_complete (2) cookie 94611588115904 notify 124554051597 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7ff3c8037db0 con 0x7ff3b800d3d0 2023-10-05T21:15:17.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.374+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 34 ==== osd_op_reply(113 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.374+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:114 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94611587543984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a19edc0 con 0x7ff3c0007030 2023-10-05T21:15:17.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.375+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== osd_op_reply(114 notify.0 [watch unwatch cookie 94611587543984] v29'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3b8006070 con 0x7ff3c0007030 2023-10-05T21:15:17.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.375+0000 7ff3db0b6680 20 remove_watcher() i=0 2023-10-05T21:15:17.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.375+0000 7ff3db0b6680 2 removed watcher, disabling cache 2023-10-05T21:15:17.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.375+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:115 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94611587549344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a1133b0 con 0x560c7a0da9e0 2023-10-05T21:15:17.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.376+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(115 notify.1 [watch unwatch cookie 94611587549344] v29'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.376+0000 7ff3db0b6680 20 remove_watcher() i=1 2023-10-05T21:15:17.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.376+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:116 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94611587550736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a1148a0 con 0x560c7a10c050 2023-10-05T21:15:17.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.377+0000 7ff3ce18e700 1 -- 172.21.15.153:0/4178802676 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(116 notify.2 [watch unwatch cookie 94611587550736] v29'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3c0036070 con 0x560c7a10c050 2023-10-05T21:15:17.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.377+0000 7ff3db0b6680 20 remove_watcher() i=2 2023-10-05T21:15:17.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.377+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:117 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94611587555312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a1148a0 con 0x7ff3c0007030 2023-10-05T21:15:17.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.377+0000 7ff3c7fff700 1 -- 172.21.15.153:0/4178802676 <== osd.2 v2:172.21.15.153:6807/140454 22 ==== osd_op_reply(117 notify.3 [watch unwatch cookie 94611587555312] v29'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3b8006070 con 0x7ff3c0007030 2023-10-05T21:15:17.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.377+0000 7ff3db0b6680 20 remove_watcher() i=3 2023-10-05T21:15:17.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.377+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:118 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94611587558832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a115ff0 con 0x560c7a0da9e0 2023-10-05T21:15:17.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.378+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(118 notify.4 [watch unwatch cookie 94611587558832] v29'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.378+0000 7ff3db0b6680 20 remove_watcher() i=4 2023-10-05T21:15:17.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.378+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:119 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94611587560496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a1148a0 con 0x7ff3b800d3d0 2023-10-05T21:15:17.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.379+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 35 ==== osd_op_reply(119 notify.5 [watch unwatch cookie 94611587560496] v29'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.379+0000 7ff3db0b6680 20 remove_watcher() i=5 2023-10-05T21:15:17.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.379+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:120 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94611587565088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a116db0 con 0x7ff3b800d3d0 2023-10-05T21:15:17.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.380+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 36 ==== osd_op_reply(120 notify.6 [watch unwatch cookie 94611587565088] v29'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.380+0000 7ff3db0b6680 20 remove_watcher() i=6 2023-10-05T21:15:17.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.380+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:121 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94611587569152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a117430 con 0x7ff3b800d3d0 2023-10-05T21:15:17.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.381+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.0 v2:172.21.15.111:6800/111394 37 ==== osd_op_reply(121 notify.7 [watch unwatch cookie 94611587569152] v29'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff3c800a570 con 0x7ff3b800d3d0 2023-10-05T21:15:17.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.381+0000 7ff3db0b6680 20 remove_watcher() i=7 2023-10-05T21:15:17.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.381+0000 7ff39ffdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:17.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.381+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:122 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94611587562512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x560c7a1148a0 con 0x560c7a0da9e0 2023-10-05T21:15:17.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.382+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(122 data_loggenerations_metadata [watch unwatch cookie 94611587562512] v29'118 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff3c800a570 con 0x560c7a0da9e0 2023-10-05T21:15:17.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.382+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ff3b800d3d0 msgr2=0x7ff3b800d820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.382+0000 7ff3db0b6680 1 --2- 172.21.15.153:0/4178802676 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ff3b800d3d0 0x7ff3b800d820 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.382+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x560c7a0da9e0 msgr2=0x560c7a109be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.382+0000 7ff3db0b6680 1 --2- 172.21.15.153:0/4178802676 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x560c7a0da9e0 0x560c7a109be0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.382+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ff3c0007030 msgr2=0x7ff3c0048940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.382+0000 7ff3db0b6680 1 --2- 172.21.15.153:0/4178802676 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ff3c0007030 0x7ff3c0048940 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.382+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x560c7a10c050 msgr2=0x560c7a10e430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.382+0000 7ff3db0b6680 1 --2- 172.21.15.153:0/4178802676 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x560c7a10c050 0x560c7a10e430 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.382+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff3b0034140 msgr2=0x7ff3b00365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.382+0000 7ff3db0b6680 1 --2- 172.21.15.153:0/4178802676 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff3b0034140 0x7ff3b00365f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8004170 tx=0x7ff3b8001380 comp rx=0 tx=0).stop 2023-10-05T21:15:17.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.382+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a0490b0 msgr2=0x560c7a0fddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.382+0000 7ff3ce98f700 1 -- 172.21.15.153:0/4178802676 reap_dead start 2023-10-05T21:15:17.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.382+0000 7ff3db0b6680 1 --2- 172.21.15.153:0/4178802676 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a0490b0 0x560c7a0fddf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff3c001f040 tx=0x7ff3c001d000 comp rx=0 tx=0).stop 2023-10-05T21:15:17.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.382+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 shutdown_connections 2023-10-05T21:15:17.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.382+0000 7ff3db0b6680 1 --2- 172.21.15.153:0/4178802676 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a0490b0 0x560c7a0fddf0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.382+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 >> 172.21.15.153:0/4178802676 conn(0x560c7a0cfb90 msgr2=0x560c7a0f0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.382+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 shutdown_connections 2023-10-05T21:15:17.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.382+0000 7ff3db0b6680 1 -- 172.21.15.153:0/4178802676 wait complete. 2023-10-05T21:15:17.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.383+0000 7ff3db0b6680 1 -- 172.21.15.153:0/290117152 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff314034140 msgr2=0x7ff3140365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.383+0000 7ff3db0b6680 1 --2- 172.21.15.153:0/290117152 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff314034140 0x7ff3140365f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x560c7a119320 tx=0x7ff3c8037450 comp rx=0 tx=0).stop 2023-10-05T21:15:17.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.383+0000 7ff3db0b6680 1 -- 172.21.15.153:0/290117152 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a1265d0 msgr2=0x560c7a12d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.383+0000 7ff3db0b6680 1 --2- 172.21.15.153:0/290117152 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a1265d0 0x560c7a12d2b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x560c7a1075f0 tx=0x7ff3b8030000 comp rx=0 tx=0).stop 2023-10-05T21:15:17.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.383+0000 7ff3db0b6680 1 -- 172.21.15.153:0/290117152 shutdown_connections 2023-10-05T21:15:17.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.383+0000 7ff3db0b6680 1 --2- 172.21.15.153:0/290117152 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff314034140 0x7ff3140365f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.383+0000 7ff3db0b6680 1 --2- 172.21.15.153:0/290117152 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c7a1265d0 0x560c7a12d2b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.383+0000 7ff3db0b6680 1 -- 172.21.15.153:0/290117152 >> 172.21.15.153:0/290117152 conn(0x560c7a1228d0 msgr2=0x560c7a1209a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.383+0000 7ff3db0b6680 1 -- 172.21.15.153:0/290117152 shutdown_connections 2023-10-05T21:15:17.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.383+0000 7ff3db0b6680 1 -- 172.21.15.153:0/290117152 wait complete. 2023-10-05T21:15:17.422 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1'] 2023-10-05T21:15:17.422 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1'] 2023-10-05T21:15:17.422 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 2023-10-05T21:15:17.470 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:17.471 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:17.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.470+0000 7f4a3dd46680 1 Processor -- start 2023-10-05T21:15:17.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.470+0000 7f4a3dd46680 1 -- start start 2023-10-05T21:15:17.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.470+0000 7f4a3dd46680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55b772fee750 0x55b772ff0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.470+0000 7f4a3dd46680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b772f37930 con 0x55b772f5e040 2023-10-05T21:15:17.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.470+0000 7f4a3dd46680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b772ef7db0 con 0x55b772fee750 2023-10-05T21:15:17.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.470+0000 7f4a2bfff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55b772fee750 0x55b772ff0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.470+0000 7f4a30e1e700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55b772f5e040 0x55b772fed030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:55188/0 (socket says 172.21.15.153:55188) 2023-10-05T21:15:17.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.470+0000 7f4a30e1e700 1 -- 172.21.15.153:0/2091790475 learned_addr learned my addr 172.21.15.153:0/2091790475 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:17.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.471+0000 7f4a2bfff700 1 -- 172.21.15.153:0/2091790475 >> v1:172.21.15.111:6789/0 conn(0x55b772f5e040 legacy=0x55b772fed030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.471+0000 7f4a2bfff700 1 -- 172.21.15.153:0/2091790475 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b772ff2180 con 0x55b772fee750 2023-10-05T21:15:17.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.471+0000 7f4a2bfff700 1 --2- 172.21.15.153:0/2091790475 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b772fee750 0x55b772ff0b30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c00a5d0 tx=0x7f4a1c005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75abdb96f50d7f98 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.471+0000 7f4a2b7fe700 1 -- 172.21.15.153:0/2091790475 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a1c0086a0 con 0x55b772fee750 2023-10-05T21:15:17.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.471+0000 7f4a2b7fe700 1 -- 172.21.15.153:0/2091790475 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1c008800 con 0x55b772fee750 2023-10-05T21:15:17.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.471+0000 7f4a2b7fe700 1 -- 172.21.15.153:0/2091790475 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a1c008ad0 con 0x55b772fee750 2023-10-05T21:15:17.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.471+0000 7f4a3dd46680 1 -- 172.21.15.153:0/2091790475 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b772fee750 msgr2=0x55b772ff0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.471+0000 7f4a3dd46680 1 --2- 172.21.15.153:0/2091790475 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b772fee750 0x55b772ff0b30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c00a5d0 tx=0x7f4a1c005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:17.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.471+0000 7f4a3dd46680 1 -- 172.21.15.153:0/2091790475 shutdown_connections 2023-10-05T21:15:17.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.471+0000 7f4a3dd46680 1 --2- 172.21.15.153:0/2091790475 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b772fee750 0x55b772ff0b30 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.471+0000 7f4a3dd46680 1 -- 172.21.15.153:0/2091790475 >> 172.21.15.153:0/2091790475 conn(0x55b772fe4b20 msgr2=0x55b772fe6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.471+0000 7f4a3dd46680 1 -- 172.21.15.153:0/2091790475 shutdown_connections 2023-10-05T21:15:17.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.472+0000 7f4a3dd46680 1 -- 172.21.15.153:0/2091790475 wait complete. 2023-10-05T21:15:17.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.473+0000 7f4a3dd46680 1 Processor -- start 2023-10-05T21:15:17.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.473+0000 7f4a3dd46680 1 -- start start 2023-10-05T21:15:17.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.473+0000 7f4a3dd46680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b772f5e040 0x55b7730098d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.473+0000 7f4a3dd46680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b772e97ea0 con 0x55b772f5e040 2023-10-05T21:15:17.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.473+0000 7f4a30e1e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b772f5e040 0x55b7730098d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.473+0000 7f4a30e1e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b772f5e040 0x55b7730098d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37608/0 (socket says 172.21.15.153:37608) 2023-10-05T21:15:17.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.473+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1154571704 learned_addr learned my addr 172.21.15.153:0/1154571704 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:17.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.473+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1154571704 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1c005cf0 con 0x55b772f5e040 2023-10-05T21:15:17.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.474+0000 7f4a30e1e700 1 --2- 172.21.15.153:0/1154571704 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b772f5e040 0x55b7730098d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4a24001bc0 tx=0x7f4a24001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d08b7d09a96ddea server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.474+0000 7f4a2a7fc700 1 -- 172.21.15.153:0/1154571704 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a2400bbf0 con 0x55b772f5e040 2023-10-05T21:15:17.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.474+0000 7f4a2a7fc700 1 -- 172.21.15.153:0/1154571704 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2400bd50 con 0x55b772f5e040 2023-10-05T21:15:17.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.474+0000 7f4a2a7fc700 1 -- 172.21.15.153:0/1154571704 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a2400e470 con 0x55b772f5e040 2023-10-05T21:15:17.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.474+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1154571704 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b772f5e040 msgr2=0x55b7730098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.474+0000 7f4a3dd46680 1 --2- 172.21.15.153:0/1154571704 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b772f5e040 0x55b7730098d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4a24001bc0 tx=0x7f4a24001770 comp rx=0 tx=0).stop 2023-10-05T21:15:17.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.474+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1154571704 shutdown_connections 2023-10-05T21:15:17.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.474+0000 7f4a3dd46680 1 --2- 172.21.15.153:0/1154571704 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b772f5e040 0x55b7730098d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.474+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1154571704 >> 172.21.15.153:0/1154571704 conn(0x55b772fe4b20 msgr2=0x55b7730053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.474+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1154571704 shutdown_connections 2023-10-05T21:15:17.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.474+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1154571704 wait complete. 2023-10-05T21:15:17.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.474+0000 7f4a3dd46680 1 Processor -- start 2023-10-05T21:15:17.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.475+0000 7f4a3dd46680 1 -- start start 2023-10-05T21:15:17.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.475+0000 7f4a3dd46680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b772f5e040 0x55b773010db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.475+0000 7f4a3dd46680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b772e8ec80 con 0x55b772f5e040 2023-10-05T21:15:17.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.475+0000 7f4a30e1e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b772f5e040 0x55b773010db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.475+0000 7f4a30e1e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b772f5e040 0x55b773010db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37610/0 (socket says 172.21.15.153:37610) 2023-10-05T21:15:17.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.475+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 learned_addr learned my addr 172.21.15.153:0/1808471824 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:17.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.475+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b772f37930 con 0x55b772f5e040 2023-10-05T21:15:17.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.475+0000 7f4a30e1e700 1 --2- 172.21.15.153:0/1808471824 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b772f5e040 0x55b773010db0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x55b77300a670 tx=0x7f4a24016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.475+0000 7f4a28ff9700 1 -- 172.21.15.153:0/1808471824 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a2401f070 con 0x55b772f5e040 2023-10-05T21:15:17.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.476+0000 7f4a28ff9700 1 -- 172.21.15.153:0/1808471824 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2401a2e0 con 0x55b772f5e040 2023-10-05T21:15:17.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.476+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b7730112f0 con 0x55b772f5e040 2023-10-05T21:15:17.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.476+0000 7f4a28ff9700 1 -- 172.21.15.153:0/1808471824 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a2400bec0 con 0x55b772f5e040 2023-10-05T21:15:17.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.476+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b7730117c0 con 0x55b772f5e040 2023-10-05T21:15:17.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.476+0000 7f4a3dd46680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.477+0000 7f4a28ff9700 1 -- 172.21.15.153:0/1808471824 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f4a2401a940 con 0x55b772f5e040 2023-10-05T21:15:17.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.477+0000 7f4a28ff9700 1 --2- 172.21.15.153:0/1808471824 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4a140340f0 0x7f4a140365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.477+0000 7f4a28ff9700 1 -- 172.21.15.153:0/1808471824 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f4a24048d60 con 0x55b772f5e040 2023-10-05T21:15:17.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.477+0000 7f4a2bfff700 1 --2- 172.21.15.153:0/1808471824 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4a140340f0 0x7f4a140365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.477+0000 7f4a3dd46680 1 --2- 172.21.15.153:0/1808471824 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55b772fee750 0x55b77301cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.477+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b77301d350 con 0x55b772fee750 2023-10-05T21:15:17.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.477+0000 7f4a3161f700 1 --2- 172.21.15.153:0/1808471824 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55b772fee750 0x55b77301cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.477+0000 7f4a2bfff700 1 --2- 172.21.15.153:0/1808471824 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4a140340f0 0x7f4a140365a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c005a90 tx=0x7f4a1c015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.477+0000 7f4a3161f700 1 --2- 172.21.15.153:0/1808471824 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55b772fee750 0x55b77301cbc0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.478+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.478+0000 7f4a3dd46680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.478+0000 7f4a3dd46680 20 realm 2023-10-05T21:15:17.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.478+0000 7f4a3dd46680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.478+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b77301a1a0 con 0x55b772fee750 2023-10-05T21:15:17.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.478+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.478+0000 7f4a3dd46680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.478+0000 7f4a3dd46680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:17.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.478+0000 7f4a3dd46680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.478+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b77301de50 con 0x55b772fee750 2023-10-05T21:15:17.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.478+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.478+0000 7f4a3dd46680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.478+0000 7f4a3dd46680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.478+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b77301e770 con 0x55b772fee750 2023-10-05T21:15:17.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.478+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.478+0000 7f4a3dd46680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.478+0000 7f4a3dd46680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.478+0000 7f4a3dd46680 1 --2- 172.21.15.153:0/1808471824 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b77301f030 0x55b773021410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.478+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773021a60 con 0x55b77301f030 2023-10-05T21:15:17.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.479+0000 7f4a30e1e700 1 --2- 172.21.15.153:0/1808471824 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b77301f030 0x55b773021410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.479+0000 7f4a30e1e700 1 --2- 172.21.15.153:0/1808471824 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b77301f030 0x55b773021410 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.479+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f4a24043db0 con 0x55b77301f030 2023-10-05T21:15:17.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.479+0000 7f4a3dd46680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:17.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.479+0000 7f4a3dd46680 20 searching for the correct realm 2023-10-05T21:15:17.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.479+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x55b77301f030 2023-10-05T21:15:17.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.479+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a24043db0 con 0x55b77301f030 2023-10-05T21:15:17.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.479+0000 7f4a30e1e700 1 --2- 172.21.15.153:0/1808471824 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4a2400dbd0 0x7f4a2402d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.480+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x7f4a2400dbd0 2023-10-05T21:15:17.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.480+0000 7f4a2bfff700 1 --2- 172.21.15.153:0/1808471824 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4a2400dbd0 0x7f4a2402d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.480+0000 7f4a2bfff700 1 --2- 172.21.15.153:0/1808471824 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4a2400dbd0 0x7f4a2402d3f0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.480+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a1c019040 con 0x7f4a2400dbd0 2023-10-05T21:15:17.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.480+0000 7f4a2bfff700 1 --2- 172.21.15.153:0/1808471824 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4a1c007030 0x7f4a1c01d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.480+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x7f4a1c007030 2023-10-05T21:15:17.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.480+0000 7f4a3161f700 1 --2- 172.21.15.153:0/1808471824 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4a1c007030 0x7f4a1c01d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.481+0000 7f4a3161f700 1 --2- 172.21.15.153:0/1808471824 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4a1c007030 0x7f4a1c01d420 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.481+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.481+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x55b772fee750 2023-10-05T21:15:17.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.481+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.481+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x55b772fee750 2023-10-05T21:15:17.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.481+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.481+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x7f4a1c007030 2023-10-05T21:15:17.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.481+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.482+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x7f4a1c007030 2023-10-05T21:15:17.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.482+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.482+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x7f4a2400dbd0 2023-10-05T21:15:17.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.482+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a1c019040 con 0x7f4a2400dbd0 2023-10-05T21:15:17.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.482+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x55b77301f030 2023-10-05T21:15:17.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.482+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4a24043db0 con 0x55b77301f030 2023-10-05T21:15:17.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.482+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x55b772fee750 2023-10-05T21:15:17.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.482+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.482+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x7f4a1c007030 2023-10-05T21:15:17.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.483+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.483+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x55b772fee750 2023-10-05T21:15:17.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.483+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.483+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x7f4a2400dbd0 2023-10-05T21:15:17.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.483+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a1c019040 con 0x7f4a2400dbd0 2023-10-05T21:15:17.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.483+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x55b77301f030 2023-10-05T21:15:17.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.483+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a24043db0 con 0x55b77301f030 2023-10-05T21:15:17.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.483+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x55b77301f030 2023-10-05T21:15:17.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.484+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a24043db0 con 0x55b77301f030 2023-10-05T21:15:17.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.484+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x7f4a1c007030 2023-10-05T21:15:17.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.484+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.484+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x55b77301f030 2023-10-05T21:15:17.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.484+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a24043db0 con 0x55b77301f030 2023-10-05T21:15:17.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.484+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x55b77301f030 2023-10-05T21:15:17.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.484+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a24043db0 con 0x55b77301f030 2023-10-05T21:15:17.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.484+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x55b772fee750 2023-10-05T21:15:17.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.485+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.485+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x55b772fee750 2023-10-05T21:15:17.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.485+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.485+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x7f4a1c007030 2023-10-05T21:15:17.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.485+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.485+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x55b77301f030 2023-10-05T21:15:17.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.485+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a24043db0 con 0x55b77301f030 2023-10-05T21:15:17.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.485+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x7f4a2400dbd0 2023-10-05T21:15:17.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.485+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a1c019040 con 0x7f4a2400dbd0 2023-10-05T21:15:17.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.486+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x55b772fee750 2023-10-05T21:15:17.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.486+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.486+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x7f4a1c007030 2023-10-05T21:15:17.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.486+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.486+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x55b77301f030 2023-10-05T21:15:17.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.486+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a24043db0 con 0x55b77301f030 2023-10-05T21:15:17.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.486+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x7f4a1c007030 2023-10-05T21:15:17.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.487+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.487+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x7f4a2400dbd0 2023-10-05T21:15:17.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.487+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a1c019040 con 0x7f4a2400dbd0 2023-10-05T21:15:17.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.487+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x55b77301f030 2023-10-05T21:15:17.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.487+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a24043db0 con 0x55b77301f030 2023-10-05T21:15:17.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.487+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x7f4a1c007030 2023-10-05T21:15:17.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.487+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.487+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x55b772fee750 2023-10-05T21:15:17.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.487+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.487+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730235d0 con 0x7f4a2400dbd0 2023-10-05T21:15:17.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.488+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a1c019040 con 0x7f4a2400dbd0 2023-10-05T21:15:17.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.488+0000 7f4a3dd46680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:17.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.488+0000 7f4a3dd46680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:17.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.488+0000 7f4a3dd46680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:17.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.488+0000 7f4a3dd46680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:17.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.488+0000 7f4a3dd46680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.488+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773022520 con 0x55b772fee750 2023-10-05T21:15:17.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.488+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.488+0000 7f4a3dd46680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.488+0000 7f4a3dd46680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.488+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773022920 con 0x55b772fee750 2023-10-05T21:15:17.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.488+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.488+0000 7f4a3dd46680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.488+0000 7f4a3dd46680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.488+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773023a60 con 0x55b772fee750 2023-10-05T21:15:17.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.488+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.488+0000 7f4a3dd46680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:17.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.488+0000 7f4a3dd46680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.488+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773023e10 con 0x55b77301f030 2023-10-05T21:15:17.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.489+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f4a24043db0 con 0x55b77301f030 2023-10-05T21:15:17.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.489+0000 7f4a3dd46680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.489+0000 7f4a3dd46680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.489+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730241c0 con 0x55b772fee750 2023-10-05T21:15:17.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.489+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.489+0000 7f4a3dd46680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.489+0000 7f4a3dd46680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.489+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730241c0 con 0x55b772fee750 2023-10-05T21:15:17.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.489+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.489+0000 7f4a3dd46680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.489+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730241c0 con 0x55b77301f030 2023-10-05T21:15:17.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.489+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a24043db0 con 0x55b77301f030 2023-10-05T21:15:17.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.489+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730241c0 con 0x7f4a2400dbd0 2023-10-05T21:15:17.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.490+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a1c019040 con 0x7f4a2400dbd0 2023-10-05T21:15:17.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.490+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730241c0 con 0x7f4a1c007030 2023-10-05T21:15:17.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.490+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.490+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773023a60 con 0x55b772fee750 2023-10-05T21:15:17.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.490+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.490+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773023a60 con 0x55b772fee750 2023-10-05T21:15:17.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.491+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.491+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773023a60 con 0x7f4a1c007030 2023-10-05T21:15:17.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.491+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.491+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773023a60 con 0x7f4a1c007030 2023-10-05T21:15:17.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.491+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.491+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773023a60 con 0x7f4a2400dbd0 2023-10-05T21:15:17.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.491+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a1c019040 con 0x7f4a2400dbd0 2023-10-05T21:15:17.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.491+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773023a60 con 0x55b77301f030 2023-10-05T21:15:17.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.492+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4a24043db0 con 0x55b77301f030 2023-10-05T21:15:17.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.492+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773023a60 con 0x55b772fee750 2023-10-05T21:15:17.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.492+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.492+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773023a60 con 0x7f4a1c007030 2023-10-05T21:15:17.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.492+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.492+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773023a60 con 0x55b772fee750 2023-10-05T21:15:17.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.492+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.492+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773023a60 con 0x7f4a2400dbd0 2023-10-05T21:15:17.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.493+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a1c019040 con 0x7f4a2400dbd0 2023-10-05T21:15:17.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.493+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773023a60 con 0x55b77301f030 2023-10-05T21:15:17.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.493+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a24043db0 con 0x55b77301f030 2023-10-05T21:15:17.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.493+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773023a60 con 0x55b77301f030 2023-10-05T21:15:17.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.493+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a24043db0 con 0x55b77301f030 2023-10-05T21:15:17.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.493+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773023a60 con 0x7f4a1c007030 2023-10-05T21:15:17.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.493+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.493+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773023a60 con 0x55b77301f030 2023-10-05T21:15:17.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.493+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a24043db0 con 0x55b77301f030 2023-10-05T21:15:17.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.493+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773023a60 con 0x55b77301f030 2023-10-05T21:15:17.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.494+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a24043db0 con 0x55b77301f030 2023-10-05T21:15:17.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.494+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773023a60 con 0x55b772fee750 2023-10-05T21:15:17.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.494+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.494+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773023a60 con 0x55b772fee750 2023-10-05T21:15:17.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.494+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.494+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773023a60 con 0x7f4a1c007030 2023-10-05T21:15:17.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.494+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.494+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773023a60 con 0x55b77301f030 2023-10-05T21:15:17.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.494+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a24043db0 con 0x55b77301f030 2023-10-05T21:15:17.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.494+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773023a60 con 0x7f4a2400dbd0 2023-10-05T21:15:17.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.495+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a1c019040 con 0x7f4a2400dbd0 2023-10-05T21:15:17.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.495+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773023a60 con 0x55b772fee750 2023-10-05T21:15:17.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.495+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.495+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773023a60 con 0x7f4a1c007030 2023-10-05T21:15:17.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.495+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.495+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773023a60 con 0x55b77301f030 2023-10-05T21:15:17.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.495+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a24043db0 con 0x55b77301f030 2023-10-05T21:15:17.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.495+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773023a60 con 0x7f4a1c007030 2023-10-05T21:15:17.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.496+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.496+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773023a60 con 0x7f4a2400dbd0 2023-10-05T21:15:17.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.496+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a1c019040 con 0x7f4a2400dbd0 2023-10-05T21:15:17.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.496+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773023a60 con 0x55b77301f030 2023-10-05T21:15:17.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.496+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a24043db0 con 0x55b77301f030 2023-10-05T21:15:17.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.496+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773023a60 con 0x7f4a1c007030 2023-10-05T21:15:17.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.496+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.496+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773023a60 con 0x55b772fee750 2023-10-05T21:15:17.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.496+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.497+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773023a60 con 0x7f4a2400dbd0 2023-10-05T21:15:17.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.497+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4a1c019040 con 0x7f4a2400dbd0 2023-10-05T21:15:17.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.497+0000 7f4a3dd46680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:17.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.497+0000 7f4a3dd46680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:17.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.497+0000 7f4a3dd46680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:17.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.497+0000 7f4a3dd46680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:17.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.497+0000 7f4a3dd46680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.497+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730241c0 con 0x55b772fee750 2023-10-05T21:15:17.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.497+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.497+0000 7f4a3dd46680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.497+0000 7f4a3dd46680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.497+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730245c0 con 0x55b77301f030 2023-10-05T21:15:17.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.497+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f4a24043db0 con 0x55b77301f030 2023-10-05T21:15:17.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.497+0000 7f4a3dd46680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:17.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.497+0000 7f4a3dd46680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.497+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773022150 con 0x55b772fee750 2023-10-05T21:15:17.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.498+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.498+0000 7f4a3dd46680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.498+0000 7f4a3dd46680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.498+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773024f30 con 0x55b772fee750 2023-10-05T21:15:17.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.498+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.498+0000 7f4a3dd46680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:17.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.498+0000 7f4a3dd46680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.498+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773024f30 con 0x7f4a1c007030 2023-10-05T21:15:17.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.498+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.498+0000 7f4a3dd46680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.498+0000 7f4a3dd46680 20 zone default found 2023-10-05T21:15:17.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.498+0000 7f4a3dd46680 4 Realm: () 2023-10-05T21:15:17.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.498+0000 7f4a3dd46680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:17.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.498+0000 7f4a3dd46680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:17.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.498+0000 7f4a3dd46680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:17.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.498+0000 7f4a3dd46680 20 zonegroup default 2023-10-05T21:15:17.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.498+0000 7f4a3dd46680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.498+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773024f30 con 0x7f4a1c007030 2023-10-05T21:15:17.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.498+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.498+0000 7f4a3dd46680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.498+0000 7f4a3dd46680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.498+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730268b0 con 0x55b77301f030 2023-10-05T21:15:17.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.499+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4a24043db0 con 0x55b77301f030 2023-10-05T21:15:17.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.499+0000 7f4a3dd46680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.499+0000 7f4a3dd46680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.499+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773026c60 con 0x55b77301f030 2023-10-05T21:15:17.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.499+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4a24043db0 con 0x55b77301f030 2023-10-05T21:15:17.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.499+0000 7f4a3dd46680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.499+0000 7f4a3dd46680 20 started sync module instance, tier type = 2023-10-05T21:15:17.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.499+0000 7f4a3dd46680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:17.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.499+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773025f70 con 0x7f4a2400dbd0 2023-10-05T21:15:17.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.500+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a1c019040 con 0x7f4a2400dbd0 2023-10-05T21:15:17.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.500+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94246396912496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773027500 con 0x7f4a2400dbd0 2023-10-05T21:15:17.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.500+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773027da0 con 0x55b772fee750 2023-10-05T21:15:17.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.500+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94246396912496] v29'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a1c019040 con 0x7f4a2400dbd0 2023-10-05T21:15:17.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.500+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.500+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94246396917936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773027130 con 0x55b772fee750 2023-10-05T21:15:17.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.501+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730289c0 con 0x55b77301f030 2023-10-05T21:15:17.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.501+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94246396917936] v29'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.501+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a24043db0 con 0x55b77301f030 2023-10-05T21:15:17.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.501+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94246396921040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773028dc0 con 0x55b77301f030 2023-10-05T21:15:17.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.501+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730297d0 con 0x7f4a2400dbd0 2023-10-05T21:15:17.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.502+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94246396921040] v29'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a24043db0 con 0x55b77301f030 2023-10-05T21:15:17.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.502+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a1c019040 con 0x7f4a2400dbd0 2023-10-05T21:15:17.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.502+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94246396919040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773029420 con 0x7f4a2400dbd0 2023-10-05T21:15:17.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.502+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b77302a860 con 0x55b772fee750 2023-10-05T21:15:17.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.503+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94246396919040] v29'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a1c019040 con 0x7f4a2400dbd0 2023-10-05T21:15:17.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.503+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.503+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94246396928848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b77302ac60 con 0x55b772fee750 2023-10-05T21:15:17.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.503+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b77302b740 con 0x7f4a1c007030 2023-10-05T21:15:17.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.504+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94246396928848] v29'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.504+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.504+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94246396926848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b77302b700 con 0x7f4a1c007030 2023-10-05T21:15:17.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.504+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b77302c1c0 con 0x7f4a1c007030 2023-10-05T21:15:17.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.504+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94246396926848] v29'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.504+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.504+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94246396935344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b77302b700 con 0x7f4a1c007030 2023-10-05T21:15:17.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.504+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b77302cc20 con 0x7f4a1c007030 2023-10-05T21:15:17.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.505+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94246396935344] v29'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.505+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.505+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94246396938592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b77302b700 con 0x7f4a1c007030 2023-10-05T21:15:17.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.505+0000 7f4a3dd46680 20 add_watcher() i=0 2023-10-05T21:15:17.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.505+0000 7f4a3dd46680 20 add_watcher() i=1 2023-10-05T21:15:17.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.505+0000 7f4a3dd46680 20 add_watcher() i=2 2023-10-05T21:15:17.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.505+0000 7f4a3dd46680 20 add_watcher() i=3 2023-10-05T21:15:17.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.505+0000 7f4a3dd46680 20 add_watcher() i=4 2023-10-05T21:15:17.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.505+0000 7f4a3dd46680 20 add_watcher() i=5 2023-10-05T21:15:17.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.505+0000 7f4a3dd46680 20 add_watcher() i=6 2023-10-05T21:15:17.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.506+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94246396938592] v29'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.506+0000 7f4a3dd46680 20 add_watcher() i=7 2023-10-05T21:15:17.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.506+0000 7f4a3dd46680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:17.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.506+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773030050 con 0x55b772fee750 2023-10-05T21:15:17.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.506+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.506+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94246396933136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b77302d520 con 0x55b772fee750 2023-10-05T21:15:17.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.507+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94246396933136] v29'119 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.507+0000 7f4a01fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:17.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.507+0000 7f4a3dd46680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:17.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.507+0000 7f4a3dd46680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:17.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.507+0000 7f4a3dd46680 1 Processor -- start 2023-10-05T21:15:17.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.507+0000 7f4a3dd46680 1 -- start start 2023-10-05T21:15:17.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.507+0000 7f4a3dd46680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b773039ca0 0x55b77303a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.507+0000 7f4a3dd46680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b77303a6c0 con 0x55b773039ca0 2023-10-05T21:15:17.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.508+0000 7f4a2bfff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b773039ca0 0x55b77303a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.508+0000 7f4a2bfff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b773039ca0 0x55b77303a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37622/0 (socket says 172.21.15.153:37622) 2023-10-05T21:15:17.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.508+0000 7f4a2bfff700 1 -- 172.21.15.153:0/3598505961 learned_addr learned my addr 172.21.15.153:0/3598505961 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:17.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.508+0000 7f4a2bfff700 1 -- 172.21.15.153:0/3598505961 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b77303aba0 con 0x55b773039ca0 2023-10-05T21:15:17.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.508+0000 7f4a2bfff700 1 --2- 172.21.15.153:0/3598505961 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b773039ca0 0x55b77303a0b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x55b772ff2150 tx=0x7f4a1c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a12c1dc82d812a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.508+0000 7f4a017e2700 1 -- 172.21.15.153:0/3598505961 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a1c01ddc0 con 0x55b773039ca0 2023-10-05T21:15:17.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.508+0000 7f4a017e2700 1 -- 172.21.15.153:0/3598505961 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1c02b440 con 0x55b773039ca0 2023-10-05T21:15:17.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.508+0000 7f4a017e2700 1 -- 172.21.15.153:0/3598505961 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a1c02b5f0 con 0x55b773039ca0 2023-10-05T21:15:17.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.509+0000 7f4a3dd46680 1 -- 172.21.15.153:0/3598505961 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b773039ca0 msgr2=0x55b77303a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.509+0000 7f4a3dd46680 1 --2- 172.21.15.153:0/3598505961 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b773039ca0 0x55b77303a0b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x55b772ff2150 tx=0x7f4a1c012000 comp rx=0 tx=0).stop 2023-10-05T21:15:17.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.509+0000 7f4a3dd46680 1 -- 172.21.15.153:0/3598505961 shutdown_connections 2023-10-05T21:15:17.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.509+0000 7f4a3dd46680 1 --2- 172.21.15.153:0/3598505961 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b773039ca0 0x55b77303a0b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.509+0000 7f4a3dd46680 1 -- 172.21.15.153:0/3598505961 >> 172.21.15.153:0/3598505961 conn(0x55b773035fa0 msgr2=0x55b7730340a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.509+0000 7f4a3dd46680 1 -- 172.21.15.153:0/3598505961 shutdown_connections 2023-10-05T21:15:17.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.509+0000 7f4a3dd46680 1 -- 172.21.15.153:0/3598505961 wait complete. 2023-10-05T21:15:17.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.509+0000 7f4a3dd46680 1 Processor -- start 2023-10-05T21:15:17.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.509+0000 7f4a3dd46680 1 -- start start 2023-10-05T21:15:17.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.510+0000 7f4a3dd46680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b773039ca0 0x55b773040910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.510+0000 7f4a3dd46680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b773040e50 con 0x55b773039ca0 2023-10-05T21:15:17.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.510+0000 7f4a2bfff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b773039ca0 0x55b773040910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.510+0000 7f4a2bfff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b773039ca0 0x55b773040910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37638/0 (socket says 172.21.15.153:37638) 2023-10-05T21:15:17.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.510+0000 7f4a2bfff700 1 -- 172.21.15.153:0/2179457117 learned_addr learned my addr 172.21.15.153:0/2179457117 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:17.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.510+0000 7f4a2bfff700 1 -- 172.21.15.153:0/2179457117 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b772ff2180 con 0x55b773039ca0 2023-10-05T21:15:17.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.510+0000 7f4a2bfff700 1 --2- 172.21.15.153:0/2179457117 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b773039ca0 0x55b773040910 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x55b773035510 tx=0x7f4a1c030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.510+0000 7f497b7fe700 1 -- 172.21.15.153:0/2179457117 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a1c036610 con 0x55b773039ca0 2023-10-05T21:15:17.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.510+0000 7f497b7fe700 1 -- 172.21.15.153:0/2179457117 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1c036770 con 0x55b773039ca0 2023-10-05T21:15:17.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.510+0000 7f4a3dd46680 1 -- 172.21.15.153:0/2179457117 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b773041050 con 0x55b773039ca0 2023-10-05T21:15:17.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.510+0000 7f497b7fe700 1 -- 172.21.15.153:0/2179457117 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a1c036920 con 0x55b773039ca0 2023-10-05T21:15:17.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.510+0000 7f4a3dd46680 1 -- 172.21.15.153:0/2179457117 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b7730414a0 con 0x55b773039ca0 2023-10-05T21:15:17.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.511+0000 7f497b7fe700 1 -- 172.21.15.153:0/2179457117 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f4a1c036a80 con 0x55b773039ca0 2023-10-05T21:15:17.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.511+0000 7f497b7fe700 1 --2- 172.21.15.153:0/2179457117 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4970034140 0x7f49700365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.511+0000 7f497b7fe700 1 -- 172.21.15.153:0/2179457117 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f4a1c030070 con 0x55b773039ca0 2023-10-05T21:15:17.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.511+0000 7f4a3161f700 1 --2- 172.21.15.153:0/2179457117 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4970034140 0x7f49700365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.511+0000 7f4a3dd46680 5 note: GC not initialized 2023-10-05T21:15:17.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.512+0000 7f4a3161f700 1 --2- 172.21.15.153:0/2179457117 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4970034140 0x7f49700365f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55b77302d480 tx=0x7f4a2c037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.512+0000 7f4978ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:17.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.513+0000 7f496e7fc700 20 reqs_thread_entry: start 2023-10-05T21:15:17.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.513+0000 7f4a3dd46680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:17.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.513+0000 7f4a3dd46680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:17.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.513+0000 7f496cff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:47 2023 2023-10-05T21:15:17.548 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:17.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.513+0000 7f4953fff700 20 reqs_thread_entry: start 2023-10-05T21:15:17.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.513+0000 7f4a3dd46680 20 get_system_obj_state: rctx=0x7ffccadb0458 obj=default.rgw.meta:users.uid:foo state=0x55b772e9d240 s->prefetch_data=0 2023-10-05T21:15:17.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.513+0000 7f4a3dd46680 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T21:15:17.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.513+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730a62f0 con 0x55b772fee750 2023-10-05T21:15:17.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.513+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.513+0000 7f4a3dd46680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T21:15:17.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.513+0000 7f4a3dd46680 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:17.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.513+0000 7f4a3dd46680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:17.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.513+0000 7f4a3dd46680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:17.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.513+0000 7f4a3dd46680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:17.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.513+0000 7f4a3dd46680 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:17.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.513+0000 7f4a3dd46680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.513+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730a85f0 con 0x55b772fee750 2023-10-05T21:15:17.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.514+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.514+0000 7f4a3dd46680 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T21:15:17.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.514+0000 7f4a3dd46680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T21:15:17.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.514+0000 7f4a3dd46680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:17.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.514+0000 7f4a3dd46680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:17.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.514+0000 7f4a3dd46680 20 get_system_obj_state: rctx=0x7ffccadaf860 obj=default.rgw.meta:root:myfoo state=0x55b772e9d240 s->prefetch_data=0 2023-10-05T21:15:17.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.514+0000 7f4a3dd46680 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-10-05T21:15:17.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.514+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:104 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730a7630 con 0x7f4a2400dbd0 2023-10-05T21:15:17.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.514+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(104 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv21 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f4a1c033040 con 0x7f4a2400dbd0 2023-10-05T21:15:17.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.514+0000 7f4a3dd46680 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x16 2023-10-05T21:15:17.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.514+0000 7f4a3dd46680 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:17.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.514+0000 7f4a3dd46680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:17.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.514+0000 7f4a3dd46680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:17.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.514+0000 7f4a3dd46680 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x11, cached=0x16) 2023-10-05T21:15:17.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.514+0000 7f4a3dd46680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.514+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730a7630 con 0x7f4a2400dbd0 2023-10-05T21:15:17.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.515+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(105 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7f4a1c033040 con 0x7f4a2400dbd0 2023-10-05T21:15:17.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.515+0000 7f4a3dd46680 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T21:15:17.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.515+0000 7f4a3dd46680 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2023-10-05T21:15:17.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.515+0000 7f4a3dd46680 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:17.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.515+0000 7f4a3dd46680 20 get_system_obj_state: rctx=0x7ffccadaf860 obj=default.rgw.meta:root:.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 state=0x55b772e9d500 s->prefetch_data=0 2023-10-05T21:15:17.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.515+0000 7f4a3dd46680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 : miss 2023-10-05T21:15:17.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.515+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:106 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730aa1e0 con 0x55b77301f030 2023-10-05T21:15:17.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.515+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(106 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f4a24043db0 con 0x55b77301f030 2023-10-05T21:15:17.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.515+0000 7f4a3dd46680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 info.flags=0x16 2023-10-05T21:15:17.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.515+0000 7f4a3dd46680 10 adding default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 to cache LRU end 2023-10-05T21:15:17.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.515+0000 7f4a3dd46680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:17.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.515+0000 7f4a3dd46680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:17.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.515+0000 7f4a3dd46680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:17.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.515+0000 7f4a3dd46680 20 Read xattr: user.rgw.acl 2023-10-05T21:15:17.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.515+0000 7f4a3dd46680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:17.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.515+0000 7f4a3dd46680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:17.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.515+0000 7f4a3dd46680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.515+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730ad370 con 0x55b77301f030 2023-10-05T21:15:17.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.515+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(107 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv2 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f4a24043db0 con 0x55b77301f030 2023-10-05T21:15:17.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.515+0000 7f4a3dd46680 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T21:15:17.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.516+0000 7f4a3dd46680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 info.flags=0x13 2023-10-05T21:15:17.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.516+0000 7f4a3dd46680 10 moving default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 to cache LRU end 2023-10-05T21:15:17.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.516+0000 7f4a3dd46680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:17.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.516+0000 7f4a3dd46680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:17.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.516+0000 7f4a3dd46680 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 2023-10-05T21:15:17.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.516+0000 7f4a3dd46680 20 get_system_obj_state: rctx=0x7ffccadaf7e8 obj=default.rgw.meta:users.uid:foo state=0x55b772e9d500 s->prefetch_data=0 2023-10-05T21:15:17.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.516+0000 7f4a3dd46680 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x16, cached=0x13) 2023-10-05T21:15:17.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.516+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:108 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730ad090 con 0x55b772fee750 2023-10-05T21:15:17.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.516+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(108 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.516+0000 7f4a3dd46680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T21:15:17.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.516+0000 7f4a3dd46680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:17.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.516+0000 7f4a3dd46680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:17.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.516+0000 7f4a3dd46680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:17.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.516+0000 7f4a3dd46680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:17.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.516+0000 7f4a3dd46680 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x17) 2023-10-05T21:15:17.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.516+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730af9b0 con 0x7f4a1c007030 2023-10-05T21:15:17.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.517+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(109 fud.buckets [call] v29'3 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.517+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:110 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730b59d0 con 0x55b77301f030 2023-10-05T21:15:17.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.518+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(110 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v29'3 uv3 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7f4a24043db0 con 0x55b77301f030 2023-10-05T21:15:17.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.518+0000 7f4a3dd46680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 info.flags=0x17 2023-10-05T21:15:17.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.518+0000 7f4a3dd46680 10 moving default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 to cache LRU end 2023-10-05T21:15:17.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.518+0000 7f4a3dd46680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:17.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.518+0000 7f4a3dd46680 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1, ofs0, ns] 2023-10-05T21:15:17.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.518+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:111 7.15 7:a93a5511:::notify.2:head [notify cookie 94246397499712 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730b2e20 con 0x55b77301f030 2023-10-05T21:15:17.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.518+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== watch-notify(notify (1) cookie 94246396921040 notify 124554051589 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x55b7730117c0 con 0x55b77301f030 2023-10-05T21:15:17.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.518+0000 7f4a2a7fc700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051589 cookie 94246396921040 notifier 4472 bl.length()=725 2023-10-05T21:15:17.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.518+0000 7f4a2a7fc700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 info.flags=0x17 2023-10-05T21:15:17.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.518+0000 7f4a2a7fc700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 to cache LRU end 2023-10-05T21:15:17.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.518+0000 7f4a2a7fc700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:17.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.518+0000 7f4a2a7fc700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:112 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f4a10003d90 con 0x55b77301f030 2023-10-05T21:15:17.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.518+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(111 notify.2 [notify cookie 94246397499712 out=8b] v0'0 uv123 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f4a24043db0 con 0x55b77301f030 2023-10-05T21:15:17.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.518+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 31 ==== osd_op_reply(112 notify.2 [notify-ack] v0'0 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a24043db0 con 0x55b77301f030 2023-10-05T21:15:17.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.518+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 32 ==== watch-notify(notify_complete (2) cookie 94246397499712 notify 124554051589 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55b7730112f0 con 0x55b77301f030 2023-10-05T21:15:17.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.518+0000 7f4a3dd46680 20 handle_bi_update(): bucket=:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1]): orig_sources= new_sources= 2023-10-05T21:15:17.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.518+0000 7f4a3dd46680 20 handle_bi_update(): bucket=:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1]): potential sources added=[] removed=[] 2023-10-05T21:15:17.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.518+0000 7f4a3dd46680 20 handle_bi_update(): bucket=:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1]): orig_dests= new_dests= 2023-10-05T21:15:17.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.518+0000 7f4a3dd46680 20 handle_bi_update(): bucket=:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1]): potential dests added=[] removed=[] 2023-10-05T21:15:17.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.518+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:113 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730b58b0 con 0x7f4a2400dbd0 2023-10-05T21:15:17.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.519+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(113 foo.buckets [call] v29'22 uv22 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f4a1c033040 con 0x7f4a2400dbd0 2023-10-05T21:15:17.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.519+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:114 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730b5210 con 0x7f4a2400dbd0 2023-10-05T21:15:17.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.520+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(114 myfoo [delete,create,call,writefull 0~165] v29'23 uv23 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4a1c033040 con 0x7f4a2400dbd0 2023-10-05T21:15:17.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.520+0000 7f4a3dd46680 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2023-10-05T21:15:17.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.520+0000 7f4a3dd46680 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:17.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.520+0000 7f4a3dd46680 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2023-10-05T21:15:17.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.520+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:115 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94246397499440 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730b46f0 con 0x7f4a1c007030 2023-10-05T21:15:17.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.520+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== watch-notify(notify (1) cookie 94246396935344 notify 124554051598 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x7f4a2c0291f0 con 0x7f4a1c007030 2023-10-05T21:15:17.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.520+0000 7f4a29ffb700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051598 cookie 94246396935344 notifier 4472 bl.length()=314 2023-10-05T21:15:17.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.521+0000 7f4a29ffb700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2023-10-05T21:15:17.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.521+0000 7f4a29ffb700 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:17.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.521+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(115 notify.6 [notify cookie 94246397499440 out=8b] v0'0 uv123 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.521+0000 7f4a29ffb700 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:116 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f4980003410 con 0x7f4a1c007030 2023-10-05T21:15:17.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.521+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(116 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.521+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 31 ==== watch-notify(notify_complete (2) cookie 94246397499440 notify 124554051598 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f4a2c02d040 con 0x7f4a1c007030 2023-10-05T21:15:17.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.521+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:117 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94246396912496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773064980 con 0x7f4a2400dbd0 2023-10-05T21:15:17.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.522+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== osd_op_reply(117 notify.0 [watch unwatch cookie 94246396912496] v29'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a1c033040 con 0x7f4a2400dbd0 2023-10-05T21:15:17.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.522+0000 7f4a3dd46680 20 remove_watcher() i=0 2023-10-05T21:15:17.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.522+0000 7f4a3dd46680 2 removed watcher, disabling cache 2023-10-05T21:15:17.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.522+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:118 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94246396917936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773026370 con 0x55b772fee750 2023-10-05T21:15:17.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.523+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(118 notify.1 [watch unwatch cookie 94246396917936] v29'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.523+0000 7f4a3dd46680 20 remove_watcher() i=1 2023-10-05T21:15:17.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.523+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:119 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94246396921040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730278b0 con 0x55b77301f030 2023-10-05T21:15:17.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.523+0000 7f4a30e1e700 1 -- 172.21.15.153:0/1808471824 <== osd.3 v2:172.21.15.153:6800/140455 33 ==== osd_op_reply(119 notify.2 [watch unwatch cookie 94246396921040] v29'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a24043db0 con 0x55b77301f030 2023-10-05T21:15:17.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.523+0000 7f4a3dd46680 20 remove_watcher() i=2 2023-10-05T21:15:17.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.523+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:120 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94246396919040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730278b0 con 0x7f4a2400dbd0 2023-10-05T21:15:17.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.524+0000 7f4a2bfff700 1 -- 172.21.15.153:0/1808471824 <== osd.2 v2:172.21.15.153:6807/140454 22 ==== osd_op_reply(120 notify.3 [watch unwatch cookie 94246396919040] v29'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a1c033040 con 0x7f4a2400dbd0 2023-10-05T21:15:17.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.524+0000 7f4a3dd46680 20 remove_watcher() i=3 2023-10-05T21:15:17.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.524+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:121 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94246396928848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b7730284d0 con 0x55b772fee750 2023-10-05T21:15:17.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.525+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(121 notify.4 [watch unwatch cookie 94246396928848] v29'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.525+0000 7f4a3dd46680 20 remove_watcher() i=4 2023-10-05T21:15:17.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.525+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:122 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94246396926848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b77302a350 con 0x7f4a1c007030 2023-10-05T21:15:17.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.525+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 32 ==== osd_op_reply(122 notify.5 [watch unwatch cookie 94246396926848] v29'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.525+0000 7f4a3dd46680 20 remove_watcher() i=5 2023-10-05T21:15:17.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.525+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:123 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94246396935344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773029b80 con 0x7f4a1c007030 2023-10-05T21:15:17.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.526+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 33 ==== osd_op_reply(123 notify.6 [watch unwatch cookie 94246396935344] v29'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.526+0000 7f4a3dd46680 20 remove_watcher() i=6 2023-10-05T21:15:17.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.526+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:124 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94246396938592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b773029b80 con 0x7f4a1c007030 2023-10-05T21:15:17.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.527+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.0 v2:172.21.15.111:6800/111394 34 ==== osd_op_reply(124 notify.7 [watch unwatch cookie 94246396938592] v29'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4a2c00a570 con 0x7f4a1c007030 2023-10-05T21:15:17.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.527+0000 7f4a3dd46680 20 remove_watcher() i=7 2023-10-05T21:15:17.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.527+0000 7f4a01fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:17.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.527+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:125 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94246396933136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b77302c960 con 0x55b772fee750 2023-10-05T21:15:17.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.528+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(125 data_loggenerations_metadata [watch unwatch cookie 94246396933136] v29'120 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4a2c00a570 con 0x55b772fee750 2023-10-05T21:15:17.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.528+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4a1c007030 msgr2=0x7f4a1c01d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.528+0000 7f4a3dd46680 1 --2- 172.21.15.153:0/1808471824 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4a1c007030 0x7f4a1c01d420 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.528+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55b772fee750 msgr2=0x55b77301cbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.528+0000 7f4a3dd46680 1 --2- 172.21.15.153:0/1808471824 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55b772fee750 0x55b77301cbc0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.528+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4a2400dbd0 msgr2=0x7f4a2402d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.528+0000 7f4a3dd46680 1 --2- 172.21.15.153:0/1808471824 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4a2400dbd0 0x7f4a2402d3f0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.528+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b77301f030 msgr2=0x55b773021410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.528+0000 7f4a3dd46680 1 --2- 172.21.15.153:0/1808471824 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b77301f030 0x55b773021410 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.528+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4a140340f0 msgr2=0x7f4a140365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.528+0000 7f4a3dd46680 1 --2- 172.21.15.153:0/1808471824 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4a140340f0 0x7f4a140365a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c005a90 tx=0x7f4a1c015000 comp rx=0 tx=0).stop 2023-10-05T21:15:17.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.528+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b772f5e040 msgr2=0x55b773010db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.528+0000 7f4a3161f700 1 -- 172.21.15.153:0/1808471824 reap_dead start 2023-10-05T21:15:17.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.528+0000 7f4a3dd46680 1 --2- 172.21.15.153:0/1808471824 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b772f5e040 0x55b773010db0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x55b77300a670 tx=0x7f4a24016000 comp rx=0 tx=0).stop 2023-10-05T21:15:17.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.528+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 shutdown_connections 2023-10-05T21:15:17.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.528+0000 7f4a3dd46680 1 --2- 172.21.15.153:0/1808471824 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b772f5e040 0x55b773010db0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.528+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 >> 172.21.15.153:0/1808471824 conn(0x55b772fe4b20 msgr2=0x55b773003c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.529+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 shutdown_connections 2023-10-05T21:15:17.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.529+0000 7f4a3dd46680 1 -- 172.21.15.153:0/1808471824 wait complete. 2023-10-05T21:15:17.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.529+0000 7f4a3dd46680 1 -- 172.21.15.153:0/2179457117 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4970034140 msgr2=0x7f49700365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.529+0000 7f4a3dd46680 1 --2- 172.21.15.153:0/2179457117 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4970034140 0x7f49700365f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55b77302d480 tx=0x7f4a2c037450 comp rx=0 tx=0).stop 2023-10-05T21:15:17.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.529+0000 7f4a3dd46680 1 -- 172.21.15.153:0/2179457117 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b773039ca0 msgr2=0x55b773040910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.529+0000 7f4a3dd46680 1 --2- 172.21.15.153:0/2179457117 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b773039ca0 0x55b773040910 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x55b773035510 tx=0x7f4a1c030000 comp rx=0 tx=0).stop 2023-10-05T21:15:17.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.529+0000 7f4a3dd46680 1 -- 172.21.15.153:0/2179457117 shutdown_connections 2023-10-05T21:15:17.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.529+0000 7f4a3dd46680 1 --2- 172.21.15.153:0/2179457117 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4970034140 0x7f49700365f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.529+0000 7f4a3dd46680 1 --2- 172.21.15.153:0/2179457117 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b773039ca0 0x55b773040910 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.529+0000 7f4a3dd46680 1 -- 172.21.15.153:0/2179457117 >> 172.21.15.153:0/2179457117 conn(0x55b773035fa0 msgr2=0x55b773034070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.529+0000 7f4a3dd46680 1 -- 172.21.15.153:0/2179457117 shutdown_connections 2023-10-05T21:15:17.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.529+0000 7f4a3dd46680 1 -- 172.21.15.153:0/2179457117 wait complete. 2023-10-05T21:15:17.562 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2023-10-05T21:15:17.563 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2023-10-05T21:15:17.563 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2023-10-05T21:15:17.606 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:17.607 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:17.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.606+0000 7fef438d4680 1 Processor -- start 2023-10-05T21:15:17.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.606+0000 7fef438d4680 1 -- start start 2023-10-05T21:15:17.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.606+0000 7fef438d4680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55899ca437e0 0x55899ca45bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.606+0000 7fef438d4680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55899c98d990 con 0x55899ca3f2b0 2023-10-05T21:15:17.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.606+0000 7fef438d4680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55899c94ddb0 con 0x55899ca437e0 2023-10-05T21:15:17.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.606+0000 7fef361ab700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55899ca437e0 0x55899ca45bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.606+0000 7fef361ab700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55899ca437e0 0x55899ca45bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37650/0 (socket says 172.21.15.153:37650) 2023-10-05T21:15:17.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.606+0000 7fef361ab700 1 -- 172.21.15.153:0/999584125 learned_addr learned my addr 172.21.15.153:0/999584125 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:17.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.606+0000 7fef369ac700 1 --1- 172.21.15.153:0/999584125 >> v1:172.21.15.111:6789/0 conn(0x55899ca3f2b0 0x55899ca3f6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:55192/0 (socket says 172.21.15.153:55192) 2023-10-05T21:15:17.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.606+0000 7fef361ab700 1 -- 172.21.15.153:0/999584125 >> v1:172.21.15.111:6789/0 conn(0x55899ca3f2b0 legacy=0x55899ca3f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.607+0000 7fef361ab700 1 -- 172.21.15.153:0/999584125 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55899ca47110 con 0x55899ca437e0 2023-10-05T21:15:17.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.607+0000 7fef361ab700 1 --2- 172.21.15.153:0/999584125 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55899ca437e0 0x55899ca45bc0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fef2000a650 tx=0x7fef20005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60996975ed5147cb server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.607+0000 7fef359aa700 1 -- 172.21.15.153:0/999584125 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef20008760 con 0x55899ca437e0 2023-10-05T21:15:17.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.607+0000 7fef359aa700 1 -- 172.21.15.153:0/999584125 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef200088c0 con 0x55899ca437e0 2023-10-05T21:15:17.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.607+0000 7fef359aa700 1 -- 172.21.15.153:0/999584125 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef20008bb0 con 0x55899ca437e0 2023-10-05T21:15:17.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.607+0000 7fef438d4680 1 -- 172.21.15.153:0/999584125 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55899ca437e0 msgr2=0x55899ca45bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.607+0000 7fef438d4680 1 --2- 172.21.15.153:0/999584125 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55899ca437e0 0x55899ca45bc0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fef2000a650 tx=0x7fef20005b10 comp rx=0 tx=0).stop 2023-10-05T21:15:17.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.607+0000 7fef438d4680 1 -- 172.21.15.153:0/999584125 shutdown_connections 2023-10-05T21:15:17.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.607+0000 7fef438d4680 1 --2- 172.21.15.153:0/999584125 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55899ca437e0 0x55899ca45bc0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.607+0000 7fef438d4680 1 -- 172.21.15.153:0/999584125 >> 172.21.15.153:0/999584125 conn(0x55899ca3ab80 msgr2=0x55899ca3cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.607+0000 7fef438d4680 1 -- 172.21.15.153:0/999584125 shutdown_connections 2023-10-05T21:15:17.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.607+0000 7fef438d4680 1 -- 172.21.15.153:0/999584125 wait complete. 2023-10-05T21:15:17.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.608+0000 7fef438d4680 1 Processor -- start 2023-10-05T21:15:17.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.608+0000 7fef438d4680 1 -- start start 2023-10-05T21:15:17.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.608+0000 7fef438d4680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55899ca3f2b0 0x55899ca5e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.608+0000 7fef438d4680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55899c8edea0 con 0x55899ca3f2b0 2023-10-05T21:15:17.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.609+0000 7fef369ac700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55899ca3f2b0 0x55899ca5e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.609+0000 7fef369ac700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55899ca3f2b0 0x55899ca5e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37658/0 (socket says 172.21.15.153:37658) 2023-10-05T21:15:17.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.609+0000 7fef369ac700 1 -- 172.21.15.153:0/591872581 learned_addr learned my addr 172.21.15.153:0/591872581 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:17.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.609+0000 7fef369ac700 1 -- 172.21.15.153:0/591872581 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef20005db0 con 0x55899ca3f2b0 2023-10-05T21:15:17.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.609+0000 7fef369ac700 1 --2- 172.21.15.153:0/591872581 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55899ca3f2b0 0x55899ca5e7b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fef28001cf0 tx=0x7fef280018a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff58ac7b2fe8e642 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.609+0000 7fef349a8700 1 -- 172.21.15.153:0/591872581 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef28014070 con 0x55899ca3f2b0 2023-10-05T21:15:17.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.609+0000 7fef349a8700 1 -- 172.21.15.153:0/591872581 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2800be10 con 0x55899ca3f2b0 2023-10-05T21:15:17.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.609+0000 7fef349a8700 1 -- 172.21.15.153:0/591872581 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef2800f590 con 0x55899ca3f2b0 2023-10-05T21:15:17.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.610+0000 7fef438d4680 1 -- 172.21.15.153:0/591872581 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55899ca3f2b0 msgr2=0x55899ca5e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.610+0000 7fef438d4680 1 --2- 172.21.15.153:0/591872581 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55899ca3f2b0 0x55899ca5e7b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fef28001cf0 tx=0x7fef280018a0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.610+0000 7fef438d4680 1 -- 172.21.15.153:0/591872581 shutdown_connections 2023-10-05T21:15:17.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.610+0000 7fef438d4680 1 --2- 172.21.15.153:0/591872581 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55899ca3f2b0 0x55899ca5e7b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.610+0000 7fef438d4680 1 -- 172.21.15.153:0/591872581 >> 172.21.15.153:0/591872581 conn(0x55899ca3ab80 msgr2=0x55899ca5a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.610+0000 7fef438d4680 1 -- 172.21.15.153:0/591872581 shutdown_connections 2023-10-05T21:15:17.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.610+0000 7fef438d4680 1 -- 172.21.15.153:0/591872581 wait complete. 2023-10-05T21:15:17.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.610+0000 7fef438d4680 1 Processor -- start 2023-10-05T21:15:17.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.610+0000 7fef438d4680 1 -- start start 2023-10-05T21:15:17.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.610+0000 7fef438d4680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55899ca3f2b0 0x55899ca65cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.610+0000 7fef438d4680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55899c8e4c80 con 0x55899ca3f2b0 2023-10-05T21:15:17.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.610+0000 7fef369ac700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55899ca3f2b0 0x55899ca65cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.611+0000 7fef369ac700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55899ca3f2b0 0x55899ca65cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37670/0 (socket says 172.21.15.153:37670) 2023-10-05T21:15:17.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.611+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 learned_addr learned my addr 172.21.15.153:0/3414621598 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:17.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.611+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55899c98d990 con 0x55899ca3f2b0 2023-10-05T21:15:17.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.611+0000 7fef369ac700 1 --2- 172.21.15.153:0/3414621598 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55899ca3f2b0 0x55899ca65cc0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fef280018e0 tx=0x7fef28016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.611+0000 7fef2effd700 1 -- 172.21.15.153:0/3414621598 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef28021070 con 0x55899ca3f2b0 2023-10-05T21:15:17.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.611+0000 7fef2effd700 1 -- 172.21.15.153:0/3414621598 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2801a880 con 0x55899ca3f2b0 2023-10-05T21:15:17.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.611+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55899ca66200 con 0x55899ca3f2b0 2023-10-05T21:15:17.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.611+0000 7fef2effd700 1 -- 172.21.15.153:0/3414621598 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef2801ab50 con 0x55899ca3f2b0 2023-10-05T21:15:17.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.611+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55899ca66650 con 0x55899ca3f2b0 2023-10-05T21:15:17.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.612+0000 7fef2effd700 1 -- 172.21.15.153:0/3414621598 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fef2800e3b0 con 0x55899ca3f2b0 2023-10-05T21:15:17.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.612+0000 7fef2effd700 1 --2- 172.21.15.153:0/3414621598 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fef18034140 0x7fef180365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.612+0000 7fef2effd700 1 -- 172.21.15.153:0/3414621598 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fef28008030 con 0x55899ca3f2b0 2023-10-05T21:15:17.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.612+0000 7fef361ab700 1 --2- 172.21.15.153:0/3414621598 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fef18034140 0x7fef180365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.612+0000 7fef438d4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.612+0000 7fef438d4680 1 --2- 172.21.15.153:0/3414621598 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55899ca437e0 0x55899ca70900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.612+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca71090 con 0x55899ca437e0 2023-10-05T21:15:17.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.613+0000 7fef361ab700 1 --2- 172.21.15.153:0/3414621598 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fef18034140 0x7fef180365f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fef20005b50 tx=0x7fef20015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.613+0000 7fef371ad700 1 --2- 172.21.15.153:0/3414621598 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55899ca437e0 0x55899ca70900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.613+0000 7fef371ad700 1 --2- 172.21.15.153:0/3414621598 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55899ca437e0 0x55899ca70900 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.613+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.613+0000 7fef438d4680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.613+0000 7fef438d4680 20 realm 2023-10-05T21:15:17.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.613+0000 7fef438d4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.613+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca6de80 con 0x55899ca437e0 2023-10-05T21:15:17.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.613+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.613+0000 7fef438d4680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.613+0000 7fef438d4680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:17.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.613+0000 7fef438d4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.613+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca71b40 con 0x55899ca437e0 2023-10-05T21:15:17.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.614+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.614+0000 7fef438d4680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.614+0000 7fef438d4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.614+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca72460 con 0x55899ca437e0 2023-10-05T21:15:17.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.614+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.614+0000 7fef438d4680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.614+0000 7fef438d4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.614+0000 7fef438d4680 1 --2- 172.21.15.153:0/3414621598 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55899ca72d20 0x55899ca75100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.614+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca75750 con 0x55899ca72d20 2023-10-05T21:15:17.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.614+0000 7fef369ac700 1 --2- 172.21.15.153:0/3414621598 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55899ca72d20 0x55899ca75100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.614+0000 7fef369ac700 1 --2- 172.21.15.153:0/3414621598 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55899ca72d20 0x55899ca75100 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.614+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fef28016070 con 0x55899ca72d20 2023-10-05T21:15:17.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.614+0000 7fef438d4680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:17.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.614+0000 7fef438d4680 20 searching for the correct realm 2023-10-05T21:15:17.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.615+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x55899ca72d20 2023-10-05T21:15:17.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.615+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef28016070 con 0x55899ca72d20 2023-10-05T21:15:17.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.615+0000 7fef369ac700 1 --2- 172.21.15.153:0/3414621598 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fef28048500 0x7fef2802e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.615+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x7fef28048500 2023-10-05T21:15:17.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.615+0000 7fef361ab700 1 --2- 172.21.15.153:0/3414621598 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fef28048500 0x7fef2802e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.615+0000 7fef361ab700 1 --2- 172.21.15.153:0/3414621598 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fef28048500 0x7fef2802e350 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.615+0000 7fef361ab700 1 -- 172.21.15.153:0/3414621598 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef20012450 con 0x7fef28048500 2023-10-05T21:15:17.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.615+0000 7fef361ab700 1 --2- 172.21.15.153:0/3414621598 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fef20007030 0x7fef2001c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.615+0000 7fef361ab700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x7fef20007030 2023-10-05T21:15:17.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.616+0000 7fef371ad700 1 --2- 172.21.15.153:0/3414621598 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fef20007030 0x7fef2001c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.616+0000 7fef371ad700 1 --2- 172.21.15.153:0/3414621598 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fef20007030 0x7fef2001c920 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.616+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.616+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x55899ca437e0 2023-10-05T21:15:17.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.616+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.616+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x55899ca437e0 2023-10-05T21:15:17.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.617+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.617+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x7fef20007030 2023-10-05T21:15:17.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.617+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.617+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x7fef20007030 2023-10-05T21:15:17.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.617+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.617+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x7fef28048500 2023-10-05T21:15:17.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.617+0000 7fef361ab700 1 -- 172.21.15.153:0/3414621598 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef20012450 con 0x7fef28048500 2023-10-05T21:15:17.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.617+0000 7fef361ab700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x55899ca72d20 2023-10-05T21:15:17.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.617+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fef28016070 con 0x55899ca72d20 2023-10-05T21:15:17.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.617+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x55899ca437e0 2023-10-05T21:15:17.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.618+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.618+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x7fef20007030 2023-10-05T21:15:17.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.618+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.618+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x55899ca437e0 2023-10-05T21:15:17.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.618+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.618+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x7fef28048500 2023-10-05T21:15:17.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.618+0000 7fef361ab700 1 -- 172.21.15.153:0/3414621598 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef20012450 con 0x7fef28048500 2023-10-05T21:15:17.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.618+0000 7fef361ab700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x55899ca72d20 2023-10-05T21:15:17.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.619+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef28016070 con 0x55899ca72d20 2023-10-05T21:15:17.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.619+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x55899ca72d20 2023-10-05T21:15:17.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.619+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef28016070 con 0x55899ca72d20 2023-10-05T21:15:17.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.619+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x7fef20007030 2023-10-05T21:15:17.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.619+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.619+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x55899ca72d20 2023-10-05T21:15:17.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.619+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef28016070 con 0x55899ca72d20 2023-10-05T21:15:17.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.619+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x55899ca72d20 2023-10-05T21:15:17.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.619+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef28016070 con 0x55899ca72d20 2023-10-05T21:15:17.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.619+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x55899ca437e0 2023-10-05T21:15:17.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.620+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.620+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x55899ca437e0 2023-10-05T21:15:17.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.620+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.620+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x7fef20007030 2023-10-05T21:15:17.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.620+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.620+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x55899ca72d20 2023-10-05T21:15:17.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.620+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef28016070 con 0x55899ca72d20 2023-10-05T21:15:17.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.620+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x7fef28048500 2023-10-05T21:15:17.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.621+0000 7fef361ab700 1 -- 172.21.15.153:0/3414621598 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef20012450 con 0x7fef28048500 2023-10-05T21:15:17.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.621+0000 7fef361ab700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x55899ca437e0 2023-10-05T21:15:17.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.621+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.621+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x7fef20007030 2023-10-05T21:15:17.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.621+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.621+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x55899ca72d20 2023-10-05T21:15:17.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.621+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef28016070 con 0x55899ca72d20 2023-10-05T21:15:17.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.621+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x7fef20007030 2023-10-05T21:15:17.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.621+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.622+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x7fef28048500 2023-10-05T21:15:17.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.622+0000 7fef361ab700 1 -- 172.21.15.153:0/3414621598 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef20012450 con 0x7fef28048500 2023-10-05T21:15:17.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.622+0000 7fef361ab700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x55899ca72d20 2023-10-05T21:15:17.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.622+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef28016070 con 0x55899ca72d20 2023-10-05T21:15:17.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.622+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x7fef20007030 2023-10-05T21:15:17.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.622+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.622+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x55899ca437e0 2023-10-05T21:15:17.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.622+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.622+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77280 con 0x7fef28048500 2023-10-05T21:15:17.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.623+0000 7fef361ab700 1 -- 172.21.15.153:0/3414621598 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef20012450 con 0x7fef28048500 2023-10-05T21:15:17.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.623+0000 7fef438d4680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:17.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.623+0000 7fef438d4680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:17.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.623+0000 7fef438d4680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:17.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.623+0000 7fef438d4680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:17.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.623+0000 7fef438d4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.623+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca761d0 con 0x55899ca437e0 2023-10-05T21:15:17.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.623+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.623+0000 7fef438d4680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.623+0000 7fef438d4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.623+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca765d0 con 0x55899ca437e0 2023-10-05T21:15:17.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.623+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.623+0000 7fef438d4680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.623+0000 7fef438d4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.623+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77710 con 0x55899ca437e0 2023-10-05T21:15:17.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.623+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.623+0000 7fef438d4680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:17.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.623+0000 7fef438d4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.623+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77ac0 con 0x55899ca72d20 2023-10-05T21:15:17.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.624+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fef28016070 con 0x55899ca72d20 2023-10-05T21:15:17.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.624+0000 7fef438d4680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.624+0000 7fef438d4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.624+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77e70 con 0x55899ca437e0 2023-10-05T21:15:17.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.624+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.624+0000 7fef438d4680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.624+0000 7fef438d4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.624+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77e70 con 0x55899ca437e0 2023-10-05T21:15:17.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.624+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.624+0000 7fef438d4680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.624+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca78e80 con 0x55899ca72d20 2023-10-05T21:15:17.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.624+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef28016070 con 0x55899ca72d20 2023-10-05T21:15:17.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.624+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca78e80 con 0x7fef28048500 2023-10-05T21:15:17.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.624+0000 7fef361ab700 1 -- 172.21.15.153:0/3414621598 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef20012450 con 0x7fef28048500 2023-10-05T21:15:17.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.624+0000 7fef361ab700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca78e80 con 0x7fef20007030 2023-10-05T21:15:17.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.625+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.625+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77710 con 0x55899ca437e0 2023-10-05T21:15:17.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.625+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.625+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77710 con 0x55899ca437e0 2023-10-05T21:15:17.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.625+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.625+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77710 con 0x7fef20007030 2023-10-05T21:15:17.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.626+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.626+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77710 con 0x7fef20007030 2023-10-05T21:15:17.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.626+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.626+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77710 con 0x7fef28048500 2023-10-05T21:15:17.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.626+0000 7fef361ab700 1 -- 172.21.15.153:0/3414621598 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef20012450 con 0x7fef28048500 2023-10-05T21:15:17.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.626+0000 7fef361ab700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77710 con 0x55899ca72d20 2023-10-05T21:15:17.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.626+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fef28016070 con 0x55899ca72d20 2023-10-05T21:15:17.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.626+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77710 con 0x55899ca437e0 2023-10-05T21:15:17.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.627+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.627+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77710 con 0x7fef20007030 2023-10-05T21:15:17.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.627+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.627+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77710 con 0x55899ca437e0 2023-10-05T21:15:17.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.627+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.627+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77710 con 0x7fef28048500 2023-10-05T21:15:17.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.627+0000 7fef361ab700 1 -- 172.21.15.153:0/3414621598 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef20012450 con 0x7fef28048500 2023-10-05T21:15:17.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.627+0000 7fef361ab700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77710 con 0x55899ca72d20 2023-10-05T21:15:17.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.628+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef28016070 con 0x55899ca72d20 2023-10-05T21:15:17.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.628+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77710 con 0x55899ca72d20 2023-10-05T21:15:17.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.628+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef28016070 con 0x55899ca72d20 2023-10-05T21:15:17.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.628+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77710 con 0x7fef20007030 2023-10-05T21:15:17.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.628+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.628+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77710 con 0x55899ca72d20 2023-10-05T21:15:17.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.628+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef28016070 con 0x55899ca72d20 2023-10-05T21:15:17.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.628+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77710 con 0x55899ca72d20 2023-10-05T21:15:17.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.628+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef28052040 con 0x55899ca72d20 2023-10-05T21:15:17.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.628+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77710 con 0x55899ca437e0 2023-10-05T21:15:17.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.629+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.629+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77710 con 0x55899ca437e0 2023-10-05T21:15:17.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.629+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.629+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77710 con 0x7fef20007030 2023-10-05T21:15:17.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.629+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.629+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77710 con 0x55899ca72d20 2023-10-05T21:15:17.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.629+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef28052040 con 0x55899ca72d20 2023-10-05T21:15:17.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.629+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77710 con 0x7fef28048500 2023-10-05T21:15:17.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.629+0000 7fef361ab700 1 -- 172.21.15.153:0/3414621598 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef20012450 con 0x7fef28048500 2023-10-05T21:15:17.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.629+0000 7fef361ab700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77710 con 0x55899ca437e0 2023-10-05T21:15:17.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.630+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.630+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77710 con 0x7fef20007030 2023-10-05T21:15:17.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.630+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.630+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77710 con 0x55899ca72d20 2023-10-05T21:15:17.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.630+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef28052040 con 0x55899ca72d20 2023-10-05T21:15:17.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.630+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77710 con 0x7fef20007030 2023-10-05T21:15:17.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.630+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.630+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77710 con 0x7fef28048500 2023-10-05T21:15:17.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.631+0000 7fef361ab700 1 -- 172.21.15.153:0/3414621598 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef20012450 con 0x7fef28048500 2023-10-05T21:15:17.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.631+0000 7fef361ab700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77710 con 0x55899ca72d20 2023-10-05T21:15:17.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.631+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef28052040 con 0x55899ca72d20 2023-10-05T21:15:17.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.631+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77710 con 0x7fef20007030 2023-10-05T21:15:17.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.631+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.631+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77710 con 0x55899ca437e0 2023-10-05T21:15:17.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.631+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.631+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77710 con 0x7fef28048500 2023-10-05T21:15:17.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.632+0000 7fef361ab700 1 -- 172.21.15.153:0/3414621598 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef20012450 con 0x7fef28048500 2023-10-05T21:15:17.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.632+0000 7fef438d4680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:17.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.632+0000 7fef438d4680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:17.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.632+0000 7fef438d4680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:17.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.632+0000 7fef438d4680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:17.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.632+0000 7fef438d4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.632+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca77e70 con 0x55899ca437e0 2023-10-05T21:15:17.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.632+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.632+0000 7fef438d4680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.632+0000 7fef438d4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.632+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca78270 con 0x55899ca72d20 2023-10-05T21:15:17.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.632+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fef28052040 con 0x55899ca72d20 2023-10-05T21:15:17.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.632+0000 7fef438d4680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:17.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.632+0000 7fef438d4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.632+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca78b60 con 0x55899ca437e0 2023-10-05T21:15:17.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.632+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.632+0000 7fef438d4680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.632+0000 7fef438d4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.632+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca78b60 con 0x55899ca437e0 2023-10-05T21:15:17.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.633+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.633+0000 7fef438d4680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:17.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.633+0000 7fef438d4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.633+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca78b60 con 0x7fef20007030 2023-10-05T21:15:17.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.633+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.633+0000 7fef438d4680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.633+0000 7fef438d4680 20 zone default found 2023-10-05T21:15:17.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.633+0000 7fef438d4680 4 Realm: () 2023-10-05T21:15:17.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.633+0000 7fef438d4680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:17.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.633+0000 7fef438d4680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:17.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.633+0000 7fef438d4680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:17.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.633+0000 7fef438d4680 20 zonegroup default 2023-10-05T21:15:17.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.633+0000 7fef438d4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.633+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca78b60 con 0x7fef20007030 2023-10-05T21:15:17.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.633+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.633+0000 7fef438d4680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.633+0000 7fef438d4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.633+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca78b60 con 0x55899ca72d20 2023-10-05T21:15:17.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.633+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fef28052040 con 0x55899ca72d20 2023-10-05T21:15:17.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.633+0000 7fef438d4680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.633+0000 7fef438d4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.633+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca7aa10 con 0x55899ca72d20 2023-10-05T21:15:17.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.634+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fef28052040 con 0x55899ca72d20 2023-10-05T21:15:17.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.634+0000 7fef438d4680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.634+0000 7fef438d4680 20 started sync module instance, tier type = 2023-10-05T21:15:17.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.634+0000 7fef438d4680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:17.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.634+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca7a0d0 con 0x7fef28048500 2023-10-05T21:15:17.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.634+0000 7fef361ab700 1 -- 172.21.15.153:0/3414621598 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef20012450 con 0x7fef28048500 2023-10-05T21:15:17.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.634+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94049527105136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca7a610 con 0x7fef28048500 2023-10-05T21:15:17.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.634+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca7b920 con 0x55899ca437e0 2023-10-05T21:15:17.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.635+0000 7fef361ab700 1 -- 172.21.15.153:0/3414621598 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94049527105136] v29'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef20012450 con 0x7fef28048500 2023-10-05T21:15:17.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.635+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.635+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94049527115200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca7bd20 con 0x55899ca437e0 2023-10-05T21:15:17.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.635+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca7c730 con 0x55899ca72d20 2023-10-05T21:15:17.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.636+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94049527115200] v29'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.636+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef28052040 con 0x55899ca72d20 2023-10-05T21:15:17.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.636+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94049527120448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca7cb30 con 0x55899ca72d20 2023-10-05T21:15:17.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.636+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca7d540 con 0x7fef28048500 2023-10-05T21:15:17.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.637+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94049527120448] v29'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef28052040 con 0x55899ca72d20 2023-10-05T21:15:17.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.637+0000 7fef361ab700 1 -- 172.21.15.153:0/3414621598 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef20012450 con 0x7fef28048500 2023-10-05T21:15:17.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.637+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94049527116784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca7dde0 con 0x7fef28048500 2023-10-05T21:15:17.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.637+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca7e680 con 0x55899ca437e0 2023-10-05T21:15:17.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.637+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.637+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94049527129024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca7ee50 con 0x55899ca437e0 2023-10-05T21:15:17.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.637+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca7fa50 con 0x7fef20007030 2023-10-05T21:15:17.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.637+0000 7fef361ab700 1 -- 172.21.15.153:0/3414621598 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94049527116784] v29'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef20012450 con 0x7fef28048500 2023-10-05T21:15:17.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.638+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94049527129024] v29'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.638+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.638+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94049527133408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca7fa10 con 0x7fef20007030 2023-10-05T21:15:17.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.638+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca7ea10 con 0x7fef20007030 2023-10-05T21:15:17.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.639+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(96 notify.6 [create] v29'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.639+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94049527135296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca806e0 con 0x7fef20007030 2023-10-05T21:15:17.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.639+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(95 notify.5 [watch watch cookie 94049527133408] v29'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.639+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca7d930 con 0x7fef20007030 2023-10-05T21:15:17.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.640+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(98 notify.7 [create] v29'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.640+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94049527126320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca81260 con 0x7fef20007030 2023-10-05T21:15:17.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.640+0000 7fef438d4680 20 add_watcher() i=0 2023-10-05T21:15:17.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.640+0000 7fef438d4680 20 add_watcher() i=1 2023-10-05T21:15:17.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.640+0000 7fef438d4680 20 add_watcher() i=2 2023-10-05T21:15:17.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.640+0000 7fef438d4680 20 add_watcher() i=3 2023-10-05T21:15:17.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.640+0000 7fef438d4680 20 add_watcher() i=4 2023-10-05T21:15:17.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.640+0000 7fef438d4680 20 add_watcher() i=5 2023-10-05T21:15:17.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.640+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(97 notify.6 [watch watch cookie 94049527135296] v29'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.640+0000 7fef438d4680 20 add_watcher() i=6 2023-10-05T21:15:17.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.640+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94049527126320] v29'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.640+0000 7fef438d4680 20 add_watcher() i=7 2023-10-05T21:15:17.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.640+0000 7fef438d4680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:17.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.640+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca81260 con 0x55899ca437e0 2023-10-05T21:15:17.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.641+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.641+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94049527139696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca811c0 con 0x55899ca437e0 2023-10-05T21:15:17.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.641+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94049527139696] v29'121 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.642+0000 7fee83fff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:17.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.642+0000 7fef438d4680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:17.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.642+0000 7fef438d4680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:17.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.642+0000 7fef438d4680 1 Processor -- start 2023-10-05T21:15:17.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.642+0000 7fef438d4680 1 -- start start 2023-10-05T21:15:17.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.642+0000 7fef438d4680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55899ca8dd20 0x55899ca8e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.642+0000 7fef438d4680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55899ca8e740 con 0x55899ca8dd20 2023-10-05T21:15:17.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.642+0000 7fef361ab700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55899ca8dd20 0x55899ca8e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.642+0000 7fef361ab700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55899ca8dd20 0x55899ca8e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37684/0 (socket says 172.21.15.153:37684) 2023-10-05T21:15:17.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.642+0000 7fef361ab700 1 -- 172.21.15.153:0/327351060 learned_addr learned my addr 172.21.15.153:0/327351060 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:17.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.643+0000 7fef361ab700 1 -- 172.21.15.153:0/327351060 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55899ca8ec20 con 0x55899ca8dd20 2023-10-05T21:15:17.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.643+0000 7fef361ab700 1 --2- 172.21.15.153:0/327351060 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55899ca8dd20 0x55899ca8e130 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x55899ca3ff80 tx=0x7fef20011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f500ef224f4a88 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.643+0000 7fee837fe700 1 -- 172.21.15.153:0/327351060 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef20008de0 con 0x55899ca8dd20 2023-10-05T21:15:17.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.643+0000 7fee837fe700 1 -- 172.21.15.153:0/327351060 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef20030040 con 0x55899ca8dd20 2023-10-05T21:15:17.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.643+0000 7fee837fe700 1 -- 172.21.15.153:0/327351060 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef2002a5a0 con 0x55899ca8dd20 2023-10-05T21:15:17.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.644+0000 7fef438d4680 1 -- 172.21.15.153:0/327351060 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55899ca8dd20 msgr2=0x55899ca8e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.644+0000 7fef438d4680 1 --2- 172.21.15.153:0/327351060 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55899ca8dd20 0x55899ca8e130 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x55899ca3ff80 tx=0x7fef20011000 comp rx=0 tx=0).stop 2023-10-05T21:15:17.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.644+0000 7fef438d4680 1 -- 172.21.15.153:0/327351060 shutdown_connections 2023-10-05T21:15:17.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.644+0000 7fef438d4680 1 --2- 172.21.15.153:0/327351060 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55899ca8dd20 0x55899ca8e130 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.644+0000 7fef438d4680 1 -- 172.21.15.153:0/327351060 >> 172.21.15.153:0/327351060 conn(0x55899ca8a020 msgr2=0x55899ca88120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.644+0000 7fef438d4680 1 -- 172.21.15.153:0/327351060 shutdown_connections 2023-10-05T21:15:17.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.644+0000 7fef438d4680 1 -- 172.21.15.153:0/327351060 wait complete. 2023-10-05T21:15:17.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.644+0000 7fef438d4680 1 Processor -- start 2023-10-05T21:15:17.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.644+0000 7fef438d4680 1 -- start start 2023-10-05T21:15:17.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.644+0000 7fef438d4680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55899ca8dd20 0x55899ca94a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.644+0000 7fef438d4680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55899ca94f90 con 0x55899ca8dd20 2023-10-05T21:15:17.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.645+0000 7fef361ab700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55899ca8dd20 0x55899ca94a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.645+0000 7fef361ab700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55899ca8dd20 0x55899ca94a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37690/0 (socket says 172.21.15.153:37690) 2023-10-05T21:15:17.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.645+0000 7fef361ab700 1 -- 172.21.15.153:0/3545441842 learned_addr learned my addr 172.21.15.153:0/3545441842 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:17.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.645+0000 7fef361ab700 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55899ca47110 con 0x55899ca8dd20 2023-10-05T21:15:17.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.645+0000 7fef361ab700 1 --2- 172.21.15.153:0/3545441842 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55899ca8dd20 0x55899ca94a50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x55899ca89590 tx=0x7fef2002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.645+0000 7fee81ffb700 1 -- 172.21.15.153:0/3545441842 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef200096c0 con 0x55899ca8dd20 2023-10-05T21:15:17.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.645+0000 7fee81ffb700 1 -- 172.21.15.153:0/3545441842 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef20009840 con 0x55899ca8dd20 2023-10-05T21:15:17.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.645+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55899ca95190 con 0x55899ca8dd20 2023-10-05T21:15:17.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.645+0000 7fee81ffb700 1 -- 172.21.15.153:0/3545441842 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef20009b30 con 0x55899ca8dd20 2023-10-05T21:15:17.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.645+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55899ca95640 con 0x55899ca8dd20 2023-10-05T21:15:17.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.646+0000 7fee81ffb700 1 -- 172.21.15.153:0/3545441842 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fef20009c90 con 0x55899ca8dd20 2023-10-05T21:15:17.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.646+0000 7fee81ffb700 1 --2- 172.21.15.153:0/3545441842 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fee74034190 0x7fee74036640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.646+0000 7fee81ffb700 1 -- 172.21.15.153:0/3545441842 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fef20049ad0 con 0x55899ca8dd20 2023-10-05T21:15:17.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.646+0000 7fef371ad700 1 --2- 172.21.15.153:0/3545441842 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fee74034190 0x7fee74036640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.646+0000 7fef438d4680 1 --2- 172.21.15.153:0/3545441842 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55899ca9f800 0x55899caa1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.646+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899caa2360 con 0x55899ca9f800 2023-10-05T21:15:17.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.647+0000 7fef369ac700 1 --2- 172.21.15.153:0/3545441842 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55899ca9f800 0x55899caa1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.647+0000 7fef371ad700 1 --2- 172.21.15.153:0/3545441842 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fee74034190 0x7fee74036640 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x55899ca804c0 tx=0x7fef30037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.647+0000 7fef369ac700 1 --2- 172.21.15.153:0/3545441842 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55899ca9f800 0x55899caa1cb0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.648+0000 7fef369ac700 1 -- 172.21.15.153:0/3545441842 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v29'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fef28052040 con 0x55899ca9f800 2023-10-05T21:15:17.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.648+0000 7fef438d4680 1 --2- 172.21.15.153:0/3545441842 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55899caa30e0 0x55899caa54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.648+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899caa5bc0 con 0x55899caa30e0 2023-10-05T21:15:17.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.648+0000 7fef361ab700 1 --2- 172.21.15.153:0/3545441842 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55899caa30e0 0x55899caa54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.648+0000 7fef361ab700 1 --2- 172.21.15.153:0/3545441842 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55899caa30e0 0x55899caa54c0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.649+0000 7fef361ab700 1 -- 172.21.15.153:0/3545441842 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v29'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fef20045070 con 0x55899caa30e0 2023-10-05T21:15:17.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.649+0000 7fef438d4680 1 --2- 172.21.15.153:0/3545441842 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55899caa6d10 0x55899caa91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.649+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899caa9910 con 0x55899caa6d10 2023-10-05T21:15:17.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.649+0000 7fef371ad700 1 --2- 172.21.15.153:0/3545441842 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55899caa6d10 0x55899caa91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.650+0000 7fef371ad700 1 --2- 172.21.15.153:0/3545441842 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55899caa6d10 0x55899caa91c0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.650+0000 7fef371ad700 1 -- 172.21.15.153:0/3545441842 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v29'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x55899caa6d10 2023-10-05T21:15:17.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.650+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899caaa040 con 0x55899ca9f800 2023-10-05T21:15:17.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.651+0000 7fef369ac700 1 -- 172.21.15.153:0/3545441842 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v29'122 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fef28052040 con 0x55899ca9f800 2023-10-05T21:15:17.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.651+0000 7fef438d4680 1 --2- 172.21.15.153:0/3545441842 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55899caaadc0 0x55899caad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.651+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899caad8a0 con 0x55899caaadc0 2023-10-05T21:15:17.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.651+0000 7fef369ac700 1 --2- 172.21.15.153:0/3545441842 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55899caaadc0 0x55899caad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.651+0000 7fef369ac700 1 --2- 172.21.15.153:0/3545441842 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55899caaadc0 0x55899caad1a0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.652+0000 7fef369ac700 1 -- 172.21.15.153:0/3545441842 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v29'38 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fef28052040 con 0x55899caaadc0 2023-10-05T21:15:17.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.652+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899caadfd0 con 0x55899caa6d10 2023-10-05T21:15:17.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.653+0000 7fef371ad700 1 -- 172.21.15.153:0/3545441842 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v29'23 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x55899caa6d10 2023-10-05T21:15:17.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.653+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899caae630 con 0x55899ca9f800 2023-10-05T21:15:17.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.654+0000 7fef369ac700 1 -- 172.21.15.153:0/3545441842 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v29'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fef28052040 con 0x55899ca9f800 2023-10-05T21:15:17.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.654+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899caae630 con 0x55899caa30e0 2023-10-05T21:15:17.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.655+0000 7fef361ab700 1 -- 172.21.15.153:0/3545441842 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v29'26 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fef20045070 con 0x55899caa30e0 2023-10-05T21:15:17.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.655+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899caaec50 con 0x55899caaadc0 2023-10-05T21:15:17.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.656+0000 7fef369ac700 1 -- 172.21.15.153:0/3545441842 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v29'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fef28052040 con 0x55899caaadc0 2023-10-05T21:15:17.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.656+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899caaec50 con 0x55899caa6d10 2023-10-05T21:15:17.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.656+0000 7fef371ad700 1 -- 172.21.15.153:0/3545441842 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v29'21 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x55899caa6d10 2023-10-05T21:15:17.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.656+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899caaf300 con 0x55899caaadc0 2023-10-05T21:15:17.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.657+0000 7fef369ac700 1 -- 172.21.15.153:0/3545441842 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v29'39 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef28052040 con 0x55899caaadc0 2023-10-05T21:15:17.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.657+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899caaf300 con 0x55899caa30e0 2023-10-05T21:15:17.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.658+0000 7fef361ab700 1 -- 172.21.15.153:0/3545441842 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v29'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef20045070 con 0x55899caa30e0 2023-10-05T21:15:17.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.658+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899caaf920 con 0x55899caaadc0 2023-10-05T21:15:17.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.659+0000 7fef369ac700 1 -- 172.21.15.153:0/3545441842 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v29'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef28052040 con 0x55899caaadc0 2023-10-05T21:15:17.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.659+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899caaf920 con 0x55899caa30e0 2023-10-05T21:15:17.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.659+0000 7fef361ab700 1 -- 172.21.15.153:0/3545441842 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v29'29 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef20045070 con 0x55899caa30e0 2023-10-05T21:15:17.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.659+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899caafaa0 con 0x55899ca9f800 2023-10-05T21:15:17.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.660+0000 7fef369ac700 1 -- 172.21.15.153:0/3545441842 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v29'123 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef28052040 con 0x55899ca9f800 2023-10-05T21:15:17.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.660+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899caafa80 con 0x55899caa6d10 2023-10-05T21:15:17.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.661+0000 7fef371ad700 1 -- 172.21.15.153:0/3545441842 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v29'29 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x55899caa6d10 2023-10-05T21:15:17.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.661+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899caafa80 con 0x55899caaadc0 2023-10-05T21:15:17.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.662+0000 7fef369ac700 1 -- 172.21.15.153:0/3545441842 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v29'40 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef28052040 con 0x55899caaadc0 2023-10-05T21:15:17.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.662+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899caafa60 con 0x55899caa6d10 2023-10-05T21:15:17.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.662+0000 7fef371ad700 1 -- 172.21.15.153:0/3545441842 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v29'15 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x55899caa6d10 2023-10-05T21:15:17.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.662+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899caafb90 con 0x55899ca9f800 2023-10-05T21:15:17.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.663+0000 7fef369ac700 1 -- 172.21.15.153:0/3545441842 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v29'25 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef28052040 con 0x55899ca9f800 2023-10-05T21:15:17.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.663+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899caafb90 con 0x55899ca9f800 2023-10-05T21:15:17.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.664+0000 7fef369ac700 1 -- 172.21.15.153:0/3545441842 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v29'124 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef28052040 con 0x55899ca9f800 2023-10-05T21:15:17.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.664+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899cab0160 con 0x55899caa6d10 2023-10-05T21:15:17.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.664+0000 7fef371ad700 1 -- 172.21.15.153:0/3545441842 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v29'30 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x55899caa6d10 2023-10-05T21:15:17.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.664+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899cab0160 con 0x55899caaadc0 2023-10-05T21:15:17.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.665+0000 7fef369ac700 1 -- 172.21.15.153:0/3545441842 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v29'30 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef28052040 con 0x55899caaadc0 2023-10-05T21:15:17.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.665+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899cab0160 con 0x55899caa6d10 2023-10-05T21:15:17.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.666+0000 7fef371ad700 1 -- 172.21.15.153:0/3545441842 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v29'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x55899caa6d10 2023-10-05T21:15:17.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.666+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899cab0160 con 0x55899caa6d10 2023-10-05T21:15:17.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.666+0000 7fef371ad700 1 -- 172.21.15.153:0/3545441842 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v29'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x55899caa6d10 2023-10-05T21:15:17.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.666+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899cab0160 con 0x55899caa6d10 2023-10-05T21:15:17.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.667+0000 7fef371ad700 1 -- 172.21.15.153:0/3545441842 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v29'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x55899caa6d10 2023-10-05T21:15:17.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.667+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899cab0160 con 0x55899caa6d10 2023-10-05T21:15:17.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.668+0000 7fef371ad700 1 -- 172.21.15.153:0/3545441842 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v29'24 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x55899caa6d10 2023-10-05T21:15:17.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.668+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899cab0160 con 0x55899caa30e0 2023-10-05T21:15:17.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.668+0000 7fef361ab700 1 -- 172.21.15.153:0/3545441842 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v29'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef20045070 con 0x55899caa30e0 2023-10-05T21:15:17.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.669+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899cab0160 con 0x55899caa6d10 2023-10-05T21:15:17.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.669+0000 7fef371ad700 1 -- 172.21.15.153:0/3545441842 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v29'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x55899caa6d10 2023-10-05T21:15:17.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.669+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899cab0160 con 0x55899caa30e0 2023-10-05T21:15:17.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.670+0000 7fef361ab700 1 -- 172.21.15.153:0/3545441842 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v29'27 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef20045070 con 0x55899caa30e0 2023-10-05T21:15:17.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.670+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899cab0160 con 0x55899caa6d10 2023-10-05T21:15:17.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.671+0000 7fef371ad700 1 -- 172.21.15.153:0/3545441842 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v29'31 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x55899caa6d10 2023-10-05T21:15:17.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.671+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899cab0160 con 0x55899caa30e0 2023-10-05T21:15:17.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.671+0000 7fef361ab700 1 -- 172.21.15.153:0/3545441842 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v29'30 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef20045070 con 0x55899caa30e0 2023-10-05T21:15:17.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.671+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899cab0160 con 0x55899caaadc0 2023-10-05T21:15:17.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.672+0000 7fef369ac700 1 -- 172.21.15.153:0/3545441842 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v29'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef28052040 con 0x55899caaadc0 2023-10-05T21:15:17.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.673+0000 7fee7affd700 20 reqs_thread_entry: start 2023-10-05T21:15:17.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.674+0000 7fee78ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:17.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.674+0000 7fef438d4680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:17.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.674+0000 7fef438d4680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:17.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.674+0000 7fee66ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:48 2023 2023-10-05T21:15:17.699 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:17.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.674+0000 7fee667fc700 20 reqs_thread_entry: start 2023-10-05T21:15:17.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.674+0000 7fef438d4680 20 get_system_obj_state: rctx=0x7ffd9ecfe678 obj=default.rgw.meta:users.uid:fud state=0x55899c8f3240 s->prefetch_data=0 2023-10-05T21:15:17.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.674+0000 7fef438d4680 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2023-10-05T21:15:17.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.674+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899cb0b2c0 con 0x7fef20007030 2023-10-05T21:15:17.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.674+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(102 fud [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.674+0000 7fef438d4680 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x16 2023-10-05T21:15:17.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.674+0000 7fef438d4680 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T21:15:17.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.674+0000 7fef438d4680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:17.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.674+0000 7fef438d4680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:17.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.674+0000 7fef438d4680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:17.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.674+0000 7fef438d4680 10 cache get: name=default.rgw.meta+users.uid+fud : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:17.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.674+0000 7fef438d4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.675+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:103 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899cb0d550 con 0x7fef20007030 2023-10-05T21:15:17.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.675+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(103 fud [call,call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 273+0+469 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.675+0000 7fef438d4680 20 rados_obj.operate() r=0 bl.length=346 2023-10-05T21:15:17.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.675+0000 7fef438d4680 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2023-10-05T21:15:17.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.675+0000 7fef438d4680 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T21:15:17.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.675+0000 7fef438d4680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:17.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.675+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:104 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899cb0d550 con 0x7fef20007030 2023-10-05T21:15:17.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.675+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(104 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) v8 ==== 155+0+15 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.676+0000 7fef438d4680 10 removing key index: p5YnriCv1nAtykxBrupQ 2023-10-05T21:15:17.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.676+0000 7fef438d4680 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2023-10-05T21:15:17.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.676+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:105 7.15 7:a93a5511:::notify.2:head [notify cookie 94049527709152 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899cb0c7a0 con 0x55899ca72d20 2023-10-05T21:15:17.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.676+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== watch-notify(notify (1) cookie 94049527120448 notify 124554051590 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x55899ca66650 con 0x55899ca72d20 2023-10-05T21:15:17.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.676+0000 7fef349a8700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051590 cookie 94049527120448 notifier 4478 bl.length()=170 2023-10-05T21:15:17.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.676+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(105 notify.2 [notify cookie 94049527709152 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fef28052040 con 0x55899ca72d20 2023-10-05T21:15:17.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.676+0000 7fef349a8700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fef1c003c50 con 0x55899ca72d20 2023-10-05T21:15:17.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.676+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(106 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef28052040 con 0x55899ca72d20 2023-10-05T21:15:17.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.676+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== watch-notify(notify_complete (2) cookie 94049527709152 notify 124554051590 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55899ca66200 con 0x55899ca72d20 2023-10-05T21:15:17.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.676+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:107 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899cb0b2c0 con 0x7fef20007030 2023-10-05T21:15:17.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.677+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(107 p5YnriCv1nAtykxBrupQ [delete] v29'4 uv4 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.677+0000 7fef438d4680 10 removing email index: 2023-10-05T21:15:17.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.677+0000 7fef438d4680 10 removing user buckets index 2023-10-05T21:15:17.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.677+0000 7fef438d4680 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2023-10-05T21:15:17.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.677+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94049527709152 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899cb0c720 con 0x7fef20007030 2023-10-05T21:15:17.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.677+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 31 ==== watch-notify(notify (1) cookie 94049527135296 notify 124554051599 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x7fef3002d040 con 0x7fef20007030 2023-10-05T21:15:17.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.677+0000 7fef2ffff700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051599 cookie 94049527135296 notifier 4478 bl.length()=160 2023-10-05T21:15:17.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.677+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 32 ==== osd_op_reply(108 notify.6 [notify cookie 94049527709152 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.677+0000 7fef2ffff700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fee880032d0 con 0x7fef20007030 2023-10-05T21:15:17.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.678+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 33 ==== osd_op_reply(109 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.678+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 34 ==== watch-notify(notify_complete (2) cookie 94049527709152 notify 124554051599 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fef30060440 con 0x7fef20007030 2023-10-05T21:15:17.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.678+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899cb0b2c0 con 0x7fef20007030 2023-10-05T21:15:17.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.678+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 35 ==== osd_op_reply(110 fud.buckets [delete] v29'4 uv4 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.678+0000 7fef438d4680 10 removing user index: fud 2023-10-05T21:15:17.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.678+0000 7fef438d4680 10 removing default.rgw.meta+users.uid+fud from cache 2023-10-05T21:15:17.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.678+0000 7fef438d4680 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2023-10-05T21:15:17.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.678+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [notify cookie 94049527705040 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899cb0c720 con 0x7fef20007030 2023-10-05T21:15:17.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.679+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 36 ==== watch-notify(notify (1) cookie 94049527133408 notify 124554051600 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x7fef30060440 con 0x7fef20007030 2023-10-05T21:15:17.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.679+0000 7fef349a8700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051600 cookie 94049527133408 notifier 4478 bl.length()=152 2023-10-05T21:15:17.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.679+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 37 ==== osd_op_reply(111 notify.5 [notify cookie 94049527705040 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.679+0000 7fef349a8700 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fef1c003c50 con 0x7fef20007030 2023-10-05T21:15:17.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.679+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 38 ==== osd_op_reply(112 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.679+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 39 ==== watch-notify(notify_complete (2) cookie 94049527705040 notify 124554051600 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fef30060670 con 0x7fef20007030 2023-10-05T21:15:17.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.679+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:113 8.e 8:75f48285:users.uid::fud:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899cb0c2d0 con 0x7fef20007030 2023-10-05T21:15:17.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.680+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 40 ==== osd_op_reply(113 fud [call,delete] v29'2 uv2 ondisk = 0) v8 ==== 189+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.680+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:114 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94049527105136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899cac9df0 con 0x7fef28048500 2023-10-05T21:15:17.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.681+0000 7fef361ab700 1 -- 172.21.15.153:0/3414621598 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(114 notify.0 [watch unwatch cookie 94049527105136] v29'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef20045070 con 0x7fef28048500 2023-10-05T21:15:17.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.681+0000 7fef438d4680 20 remove_watcher() i=0 2023-10-05T21:15:17.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.681+0000 7fef438d4680 2 removed watcher, disabling cache 2023-10-05T21:15:17.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.681+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:115 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94049527115200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca78670 con 0x55899ca437e0 2023-10-05T21:15:17.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.681+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(115 notify.1 [watch unwatch cookie 94049527115200] v29'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.681+0000 7fef438d4680 20 remove_watcher() i=1 2023-10-05T21:15:17.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.681+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:116 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94049527120448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca78670 con 0x55899ca72d20 2023-10-05T21:15:17.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.682+0000 7fef369ac700 1 -- 172.21.15.153:0/3414621598 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(116 notify.2 [watch unwatch cookie 94049527120448] v29'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef28052040 con 0x55899ca72d20 2023-10-05T21:15:17.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.682+0000 7fef438d4680 20 remove_watcher() i=2 2023-10-05T21:15:17.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.682+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:117 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94049527116784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca7c240 con 0x7fef28048500 2023-10-05T21:15:17.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.683+0000 7fef361ab700 1 -- 172.21.15.153:0/3414621598 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(117 notify.3 [watch unwatch cookie 94049527116784] v29'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef20045070 con 0x7fef28048500 2023-10-05T21:15:17.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.683+0000 7fef438d4680 20 remove_watcher() i=3 2023-10-05T21:15:17.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.683+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:118 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94049527129024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca78670 con 0x55899ca437e0 2023-10-05T21:15:17.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.683+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(118 notify.4 [watch unwatch cookie 94049527129024] v29'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.684+0000 7fef438d4680 20 remove_watcher() i=4 2023-10-05T21:15:17.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.684+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:119 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94049527133408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca7b3f0 con 0x7fef20007030 2023-10-05T21:15:17.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.684+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 41 ==== osd_op_reply(119 notify.5 [watch unwatch cookie 94049527133408] v29'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.684+0000 7fef438d4680 20 remove_watcher() i=5 2023-10-05T21:15:17.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.684+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:120 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94049527135296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca78670 con 0x7fef20007030 2023-10-05T21:15:17.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.685+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 42 ==== osd_op_reply(120 notify.6 [watch unwatch cookie 94049527135296] v29'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.685+0000 7fef438d4680 20 remove_watcher() i=6 2023-10-05T21:15:17.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.685+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:121 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94049527126320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca7f4e0 con 0x7fef20007030 2023-10-05T21:15:17.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.686+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.0 v2:172.21.15.111:6800/111394 43 ==== osd_op_reply(121 notify.7 [watch unwatch cookie 94049527126320] v29'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x7fef20007030 2023-10-05T21:15:17.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.686+0000 7fef438d4680 20 remove_watcher() i=7 2023-10-05T21:15:17.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.686+0000 7fee83fff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:17.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.686+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:122 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94049527139696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55899ca7fc40 con 0x55899ca437e0 2023-10-05T21:15:17.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.687+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(122 data_loggenerations_metadata [watch unwatch cookie 94049527139696] v29'125 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fef3000a570 con 0x55899ca437e0 2023-10-05T21:15:17.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.687+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fef20007030 msgr2=0x7fef2001c920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.687+0000 7fef438d4680 1 --2- 172.21.15.153:0/3414621598 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fef20007030 0x7fef2001c920 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.687+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55899ca437e0 msgr2=0x55899ca70900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.687+0000 7fef438d4680 1 --2- 172.21.15.153:0/3414621598 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55899ca437e0 0x55899ca70900 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.687+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fef28048500 msgr2=0x7fef2802e350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.687+0000 7fef438d4680 1 --2- 172.21.15.153:0/3414621598 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fef28048500 0x7fef2802e350 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.687+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55899ca72d20 msgr2=0x55899ca75100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.687+0000 7fef438d4680 1 --2- 172.21.15.153:0/3414621598 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55899ca72d20 0x55899ca75100 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.687+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fef18034140 msgr2=0x7fef180365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.687+0000 7fef438d4680 1 --2- 172.21.15.153:0/3414621598 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fef18034140 0x7fef180365f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fef20005b50 tx=0x7fef20015000 comp rx=0 tx=0).stop 2023-10-05T21:15:17.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.687+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55899ca3f2b0 msgr2=0x55899ca65cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.687+0000 7fef371ad700 1 -- 172.21.15.153:0/3414621598 reap_dead start 2023-10-05T21:15:17.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.687+0000 7fef438d4680 1 --2- 172.21.15.153:0/3414621598 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55899ca3f2b0 0x55899ca65cc0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fef280018e0 tx=0x7fef28016000 comp rx=0 tx=0).stop 2023-10-05T21:15:17.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.687+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 shutdown_connections 2023-10-05T21:15:17.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.687+0000 7fef438d4680 1 --2- 172.21.15.153:0/3414621598 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55899ca3f2b0 0x55899ca65cc0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.688+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 >> 172.21.15.153:0/3414621598 conn(0x55899ca3ab80 msgr2=0x55899ca58b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.688+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 shutdown_connections 2023-10-05T21:15:17.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.688+0000 7fef438d4680 1 -- 172.21.15.153:0/3414621598 wait complete. 2023-10-05T21:15:17.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.688+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55899caa30e0 msgr2=0x55899caa54c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.688+0000 7fef438d4680 1 --2- 172.21.15.153:0/3545441842 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55899caa30e0 0x55899caa54c0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.688+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55899ca9f800 msgr2=0x55899caa1cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.688+0000 7fef438d4680 1 --2- 172.21.15.153:0/3545441842 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55899ca9f800 0x55899caa1cb0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.688+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55899caaadc0 msgr2=0x55899caad1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.688+0000 7fef438d4680 1 --2- 172.21.15.153:0/3545441842 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55899caaadc0 0x55899caad1a0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.688+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55899caa6d10 msgr2=0x55899caa91c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.688+0000 7fef438d4680 1 --2- 172.21.15.153:0/3545441842 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55899caa6d10 0x55899caa91c0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.688+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fee74034190 msgr2=0x7fee74036640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.688+0000 7fef438d4680 1 --2- 172.21.15.153:0/3545441842 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fee74034190 0x7fee74036640 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x55899ca804c0 tx=0x7fef30037450 comp rx=0 tx=0).stop 2023-10-05T21:15:17.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.688+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55899ca8dd20 msgr2=0x55899ca94a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.688+0000 7fef438d4680 1 --2- 172.21.15.153:0/3545441842 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55899ca8dd20 0x55899ca94a50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x55899ca89590 tx=0x7fef2002c000 comp rx=0 tx=0).stop 2023-10-05T21:15:17.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.688+0000 7fef369ac700 1 -- 172.21.15.153:0/3545441842 reap_dead start 2023-10-05T21:15:17.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.688+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 shutdown_connections 2023-10-05T21:15:17.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.688+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 >> 172.21.15.153:0/3545441842 conn(0x55899ca8a020 msgr2=0x55899ca880f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.688+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 shutdown_connections 2023-10-05T21:15:17.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.688+0000 7fef438d4680 1 -- 172.21.15.153:0/3545441842 wait complete. 2023-10-05T21:15:17.711 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2023-10-05T21:15:17.711 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2023-10-05T21:15:17.711 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2023-10-05T21:15:17.793 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:17.793 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:17.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.792+0000 7f7e02a11680 1 Processor -- start 2023-10-05T21:15:17.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.792+0000 7f7e02a11680 1 -- start start 2023-10-05T21:15:17.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.792+0000 7f7e02a11680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55ca136ae040 0x55ca1373d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.792+0000 7f7e02a11680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ca13687930 con 0x55ca1373d570 2023-10-05T21:15:17.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.792+0000 7f7e02a11680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ca13647db0 con 0x55ca136ae040 2023-10-05T21:15:17.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.793+0000 7f7df5ae9700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55ca136ae040 0x55ca1373d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.793+0000 7f7df52e8700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55ca1373d570 0x55ca1373f950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:55206/0 (socket says 172.21.15.153:55206) 2023-10-05T21:15:17.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.793+0000 7f7df52e8700 1 -- 172.21.15.153:0/2959207052 learned_addr learned my addr 172.21.15.153:0/2959207052 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:17.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.793+0000 7f7df5ae9700 1 -- 172.21.15.153:0/2959207052 >> v1:172.21.15.111:6789/0 conn(0x55ca1373d570 legacy=0x55ca1373f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.793+0000 7f7df5ae9700 1 -- 172.21.15.153:0/2959207052 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca13742180 con 0x55ca136ae040 2023-10-05T21:15:17.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.793+0000 7f7df4ae7700 1 -- 172.21.15.153:0/2959207052 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3020712800 0 0) 0x55ca13687930 con 0x55ca1373d570 2023-10-05T21:15:17.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.793+0000 7f7df5ae9700 1 --2- 172.21.15.153:0/2959207052 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca136ae040 0x55ca1373d030 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7dec00a5d0 tx=0x7f7dec005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d557c2cf942b4d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.793+0000 7f7df4ae7700 1 -- 172.21.15.153:0/2959207052 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7dec0086a0 con 0x55ca136ae040 2023-10-05T21:15:17.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.793+0000 7f7df4ae7700 1 -- 172.21.15.153:0/2959207052 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dec008800 con 0x55ca136ae040 2023-10-05T21:15:17.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.793+0000 7f7df4ae7700 1 -- 172.21.15.153:0/2959207052 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7dec008ad0 con 0x55ca136ae040 2023-10-05T21:15:17.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.794+0000 7f7e02a11680 1 -- 172.21.15.153:0/2959207052 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca136ae040 msgr2=0x55ca1373d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.794+0000 7f7e02a11680 1 --2- 172.21.15.153:0/2959207052 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca136ae040 0x55ca1373d030 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7dec00a5d0 tx=0x7f7dec005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:17.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.794+0000 7f7e02a11680 1 -- 172.21.15.153:0/2959207052 shutdown_connections 2023-10-05T21:15:17.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.794+0000 7f7e02a11680 1 --2- 172.21.15.153:0/2959207052 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca136ae040 0x55ca1373d030 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.794+0000 7f7e02a11680 1 -- 172.21.15.153:0/2959207052 >> 172.21.15.153:0/2959207052 conn(0x55ca13734b20 msgr2=0x55ca13736f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.794+0000 7f7e02a11680 1 -- 172.21.15.153:0/2959207052 shutdown_connections 2023-10-05T21:15:17.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.794+0000 7f7e02a11680 1 -- 172.21.15.153:0/2959207052 wait complete. 2023-10-05T21:15:17.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.795+0000 7f7e02a11680 1 Processor -- start 2023-10-05T21:15:17.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.795+0000 7f7e02a11680 1 -- start start 2023-10-05T21:15:17.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.795+0000 7f7e02a11680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca136ae040 0x55ca137597b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.795+0000 7f7e02a11680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca135e7ea0 con 0x55ca136ae040 2023-10-05T21:15:17.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.795+0000 7f7df5ae9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca136ae040 0x55ca137597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.795+0000 7f7df5ae9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca136ae040 0x55ca137597b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37706/0 (socket says 172.21.15.153:37706) 2023-10-05T21:15:17.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.795+0000 7f7df5ae9700 1 -- 172.21.15.153:0/4178687845 learned_addr learned my addr 172.21.15.153:0/4178687845 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:17.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.795+0000 7f7df5ae9700 1 -- 172.21.15.153:0/4178687845 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dec005cf0 con 0x55ca136ae040 2023-10-05T21:15:17.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.795+0000 7f7df5ae9700 1 --2- 172.21.15.153:0/4178687845 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca136ae040 0x55ca137597b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7dec000c00 tx=0x7f7dec015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0bb2b74bd5ae5d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.795+0000 7f7de77fe700 1 -- 172.21.15.153:0/4178687845 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7dec0086a0 con 0x55ca136ae040 2023-10-05T21:15:17.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.795+0000 7f7de77fe700 1 -- 172.21.15.153:0/4178687845 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dec008970 con 0x55ca136ae040 2023-10-05T21:15:17.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.795+0000 7f7de77fe700 1 -- 172.21.15.153:0/4178687845 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7dec008b20 con 0x55ca136ae040 2023-10-05T21:15:17.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.796+0000 7f7e02a11680 1 -- 172.21.15.153:0/4178687845 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca136ae040 msgr2=0x55ca137597b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.796+0000 7f7e02a11680 1 --2- 172.21.15.153:0/4178687845 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca136ae040 0x55ca137597b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7dec000c00 tx=0x7f7dec015000 comp rx=0 tx=0).stop 2023-10-05T21:15:17.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.796+0000 7f7e02a11680 1 -- 172.21.15.153:0/4178687845 shutdown_connections 2023-10-05T21:15:17.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.796+0000 7f7e02a11680 1 --2- 172.21.15.153:0/4178687845 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca136ae040 0x55ca137597b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.796+0000 7f7e02a11680 1 -- 172.21.15.153:0/4178687845 >> 172.21.15.153:0/4178687845 conn(0x55ca13734b20 msgr2=0x55ca13755280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.796+0000 7f7e02a11680 1 -- 172.21.15.153:0/4178687845 shutdown_connections 2023-10-05T21:15:17.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.796+0000 7f7e02a11680 1 -- 172.21.15.153:0/4178687845 wait complete. 2023-10-05T21:15:17.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.796+0000 7f7e02a11680 1 Processor -- start 2023-10-05T21:15:17.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.796+0000 7f7e02a11680 1 -- start start 2023-10-05T21:15:17.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.797+0000 7f7e02a11680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca136ae040 0x55ca13760b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.797+0000 7f7e02a11680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca135dec80 con 0x55ca136ae040 2023-10-05T21:15:17.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.797+0000 7f7df5ae9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca136ae040 0x55ca13760b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.797+0000 7f7df5ae9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca136ae040 0x55ca13760b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37720/0 (socket says 172.21.15.153:37720) 2023-10-05T21:15:17.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.797+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 learned_addr learned my addr 172.21.15.153:0/3020285856 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:17.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.797+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca13742180 con 0x55ca136ae040 2023-10-05T21:15:17.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.797+0000 7f7df5ae9700 1 --2- 172.21.15.153:0/3020285856 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca136ae040 0x55ca13760b60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7dec00a520 tx=0x7f7dec01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.797+0000 7f7de5ffb700 1 -- 172.21.15.153:0/3020285856 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7dec01d420 con 0x55ca136ae040 2023-10-05T21:15:17.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.797+0000 7f7de5ffb700 1 -- 172.21.15.153:0/3020285856 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dec01d580 con 0x55ca136ae040 2023-10-05T21:15:17.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.797+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ca137610a0 con 0x55ca136ae040 2023-10-05T21:15:17.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.797+0000 7f7de5ffb700 1 -- 172.21.15.153:0/3020285856 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7dec01d730 con 0x55ca136ae040 2023-10-05T21:15:17.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.797+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca13761490 con 0x55ca136ae040 2023-10-05T21:15:17.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.798+0000 7f7de5ffb700 1 -- 172.21.15.153:0/3020285856 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f7dec01d9f0 con 0x55ca136ae040 2023-10-05T21:15:17.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.798+0000 7f7de5ffb700 1 --2- 172.21.15.153:0/3020285856 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7dd80340f0 0x7f7dd80365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.798+0000 7f7de5ffb700 1 -- 172.21.15.153:0/3020285856 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f7dec04a4a0 con 0x55ca136ae040 2023-10-05T21:15:17.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.798+0000 7f7df52e8700 1 --2- 172.21.15.153:0/3020285856 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7dd80340f0 0x7f7dd80365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.799+0000 7f7e02a11680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.799+0000 7f7e02a11680 1 --2- 172.21.15.153:0/3020285856 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ca1373d570 0x55ca1376c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.799+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca1376d080 con 0x55ca1373d570 2023-10-05T21:15:17.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.799+0000 7f7df52e8700 1 --2- 172.21.15.153:0/3020285856 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7dd80340f0 0x7f7dd80365a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7de80011e0 tx=0x7f7de80013a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.799+0000 7f7df62ea700 1 --2- 172.21.15.153:0/3020285856 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ca1373d570 0x55ca1376c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.799+0000 7f7df62ea700 1 --2- 172.21.15.153:0/3020285856 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ca1373d570 0x55ca1376c8f0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.799+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.799+0000 7f7e02a11680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.799+0000 7f7e02a11680 20 realm 2023-10-05T21:15:17.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.799+0000 7f7e02a11680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.799+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13769e30 con 0x55ca1373d570 2023-10-05T21:15:17.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.800+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.800+0000 7f7e02a11680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.800+0000 7f7e02a11680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:17.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.800+0000 7f7e02a11680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.800+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca1376db30 con 0x55ca1373d570 2023-10-05T21:15:17.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.800+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.800+0000 7f7e02a11680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.800+0000 7f7e02a11680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.800+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca1376e450 con 0x55ca1373d570 2023-10-05T21:15:17.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.800+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.800+0000 7f7e02a11680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.800+0000 7f7e02a11680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.800+0000 7f7e02a11680 1 --2- 172.21.15.153:0/3020285856 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ca1376ed10 0x55ca137710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.800+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13771700 con 0x55ca1376ed10 2023-10-05T21:15:17.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.800+0000 7f7df5ae9700 1 --2- 172.21.15.153:0/3020285856 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ca1376ed10 0x55ca137710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.801+0000 7f7df5ae9700 1 --2- 172.21.15.153:0/3020285856 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ca1376ed10 0x55ca137710f0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.801+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f7dec036070 con 0x55ca1376ed10 2023-10-05T21:15:17.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.801+0000 7f7e02a11680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:17.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.801+0000 7f7e02a11680 20 searching for the correct realm 2023-10-05T21:15:17.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.801+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x55ca1376ed10 2023-10-05T21:15:17.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.801+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7dec036070 con 0x55ca1376ed10 2023-10-05T21:15:17.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.801+0000 7f7df5ae9700 1 --2- 172.21.15.153:0/3020285856 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f7dec039030 0x7f7dec02f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.801+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x7f7dec039030 2023-10-05T21:15:17.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.801+0000 7f7df52e8700 1 --2- 172.21.15.153:0/3020285856 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f7dec039030 0x7f7dec02f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.801+0000 7f7df52e8700 1 --2- 172.21.15.153:0/3020285856 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f7dec039030 0x7f7dec02f3a0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.802+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7de8006070 con 0x7f7dec039030 2023-10-05T21:15:17.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.802+0000 7f7df52e8700 1 --2- 172.21.15.153:0/3020285856 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f7de800d8e0 0x7f7de800c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.802+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x7f7de800d8e0 2023-10-05T21:15:17.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.802+0000 7f7df62ea700 1 --2- 172.21.15.153:0/3020285856 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f7de800d8e0 0x7f7de800c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.802+0000 7f7df62ea700 1 --2- 172.21.15.153:0/3020285856 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f7de800d8e0 0x7f7de800c360 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.803+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.803+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x55ca1373d570 2023-10-05T21:15:17.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.803+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.803+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x55ca1373d570 2023-10-05T21:15:17.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.803+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.803+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x7f7de800d8e0 2023-10-05T21:15:17.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.803+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.803+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x7f7de800d8e0 2023-10-05T21:15:17.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.803+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.803+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x7f7dec039030 2023-10-05T21:15:17.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.804+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7de8006070 con 0x7f7dec039030 2023-10-05T21:15:17.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.804+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x55ca1376ed10 2023-10-05T21:15:17.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.804+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f7dec036070 con 0x55ca1376ed10 2023-10-05T21:15:17.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.804+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x55ca1373d570 2023-10-05T21:15:17.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.804+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.804+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x7f7de800d8e0 2023-10-05T21:15:17.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.804+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.804+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x55ca1373d570 2023-10-05T21:15:17.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.804+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.804+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x7f7dec039030 2023-10-05T21:15:17.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.805+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7de8006070 con 0x7f7dec039030 2023-10-05T21:15:17.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.805+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x55ca1376ed10 2023-10-05T21:15:17.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.805+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7dec036070 con 0x55ca1376ed10 2023-10-05T21:15:17.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.805+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x55ca1376ed10 2023-10-05T21:15:17.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.805+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7dec036070 con 0x55ca1376ed10 2023-10-05T21:15:17.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.805+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x7f7de800d8e0 2023-10-05T21:15:17.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.805+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.806+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x55ca1376ed10 2023-10-05T21:15:17.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.806+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7dec036070 con 0x55ca1376ed10 2023-10-05T21:15:17.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.806+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x55ca1376ed10 2023-10-05T21:15:17.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.806+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7dec036070 con 0x55ca1376ed10 2023-10-05T21:15:17.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.806+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x55ca1373d570 2023-10-05T21:15:17.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.806+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.806+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x55ca1373d570 2023-10-05T21:15:17.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.806+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.806+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x7f7de800d8e0 2023-10-05T21:15:17.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.807+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.807+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x55ca1376ed10 2023-10-05T21:15:17.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.807+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7dec036070 con 0x55ca1376ed10 2023-10-05T21:15:17.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.807+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x7f7dec039030 2023-10-05T21:15:17.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.807+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7de8006070 con 0x7f7dec039030 2023-10-05T21:15:17.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.807+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x55ca1373d570 2023-10-05T21:15:17.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.807+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.807+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x7f7de800d8e0 2023-10-05T21:15:17.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.808+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.808+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x55ca1376ed10 2023-10-05T21:15:17.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.808+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7dec036070 con 0x55ca1376ed10 2023-10-05T21:15:17.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.808+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x7f7de800d8e0 2023-10-05T21:15:17.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.808+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.808+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x7f7dec039030 2023-10-05T21:15:17.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.809+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7de8006070 con 0x7f7dec039030 2023-10-05T21:15:17.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.809+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x55ca1376ed10 2023-10-05T21:15:17.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.809+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7dec036070 con 0x55ca1376ed10 2023-10-05T21:15:17.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.809+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x7f7de800d8e0 2023-10-05T21:15:17.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.809+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.809+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x55ca1373d570 2023-10-05T21:15:17.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.809+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.809+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773250 con 0x7f7dec039030 2023-10-05T21:15:17.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.810+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7de8006070 con 0x7f7dec039030 2023-10-05T21:15:17.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.810+0000 7f7e02a11680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:17.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.810+0000 7f7e02a11680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:17.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.810+0000 7f7e02a11680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:17.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.810+0000 7f7e02a11680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:17.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.810+0000 7f7e02a11680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.810+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137723f0 con 0x55ca1373d570 2023-10-05T21:15:17.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.810+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.810+0000 7f7e02a11680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.810+0000 7f7e02a11680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.810+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13772020 con 0x55ca1373d570 2023-10-05T21:15:17.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.810+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.810+0000 7f7e02a11680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.810+0000 7f7e02a11680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.810+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137736e0 con 0x55ca1373d570 2023-10-05T21:15:17.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.810+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.810+0000 7f7e02a11680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:17.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.810+0000 7f7e02a11680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.810+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773a90 con 0x55ca1376ed10 2023-10-05T21:15:17.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.810+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f7dec036070 con 0x55ca1376ed10 2023-10-05T21:15:17.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.810+0000 7f7e02a11680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.810+0000 7f7e02a11680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.810+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773e40 con 0x55ca1373d570 2023-10-05T21:15:17.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.811+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.811+0000 7f7e02a11680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.811+0000 7f7e02a11680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.811+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773e40 con 0x55ca1373d570 2023-10-05T21:15:17.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.811+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.811+0000 7f7e02a11680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.811+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773e40 con 0x55ca1376ed10 2023-10-05T21:15:17.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.811+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7dec036070 con 0x55ca1376ed10 2023-10-05T21:15:17.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.811+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773e40 con 0x7f7dec039030 2023-10-05T21:15:17.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.811+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7de8006070 con 0x7f7dec039030 2023-10-05T21:15:17.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.811+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773e40 con 0x7f7de800d8e0 2023-10-05T21:15:17.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.812+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.812+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137736e0 con 0x55ca1373d570 2023-10-05T21:15:17.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.812+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.812+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137736e0 con 0x55ca1373d570 2023-10-05T21:15:17.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.812+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.812+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137736e0 con 0x7f7de800d8e0 2023-10-05T21:15:17.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.813+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.813+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137736e0 con 0x7f7de800d8e0 2023-10-05T21:15:17.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.813+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.813+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137736e0 con 0x7f7dec039030 2023-10-05T21:15:17.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.813+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7de8006070 con 0x7f7dec039030 2023-10-05T21:15:17.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.813+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137736e0 con 0x55ca1376ed10 2023-10-05T21:15:17.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.813+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f7dec036070 con 0x55ca1376ed10 2023-10-05T21:15:17.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.813+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137736e0 con 0x55ca1373d570 2023-10-05T21:15:17.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.814+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.814+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137736e0 con 0x7f7de800d8e0 2023-10-05T21:15:17.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.814+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.814+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137736e0 con 0x55ca1373d570 2023-10-05T21:15:17.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.814+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.814+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137736e0 con 0x7f7dec039030 2023-10-05T21:15:17.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.814+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7de8006070 con 0x7f7dec039030 2023-10-05T21:15:17.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.814+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137736e0 con 0x55ca1376ed10 2023-10-05T21:15:17.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.814+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7dec036070 con 0x55ca1376ed10 2023-10-05T21:15:17.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.814+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137736e0 con 0x55ca1376ed10 2023-10-05T21:15:17.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.815+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7dec036070 con 0x55ca1376ed10 2023-10-05T21:15:17.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.815+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137736e0 con 0x7f7de800d8e0 2023-10-05T21:15:17.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.815+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.815+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137736e0 con 0x55ca1376ed10 2023-10-05T21:15:17.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.815+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7dec036070 con 0x55ca1376ed10 2023-10-05T21:15:17.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.815+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137736e0 con 0x55ca1376ed10 2023-10-05T21:15:17.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.815+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7dec036070 con 0x55ca1376ed10 2023-10-05T21:15:17.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.815+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137736e0 con 0x55ca1373d570 2023-10-05T21:15:17.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.815+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.815+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137736e0 con 0x55ca1373d570 2023-10-05T21:15:17.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.816+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.816+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137736e0 con 0x7f7de800d8e0 2023-10-05T21:15:17.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.816+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.816+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137736e0 con 0x55ca1376ed10 2023-10-05T21:15:17.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.816+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7dec036070 con 0x55ca1376ed10 2023-10-05T21:15:17.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.816+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137736e0 con 0x7f7dec039030 2023-10-05T21:15:17.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.816+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7de8006070 con 0x7f7dec039030 2023-10-05T21:15:17.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.816+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137736e0 con 0x55ca1373d570 2023-10-05T21:15:17.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.816+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.817+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137736e0 con 0x7f7de800d8e0 2023-10-05T21:15:17.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.817+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.817+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137736e0 con 0x55ca1376ed10 2023-10-05T21:15:17.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.817+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7dec036070 con 0x55ca1376ed10 2023-10-05T21:15:17.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.817+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137736e0 con 0x7f7de800d8e0 2023-10-05T21:15:17.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.817+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.817+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137736e0 con 0x7f7dec039030 2023-10-05T21:15:17.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.817+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7de8006070 con 0x7f7dec039030 2023-10-05T21:15:17.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.817+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137736e0 con 0x55ca1376ed10 2023-10-05T21:15:17.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.818+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7dec036070 con 0x55ca1376ed10 2023-10-05T21:15:17.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.818+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137736e0 con 0x7f7de800d8e0 2023-10-05T21:15:17.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.818+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.818+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137736e0 con 0x55ca1373d570 2023-10-05T21:15:17.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.818+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.818+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137736e0 con 0x7f7dec039030 2023-10-05T21:15:17.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.818+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7de8006070 con 0x7f7dec039030 2023-10-05T21:15:17.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.818+0000 7f7e02a11680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:17.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.818+0000 7f7e02a11680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:17.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.818+0000 7f7e02a11680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:17.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.818+0000 7f7e02a11680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:17.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.818+0000 7f7e02a11680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.818+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13773e40 con 0x55ca1373d570 2023-10-05T21:15:17.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.819+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.819+0000 7f7e02a11680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.819+0000 7f7e02a11680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.819+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13774240 con 0x55ca1376ed10 2023-10-05T21:15:17.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.819+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f7dec036070 con 0x55ca1376ed10 2023-10-05T21:15:17.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.819+0000 7f7e02a11680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:17.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.819+0000 7f7e02a11680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.819+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13774ae0 con 0x55ca1373d570 2023-10-05T21:15:17.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.819+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.819+0000 7f7e02a11680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.819+0000 7f7e02a11680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.819+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13774ae0 con 0x55ca1373d570 2023-10-05T21:15:17.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.819+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.819+0000 7f7e02a11680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:17.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.819+0000 7f7e02a11680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.819+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13774c00 con 0x7f7de800d8e0 2023-10-05T21:15:17.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.820+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.820+0000 7f7e02a11680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.820+0000 7f7e02a11680 20 zone default found 2023-10-05T21:15:17.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.820+0000 7f7e02a11680 4 Realm: () 2023-10-05T21:15:17.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.820+0000 7f7e02a11680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:17.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.820+0000 7f7e02a11680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:17.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.820+0000 7f7e02a11680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:17.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.820+0000 7f7e02a11680 20 zonegroup default 2023-10-05T21:15:17.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.820+0000 7f7e02a11680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.820+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13774c00 con 0x7f7de800d8e0 2023-10-05T21:15:17.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.820+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.820+0000 7f7e02a11680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.820+0000 7f7e02a11680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.820+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13776580 con 0x55ca1376ed10 2023-10-05T21:15:17.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.820+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7dec036070 con 0x55ca1376ed10 2023-10-05T21:15:17.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.820+0000 7f7e02a11680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.820+0000 7f7e02a11680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.820+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13776930 con 0x55ca1376ed10 2023-10-05T21:15:17.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.821+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7dec036070 con 0x55ca1376ed10 2023-10-05T21:15:17.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.821+0000 7f7e02a11680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.821+0000 7f7e02a11680 20 started sync module instance, tier type = 2023-10-05T21:15:17.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.821+0000 7f7e02a11680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:17.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.821+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13775c90 con 0x7f7dec039030 2023-10-05T21:15:17.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.821+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7de8006070 con 0x7f7dec039030 2023-10-05T21:15:17.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.821+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94326398345360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13777240 con 0x7f7dec039030 2023-10-05T21:15:17.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.821+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13777ae0 con 0x55ca1373d570 2023-10-05T21:15:17.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.822+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94326398345360] v29'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7de8006070 con 0x7f7dec039030 2023-10-05T21:15:17.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.822+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.822+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94326398350832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13776e90 con 0x55ca1373d570 2023-10-05T21:15:17.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.822+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13778720 con 0x55ca1376ed10 2023-10-05T21:15:17.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.823+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94326398350832] v29'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.823+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7dec036070 con 0x55ca1376ed10 2023-10-05T21:15:17.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.823+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94326398353840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13778b20 con 0x55ca1376ed10 2023-10-05T21:15:17.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.823+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca13779530 con 0x7f7dec039030 2023-10-05T21:15:17.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.824+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94326398353840] v29'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7dec036070 con 0x55ca1376ed10 2023-10-05T21:15:17.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.824+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7de8006070 con 0x7f7dec039030 2023-10-05T21:15:17.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.824+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94326398357568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137798e0 con 0x7f7dec039030 2023-10-05T21:15:17.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.824+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca1377a2f0 con 0x55ca1373d570 2023-10-05T21:15:17.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.825+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94326398357568] v29'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7de8006070 con 0x7f7dec039030 2023-10-05T21:15:17.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.825+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.825+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94326398361088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca1377a740 con 0x55ca1373d570 2023-10-05T21:15:17.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.825+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca1377b150 con 0x7f7de800d8e0 2023-10-05T21:15:17.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.825+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94326398361088] v29'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.825+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.825+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94326398362784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca1377b150 con 0x7f7de800d8e0 2023-10-05T21:15:17.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.825+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca1377bb60 con 0x7f7de800d8e0 2023-10-05T21:15:17.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.826+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94326398362784] v29'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.826+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.826+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94326398364768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca1377b130 con 0x7f7de800d8e0 2023-10-05T21:15:17.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.826+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca1377c5a0 con 0x7f7de800d8e0 2023-10-05T21:15:17.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.827+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94326398364768] v29'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.827+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.827+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94326398367904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca1377c560 con 0x7f7de800d8e0 2023-10-05T21:15:17.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.827+0000 7f7e02a11680 20 add_watcher() i=0 2023-10-05T21:15:17.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.827+0000 7f7e02a11680 20 add_watcher() i=1 2023-10-05T21:15:17.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.827+0000 7f7e02a11680 20 add_watcher() i=2 2023-10-05T21:15:17.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.827+0000 7f7e02a11680 20 add_watcher() i=3 2023-10-05T21:15:17.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.827+0000 7f7e02a11680 20 add_watcher() i=4 2023-10-05T21:15:17.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.827+0000 7f7e02a11680 20 add_watcher() i=5 2023-10-05T21:15:17.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.827+0000 7f7e02a11680 20 add_watcher() i=6 2023-10-05T21:15:17.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.828+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94326398367904] v29'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.828+0000 7f7e02a11680 20 add_watcher() i=7 2023-10-05T21:15:17.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.828+0000 7f7e02a11680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:17.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.828+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca1377f9a0 con 0x55ca1373d570 2023-10-05T21:15:17.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.828+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.828+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94326398370368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca1377ce60 con 0x55ca1373d570 2023-10-05T21:15:17.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.829+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94326398370368] v29'126 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.829+0000 7f7dc6fe5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:17.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.829+0000 7f7e02a11680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:17.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.829+0000 7f7e02a11680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:17.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.829+0000 7f7e02a11680 1 Processor -- start 2023-10-05T21:15:17.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.829+0000 7f7e02a11680 1 -- start start 2023-10-05T21:15:17.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.829+0000 7f7e02a11680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca137895b0 0x55ca137899c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.829+0000 7f7e02a11680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca13789fd0 con 0x55ca137895b0 2023-10-05T21:15:17.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.830+0000 7f7df52e8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca137895b0 0x55ca137899c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.830+0000 7f7df52e8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca137895b0 0x55ca137899c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37724/0 (socket says 172.21.15.153:37724) 2023-10-05T21:15:17.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.830+0000 7f7df52e8700 1 -- 172.21.15.153:0/1788362298 learned_addr learned my addr 172.21.15.153:0/1788362298 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:17.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.830+0000 7f7df52e8700 1 -- 172.21.15.153:0/1788362298 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca1378a4b0 con 0x55ca137895b0 2023-10-05T21:15:17.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.830+0000 7f7df52e8700 1 --2- 172.21.15.153:0/1788362298 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca137895b0 0x55ca137899c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x55ca13771c10 tx=0x7f7de8006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3196802c59188887 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.830+0000 7f7dc67e4700 1 -- 172.21.15.153:0/1788362298 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7de8023040 con 0x55ca137895b0 2023-10-05T21:15:17.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.830+0000 7f7dc67e4700 1 -- 172.21.15.153:0/1788362298 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de8024040 con 0x55ca137895b0 2023-10-05T21:15:17.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.830+0000 7f7dc67e4700 1 -- 172.21.15.153:0/1788362298 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7de8013040 con 0x55ca137895b0 2023-10-05T21:15:17.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.831+0000 7f7e02a11680 1 -- 172.21.15.153:0/1788362298 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca137895b0 msgr2=0x55ca137899c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.831+0000 7f7e02a11680 1 --2- 172.21.15.153:0/1788362298 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca137895b0 0x55ca137899c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x55ca13771c10 tx=0x7f7de8006000 comp rx=0 tx=0).stop 2023-10-05T21:15:17.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.831+0000 7f7e02a11680 1 -- 172.21.15.153:0/1788362298 shutdown_connections 2023-10-05T21:15:17.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.831+0000 7f7e02a11680 1 --2- 172.21.15.153:0/1788362298 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca137895b0 0x55ca137899c0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.831+0000 7f7e02a11680 1 -- 172.21.15.153:0/1788362298 >> 172.21.15.153:0/1788362298 conn(0x55ca137858b0 msgr2=0x55ca137839b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.831+0000 7f7e02a11680 1 -- 172.21.15.153:0/1788362298 shutdown_connections 2023-10-05T21:15:17.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.831+0000 7f7e02a11680 1 -- 172.21.15.153:0/1788362298 wait complete. 2023-10-05T21:15:17.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.831+0000 7f7e02a11680 1 Processor -- start 2023-10-05T21:15:17.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.831+0000 7f7e02a11680 1 -- start start 2023-10-05T21:15:17.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.832+0000 7f7e02a11680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca137895b0 0x55ca13790300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.832+0000 7f7e02a11680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca13790840 con 0x55ca137895b0 2023-10-05T21:15:17.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.832+0000 7f7df52e8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca137895b0 0x55ca13790300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.832+0000 7f7df52e8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca137895b0 0x55ca13790300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37736/0 (socket says 172.21.15.153:37736) 2023-10-05T21:15:17.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.832+0000 7f7df52e8700 1 -- 172.21.15.153:0/150498842 learned_addr learned my addr 172.21.15.153:0/150498842 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:17.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.832+0000 7f7df52e8700 1 -- 172.21.15.153:0/150498842 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de800ed20 con 0x55ca137895b0 2023-10-05T21:15:17.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.832+0000 7f7df52e8700 1 --2- 172.21.15.153:0/150498842 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca137895b0 0x55ca13790300 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x55ca13784e20 tx=0x7f7de8030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.832+0000 7f7dc4fe1700 1 -- 172.21.15.153:0/150498842 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7de8023040 con 0x55ca137895b0 2023-10-05T21:15:17.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.832+0000 7f7dc4fe1700 1 -- 172.21.15.153:0/150498842 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de803b580 con 0x55ca137895b0 2023-10-05T21:15:17.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.832+0000 7f7e02a11680 1 -- 172.21.15.153:0/150498842 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ca13790a40 con 0x55ca137895b0 2023-10-05T21:15:17.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.832+0000 7f7dc4fe1700 1 -- 172.21.15.153:0/150498842 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7de803b730 con 0x55ca137895b0 2023-10-05T21:15:17.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.832+0000 7f7e02a11680 1 -- 172.21.15.153:0/150498842 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca13790e90 con 0x55ca137895b0 2023-10-05T21:15:17.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.833+0000 7f7dc4fe1700 1 -- 172.21.15.153:0/150498842 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f7de803b890 con 0x55ca137895b0 2023-10-05T21:15:17.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.833+0000 7f7dc4fe1700 1 --2- 172.21.15.153:0/150498842 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7d3c0340f0 0x7f7d3c0365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.833+0000 7f7dc4fe1700 1 -- 172.21.15.153:0/150498842 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f7de8044ab0 con 0x55ca137895b0 2023-10-05T21:15:17.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.833+0000 7f7df62ea700 1 --2- 172.21.15.153:0/150498842 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7d3c0340f0 0x7f7d3c0365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.833+0000 7f7e02a11680 5 note: GC not initialized 2023-10-05T21:15:17.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.834+0000 7f7df62ea700 1 --2- 172.21.15.153:0/150498842 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7d3c0340f0 0x7f7d3c0365a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55ca1377b350 tx=0x7f7df0037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.834+0000 7f7d35ffb700 20 reqs_thread_entry: start 2023-10-05T21:15:17.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.834+0000 7f7d277fe700 20 reqs_thread_entry: start 2023-10-05T21:15:17.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.834+0000 7f7e02a11680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:17.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.835+0000 7f7e02a11680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:17.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.835+0000 7f7d25ffb700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:48 2023 2023-10-05T21:15:17.866 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:17.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.835+0000 7f7d257fa700 20 reqs_thread_entry: start 2023-10-05T21:15:17.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.835+0000 7f7e02a11680 20 get_system_obj_state: rctx=0x7ffe33351198 obj=default.rgw.meta:users.uid:testx$tenanteduser state=0x55ca135ed240 s->prefetch_data=0 2023-10-05T21:15:17.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.835+0000 7f7e02a11680 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2023-10-05T21:15:17.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.835+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137f5d70 con 0x7f7de800d8e0 2023-10-05T21:15:17.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.835+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(102 testx$tenanteduser [call,getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 246+0+0 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.835+0000 7f7e02a11680 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2023-10-05T21:15:17.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.835+0000 7f7e02a11680 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2023-10-05T21:15:17.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.835+0000 7f7e02a11680 20 get_system_obj_state: rctx=0x7ffe33350e88 obj=default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ state=0x55ca135ed240 s->prefetch_data=0 2023-10-05T21:15:17.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.835+0000 7f7e02a11680 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2023-10-05T21:15:17.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.835+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:103 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137f4d60 con 0x7f7de800d8e0 2023-10-05T21:15:17.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.835+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(103 p5YnriCv1nAtykxBrupQ [getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.835+0000 7f7e02a11680 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2023-10-05T21:15:17.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.835+0000 7f7e02a11680 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-10-05T21:15:17.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.835+0000 7f7e02a11680 20 get_system_obj_state: rctx=0x7ffe33350718 obj=default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ state=0x55ca135ed240 s->prefetch_data=0 2023-10-05T21:15:17.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.835+0000 7f7e02a11680 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2023-10-05T21:15:17.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.835+0000 7f7e02a11680 20 get_system_obj_state: rctx=0x7ffe33350dc8 obj=default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ state=0x55ca135ed240 s->prefetch_data=0 2023-10-05T21:15:17.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.835+0000 7f7e02a11680 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2023-10-05T21:15:17.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.835+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:104 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~385 in=385b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137f8430 con 0x7f7de800d8e0 2023-10-05T21:15:17.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.836+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(104 testx$tenanteduser [delete,create,call,writefull 0~385] v29'5 uv5 ondisk = 0) v8 ==== 288+0+0 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.836+0000 7f7e02a11680 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2023-10-05T21:15:17.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.836+0000 7f7e02a11680 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2023-10-05T21:15:17.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.836+0000 7f7e02a11680 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2023-10-05T21:15:17.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.836+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [notify cookie 94326398877136 in=588b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137f90d0 con 0x7f7dec039030 2023-10-05T21:15:17.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.837+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== watch-notify(notify (1) cookie 94326398357568 notify 124554051596 ret 0) v3 ==== 618+0+0 (crc 0 0 0) 0x55ca13790e90 con 0x7f7dec039030 2023-10-05T21:15:17.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.837+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(105 notify.3 [notify cookie 94326398877136 out=8b] v0'0 uv129 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f7de8006070 con 0x7f7dec039030 2023-10-05T21:15:17.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.837+0000 7f7de6ffd700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051596 cookie 94326398357568 notifier 4484 bl.length()=576 2023-10-05T21:15:17.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.837+0000 7f7de6ffd700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2023-10-05T21:15:17.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.837+0000 7f7de6ffd700 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2023-10-05T21:15:17.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.837+0000 7f7de6ffd700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:106 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f7d44003480 con 0x7f7dec039030 2023-10-05T21:15:17.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.837+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== watch-notify(notify_complete (2) cookie 94326398877136 notify 124554051596 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55ca13790a40 con 0x7f7dec039030 2023-10-05T21:15:17.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.837+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(106 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7de8006070 con 0x7f7dec039030 2023-10-05T21:15:17.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.837+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:107 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137f7dd0 con 0x7f7de800d8e0 2023-10-05T21:15:17.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.838+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(107 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v29'6 uv6 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.838+0000 7f7e02a11680 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2023-10-05T21:15:17.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.838+0000 7f7e02a11680 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-10-05T21:15:17.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.838+0000 7f7e02a11680 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2023-10-05T21:15:17.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.838+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [notify cookie 94326398877136 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137f8bc0 con 0x55ca1376ed10 2023-10-05T21:15:17.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.838+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== watch-notify(notify (1) cookie 94326398353840 notify 124554051591 ret 0) v3 ==== 234+0+0 (crc 0 0 0) 0x55ca13761490 con 0x55ca1376ed10 2023-10-05T21:15:17.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.838+0000 7f7de6ffd700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051591 cookie 94326398353840 notifier 4484 bl.length()=192 2023-10-05T21:15:17.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.838+0000 7f7de6ffd700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2023-10-05T21:15:17.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.838+0000 7f7de6ffd700 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-10-05T21:15:17.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.838+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(108 notify.2 [notify cookie 94326398877136 out=8b] v0'0 uv129 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f7dec036070 con 0x55ca1376ed10 2023-10-05T21:15:17.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.838+0000 7f7de6ffd700 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:109 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f7d440034c0 con 0x55ca1376ed10 2023-10-05T21:15:17.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.838+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== watch-notify(notify_complete (2) cookie 94326398877136 notify 124554051591 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55ca137610a0 con 0x55ca1376ed10 2023-10-05T21:15:17.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.838+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== osd_op_reply(109 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7dec036070 con 0x55ca1376ed10 2023-10-05T21:15:17.871 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:17.871 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "testx$tenanteduser", 2023-10-05T21:15:17.871 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "tenanted-user", 2023-10-05T21:15:17.871 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "", 2023-10-05T21:15:17.871 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2023-10-05T21:15:17.871 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 1, 2023-10-05T21:15:17.871 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [], 2023-10-05T21:15:17.871 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2023-10-05T21:15:17.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:17.871 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "testx$tenanteduser", 2023-10-05T21:15:17.872 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "p5YnriCv1nAtykxBrupQ", 2023-10-05T21:15:17.872 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh" 2023-10-05T21:15:17.872 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:17.872 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:17.872 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [], 2023-10-05T21:15:17.872 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2023-10-05T21:15:17.872 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2023-10-05T21:15:17.872 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2023-10-05T21:15:17.872 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2023-10-05T21:15:17.872 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2023-10-05T21:15:17.872 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:15:17.872 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:17.873 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:17.873 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:17.873 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:17.873 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:17.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:17.873 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2023-10-05T21:15:17.873 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:17.873 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:17.873 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:17.873 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:17.873 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:17.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:17.874 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2023-10-05T21:15:17.874 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2023-10-05T21:15:17.874 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [] 2023-10-05T21:15:17.874 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:17.874 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:15:17.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.839+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:110 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94326398345360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137f8bc0 con 0x7f7dec039030 2023-10-05T21:15:17.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.839+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== osd_op_reply(110 notify.0 [watch unwatch cookie 94326398345360] v29'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7de8006070 con 0x7f7dec039030 2023-10-05T21:15:17.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.839+0000 7f7e02a11680 20 remove_watcher() i=0 2023-10-05T21:15:17.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.839+0000 7f7e02a11680 2 removed watcher, disabling cache 2023-10-05T21:15:17.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.839+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:111 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94326398350832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137f8bc0 con 0x55ca1373d570 2023-10-05T21:15:17.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.840+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(111 notify.1 [watch unwatch cookie 94326398350832] v29'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.840+0000 7f7e02a11680 20 remove_watcher() i=1 2023-10-05T21:15:17.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.840+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:112 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94326398353840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137f8bc0 con 0x55ca1376ed10 2023-10-05T21:15:17.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.841+0000 7f7df5ae9700 1 -- 172.21.15.153:0/3020285856 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(112 notify.2 [watch unwatch cookie 94326398353840] v29'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7dec036070 con 0x55ca1376ed10 2023-10-05T21:15:17.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.841+0000 7f7e02a11680 20 remove_watcher() i=2 2023-10-05T21:15:17.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.841+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:113 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94326398357568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137f8bc0 con 0x7f7dec039030 2023-10-05T21:15:17.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.842+0000 7f7df52e8700 1 -- 172.21.15.153:0/3020285856 <== osd.2 v2:172.21.15.153:6807/140454 22 ==== osd_op_reply(113 notify.3 [watch unwatch cookie 94326398357568] v29'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7de8053040 con 0x7f7dec039030 2023-10-05T21:15:17.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.842+0000 7f7e02a11680 20 remove_watcher() i=3 2023-10-05T21:15:17.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.842+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:114 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94326398361088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137f8bc0 con 0x55ca1373d570 2023-10-05T21:15:17.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.843+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(114 notify.4 [watch unwatch cookie 94326398361088] v29'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.843+0000 7f7e02a11680 20 remove_watcher() i=4 2023-10-05T21:15:17.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.843+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:115 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94326398362784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137f8bc0 con 0x7f7de800d8e0 2023-10-05T21:15:17.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.843+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 31 ==== osd_op_reply(115 notify.5 [watch unwatch cookie 94326398362784] v29'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.843+0000 7f7e02a11680 20 remove_watcher() i=5 2023-10-05T21:15:17.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.844+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:116 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94326398364768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137f8bc0 con 0x7f7de800d8e0 2023-10-05T21:15:17.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.845+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 32 ==== osd_op_reply(116 notify.6 [watch unwatch cookie 94326398364768] v29'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.845+0000 7f7e02a11680 20 remove_watcher() i=6 2023-10-05T21:15:17.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.845+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:117 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94326398367904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137f8bc0 con 0x7f7de800d8e0 2023-10-05T21:15:17.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.845+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.0 v2:172.21.15.111:6800/111394 33 ==== osd_op_reply(117 notify.7 [watch unwatch cookie 94326398367904] v29'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7df000a570 con 0x7f7de800d8e0 2023-10-05T21:15:17.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.845+0000 7f7e02a11680 20 remove_watcher() i=7 2023-10-05T21:15:17.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.846+0000 7f7dc6fe5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:17.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.846+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:118 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94326398370368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ca137f8bc0 con 0x55ca1373d570 2023-10-05T21:15:17.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.847+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(118 data_loggenerations_metadata [watch unwatch cookie 94326398370368] v29'127 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7df000a570 con 0x55ca1373d570 2023-10-05T21:15:17.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.847+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f7de800d8e0 msgr2=0x7f7de800c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.847+0000 7f7e02a11680 1 --2- 172.21.15.153:0/3020285856 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f7de800d8e0 0x7f7de800c360 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.847+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ca1373d570 msgr2=0x55ca1376c8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.847+0000 7f7e02a11680 1 --2- 172.21.15.153:0/3020285856 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ca1373d570 0x55ca1376c8f0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.847+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f7dec039030 msgr2=0x7f7dec02f3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.847+0000 7f7e02a11680 1 --2- 172.21.15.153:0/3020285856 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f7dec039030 0x7f7dec02f3a0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.847+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ca1376ed10 msgr2=0x55ca137710f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.847+0000 7f7e02a11680 1 --2- 172.21.15.153:0/3020285856 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ca1376ed10 0x55ca137710f0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.847+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7dd80340f0 msgr2=0x7f7dd80365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.847+0000 7f7e02a11680 1 --2- 172.21.15.153:0/3020285856 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7dd80340f0 0x7f7dd80365a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7de80011e0 tx=0x7f7de80013a0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.847+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca136ae040 msgr2=0x55ca13760b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.847+0000 7f7e02a11680 1 --2- 172.21.15.153:0/3020285856 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca136ae040 0x55ca13760b60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7dec00a520 tx=0x7f7dec01d000 comp rx=0 tx=0).stop 2023-10-05T21:15:17.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.847+0000 7f7df62ea700 1 -- 172.21.15.153:0/3020285856 reap_dead start 2023-10-05T21:15:17.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.847+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 shutdown_connections 2023-10-05T21:15:17.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.847+0000 7f7e02a11680 1 --2- 172.21.15.153:0/3020285856 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca136ae040 0x55ca13760b60 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.847+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 >> 172.21.15.153:0/3020285856 conn(0x55ca13734b20 msgr2=0x55ca13753ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.847+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 shutdown_connections 2023-10-05T21:15:17.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.847+0000 7f7e02a11680 1 -- 172.21.15.153:0/3020285856 wait complete. 2023-10-05T21:15:17.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.847+0000 7f7e02a11680 1 -- 172.21.15.153:0/150498842 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7d3c0340f0 msgr2=0x7f7d3c0365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.847+0000 7f7e02a11680 1 --2- 172.21.15.153:0/150498842 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7d3c0340f0 0x7f7d3c0365a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55ca1377b350 tx=0x7f7df0037450 comp rx=0 tx=0).stop 2023-10-05T21:15:17.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.847+0000 7f7e02a11680 1 -- 172.21.15.153:0/150498842 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca137895b0 msgr2=0x55ca13790300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.847+0000 7f7e02a11680 1 --2- 172.21.15.153:0/150498842 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca137895b0 0x55ca13790300 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x55ca13784e20 tx=0x7f7de8030000 comp rx=0 tx=0).stop 2023-10-05T21:15:17.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.848+0000 7f7e02a11680 1 -- 172.21.15.153:0/150498842 shutdown_connections 2023-10-05T21:15:17.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.848+0000 7f7e02a11680 1 --2- 172.21.15.153:0/150498842 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7d3c0340f0 0x7f7d3c0365a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.848+0000 7f7e02a11680 1 --2- 172.21.15.153:0/150498842 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ca137895b0 0x55ca13790300 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.848+0000 7f7e02a11680 1 -- 172.21.15.153:0/150498842 >> 172.21.15.153:0/150498842 conn(0x55ca137858b0 msgr2=0x55ca13783980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.848+0000 7f7e02a11680 1 -- 172.21.15.153:0/150498842 shutdown_connections 2023-10-05T21:15:17.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.848+0000 7f7e02a11680 1 -- 172.21.15.153:0/150498842 wait complete. 2023-10-05T21:15:17.884 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:15:17.884 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2023-10-05T21:15:17.884 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2023-10-05T21:15:17.885 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2023-10-05T21:15:17.933 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:17.933 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:17.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.931+0000 7f1fcf396680 1 Processor -- start 2023-10-05T21:15:17.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.931+0000 7f1fcf396680 1 -- start start 2023-10-05T21:15:17.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.931+0000 7f1fcf396680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x558640ccf040 0x558640d5e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.931+0000 7f1fcf396680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558640ca8930 con 0x558640d5e570 2023-10-05T21:15:17.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.931+0000 7f1fcf396680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x558640c68db0 con 0x558640ccf040 2023-10-05T21:15:17.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.932+0000 7f1fc246e700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x558640ccf040 0x558640d5e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.932+0000 7f1fc1c6d700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x558640d5e570 0x558640d60950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:55210/0 (socket says 172.21.15.153:55210) 2023-10-05T21:15:17.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.932+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/820155705 learned_addr learned my addr 172.21.15.153:0/820155705 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:17.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.932+0000 7f1fc246e700 1 -- 172.21.15.153:0/820155705 >> v1:172.21.15.111:6789/0 conn(0x558640d5e570 legacy=0x558640d60950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.932+0000 7f1fc246e700 1 -- 172.21.15.153:0/820155705 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558640d63180 con 0x558640ccf040 2023-10-05T21:15:17.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.932+0000 7f1fc146c700 1 -- 172.21.15.153:0/820155705 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823162272 0 0) 0x558640ca8930 con 0x558640d5e570 2023-10-05T21:15:17.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.932+0000 7f1fc246e700 1 --2- 172.21.15.153:0/820155705 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640ccf040 0x558640d5e030 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc00a5d0 tx=0x7f1fbc005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab42bfa7a960d9c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.932+0000 7f1fc146c700 1 -- 172.21.15.153:0/820155705 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fbc0086a0 con 0x558640ccf040 2023-10-05T21:15:17.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.932+0000 7f1fc146c700 1 -- 172.21.15.153:0/820155705 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fbc008800 con 0x558640ccf040 2023-10-05T21:15:17.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.932+0000 7f1fc146c700 1 -- 172.21.15.153:0/820155705 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fbc008ad0 con 0x558640ccf040 2023-10-05T21:15:17.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.933+0000 7f1fcf396680 1 -- 172.21.15.153:0/820155705 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640ccf040 msgr2=0x558640d5e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.933+0000 7f1fcf396680 1 --2- 172.21.15.153:0/820155705 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640ccf040 0x558640d5e030 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc00a5d0 tx=0x7f1fbc005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:17.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.933+0000 7f1fcf396680 1 -- 172.21.15.153:0/820155705 shutdown_connections 2023-10-05T21:15:17.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.933+0000 7f1fcf396680 1 --2- 172.21.15.153:0/820155705 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640ccf040 0x558640d5e030 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.933+0000 7f1fcf396680 1 -- 172.21.15.153:0/820155705 >> 172.21.15.153:0/820155705 conn(0x558640d55b20 msgr2=0x558640d57f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.933+0000 7f1fcf396680 1 -- 172.21.15.153:0/820155705 shutdown_connections 2023-10-05T21:15:17.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.933+0000 7f1fcf396680 1 -- 172.21.15.153:0/820155705 wait complete. 2023-10-05T21:15:17.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.933+0000 7f1fcf396680 1 Processor -- start 2023-10-05T21:15:17.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.933+0000 7f1fcf396680 1 -- start start 2023-10-05T21:15:17.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.934+0000 7f1fcf396680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640ccf040 0x558640d5b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.934+0000 7f1fcf396680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x558640c08ea0 con 0x558640ccf040 2023-10-05T21:15:17.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.934+0000 7f1fc246e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640ccf040 0x558640d5b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.934+0000 7f1fc246e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640ccf040 0x558640d5b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37750/0 (socket says 172.21.15.153:37750) 2023-10-05T21:15:17.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.934+0000 7f1fc246e700 1 -- 172.21.15.153:0/290222868 learned_addr learned my addr 172.21.15.153:0/290222868 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:17.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.934+0000 7f1fc246e700 1 -- 172.21.15.153:0/290222868 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fbc005cf0 con 0x558640ccf040 2023-10-05T21:15:17.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.934+0000 7f1fc246e700 1 --2- 172.21.15.153:0/290222868 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640ccf040 0x558640d5b950 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc000c00 tx=0x7f1fbc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e28ec3808b99c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.934+0000 7f1fb3fff700 1 -- 172.21.15.153:0/290222868 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fbc0086a0 con 0x558640ccf040 2023-10-05T21:15:17.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.934+0000 7f1fb3fff700 1 -- 172.21.15.153:0/290222868 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fbc008970 con 0x558640ccf040 2023-10-05T21:15:17.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.934+0000 7f1fb3fff700 1 -- 172.21.15.153:0/290222868 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fbc008b20 con 0x558640ccf040 2023-10-05T21:15:17.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.935+0000 7f1fcf396680 1 -- 172.21.15.153:0/290222868 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640ccf040 msgr2=0x558640d5b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:17.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.935+0000 7f1fcf396680 1 --2- 172.21.15.153:0/290222868 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640ccf040 0x558640d5b950 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc000c00 tx=0x7f1fbc015000 comp rx=0 tx=0).stop 2023-10-05T21:15:17.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.935+0000 7f1fcf396680 1 -- 172.21.15.153:0/290222868 shutdown_connections 2023-10-05T21:15:17.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.935+0000 7f1fcf396680 1 --2- 172.21.15.153:0/290222868 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640ccf040 0x558640d5b950 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:17.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.935+0000 7f1fcf396680 1 -- 172.21.15.153:0/290222868 >> 172.21.15.153:0/290222868 conn(0x558640d55b20 msgr2=0x558640d761c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:17.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.935+0000 7f1fcf396680 1 -- 172.21.15.153:0/290222868 shutdown_connections 2023-10-05T21:15:17.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.935+0000 7f1fcf396680 1 -- 172.21.15.153:0/290222868 wait complete. 2023-10-05T21:15:17.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.935+0000 7f1fcf396680 1 Processor -- start 2023-10-05T21:15:17.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.935+0000 7f1fcf396680 1 -- start start 2023-10-05T21:15:17.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.935+0000 7f1fcf396680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640ccf040 0x558640d83c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.935+0000 7f1fcf396680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x558640bffc80 con 0x558640ccf040 2023-10-05T21:15:17.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.935+0000 7f1fc246e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640ccf040 0x558640d83c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.935+0000 7f1fc246e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640ccf040 0x558640d83c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37758/0 (socket says 172.21.15.153:37758) 2023-10-05T21:15:17.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.935+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 learned_addr learned my addr 172.21.15.153:0/225554700 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:17.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.936+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558640d63180 con 0x558640ccf040 2023-10-05T21:15:17.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.936+0000 7f1fc246e700 1 --2- 172.21.15.153:0/225554700 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640ccf040 0x558640d83c20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc00a520 tx=0x7f1fbc01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.936+0000 7f1fb27fc700 1 -- 172.21.15.153:0/225554700 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fbc01d420 con 0x558640ccf040 2023-10-05T21:15:17.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.936+0000 7f1fb27fc700 1 -- 172.21.15.153:0/225554700 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fbc01d580 con 0x558640ccf040 2023-10-05T21:15:17.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.936+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558640d84160 con 0x558640ccf040 2023-10-05T21:15:17.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.936+0000 7f1fb27fc700 1 -- 172.21.15.153:0/225554700 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fbc01d770 con 0x558640ccf040 2023-10-05T21:15:17.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.936+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558640d845d0 con 0x558640ccf040 2023-10-05T21:15:17.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.937+0000 7f1fcf396680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.937+0000 7f1fb27fc700 1 -- 172.21.15.153:0/225554700 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f1fbc01da30 con 0x558640ccf040 2023-10-05T21:15:17.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.937+0000 7f1fb27fc700 1 --2- 172.21.15.153:0/225554700 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1fa40340f0 0x7f1fa40365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.937+0000 7f1fb27fc700 1 -- 172.21.15.153:0/225554700 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f1fbc04a2f0 con 0x558640ccf040 2023-10-05T21:15:17.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.937+0000 7f1fc1c6d700 1 --2- 172.21.15.153:0/225554700 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1fa40340f0 0x7f1fa40365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.937+0000 7f1fcf396680 1 --2- 172.21.15.153:0/225554700 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x558640d5e570 0x558640d8fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.937+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d901c0 con 0x558640d5e570 2023-10-05T21:15:17.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.938+0000 7f1fc2c6f700 1 --2- 172.21.15.153:0/225554700 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x558640d5e570 0x558640d8fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.938+0000 7f1fc1c6d700 1 --2- 172.21.15.153:0/225554700 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1fa40340f0 0x7f1fa40365a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1fb80011e0 tx=0x7f1fb80013a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.938+0000 7f1fc2c6f700 1 --2- 172.21.15.153:0/225554700 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x558640d5e570 0x558640d8fa30 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.938+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.938+0000 7f1fcf396680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.938+0000 7f1fcf396680 20 realm 2023-10-05T21:15:17.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.938+0000 7f1fcf396680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.938+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d8d010 con 0x558640d5e570 2023-10-05T21:15:17.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.938+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.938+0000 7f1fcf396680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.938+0000 7f1fcf396680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:17.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.938+0000 7f1fcf396680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.938+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d90cc0 con 0x558640d5e570 2023-10-05T21:15:17.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.938+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.939+0000 7f1fcf396680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.939+0000 7f1fcf396680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.939+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d90910 con 0x558640d5e570 2023-10-05T21:15:17.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.939+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.939+0000 7f1fcf396680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.939+0000 7f1fcf396680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.939+0000 7f1fcf396680 1 --2- 172.21.15.153:0/225554700 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x558640d92080 0x558640d94460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.939+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d949a0 con 0x558640d92080 2023-10-05T21:15:17.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.939+0000 7f1fc246e700 1 --2- 172.21.15.153:0/225554700 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x558640d92080 0x558640d94460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.939+0000 7f1fc246e700 1 --2- 172.21.15.153:0/225554700 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x558640d92080 0x558640d94460 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.939+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:17.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.939+0000 7f1fcf396680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:17.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.939+0000 7f1fcf396680 20 searching for the correct realm 2023-10-05T21:15:17.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.939+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x558640d92080 2023-10-05T21:15:17.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.940+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:17.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.940+0000 7f1fc246e700 1 --2- 172.21.15.153:0/225554700 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f1fbc048c30 0x7f1fbc0113b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.940+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x7f1fbc048c30 2023-10-05T21:15:17.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.940+0000 7f1fc1c6d700 1 --2- 172.21.15.153:0/225554700 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f1fbc048c30 0x7f1fbc0113b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.940+0000 7f1fc1c6d700 1 --2- 172.21.15.153:0/225554700 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f1fbc048c30 0x7f1fbc0113b0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.940+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb8006070 con 0x7f1fbc048c30 2023-10-05T21:15:17.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.940+0000 7f1fc1c6d700 1 --2- 172.21.15.153:0/225554700 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f1fb800d8e0 0x7f1fb800c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:17.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.940+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x7f1fb800d8e0 2023-10-05T21:15:17.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.941+0000 7f1fc2c6f700 1 --2- 172.21.15.153:0/225554700 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f1fb800d8e0 0x7f1fb800c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:17.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.941+0000 7f1fc2c6f700 1 --2- 172.21.15.153:0/225554700 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f1fb800d8e0 0x7f1fb800c360 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:17.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.941+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb400a570 con 0x7f1fb800d8e0 2023-10-05T21:15:17.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.941+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x558640d5e570 2023-10-05T21:15:17.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.941+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.941+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x558640d5e570 2023-10-05T21:15:17.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.942+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.942+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x7f1fb800d8e0 2023-10-05T21:15:17.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.942+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb400a570 con 0x7f1fb800d8e0 2023-10-05T21:15:17.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.942+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x7f1fb800d8e0 2023-10-05T21:15:17.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.942+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb400a570 con 0x7f1fb800d8e0 2023-10-05T21:15:17.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.942+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x7f1fbc048c30 2023-10-05T21:15:17.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.942+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb8006070 con 0x7f1fbc048c30 2023-10-05T21:15:17.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.942+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x558640d92080 2023-10-05T21:15:17.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.942+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:17.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.942+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x558640d5e570 2023-10-05T21:15:17.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.943+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.943+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x7f1fb800d8e0 2023-10-05T21:15:17.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.943+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb400a570 con 0x7f1fb800d8e0 2023-10-05T21:15:17.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.943+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x558640d5e570 2023-10-05T21:15:17.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.943+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.943+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x7f1fbc048c30 2023-10-05T21:15:17.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.943+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb8006070 con 0x7f1fbc048c30 2023-10-05T21:15:17.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.943+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x558640d92080 2023-10-05T21:15:17.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.944+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:17.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.944+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x558640d92080 2023-10-05T21:15:17.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.944+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:17.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.944+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x7f1fb800d8e0 2023-10-05T21:15:17.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.944+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb400a570 con 0x7f1fb800d8e0 2023-10-05T21:15:17.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.944+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x558640d92080 2023-10-05T21:15:17.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.944+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:17.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.944+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x558640d92080 2023-10-05T21:15:17.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.944+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:17.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.944+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x558640d5e570 2023-10-05T21:15:17.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.945+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.945+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x558640d5e570 2023-10-05T21:15:17.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.945+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.945+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x7f1fb800d8e0 2023-10-05T21:15:17.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.945+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb400a570 con 0x7f1fb800d8e0 2023-10-05T21:15:17.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.945+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x558640d92080 2023-10-05T21:15:17.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.945+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:17.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.945+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x7f1fbc048c30 2023-10-05T21:15:17.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.945+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb8006070 con 0x7f1fbc048c30 2023-10-05T21:15:17.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.945+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x558640d5e570 2023-10-05T21:15:17.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.946+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.946+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x7f1fb800d8e0 2023-10-05T21:15:17.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.946+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb400a570 con 0x7f1fb800d8e0 2023-10-05T21:15:17.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.946+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x558640d92080 2023-10-05T21:15:17.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.946+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:17.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.946+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x7f1fb800d8e0 2023-10-05T21:15:17.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.946+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb400a570 con 0x7f1fb800d8e0 2023-10-05T21:15:17.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.946+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x7f1fbc048c30 2023-10-05T21:15:17.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.947+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb8006070 con 0x7f1fbc048c30 2023-10-05T21:15:17.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.947+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x558640d92080 2023-10-05T21:15:17.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.947+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:17.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.947+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x7f1fb800d8e0 2023-10-05T21:15:17.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.947+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb400a570 con 0x7f1fb800d8e0 2023-10-05T21:15:17.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.947+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x558640d5e570 2023-10-05T21:15:17.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.947+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.947+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96410 con 0x7f1fbc048c30 2023-10-05T21:15:17.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.947+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb8006070 con 0x7f1fbc048c30 2023-10-05T21:15:17.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.948+0000 7f1fcf396680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:17.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.948+0000 7f1fcf396680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:17.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.948+0000 7f1fcf396680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:17.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.948+0000 7f1fcf396680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:17.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.948+0000 7f1fcf396680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.948+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d95330 con 0x558640d5e570 2023-10-05T21:15:17.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.948+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.948+0000 7f1fcf396680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.948+0000 7f1fcf396680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.948+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d95730 con 0x558640d5e570 2023-10-05T21:15:17.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.948+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.948+0000 7f1fcf396680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.948+0000 7f1fcf396680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.948+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d968a0 con 0x558640d5e570 2023-10-05T21:15:17.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.948+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.948+0000 7f1fcf396680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:17.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.948+0000 7f1fcf396680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.948+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d96c50 con 0x558640d92080 2023-10-05T21:15:17.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.948+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:17.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.948+0000 7f1fcf396680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.948+0000 7f1fcf396680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.948+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d97000 con 0x558640d5e570 2023-10-05T21:15:17.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.949+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.949+0000 7f1fcf396680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.949+0000 7f1fcf396680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.949+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d97000 con 0x558640d5e570 2023-10-05T21:15:17.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.949+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.949+0000 7f1fcf396680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.949+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d97000 con 0x558640d92080 2023-10-05T21:15:17.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.949+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:17.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.949+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d97000 con 0x7f1fbc048c30 2023-10-05T21:15:17.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.949+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb8006070 con 0x7f1fbc048c30 2023-10-05T21:15:17.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.949+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d97000 con 0x7f1fb800d8e0 2023-10-05T21:15:17.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.950+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb400a570 con 0x7f1fb800d8e0 2023-10-05T21:15:17.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.950+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d968a0 con 0x558640d5e570 2023-10-05T21:15:17.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.950+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.950+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d968a0 con 0x558640d5e570 2023-10-05T21:15:17.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.950+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.950+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d968a0 con 0x7f1fb800d8e0 2023-10-05T21:15:17.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.950+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb400a570 con 0x7f1fb800d8e0 2023-10-05T21:15:17.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.950+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d968a0 con 0x7f1fb800d8e0 2023-10-05T21:15:17.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.950+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb400a570 con 0x7f1fb800d8e0 2023-10-05T21:15:17.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.950+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d968a0 con 0x7f1fbc048c30 2023-10-05T21:15:17.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.951+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb8006070 con 0x7f1fbc048c30 2023-10-05T21:15:17.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.951+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d968a0 con 0x558640d92080 2023-10-05T21:15:17.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.951+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:17.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.951+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d968a0 con 0x558640d5e570 2023-10-05T21:15:17.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.951+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.951+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d968a0 con 0x7f1fb800d8e0 2023-10-05T21:15:17.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.951+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb400a570 con 0x7f1fb800d8e0 2023-10-05T21:15:17.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.951+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d968a0 con 0x558640d5e570 2023-10-05T21:15:17.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.952+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.952+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d968a0 con 0x7f1fbc048c30 2023-10-05T21:15:17.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.952+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb8006070 con 0x7f1fbc048c30 2023-10-05T21:15:17.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.952+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d968a0 con 0x558640d92080 2023-10-05T21:15:17.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.952+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:17.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.952+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d968a0 con 0x558640d92080 2023-10-05T21:15:17.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.952+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:17.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.952+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d968a0 con 0x7f1fb800d8e0 2023-10-05T21:15:17.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.952+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb400a570 con 0x7f1fb800d8e0 2023-10-05T21:15:17.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.952+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d968a0 con 0x558640d92080 2023-10-05T21:15:17.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.953+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:17.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.953+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d968a0 con 0x558640d92080 2023-10-05T21:15:17.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.953+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:17.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.953+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d968a0 con 0x558640d5e570 2023-10-05T21:15:17.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.953+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.953+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d968a0 con 0x558640d5e570 2023-10-05T21:15:17.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.953+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.953+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d968a0 con 0x7f1fb800d8e0 2023-10-05T21:15:17.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.953+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb400a570 con 0x7f1fb800d8e0 2023-10-05T21:15:17.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.953+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d968a0 con 0x558640d92080 2023-10-05T21:15:17.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.954+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:17.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.954+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d968a0 con 0x7f1fbc048c30 2023-10-05T21:15:17.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.954+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb8006070 con 0x7f1fbc048c30 2023-10-05T21:15:17.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.954+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d968a0 con 0x558640d5e570 2023-10-05T21:15:17.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.954+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.954+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d968a0 con 0x7f1fb800d8e0 2023-10-05T21:15:17.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.954+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb400a570 con 0x7f1fb800d8e0 2023-10-05T21:15:17.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.954+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d968a0 con 0x558640d92080 2023-10-05T21:15:17.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.955+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:17.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.955+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d968a0 con 0x7f1fb800d8e0 2023-10-05T21:15:17.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.955+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb400a570 con 0x7f1fb800d8e0 2023-10-05T21:15:17.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.955+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d968a0 con 0x7f1fbc048c30 2023-10-05T21:15:17.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.955+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb8006070 con 0x7f1fbc048c30 2023-10-05T21:15:17.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.955+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d968a0 con 0x558640d92080 2023-10-05T21:15:17.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.955+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:17.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.955+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d968a0 con 0x7f1fb800d8e0 2023-10-05T21:15:17.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.955+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb400a570 con 0x7f1fb800d8e0 2023-10-05T21:15:17.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.955+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d968a0 con 0x558640d5e570 2023-10-05T21:15:17.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.956+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.956+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d968a0 con 0x7f1fbc048c30 2023-10-05T21:15:17.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.956+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1fb8006070 con 0x7f1fbc048c30 2023-10-05T21:15:17.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.956+0000 7f1fcf396680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:17.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.956+0000 7f1fcf396680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:17.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.956+0000 7f1fcf396680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:17.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.956+0000 7f1fcf396680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:17.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.956+0000 7f1fcf396680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.956+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d97000 con 0x558640d5e570 2023-10-05T21:15:17.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.956+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.956+0000 7f1fcf396680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.956+0000 7f1fcf396680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.956+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d97400 con 0x558640d92080 2023-10-05T21:15:17.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.956+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:17.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.956+0000 7f1fcf396680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:17.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.957+0000 7f1fcf396680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.957+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d97cf0 con 0x558640d5e570 2023-10-05T21:15:17.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.957+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.957+0000 7f1fcf396680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:17.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.957+0000 7f1fcf396680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.957+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d97cf0 con 0x558640d5e570 2023-10-05T21:15:17.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.957+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.957+0000 7f1fcf396680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:17.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.957+0000 7f1fcf396680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.957+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d98120 con 0x7f1fb800d8e0 2023-10-05T21:15:17.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.957+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f1fb400a570 con 0x7f1fb800d8e0 2023-10-05T21:15:17.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.957+0000 7f1fcf396680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.957+0000 7f1fcf396680 20 zone default found 2023-10-05T21:15:17.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.957+0000 7f1fcf396680 4 Realm: () 2023-10-05T21:15:17.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.957+0000 7f1fcf396680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:17.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.957+0000 7f1fcf396680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:17.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.957+0000 7f1fcf396680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:17.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.957+0000 7f1fcf396680 20 zonegroup default 2023-10-05T21:15:17.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.957+0000 7f1fcf396680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.957+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d97df0 con 0x7f1fb800d8e0 2023-10-05T21:15:17.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.957+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1fb400a570 con 0x7f1fb800d8e0 2023-10-05T21:15:17.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.957+0000 7f1fcf396680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.957+0000 7f1fcf396680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.957+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d99770 con 0x558640d92080 2023-10-05T21:15:17.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.958+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:17.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.958+0000 7f1fcf396680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.958+0000 7f1fcf396680 20 rados->read ofs=0 len=0 2023-10-05T21:15:17.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.958+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d99b20 con 0x558640d92080 2023-10-05T21:15:17.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.958+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:17.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.958+0000 7f1fcf396680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:17.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.958+0000 7f1fcf396680 20 started sync module instance, tier type = 2023-10-05T21:15:17.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.958+0000 7f1fcf396680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:17.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.958+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d98e80 con 0x7f1fbc048c30 2023-10-05T21:15:17.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.959+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fb8006070 con 0x7f1fbc048c30 2023-10-05T21:15:17.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.959+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94035101979264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d9a410 con 0x7f1fbc048c30 2023-10-05T21:15:17.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.959+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d9acb0 con 0x558640d5e570 2023-10-05T21:15:17.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.959+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94035101979264] v29'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fb8006070 con 0x7f1fbc048c30 2023-10-05T21:15:17.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.960+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.960+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94035101982496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d9acf0 con 0x558640d5e570 2023-10-05T21:15:17.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.960+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d9b8b0 con 0x558640d92080 2023-10-05T21:15:17.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.961+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94035101982496] v29'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.961+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:17.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.961+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94035101984704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d9bcb0 con 0x558640d92080 2023-10-05T21:15:17.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.961+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d9c6c0 con 0x7f1fbc048c30 2023-10-05T21:15:17.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.962+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fb8006070 con 0x7f1fbc048c30 2023-10-05T21:15:17.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.962+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94035101991376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d9cf60 con 0x7f1fbc048c30 2023-10-05T21:15:17.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.962+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d9d970 con 0x558640d5e570 2023-10-05T21:15:17.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.963+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94035101984704] v29'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:17.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.963+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94035101991376] v29'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fb8006070 con 0x7f1fbc048c30 2023-10-05T21:15:17.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.963+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.964+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94035101987712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d9d970 con 0x558640d5e570 2023-10-05T21:15:17.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.964+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d9e260 con 0x7f1fb800d8e0 2023-10-05T21:15:17.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.965+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94035101987712] v29'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:17.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.965+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fb400a570 con 0x7f1fb800d8e0 2023-10-05T21:15:17.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.965+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94035101996720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d9e0b0 con 0x7f1fb800d8e0 2023-10-05T21:15:17.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.965+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d9ecb0 con 0x7f1fb800d8e0 2023-10-05T21:15:17.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.966+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94035101996720] v29'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fb400a570 con 0x7f1fb800d8e0 2023-10-05T21:15:17.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.966+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fb400a570 con 0x7f1fb800d8e0 2023-10-05T21:15:17.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.966+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94035102000960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d9ec70 con 0x7f1fb800d8e0 2023-10-05T21:15:17.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.966+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d9f740 con 0x7f1fb800d8e0 2023-10-05T21:15:18.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.967+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94035102000960] v29'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fb400a570 con 0x7f1fb800d8e0 2023-10-05T21:15:18.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.967+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fb400a570 con 0x7f1fb800d8e0 2023-10-05T21:15:18.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.967+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94035102003696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d9f700 con 0x7f1fb800d8e0 2023-10-05T21:15:18.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.967+0000 7f1fcf396680 20 add_watcher() i=0 2023-10-05T21:15:18.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.967+0000 7f1fcf396680 20 add_watcher() i=1 2023-10-05T21:15:18.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.967+0000 7f1fcf396680 20 add_watcher() i=2 2023-10-05T21:15:18.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.967+0000 7f1fcf396680 20 add_watcher() i=3 2023-10-05T21:15:18.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.967+0000 7f1fcf396680 20 add_watcher() i=4 2023-10-05T21:15:18.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.967+0000 7f1fcf396680 20 add_watcher() i=5 2023-10-05T21:15:18.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.967+0000 7f1fcf396680 20 add_watcher() i=6 2023-10-05T21:15:18.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.968+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94035102003696] v29'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fb400a570 con 0x7f1fb800d8e0 2023-10-05T21:15:18.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.968+0000 7f1fcf396680 20 add_watcher() i=7 2023-10-05T21:15:18.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.968+0000 7f1fcf396680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:18.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.968+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640da2b10 con 0x558640d5e570 2023-10-05T21:15:18.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.968+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:18.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.968+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94035101997824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640da0000 con 0x558640d5e570 2023-10-05T21:15:18.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.969+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94035101997824] v29'128 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1fb400a570 con 0x558640d5e570 2023-10-05T21:15:18.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.969+0000 7f1f93fdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:18.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.969+0000 7f1fcf396680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:18.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.969+0000 7f1fcf396680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:18.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.969+0000 7f1fcf396680 1 Processor -- start 2023-10-05T21:15:18.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.969+0000 7f1fcf396680 1 -- start start 2023-10-05T21:15:18.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.969+0000 7f1fcf396680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640dac780 0x558640dacb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.970+0000 7f1fcf396680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x558640dad1a0 con 0x558640dac780 2023-10-05T21:15:18.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.970+0000 7f1fc1c6d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640dac780 0x558640dacb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.970+0000 7f1fc1c6d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640dac780 0x558640dacb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37764/0 (socket says 172.21.15.153:37764) 2023-10-05T21:15:18.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.970+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/2073730817 learned_addr learned my addr 172.21.15.153:0/2073730817 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:18.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.970+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/2073730817 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558640dad680 con 0x558640dac780 2023-10-05T21:15:18.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.970+0000 7f1fc1c6d700 1 --2- 172.21.15.153:0/2073730817 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640dac780 0x558640dacb90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x558640d94de0 tx=0x7f1fb8006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbdc06bf251163de server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.970+0000 7f1f937de700 1 -- 172.21.15.153:0/2073730817 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fb8023040 con 0x558640dac780 2023-10-05T21:15:18.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.970+0000 7f1f937de700 1 -- 172.21.15.153:0/2073730817 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb8024040 con 0x558640dac780 2023-10-05T21:15:18.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.970+0000 7f1f937de700 1 -- 172.21.15.153:0/2073730817 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fb8013040 con 0x558640dac780 2023-10-05T21:15:18.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.971+0000 7f1fcf396680 1 -- 172.21.15.153:0/2073730817 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640dac780 msgr2=0x558640dacb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.971+0000 7f1fcf396680 1 --2- 172.21.15.153:0/2073730817 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640dac780 0x558640dacb90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x558640d94de0 tx=0x7f1fb8006000 comp rx=0 tx=0).stop 2023-10-05T21:15:18.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.971+0000 7f1fcf396680 1 -- 172.21.15.153:0/2073730817 shutdown_connections 2023-10-05T21:15:18.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.971+0000 7f1fcf396680 1 --2- 172.21.15.153:0/2073730817 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640dac780 0x558640dacb90 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.971+0000 7f1fcf396680 1 -- 172.21.15.153:0/2073730817 >> 172.21.15.153:0/2073730817 conn(0x558640da8a80 msgr2=0x558640da6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.971+0000 7f1fcf396680 1 -- 172.21.15.153:0/2073730817 shutdown_connections 2023-10-05T21:15:18.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.971+0000 7f1fcf396680 1 -- 172.21.15.153:0/2073730817 wait complete. 2023-10-05T21:15:18.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.971+0000 7f1fcf396680 1 Processor -- start 2023-10-05T21:15:18.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.972+0000 7f1fcf396680 1 -- start start 2023-10-05T21:15:18.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.972+0000 7f1fcf396680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640dac780 0x558640db3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.972+0000 7f1fcf396680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x558640db3a40 con 0x558640dac780 2023-10-05T21:15:18.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.972+0000 7f1fc1c6d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640dac780 0x558640db3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.972+0000 7f1fc1c6d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640dac780 0x558640db3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37768/0 (socket says 172.21.15.153:37768) 2023-10-05T21:15:18.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.972+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/1318219625 learned_addr learned my addr 172.21.15.153:0/1318219625 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:18.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.972+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/1318219625 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb800ed20 con 0x558640dac780 2023-10-05T21:15:18.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.972+0000 7f1fc1c6d700 1 --2- 172.21.15.153:0/1318219625 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640dac780 0x558640db3500 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1fb800dfd0 tx=0x7f1fb8030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.973+0000 7f1f91fdb700 1 -- 172.21.15.153:0/1318219625 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fb8023040 con 0x558640dac780 2023-10-05T21:15:18.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.973+0000 7f1f91fdb700 1 -- 172.21.15.153:0/1318219625 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb803a4f0 con 0x558640dac780 2023-10-05T21:15:18.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.973+0000 7f1fcf396680 1 -- 172.21.15.153:0/1318219625 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558640db3c40 con 0x558640dac780 2023-10-05T21:15:18.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.973+0000 7f1f91fdb700 1 -- 172.21.15.153:0/1318219625 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fb803a6a0 con 0x558640dac780 2023-10-05T21:15:18.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.973+0000 7f1fcf396680 1 -- 172.21.15.153:0/1318219625 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558640db4090 con 0x558640dac780 2023-10-05T21:15:18.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.973+0000 7f1f91fdb700 1 -- 172.21.15.153:0/1318219625 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f1fb803a800 con 0x558640dac780 2023-10-05T21:15:18.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.974+0000 7f1f91fdb700 1 --2- 172.21.15.153:0/1318219625 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1f08034140 0x7f1f080365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.974+0000 7f1f91fdb700 1 -- 172.21.15.153:0/1318219625 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f1fb804fb00 con 0x558640dac780 2023-10-05T21:15:18.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.974+0000 7f1fc2c6f700 1 --2- 172.21.15.153:0/1318219625 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1f08034140 0x7f1f080365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.974+0000 7f1fcf396680 5 note: GC not initialized 2023-10-05T21:15:18.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.974+0000 7f1fc2c6f700 1 --2- 172.21.15.153:0/1318219625 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1f08034140 0x7f1f080365f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x558640d9f9d0 tx=0x7f1fb4037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.975+0000 7f1f02ffd700 20 reqs_thread_entry: start 2023-10-05T21:15:18.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.975+0000 7f1f00ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:18.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.975+0000 7f1fcf396680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:18.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.975+0000 7f1fcf396680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:18.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.975+0000 7f1ef2ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:48 2023 2023-10-05T21:15:18.016 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:18.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.975+0000 7f1ef27fc700 20 reqs_thread_entry: start 2023-10-05T21:15:18.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.975+0000 7f1fcf396680 20 get_system_obj_state: rctx=0x7ffc71b95308 obj=default.rgw.meta:users.uid:testx$tenanteduser state=0x558640c0e240 s->prefetch_data=0 2023-10-05T21:15:18.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.975+0000 7f1fcf396680 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2023-10-05T21:15:18.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.975+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640e18dc0 con 0x7f1fb800d8e0 2023-10-05T21:15:18.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.976+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(102 testx$tenanteduser [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 246+0+139 (crc 0 0 0) 0x7f1fb400a570 con 0x7f1fb800d8e0 2023-10-05T21:15:18.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.976+0000 7f1fcf396680 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x16 2023-10-05T21:15:18.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.976+0000 7f1fcf396680 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2023-10-05T21:15:18.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.976+0000 7f1fcf396680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:18.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.976+0000 7f1fcf396680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:18.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.976+0000 7f1fcf396680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:18.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.976+0000 7f1fcf396680 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:18.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.976+0000 7f1fcf396680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.976+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:103 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640e1b560 con 0x7f1fb800d8e0 2023-10-05T21:15:18.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.976+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(103 testx$tenanteduser [call,call out=48b,read 0~385 out=385b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 288+0+508 (crc 0 0 0) 0x7f1fb400a570 con 0x7f1fb800d8e0 2023-10-05T21:15:18.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.976+0000 7f1fcf396680 20 rados_obj.operate() r=0 bl.length=385 2023-10-05T21:15:18.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.976+0000 7f1fcf396680 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2023-10-05T21:15:18.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.976+0000 7f1fcf396680 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2023-10-05T21:15:18.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.976+0000 7f1fcf396680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:18.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.976+0000 7f1fcf396680 20 get_system_obj_state: rctx=0x7ffc71b94710 obj=default.rgw.meta:root:myfoo state=0x558640c0e240 s->prefetch_data=0 2023-10-05T21:15:18.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.976+0000 7f1fcf396680 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-10-05T21:15:18.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.976+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:104 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640e1a100 con 0x7f1fbc048c30 2023-10-05T21:15:18.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.977+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(104 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv23 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f1fb8006070 con 0x7f1fbc048c30 2023-10-05T21:15:18.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.977+0000 7f1fcf396680 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x16 2023-10-05T21:15:18.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.977+0000 7f1fcf396680 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:18.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.977+0000 7f1fcf396680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:18.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.977+0000 7f1fcf396680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:18.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.977+0000 7f1fcf396680 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x11, cached=0x16) 2023-10-05T21:15:18.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.977+0000 7f1fcf396680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.977+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640e1dbc0 con 0x7f1fbc048c30 2023-10-05T21:15:18.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.977+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(105 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7f1fb8006070 con 0x7f1fbc048c30 2023-10-05T21:15:18.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.977+0000 7f1fcf396680 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T21:15:18.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.977+0000 7f1fcf396680 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2023-10-05T21:15:18.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.977+0000 7f1fcf396680 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:18.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.977+0000 7f1fcf396680 20 get_system_obj_state: rctx=0x7ffc71b94710 obj=default.rgw.meta:root:.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 state=0x558640c0e500 s->prefetch_data=0 2023-10-05T21:15:18.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.977+0000 7f1fcf396680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 : miss 2023-10-05T21:15:18.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.977+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:106 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640e1d4b0 con 0x558640d92080 2023-10-05T21:15:18.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.977+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(106 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:18.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.977+0000 7f1fcf396680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 info.flags=0x16 2023-10-05T21:15:18.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.977+0000 7f1fcf396680 10 adding default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 to cache LRU end 2023-10-05T21:15:18.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.977+0000 7f1fcf396680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:18.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.977+0000 7f1fcf396680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:18.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.977+0000 7f1fcf396680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:18.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.977+0000 7f1fcf396680 20 Read xattr: user.rgw.acl 2023-10-05T21:15:18.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.977+0000 7f1fcf396680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:18.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.977+0000 7f1fcf396680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:18.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.977+0000 7f1fcf396680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.977+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640e20120 con 0x558640d92080 2023-10-05T21:15:18.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.978+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(107 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:18.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.978+0000 7f1fcf396680 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T21:15:18.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.978+0000 7f1fcf396680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 info.flags=0x13 2023-10-05T21:15:18.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.978+0000 7f1fcf396680 10 moving default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 to cache LRU end 2023-10-05T21:15:18.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.978+0000 7f1fcf396680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:18.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.978+0000 7f1fcf396680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:18.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.978+0000 7f1fcf396680 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 2023-10-05T21:15:18.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.978+0000 7f1fcf396680 20 get_system_obj_state: rctx=0x7ffc71b94698 obj=default.rgw.meta:users.uid:testx$tenanteduser state=0x558640c0e500 s->prefetch_data=0 2023-10-05T21:15:18.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.978+0000 7f1fcf396680 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : type miss (requested=0x16, cached=0x13) 2023-10-05T21:15:18.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.978+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:108 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640e20850 con 0x7f1fb800d8e0 2023-10-05T21:15:18.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.978+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(108 testx$tenanteduser [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 246+0+139 (crc 0 0 0) 0x7f1fb4055040 con 0x7f1fb800d8e0 2023-10-05T21:15:18.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.978+0000 7f1fcf396680 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x16 2023-10-05T21:15:18.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.978+0000 7f1fcf396680 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2023-10-05T21:15:18.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.978+0000 7f1fcf396680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:18.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.978+0000 7f1fcf396680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:18.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.978+0000 7f1fcf396680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:18.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.978+0000 7f1fcf396680 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x17) 2023-10-05T21:15:18.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.978+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:109 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640e23090 con 0x7f1fbc048c30 2023-10-05T21:15:18.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.979+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(109 foo.buckets [call] v29'24 uv24 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f1fb8006070 con 0x7f1fbc048c30 2023-10-05T21:15:18.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.979+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:110 8.16 8:6f41a5b8:root::.bucket.meta.testx%3amyfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [create,call version.inc in=38b,writefull 0~371 in=371b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640e265b0 con 0x558640d92080 2023-10-05T21:15:18.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.980+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(110 .bucket.meta.testx:myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [create,call,writefull 0~371,setxattr (203)] v29'1 uv1 ondisk = 0) v8 ==== 338+0+0 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:18.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.980+0000 7f1fcf396680 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 info.flags=0x7 2023-10-05T21:15:18.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.980+0000 7f1fcf396680 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 to cache LRU end 2023-10-05T21:15:18.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.980+0000 7f1fcf396680 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T21:15:18.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.980+0000 7f1fcf396680 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1, ofs0, ns] 2023-10-05T21:15:18.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.980+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:111 7.0 7:05bf5b68:::notify.1:head [notify cookie 94035102548352 in=818b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640e25e70 con 0x558640d5e570 2023-10-05T21:15:18.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.980+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== watch-notify(notify (1) cookie 94035101982496 notify 124554051598 ret 0) v3 ==== 848+0+0 (crc 0 0 0) 0x7f1fb402d040 con 0x558640d5e570 2023-10-05T21:15:18.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.980+0000 7f1fb3fff700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051598 cookie 94035101982496 notifier 4490 bl.length()=806 2023-10-05T21:15:18.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.980+0000 7f1fb3fff700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 info.flags=0x7 2023-10-05T21:15:18.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.980+0000 7f1fb3fff700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 to cache LRU end 2023-10-05T21:15:18.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.980+0000 7f1fb3fff700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T21:15:18.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.980+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(111 notify.1 [notify cookie 94035102548352 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1fb4055040 con 0x558640d5e570 2023-10-05T21:15:18.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.980+0000 7f1fb3fff700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:112 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f1fa8003d90 con 0x558640d5e570 2023-10-05T21:15:18.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.980+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(112 notify.1 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fb4055040 con 0x558640d5e570 2023-10-05T21:15:18.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.981+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== watch-notify(notify_complete (2) cookie 94035102548352 notify 124554051598 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f1fb4037640 con 0x558640d5e570 2023-10-05T21:15:18.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.981+0000 7f1fcf396680 20 handle_bi_update(): bucket=testx:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1]): orig_sources= new_sources= 2023-10-05T21:15:18.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.981+0000 7f1fcf396680 20 handle_bi_update(): bucket=testx:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1]): potential sources added=[] removed=[] 2023-10-05T21:15:18.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.981+0000 7f1fcf396680 20 handle_bi_update(): bucket=testx:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1]): orig_dests= new_dests= 2023-10-05T21:15:18.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.981+0000 7f1fcf396680 20 handle_bi_update(): bucket=testx:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1]): potential dests added=[] removed=[] 2023-10-05T21:15:18.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.981+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:113 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640e25cf0 con 0x558640d5e570 2023-10-05T21:15:18.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.981+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(113 testx$tenanteduser.buckets [call] v29'1 uv1 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7f1fb4055040 con 0x558640d5e570 2023-10-05T21:15:18.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.982+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:114 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640e257c0 con 0x558640d5e570 2023-10-05T21:15:18.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.982+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(114 testx/myfoo [delete,create,call,writefull 0~193] v29'1 uv1 ondisk = 0) v8 ==== 281+0+0 (crc 0 0 0) 0x7f1fb4055040 con 0x558640d5e570 2023-10-05T21:15:18.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.982+0000 7f1fcf396680 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2023-10-05T21:15:18.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.982+0000 7f1fcf396680 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2023-10-05T21:15:18.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.982+0000 7f1fcf396680 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2023-10-05T21:15:18.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.982+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:115 7.d 7:b4812045:::notify.4:head [notify cookie 94035102555664 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640e26d30 con 0x558640d5e570 2023-10-05T21:15:18.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.982+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== watch-notify(notify (1) cookie 94035101987712 notify 124554051599 ret 0) v3 ==== 390+0+0 (crc 0 0 0) 0x7f1fb4029040 con 0x558640d5e570 2023-10-05T21:15:18.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.983+0000 7f1fb37fe700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051599 cookie 94035101987712 notifier 4490 bl.length()=348 2023-10-05T21:15:18.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.983+0000 7f1fb37fe700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2023-10-05T21:15:18.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.983+0000 7f1fb37fe700 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2023-10-05T21:15:18.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.983+0000 7f1fb37fe700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:116 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f1f10003410 con 0x558640d5e570 2023-10-05T21:15:18.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.983+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 42 ==== osd_op_reply(115 notify.4 [notify cookie 94035102555664 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1fb4055040 con 0x558640d5e570 2023-10-05T21:15:18.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.983+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 43 ==== osd_op_reply(116 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fb4055040 con 0x558640d5e570 2023-10-05T21:15:18.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.983+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 44 ==== watch-notify(notify_complete (2) cookie 94035102555664 notify 124554051599 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f1fb4037dc0 con 0x558640d5e570 2023-10-05T21:15:18.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.983+0000 7f1fcf396680 10 removing default.rgw.meta+root+myfoo from cache 2023-10-05T21:15:18.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.983+0000 7f1fcf396680 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2023-10-05T21:15:18.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.983+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:117 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94035102555664 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640e23660 con 0x7f1fb800d8e0 2023-10-05T21:15:18.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.983+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== watch-notify(notify (1) cookie 94035102000960 notify 124554051601 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x7f1fb4037dc0 con 0x7f1fb800d8e0 2023-10-05T21:15:18.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.983+0000 7f1fb3fff700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051601 cookie 94035102000960 notifier 4490 bl.length()=149 2023-10-05T21:15:18.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.983+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 31 ==== osd_op_reply(117 notify.6 [notify cookie 94035102555664 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1fb4055040 con 0x7f1fb800d8e0 2023-10-05T21:15:18.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.983+0000 7f1fb3fff700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:118 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f1fa8003d90 con 0x7f1fb800d8e0 2023-10-05T21:15:18.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.983+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 32 ==== osd_op_reply(118 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fb4055040 con 0x7f1fb800d8e0 2023-10-05T21:15:18.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.984+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 33 ==== watch-notify(notify_complete (2) cookie 94035102555664 notify 124554051601 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f1fb4051470 con 0x7f1fb800d8e0 2023-10-05T21:15:18.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.984+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:119 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640e25e10 con 0x7f1fbc048c30 2023-10-05T21:15:18.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.985+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(119 myfoo [call,delete] v29'25 uv25 ondisk = 0) v8 ==== 191+0+0 (crc 0 0 0) 0x7f1fb8006070 con 0x7f1fbc048c30 2023-10-05T21:15:18.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.985+0000 7f1fcf396680 10 removing default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 from cache 2023-10-05T21:15:18.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.985+0000 7f1fcf396680 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1, ofs0, ns] 2023-10-05T21:15:18.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.985+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:120 7.15 7:a93a5511:::notify.2:head [notify cookie 94035102555664 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640e22080 con 0x558640d92080 2023-10-05T21:15:18.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.985+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== watch-notify(notify (1) cookie 94035101984704 notify 124554051592 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x558640d845d0 con 0x558640d92080 2023-10-05T21:15:18.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.985+0000 7f1fb3fff700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051592 cookie 94035101984704 notifier 4490 bl.length()=206 2023-10-05T21:15:18.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.985+0000 7f1fb3fff700 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:121 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f1fa8003d90 con 0x558640d92080 2023-10-05T21:15:18.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.985+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(120 notify.2 [notify cookie 94035102555664 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:18.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.985+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 31 ==== osd_op_reply(121 notify.2 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:18.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.985+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 32 ==== watch-notify(notify_complete (2) cookie 94035102555664 notify 124554051592 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x558640d84160 con 0x558640d92080 2023-10-05T21:15:18.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.986+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:122 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640e25e10 con 0x558640d92080 2023-10-05T21:15:18.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.986+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 33 ==== osd_op_reply(122 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call,delete] v29'4 uv4 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:18.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.986+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:123 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94035101979264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640e1dfa0 con 0x7f1fbc048c30 2023-10-05T21:15:18.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.987+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== osd_op_reply(123 notify.0 [watch unwatch cookie 94035101979264] v29'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fb8006070 con 0x7f1fbc048c30 2023-10-05T21:15:18.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.987+0000 7f1fcf396680 20 remove_watcher() i=0 2023-10-05T21:15:18.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.987+0000 7f1fcf396680 2 removed watcher, disabling cache 2023-10-05T21:15:18.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.987+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:124 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94035101982496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d99280 con 0x558640d5e570 2023-10-05T21:15:18.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.988+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 45 ==== osd_op_reply(124 notify.1 [watch unwatch cookie 94035101982496] v29'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fb4055040 con 0x558640d5e570 2023-10-05T21:15:18.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.988+0000 7f1fcf396680 20 remove_watcher() i=1 2023-10-05T21:15:18.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.988+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:125 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94035101984704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d99280 con 0x558640d92080 2023-10-05T21:15:18.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.989+0000 7f1fc246e700 1 -- 172.21.15.153:0/225554700 <== osd.3 v2:172.21.15.153:6800/140455 34 ==== osd_op_reply(125 notify.2 [watch unwatch cookie 94035101984704] v29'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fbc036070 con 0x558640d92080 2023-10-05T21:15:18.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.989+0000 7f1fcf396680 20 remove_watcher() i=2 2023-10-05T21:15:18.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.989+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:126 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94035101991376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d99280 con 0x7f1fbc048c30 2023-10-05T21:15:18.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.989+0000 7f1fc1c6d700 1 -- 172.21.15.153:0/225554700 <== osd.2 v2:172.21.15.153:6807/140454 22 ==== osd_op_reply(126 notify.3 [watch unwatch cookie 94035101991376] v29'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fb8006070 con 0x7f1fbc048c30 2023-10-05T21:15:18.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.990+0000 7f1fcf396680 20 remove_watcher() i=3 2023-10-05T21:15:18.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.990+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:127 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94035101987712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d99280 con 0x558640d5e570 2023-10-05T21:15:18.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.990+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 46 ==== osd_op_reply(127 notify.4 [watch unwatch cookie 94035101987712] v29'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fb4055040 con 0x558640d5e570 2023-10-05T21:15:18.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.990+0000 7f1fcf396680 20 remove_watcher() i=4 2023-10-05T21:15:18.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.990+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:128 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94035101996720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d99280 con 0x7f1fb800d8e0 2023-10-05T21:15:18.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.991+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 34 ==== osd_op_reply(128 notify.5 [watch unwatch cookie 94035101996720] v29'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fb4055040 con 0x7f1fb800d8e0 2023-10-05T21:15:18.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.991+0000 7f1fcf396680 20 remove_watcher() i=5 2023-10-05T21:15:18.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.991+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:129 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94035102000960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d9d6b0 con 0x7f1fb800d8e0 2023-10-05T21:15:18.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.992+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 35 ==== osd_op_reply(129 notify.6 [watch unwatch cookie 94035102000960] v29'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fb4055040 con 0x7f1fb800d8e0 2023-10-05T21:15:18.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.992+0000 7f1fcf396680 20 remove_watcher() i=6 2023-10-05T21:15:18.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.992+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:130 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94035102003696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640d99280 con 0x7f1fb800d8e0 2023-10-05T21:15:18.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.993+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.0 v2:172.21.15.111:6800/111394 36 ==== osd_op_reply(130 notify.7 [watch unwatch cookie 94035102003696] v29'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1fb4055040 con 0x7f1fb800d8e0 2023-10-05T21:15:18.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.993+0000 7f1fcf396680 20 remove_watcher() i=7 2023-10-05T21:15:18.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.993+0000 7f1f93fdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:18.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.993+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:131 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94035101997824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x558640ddbd90 con 0x558640d5e570 2023-10-05T21:15:18.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.994+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 <== osd.1 v2:172.21.15.153:6816/140456 47 ==== osd_op_reply(131 data_loggenerations_metadata [watch unwatch cookie 94035101997824] v29'129 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1fb4055040 con 0x558640d5e570 2023-10-05T21:15:18.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.994+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f1fb800d8e0 msgr2=0x7f1fb800c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.994+0000 7f1fcf396680 1 --2- 172.21.15.153:0/225554700 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f1fb800d8e0 0x7f1fb800c360 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.994+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x558640d5e570 msgr2=0x558640d8fa30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.994+0000 7f1fcf396680 1 --2- 172.21.15.153:0/225554700 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x558640d5e570 0x558640d8fa30 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.994+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f1fbc048c30 msgr2=0x7f1fbc0113b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.994+0000 7f1fcf396680 1 --2- 172.21.15.153:0/225554700 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f1fbc048c30 0x7f1fbc0113b0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.994+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x558640d92080 msgr2=0x558640d94460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.994+0000 7f1fcf396680 1 --2- 172.21.15.153:0/225554700 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x558640d92080 0x558640d94460 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.994+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1fa40340f0 msgr2=0x7f1fa40365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.994+0000 7f1fcf396680 1 --2- 172.21.15.153:0/225554700 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1fa40340f0 0x7f1fa40365a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1fb80011e0 tx=0x7f1fb80013a0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.994+0000 7f1fc2c6f700 1 -- 172.21.15.153:0/225554700 reap_dead start 2023-10-05T21:15:18.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.994+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640ccf040 msgr2=0x558640d83c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.994+0000 7f1fcf396680 1 --2- 172.21.15.153:0/225554700 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640ccf040 0x558640d83c20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc00a520 tx=0x7f1fbc01d000 comp rx=0 tx=0).stop 2023-10-05T21:15:18.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.994+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 shutdown_connections 2023-10-05T21:15:18.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.994+0000 7f1fcf396680 1 --2- 172.21.15.153:0/225554700 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640ccf040 0x558640d83c20 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.994+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 >> 172.21.15.153:0/225554700 conn(0x558640d55b20 msgr2=0x558640d5a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.994+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 shutdown_connections 2023-10-05T21:15:18.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.994+0000 7f1fcf396680 1 -- 172.21.15.153:0/225554700 wait complete. 2023-10-05T21:15:18.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.995+0000 7f1fcf396680 1 -- 172.21.15.153:0/1318219625 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1f08034140 msgr2=0x7f1f080365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.995+0000 7f1fcf396680 1 --2- 172.21.15.153:0/1318219625 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1f08034140 0x7f1f080365f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x558640d9f9d0 tx=0x7f1fb4037450 comp rx=0 tx=0).stop 2023-10-05T21:15:18.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.995+0000 7f1fcf396680 1 -- 172.21.15.153:0/1318219625 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640dac780 msgr2=0x558640db3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.995+0000 7f1fcf396680 1 --2- 172.21.15.153:0/1318219625 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640dac780 0x558640db3500 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1fb800dfd0 tx=0x7f1fb8030000 comp rx=0 tx=0).stop 2023-10-05T21:15:18.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.995+0000 7f1fcf396680 1 -- 172.21.15.153:0/1318219625 shutdown_connections 2023-10-05T21:15:18.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.995+0000 7f1fcf396680 1 --2- 172.21.15.153:0/1318219625 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1f08034140 0x7f1f080365f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.995+0000 7f1fcf396680 1 --2- 172.21.15.153:0/1318219625 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558640dac780 0x558640db3500 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.995+0000 7f1fcf396680 1 -- 172.21.15.153:0/1318219625 >> 172.21.15.153:0/1318219625 conn(0x558640da8a80 msgr2=0x558640da6b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.995+0000 7f1fcf396680 1 -- 172.21.15.153:0/1318219625 shutdown_connections 2023-10-05T21:15:18.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:17.995+0000 7f1fcf396680 1 -- 172.21.15.153:0/1318219625 wait complete. 2023-10-05T21:15:18.033 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2023-10-05T21:15:18.033 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2023-10-05T21:15:18.033 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2023-10-05T21:15:18.078 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:18.078 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:18.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.076+0000 7fef5e4db680 1 Processor -- start 2023-10-05T21:15:18.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.076+0000 7fef5e4db680 1 -- start start 2023-10-05T21:15:18.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.077+0000 7fef5e4db680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55f2ab87a2b0 0x55f2ab87a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.077+0000 7fef5e4db680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f2ab7c8990 con 0x55f2ab87ac00 2023-10-05T21:15:18.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.077+0000 7fef5e4db680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f2ab788db0 con 0x55f2ab87a2b0 2023-10-05T21:15:18.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.077+0000 7fef515b3700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55f2ab87a2b0 0x55f2ab87a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.077+0000 7fef515b3700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55f2ab87a2b0 0x55f2ab87a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37784/0 (socket says 172.21.15.153:37784) 2023-10-05T21:15:18.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.077+0000 7fef515b3700 1 -- 172.21.15.153:0/151598716 learned_addr learned my addr 172.21.15.153:0/151598716 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:18.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.077+0000 7fef50db2700 1 --1- 172.21.15.153:0/151598716 >> v1:172.21.15.111:6789/0 conn(0x55f2ab87ac00 0x55f2ab87b5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:55220/0 (socket says 172.21.15.153:55220) 2023-10-05T21:15:18.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.077+0000 7fef515b3700 1 -- 172.21.15.153:0/151598716 >> v1:172.21.15.111:6789/0 conn(0x55f2ab87ac00 legacy=0x55f2ab87b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.077+0000 7fef515b3700 1 -- 172.21.15.153:0/151598716 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2ab87bea0 con 0x55f2ab87a2b0 2023-10-05T21:15:18.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.077+0000 7fef43fff700 1 -- 172.21.15.153:0/151598716 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4158409947 0 0) 0x55f2ab7c8990 con 0x55f2ab87ac00 2023-10-05T21:15:18.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.078+0000 7fef515b3700 1 --2- 172.21.15.153:0/151598716 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab87a2b0 0x55f2ab87a6c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fef4400a760 tx=0x7fef44005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c1d8ec480bcae9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.078+0000 7fef43fff700 1 -- 172.21.15.153:0/151598716 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef4400f070 con 0x55f2ab87a2b0 2023-10-05T21:15:18.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.078+0000 7fef43fff700 1 -- 172.21.15.153:0/151598716 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4400a2e0 con 0x55f2ab87a2b0 2023-10-05T21:15:18.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.078+0000 7fef43fff700 1 -- 172.21.15.153:0/151598716 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef440085b0 con 0x55f2ab87a2b0 2023-10-05T21:15:18.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.078+0000 7fef5e4db680 1 -- 172.21.15.153:0/151598716 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab87a2b0 msgr2=0x55f2ab87a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.078+0000 7fef5e4db680 1 --2- 172.21.15.153:0/151598716 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab87a2b0 0x55f2ab87a6c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fef4400a760 tx=0x7fef44005b10 comp rx=0 tx=0).stop 2023-10-05T21:15:18.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.078+0000 7fef5e4db680 1 -- 172.21.15.153:0/151598716 shutdown_connections 2023-10-05T21:15:18.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.078+0000 7fef5e4db680 1 --2- 172.21.15.153:0/151598716 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab87a2b0 0x55f2ab87a6c0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.078+0000 7fef5e4db680 1 -- 172.21.15.153:0/151598716 >> 172.21.15.153:0/151598716 conn(0x55f2ab875b80 msgr2=0x55f2ab877f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.078+0000 7fef5e4db680 1 -- 172.21.15.153:0/151598716 shutdown_connections 2023-10-05T21:15:18.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.078+0000 7fef5e4db680 1 -- 172.21.15.153:0/151598716 wait complete. 2023-10-05T21:15:18.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.079+0000 7fef5e4db680 1 Processor -- start 2023-10-05T21:15:18.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.079+0000 7fef5e4db680 1 -- start start 2023-10-05T21:15:18.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.079+0000 7fef5e4db680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab87a2b0 0x55f2ab898580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.079+0000 7fef5e4db680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2ab728ea0 con 0x55f2ab87a2b0 2023-10-05T21:15:18.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.079+0000 7fef515b3700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab87a2b0 0x55f2ab898580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.079+0000 7fef515b3700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab87a2b0 0x55f2ab898580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37790/0 (socket says 172.21.15.153:37790) 2023-10-05T21:15:18.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.079+0000 7fef515b3700 1 -- 172.21.15.153:0/1979869540 learned_addr learned my addr 172.21.15.153:0/1979869540 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:18.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.080+0000 7fef515b3700 1 -- 172.21.15.153:0/1979869540 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef44005db0 con 0x55f2ab87a2b0 2023-10-05T21:15:18.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.080+0000 7fef515b3700 1 --2- 172.21.15.153:0/1979869540 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab87a2b0 0x55f2ab898580 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fef44005b50 tx=0x7fef44018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a3e3d588f8d456 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.080+0000 7fef42ffd700 1 -- 172.21.15.153:0/1979869540 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef440085b0 con 0x55f2ab87a2b0 2023-10-05T21:15:18.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.080+0000 7fef42ffd700 1 -- 172.21.15.153:0/1979869540 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef44008730 con 0x55f2ab87a2b0 2023-10-05T21:15:18.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.080+0000 7fef42ffd700 1 -- 172.21.15.153:0/1979869540 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef440088e0 con 0x55f2ab87a2b0 2023-10-05T21:15:18.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.081+0000 7fef5e4db680 1 -- 172.21.15.153:0/1979869540 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab87a2b0 msgr2=0x55f2ab898580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.081+0000 7fef5e4db680 1 --2- 172.21.15.153:0/1979869540 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab87a2b0 0x55f2ab898580 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fef44005b50 tx=0x7fef44018000 comp rx=0 tx=0).stop 2023-10-05T21:15:18.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.081+0000 7fef5e4db680 1 -- 172.21.15.153:0/1979869540 shutdown_connections 2023-10-05T21:15:18.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.081+0000 7fef5e4db680 1 --2- 172.21.15.153:0/1979869540 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab87a2b0 0x55f2ab898580 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.081+0000 7fef5e4db680 1 -- 172.21.15.153:0/1979869540 >> 172.21.15.153:0/1979869540 conn(0x55f2ab875b80 msgr2=0x55f2ab894050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.081+0000 7fef5e4db680 1 -- 172.21.15.153:0/1979869540 shutdown_connections 2023-10-05T21:15:18.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.081+0000 7fef5e4db680 1 -- 172.21.15.153:0/1979869540 wait complete. 2023-10-05T21:15:18.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.081+0000 7fef5e4db680 1 Processor -- start 2023-10-05T21:15:18.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.081+0000 7fef5e4db680 1 -- start start 2023-10-05T21:15:18.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.081+0000 7fef5e4db680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab87a2b0 0x55f2ab89f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.081+0000 7fef5e4db680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2ab71fc80 con 0x55f2ab87a2b0 2023-10-05T21:15:18.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.081+0000 7fef515b3700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab87a2b0 0x55f2ab89f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.081+0000 7fef515b3700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab87a2b0 0x55f2ab89f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37798/0 (socket says 172.21.15.153:37798) 2023-10-05T21:15:18.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.081+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 learned_addr learned my addr 172.21.15.153:0/2881391332 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:18.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.082+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2ab87bea0 con 0x55f2ab87a2b0 2023-10-05T21:15:18.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.082+0000 7fef515b3700 1 --2- 172.21.15.153:0/2881391332 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab87a2b0 0x55f2ab89f950 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fef44020040 tx=0x7fef4401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.082+0000 7fef417fa700 1 -- 172.21.15.153:0/2881391332 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef44008e60 con 0x55f2ab87a2b0 2023-10-05T21:15:18.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.082+0000 7fef417fa700 1 -- 172.21.15.153:0/2881391332 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4402a070 con 0x55f2ab87a2b0 2023-10-05T21:15:18.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.082+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f2ab89fe90 con 0x55f2ab87a2b0 2023-10-05T21:15:18.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.082+0000 7fef417fa700 1 -- 172.21.15.153:0/2881391332 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef440088a0 con 0x55f2ab87a2b0 2023-10-05T21:15:18.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.082+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f2ab8a02e0 con 0x55f2ab87a2b0 2023-10-05T21:15:18.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.083+0000 7fef417fa700 1 -- 172.21.15.153:0/2881391332 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fef440139c0 con 0x55f2ab87a2b0 2023-10-05T21:15:18.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.083+0000 7fef5e4db680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.083+0000 7fef417fa700 1 --2- 172.21.15.153:0/2881391332 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fef34034140 0x7fef340365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.083+0000 7fef417fa700 1 -- 172.21.15.153:0/2881391332 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fef4402c070 con 0x55f2ab87a2b0 2023-10-05T21:15:18.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.083+0000 7fef50db2700 1 --2- 172.21.15.153:0/2881391332 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fef34034140 0x7fef340365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.083+0000 7fef5e4db680 1 --2- 172.21.15.153:0/2881391332 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55f2ab8a95f0 0x55f2ab8ab9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.083+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8ac180 con 0x55f2ab8a95f0 2023-10-05T21:15:18.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.084+0000 7fef51db4700 1 --2- 172.21.15.153:0/2881391332 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55f2ab8a95f0 0x55f2ab8ab9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.084+0000 7fef51db4700 1 --2- 172.21.15.153:0/2881391332 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55f2ab8a95f0 0x55f2ab8ab9f0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.084+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.084+0000 7fef5e4db680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.084+0000 7fef5e4db680 20 realm 2023-10-05T21:15:18.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.084+0000 7fef5e4db680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.084+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8a8c60 con 0x55f2ab8a95f0 2023-10-05T21:15:18.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.085+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.085+0000 7fef5e4db680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.085+0000 7fef5e4db680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:18.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.085+0000 7fef5e4db680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.085+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8acc30 con 0x55f2ab8a95f0 2023-10-05T21:15:18.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.085+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.085+0000 7fef5e4db680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.085+0000 7fef5e4db680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.085+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8ad550 con 0x55f2ab8a95f0 2023-10-05T21:15:18.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.085+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.085+0000 7fef5e4db680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:18.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.085+0000 7fef5e4db680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.085+0000 7fef5e4db680 1 --2- 172.21.15.153:0/2881391332 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55f2ab8ade10 0x55f2ab8b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.085+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b07b0 con 0x55f2ab8ade10 2023-10-05T21:15:18.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.085+0000 7fef515b3700 1 --2- 172.21.15.153:0/2881391332 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55f2ab8ade10 0x55f2ab8b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.086+0000 7fef515b3700 1 --2- 172.21.15.153:0/2881391332 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55f2ab8ade10 0x55f2ab8b01f0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.086+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fef4401a040 con 0x55f2ab8ade10 2023-10-05T21:15:18.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.086+0000 7fef5e4db680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:18.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.086+0000 7fef5e4db680 20 searching for the correct realm 2023-10-05T21:15:18.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.086+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x55f2ab8ade10 2023-10-05T21:15:18.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.086+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4401a040 con 0x55f2ab8ade10 2023-10-05T21:15:18.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.086+0000 7fef515b3700 1 --2- 172.21.15.153:0/2881391332 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fef44012710 0x7fef44027790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.086+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x7fef44012710 2023-10-05T21:15:18.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.087+0000 7fef50db2700 1 --2- 172.21.15.153:0/2881391332 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fef44012710 0x7fef44027790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.087+0000 7fef50db2700 1 --2- 172.21.15.153:0/2881391332 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fef34034140 0x7fef340365f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fef480011e0 tx=0x7fef480013c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.087+0000 7fef50db2700 1 --2- 172.21.15.153:0/2881391332 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fef44012710 0x7fef44027790 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.088+0000 7fef50db2700 1 -- 172.21.15.153:0/2881391332 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef48012880 con 0x7fef44012710 2023-10-05T21:15:18.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.088+0000 7fef50db2700 1 --2- 172.21.15.153:0/2881391332 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fef48012b70 0x7fef480133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.088+0000 7fef50db2700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x7fef48012b70 2023-10-05T21:15:18.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.088+0000 7fef51db4700 1 --2- 172.21.15.153:0/2881391332 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fef48012b70 0x7fef480133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.088+0000 7fef51db4700 1 --2- 172.21.15.153:0/2881391332 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fef48012b70 0x7fef480133d0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.088+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4c00a570 con 0x7fef48012b70 2023-10-05T21:15:18.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.088+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x55f2ab8a95f0 2023-10-05T21:15:18.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.089+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.089+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x55f2ab8a95f0 2023-10-05T21:15:18.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.089+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.089+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x7fef48012b70 2023-10-05T21:15:18.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.089+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4c00a570 con 0x7fef48012b70 2023-10-05T21:15:18.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.089+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x7fef48012b70 2023-10-05T21:15:18.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.089+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4c00a570 con 0x7fef48012b70 2023-10-05T21:15:18.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.089+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x7fef44012710 2023-10-05T21:15:18.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.089+0000 7fef50db2700 1 -- 172.21.15.153:0/2881391332 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef48012880 con 0x7fef44012710 2023-10-05T21:15:18.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.089+0000 7fef50db2700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x55f2ab8ade10 2023-10-05T21:15:18.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.090+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fef4401a040 con 0x55f2ab8ade10 2023-10-05T21:15:18.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.090+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x55f2ab8a95f0 2023-10-05T21:15:18.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.090+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.090+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x7fef48012b70 2023-10-05T21:15:18.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.090+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4c00a570 con 0x7fef48012b70 2023-10-05T21:15:18.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.090+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x55f2ab8a95f0 2023-10-05T21:15:18.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.090+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.090+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x7fef44012710 2023-10-05T21:15:18.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.091+0000 7fef50db2700 1 -- 172.21.15.153:0/2881391332 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef48012880 con 0x7fef44012710 2023-10-05T21:15:18.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.091+0000 7fef50db2700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x55f2ab8ade10 2023-10-05T21:15:18.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.091+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4401a040 con 0x55f2ab8ade10 2023-10-05T21:15:18.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.091+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x55f2ab8ade10 2023-10-05T21:15:18.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.091+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4401a040 con 0x55f2ab8ade10 2023-10-05T21:15:18.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.091+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x7fef48012b70 2023-10-05T21:15:18.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.091+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4c00a570 con 0x7fef48012b70 2023-10-05T21:15:18.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.091+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x55f2ab8ade10 2023-10-05T21:15:18.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.091+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4401a040 con 0x55f2ab8ade10 2023-10-05T21:15:18.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.091+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x55f2ab8ade10 2023-10-05T21:15:18.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.092+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4401a040 con 0x55f2ab8ade10 2023-10-05T21:15:18.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.092+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x55f2ab8a95f0 2023-10-05T21:15:18.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.092+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.092+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x55f2ab8a95f0 2023-10-05T21:15:18.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.092+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.092+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x7fef48012b70 2023-10-05T21:15:18.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.092+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4c00a570 con 0x7fef48012b70 2023-10-05T21:15:18.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.092+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x55f2ab8ade10 2023-10-05T21:15:18.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.092+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4401a040 con 0x55f2ab8ade10 2023-10-05T21:15:18.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.092+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x7fef44012710 2023-10-05T21:15:18.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.093+0000 7fef50db2700 1 -- 172.21.15.153:0/2881391332 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef48012880 con 0x7fef44012710 2023-10-05T21:15:18.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.093+0000 7fef50db2700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x55f2ab8a95f0 2023-10-05T21:15:18.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.093+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.093+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x7fef48012b70 2023-10-05T21:15:18.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.093+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4c00a570 con 0x7fef48012b70 2023-10-05T21:15:18.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.093+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x55f2ab8ade10 2023-10-05T21:15:18.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.093+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4401a040 con 0x55f2ab8ade10 2023-10-05T21:15:18.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.093+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x7fef48012b70 2023-10-05T21:15:18.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.094+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4c00a570 con 0x7fef48012b70 2023-10-05T21:15:18.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.094+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x7fef44012710 2023-10-05T21:15:18.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.094+0000 7fef50db2700 1 -- 172.21.15.153:0/2881391332 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef48012880 con 0x7fef44012710 2023-10-05T21:15:18.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.094+0000 7fef50db2700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x55f2ab8ade10 2023-10-05T21:15:18.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.094+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4401a040 con 0x55f2ab8ade10 2023-10-05T21:15:18.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.094+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x7fef48012b70 2023-10-05T21:15:18.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.095+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4c00a570 con 0x7fef48012b70 2023-10-05T21:15:18.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.095+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x55f2ab8a95f0 2023-10-05T21:15:18.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.095+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.095+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b20d0 con 0x7fef44012710 2023-10-05T21:15:18.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.095+0000 7fef50db2700 1 -- 172.21.15.153:0/2881391332 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef48012880 con 0x7fef44012710 2023-10-05T21:15:18.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.095+0000 7fef5e4db680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:18.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.095+0000 7fef5e4db680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:18.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.095+0000 7fef5e4db680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:18.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.095+0000 7fef5e4db680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:18.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.095+0000 7fef5e4db680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.095+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b12f0 con 0x55f2ab8a95f0 2023-10-05T21:15:18.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.095+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.095+0000 7fef5e4db680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.095+0000 7fef5e4db680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.095+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b1780 con 0x55f2ab8a95f0 2023-10-05T21:15:18.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.095+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.095+0000 7fef5e4db680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:18.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.095+0000 7fef5e4db680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.095+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b1bb0 con 0x55f2ab8a95f0 2023-10-05T21:15:18.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.096+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.096+0000 7fef5e4db680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:18.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.096+0000 7fef5e4db680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.096+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b0e80 con 0x55f2ab8ade10 2023-10-05T21:15:18.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.096+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fef4401a040 con 0x55f2ab8ade10 2023-10-05T21:15:18.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.096+0000 7fef5e4db680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.096+0000 7fef5e4db680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.096+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b2970 con 0x55f2ab8a95f0 2023-10-05T21:15:18.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.096+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.096+0000 7fef5e4db680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.096+0000 7fef5e4db680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.096+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b2d70 con 0x55f2ab8a95f0 2023-10-05T21:15:18.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.096+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.096+0000 7fef5e4db680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:18.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.096+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b3d80 con 0x55f2ab8ade10 2023-10-05T21:15:18.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.097+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4401a040 con 0x55f2ab8ade10 2023-10-05T21:15:18.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.097+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b3d80 con 0x7fef44012710 2023-10-05T21:15:18.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.097+0000 7fef50db2700 1 -- 172.21.15.153:0/2881391332 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef48012880 con 0x7fef44012710 2023-10-05T21:15:18.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.097+0000 7fef50db2700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b3d80 con 0x7fef48012b70 2023-10-05T21:15:18.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.097+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4c00a570 con 0x7fef48012b70 2023-10-05T21:15:18.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.097+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b1bb0 con 0x55f2ab8a95f0 2023-10-05T21:15:18.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.098+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.098+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b1bb0 con 0x55f2ab8a95f0 2023-10-05T21:15:18.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.098+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.098+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b1bb0 con 0x7fef48012b70 2023-10-05T21:15:18.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.098+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4c00a570 con 0x7fef48012b70 2023-10-05T21:15:18.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.098+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b1bb0 con 0x7fef48012b70 2023-10-05T21:15:18.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.098+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4c00a570 con 0x7fef48012b70 2023-10-05T21:15:18.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.098+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b1bb0 con 0x7fef44012710 2023-10-05T21:15:18.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.098+0000 7fef50db2700 1 -- 172.21.15.153:0/2881391332 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef48012880 con 0x7fef44012710 2023-10-05T21:15:18.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.098+0000 7fef50db2700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b1bb0 con 0x55f2ab8ade10 2023-10-05T21:15:18.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.099+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fef4401a040 con 0x55f2ab8ade10 2023-10-05T21:15:18.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.099+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b1bb0 con 0x55f2ab8a95f0 2023-10-05T21:15:18.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.099+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.099+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b1bb0 con 0x7fef48012b70 2023-10-05T21:15:18.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.099+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4c00a570 con 0x7fef48012b70 2023-10-05T21:15:18.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.099+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b1bb0 con 0x55f2ab8a95f0 2023-10-05T21:15:18.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.099+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.099+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b1bb0 con 0x7fef44012710 2023-10-05T21:15:18.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.099+0000 7fef50db2700 1 -- 172.21.15.153:0/2881391332 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef48012880 con 0x7fef44012710 2023-10-05T21:15:18.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.099+0000 7fef50db2700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b1bb0 con 0x55f2ab8ade10 2023-10-05T21:15:18.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.100+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4401a040 con 0x55f2ab8ade10 2023-10-05T21:15:18.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.100+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b1bb0 con 0x55f2ab8ade10 2023-10-05T21:15:18.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.100+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4401a040 con 0x55f2ab8ade10 2023-10-05T21:15:18.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.100+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b1bb0 con 0x7fef48012b70 2023-10-05T21:15:18.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.100+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4c00a570 con 0x7fef48012b70 2023-10-05T21:15:18.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.100+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b1bb0 con 0x55f2ab8ade10 2023-10-05T21:15:18.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.100+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4401a040 con 0x55f2ab8ade10 2023-10-05T21:15:18.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.100+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b1bb0 con 0x55f2ab8ade10 2023-10-05T21:15:18.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.100+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4401a040 con 0x55f2ab8ade10 2023-10-05T21:15:18.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.100+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b1bb0 con 0x55f2ab8a95f0 2023-10-05T21:15:18.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.101+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.101+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b1bb0 con 0x55f2ab8a95f0 2023-10-05T21:15:18.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.101+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.101+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b1bb0 con 0x7fef48012b70 2023-10-05T21:15:18.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.101+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4c00a570 con 0x7fef48012b70 2023-10-05T21:15:18.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.101+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b1bb0 con 0x55f2ab8ade10 2023-10-05T21:15:18.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.101+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4401a040 con 0x55f2ab8ade10 2023-10-05T21:15:18.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.101+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b1bb0 con 0x7fef44012710 2023-10-05T21:15:18.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.101+0000 7fef50db2700 1 -- 172.21.15.153:0/2881391332 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef48012880 con 0x7fef44012710 2023-10-05T21:15:18.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.101+0000 7fef50db2700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b1bb0 con 0x55f2ab8a95f0 2023-10-05T21:15:18.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.102+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.102+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b1bb0 con 0x7fef48012b70 2023-10-05T21:15:18.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.102+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4c00a570 con 0x7fef48012b70 2023-10-05T21:15:18.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.102+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b1bb0 con 0x55f2ab8ade10 2023-10-05T21:15:18.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.102+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4401a040 con 0x55f2ab8ade10 2023-10-05T21:15:18.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.102+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b1bb0 con 0x7fef48012b70 2023-10-05T21:15:18.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.102+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4c00a570 con 0x7fef48012b70 2023-10-05T21:15:18.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.103+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b1bb0 con 0x7fef44012710 2023-10-05T21:15:18.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.103+0000 7fef50db2700 1 -- 172.21.15.153:0/2881391332 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef48012880 con 0x7fef44012710 2023-10-05T21:15:18.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.103+0000 7fef50db2700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b1bb0 con 0x55f2ab8ade10 2023-10-05T21:15:18.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.103+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4401a040 con 0x55f2ab8ade10 2023-10-05T21:15:18.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.103+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b1bb0 con 0x7fef48012b70 2023-10-05T21:15:18.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.103+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef4c00a570 con 0x7fef48012b70 2023-10-05T21:15:18.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.103+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b1bb0 con 0x55f2ab8a95f0 2023-10-05T21:15:18.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.103+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.103+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b1bb0 con 0x7fef44012710 2023-10-05T21:15:18.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.104+0000 7fef50db2700 1 -- 172.21.15.153:0/2881391332 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef48012880 con 0x7fef44012710 2023-10-05T21:15:18.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.104+0000 7fef5e4db680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:18.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.104+0000 7fef5e4db680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:18.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.104+0000 7fef5e4db680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:18.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.104+0000 7fef5e4db680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:18.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.104+0000 7fef5e4db680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.104+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b2d70 con 0x55f2ab8a95f0 2023-10-05T21:15:18.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.104+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.104+0000 7fef5e4db680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:18.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.104+0000 7fef5e4db680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.104+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b3120 con 0x55f2ab8ade10 2023-10-05T21:15:18.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.104+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fef4401a040 con 0x55f2ab8ade10 2023-10-05T21:15:18.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.104+0000 7fef5e4db680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:18.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.104+0000 7fef5e4db680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.104+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b3500 con 0x55f2ab8a95f0 2023-10-05T21:15:18.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.104+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.104+0000 7fef5e4db680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:18.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.104+0000 7fef5e4db680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.104+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b34d0 con 0x55f2ab8a95f0 2023-10-05T21:15:18.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.105+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.105+0000 7fef5e4db680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:18.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.105+0000 7fef5e4db680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.105+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b3930 con 0x7fef48012b70 2023-10-05T21:15:18.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.105+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fef4c00a570 con 0x7fef48012b70 2023-10-05T21:15:18.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.105+0000 7fef5e4db680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.105+0000 7fef5e4db680 20 zone default found 2023-10-05T21:15:18.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.105+0000 7fef5e4db680 4 Realm: () 2023-10-05T21:15:18.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.105+0000 7fef5e4db680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:18.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.105+0000 7fef5e4db680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:18.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.105+0000 7fef5e4db680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:18.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.105+0000 7fef5e4db680 20 zonegroup default 2023-10-05T21:15:18.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.105+0000 7fef5e4db680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.105+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b3750 con 0x7fef48012b70 2023-10-05T21:15:18.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.105+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fef4c00a570 con 0x7fef48012b70 2023-10-05T21:15:18.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.105+0000 7fef5e4db680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.105+0000 7fef5e4db680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.105+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b50d0 con 0x55f2ab8ade10 2023-10-05T21:15:18.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.105+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fef4401a040 con 0x55f2ab8ade10 2023-10-05T21:15:18.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.106+0000 7fef5e4db680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.106+0000 7fef5e4db680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.106+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b5480 con 0x55f2ab8ade10 2023-10-05T21:15:18.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.106+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fef4401a040 con 0x55f2ab8ade10 2023-10-05T21:15:18.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.106+0000 7fef5e4db680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.106+0000 7fef5e4db680 20 started sync module instance, tier type = 2023-10-05T21:15:18.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.106+0000 7fef5e4db680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:18.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.106+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b4790 con 0x7fef44012710 2023-10-05T21:15:18.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.107+0000 7fef50db2700 1 -- 172.21.15.153:0/2881391332 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef48012880 con 0x7fef44012710 2023-10-05T21:15:18.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.107+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94500748479424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b5d90 con 0x7fef44012710 2023-10-05T21:15:18.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.107+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b6630 con 0x55f2ab8a95f0 2023-10-05T21:15:18.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.107+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.107+0000 7fef50db2700 1 -- 172.21.15.153:0/2881391332 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94500748479424] v29'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef48012880 con 0x7fef44012710 2023-10-05T21:15:18.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.107+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94500748485216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b6d00 con 0x55f2ab8a95f0 2023-10-05T21:15:18.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.107+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b58a0 con 0x55f2ab8ade10 2023-10-05T21:15:18.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.108+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94500748485216] v29'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.108+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef4401a040 con 0x55f2ab8ade10 2023-10-05T21:15:18.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.108+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94500748486416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b7880 con 0x55f2ab8ade10 2023-10-05T21:15:18.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.108+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b8120 con 0x7fef44012710 2023-10-05T21:15:18.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.109+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94500748486416] v29'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef4401a040 con 0x55f2ab8ade10 2023-10-05T21:15:18.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.109+0000 7fef50db2700 1 -- 172.21.15.153:0/2881391332 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef48012880 con 0x7fef44012710 2023-10-05T21:15:18.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.109+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94500748490000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b8520 con 0x7fef44012710 2023-10-05T21:15:18.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.109+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b8f30 con 0x55f2ab8a95f0 2023-10-05T21:15:18.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.110+0000 7fef50db2700 1 -- 172.21.15.153:0/2881391332 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94500748490000] v29'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef48012880 con 0x7fef44012710 2023-10-05T21:15:18.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.110+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.110+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94500748495424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b8e90 con 0x55f2ab8a95f0 2023-10-05T21:15:18.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.110+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b9d90 con 0x7fef48012b70 2023-10-05T21:15:18.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.111+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94500748495424] v29'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.111+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef4c00a570 con 0x7fef48012b70 2023-10-05T21:15:18.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.111+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94500748497632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b9d50 con 0x7fef48012b70 2023-10-05T21:15:18.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.111+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8ba840 con 0x7fef48012b70 2023-10-05T21:15:18.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.111+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94500748497632] v29'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef4c00a570 con 0x7fef48012b70 2023-10-05T21:15:18.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.112+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef4c00a570 con 0x7fef48012b70 2023-10-05T21:15:18.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.112+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94500748501808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8ba840 con 0x7fef48012b70 2023-10-05T21:15:18.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.112+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8bb290 con 0x7fef48012b70 2023-10-05T21:15:18.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.112+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(98 notify.7 [create] v29'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef4c00a570 con 0x7fef48012b70 2023-10-05T21:15:18.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.112+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94500748504416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8bb720 con 0x7fef48012b70 2023-10-05T21:15:18.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.112+0000 7fef5e4db680 20 add_watcher() i=0 2023-10-05T21:15:18.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.112+0000 7fef5e4db680 20 add_watcher() i=1 2023-10-05T21:15:18.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.112+0000 7fef5e4db680 20 add_watcher() i=2 2023-10-05T21:15:18.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.112+0000 7fef5e4db680 20 add_watcher() i=3 2023-10-05T21:15:18.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.112+0000 7fef5e4db680 20 add_watcher() i=4 2023-10-05T21:15:18.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.112+0000 7fef5e4db680 20 add_watcher() i=5 2023-10-05T21:15:18.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.112+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(97 notify.6 [watch watch cookie 94500748501808] v29'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef4c00a570 con 0x7fef48012b70 2023-10-05T21:15:18.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.112+0000 7fef5e4db680 20 add_watcher() i=6 2023-10-05T21:15:18.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.113+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94500748504416] v29'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef4c00a570 con 0x7fef48012b70 2023-10-05T21:15:18.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.113+0000 7fef5e4db680 20 add_watcher() i=7 2023-10-05T21:15:18.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.113+0000 7fef5e4db680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:18.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.113+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b9730 con 0x55f2ab8a95f0 2023-10-05T21:15:18.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.113+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.113+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94500748505520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b9730 con 0x55f2ab8a95f0 2023-10-05T21:15:18.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.114+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94500748505520] v29'130 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.114+0000 7fef227e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:18.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.114+0000 7fef5e4db680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:18.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.114+0000 7fef5e4db680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:18.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.114+0000 7fef5e4db680 1 Processor -- start 2023-10-05T21:15:18.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.114+0000 7fef5e4db680 1 -- start start 2023-10-05T21:15:18.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.114+0000 7fef5e4db680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab8cc280 0x55f2ab8cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.114+0000 7fef5e4db680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2ab8ccbd0 con 0x55f2ab8cc280 2023-10-05T21:15:18.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.115+0000 7fef50db2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab8cc280 0x55f2ab8cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.115+0000 7fef50db2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab8cc280 0x55f2ab8cc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37810/0 (socket says 172.21.15.153:37810) 2023-10-05T21:15:18.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.115+0000 7fef50db2700 1 -- 172.21.15.153:0/493454661 learned_addr learned my addr 172.21.15.153:0/493454661 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:18.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.115+0000 7fef50db2700 1 -- 172.21.15.153:0/493454661 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2ab8ccd10 con 0x55f2ab8cc280 2023-10-05T21:15:18.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.115+0000 7fef50db2700 1 --2- 172.21.15.153:0/493454661 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab8cc280 0x55f2ab8cc690 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x55f2ab8b0ba0 tx=0x7fef48018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=722eae2de4a1a0aa server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.115+0000 7fef21fe3700 1 -- 172.21.15.153:0/493454661 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef48024040 con 0x55f2ab8cc280 2023-10-05T21:15:18.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.115+0000 7fef21fe3700 1 -- 172.21.15.153:0/493454661 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef48025040 con 0x55f2ab8cc280 2023-10-05T21:15:18.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.115+0000 7fef21fe3700 1 -- 172.21.15.153:0/493454661 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef48013b20 con 0x55f2ab8cc280 2023-10-05T21:15:18.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.116+0000 7fef5e4db680 1 -- 172.21.15.153:0/493454661 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab8cc280 msgr2=0x55f2ab8cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.116+0000 7fef5e4db680 1 --2- 172.21.15.153:0/493454661 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab8cc280 0x55f2ab8cc690 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x55f2ab8b0ba0 tx=0x7fef48018000 comp rx=0 tx=0).stop 2023-10-05T21:15:18.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.116+0000 7fef5e4db680 1 -- 172.21.15.153:0/493454661 shutdown_connections 2023-10-05T21:15:18.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.116+0000 7fef5e4db680 1 --2- 172.21.15.153:0/493454661 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab8cc280 0x55f2ab8cc690 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.116+0000 7fef5e4db680 1 -- 172.21.15.153:0/493454661 >> 172.21.15.153:0/493454661 conn(0x55f2ab8c4230 msgr2=0x55f2ab8c2390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.116+0000 7fef5e4db680 1 -- 172.21.15.153:0/493454661 shutdown_connections 2023-10-05T21:15:18.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.116+0000 7fef5e4db680 1 -- 172.21.15.153:0/493454661 wait complete. 2023-10-05T21:15:18.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.116+0000 7fef5e4db680 1 Processor -- start 2023-10-05T21:15:18.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.116+0000 7fef5e4db680 1 -- start start 2023-10-05T21:15:18.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.116+0000 7fef5e4db680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab8cc280 0x55f2ab8d3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.116+0000 7fef5e4db680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2ab8d3560 con 0x55f2ab8cc280 2023-10-05T21:15:18.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.117+0000 7fef50db2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab8cc280 0x55f2ab8d3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.117+0000 7fef50db2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab8cc280 0x55f2ab8d3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37822/0 (socket says 172.21.15.153:37822) 2023-10-05T21:15:18.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.117+0000 7fef50db2700 1 -- 172.21.15.153:0/2916155193 learned_addr learned my addr 172.21.15.153:0/2916155193 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:18.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.117+0000 7fef50db2700 1 -- 172.21.15.153:0/2916155193 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef480144e0 con 0x55f2ab8cc280 2023-10-05T21:15:18.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.117+0000 7fef50db2700 1 --2- 172.21.15.153:0/2916155193 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab8cc280 0x55f2ab8d3020 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fef48001c00 tx=0x7fef48031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.117+0000 7fee93fff700 1 -- 172.21.15.153:0/2916155193 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef48024030 con 0x55f2ab8cc280 2023-10-05T21:15:18.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.117+0000 7fee93fff700 1 -- 172.21.15.153:0/2916155193 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4801f970 con 0x55f2ab8cc280 2023-10-05T21:15:18.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.117+0000 7fee93fff700 1 -- 172.21.15.153:0/2916155193 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef4801fc80 con 0x55f2ab8cc280 2023-10-05T21:15:18.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.117+0000 7fef5e4db680 1 -- 172.21.15.153:0/2916155193 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f2ab8d3760 con 0x55f2ab8cc280 2023-10-05T21:15:18.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.117+0000 7fef5e4db680 1 -- 172.21.15.153:0/2916155193 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f2ab8d3bb0 con 0x55f2ab8cc280 2023-10-05T21:15:18.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.118+0000 7fee93fff700 1 -- 172.21.15.153:0/2916155193 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fef4803b420 con 0x55f2ab8cc280 2023-10-05T21:15:18.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.118+0000 7fee93fff700 1 --2- 172.21.15.153:0/2916155193 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fee98034140 0x7fee980365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.118+0000 7fee93fff700 1 -- 172.21.15.153:0/2916155193 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fef48045ab0 con 0x55f2ab8cc280 2023-10-05T21:15:18.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.118+0000 7fef51db4700 1 --2- 172.21.15.153:0/2916155193 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fee98034140 0x7fee980365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.118+0000 7fef5e4db680 5 note: GC not initialized 2023-10-05T21:15:18.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.119+0000 7fef51db4700 1 --2- 172.21.15.153:0/2916155193 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fee98034140 0x7fee980365f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x55f2ab8b9b90 tx=0x7fef4c00aee0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.119+0000 7fee917fa700 20 reqs_thread_entry: start 2023-10-05T21:15:18.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.119+0000 7fee8affd700 20 reqs_thread_entry: start 2023-10-05T21:15:18.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.119+0000 7fef5e4db680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:18.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.120+0000 7fef5e4db680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:18.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.120+0000 7fee897fa700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:48 2023 2023-10-05T21:15:18.152 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:18.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.120+0000 7fee88ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:18.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.120+0000 7fef5e4db680 20 get_system_obj_state: rctx=0x7fff60b97ce8 obj=default.rgw.meta:root:testx/myfoo state=0x55f2ab72e240 s->prefetch_data=0 2023-10-05T21:15:18.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.120+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab9385f0 con 0x55f2ab8a95f0 2023-10-05T21:15:18.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.120+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 testx/myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 239+0+139 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.120+0000 7fef5e4db680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:18.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.120+0000 7fef5e4db680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:18.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.120+0000 7fef5e4db680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.120+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab93a880 con 0x55f2ab8a95f0 2023-10-05T21:15:18.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.120+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 testx/myfoo [call,call out=48b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 281+0+316 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.120+0000 7fef5e4db680 20 rados_obj.operate() r=0 bl.length=193 2023-10-05T21:15:18.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.121+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94500748479424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8f7100 con 0x7fef44012710 2023-10-05T21:15:18.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.121+0000 7fef50db2700 1 -- 172.21.15.153:0/2881391332 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94500748479424] v29'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef48012880 con 0x7fef44012710 2023-10-05T21:15:18.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.121+0000 7fef5e4db680 20 remove_watcher() i=0 2023-10-05T21:15:18.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.121+0000 7fef5e4db680 2 removed watcher, disabling cache 2023-10-05T21:15:18.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.121+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94500748485216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b4bc0 con 0x55f2ab8a95f0 2023-10-05T21:15:18.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.122+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94500748485216] v29'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.122+0000 7fef5e4db680 20 remove_watcher() i=1 2023-10-05T21:15:18.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.122+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94500748486416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b4bc0 con 0x55f2ab8ade10 2023-10-05T21:15:18.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.123+0000 7fef515b3700 1 -- 172.21.15.153:0/2881391332 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94500748486416] v29'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef4401a040 con 0x55f2ab8ade10 2023-10-05T21:15:18.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.123+0000 7fef5e4db680 20 remove_watcher() i=2 2023-10-05T21:15:18.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.123+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94500748490000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b4bc0 con 0x7fef44012710 2023-10-05T21:15:18.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.124+0000 7fef50db2700 1 -- 172.21.15.153:0/2881391332 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94500748490000] v29'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef48012880 con 0x7fef44012710 2023-10-05T21:15:18.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.124+0000 7fef5e4db680 20 remove_watcher() i=3 2023-10-05T21:15:18.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.124+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94500748495424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b7510 con 0x55f2ab8a95f0 2023-10-05T21:15:18.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.125+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94500748495424] v29'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.125+0000 7fef5e4db680 20 remove_watcher() i=4 2023-10-05T21:15:18.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.125+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94500748497632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b4bc0 con 0x7fef48012b70 2023-10-05T21:15:18.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.125+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94500748497632] v29'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef4c00a570 con 0x7fef48012b70 2023-10-05T21:15:18.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.125+0000 7fef5e4db680 20 remove_watcher() i=5 2023-10-05T21:15:18.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.125+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94500748501808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b8a40 con 0x7fef48012b70 2023-10-05T21:15:18.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.126+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94500748501808] v29'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef4c00a570 con 0x7fef48012b70 2023-10-05T21:15:18.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.126+0000 7fef5e4db680 20 remove_watcher() i=6 2023-10-05T21:15:18.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.126+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94500748504416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b7510 con 0x7fef48012b70 2023-10-05T21:15:18.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.127+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94500748504416] v29'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef4c00a570 con 0x7fef48012b70 2023-10-05T21:15:18.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.127+0000 7fef5e4db680 20 remove_watcher() i=7 2023-10-05T21:15:18.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.128+0000 7fef227e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:18.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.128+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:112 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94500748505520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f2ab8b4bc0 con 0x55f2ab8a95f0 2023-10-05T21:15:18.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.129+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(112 data_loggenerations_metadata [watch unwatch cookie 94500748505520] v29'131 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fef4c00a570 con 0x55f2ab8a95f0 2023-10-05T21:15:18.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.129+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fef48012b70 msgr2=0x7fef480133d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.129+0000 7fef5e4db680 1 --2- 172.21.15.153:0/2881391332 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fef48012b70 0x7fef480133d0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.129+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55f2ab8a95f0 msgr2=0x55f2ab8ab9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.129+0000 7fef5e4db680 1 --2- 172.21.15.153:0/2881391332 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55f2ab8a95f0 0x55f2ab8ab9f0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.129+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fef44012710 msgr2=0x7fef44027790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.129+0000 7fef5e4db680 1 --2- 172.21.15.153:0/2881391332 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fef44012710 0x7fef44027790 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.129+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55f2ab8ade10 msgr2=0x55f2ab8b01f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.129+0000 7fef5e4db680 1 --2- 172.21.15.153:0/2881391332 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55f2ab8ade10 0x55f2ab8b01f0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.129+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fef34034140 msgr2=0x7fef340365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.129+0000 7fef5e4db680 1 --2- 172.21.15.153:0/2881391332 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fef34034140 0x7fef340365f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fef480011e0 tx=0x7fef480013c0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.129+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab87a2b0 msgr2=0x55f2ab89f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.129+0000 7fef5e4db680 1 --2- 172.21.15.153:0/2881391332 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab87a2b0 0x55f2ab89f950 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fef44020040 tx=0x7fef4401e000 comp rx=0 tx=0).stop 2023-10-05T21:15:18.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.129+0000 7fef51db4700 1 -- 172.21.15.153:0/2881391332 reap_dead start 2023-10-05T21:15:18.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.129+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 shutdown_connections 2023-10-05T21:15:18.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.129+0000 7fef5e4db680 1 --2- 172.21.15.153:0/2881391332 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab87a2b0 0x55f2ab89f950 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.129+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 >> 172.21.15.153:0/2881391332 conn(0x55f2ab875b80 msgr2=0x55f2ab892890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.129+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 shutdown_connections 2023-10-05T21:15:18.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.129+0000 7fef5e4db680 1 -- 172.21.15.153:0/2881391332 wait complete. 2023-10-05T21:15:18.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.129+0000 7fef5e4db680 1 -- 172.21.15.153:0/2916155193 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fee98034140 msgr2=0x7fee980365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.129+0000 7fef5e4db680 1 --2- 172.21.15.153:0/2916155193 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fee98034140 0x7fee980365f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x55f2ab8b9b90 tx=0x7fef4c00aee0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.129+0000 7fef5e4db680 1 -- 172.21.15.153:0/2916155193 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab8cc280 msgr2=0x55f2ab8d3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.129+0000 7fef5e4db680 1 --2- 172.21.15.153:0/2916155193 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab8cc280 0x55f2ab8d3020 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fef48001c00 tx=0x7fef48031000 comp rx=0 tx=0).stop 2023-10-05T21:15:18.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.129+0000 7fef5e4db680 1 -- 172.21.15.153:0/2916155193 shutdown_connections 2023-10-05T21:15:18.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.129+0000 7fef5e4db680 1 --2- 172.21.15.153:0/2916155193 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fee98034140 0x7fee980365f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.129+0000 7fef5e4db680 1 --2- 172.21.15.153:0/2916155193 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f2ab8cc280 0x55f2ab8d3020 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.129+0000 7fef5e4db680 1 -- 172.21.15.153:0/2916155193 >> 172.21.15.153:0/2916155193 conn(0x55f2ab8c4230 msgr2=0x55f2ab8c2360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.129+0000 7fef5e4db680 1 -- 172.21.15.153:0/2916155193 shutdown_connections 2023-10-05T21:15:18.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.129+0000 7fef5e4db680 1 -- 172.21.15.153:0/2916155193 wait complete. 2023-10-05T21:15:18.159 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:18.159 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "bucket:testx/myfoo", 2023-10-05T21:15:18.159 INFO:teuthology.orchestra.run.smithi153.stdout: "ver": { 2023-10-05T21:15:18.159 INFO:teuthology.orchestra.run.smithi153.stdout: "tag": "rBU8hIRebSwLCv48bFKoSTb8", 2023-10-05T21:15:18.160 INFO:teuthology.orchestra.run.smithi153.stdout: "ver": 2 2023-10-05T21:15:18.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:18.160 INFO:teuthology.orchestra.run.smithi153.stdout: "mtime": "2023-10-05T21:15:17.983816Z", 2023-10-05T21:15:18.160 INFO:teuthology.orchestra.run.smithi153.stdout: "data": { 2023-10-05T21:15:18.160 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": { 2023-10-05T21:15:18.160 INFO:teuthology.orchestra.run.smithi153.stdout: "name": "myfoo", 2023-10-05T21:15:18.160 INFO:teuthology.orchestra.run.smithi153.stdout: "marker": "193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1", 2023-10-05T21:15:18.160 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_id": "193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1", 2023-10-05T21:15:18.160 INFO:teuthology.orchestra.run.smithi153.stdout: "tenant": "testx", 2023-10-05T21:15:18.160 INFO:teuthology.orchestra.run.smithi153.stdout: "explicit_placement": { 2023-10-05T21:15:18.160 INFO:teuthology.orchestra.run.smithi153.stdout: "data_pool": "", 2023-10-05T21:15:18.160 INFO:teuthology.orchestra.run.smithi153.stdout: "data_extra_pool": "", 2023-10-05T21:15:18.161 INFO:teuthology.orchestra.run.smithi153.stdout: "index_pool": "" 2023-10-05T21:15:18.161 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:18.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:18.161 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "testx$tenanteduser", 2023-10-05T21:15:18.161 INFO:teuthology.orchestra.run.smithi153.stdout: "creation_time": "2023-10-05T21:15:15.576323Z", 2023-10-05T21:15:18.161 INFO:teuthology.orchestra.run.smithi153.stdout: "linked": "true", 2023-10-05T21:15:18.161 INFO:teuthology.orchestra.run.smithi153.stdout: "has_bucket_info": "false" 2023-10-05T21:15:18.161 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:18.161 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:18.161 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'rBU8hIRebSwLCv48bFKoSTb8', 'ver': 2}, 'mtime': '2023-10-05T21:15:17.983816Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1', 'bucket_id': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2023-10-05T21:15:15.576323Z', 'linked': 'true', 'has_bucket_info': 'false'}} 2023-10-05T21:15:18.162 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2023-10-05T21:15:18.162 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2023-10-05T21:15:18.162 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2023-10-05T21:15:18.208 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:18.208 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:18.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.206+0000 7f239e4d0680 1 Processor -- start 2023-10-05T21:15:18.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.206+0000 7f239e4d0680 1 -- start start 2023-10-05T21:15:18.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.206+0000 7f239e4d0680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55d994d3a910 0x55d994d3ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.206+0000 7f239e4d0680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d994c84930 con 0x55d994d368d0 2023-10-05T21:15:18.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.206+0000 7f239e4d0680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d994c44db0 con 0x55d994d3a910 2023-10-05T21:15:18.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.207+0000 7f2390da7700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55d994d3a910 0x55d994d3ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.207+0000 7f23915a8700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55d994d368d0 0x55d994d36ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:55232/0 (socket says 172.21.15.153:55232) 2023-10-05T21:15:18.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.207+0000 7f2390da7700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55d994d3a910 0x55d994d3ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37838/0 (socket says 172.21.15.153:37838) 2023-10-05T21:15:18.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.207+0000 7f23915a8700 1 -- 172.21.15.153:0/3038268062 learned_addr learned my addr 172.21.15.153:0/3038268062 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:18.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.207+0000 7f2390da7700 1 -- 172.21.15.153:0/3038268062 >> v1:172.21.15.111:6789/0 conn(0x55d994d368d0 legacy=0x55d994d36ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.207+0000 7f2390da7700 1 -- 172.21.15.153:0/3038268062 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d994d3e240 con 0x55d994d3a910 2023-10-05T21:15:18.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.207+0000 7f238bfff700 1 -- 172.21.15.153:0/3038268062 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103204354 0 0) 0x55d994c84930 con 0x55d994d368d0 2023-10-05T21:15:18.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.207+0000 7f2390da7700 1 --2- 172.21.15.153:0/3038268062 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d3a910 0x55d994d3ccf0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f237c00a5d0 tx=0x7f237c005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a36cbfb9e394763 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.207+0000 7f238bfff700 1 -- 172.21.15.153:0/3038268062 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f237c0086a0 con 0x55d994d3a910 2023-10-05T21:15:18.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.207+0000 7f238bfff700 1 -- 172.21.15.153:0/3038268062 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237c008800 con 0x55d994d3a910 2023-10-05T21:15:18.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.207+0000 7f238bfff700 1 -- 172.21.15.153:0/3038268062 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f237c008ad0 con 0x55d994d3a910 2023-10-05T21:15:18.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.208+0000 7f239e4d0680 1 -- 172.21.15.153:0/3038268062 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d3a910 msgr2=0x55d994d3ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.208+0000 7f239e4d0680 1 --2- 172.21.15.153:0/3038268062 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d3a910 0x55d994d3ccf0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f237c00a5d0 tx=0x7f237c005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:18.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.208+0000 7f239e4d0680 1 -- 172.21.15.153:0/3038268062 shutdown_connections 2023-10-05T21:15:18.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.208+0000 7f239e4d0680 1 --2- 172.21.15.153:0/3038268062 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d3a910 0x55d994d3ccf0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.208+0000 7f239e4d0680 1 -- 172.21.15.153:0/3038268062 >> 172.21.15.153:0/3038268062 conn(0x55d994d31310 msgr2=0x55d994d33720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.208+0000 7f239e4d0680 1 -- 172.21.15.153:0/3038268062 shutdown_connections 2023-10-05T21:15:18.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.208+0000 7f239e4d0680 1 -- 172.21.15.153:0/3038268062 wait complete. 2023-10-05T21:15:18.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.208+0000 7f239e4d0680 1 Processor -- start 2023-10-05T21:15:18.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.208+0000 7f239e4d0680 1 -- start start 2023-10-05T21:15:18.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.209+0000 7f239e4d0680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d368d0 0x55d994d360f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.209+0000 7f239e4d0680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d994be4ea0 con 0x55d994d368d0 2023-10-05T21:15:18.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.209+0000 7f23915a8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d368d0 0x55d994d360f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.209+0000 7f23915a8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d368d0 0x55d994d360f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37842/0 (socket says 172.21.15.153:37842) 2023-10-05T21:15:18.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.209+0000 7f23915a8700 1 -- 172.21.15.153:0/791900180 learned_addr learned my addr 172.21.15.153:0/791900180 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:18.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.209+0000 7f23915a8700 1 -- 172.21.15.153:0/791900180 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237c005cf0 con 0x55d994d368d0 2023-10-05T21:15:18.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.209+0000 7f23915a8700 1 --2- 172.21.15.153:0/791900180 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d368d0 0x55d994d360f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f238c001dc0 tx=0x7f238c001790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9818b4d89f988e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.209+0000 7f238affd700 1 -- 172.21.15.153:0/791900180 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f238c00bd70 con 0x55d994d368d0 2023-10-05T21:15:18.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.209+0000 7f238affd700 1 -- 172.21.15.153:0/791900180 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238c00e470 con 0x55d994d368d0 2023-10-05T21:15:18.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.209+0000 7f238affd700 1 -- 172.21.15.153:0/791900180 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f238c00e740 con 0x55d994d368d0 2023-10-05T21:15:18.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.210+0000 7f239e4d0680 1 -- 172.21.15.153:0/791900180 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d368d0 msgr2=0x55d994d360f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.210+0000 7f239e4d0680 1 --2- 172.21.15.153:0/791900180 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d368d0 0x55d994d360f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f238c001dc0 tx=0x7f238c001790 comp rx=0 tx=0).stop 2023-10-05T21:15:18.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.210+0000 7f239e4d0680 1 -- 172.21.15.153:0/791900180 shutdown_connections 2023-10-05T21:15:18.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.210+0000 7f239e4d0680 1 --2- 172.21.15.153:0/791900180 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d368d0 0x55d994d360f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.210+0000 7f239e4d0680 1 -- 172.21.15.153:0/791900180 >> 172.21.15.153:0/791900180 conn(0x55d994d31310 msgr2=0x55d994d51100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.210+0000 7f239e4d0680 1 -- 172.21.15.153:0/791900180 shutdown_connections 2023-10-05T21:15:18.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.210+0000 7f239e4d0680 1 -- 172.21.15.153:0/791900180 wait complete. 2023-10-05T21:15:18.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.210+0000 7f239e4d0680 1 Processor -- start 2023-10-05T21:15:18.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.210+0000 7f239e4d0680 1 -- start start 2023-10-05T21:15:18.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.210+0000 7f239e4d0680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d368d0 0x55d994d5fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.210+0000 7f239e4d0680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d994bdbc80 con 0x55d994d368d0 2023-10-05T21:15:18.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.211+0000 7f23915a8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d368d0 0x55d994d5fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.211+0000 7f23915a8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d368d0 0x55d994d5fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37858/0 (socket says 172.21.15.153:37858) 2023-10-05T21:15:18.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.211+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 learned_addr learned my addr 172.21.15.153:0/834058690 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:18.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.211+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238c001a70 con 0x55d994d368d0 2023-10-05T21:15:18.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.211+0000 7f23915a8700 1 --2- 172.21.15.153:0/834058690 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d368d0 0x55d994d5fe30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f238c0017d0 tx=0x7f238c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.211+0000 7f23897fa700 1 -- 172.21.15.153:0/834058690 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f238c01f070 con 0x55d994d368d0 2023-10-05T21:15:18.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.211+0000 7f23897fa700 1 -- 172.21.15.153:0/834058690 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238c01a640 con 0x55d994d368d0 2023-10-05T21:15:18.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.211+0000 7f23897fa700 1 -- 172.21.15.153:0/834058690 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f238c01a910 con 0x55d994d368d0 2023-10-05T21:15:18.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.211+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d994d60370 con 0x55d994d368d0 2023-10-05T21:15:18.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.211+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d994d607c0 con 0x55d994d368d0 2023-10-05T21:15:18.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.212+0000 7f23897fa700 1 -- 172.21.15.153:0/834058690 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f238c01aa70 con 0x55d994d368d0 2023-10-05T21:15:18.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.212+0000 7f239e4d0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.212+0000 7f23897fa700 1 --2- 172.21.15.153:0/834058690 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2374034140 0x7f23740365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.212+0000 7f23897fa700 1 -- 172.21.15.153:0/834058690 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f238c048f30 con 0x55d994d368d0 2023-10-05T21:15:18.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.212+0000 7f2390da7700 1 --2- 172.21.15.153:0/834058690 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2374034140 0x7f23740365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.213+0000 7f239e4d0680 1 --2- 172.21.15.153:0/834058690 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d994d3a910 0x55d994d6bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.213+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d6c310 con 0x55d994d3a910 2023-10-05T21:15:18.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.213+0000 7f2391da9700 1 --2- 172.21.15.153:0/834058690 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d994d3a910 0x55d994d6bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.213+0000 7f2390da7700 1 --2- 172.21.15.153:0/834058690 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2374034140 0x7f23740365f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x55d994caa0c0 tx=0x7f237c015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.213+0000 7f2391da9700 1 --2- 172.21.15.153:0/834058690 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d994d3a910 0x55d994d6bb80 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.213+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.213+0000 7f239e4d0680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.213+0000 7f239e4d0680 20 realm 2023-10-05T21:15:18.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.213+0000 7f239e4d0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.213+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d691a0 con 0x55d994d3a910 2023-10-05T21:15:18.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.213+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.213+0000 7f239e4d0680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.213+0000 7f239e4d0680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:18.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.213+0000 7f239e4d0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.213+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d6ce10 con 0x55d994d3a910 2023-10-05T21:15:18.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.214+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.214+0000 7f239e4d0680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.214+0000 7f239e4d0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.214+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d6d730 con 0x55d994d3a910 2023-10-05T21:15:18.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.214+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.214+0000 7f239e4d0680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:18.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.214+0000 7f239e4d0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.214+0000 7f239e4d0680 1 --2- 172.21.15.153:0/834058690 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d994d6dff0 0x55d994d703d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.214+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d70a20 con 0x55d994d6dff0 2023-10-05T21:15:18.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.214+0000 7f23915a8700 1 --2- 172.21.15.153:0/834058690 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d994d6dff0 0x55d994d703d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.214+0000 7f23915a8700 1 --2- 172.21.15.153:0/834058690 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d994d6dff0 0x55d994d703d0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.215+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.215+0000 7f239e4d0680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:18.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.215+0000 7f239e4d0680 20 searching for the correct realm 2023-10-05T21:15:18.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.215+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x55d994d6dff0 2023-10-05T21:15:18.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.215+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.215+0000 7f23915a8700 1 --2- 172.21.15.153:0/834058690 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f238c02d020 0x7f238c0461a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.215+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x7f238c02d020 2023-10-05T21:15:18.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.215+0000 7f2390da7700 1 --2- 172.21.15.153:0/834058690 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f238c02d020 0x7f238c0461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.215+0000 7f2390da7700 1 --2- 172.21.15.153:0/834058690 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f238c02d020 0x7f238c0461a0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.216+0000 7f2390da7700 1 -- 172.21.15.153:0/834058690 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f237c019040 con 0x7f238c02d020 2023-10-05T21:15:18.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.216+0000 7f2390da7700 1 --2- 172.21.15.153:0/834058690 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f237c007030 0x7f237c01d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.216+0000 7f2390da7700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x7f237c007030 2023-10-05T21:15:18.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.216+0000 7f2391da9700 1 --2- 172.21.15.153:0/834058690 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f237c007030 0x7f237c01d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.216+0000 7f2391da9700 1 --2- 172.21.15.153:0/834058690 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f237c007030 0x7f237c01d420 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.217+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238400a570 con 0x7f237c007030 2023-10-05T21:15:18.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.217+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x55d994d3a910 2023-10-05T21:15:18.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.217+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.217+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x55d994d3a910 2023-10-05T21:15:18.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.217+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.217+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x7f237c007030 2023-10-05T21:15:18.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.217+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238400a570 con 0x7f237c007030 2023-10-05T21:15:18.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.217+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x7f237c007030 2023-10-05T21:15:18.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.218+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238400a570 con 0x7f237c007030 2023-10-05T21:15:18.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.218+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x7f238c02d020 2023-10-05T21:15:18.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.218+0000 7f2390da7700 1 -- 172.21.15.153:0/834058690 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f237c019040 con 0x7f238c02d020 2023-10-05T21:15:18.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.218+0000 7f2390da7700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x55d994d6dff0 2023-10-05T21:15:18.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.218+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.218+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x55d994d3a910 2023-10-05T21:15:18.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.218+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.218+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x7f237c007030 2023-10-05T21:15:18.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.219+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238400a570 con 0x7f237c007030 2023-10-05T21:15:18.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.219+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x55d994d3a910 2023-10-05T21:15:18.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.219+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.219+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x7f238c02d020 2023-10-05T21:15:18.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.219+0000 7f2390da7700 1 -- 172.21.15.153:0/834058690 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f237c019040 con 0x7f238c02d020 2023-10-05T21:15:18.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.219+0000 7f2390da7700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x55d994d6dff0 2023-10-05T21:15:18.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.219+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.219+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x55d994d6dff0 2023-10-05T21:15:18.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.219+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.219+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x7f237c007030 2023-10-05T21:15:18.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.220+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238400a570 con 0x7f237c007030 2023-10-05T21:15:18.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.220+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x55d994d6dff0 2023-10-05T21:15:18.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.220+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.220+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x55d994d6dff0 2023-10-05T21:15:18.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.220+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.220+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x55d994d3a910 2023-10-05T21:15:18.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.220+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.220+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x55d994d3a910 2023-10-05T21:15:18.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.221+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.221+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x7f237c007030 2023-10-05T21:15:18.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.221+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238400a570 con 0x7f237c007030 2023-10-05T21:15:18.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.221+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x55d994d6dff0 2023-10-05T21:15:18.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.221+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.221+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x7f238c02d020 2023-10-05T21:15:18.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.221+0000 7f2390da7700 1 -- 172.21.15.153:0/834058690 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f237c019040 con 0x7f238c02d020 2023-10-05T21:15:18.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.221+0000 7f2390da7700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x55d994d3a910 2023-10-05T21:15:18.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.221+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.221+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x7f237c007030 2023-10-05T21:15:18.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.222+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238400a570 con 0x7f237c007030 2023-10-05T21:15:18.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.222+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x55d994d6dff0 2023-10-05T21:15:18.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.222+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.222+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x7f237c007030 2023-10-05T21:15:18.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.222+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238400a570 con 0x7f237c007030 2023-10-05T21:15:18.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.222+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x7f238c02d020 2023-10-05T21:15:18.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.223+0000 7f2390da7700 1 -- 172.21.15.153:0/834058690 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f237c019040 con 0x7f238c02d020 2023-10-05T21:15:18.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.223+0000 7f2390da7700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x55d994d6dff0 2023-10-05T21:15:18.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.223+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.223+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x7f237c007030 2023-10-05T21:15:18.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.223+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238400a570 con 0x7f237c007030 2023-10-05T21:15:18.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.223+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x55d994d3a910 2023-10-05T21:15:18.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.223+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.223+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72590 con 0x7f238c02d020 2023-10-05T21:15:18.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.224+0000 7f2390da7700 1 -- 172.21.15.153:0/834058690 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f237c019040 con 0x7f238c02d020 2023-10-05T21:15:18.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.224+0000 7f239e4d0680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:18.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.224+0000 7f239e4d0680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:18.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.224+0000 7f239e4d0680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:18.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.224+0000 7f239e4d0680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:18.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.224+0000 7f239e4d0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.224+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d714e0 con 0x55d994d3a910 2023-10-05T21:15:18.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.224+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.224+0000 7f239e4d0680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.224+0000 7f239e4d0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.224+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d718e0 con 0x55d994d3a910 2023-10-05T21:15:18.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.224+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.224+0000 7f239e4d0680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:18.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.224+0000 7f239e4d0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.224+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72a20 con 0x55d994d3a910 2023-10-05T21:15:18.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.224+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.224+0000 7f239e4d0680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:18.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.224+0000 7f239e4d0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.224+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72dd0 con 0x55d994d6dff0 2023-10-05T21:15:18.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.224+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.224+0000 7f239e4d0680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.224+0000 7f239e4d0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.224+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d73180 con 0x55d994d3a910 2023-10-05T21:15:18.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.225+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.225+0000 7f239e4d0680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.225+0000 7f239e4d0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.225+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d73180 con 0x55d994d3a910 2023-10-05T21:15:18.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.225+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.225+0000 7f239e4d0680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:18.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.225+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d74190 con 0x55d994d6dff0 2023-10-05T21:15:18.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.225+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.225+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d74190 con 0x7f238c02d020 2023-10-05T21:15:18.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.225+0000 7f2390da7700 1 -- 172.21.15.153:0/834058690 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f237c019040 con 0x7f238c02d020 2023-10-05T21:15:18.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.225+0000 7f2390da7700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d74190 con 0x7f237c007030 2023-10-05T21:15:18.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.226+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238400a570 con 0x7f237c007030 2023-10-05T21:15:18.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.226+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72a20 con 0x55d994d3a910 2023-10-05T21:15:18.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.226+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.226+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72a20 con 0x55d994d3a910 2023-10-05T21:15:18.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.226+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.226+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72a20 con 0x7f237c007030 2023-10-05T21:15:18.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.226+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238400a570 con 0x7f237c007030 2023-10-05T21:15:18.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.226+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72a20 con 0x7f237c007030 2023-10-05T21:15:18.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.226+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238400a570 con 0x7f237c007030 2023-10-05T21:15:18.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.226+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72a20 con 0x7f238c02d020 2023-10-05T21:15:18.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.227+0000 7f2390da7700 1 -- 172.21.15.153:0/834058690 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f237c019040 con 0x7f238c02d020 2023-10-05T21:15:18.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.227+0000 7f2390da7700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72a20 con 0x55d994d6dff0 2023-10-05T21:15:18.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.227+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.227+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72a20 con 0x55d994d3a910 2023-10-05T21:15:18.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.227+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.227+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72a20 con 0x7f237c007030 2023-10-05T21:15:18.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.227+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238400a570 con 0x7f237c007030 2023-10-05T21:15:18.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.227+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72a20 con 0x55d994d3a910 2023-10-05T21:15:18.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.228+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.228+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72a20 con 0x7f238c02d020 2023-10-05T21:15:18.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.228+0000 7f2390da7700 1 -- 172.21.15.153:0/834058690 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f237c019040 con 0x7f238c02d020 2023-10-05T21:15:18.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.228+0000 7f2390da7700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72a20 con 0x55d994d6dff0 2023-10-05T21:15:18.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.228+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.228+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72a20 con 0x55d994d6dff0 2023-10-05T21:15:18.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.228+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.228+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72a20 con 0x7f237c007030 2023-10-05T21:15:18.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.229+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238400a570 con 0x7f237c007030 2023-10-05T21:15:18.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.229+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72a20 con 0x55d994d6dff0 2023-10-05T21:15:18.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.229+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.229+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72a20 con 0x55d994d6dff0 2023-10-05T21:15:18.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.229+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.229+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72a20 con 0x55d994d3a910 2023-10-05T21:15:18.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.229+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.229+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72a20 con 0x55d994d3a910 2023-10-05T21:15:18.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.229+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.229+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72a20 con 0x7f237c007030 2023-10-05T21:15:18.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.230+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238400a570 con 0x7f237c007030 2023-10-05T21:15:18.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.230+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72a20 con 0x55d994d6dff0 2023-10-05T21:15:18.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.230+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.230+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72a20 con 0x7f238c02d020 2023-10-05T21:15:18.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.230+0000 7f2390da7700 1 -- 172.21.15.153:0/834058690 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f237c019040 con 0x7f238c02d020 2023-10-05T21:15:18.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.230+0000 7f2390da7700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72a20 con 0x55d994d3a910 2023-10-05T21:15:18.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.230+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.230+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72a20 con 0x7f237c007030 2023-10-05T21:15:18.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.231+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238400a570 con 0x7f237c007030 2023-10-05T21:15:18.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.231+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72a20 con 0x55d994d6dff0 2023-10-05T21:15:18.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.231+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.231+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72a20 con 0x7f237c007030 2023-10-05T21:15:18.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.231+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238400a570 con 0x7f237c007030 2023-10-05T21:15:18.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.231+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72a20 con 0x7f238c02d020 2023-10-05T21:15:18.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.231+0000 7f2390da7700 1 -- 172.21.15.153:0/834058690 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f237c019040 con 0x7f238c02d020 2023-10-05T21:15:18.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.231+0000 7f2390da7700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72a20 con 0x55d994d6dff0 2023-10-05T21:15:18.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.231+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.232+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72a20 con 0x7f237c007030 2023-10-05T21:15:18.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.232+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f238400a570 con 0x7f237c007030 2023-10-05T21:15:18.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.232+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72a20 con 0x55d994d3a910 2023-10-05T21:15:18.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.232+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.232+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d72a20 con 0x7f238c02d020 2023-10-05T21:15:18.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.232+0000 7f2390da7700 1 -- 172.21.15.153:0/834058690 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f237c019040 con 0x7f238c02d020 2023-10-05T21:15:18.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.232+0000 7f239e4d0680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:18.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.232+0000 7f239e4d0680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:18.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.232+0000 7f239e4d0680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:18.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.232+0000 7f239e4d0680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:18.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.232+0000 7f239e4d0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.232+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d73180 con 0x55d994d3a910 2023-10-05T21:15:18.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.232+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.232+0000 7f239e4d0680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:18.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.232+0000 7f239e4d0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.232+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d73580 con 0x55d994d6dff0 2023-10-05T21:15:18.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.233+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.233+0000 7f239e4d0680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:18.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.233+0000 7f239e4d0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.233+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d71110 con 0x55d994d3a910 2023-10-05T21:15:18.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.233+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.233+0000 7f239e4d0680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:18.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.233+0000 7f239e4d0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.233+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d710f0 con 0x55d994d3a910 2023-10-05T21:15:18.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.233+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.233+0000 7f239e4d0680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:18.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.233+0000 7f239e4d0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.233+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d73f40 con 0x7f237c007030 2023-10-05T21:15:18.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.233+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f238400a570 con 0x7f237c007030 2023-10-05T21:15:18.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.233+0000 7f239e4d0680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.233+0000 7f239e4d0680 20 zone default found 2023-10-05T21:15:18.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.233+0000 7f239e4d0680 4 Realm: () 2023-10-05T21:15:18.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.233+0000 7f239e4d0680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:18.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.233+0000 7f239e4d0680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:18.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.233+0000 7f239e4d0680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:18.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.233+0000 7f239e4d0680 20 zonegroup default 2023-10-05T21:15:18.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.233+0000 7f239e4d0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.233+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d73f40 con 0x7f237c007030 2023-10-05T21:15:18.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.234+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f238400a570 con 0x7f237c007030 2023-10-05T21:15:18.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.234+0000 7f239e4d0680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.234+0000 7f239e4d0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.234+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d758c0 con 0x55d994d6dff0 2023-10-05T21:15:18.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.234+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.234+0000 7f239e4d0680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.234+0000 7f239e4d0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.234+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d75c70 con 0x55d994d6dff0 2023-10-05T21:15:18.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.234+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.234+0000 7f239e4d0680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.234+0000 7f239e4d0680 20 started sync module instance, tier type = 2023-10-05T21:15:18.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.234+0000 7f239e4d0680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:18.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.234+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d74f80 con 0x7f238c02d020 2023-10-05T21:15:18.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.235+0000 7f2390da7700 1 -- 172.21.15.153:0/834058690 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f237c019040 con 0x7f238c02d020 2023-10-05T21:15:18.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.235+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94392993403776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d76510 con 0x7f238c02d020 2023-10-05T21:15:18.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.235+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d76db0 con 0x55d994d3a910 2023-10-05T21:15:18.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.236+0000 7f2390da7700 1 -- 172.21.15.153:0/834058690 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94392993403776] v29'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f237c019040 con 0x7f238c02d020 2023-10-05T21:15:18.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.236+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.236+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94392993407008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d76e10 con 0x55d994d3a910 2023-10-05T21:15:18.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.236+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d779c0 con 0x55d994d6dff0 2023-10-05T21:15:18.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.237+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94392993407008] v29'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.237+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.237+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94392993412176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d77dc0 con 0x55d994d6dff0 2023-10-05T21:15:18.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.237+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d787d0 con 0x7f238c02d020 2023-10-05T21:15:18.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.237+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94392993412176] v29'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.237+0000 7f2390da7700 1 -- 172.21.15.153:0/834058690 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f237c019040 con 0x7f238c02d020 2023-10-05T21:15:18.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.237+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94392993409216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d78420 con 0x7f238c02d020 2023-10-05T21:15:18.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.237+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d79840 con 0x55d994d3a910 2023-10-05T21:15:18.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.238+0000 7f2390da7700 1 -- 172.21.15.153:0/834058690 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94392993409216] v29'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f237c019040 con 0x7f238c02d020 2023-10-05T21:15:18.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.238+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.238+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94392993420016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d79c40 con 0x55d994d3a910 2023-10-05T21:15:18.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.238+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d7a690 con 0x7f237c007030 2023-10-05T21:15:18.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.239+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94392993420016] v29'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.239+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f238400a570 con 0x7f237c007030 2023-10-05T21:15:18.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.239+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94392993418112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d7a650 con 0x7f237c007030 2023-10-05T21:15:18.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.239+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d7b110 con 0x7f237c007030 2023-10-05T21:15:18.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.240+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94392993418112] v29'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f238400a570 con 0x7f237c007030 2023-10-05T21:15:18.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.240+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f238400a570 con 0x7f237c007030 2023-10-05T21:15:18.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.240+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94392993426432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d7b110 con 0x7f237c007030 2023-10-05T21:15:18.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.240+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d7bb60 con 0x7f237c007030 2023-10-05T21:15:18.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.240+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(98 notify.7 [create] v29'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f238400a570 con 0x7f237c007030 2023-10-05T21:15:18.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.240+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94392993429040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d7bac0 con 0x7f237c007030 2023-10-05T21:15:18.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.240+0000 7f239e4d0680 20 add_watcher() i=0 2023-10-05T21:15:18.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.240+0000 7f239e4d0680 20 add_watcher() i=1 2023-10-05T21:15:18.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.240+0000 7f239e4d0680 20 add_watcher() i=2 2023-10-05T21:15:18.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.240+0000 7f239e4d0680 20 add_watcher() i=3 2023-10-05T21:15:18.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.240+0000 7f239e4d0680 20 add_watcher() i=4 2023-10-05T21:15:18.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.240+0000 7f239e4d0680 20 add_watcher() i=5 2023-10-05T21:15:18.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.241+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(97 notify.6 [watch watch cookie 94392993426432] v29'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f238400a570 con 0x7f237c007030 2023-10-05T21:15:18.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.241+0000 7f239e4d0680 20 add_watcher() i=6 2023-10-05T21:15:18.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.241+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94392993429040] v29'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f238400a570 con 0x7f237c007030 2023-10-05T21:15:18.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.241+0000 7f239e4d0680 20 add_watcher() i=7 2023-10-05T21:15:18.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.241+0000 7f239e4d0680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:18.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.241+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d7a160 con 0x55d994d3a910 2023-10-05T21:15:18.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.241+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.241+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94392993431312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d7a160 con 0x55d994d3a910 2023-10-05T21:15:18.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.242+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94392993431312] v29'132 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.242+0000 7f23627e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:18.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.242+0000 7f239e4d0680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:18.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.242+0000 7f239e4d0680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:18.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.242+0000 7f239e4d0680 1 Processor -- start 2023-10-05T21:15:18.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.243+0000 7f239e4d0680 1 -- start start 2023-10-05T21:15:18.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.243+0000 7f239e4d0680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d88c20 0x55d994d89030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.243+0000 7f239e4d0680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d994d89640 con 0x55d994d88c20 2023-10-05T21:15:18.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.243+0000 7f2390da7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d88c20 0x55d994d89030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.243+0000 7f2390da7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d88c20 0x55d994d89030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37862/0 (socket says 172.21.15.153:37862) 2023-10-05T21:15:18.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.243+0000 7f2390da7700 1 -- 172.21.15.153:0/878300901 learned_addr learned my addr 172.21.15.153:0/878300901 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:18.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.243+0000 7f2390da7700 1 -- 172.21.15.153:0/878300901 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d994d89b20 con 0x55d994d88c20 2023-10-05T21:15:18.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.243+0000 7f2390da7700 1 --2- 172.21.15.153:0/878300901 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d88c20 0x55d994d89030 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f237c002000 tx=0x7f237c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d02cc63c9665a903 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.243+0000 7f2361fe3700 1 -- 172.21.15.153:0/878300901 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f237c012e50 con 0x55d994d88c20 2023-10-05T21:15:18.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.244+0000 7f2361fe3700 1 -- 172.21.15.153:0/878300901 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237c01de90 con 0x55d994d88c20 2023-10-05T21:15:18.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.244+0000 7f2361fe3700 1 -- 172.21.15.153:0/878300901 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f237c02b440 con 0x55d994d88c20 2023-10-05T21:15:18.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.244+0000 7f239e4d0680 1 -- 172.21.15.153:0/878300901 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d88c20 msgr2=0x55d994d89030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.244+0000 7f239e4d0680 1 --2- 172.21.15.153:0/878300901 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d88c20 0x55d994d89030 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f237c002000 tx=0x7f237c012000 comp rx=0 tx=0).stop 2023-10-05T21:15:18.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.244+0000 7f239e4d0680 1 -- 172.21.15.153:0/878300901 shutdown_connections 2023-10-05T21:15:18.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.244+0000 7f239e4d0680 1 --2- 172.21.15.153:0/878300901 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d88c20 0x55d994d89030 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.244+0000 7f239e4d0680 1 -- 172.21.15.153:0/878300901 >> 172.21.15.153:0/878300901 conn(0x55d994d84f20 msgr2=0x55d994d83020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.244+0000 7f239e4d0680 1 -- 172.21.15.153:0/878300901 shutdown_connections 2023-10-05T21:15:18.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.244+0000 7f239e4d0680 1 -- 172.21.15.153:0/878300901 wait complete. 2023-10-05T21:15:18.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.245+0000 7f239e4d0680 1 Processor -- start 2023-10-05T21:15:18.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.245+0000 7f239e4d0680 1 -- start start 2023-10-05T21:15:18.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.245+0000 7f239e4d0680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d88c20 0x55d994d8f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.245+0000 7f239e4d0680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d994d8fed0 con 0x55d994d88c20 2023-10-05T21:15:18.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.245+0000 7f2390da7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d88c20 0x55d994d8f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.245+0000 7f2390da7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d88c20 0x55d994d8f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37878/0 (socket says 172.21.15.153:37878) 2023-10-05T21:15:18.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.245+0000 7f2390da7700 1 -- 172.21.15.153:0/2185015256 learned_addr learned my addr 172.21.15.153:0/2185015256 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:18.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.245+0000 7f2390da7700 1 -- 172.21.15.153:0/2185015256 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d994d3e240 con 0x55d994d88c20 2023-10-05T21:15:18.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.245+0000 7f2390da7700 1 --2- 172.21.15.153:0/2185015256 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d88c20 0x55d994d8f990 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f237c008cf0 tx=0x7f237c030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.246+0000 7f22d3fff700 1 -- 172.21.15.153:0/2185015256 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f237c03f910 con 0x55d994d88c20 2023-10-05T21:15:18.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.246+0000 7f22d3fff700 1 -- 172.21.15.153:0/2185015256 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237c03fa70 con 0x55d994d88c20 2023-10-05T21:15:18.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.246+0000 7f239e4d0680 1 -- 172.21.15.153:0/2185015256 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d994d900d0 con 0x55d994d88c20 2023-10-05T21:15:18.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.246+0000 7f22d3fff700 1 -- 172.21.15.153:0/2185015256 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f237c03fc20 con 0x55d994d88c20 2023-10-05T21:15:18.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.246+0000 7f239e4d0680 1 -- 172.21.15.153:0/2185015256 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d994d90520 con 0x55d994d88c20 2023-10-05T21:15:18.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.246+0000 7f22d3fff700 1 -- 172.21.15.153:0/2185015256 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f237c052440 con 0x55d994d88c20 2023-10-05T21:15:18.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.246+0000 7f22d3fff700 1 --2- 172.21.15.153:0/2185015256 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f22d8034140 0x7f22d80365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.246+0000 7f22d3fff700 1 -- 172.21.15.153:0/2185015256 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f237c030070 con 0x55d994d88c20 2023-10-05T21:15:18.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.247+0000 7f2391da9700 1 --2- 172.21.15.153:0/2185015256 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f22d8034140 0x7f22d80365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.247+0000 7f239e4d0680 5 note: GC not initialized 2023-10-05T21:15:18.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.247+0000 7f2391da9700 1 --2- 172.21.15.153:0/2185015256 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f22d8034140 0x7f22d80365f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55d994d7c360 tx=0x7f2384037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.247+0000 7f22d17fa700 20 reqs_thread_entry: start 2023-10-05T21:15:18.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.248+0000 7f22caffd700 20 reqs_thread_entry: start 2023-10-05T21:15:18.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.248+0000 7f239e4d0680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:18.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.248+0000 7f239e4d0680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:18.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.248+0000 7f22c97fa700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:48 2023 2023-10-05T21:15:18.293 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:18.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.248+0000 7f22c8ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:18.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.248+0000 7f239e4d0680 20 get_system_obj_state: rctx=0x7ffec33a99d8 obj=default.rgw.meta:users.uid:foo state=0x55d994bea240 s->prefetch_data=0 2023-10-05T21:15:18.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.248+0000 7f239e4d0680 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T21:15:18.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.248+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994df52d0 con 0x55d994d3a910 2023-10-05T21:15:18.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.248+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.248+0000 7f239e4d0680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T21:15:18.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.248+0000 7f239e4d0680 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:18.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.248+0000 7f239e4d0680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:18.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.248+0000 7f239e4d0680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:18.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.248+0000 7f239e4d0680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:18.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.248+0000 7f239e4d0680 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:18.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.248+0000 7f239e4d0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.248+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994df7560 con 0x55d994d3a910 2023-10-05T21:15:18.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.249+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.249+0000 7f239e4d0680 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T21:15:18.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.249+0000 7f239e4d0680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T21:15:18.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.249+0000 7f239e4d0680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:18.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.249+0000 7f239e4d0680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:18.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.249+0000 7f239e4d0680 20 get_system_obj_state: rctx=0x7ffec33a8de0 obj=default.rgw.meta:root:testx/myfoo state=0x55d994bea240 s->prefetch_data=0 2023-10-05T21:15:18.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.249+0000 7f239e4d0680 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2023-10-05T21:15:18.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.249+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:104 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994df6610 con 0x55d994d3a910 2023-10-05T21:15:18.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.249+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(104 testx/myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 239+0+139 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.249+0000 7f239e4d0680 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x16 2023-10-05T21:15:18.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.249+0000 7f239e4d0680 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2023-10-05T21:15:18.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.249+0000 7f239e4d0680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:18.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.249+0000 7f239e4d0680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:18.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.249+0000 7f239e4d0680 10 cache get: name=default.rgw.meta+root+testx/myfoo : type miss (requested=0x11, cached=0x16) 2023-10-05T21:15:18.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.249+0000 7f239e4d0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.249+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:105 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994df6610 con 0x55d994d3a910 2023-10-05T21:15:18.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.249+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(105 testx/myfoo [call,call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) v8 ==== 239+0+241 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.249+0000 7f239e4d0680 20 rados_obj.operate() r=0 bl.length=193 2023-10-05T21:15:18.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.249+0000 7f239e4d0680 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2023-10-05T21:15:18.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.249+0000 7f239e4d0680 10 moving default.rgw.meta+root+testx/myfoo to cache LRU end 2023-10-05T21:15:18.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.249+0000 7f239e4d0680 20 get_system_obj_state: rctx=0x7ffec33a8de0 obj=default.rgw.meta:root:.bucket.meta.testx:myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 state=0x55d994bea500 s->prefetch_data=0 2023-10-05T21:15:18.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.249+0000 7f239e4d0680 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 : miss 2023-10-05T21:15:18.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.249+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:106 8.16 8:6f41a5b8:root::.bucket.meta.testx%3amyfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994df90c0 con 0x55d994d6dff0 2023-10-05T21:15:18.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.250+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(106 .bucket.meta.testx:myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call out=48b,getxattrs out=298b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 296+0+362 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.250+0000 7f239e4d0680 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 info.flags=0x16 2023-10-05T21:15:18.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.250+0000 7f239e4d0680 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 to cache LRU end 2023-10-05T21:15:18.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.250+0000 7f239e4d0680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:18.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.250+0000 7f239e4d0680 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T21:15:18.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.250+0000 7f239e4d0680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:18.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.250+0000 7f239e4d0680 20 Read xattr: user.rgw.acl 2023-10-05T21:15:18.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.250+0000 7f239e4d0680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:18.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.250+0000 7f239e4d0680 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:18.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.250+0000 7f239e4d0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.250+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 8.16 8:6f41a5b8:root::.bucket.meta.testx%3amyfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994dfbe50 con 0x55d994d6dff0 2023-10-05T21:15:18.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.250+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(107 .bucket.meta.testx:myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call,call out=48b,read 0~371 out=371b,getxattrs out=298b] v0'0 uv1 ondisk = 0) v8 ==== 338+0+717 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.250+0000 7f239e4d0680 20 rados_obj.operate() r=0 bl.length=371 2023-10-05T21:15:18.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.250+0000 7f239e4d0680 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 info.flags=0x13 2023-10-05T21:15:18.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.250+0000 7f239e4d0680 10 moving default.rgw.meta+root+.bucket.meta.testx:myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 to cache LRU end 2023-10-05T21:15:18.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.250+0000 7f239e4d0680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:18.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.250+0000 7f239e4d0680 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T21:15:18.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.250+0000 7f239e4d0680 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 2023-10-05T21:15:18.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.250+0000 7f239e4d0680 20 get_system_obj_state: rctx=0x7ffec33a8d68 obj=default.rgw.meta:users.uid:foo state=0x55d994bea500 s->prefetch_data=0 2023-10-05T21:15:18.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.250+0000 7f239e4d0680 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x16, cached=0x13) 2023-10-05T21:15:18.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.250+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:108 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994dfc520 con 0x55d994d3a910 2023-10-05T21:15:18.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.250+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(108 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.250+0000 7f239e4d0680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T21:15:18.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.250+0000 7f239e4d0680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:18.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.250+0000 7f239e4d0680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:18.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.250+0000 7f239e4d0680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:18.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.250+0000 7f239e4d0680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:18.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.250+0000 7f239e4d0680 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x17) 2023-10-05T21:15:18.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.251+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:109 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994dfe540 con 0x55d994d3a910 2023-10-05T21:15:18.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.251+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(109 testx$tenanteduser.buckets [call] v29'2 uv2 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.251+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:110 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [create,call version.inc in=38b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994e01cd0 con 0x55d994d6dff0 2023-10-05T21:15:18.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.252+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(110 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [create,call,writefull 0~352,setxattr (123)] v29'5 uv5 ondisk = 0) v8 ==== 332+0+0 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.252+0000 7f239e4d0680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 info.flags=0x7 2023-10-05T21:15:18.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.252+0000 7f239e4d0680 10 adding default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 to cache LRU end 2023-10-05T21:15:18.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.252+0000 7f239e4d0680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:18.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.252+0000 7f239e4d0680 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1, ofs0, ns] 2023-10-05T21:15:18.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.252+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:111 7.15 7:a93a5511:::notify.2:head [notify cookie 94392993978336 in=713b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994dffa40 con 0x55d994d6dff0 2023-10-05T21:15:18.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.253+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== watch-notify(notify (1) cookie 94392993412176 notify 124554051593 ret 0) v3 ==== 743+0+0 (crc 0 0 0) 0x55d994d607c0 con 0x55d994d6dff0 2023-10-05T21:15:18.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.253+0000 7f238affd700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051593 cookie 94392993412176 notifier 4502 bl.length()=701 2023-10-05T21:15:18.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.253+0000 7f238affd700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 info.flags=0x7 2023-10-05T21:15:18.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.253+0000 7f238affd700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 to cache LRU end 2023-10-05T21:15:18.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.253+0000 7f238affd700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:18.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.253+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(111 notify.2 [notify cookie 94392993978336 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.253+0000 7f238affd700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:112 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f2370003d90 con 0x55d994d6dff0 2023-10-05T21:15:18.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.253+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 31 ==== osd_op_reply(112 notify.2 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.253+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 32 ==== watch-notify(notify_complete (2) cookie 94392993978336 notify 124554051593 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d994d60370 con 0x55d994d6dff0 2023-10-05T21:15:18.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.253+0000 7f239e4d0680 20 handle_bi_update(): bucket=:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1]): orig_sources= new_sources= 2023-10-05T21:15:18.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.253+0000 7f239e4d0680 20 handle_bi_update(): bucket=:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1]): potential sources added=[] removed=[] 2023-10-05T21:15:18.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.253+0000 7f239e4d0680 20 handle_bi_update(): bucket=:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1]): orig_dests= new_dests= 2023-10-05T21:15:18.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.253+0000 7f239e4d0680 20 handle_bi_update(): bucket=:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1]): potential dests added=[] removed=[] 2023-10-05T21:15:18.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.253+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:113 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994e017e0 con 0x7f238c02d020 2023-10-05T21:15:18.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.254+0000 7f2390da7700 1 -- 172.21.15.153:0/834058690 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(113 foo.buckets [call] v29'26 uv26 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f237c033040 con 0x7f238c02d020 2023-10-05T21:15:18.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.254+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:114 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994dff550 con 0x7f238c02d020 2023-10-05T21:15:18.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.255+0000 7f2390da7700 1 -- 172.21.15.153:0/834058690 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(114 myfoo [delete,create,call,writefull 0~165] v29'27 uv27 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7f237c033040 con 0x7f238c02d020 2023-10-05T21:15:18.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.255+0000 7f239e4d0680 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2023-10-05T21:15:18.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.255+0000 7f239e4d0680 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:18.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.255+0000 7f239e4d0680 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2023-10-05T21:15:18.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.255+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:115 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94392993971904 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994dff550 con 0x7f237c007030 2023-10-05T21:15:18.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.256+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== watch-notify(notify (1) cookie 94392993426432 notify 124554051602 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x7f2384029040 con 0x7f237c007030 2023-10-05T21:15:18.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.256+0000 7f238affd700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051602 cookie 94392993426432 notifier 4502 bl.length()=314 2023-10-05T21:15:18.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.256+0000 7f238affd700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2023-10-05T21:15:18.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.256+0000 7f238affd700 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:18.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.256+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(115 notify.6 [notify cookie 94392993971904 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f238400a570 con 0x7f237c007030 2023-10-05T21:15:18.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.256+0000 7f238affd700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:116 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f2370003d90 con 0x7f237c007030 2023-10-05T21:15:18.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.256+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== watch-notify(notify_complete (2) cookie 94392993971904 notify 124554051602 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f238402d040 con 0x7f237c007030 2023-10-05T21:15:18.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.256+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(116 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f238400a570 con 0x7f237c007030 2023-10-05T21:15:18.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.256+0000 7f239e4d0680 10 removing default.rgw.meta+root+testx/myfoo from cache 2023-10-05T21:15:18.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.256+0000 7f239e4d0680 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2023-10-05T21:15:18.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.256+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:117 7.d 7:b4812045:::notify.4:head [notify cookie 94392993971904 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994dfda20 con 0x55d994d3a910 2023-10-05T21:15:18.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.256+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== watch-notify(notify (1) cookie 94392993420016 notify 124554051600 ret 0) v3 ==== 197+0+0 (crc 0 0 0) 0x7f238402d040 con 0x55d994d3a910 2023-10-05T21:15:18.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.256+0000 7f238a7fc700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051600 cookie 94392993420016 notifier 4502 bl.length()=155 2023-10-05T21:15:18.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.256+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 42 ==== osd_op_reply(117 notify.4 [notify cookie 94392993971904 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.256+0000 7f238a7fc700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:118 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f22e0003270 con 0x55d994d3a910 2023-10-05T21:15:18.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.257+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 43 ==== watch-notify(notify_complete (2) cookie 94392993971904 notify 124554051600 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f2384037e10 con 0x55d994d3a910 2023-10-05T21:15:18.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.257+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 44 ==== osd_op_reply(118 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.257+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:119 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994dffec0 con 0x55d994d3a910 2023-10-05T21:15:18.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.258+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 45 ==== osd_op_reply(119 testx/myfoo [call,delete] v29'2 uv2 ondisk = 0) v8 ==== 197+0+0 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.258+0000 7f239e4d0680 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 from cache 2023-10-05T21:15:18.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.258+0000 7f239e4d0680 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1, ofs0, ns] 2023-10-05T21:15:18.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.258+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:120 7.0 7:05bf5b68:::notify.1:head [notify cookie 94392993971904 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994e007d0 con 0x55d994d3a910 2023-10-05T21:15:18.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.258+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 46 ==== watch-notify(notify (1) cookie 94392993407008 notify 124554051601 ret 0) v3 ==== 254+0+0 (crc 0 0 0) 0x7f2384037e10 con 0x55d994d3a910 2023-10-05T21:15:18.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.258+0000 7f238affd700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051601 cookie 94392993407008 notifier 4502 bl.length()=212 2023-10-05T21:15:18.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.258+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 47 ==== osd_op_reply(120 notify.1 [notify cookie 94392993971904 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.258+0000 7f238affd700 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:121 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f2370003d90 con 0x55d994d3a910 2023-10-05T21:15:18.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.258+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 48 ==== osd_op_reply(121 notify.1 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.258+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 49 ==== watch-notify(notify_complete (2) cookie 94392993971904 notify 124554051601 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f238404f5c0 con 0x55d994d3a910 2023-10-05T21:15:18.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.258+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:122 8.16 8:6f41a5b8:root::.bucket.meta.testx%3amyfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994dffec0 con 0x55d994d6dff0 2023-10-05T21:15:18.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.259+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 33 ==== osd_op_reply(122 .bucket.meta.testx:myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call,delete] v29'2 uv2 ondisk = 0) v8 ==== 254+0+0 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.259+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:123 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94392993403776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994dffec0 con 0x7f238c02d020 2023-10-05T21:15:18.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.260+0000 7f2390da7700 1 -- 172.21.15.153:0/834058690 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(123 notify.0 [watch unwatch cookie 94392993403776] v29'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f237c033040 con 0x7f238c02d020 2023-10-05T21:15:18.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.260+0000 7f239e4d0680 20 remove_watcher() i=0 2023-10-05T21:15:18.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.260+0000 7f239e4d0680 2 removed watcher, disabling cache 2023-10-05T21:15:18.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.260+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:124 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94392993407008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994dffec0 con 0x55d994d3a910 2023-10-05T21:15:18.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.261+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 50 ==== osd_op_reply(124 notify.1 [watch unwatch cookie 94392993407008] v29'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.261+0000 7f239e4d0680 20 remove_watcher() i=1 2023-10-05T21:15:18.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.261+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:125 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94392993412176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d76020 con 0x55d994d6dff0 2023-10-05T21:15:18.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.261+0000 7f23915a8700 1 -- 172.21.15.153:0/834058690 <== osd.3 v2:172.21.15.153:6800/140455 34 ==== osd_op_reply(125 notify.2 [watch unwatch cookie 94392993412176] v29'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f238c014070 con 0x55d994d6dff0 2023-10-05T21:15:18.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.261+0000 7f239e4d0680 20 remove_watcher() i=2 2023-10-05T21:15:18.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.261+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:126 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94392993409216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d77450 con 0x7f238c02d020 2023-10-05T21:15:18.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.262+0000 7f2390da7700 1 -- 172.21.15.153:0/834058690 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(126 notify.3 [watch unwatch cookie 94392993409216] v29'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f237c033040 con 0x7f238c02d020 2023-10-05T21:15:18.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.262+0000 7f239e4d0680 20 remove_watcher() i=3 2023-10-05T21:15:18.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.262+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:127 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94392993420016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d768c0 con 0x55d994d3a910 2023-10-05T21:15:18.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.263+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 51 ==== osd_op_reply(127 notify.4 [watch unwatch cookie 94392993420016] v29'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.263+0000 7f239e4d0680 20 remove_watcher() i=4 2023-10-05T21:15:18.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.263+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:128 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94392993418112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d792f0 con 0x7f237c007030 2023-10-05T21:15:18.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.264+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 31 ==== osd_op_reply(128 notify.5 [watch unwatch cookie 94392993418112] v29'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f238400a570 con 0x7f237c007030 2023-10-05T21:15:18.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.264+0000 7f239e4d0680 20 remove_watcher() i=5 2023-10-05T21:15:18.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.264+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:129 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94392993426432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d768c0 con 0x7f237c007030 2023-10-05T21:15:18.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.264+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 32 ==== osd_op_reply(129 notify.6 [watch unwatch cookie 94392993426432] v29'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f238400a570 con 0x7f237c007030 2023-10-05T21:15:18.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.264+0000 7f239e4d0680 20 remove_watcher() i=6 2023-10-05T21:15:18.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.264+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:130 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94392993429040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d78b80 con 0x7f237c007030 2023-10-05T21:15:18.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.265+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.0 v2:172.21.15.111:6800/111394 33 ==== osd_op_reply(130 notify.7 [watch unwatch cookie 94392993429040] v29'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f238400a570 con 0x7f237c007030 2023-10-05T21:15:18.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.265+0000 7f239e4d0680 20 remove_watcher() i=7 2023-10-05T21:15:18.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.266+0000 7f23627e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:18.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.266+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:131 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94392993431312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d994d7ac00 con 0x55d994d3a910 2023-10-05T21:15:18.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.267+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 <== osd.1 v2:172.21.15.153:6816/140456 52 ==== osd_op_reply(131 data_loggenerations_metadata [watch unwatch cookie 94392993431312] v29'133 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f238400a570 con 0x55d994d3a910 2023-10-05T21:15:18.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.267+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f237c007030 msgr2=0x7f237c01d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.267+0000 7f239e4d0680 1 --2- 172.21.15.153:0/834058690 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f237c007030 0x7f237c01d420 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.267+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d994d3a910 msgr2=0x55d994d6bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.267+0000 7f239e4d0680 1 --2- 172.21.15.153:0/834058690 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d994d3a910 0x55d994d6bb80 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.267+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f238c02d020 msgr2=0x7f238c0461a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.267+0000 7f239e4d0680 1 --2- 172.21.15.153:0/834058690 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f238c02d020 0x7f238c0461a0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.267+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d994d6dff0 msgr2=0x55d994d703d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.267+0000 7f239e4d0680 1 --2- 172.21.15.153:0/834058690 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d994d6dff0 0x55d994d703d0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.267+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2374034140 msgr2=0x7f23740365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.267+0000 7f239e4d0680 1 --2- 172.21.15.153:0/834058690 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2374034140 0x7f23740365f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x55d994caa0c0 tx=0x7f237c015000 comp rx=0 tx=0).stop 2023-10-05T21:15:18.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.267+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d368d0 msgr2=0x55d994d5fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.267+0000 7f2391da9700 1 -- 172.21.15.153:0/834058690 reap_dead start 2023-10-05T21:15:18.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.267+0000 7f239e4d0680 1 --2- 172.21.15.153:0/834058690 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d368d0 0x55d994d5fe30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f238c0017d0 tx=0x7f238c016000 comp rx=0 tx=0).stop 2023-10-05T21:15:18.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.267+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 shutdown_connections 2023-10-05T21:15:18.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.267+0000 7f239e4d0680 1 --2- 172.21.15.153:0/834058690 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d368d0 0x55d994d5fe30 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.267+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 >> 172.21.15.153:0/834058690 conn(0x55d994d31310 msgr2=0x55d994d4f960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.267+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 shutdown_connections 2023-10-05T21:15:18.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.267+0000 7f239e4d0680 1 -- 172.21.15.153:0/834058690 wait complete. 2023-10-05T21:15:18.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.267+0000 7f239e4d0680 1 -- 172.21.15.153:0/2185015256 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f22d8034140 msgr2=0x7f22d80365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.267+0000 7f239e4d0680 1 --2- 172.21.15.153:0/2185015256 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f22d8034140 0x7f22d80365f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55d994d7c360 tx=0x7f2384037450 comp rx=0 tx=0).stop 2023-10-05T21:15:18.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.267+0000 7f239e4d0680 1 -- 172.21.15.153:0/2185015256 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d88c20 msgr2=0x55d994d8f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.267+0000 7f239e4d0680 1 --2- 172.21.15.153:0/2185015256 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d88c20 0x55d994d8f990 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f237c008cf0 tx=0x7f237c030000 comp rx=0 tx=0).stop 2023-10-05T21:15:18.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.267+0000 7f239e4d0680 1 -- 172.21.15.153:0/2185015256 shutdown_connections 2023-10-05T21:15:18.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.267+0000 7f239e4d0680 1 --2- 172.21.15.153:0/2185015256 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f22d8034140 0x7f22d80365f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.267+0000 7f239e4d0680 1 --2- 172.21.15.153:0/2185015256 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d994d88c20 0x55d994d8f990 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.267+0000 7f239e4d0680 1 -- 172.21.15.153:0/2185015256 >> 172.21.15.153:0/2185015256 conn(0x55d994d84f20 msgr2=0x55d994d82ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.268+0000 7f239e4d0680 1 -- 172.21.15.153:0/2185015256 shutdown_connections 2023-10-05T21:15:18.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.268+0000 7f239e4d0680 1 -- 172.21.15.153:0/2185015256 wait complete. 2023-10-05T21:15:18.311 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2023-10-05T21:15:18.311 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2023-10-05T21:15:18.311 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2023-10-05T21:15:18.358 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:18.358 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:18.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.356+0000 7f9f7a3b9680 1 Processor -- start 2023-10-05T21:15:18.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.356+0000 7f9f7a3b9680 1 -- start start 2023-10-05T21:15:18.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.356+0000 7f9f7a3b9680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x557e6d710900 0x557e6d712ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.356+0000 7f9f7a3b9680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557e6d659930 con 0x557e6d70c3d0 2023-10-05T21:15:18.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.356+0000 7f9f7a3b9680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x557e6d619db0 con 0x557e6d710900 2023-10-05T21:15:18.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.357+0000 7f9f6cc90700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x557e6d710900 0x557e6d712ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.357+0000 7f9f6d491700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x557e6d70c3d0 0x557e6d70c7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:55240/0 (socket says 172.21.15.153:55240) 2023-10-05T21:15:18.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.357+0000 7f9f6d491700 1 -- 172.21.15.153:0/3380409545 learned_addr learned my addr 172.21.15.153:0/3380409545 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:18.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.357+0000 7f9f6cc90700 1 -- 172.21.15.153:0/3380409545 >> v1:172.21.15.111:6789/0 conn(0x557e6d70c3d0 legacy=0x557e6d70c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.357+0000 7f9f6cc90700 1 -- 172.21.15.153:0/3380409545 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e6d714230 con 0x557e6d710900 2023-10-05T21:15:18.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.357+0000 7f9f5ffff700 1 -- 172.21.15.153:0/3380409545 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 43243397 0 0) 0x557e6d659930 con 0x557e6d70c3d0 2023-10-05T21:15:18.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.357+0000 7f9f6cc90700 1 --2- 172.21.15.153:0/3380409545 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d710900 0x557e6d712ce0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9f6000a5d0 tx=0x7f9f60005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1973d2d0205bfd88 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.357+0000 7f9f5ffff700 1 -- 172.21.15.153:0/3380409545 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f600086a0 con 0x557e6d710900 2023-10-05T21:15:18.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.357+0000 7f9f5ffff700 1 -- 172.21.15.153:0/3380409545 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f60008800 con 0x557e6d710900 2023-10-05T21:15:18.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.357+0000 7f9f5ffff700 1 -- 172.21.15.153:0/3380409545 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f60008ad0 con 0x557e6d710900 2023-10-05T21:15:18.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.358+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/3380409545 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d710900 msgr2=0x557e6d712ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.358+0000 7f9f7a3b9680 1 --2- 172.21.15.153:0/3380409545 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d710900 0x557e6d712ce0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9f6000a5d0 tx=0x7f9f60005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:18.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.358+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/3380409545 shutdown_connections 2023-10-05T21:15:18.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.358+0000 7f9f7a3b9680 1 --2- 172.21.15.153:0/3380409545 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d710900 0x557e6d712ce0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.358+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/3380409545 >> 172.21.15.153:0/3380409545 conn(0x557e6d707ca0 msgr2=0x557e6d70a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.358+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/3380409545 shutdown_connections 2023-10-05T21:15:18.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.358+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/3380409545 wait complete. 2023-10-05T21:15:18.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.359+0000 7f9f7a3b9680 1 Processor -- start 2023-10-05T21:15:18.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.359+0000 7f9f7a3b9680 1 -- start start 2023-10-05T21:15:18.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.359+0000 7f9f7a3b9680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d70c3d0 0x557e6d682110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.359+0000 7f9f7a3b9680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e6d5b9ea0 con 0x557e6d70c3d0 2023-10-05T21:15:18.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.359+0000 7f9f6d491700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d70c3d0 0x557e6d682110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.359+0000 7f9f6d491700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d70c3d0 0x557e6d682110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37894/0 (socket says 172.21.15.153:37894) 2023-10-05T21:15:18.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.359+0000 7f9f6d491700 1 -- 172.21.15.153:0/2475268271 learned_addr learned my addr 172.21.15.153:0/2475268271 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:18.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.359+0000 7f9f6d491700 1 -- 172.21.15.153:0/2475268271 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f60005cf0 con 0x557e6d70c3d0 2023-10-05T21:15:18.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.359+0000 7f9f6d491700 1 --2- 172.21.15.153:0/2475268271 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d70c3d0 0x557e6d682110 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9f64001dc0 tx=0x7f9f64001790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49af74549540301b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.359+0000 7f9f5effd700 1 -- 172.21.15.153:0/2475268271 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f6400bce0 con 0x557e6d70c3d0 2023-10-05T21:15:18.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.359+0000 7f9f5effd700 1 -- 172.21.15.153:0/2475268271 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6400be40 con 0x557e6d70c3d0 2023-10-05T21:15:18.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.359+0000 7f9f5effd700 1 -- 172.21.15.153:0/2475268271 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f6400e5d0 con 0x557e6d70c3d0 2023-10-05T21:15:18.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.360+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2475268271 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d70c3d0 msgr2=0x557e6d682110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.360+0000 7f9f7a3b9680 1 --2- 172.21.15.153:0/2475268271 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d70c3d0 0x557e6d682110 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9f64001dc0 tx=0x7f9f64001790 comp rx=0 tx=0).stop 2023-10-05T21:15:18.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.360+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2475268271 shutdown_connections 2023-10-05T21:15:18.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.360+0000 7f9f7a3b9680 1 --2- 172.21.15.153:0/2475268271 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d70c3d0 0x557e6d682110 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.360+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2475268271 >> 172.21.15.153:0/2475268271 conn(0x557e6d707ca0 msgr2=0x557e6d7271e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.360+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2475268271 shutdown_connections 2023-10-05T21:15:18.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.360+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2475268271 wait complete. 2023-10-05T21:15:18.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.360+0000 7f9f7a3b9680 1 Processor -- start 2023-10-05T21:15:18.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.360+0000 7f9f7a3b9680 1 -- start start 2023-10-05T21:15:18.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.360+0000 7f9f7a3b9680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d70c3d0 0x557e6d734dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.360+0000 7f9f7a3b9680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e6d5b0c80 con 0x557e6d70c3d0 2023-10-05T21:15:18.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.361+0000 7f9f6d491700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d70c3d0 0x557e6d734dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.361+0000 7f9f6d491700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d70c3d0 0x557e6d734dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37910/0 (socket says 172.21.15.153:37910) 2023-10-05T21:15:18.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.361+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 learned_addr learned my addr 172.21.15.153:0/2493833806 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:18.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.361+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f64001a70 con 0x557e6d70c3d0 2023-10-05T21:15:18.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.361+0000 7f9f6d491700 1 --2- 172.21.15.153:0/2493833806 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d70c3d0 0x557e6d734dc0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9f640017d0 tx=0x7f9f64016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.361+0000 7f9f5d7fa700 1 -- 172.21.15.153:0/2493833806 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f6401f070 con 0x557e6d70c3d0 2023-10-05T21:15:18.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.361+0000 7f9f5d7fa700 1 -- 172.21.15.153:0/2493833806 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6401a4d0 con 0x557e6d70c3d0 2023-10-05T21:15:18.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.361+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557e6d735300 con 0x557e6d70c3d0 2023-10-05T21:15:18.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.361+0000 7f9f5d7fa700 1 -- 172.21.15.153:0/2493833806 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f6401a7a0 con 0x557e6d70c3d0 2023-10-05T21:15:18.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.361+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557e6d735750 con 0x557e6d70c3d0 2023-10-05T21:15:18.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.362+0000 7f9f5d7fa700 1 -- 172.21.15.153:0/2493833806 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f9f6401a900 con 0x557e6d70c3d0 2023-10-05T21:15:18.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.362+0000 7f9f5d7fa700 1 --2- 172.21.15.153:0/2493833806 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9f50034140 0x7f9f500365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.362+0000 7f9f7a3b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.362+0000 7f9f5d7fa700 1 -- 172.21.15.153:0/2493833806 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f9f64048e90 con 0x557e6d70c3d0 2023-10-05T21:15:18.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.362+0000 7f9f6cc90700 1 --2- 172.21.15.153:0/2493833806 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9f50034140 0x7f9f500365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.362+0000 7f9f7a3b9680 1 --2- 172.21.15.153:0/2493833806 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x557e6d710900 0x557e6d740b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.363+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d7412a0 con 0x557e6d710900 2023-10-05T21:15:18.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.363+0000 7f9f6dc92700 1 --2- 172.21.15.153:0/2493833806 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x557e6d710900 0x557e6d740b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.363+0000 7f9f6cc90700 1 --2- 172.21.15.153:0/2493833806 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9f50034140 0x7f9f500365f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9f60003080 tx=0x7f9f60015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.363+0000 7f9f6dc92700 1 --2- 172.21.15.153:0/2493833806 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x557e6d710900 0x557e6d740b10 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.363+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.363+0000 7f9f7a3b9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.363+0000 7f9f7a3b9680 20 realm 2023-10-05T21:15:18.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.363+0000 7f9f7a3b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.363+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d73e130 con 0x557e6d710900 2023-10-05T21:15:18.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.363+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.363+0000 7f9f7a3b9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.363+0000 7f9f7a3b9680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:18.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.363+0000 7f9f7a3b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.363+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d741da0 con 0x557e6d710900 2023-10-05T21:15:18.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.364+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.364+0000 7f9f7a3b9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.364+0000 7f9f7a3b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.364+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d7426c0 con 0x557e6d710900 2023-10-05T21:15:18.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.364+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.364+0000 7f9f7a3b9680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:18.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.364+0000 7f9f7a3b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.364+0000 7f9f7a3b9680 1 --2- 172.21.15.153:0/2493833806 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x557e6d742f80 0x557e6d745360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.364+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d7459b0 con 0x557e6d742f80 2023-10-05T21:15:18.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.364+0000 7f9f6d491700 1 --2- 172.21.15.153:0/2493833806 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x557e6d742f80 0x557e6d745360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.364+0000 7f9f6d491700 1 --2- 172.21.15.153:0/2493833806 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x557e6d742f80 0x557e6d745360 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.364+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d742f80 2023-10-05T21:15:18.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.365+0000 7f9f7a3b9680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:18.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.365+0000 7f9f7a3b9680 20 searching for the correct realm 2023-10-05T21:15:18.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.365+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x557e6d742f80 2023-10-05T21:15:18.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.365+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d742f80 2023-10-05T21:15:18.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.365+0000 7f9f6d491700 1 --2- 172.21.15.153:0/2493833806 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f9f64016730 0x7f9f640235f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.365+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x7f9f64016730 2023-10-05T21:15:18.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.365+0000 7f9f6cc90700 1 --2- 172.21.15.153:0/2493833806 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f9f64016730 0x7f9f640235f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.365+0000 7f9f6cc90700 1 --2- 172.21.15.153:0/2493833806 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f9f64016730 0x7f9f640235f0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.365+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f60019040 con 0x7f9f64016730 2023-10-05T21:15:18.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.365+0000 7f9f6cc90700 1 --2- 172.21.15.153:0/2493833806 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f9f60007030 0x7f9f6001d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.365+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x7f9f60007030 2023-10-05T21:15:18.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.366+0000 7f9f6dc92700 1 --2- 172.21.15.153:0/2493833806 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f9f60007030 0x7f9f6001d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.366+0000 7f9f6dc92700 1 --2- 172.21.15.153:0/2493833806 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f9f60007030 0x7f9f6001d420 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.366+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.366+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x557e6d710900 2023-10-05T21:15:18.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.366+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.366+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x557e6d710900 2023-10-05T21:15:18.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.367+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.367+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x7f9f60007030 2023-10-05T21:15:18.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.367+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.367+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x7f9f60007030 2023-10-05T21:15:18.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.367+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.367+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x7f9f64016730 2023-10-05T21:15:18.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.367+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f60019040 con 0x7f9f64016730 2023-10-05T21:15:18.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.367+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x557e6d742f80 2023-10-05T21:15:18.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.368+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d742f80 2023-10-05T21:15:18.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.368+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x557e6d710900 2023-10-05T21:15:18.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.368+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.368+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x7f9f60007030 2023-10-05T21:15:18.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.368+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.368+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x557e6d710900 2023-10-05T21:15:18.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.368+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.368+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x7f9f64016730 2023-10-05T21:15:18.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.368+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f60019040 con 0x7f9f64016730 2023-10-05T21:15:18.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.369+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x557e6d742f80 2023-10-05T21:15:18.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.369+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d742f80 2023-10-05T21:15:18.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.369+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x557e6d742f80 2023-10-05T21:15:18.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.369+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d742f80 2023-10-05T21:15:18.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.369+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x7f9f60007030 2023-10-05T21:15:18.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.369+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.369+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x557e6d742f80 2023-10-05T21:15:18.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.369+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d742f80 2023-10-05T21:15:18.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.369+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x557e6d742f80 2023-10-05T21:15:18.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.370+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d742f80 2023-10-05T21:15:18.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.370+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x557e6d710900 2023-10-05T21:15:18.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.370+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.370+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x557e6d710900 2023-10-05T21:15:18.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.370+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.370+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x7f9f60007030 2023-10-05T21:15:18.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.370+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.370+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x557e6d742f80 2023-10-05T21:15:18.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.370+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d742f80 2023-10-05T21:15:18.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.370+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x7f9f64016730 2023-10-05T21:15:18.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.371+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f60019040 con 0x7f9f64016730 2023-10-05T21:15:18.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.371+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x557e6d710900 2023-10-05T21:15:18.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.371+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.371+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x7f9f60007030 2023-10-05T21:15:18.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.371+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.371+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x557e6d742f80 2023-10-05T21:15:18.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.371+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d742f80 2023-10-05T21:15:18.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.371+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x7f9f60007030 2023-10-05T21:15:18.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.371+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.371+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x7f9f64016730 2023-10-05T21:15:18.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.372+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f60019040 con 0x7f9f64016730 2023-10-05T21:15:18.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.372+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x557e6d742f80 2023-10-05T21:15:18.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.372+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d742f80 2023-10-05T21:15:18.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.372+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x7f9f60007030 2023-10-05T21:15:18.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.372+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.372+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x557e6d710900 2023-10-05T21:15:18.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.372+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.372+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747520 con 0x7f9f64016730 2023-10-05T21:15:18.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.373+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f60019040 con 0x7f9f64016730 2023-10-05T21:15:18.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.373+0000 7f9f7a3b9680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:18.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.373+0000 7f9f7a3b9680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:18.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.373+0000 7f9f7a3b9680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:18.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.373+0000 7f9f7a3b9680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:18.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.373+0000 7f9f7a3b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.373+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d746470 con 0x557e6d710900 2023-10-05T21:15:18.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.373+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.373+0000 7f9f7a3b9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.373+0000 7f9f7a3b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.373+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d746870 con 0x557e6d710900 2023-10-05T21:15:18.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.373+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.373+0000 7f9f7a3b9680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:18.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.373+0000 7f9f7a3b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.373+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d7479b0 con 0x557e6d710900 2023-10-05T21:15:18.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.373+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.373+0000 7f9f7a3b9680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:18.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.373+0000 7f9f7a3b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.373+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d747d60 con 0x557e6d742f80 2023-10-05T21:15:18.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.374+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d742f80 2023-10-05T21:15:18.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.374+0000 7f9f7a3b9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.374+0000 7f9f7a3b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.374+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d748110 con 0x557e6d710900 2023-10-05T21:15:18.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.374+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.374+0000 7f9f7a3b9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.374+0000 7f9f7a3b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.374+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d748110 con 0x557e6d710900 2023-10-05T21:15:18.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.374+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.374+0000 7f9f7a3b9680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:18.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.374+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d748110 con 0x557e6d742f80 2023-10-05T21:15:18.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.374+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d742f80 2023-10-05T21:15:18.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.374+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d748110 con 0x7f9f64016730 2023-10-05T21:15:18.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.374+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f60019040 con 0x7f9f64016730 2023-10-05T21:15:18.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.375+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d748110 con 0x7f9f60007030 2023-10-05T21:15:18.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.375+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.375+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d7479b0 con 0x557e6d710900 2023-10-05T21:15:18.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.375+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.375+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d7479b0 con 0x557e6d710900 2023-10-05T21:15:18.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.375+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.375+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d7479b0 con 0x7f9f60007030 2023-10-05T21:15:18.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.376+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.376+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d7479b0 con 0x7f9f60007030 2023-10-05T21:15:18.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.376+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.376+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d7479b0 con 0x7f9f64016730 2023-10-05T21:15:18.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.376+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f60019040 con 0x7f9f64016730 2023-10-05T21:15:18.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.376+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d7479b0 con 0x557e6d742f80 2023-10-05T21:15:18.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.376+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d742f80 2023-10-05T21:15:18.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.376+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d7479b0 con 0x557e6d710900 2023-10-05T21:15:18.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.376+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.377+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d7479b0 con 0x7f9f60007030 2023-10-05T21:15:18.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.377+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.377+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d7479b0 con 0x557e6d710900 2023-10-05T21:15:18.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.377+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.377+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d7479b0 con 0x7f9f64016730 2023-10-05T21:15:18.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.377+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f60019040 con 0x7f9f64016730 2023-10-05T21:15:18.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.377+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d7479b0 con 0x557e6d742f80 2023-10-05T21:15:18.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.377+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d742f80 2023-10-05T21:15:18.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.377+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d7479b0 con 0x557e6d742f80 2023-10-05T21:15:18.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.378+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d742f80 2023-10-05T21:15:18.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.378+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f6404d040 con 0x7f9f60007030 2023-10-05T21:15:18.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.378+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.378+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f6404d040 con 0x557e6d742f80 2023-10-05T21:15:18.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.378+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d742f80 2023-10-05T21:15:18.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.378+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f6404d040 con 0x557e6d742f80 2023-10-05T21:15:18.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.378+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d742f80 2023-10-05T21:15:18.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.378+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f6404d040 con 0x557e6d710900 2023-10-05T21:15:18.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.379+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.379+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f6404d040 con 0x557e6d710900 2023-10-05T21:15:18.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.379+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.379+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f6404d040 con 0x7f9f60007030 2023-10-05T21:15:18.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.379+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.379+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f6404d040 con 0x557e6d742f80 2023-10-05T21:15:18.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.379+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d742f80 2023-10-05T21:15:18.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.379+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f6404d040 con 0x7f9f64016730 2023-10-05T21:15:18.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.379+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f60019040 con 0x7f9f64016730 2023-10-05T21:15:18.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.379+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f6404d040 con 0x557e6d710900 2023-10-05T21:15:18.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.380+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.380+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f6404d040 con 0x7f9f60007030 2023-10-05T21:15:18.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.380+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.380+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f6404d040 con 0x557e6d742f80 2023-10-05T21:15:18.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.380+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d742f80 2023-10-05T21:15:18.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.380+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f6404d040 con 0x7f9f60007030 2023-10-05T21:15:18.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.380+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.380+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f6404d040 con 0x7f9f64016730 2023-10-05T21:15:18.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.381+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f60019040 con 0x7f9f64016730 2023-10-05T21:15:18.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.381+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f6404d040 con 0x557e6d742f80 2023-10-05T21:15:18.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.381+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d742f80 2023-10-05T21:15:18.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.381+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f6404d040 con 0x7f9f60007030 2023-10-05T21:15:18.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.381+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.381+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f6404d040 con 0x557e6d710900 2023-10-05T21:15:18.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.381+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.381+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f6404d040 con 0x7f9f64016730 2023-10-05T21:15:18.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.382+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f60019040 con 0x7f9f64016730 2023-10-05T21:15:18.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.382+0000 7f9f7a3b9680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:18.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.382+0000 7f9f7a3b9680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:18.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.382+0000 7f9f7a3b9680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:18.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.382+0000 7f9f7a3b9680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:18.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.382+0000 7f9f7a3b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.382+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d748110 con 0x557e6d710900 2023-10-05T21:15:18.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.382+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.382+0000 7f9f7a3b9680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:18.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.382+0000 7f9f7a3b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.382+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d748510 con 0x557e6d742f80 2023-10-05T21:15:18.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.382+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d742f80 2023-10-05T21:15:18.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.382+0000 7f9f7a3b9680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:18.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.382+0000 7f9f7a3b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.382+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d748db0 con 0x557e6d710900 2023-10-05T21:15:18.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.382+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.382+0000 7f9f7a3b9680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:18.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.382+0000 7f9f7a3b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.382+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d748db0 con 0x557e6d710900 2023-10-05T21:15:18.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.383+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.383+0000 7f9f7a3b9680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:18.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.383+0000 7f9f7a3b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.383+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d748eb0 con 0x7f9f60007030 2023-10-05T21:15:18.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.383+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.383+0000 7f9f7a3b9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.383+0000 7f9f7a3b9680 20 zone default found 2023-10-05T21:15:18.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.383+0000 7f9f7a3b9680 4 Realm: () 2023-10-05T21:15:18.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.383+0000 7f9f7a3b9680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:18.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.383+0000 7f9f7a3b9680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:18.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.383+0000 7f9f7a3b9680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:18.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.383+0000 7f9f7a3b9680 20 zonegroup default 2023-10-05T21:15:18.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.383+0000 7f9f7a3b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.383+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d748eb0 con 0x7f9f60007030 2023-10-05T21:15:18.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.383+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.383+0000 7f9f7a3b9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.383+0000 7f9f7a3b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.383+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d74a830 con 0x557e6d742f80 2023-10-05T21:15:18.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.383+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d742f80 2023-10-05T21:15:18.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.383+0000 7f9f7a3b9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.383+0000 7f9f7a3b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.383+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d74abe0 con 0x557e6d742f80 2023-10-05T21:15:18.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.384+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d742f80 2023-10-05T21:15:18.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.384+0000 7f9f7a3b9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.384+0000 7f9f7a3b9680 20 started sync module instance, tier type = 2023-10-05T21:15:18.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.384+0000 7f9f7a3b9680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:18.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.384+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d749ef0 con 0x7f9f64016730 2023-10-05T21:15:18.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.384+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f60019040 con 0x7f9f64016730 2023-10-05T21:15:18.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.384+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94001490600688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d74b480 con 0x7f9f64016730 2023-10-05T21:15:18.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.384+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d74bd20 con 0x557e6d710900 2023-10-05T21:15:18.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.385+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94001490600688] v29'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f60019040 con 0x7f9f64016730 2023-10-05T21:15:18.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.385+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.385+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94001490603920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d74bd20 con 0x557e6d710900 2023-10-05T21:15:18.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.385+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d74c8b0 con 0x557e6d742f80 2023-10-05T21:15:18.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.386+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94001490603920] v29'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.386+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d742f80 2023-10-05T21:15:18.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.386+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94001490606128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d74bc80 con 0x557e6d742f80 2023-10-05T21:15:18.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.386+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d74d690 con 0x7f9f64016730 2023-10-05T21:15:18.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.387+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f60019040 con 0x7f9f64016730 2023-10-05T21:15:18.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.387+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94001490606128] v29'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d742f80 2023-10-05T21:15:18.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.387+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94001490612640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d74df80 con 0x7f9f64016730 2023-10-05T21:15:18.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.387+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d74e850 con 0x557e6d710900 2023-10-05T21:15:18.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.388+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.388+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94001490612640] v29'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f60019040 con 0x7f9f64016730 2023-10-05T21:15:18.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.388+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94001490617184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d74e7b0 con 0x557e6d710900 2023-10-05T21:15:18.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.388+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d74f2b0 con 0x7f9f60007030 2023-10-05T21:15:18.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.388+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94001490617184] v29'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.388+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.388+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94001490619744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d74f270 con 0x7f9f60007030 2023-10-05T21:15:18.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.388+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d74fd80 con 0x7f9f60007030 2023-10-05T21:15:18.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.389+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(96 notify.6 [create] v29'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.389+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(95 notify.5 [watch watch cookie 94001490619744] v29'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.389+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94001490622544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d750270 con 0x7f9f60007030 2023-10-05T21:15:18.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.389+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d74da90 con 0x7f9f60007030 2023-10-05T21:15:18.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.390+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94001490622544] v29'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.390+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.390+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94001490623872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d7501d0 con 0x7f9f60007030 2023-10-05T21:15:18.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.390+0000 7f9f7a3b9680 20 add_watcher() i=0 2023-10-05T21:15:18.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.390+0000 7f9f7a3b9680 20 add_watcher() i=1 2023-10-05T21:15:18.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.390+0000 7f9f7a3b9680 20 add_watcher() i=2 2023-10-05T21:15:18.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.390+0000 7f9f7a3b9680 20 add_watcher() i=3 2023-10-05T21:15:18.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.390+0000 7f9f7a3b9680 20 add_watcher() i=4 2023-10-05T21:15:18.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.390+0000 7f9f7a3b9680 20 add_watcher() i=5 2023-10-05T21:15:18.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.390+0000 7f9f7a3b9680 20 add_watcher() i=6 2023-10-05T21:15:18.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.391+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94001490623872] v29'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.391+0000 7f9f7a3b9680 20 add_watcher() i=7 2023-10-05T21:15:18.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.391+0000 7f9f7a3b9680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:18.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.391+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d753d70 con 0x557e6d710900 2023-10-05T21:15:18.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.391+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.391+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94001490626640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d751190 con 0x557e6d710900 2023-10-05T21:15:18.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.392+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94001490626640] v29'134 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.392+0000 7f9f3e7e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:18.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.392+0000 7f9f7a3b9680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:18.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.392+0000 7f9f7a3b9680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:18.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.392+0000 7f9f7a3b9680 1 Processor -- start 2023-10-05T21:15:18.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.392+0000 7f9f7a3b9680 1 -- start start 2023-10-05T21:15:18.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.392+0000 7f9f7a3b9680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d75d830 0x557e6d75dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.392+0000 7f9f7a3b9680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e6d75e250 con 0x557e6d75d830 2023-10-05T21:15:18.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.392+0000 7f9f6cc90700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d75d830 0x557e6d75dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.392+0000 7f9f6cc90700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d75d830 0x557e6d75dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37926/0 (socket says 172.21.15.153:37926) 2023-10-05T21:15:18.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.392+0000 7f9f6cc90700 1 -- 172.21.15.153:0/1943518828 learned_addr learned my addr 172.21.15.153:0/1943518828 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:18.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.393+0000 7f9f6cc90700 1 -- 172.21.15.153:0/1943518828 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e6d75e730 con 0x557e6d75d830 2023-10-05T21:15:18.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.393+0000 7f9f6cc90700 1 --2- 172.21.15.153:0/1943518828 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d75d830 0x557e6d75dc40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x557e6d70d0a0 tx=0x7f9f60012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=967b605021f52d06 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.393+0000 7f9f3dfe3700 1 -- 172.21.15.153:0/1943518828 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f6001ddc0 con 0x557e6d75d830 2023-10-05T21:15:18.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.393+0000 7f9f3dfe3700 1 -- 172.21.15.153:0/1943518828 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6002b440 con 0x557e6d75d830 2023-10-05T21:15:18.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.393+0000 7f9f3dfe3700 1 -- 172.21.15.153:0/1943518828 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f6002b5f0 con 0x557e6d75d830 2023-10-05T21:15:18.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.394+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/1943518828 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d75d830 msgr2=0x557e6d75dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.394+0000 7f9f7a3b9680 1 --2- 172.21.15.153:0/1943518828 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d75d830 0x557e6d75dc40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x557e6d70d0a0 tx=0x7f9f60012000 comp rx=0 tx=0).stop 2023-10-05T21:15:18.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.394+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/1943518828 shutdown_connections 2023-10-05T21:15:18.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.394+0000 7f9f7a3b9680 1 --2- 172.21.15.153:0/1943518828 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d75d830 0x557e6d75dc40 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.394+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/1943518828 >> 172.21.15.153:0/1943518828 conn(0x557e6d759b30 msgr2=0x557e6d757c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.394+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/1943518828 shutdown_connections 2023-10-05T21:15:18.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.394+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/1943518828 wait complete. 2023-10-05T21:15:18.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.394+0000 7f9f7a3b9680 1 Processor -- start 2023-10-05T21:15:18.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.394+0000 7f9f7a3b9680 1 -- start start 2023-10-05T21:15:18.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.394+0000 7f9f7a3b9680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d75d830 0x557e6d7644f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.394+0000 7f9f7a3b9680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e6d764a30 con 0x557e6d75d830 2023-10-05T21:15:18.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.394+0000 7f9f6cc90700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d75d830 0x557e6d7644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.394+0000 7f9f6cc90700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d75d830 0x557e6d7644f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37940/0 (socket says 172.21.15.153:37940) 2023-10-05T21:15:18.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.394+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2411036192 learned_addr learned my addr 172.21.15.153:0/2411036192 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:18.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.395+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e6d714230 con 0x557e6d75d830 2023-10-05T21:15:18.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.395+0000 7f9f6cc90700 1 --2- 172.21.15.153:0/2411036192 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d75d830 0x557e6d7644f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x557e6d7590a0 tx=0x7f9f60030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.395+0000 7f9eaffff700 1 -- 172.21.15.153:0/2411036192 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f6003f580 con 0x557e6d75d830 2023-10-05T21:15:18.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.395+0000 7f9eaffff700 1 -- 172.21.15.153:0/2411036192 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6003f6e0 con 0x557e6d75d830 2023-10-05T21:15:18.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.395+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557e6d764c30 con 0x557e6d75d830 2023-10-05T21:15:18.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.395+0000 7f9eaffff700 1 -- 172.21.15.153:0/2411036192 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f6003f890 con 0x557e6d75d830 2023-10-05T21:15:18.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.395+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557e6d765020 con 0x557e6d75d830 2023-10-05T21:15:18.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.396+0000 7f9eaffff700 1 -- 172.21.15.153:0/2411036192 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f9f60047070 con 0x557e6d75d830 2023-10-05T21:15:18.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.396+0000 7f9eaffff700 1 --2- 172.21.15.153:0/2411036192 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9eb4034140 0x7f9eb40365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.396+0000 7f9eaffff700 1 -- 172.21.15.153:0/2411036192 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f9f60030070 con 0x557e6d75d830 2023-10-05T21:15:18.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.396+0000 7f9f6dc92700 1 --2- 172.21.15.153:0/2411036192 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9eb4034140 0x7f9eb40365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.396+0000 7f9f7a3b9680 1 --2- 172.21.15.153:0/2411036192 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x557e6d76f350 0x557e6d7717c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.396+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d771ec0 con 0x557e6d76f350 2023-10-05T21:15:18.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.396+0000 7f9f6d491700 1 --2- 172.21.15.153:0/2411036192 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x557e6d76f350 0x557e6d7717c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.396+0000 7f9f6dc92700 1 --2- 172.21.15.153:0/2411036192 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9eb4034140 0x7f9eb40365f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x557e6d750400 tx=0x7f9f68037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.396+0000 7f9f6d491700 1 --2- 172.21.15.153:0/2411036192 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x557e6d76f350 0x557e6d7717c0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.397+0000 7f9f6d491700 1 -- 172.21.15.153:0/2411036192 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v29'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d76f350 2023-10-05T21:15:18.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.397+0000 7f9f7a3b9680 1 --2- 172.21.15.153:0/2411036192 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x557e6d772c40 0x557e6d775020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.397+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d7756e0 con 0x557e6d772c40 2023-10-05T21:15:18.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.397+0000 7f9f6cc90700 1 --2- 172.21.15.153:0/2411036192 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x557e6d772c40 0x557e6d775020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.398+0000 7f9f6cc90700 1 --2- 172.21.15.153:0/2411036192 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x557e6d772c40 0x557e6d775020 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.398+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2411036192 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v29'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9f60033040 con 0x557e6d772c40 2023-10-05T21:15:18.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.398+0000 7f9f7a3b9680 1 --2- 172.21.15.153:0/2411036192 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x557e6d776490 0x557e6d7788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.398+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d779000 con 0x557e6d776490 2023-10-05T21:15:18.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.399+0000 7f9f6dc92700 1 --2- 172.21.15.153:0/2411036192 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x557e6d776490 0x557e6d7788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.399+0000 7f9f6dc92700 1 --2- 172.21.15.153:0/2411036192 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x557e6d776490 0x557e6d7788b0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.399+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2411036192 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v29'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d776490 2023-10-05T21:15:18.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.399+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d779730 con 0x557e6d76f350 2023-10-05T21:15:18.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.400+0000 7f9f6d491700 1 -- 172.21.15.153:0/2411036192 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v29'135 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d76f350 2023-10-05T21:15:18.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.400+0000 7f9f7a3b9680 1 --2- 172.21.15.153:0/2411036192 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x557e6d77a490 0x557e6d77c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.400+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d77cf30 con 0x557e6d77a490 2023-10-05T21:15:18.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.400+0000 7f9f6d491700 1 --2- 172.21.15.153:0/2411036192 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x557e6d77a490 0x557e6d77c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.401+0000 7f9f6d491700 1 --2- 172.21.15.153:0/2411036192 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x557e6d77a490 0x557e6d77c870 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.401+0000 7f9f6d491700 1 -- 172.21.15.153:0/2411036192 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v29'41 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d77a490 2023-10-05T21:15:18.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.401+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d77d660 con 0x557e6d776490 2023-10-05T21:15:18.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.402+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2411036192 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v29'25 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d776490 2023-10-05T21:15:18.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.402+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d77da90 con 0x557e6d76f350 2023-10-05T21:15:18.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.403+0000 7f9f6d491700 1 -- 172.21.15.153:0/2411036192 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v29'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d76f350 2023-10-05T21:15:18.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.403+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d77da90 con 0x557e6d772c40 2023-10-05T21:15:18.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.404+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2411036192 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v29'28 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9f60033040 con 0x557e6d772c40 2023-10-05T21:15:18.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.404+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d77e100 con 0x557e6d77a490 2023-10-05T21:15:18.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.404+0000 7f9f6d491700 1 -- 172.21.15.153:0/2411036192 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v29'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d77a490 2023-10-05T21:15:18.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.404+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d77e100 con 0x557e6d776490 2023-10-05T21:15:18.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.405+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2411036192 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v29'22 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d776490 2023-10-05T21:15:18.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.405+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d77e770 con 0x557e6d77a490 2023-10-05T21:15:18.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.406+0000 7f9f6d491700 1 -- 172.21.15.153:0/2411036192 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v29'42 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d77a490 2023-10-05T21:15:18.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.406+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d77e770 con 0x557e6d772c40 2023-10-05T21:15:18.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.407+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2411036192 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v29'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9f60033040 con 0x557e6d772c40 2023-10-05T21:15:18.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.407+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d77ed90 con 0x557e6d77a490 2023-10-05T21:15:18.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.407+0000 7f9f6d491700 1 -- 172.21.15.153:0/2411036192 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v29'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d77a490 2023-10-05T21:15:18.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.407+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d77ed90 con 0x557e6d772c40 2023-10-05T21:15:18.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.408+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2411036192 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v29'31 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9f60033040 con 0x557e6d772c40 2023-10-05T21:15:18.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.408+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d77f430 con 0x557e6d76f350 2023-10-05T21:15:18.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.409+0000 7f9f6d491700 1 -- 172.21.15.153:0/2411036192 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v29'136 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d76f350 2023-10-05T21:15:18.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.409+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d77f410 con 0x557e6d776490 2023-10-05T21:15:18.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.410+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2411036192 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v29'32 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d776490 2023-10-05T21:15:18.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.410+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d77f410 con 0x557e6d77a490 2023-10-05T21:15:18.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.410+0000 7f9f6d491700 1 -- 172.21.15.153:0/2411036192 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v29'43 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d77a490 2023-10-05T21:15:18.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.411+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d77f410 con 0x557e6d776490 2023-10-05T21:15:18.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.411+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2411036192 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v29'16 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d776490 2023-10-05T21:15:18.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.411+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d77f410 con 0x557e6d76f350 2023-10-05T21:15:18.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.412+0000 7f9f6d491700 1 -- 172.21.15.153:0/2411036192 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v29'26 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d76f350 2023-10-05T21:15:18.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.412+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d77f410 con 0x557e6d76f350 2023-10-05T21:15:18.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.413+0000 7f9f6d491700 1 -- 172.21.15.153:0/2411036192 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v29'137 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d76f350 2023-10-05T21:15:18.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.413+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d77f410 con 0x557e6d776490 2023-10-05T21:15:18.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.414+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2411036192 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v29'33 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d776490 2023-10-05T21:15:18.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.414+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d77f410 con 0x557e6d77a490 2023-10-05T21:15:18.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.414+0000 7f9f6d491700 1 -- 172.21.15.153:0/2411036192 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v29'31 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d77a490 2023-10-05T21:15:18.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.414+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d77f410 con 0x557e6d776490 2023-10-05T21:15:18.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.415+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2411036192 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v29'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d776490 2023-10-05T21:15:18.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.415+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d77f410 con 0x557e6d776490 2023-10-05T21:15:18.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.416+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2411036192 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v29'22 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d776490 2023-10-05T21:15:18.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.416+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d77f4c0 con 0x557e6d776490 2023-10-05T21:15:18.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.416+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2411036192 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v29'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d776490 2023-10-05T21:15:18.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.416+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d77f4c0 con 0x557e6d776490 2023-10-05T21:15:18.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.417+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2411036192 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v29'26 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d776490 2023-10-05T21:15:18.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.417+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d77f4c0 con 0x557e6d772c40 2023-10-05T21:15:18.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.418+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2411036192 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v29'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9f60033040 con 0x557e6d772c40 2023-10-05T21:15:18.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.418+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d77f4c0 con 0x557e6d776490 2023-10-05T21:15:18.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.419+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2411036192 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v29'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d776490 2023-10-05T21:15:18.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.419+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d77f4c0 con 0x557e6d772c40 2023-10-05T21:15:18.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.419+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2411036192 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v29'29 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9f60033040 con 0x557e6d772c40 2023-10-05T21:15:18.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.419+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d77f4c0 con 0x557e6d776490 2023-10-05T21:15:18.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.420+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2411036192 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v29'34 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d776490 2023-10-05T21:15:18.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.420+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d77f4c0 con 0x557e6d772c40 2023-10-05T21:15:18.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.421+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2411036192 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v29'32 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9f60033040 con 0x557e6d772c40 2023-10-05T21:15:18.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.421+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d77f4c0 con 0x557e6d77a490 2023-10-05T21:15:18.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.422+0000 7f9f6d491700 1 -- 172.21.15.153:0/2411036192 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v29'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d77a490 2023-10-05T21:15:18.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.423+0000 7f9ead7fa700 20 reqs_thread_entry: start 2023-10-05T21:15:18.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.423+0000 7f9ea6ffd700 20 reqs_thread_entry: start 2023-10-05T21:15:18.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.423+0000 7f9f7a3b9680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:18.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.423+0000 7f9f7a3b9680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:18.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.423+0000 7f9ea57fa700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:48 2023 2023-10-05T21:15:18.455 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:18.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.423+0000 7f9ea4ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:18.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.423+0000 7f9f7a3b9680 20 get_system_obj_state: rctx=0x7fffb4c45c38 obj=default.rgw.meta:users.uid:testx$tenanteduser state=0x557e6d5bf240 s->prefetch_data=0 2023-10-05T21:15:18.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.423+0000 7f9f7a3b9680 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2023-10-05T21:15:18.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.423+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d7daa00 con 0x7f9f60007030 2023-10-05T21:15:18.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.424+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(102 testx$tenanteduser [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 246+0+139 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.424+0000 7f9f7a3b9680 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x16 2023-10-05T21:15:18.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.424+0000 7f9f7a3b9680 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2023-10-05T21:15:18.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.424+0000 7f9f7a3b9680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:18.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.424+0000 7f9f7a3b9680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:18.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.424+0000 7f9f7a3b9680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:18.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.424+0000 7f9f7a3b9680 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:18.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.424+0000 7f9f7a3b9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.424+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:103 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d7dcc90 con 0x7f9f60007030 2023-10-05T21:15:18.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.424+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(103 testx$tenanteduser [call,call out=48b,read 0~385 out=385b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 288+0+508 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.424+0000 7f9f7a3b9680 20 rados_obj.operate() r=0 bl.length=385 2023-10-05T21:15:18.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.424+0000 7f9f7a3b9680 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2023-10-05T21:15:18.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.424+0000 7f9f7a3b9680 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2023-10-05T21:15:18.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.424+0000 7f9f7a3b9680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:18.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.424+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:104 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d7dcc90 con 0x557e6d710900 2023-10-05T21:15:18.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.425+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(104 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) v8 ==== 170+0+15 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.425+0000 7f9f7a3b9680 10 removing key index: p5YnriCv1nAtykxBrupQ 2023-10-05T21:15:18.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.425+0000 7f9f7a3b9680 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2023-10-05T21:15:18.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.425+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:105 7.15 7:a93a5511:::notify.2:head [notify cookie 94001491195168 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d7dbe60 con 0x557e6d742f80 2023-10-05T21:15:18.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.425+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== watch-notify(notify (1) cookie 94001490606128 notify 124554051594 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x7f9f640467a0 con 0x557e6d742f80 2023-10-05T21:15:18.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.425+0000 7f9f5effd700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051594 cookie 94001490606128 notifier 4508 bl.length()=170 2023-10-05T21:15:18.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.425+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(105 notify.2 [notify cookie 94001491195168 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d742f80 2023-10-05T21:15:18.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.425+0000 7f9f5effd700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f4c003c50 con 0x557e6d742f80 2023-10-05T21:15:18.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.425+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(106 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d742f80 2023-10-05T21:15:18.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.425+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== watch-notify(notify_complete (2) cookie 94001491195168 notify 124554051594 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557e6d735750 con 0x557e6d742f80 2023-10-05T21:15:18.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.425+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:107 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d7daa00 con 0x7f9f60007030 2023-10-05T21:15:18.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.426+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(107 p5YnriCv1nAtykxBrupQ [delete] v29'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.426+0000 7f9f7a3b9680 10 removing email index: 2023-10-05T21:15:18.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.426+0000 7f9f7a3b9680 10 removing user buckets index 2023-10-05T21:15:18.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.426+0000 7f9f7a3b9680 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2023-10-05T21:15:18.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.426+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [notify cookie 94001491195168 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d7dbe60 con 0x557e6d710900 2023-10-05T21:15:18.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.426+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== watch-notify(notify (1) cookie 94001490617184 notify 124554051602 ret 0) v3 ==== 217+0+0 (crc 0 0 0) 0x7f9f6802d040 con 0x557e6d710900 2023-10-05T21:15:18.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.426+0000 7f9f5e7fc700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051602 cookie 94001490617184 notifier 4508 bl.length()=175 2023-10-05T21:15:18.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.426+0000 7f9f5e7fc700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9ebc0032d0 con 0x557e6d710900 2023-10-05T21:15:18.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.426+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(108 notify.4 [notify cookie 94001491195168 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.427+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== watch-notify(notify_complete (2) cookie 94001491195168 notify 124554051602 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f9f68037d20 con 0x557e6d710900 2023-10-05T21:15:18.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.427+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(109 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.427+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:110 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d7daa00 con 0x557e6d710900 2023-10-05T21:15:18.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.427+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(110 testx$tenanteduser.buckets [delete] v29'3 uv3 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.427+0000 7f9f7a3b9680 10 removing user index: testx$tenanteduser 2023-10-05T21:15:18.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.427+0000 7f9f7a3b9680 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2023-10-05T21:15:18.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.427+0000 7f9f7a3b9680 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2023-10-05T21:15:18.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.427+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:111 7.e 7:7759931f:::notify.3:head [notify cookie 94001491191056 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d7dbe60 con 0x7f9f64016730 2023-10-05T21:15:18.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.428+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== watch-notify(notify (1) cookie 94001490612640 notify 124554051597 ret 0) v3 ==== 209+0+0 (crc 0 0 0) 0x557e6d765020 con 0x7f9f64016730 2023-10-05T21:15:18.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.428+0000 7f9f5effd700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051597 cookie 94001490612640 notifier 4508 bl.length()=167 2023-10-05T21:15:18.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.428+0000 7f9f5effd700 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:112 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f9f4c003c50 con 0x7f9f64016730 2023-10-05T21:15:18.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.428+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(111 notify.3 [notify cookie 94001491191056 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f9f60033040 con 0x7f9f64016730 2023-10-05T21:15:18.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.428+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(112 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f60033040 con 0x7f9f64016730 2023-10-05T21:15:18.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.428+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== watch-notify(notify_complete (2) cookie 94001491191056 notify 124554051597 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557e6d764c30 con 0x7f9f64016730 2023-10-05T21:15:18.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.428+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:113 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d7dba10 con 0x7f9f60007030 2023-10-05T21:15:18.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.429+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(113 testx$tenanteduser [call,delete] v29'8 uv8 ondisk = 0) v8 ==== 204+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.429+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:114 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94001490600688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d799530 con 0x7f9f64016730 2023-10-05T21:15:18.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.430+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== osd_op_reply(114 notify.0 [watch unwatch cookie 94001490600688] v29'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f60033040 con 0x7f9f64016730 2023-10-05T21:15:18.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.430+0000 7f9f7a3b9680 20 remove_watcher() i=0 2023-10-05T21:15:18.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.430+0000 7f9f7a3b9680 2 removed watcher, disabling cache 2023-10-05T21:15:18.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.430+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:115 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94001490603920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d74a2f0 con 0x557e6d710900 2023-10-05T21:15:18.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.431+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== osd_op_reply(115 notify.1 [watch unwatch cookie 94001490603920] v29'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.431+0000 7f9f7a3b9680 20 remove_watcher() i=1 2023-10-05T21:15:18.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.431+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:116 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94001490606128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d74af90 con 0x557e6d742f80 2023-10-05T21:15:18.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.431+0000 7f9f6d491700 1 -- 172.21.15.153:0/2493833806 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(116 notify.2 [watch unwatch cookie 94001490606128] v29'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f64014070 con 0x557e6d742f80 2023-10-05T21:15:18.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.431+0000 7f9f7a3b9680 20 remove_watcher() i=2 2023-10-05T21:15:18.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.431+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:117 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94001490612640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d74af90 con 0x7f9f64016730 2023-10-05T21:15:18.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.432+0000 7f9f6cc90700 1 -- 172.21.15.153:0/2493833806 <== osd.2 v2:172.21.15.153:6807/140454 22 ==== osd_op_reply(117 notify.3 [watch unwatch cookie 94001490612640] v29'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f60033040 con 0x7f9f64016730 2023-10-05T21:15:18.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.432+0000 7f9f7a3b9680 20 remove_watcher() i=3 2023-10-05T21:15:18.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.432+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:118 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94001490617184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d74d1a0 con 0x557e6d710900 2023-10-05T21:15:18.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.433+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 42 ==== osd_op_reply(118 notify.4 [watch unwatch cookie 94001490617184] v29'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.433+0000 7f9f7a3b9680 20 remove_watcher() i=4 2023-10-05T21:15:18.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.433+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:119 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94001490619744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d74e360 con 0x7f9f60007030 2023-10-05T21:15:18.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.434+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 31 ==== osd_op_reply(119 notify.5 [watch unwatch cookie 94001490619744] v29'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.434+0000 7f9f7a3b9680 20 remove_watcher() i=5 2023-10-05T21:15:18.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.434+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:120 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94001490622544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d74d1a0 con 0x7f9f60007030 2023-10-05T21:15:18.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.434+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 32 ==== osd_op_reply(120 notify.6 [watch unwatch cookie 94001490622544] v29'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.434+0000 7f9f7a3b9680 20 remove_watcher() i=6 2023-10-05T21:15:18.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.434+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:121 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94001490623872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d74e360 con 0x7f9f60007030 2023-10-05T21:15:18.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.435+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.0 v2:172.21.15.111:6800/111394 33 ==== osd_op_reply(121 notify.7 [watch unwatch cookie 94001490623872] v29'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x7f9f60007030 2023-10-05T21:15:18.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.435+0000 7f9f7a3b9680 20 remove_watcher() i=7 2023-10-05T21:15:18.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.436+0000 7f9f3e7e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:18.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.436+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:122 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94001490626640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557e6d74f850 con 0x557e6d710900 2023-10-05T21:15:18.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.436+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 <== osd.1 v2:172.21.15.153:6816/140456 43 ==== osd_op_reply(122 data_loggenerations_metadata [watch unwatch cookie 94001490626640] v29'138 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9f6800a570 con 0x557e6d710900 2023-10-05T21:15:18.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f9f60007030 msgr2=0x7f9f6001d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 --2- 172.21.15.153:0/2493833806 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f9f60007030 0x7f9f6001d420 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x557e6d710900 msgr2=0x557e6d740b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 --2- 172.21.15.153:0/2493833806 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x557e6d710900 0x557e6d740b10 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f9f64016730 msgr2=0x7f9f640235f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 --2- 172.21.15.153:0/2493833806 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f9f64016730 0x7f9f640235f0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x557e6d742f80 msgr2=0x557e6d745360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 --2- 172.21.15.153:0/2493833806 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x557e6d742f80 0x557e6d745360 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9f50034140 msgr2=0x7f9f500365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 --2- 172.21.15.153:0/2493833806 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9f50034140 0x7f9f500365f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9f60003080 tx=0x7f9f60015000 comp rx=0 tx=0).stop 2023-10-05T21:15:18.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d70c3d0 msgr2=0x557e6d734dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f6dc92700 1 -- 172.21.15.153:0/2493833806 reap_dead start 2023-10-05T21:15:18.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 --2- 172.21.15.153:0/2493833806 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d70c3d0 0x557e6d734dc0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9f640017d0 tx=0x7f9f64016000 comp rx=0 tx=0).stop 2023-10-05T21:15:18.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 shutdown_connections 2023-10-05T21:15:18.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 --2- 172.21.15.153:0/2493833806 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d70c3d0 0x557e6d734dc0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 >> 172.21.15.153:0/2493833806 conn(0x557e6d707ca0 msgr2=0x557e6d726d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 shutdown_connections 2023-10-05T21:15:18.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2493833806 wait complete. 2023-10-05T21:15:18.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x557e6d772c40 msgr2=0x557e6d775020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 --2- 172.21.15.153:0/2411036192 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x557e6d772c40 0x557e6d775020 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x557e6d76f350 msgr2=0x557e6d7717c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 --2- 172.21.15.153:0/2411036192 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x557e6d76f350 0x557e6d7717c0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x557e6d77a490 msgr2=0x557e6d77c870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 --2- 172.21.15.153:0/2411036192 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x557e6d77a490 0x557e6d77c870 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x557e6d776490 msgr2=0x557e6d7788b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 --2- 172.21.15.153:0/2411036192 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x557e6d776490 0x557e6d7788b0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9eb4034140 msgr2=0x7f9eb40365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 --2- 172.21.15.153:0/2411036192 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9eb4034140 0x7f9eb40365f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x557e6d750400 tx=0x7f9f68037450 comp rx=0 tx=0).stop 2023-10-05T21:15:18.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d75d830 msgr2=0x557e6d7644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 --2- 172.21.15.153:0/2411036192 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d75d830 0x557e6d7644f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x557e6d7590a0 tx=0x7f9f60030000 comp rx=0 tx=0).stop 2023-10-05T21:15:18.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f6d491700 1 -- 172.21.15.153:0/2411036192 reap_dead start 2023-10-05T21:15:18.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 shutdown_connections 2023-10-05T21:15:18.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 --2- 172.21.15.153:0/2411036192 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e6d75d830 0x557e6d7644f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 >> 172.21.15.153:0/2411036192 conn(0x557e6d759b30 msgr2=0x557e6d757c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 shutdown_connections 2023-10-05T21:15:18.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.437+0000 7f9f7a3b9680 1 -- 172.21.15.153:0/2411036192 wait complete. 2023-10-05T21:15:18.472 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2023-10-05T21:15:18.474 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2023-10-05T21:15:18.477 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T21:15:18.477 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2023-10-05T21:15:18.477 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2023-10-05T21:15:18.477 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2023-10-05T21:15:18.523 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:18.523 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:18.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.521+0000 7fc212602680 1 Processor -- start 2023-10-05T21:15:18.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.521+0000 7fc212602680 1 -- start start 2023-10-05T21:15:18.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.522+0000 7fc212602680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x563a149a3bf0 0x563a149a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.522+0000 7fc212602680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563a148ec930 con 0x563a1499d7c0 2023-10-05T21:15:18.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.522+0000 7fc212602680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x563a148acdb0 con 0x563a149a3bf0 2023-10-05T21:15:18.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.522+0000 7fc204ed9700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x563a149a3bf0 0x563a149a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.522+0000 7fc2056da700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x563a1499d7c0 0x563a1499dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:55244/0 (socket says 172.21.15.153:55244) 2023-10-05T21:15:18.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.522+0000 7fc2056da700 1 -- 172.21.15.153:0/3563919831 learned_addr learned my addr 172.21.15.153:0/3563919831 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:18.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.522+0000 7fc204ed9700 1 -- 172.21.15.153:0/3563919831 >> v1:172.21.15.111:6789/0 conn(0x563a1499d7c0 legacy=0x563a1499dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.522+0000 7fc1f7fff700 1 -- 172.21.15.153:0/3563919831 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 275497813 0 0) 0x563a148ec930 con 0x563a1499d7c0 2023-10-05T21:15:18.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.522+0000 7fc204ed9700 1 -- 172.21.15.153:0/3563919831 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a149a7520 con 0x563a149a3bf0 2023-10-05T21:15:18.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.522+0000 7fc204ed9700 1 --2- 172.21.15.153:0/3563919831 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563a149a3bf0 0x563a149a5fd0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc1f800a5d0 tx=0x7fc1f8005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea30a0e9146980b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.522+0000 7fc1f7fff700 1 -- 172.21.15.153:0/3563919831 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1f80086a0 con 0x563a149a3bf0 2023-10-05T21:15:18.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.522+0000 7fc1f7fff700 1 -- 172.21.15.153:0/3563919831 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f8008800 con 0x563a149a3bf0 2023-10-05T21:15:18.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.522+0000 7fc1f7fff700 1 -- 172.21.15.153:0/3563919831 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1f8008ad0 con 0x563a149a3bf0 2023-10-05T21:15:18.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.523+0000 7fc212602680 1 -- 172.21.15.153:0/3563919831 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563a149a3bf0 msgr2=0x563a149a5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.523+0000 7fc212602680 1 --2- 172.21.15.153:0/3563919831 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563a149a3bf0 0x563a149a5fd0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc1f800a5d0 tx=0x7fc1f8005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:18.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.523+0000 7fc212602680 1 -- 172.21.15.153:0/3563919831 shutdown_connections 2023-10-05T21:15:18.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.523+0000 7fc212602680 1 --2- 172.21.15.153:0/3563919831 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563a149a3bf0 0x563a149a5fd0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.523+0000 7fc212602680 1 -- 172.21.15.153:0/3563919831 >> 172.21.15.153:0/3563919831 conn(0x563a14999310 msgr2=0x563a1499b720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.523+0000 7fc212602680 1 -- 172.21.15.153:0/3563919831 shutdown_connections 2023-10-05T21:15:18.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.523+0000 7fc212602680 1 -- 172.21.15.153:0/3563919831 wait complete. 2023-10-05T21:15:18.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.524+0000 7fc212602680 1 Processor -- start 2023-10-05T21:15:18.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.524+0000 7fc212602680 1 -- start start 2023-10-05T21:15:18.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.524+0000 7fc212602680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563a1499d7c0 0x563a149a0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.524+0000 7fc212602680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a1484cea0 con 0x563a1499d7c0 2023-10-05T21:15:18.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.524+0000 7fc2056da700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563a1499d7c0 0x563a149a0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.524+0000 7fc2056da700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563a1499d7c0 0x563a149a0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37956/0 (socket says 172.21.15.153:37956) 2023-10-05T21:15:18.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.524+0000 7fc2056da700 1 -- 172.21.15.153:0/3964133567 learned_addr learned my addr 172.21.15.153:0/3964133567 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:18.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.524+0000 7fc2056da700 1 -- 172.21.15.153:0/3964133567 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f8005cf0 con 0x563a1499d7c0 2023-10-05T21:15:18.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.524+0000 7fc2056da700 1 --2- 172.21.15.153:0/3964133567 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563a1499d7c0 0x563a149a0210 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc001dc0 tx=0x7fc1fc001790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24edbb26d37d75ce server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.524+0000 7fc1f6ffd700 1 -- 172.21.15.153:0/3964133567 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1fc00bce0 con 0x563a1499d7c0 2023-10-05T21:15:18.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.524+0000 7fc1f6ffd700 1 -- 172.21.15.153:0/3964133567 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1fc00be40 con 0x563a1499d7c0 2023-10-05T21:15:18.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.524+0000 7fc1f6ffd700 1 -- 172.21.15.153:0/3964133567 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1fc00e5d0 con 0x563a1499d7c0 2023-10-05T21:15:18.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.525+0000 7fc212602680 1 -- 172.21.15.153:0/3964133567 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563a1499d7c0 msgr2=0x563a149a0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.525+0000 7fc212602680 1 --2- 172.21.15.153:0/3964133567 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563a1499d7c0 0x563a149a0210 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc001dc0 tx=0x7fc1fc001790 comp rx=0 tx=0).stop 2023-10-05T21:15:18.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.525+0000 7fc212602680 1 -- 172.21.15.153:0/3964133567 shutdown_connections 2023-10-05T21:15:18.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.525+0000 7fc212602680 1 --2- 172.21.15.153:0/3964133567 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563a1499d7c0 0x563a149a0210 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.525+0000 7fc212602680 1 -- 172.21.15.153:0/3964133567 >> 172.21.15.153:0/3964133567 conn(0x563a14999310 msgr2=0x563a149ba410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.525+0000 7fc212602680 1 -- 172.21.15.153:0/3964133567 shutdown_connections 2023-10-05T21:15:18.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.525+0000 7fc212602680 1 -- 172.21.15.153:0/3964133567 wait complete. 2023-10-05T21:15:18.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.525+0000 7fc212602680 1 Processor -- start 2023-10-05T21:15:18.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.525+0000 7fc212602680 1 -- start start 2023-10-05T21:15:18.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.525+0000 7fc212602680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563a1499d7c0 0x563a149c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.525+0000 7fc212602680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a14843c80 con 0x563a1499d7c0 2023-10-05T21:15:18.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.526+0000 7fc2056da700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563a1499d7c0 0x563a149c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.526+0000 7fc2056da700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563a1499d7c0 0x563a149c8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37968/0 (socket says 172.21.15.153:37968) 2023-10-05T21:15:18.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.526+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 learned_addr learned my addr 172.21.15.153:0/2254680612 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:18.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.526+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1fc001a70 con 0x563a1499d7c0 2023-10-05T21:15:18.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.526+0000 7fc2056da700 1 --2- 172.21.15.153:0/2254680612 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563a1499d7c0 0x563a149c8010 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc0017d0 tx=0x7fc1fc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.526+0000 7fc1f57fa700 1 -- 172.21.15.153:0/2254680612 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1fc01f070 con 0x563a1499d7c0 2023-10-05T21:15:18.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.526+0000 7fc1f57fa700 1 -- 172.21.15.153:0/2254680612 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1fc01a4d0 con 0x563a1499d7c0 2023-10-05T21:15:18.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.526+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563a149c8550 con 0x563a1499d7c0 2023-10-05T21:15:18.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.526+0000 7fc1f57fa700 1 -- 172.21.15.153:0/2254680612 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1fc01a7a0 con 0x563a1499d7c0 2023-10-05T21:15:18.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.526+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563a149c89a0 con 0x563a1499d7c0 2023-10-05T21:15:18.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.527+0000 7fc1f57fa700 1 -- 172.21.15.153:0/2254680612 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fc1fc01a900 con 0x563a1499d7c0 2023-10-05T21:15:18.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.527+0000 7fc1f57fa700 1 --2- 172.21.15.153:0/2254680612 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc1e8034140 0x7fc1e80365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.527+0000 7fc1f57fa700 1 -- 172.21.15.153:0/2254680612 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fc1fc048e90 con 0x563a1499d7c0 2023-10-05T21:15:18.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.527+0000 7fc212602680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.527+0000 7fc204ed9700 1 --2- 172.21.15.153:0/2254680612 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc1e8034140 0x7fc1e80365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.527+0000 7fc212602680 1 --2- 172.21.15.153:0/2254680612 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x563a149a3bf0 0x563a149d3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.527+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149d44c0 con 0x563a149a3bf0 2023-10-05T21:15:18.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.528+0000 7fc205edb700 1 --2- 172.21.15.153:0/2254680612 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x563a149a3bf0 0x563a149d3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.528+0000 7fc204ed9700 1 --2- 172.21.15.153:0/2254680612 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc1e8034140 0x7fc1e80365f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8003080 tx=0x7fc1f8015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.528+0000 7fc205edb700 1 --2- 172.21.15.153:0/2254680612 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x563a149a3bf0 0x563a149d3d30 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.528+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.528+0000 7fc212602680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.528+0000 7fc212602680 20 realm 2023-10-05T21:15:18.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.528+0000 7fc212602680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.528+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149d12e0 con 0x563a149a3bf0 2023-10-05T21:15:18.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.528+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.528+0000 7fc212602680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.528+0000 7fc212602680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:18.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.528+0000 7fc212602680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.528+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149d4f70 con 0x563a149a3bf0 2023-10-05T21:15:18.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.529+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.529+0000 7fc212602680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.529+0000 7fc212602680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.529+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149d5890 con 0x563a149a3bf0 2023-10-05T21:15:18.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.529+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.529+0000 7fc212602680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:18.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.529+0000 7fc212602680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.529+0000 7fc212602680 1 --2- 172.21.15.153:0/2254680612 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x563a149d6150 0x563a149d8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.529+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149d8b40 con 0x563a149d6150 2023-10-05T21:15:18.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.529+0000 7fc2056da700 1 --2- 172.21.15.153:0/2254680612 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x563a149d6150 0x563a149d8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.529+0000 7fc2056da700 1 --2- 172.21.15.153:0/2254680612 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x563a149d6150 0x563a149d8530 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.530+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc1fc014070 con 0x563a149d6150 2023-10-05T21:15:18.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.530+0000 7fc212602680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:18.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.530+0000 7fc212602680 20 searching for the correct realm 2023-10-05T21:15:18.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.530+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x563a149d6150 2023-10-05T21:15:18.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.530+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1fc014070 con 0x563a149d6150 2023-10-05T21:15:18.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.530+0000 7fc2056da700 1 --2- 172.21.15.153:0/2254680612 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc1fc016730 0x7fc1fc0235f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.530+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x7fc1fc016730 2023-10-05T21:15:18.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.530+0000 7fc204ed9700 1 --2- 172.21.15.153:0/2254680612 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc1fc016730 0x7fc1fc0235f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.530+0000 7fc204ed9700 1 --2- 172.21.15.153:0/2254680612 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc1fc016730 0x7fc1fc0235f0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.531+0000 7fc204ed9700 1 -- 172.21.15.153:0/2254680612 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f8019040 con 0x7fc1fc016730 2023-10-05T21:15:18.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.531+0000 7fc204ed9700 1 --2- 172.21.15.153:0/2254680612 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc1f8007030 0x7fc1f801d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.531+0000 7fc204ed9700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x7fc1f8007030 2023-10-05T21:15:18.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.531+0000 7fc205edb700 1 --2- 172.21.15.153:0/2254680612 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc1f8007030 0x7fc1f801d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.531+0000 7fc205edb700 1 --2- 172.21.15.153:0/2254680612 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc1f8007030 0x7fc1f801d420 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.531+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.531+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x563a149a3bf0 2023-10-05T21:15:18.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.532+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.532+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x563a149a3bf0 2023-10-05T21:15:18.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.532+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.532+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x7fc1f8007030 2023-10-05T21:15:18.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.532+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.532+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x7fc1f8007030 2023-10-05T21:15:18.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.532+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.532+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x7fc1fc016730 2023-10-05T21:15:18.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.532+0000 7fc204ed9700 1 -- 172.21.15.153:0/2254680612 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f8019040 con 0x7fc1fc016730 2023-10-05T21:15:18.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.533+0000 7fc204ed9700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x563a149d6150 2023-10-05T21:15:18.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.533+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc1fc014070 con 0x563a149d6150 2023-10-05T21:15:18.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.533+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x563a149a3bf0 2023-10-05T21:15:18.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.533+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.533+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x7fc1f8007030 2023-10-05T21:15:18.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.533+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.533+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x563a149a3bf0 2023-10-05T21:15:18.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.533+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.533+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x7fc1fc016730 2023-10-05T21:15:18.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.534+0000 7fc204ed9700 1 -- 172.21.15.153:0/2254680612 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f8019040 con 0x7fc1fc016730 2023-10-05T21:15:18.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.534+0000 7fc204ed9700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x563a149d6150 2023-10-05T21:15:18.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.534+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1fc014070 con 0x563a149d6150 2023-10-05T21:15:18.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.534+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x563a149d6150 2023-10-05T21:15:18.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.534+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1fc014070 con 0x563a149d6150 2023-10-05T21:15:18.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.534+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x7fc1f8007030 2023-10-05T21:15:18.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.534+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.534+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x563a149d6150 2023-10-05T21:15:18.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.534+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1fc014070 con 0x563a149d6150 2023-10-05T21:15:18.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.534+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x563a149d6150 2023-10-05T21:15:18.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.535+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1fc014070 con 0x563a149d6150 2023-10-05T21:15:18.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.535+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x563a149a3bf0 2023-10-05T21:15:18.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.535+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.535+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x563a149a3bf0 2023-10-05T21:15:18.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.535+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.535+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x7fc1f8007030 2023-10-05T21:15:18.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.535+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.535+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x563a149d6150 2023-10-05T21:15:18.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.535+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1fc014070 con 0x563a149d6150 2023-10-05T21:15:18.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.535+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x7fc1fc016730 2023-10-05T21:15:18.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.536+0000 7fc204ed9700 1 -- 172.21.15.153:0/2254680612 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f8019040 con 0x7fc1fc016730 2023-10-05T21:15:18.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.536+0000 7fc204ed9700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x563a149a3bf0 2023-10-05T21:15:18.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.536+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.536+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x7fc1f8007030 2023-10-05T21:15:18.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.536+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.536+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x563a149d6150 2023-10-05T21:15:18.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.536+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1fc014070 con 0x563a149d6150 2023-10-05T21:15:18.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.536+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x7fc1f8007030 2023-10-05T21:15:18.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.537+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.537+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x7fc1fc016730 2023-10-05T21:15:18.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.537+0000 7fc204ed9700 1 -- 172.21.15.153:0/2254680612 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f8019040 con 0x7fc1fc016730 2023-10-05T21:15:18.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.537+0000 7fc204ed9700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x563a149d6150 2023-10-05T21:15:18.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.537+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1fc014070 con 0x563a149d6150 2023-10-05T21:15:18.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.537+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x7fc1f8007030 2023-10-05T21:15:18.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.537+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.537+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x563a149a3bf0 2023-10-05T21:15:18.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.537+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.538+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149da6b0 con 0x7fc1fc016730 2023-10-05T21:15:18.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.538+0000 7fc204ed9700 1 -- 172.21.15.153:0/2254680612 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f8019040 con 0x7fc1fc016730 2023-10-05T21:15:18.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.538+0000 7fc212602680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:18.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.538+0000 7fc212602680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:18.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.538+0000 7fc212602680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:18.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.538+0000 7fc212602680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:18.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.538+0000 7fc212602680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.538+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149d9600 con 0x563a149a3bf0 2023-10-05T21:15:18.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.538+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.538+0000 7fc212602680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.538+0000 7fc212602680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.538+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149d9a00 con 0x563a149a3bf0 2023-10-05T21:15:18.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.538+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.538+0000 7fc212602680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:18.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.538+0000 7fc212602680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.538+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149dab40 con 0x563a149a3bf0 2023-10-05T21:15:18.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.538+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.538+0000 7fc212602680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:18.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.539+0000 7fc212602680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.539+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149daef0 con 0x563a149d6150 2023-10-05T21:15:18.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.539+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fc1fc014070 con 0x563a149d6150 2023-10-05T21:15:18.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.539+0000 7fc212602680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.539+0000 7fc212602680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.539+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149db2a0 con 0x563a149a3bf0 2023-10-05T21:15:18.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.539+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.539+0000 7fc212602680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.539+0000 7fc212602680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.539+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149db2a0 con 0x563a149a3bf0 2023-10-05T21:15:18.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.539+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.539+0000 7fc212602680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:18.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.539+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149db2a0 con 0x563a149d6150 2023-10-05T21:15:18.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.539+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1fc014070 con 0x563a149d6150 2023-10-05T21:15:18.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.539+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149db2a0 con 0x7fc1fc016730 2023-10-05T21:15:18.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.540+0000 7fc204ed9700 1 -- 172.21.15.153:0/2254680612 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f8019040 con 0x7fc1fc016730 2023-10-05T21:15:18.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.540+0000 7fc204ed9700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149db2a0 con 0x7fc1f8007030 2023-10-05T21:15:18.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.540+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.540+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149dab40 con 0x563a149a3bf0 2023-10-05T21:15:18.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.540+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.540+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149dab40 con 0x563a149a3bf0 2023-10-05T21:15:18.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.540+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.540+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149dab40 con 0x7fc1f8007030 2023-10-05T21:15:18.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.541+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.541+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149dab40 con 0x7fc1f8007030 2023-10-05T21:15:18.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.541+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.541+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149dab40 con 0x7fc1fc016730 2023-10-05T21:15:18.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.541+0000 7fc204ed9700 1 -- 172.21.15.153:0/2254680612 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f8019040 con 0x7fc1fc016730 2023-10-05T21:15:18.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.541+0000 7fc204ed9700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149dab40 con 0x563a149d6150 2023-10-05T21:15:18.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.541+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc1fc014070 con 0x563a149d6150 2023-10-05T21:15:18.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.541+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149dab40 con 0x563a149a3bf0 2023-10-05T21:15:18.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.542+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.542+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149dab40 con 0x7fc1f8007030 2023-10-05T21:15:18.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.542+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.542+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149dab40 con 0x563a149a3bf0 2023-10-05T21:15:18.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.542+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.542+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149dab40 con 0x7fc1fc016730 2023-10-05T21:15:18.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.542+0000 7fc204ed9700 1 -- 172.21.15.153:0/2254680612 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f8019040 con 0x7fc1fc016730 2023-10-05T21:15:18.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.542+0000 7fc204ed9700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149dab40 con 0x563a149d6150 2023-10-05T21:15:18.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.542+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1fc014070 con 0x563a149d6150 2023-10-05T21:15:18.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.542+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149dab40 con 0x563a149d6150 2023-10-05T21:15:18.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.543+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1fc014070 con 0x563a149d6150 2023-10-05T21:15:18.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.543+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc1fc04d040 con 0x7fc1f8007030 2023-10-05T21:15:18.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.543+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.543+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc1fc04d040 con 0x563a149d6150 2023-10-05T21:15:18.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.543+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1fc014070 con 0x563a149d6150 2023-10-05T21:15:18.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.543+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc1fc04d040 con 0x563a149d6150 2023-10-05T21:15:18.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.543+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1fc014070 con 0x563a149d6150 2023-10-05T21:15:18.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.543+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc1fc04d040 con 0x563a149a3bf0 2023-10-05T21:15:18.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.544+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.544+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc1fc04d040 con 0x563a149a3bf0 2023-10-05T21:15:18.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.544+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.544+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc1fc04d040 con 0x7fc1f8007030 2023-10-05T21:15:18.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.544+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.544+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc1fc04d040 con 0x563a149d6150 2023-10-05T21:15:18.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.544+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1fc014070 con 0x563a149d6150 2023-10-05T21:15:18.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.544+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc1fc04d040 con 0x7fc1fc016730 2023-10-05T21:15:18.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.545+0000 7fc204ed9700 1 -- 172.21.15.153:0/2254680612 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f8019040 con 0x7fc1fc016730 2023-10-05T21:15:18.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.545+0000 7fc204ed9700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc1fc04d040 con 0x563a149a3bf0 2023-10-05T21:15:18.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.545+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.545+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc1fc04d040 con 0x7fc1f8007030 2023-10-05T21:15:18.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.545+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.545+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc1fc04d040 con 0x563a149d6150 2023-10-05T21:15:18.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.545+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1fc014070 con 0x563a149d6150 2023-10-05T21:15:18.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.545+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc1fc04d040 con 0x7fc1f8007030 2023-10-05T21:15:18.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.546+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.546+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc1fc04d040 con 0x7fc1fc016730 2023-10-05T21:15:18.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.546+0000 7fc204ed9700 1 -- 172.21.15.153:0/2254680612 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f8019040 con 0x7fc1fc016730 2023-10-05T21:15:18.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.546+0000 7fc204ed9700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc1fc04d040 con 0x563a149d6150 2023-10-05T21:15:18.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.546+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1fc014070 con 0x563a149d6150 2023-10-05T21:15:18.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.546+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc1fc04d040 con 0x7fc1f8007030 2023-10-05T21:15:18.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.546+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.546+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc1fc04d040 con 0x563a149a3bf0 2023-10-05T21:15:18.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.546+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.546+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fc1fc04d040 con 0x7fc1fc016730 2023-10-05T21:15:18.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.547+0000 7fc204ed9700 1 -- 172.21.15.153:0/2254680612 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f8019040 con 0x7fc1fc016730 2023-10-05T21:15:18.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.547+0000 7fc212602680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:18.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.547+0000 7fc212602680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:18.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.547+0000 7fc212602680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:18.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.547+0000 7fc212602680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:18.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.547+0000 7fc212602680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.547+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149db2a0 con 0x563a149a3bf0 2023-10-05T21:15:18.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.547+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.547+0000 7fc212602680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:18.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.547+0000 7fc212602680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.547+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149db6a0 con 0x563a149d6150 2023-10-05T21:15:18.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.547+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc1fc014070 con 0x563a149d6150 2023-10-05T21:15:18.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.547+0000 7fc212602680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:18.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.547+0000 7fc212602680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.547+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149dbf40 con 0x563a149a3bf0 2023-10-05T21:15:18.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.547+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.547+0000 7fc212602680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:18.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.547+0000 7fc212602680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.547+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149dbf40 con 0x563a149a3bf0 2023-10-05T21:15:18.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.548+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.548+0000 7fc212602680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:18.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.548+0000 7fc212602680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.548+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149dbf40 con 0x7fc1f8007030 2023-10-05T21:15:18.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.548+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.548+0000 7fc212602680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.548+0000 7fc212602680 20 zone default found 2023-10-05T21:15:18.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.548+0000 7fc212602680 4 Realm: () 2023-10-05T21:15:18.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.548+0000 7fc212602680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:18.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.548+0000 7fc212602680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:18.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.548+0000 7fc212602680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:18.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.548+0000 7fc212602680 20 zonegroup default 2023-10-05T21:15:18.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.548+0000 7fc212602680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.548+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149dbf40 con 0x7fc1f8007030 2023-10-05T21:15:18.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.548+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.548+0000 7fc212602680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.548+0000 7fc212602680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.548+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149dd8c0 con 0x563a149d6150 2023-10-05T21:15:18.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.549+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc1fc014070 con 0x563a149d6150 2023-10-05T21:15:18.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.549+0000 7fc212602680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.549+0000 7fc212602680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.549+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149ddc70 con 0x563a149d6150 2023-10-05T21:15:18.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.549+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc1fc014070 con 0x563a149d6150 2023-10-05T21:15:18.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.549+0000 7fc212602680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.549+0000 7fc212602680 20 started sync module instance, tier type = 2023-10-05T21:15:18.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.549+0000 7fc212602680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:18.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.549+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149dcfd0 con 0x7fc1fc016730 2023-10-05T21:15:18.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.550+0000 7fc204ed9700 1 -- 172.21.15.153:0/2254680612 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1f8019040 con 0x7fc1fc016730 2023-10-05T21:15:18.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.550+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94807453979600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149de5b0 con 0x7fc1fc016730 2023-10-05T21:15:18.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.550+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149dee50 con 0x563a149a3bf0 2023-10-05T21:15:18.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.550+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.550+0000 7fc204ed9700 1 -- 172.21.15.153:0/2254680612 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94807453979600] v29'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1f8019040 con 0x7fc1fc016730 2023-10-05T21:15:18.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.551+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94807453985408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149def50 con 0x563a149a3bf0 2023-10-05T21:15:18.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.551+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149dfb30 con 0x563a149d6150 2023-10-05T21:15:18.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.551+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94807453985408] v29'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.551+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1fc014070 con 0x563a149d6150 2023-10-05T21:15:18.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.551+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94807453988320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149dff30 con 0x563a149d6150 2023-10-05T21:15:18.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.551+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149e0940 con 0x7fc1fc016730 2023-10-05T21:15:18.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.552+0000 7fc204ed9700 1 -- 172.21.15.153:0/2254680612 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1f8019040 con 0x7fc1fc016730 2023-10-05T21:15:18.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.552+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94807453988320] v29'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1fc014070 con 0x563a149d6150 2023-10-05T21:15:18.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.552+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94807453992016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149e0cf0 con 0x7fc1fc016730 2023-10-05T21:15:18.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.552+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149e1700 con 0x563a149a3bf0 2023-10-05T21:15:18.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.553+0000 7fc204ed9700 1 -- 172.21.15.153:0/2254680612 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94807453992016] v29'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1f8019040 con 0x7fc1fc016730 2023-10-05T21:15:18.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.553+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.553+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94807453995536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149e1b50 con 0x563a149a3bf0 2023-10-05T21:15:18.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.553+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149e2560 con 0x7fc1f8007030 2023-10-05T21:15:18.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.554+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94807453995536] v29'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.554+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.554+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94807453997200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149e2560 con 0x7fc1f8007030 2023-10-05T21:15:18.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.554+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149e3000 con 0x7fc1f8007030 2023-10-05T21:15:18.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.554+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94807453997200] v29'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.554+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.554+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94807453999216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149e24c0 con 0x7fc1f8007030 2023-10-05T21:15:18.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.555+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149e3b10 con 0x7fc1f8007030 2023-10-05T21:15:18.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.555+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94807453999216] v29'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.555+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.555+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94807454003136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149e3b10 con 0x7fc1f8007030 2023-10-05T21:15:18.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.555+0000 7fc212602680 20 add_watcher() i=0 2023-10-05T21:15:18.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.555+0000 7fc212602680 20 add_watcher() i=1 2023-10-05T21:15:18.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.555+0000 7fc212602680 20 add_watcher() i=2 2023-10-05T21:15:18.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.555+0000 7fc212602680 20 add_watcher() i=3 2023-10-05T21:15:18.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.555+0000 7fc212602680 20 add_watcher() i=4 2023-10-05T21:15:18.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.555+0000 7fc212602680 20 add_watcher() i=5 2023-10-05T21:15:18.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.555+0000 7fc212602680 20 add_watcher() i=6 2023-10-05T21:15:18.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.556+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94807454003136] v29'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.556+0000 7fc212602680 20 add_watcher() i=7 2023-10-05T21:15:18.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.556+0000 7fc212602680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:18.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.556+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149e6df0 con 0x563a149a3bf0 2023-10-05T21:15:18.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.556+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.556+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94807454005136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149e40d0 con 0x563a149a3bf0 2023-10-05T21:15:18.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.557+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94807454005136] v29'139 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.557+0000 7fc1d67e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:18.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.557+0000 7fc212602680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:18.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.557+0000 7fc212602680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:18.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.557+0000 7fc212602680 1 Processor -- start 2023-10-05T21:15:18.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.557+0000 7fc212602680 1 -- start start 2023-10-05T21:15:18.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.558+0000 7fc212602680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563a149f0b40 0x563a149f0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.558+0000 7fc212602680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a149f1560 con 0x563a149f0b40 2023-10-05T21:15:18.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.558+0000 7fc204ed9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563a149f0b40 0x563a149f0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.558+0000 7fc204ed9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563a149f0b40 0x563a149f0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37970/0 (socket says 172.21.15.153:37970) 2023-10-05T21:15:18.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.558+0000 7fc204ed9700 1 -- 172.21.15.153:0/3647887935 learned_addr learned my addr 172.21.15.153:0/3647887935 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:18.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.558+0000 7fc204ed9700 1 -- 172.21.15.153:0/3647887935 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a149f1a40 con 0x563a149f0b40 2023-10-05T21:15:18.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.558+0000 7fc204ed9700 1 --2- 172.21.15.153:0/3647887935 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563a149f0b40 0x563a149f0f50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x563a1499e490 tx=0x7fc1f8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de701157a5609b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.558+0000 7fc1d5fe3700 1 -- 172.21.15.153:0/3647887935 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1f801de90 con 0x563a149f0b40 2023-10-05T21:15:18.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.558+0000 7fc1d5fe3700 1 -- 172.21.15.153:0/3647887935 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f802b440 con 0x563a149f0b40 2023-10-05T21:15:18.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.558+0000 7fc1d5fe3700 1 -- 172.21.15.153:0/3647887935 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1f802b5f0 con 0x563a149f0b40 2023-10-05T21:15:18.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.559+0000 7fc212602680 1 -- 172.21.15.153:0/3647887935 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563a149f0b40 msgr2=0x563a149f0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.559+0000 7fc212602680 1 --2- 172.21.15.153:0/3647887935 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563a149f0b40 0x563a149f0f50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x563a1499e490 tx=0x7fc1f8012000 comp rx=0 tx=0).stop 2023-10-05T21:15:18.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.559+0000 7fc212602680 1 -- 172.21.15.153:0/3647887935 shutdown_connections 2023-10-05T21:15:18.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.559+0000 7fc212602680 1 --2- 172.21.15.153:0/3647887935 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563a149f0b40 0x563a149f0f50 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.559+0000 7fc212602680 1 -- 172.21.15.153:0/3647887935 >> 172.21.15.153:0/3647887935 conn(0x563a149ece40 msgr2=0x563a149eaf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.559+0000 7fc212602680 1 -- 172.21.15.153:0/3647887935 shutdown_connections 2023-10-05T21:15:18.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.559+0000 7fc212602680 1 -- 172.21.15.153:0/3647887935 wait complete. 2023-10-05T21:15:18.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.559+0000 7fc212602680 1 Processor -- start 2023-10-05T21:15:18.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.559+0000 7fc212602680 1 -- start start 2023-10-05T21:15:18.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.560+0000 7fc212602680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563a149f0b40 0x563a149f7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.560+0000 7fc212602680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a149f7ca0 con 0x563a149f0b40 2023-10-05T21:15:18.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.560+0000 7fc204ed9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563a149f0b40 0x563a149f7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.560+0000 7fc204ed9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563a149f0b40 0x563a149f7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:37984/0 (socket says 172.21.15.153:37984) 2023-10-05T21:15:18.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.560+0000 7fc204ed9700 1 -- 172.21.15.153:0/2507857546 learned_addr learned my addr 172.21.15.153:0/2507857546 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:18.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.560+0000 7fc204ed9700 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a149a7520 con 0x563a149f0b40 2023-10-05T21:15:18.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.560+0000 7fc204ed9700 1 --2- 172.21.15.153:0/2507857546 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563a149f0b40 0x563a149f7760 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x563a149ec3b0 tx=0x7fc1f8030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.560+0000 7fc147fff700 1 -- 172.21.15.153:0/2507857546 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1f803f740 con 0x563a149f0b40 2023-10-05T21:15:18.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.560+0000 7fc147fff700 1 -- 172.21.15.153:0/2507857546 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f803f8a0 con 0x563a149f0b40 2023-10-05T21:15:18.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.560+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563a149f7ea0 con 0x563a149f0b40 2023-10-05T21:15:18.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.560+0000 7fc147fff700 1 -- 172.21.15.153:0/2507857546 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1f803fa50 con 0x563a149f0b40 2023-10-05T21:15:18.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.560+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563a149f8290 con 0x563a149f0b40 2023-10-05T21:15:18.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.561+0000 7fc147fff700 1 -- 172.21.15.153:0/2507857546 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fc1f8047070 con 0x563a149f0b40 2023-10-05T21:15:18.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.561+0000 7fc147fff700 1 --2- 172.21.15.153:0/2507857546 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc14c034190 0x7fc14c036640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.561+0000 7fc147fff700 1 -- 172.21.15.153:0/2507857546 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fc1f8030070 con 0x563a149f0b40 2023-10-05T21:15:18.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.561+0000 7fc205edb700 1 --2- 172.21.15.153:0/2507857546 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc14c034190 0x7fc14c036640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.561+0000 7fc212602680 1 --2- 172.21.15.153:0/2507857546 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x563a14a02530 0x563a14a049e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.561+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a050e0 con 0x563a14a02530 2023-10-05T21:15:18.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.561+0000 7fc2056da700 1 --2- 172.21.15.153:0/2507857546 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x563a14a02530 0x563a14a049e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.562+0000 7fc205edb700 1 --2- 172.21.15.153:0/2507857546 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc14c034190 0x7fc14c036640 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x563a149e6df0 tx=0x7fc200037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.562+0000 7fc2056da700 1 --2- 172.21.15.153:0/2507857546 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x563a14a02530 0x563a14a049e0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.562+0000 7fc2056da700 1 -- 172.21.15.153:0/2507857546 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v29'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc1fc014070 con 0x563a14a02530 2023-10-05T21:15:18.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.563+0000 7fc212602680 1 --2- 172.21.15.153:0/2507857546 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x563a14a05d80 0x563a14a081c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.563+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a088d0 con 0x563a14a05d80 2023-10-05T21:15:18.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.563+0000 7fc204ed9700 1 --2- 172.21.15.153:0/2507857546 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x563a14a05d80 0x563a14a081c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.563+0000 7fc204ed9700 1 --2- 172.21.15.153:0/2507857546 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x563a14a05d80 0x563a14a081c0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.564+0000 7fc204ed9700 1 -- 172.21.15.153:0/2507857546 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v29'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc1f8033040 con 0x563a14a05d80 2023-10-05T21:15:18.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.564+0000 7fc212602680 1 --2- 172.21.15.153:0/2507857546 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x563a14a09680 0x563a14a0bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.564+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a0c260 con 0x563a14a09680 2023-10-05T21:15:18.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.564+0000 7fc205edb700 1 --2- 172.21.15.153:0/2507857546 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x563a14a09680 0x563a14a0bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.564+0000 7fc205edb700 1 --2- 172.21.15.153:0/2507857546 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x563a14a09680 0x563a14a0bb10 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.565+0000 7fc205edb700 1 -- 172.21.15.153:0/2507857546 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v29'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x563a14a09680 2023-10-05T21:15:18.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.565+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a0c990 con 0x563a14a02530 2023-10-05T21:15:18.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.566+0000 7fc2056da700 1 -- 172.21.15.153:0/2507857546 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v29'140 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc1fc014070 con 0x563a14a02530 2023-10-05T21:15:18.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.566+0000 7fc212602680 1 --2- 172.21.15.153:0/2507857546 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x563a14a0d710 0x563a14a0faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.566+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a101f0 con 0x563a14a0d710 2023-10-05T21:15:18.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.566+0000 7fc2056da700 1 --2- 172.21.15.153:0/2507857546 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x563a14a0d710 0x563a14a0faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.566+0000 7fc2056da700 1 --2- 172.21.15.153:0/2507857546 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x563a14a0d710 0x563a14a0faf0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.567+0000 7fc2056da700 1 -- 172.21.15.153:0/2507857546 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v29'44 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc1fc014070 con 0x563a14a0d710 2023-10-05T21:15:18.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.567+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a10900 con 0x563a14a09680 2023-10-05T21:15:18.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.567+0000 7fc205edb700 1 -- 172.21.15.153:0/2507857546 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v29'27 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x563a14a09680 2023-10-05T21:15:18.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.567+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a10d10 con 0x563a14a02530 2023-10-05T21:15:18.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.568+0000 7fc2056da700 1 -- 172.21.15.153:0/2507857546 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v29'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc1fc014070 con 0x563a14a02530 2023-10-05T21:15:18.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.568+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a10d10 con 0x563a14a05d80 2023-10-05T21:15:18.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.569+0000 7fc204ed9700 1 -- 172.21.15.153:0/2507857546 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v29'30 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc1f8033040 con 0x563a14a05d80 2023-10-05T21:15:18.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.569+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a11330 con 0x563a14a0d710 2023-10-05T21:15:18.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.570+0000 7fc2056da700 1 -- 172.21.15.153:0/2507857546 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v29'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc1fc014070 con 0x563a14a0d710 2023-10-05T21:15:18.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.570+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a11330 con 0x563a14a09680 2023-10-05T21:15:18.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.570+0000 7fc205edb700 1 -- 172.21.15.153:0/2507857546 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v29'23 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x563a14a09680 2023-10-05T21:15:18.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.570+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a11950 con 0x563a14a0d710 2023-10-05T21:15:18.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.571+0000 7fc2056da700 1 -- 172.21.15.153:0/2507857546 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v29'45 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc1fc014070 con 0x563a14a0d710 2023-10-05T21:15:18.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.571+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a11950 con 0x563a14a05d80 2023-10-05T21:15:18.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.572+0000 7fc204ed9700 1 -- 172.21.15.153:0/2507857546 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v29'21 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc1f8033040 con 0x563a14a05d80 2023-10-05T21:15:18.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.572+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a11f70 con 0x563a14a0d710 2023-10-05T21:15:18.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.572+0000 7fc2056da700 1 -- 172.21.15.153:0/2507857546 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v29'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc1fc014070 con 0x563a14a0d710 2023-10-05T21:15:18.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.572+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a11f70 con 0x563a14a05d80 2023-10-05T21:15:18.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.573+0000 7fc204ed9700 1 -- 172.21.15.153:0/2507857546 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v29'33 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc1f8033040 con 0x563a14a05d80 2023-10-05T21:15:18.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.573+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a12460 con 0x563a14a02530 2023-10-05T21:15:18.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.574+0000 7fc2056da700 1 -- 172.21.15.153:0/2507857546 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v29'141 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc1fc014070 con 0x563a14a02530 2023-10-05T21:15:18.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.574+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a12460 con 0x563a14a09680 2023-10-05T21:15:18.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.574+0000 7fc205edb700 1 -- 172.21.15.153:0/2507857546 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v29'35 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x563a14a09680 2023-10-05T21:15:18.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.574+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a12460 con 0x563a14a0d710 2023-10-05T21:15:18.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.575+0000 7fc2056da700 1 -- 172.21.15.153:0/2507857546 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v29'46 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc1fc014070 con 0x563a14a0d710 2023-10-05T21:15:18.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.575+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a12460 con 0x563a14a09680 2023-10-05T21:15:18.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.576+0000 7fc205edb700 1 -- 172.21.15.153:0/2507857546 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v29'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x563a14a09680 2023-10-05T21:15:18.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.576+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a12560 con 0x563a14a02530 2023-10-05T21:15:18.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.577+0000 7fc2056da700 1 -- 172.21.15.153:0/2507857546 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v29'27 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc1fc014070 con 0x563a14a02530 2023-10-05T21:15:18.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.577+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a12560 con 0x563a14a02530 2023-10-05T21:15:18.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.577+0000 7fc2056da700 1 -- 172.21.15.153:0/2507857546 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v29'142 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc1fc014070 con 0x563a14a02530 2023-10-05T21:15:18.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.578+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a12560 con 0x563a14a09680 2023-10-05T21:15:18.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.578+0000 7fc205edb700 1 -- 172.21.15.153:0/2507857546 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v29'36 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x563a14a09680 2023-10-05T21:15:18.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.578+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a12560 con 0x563a14a0d710 2023-10-05T21:15:18.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.579+0000 7fc2056da700 1 -- 172.21.15.153:0/2507857546 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v29'32 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc1fc014070 con 0x563a14a0d710 2023-10-05T21:15:18.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.579+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a12560 con 0x563a14a09680 2023-10-05T21:15:18.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.580+0000 7fc205edb700 1 -- 172.21.15.153:0/2507857546 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v29'22 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x563a14a09680 2023-10-05T21:15:18.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.580+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a12560 con 0x563a14a09680 2023-10-05T21:15:18.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.581+0000 7fc205edb700 1 -- 172.21.15.153:0/2507857546 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v29'23 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x563a14a09680 2023-10-05T21:15:18.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.581+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a12560 con 0x563a14a09680 2023-10-05T21:15:18.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.581+0000 7fc205edb700 1 -- 172.21.15.153:0/2507857546 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v29'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x563a14a09680 2023-10-05T21:15:18.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.581+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a12560 con 0x563a14a09680 2023-10-05T21:15:18.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.582+0000 7fc205edb700 1 -- 172.21.15.153:0/2507857546 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v29'28 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x563a14a09680 2023-10-05T21:15:18.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.582+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a12560 con 0x563a14a05d80 2023-10-05T21:15:18.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.583+0000 7fc204ed9700 1 -- 172.21.15.153:0/2507857546 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v29'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc1f8033040 con 0x563a14a05d80 2023-10-05T21:15:18.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.583+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a12ac0 con 0x563a14a09680 2023-10-05T21:15:18.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.583+0000 7fc205edb700 1 -- 172.21.15.153:0/2507857546 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v29'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x563a14a09680 2023-10-05T21:15:18.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.583+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a12ac0 con 0x563a14a05d80 2023-10-05T21:15:18.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.584+0000 7fc204ed9700 1 -- 172.21.15.153:0/2507857546 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v29'31 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc1f8033040 con 0x563a14a05d80 2023-10-05T21:15:18.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.584+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a12ac0 con 0x563a14a09680 2023-10-05T21:15:18.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.585+0000 7fc205edb700 1 -- 172.21.15.153:0/2507857546 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v29'37 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x563a14a09680 2023-10-05T21:15:18.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.585+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a12ac0 con 0x563a14a05d80 2023-10-05T21:15:18.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.585+0000 7fc204ed9700 1 -- 172.21.15.153:0/2507857546 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v29'34 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc1f8033040 con 0x563a14a05d80 2023-10-05T21:15:18.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.585+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a12ac0 con 0x563a14a0d710 2023-10-05T21:15:18.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.586+0000 7fc2056da700 1 -- 172.21.15.153:0/2507857546 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v29'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc1fc014070 con 0x563a14a0d710 2023-10-05T21:15:18.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.587+0000 7fc1457fa700 20 reqs_thread_entry: start 2023-10-05T21:15:18.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.587+0000 7fc13effd700 20 reqs_thread_entry: start 2023-10-05T21:15:18.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.587+0000 7fc212602680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:18.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.588+0000 7fc212602680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:18.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.588+0000 7fc13d7fa700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:48 2023 2023-10-05T21:15:18.610 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:18.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.588+0000 7fc13cff9700 20 reqs_thread_entry: start 2023-10-05T21:15:18.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.588+0000 7fc212602680 20 get_system_obj_state: rctx=0x7ffd7baada30 obj=default.rgw.meta:root:myfoo state=0x563a14912340 s->prefetch_data=0 2023-10-05T21:15:18.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.588+0000 7fc212602680 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-10-05T21:15:18.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.588+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:102 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a6dfa0 con 0x7fc1fc016730 2023-10-05T21:15:18.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.588+0000 7fc204ed9700 1 -- 172.21.15.153:0/2254680612 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(102 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv27 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7fc1f805c0a0 con 0x7fc1fc016730 2023-10-05T21:15:18.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.588+0000 7fc212602680 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x16 2023-10-05T21:15:18.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.588+0000 7fc212602680 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:18.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.588+0000 7fc212602680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:18.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.588+0000 7fc212602680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:18.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.588+0000 7fc212602680 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x11, cached=0x16) 2023-10-05T21:15:18.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.588+0000 7fc212602680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.588+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:103 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a6ffc0 con 0x7fc1fc016730 2023-10-05T21:15:18.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.589+0000 7fc204ed9700 1 -- 172.21.15.153:0/2254680612 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(103 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7fc1f805c0a0 con 0x7fc1fc016730 2023-10-05T21:15:18.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.589+0000 7fc212602680 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T21:15:18.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.589+0000 7fc212602680 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2023-10-05T21:15:18.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.589+0000 7fc212602680 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:18.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.589+0000 7fc212602680 20 get_system_obj_state: rctx=0x7ffd7baada30 obj=default.rgw.meta:root:.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 state=0x563a14852240 s->prefetch_data=0 2023-10-05T21:15:18.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.589+0000 7fc212602680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 : miss 2023-10-05T21:15:18.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.589+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:104 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a6f6f0 con 0x563a149d6150 2023-10-05T21:15:18.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.589+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(104 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7fc1fc014070 con 0x563a149d6150 2023-10-05T21:15:18.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.589+0000 7fc212602680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 info.flags=0x16 2023-10-05T21:15:18.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.589+0000 7fc212602680 10 adding default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 to cache LRU end 2023-10-05T21:15:18.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.589+0000 7fc212602680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:18.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.589+0000 7fc212602680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:18.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.589+0000 7fc212602680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:18.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.589+0000 7fc212602680 20 Read xattr: user.rgw.acl 2023-10-05T21:15:18.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.589+0000 7fc212602680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:18.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.589+0000 7fc212602680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:18.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.589+0000 7fc212602680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.589+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:105 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a72370 con 0x563a149d6150 2023-10-05T21:15:18.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.589+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(105 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7fc1fc014070 con 0x563a149d6150 2023-10-05T21:15:18.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.589+0000 7fc212602680 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T21:15:18.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.590+0000 7fc212602680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 info.flags=0x13 2023-10-05T21:15:18.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.590+0000 7fc212602680 10 moving default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 to cache LRU end 2023-10-05T21:15:18.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.590+0000 7fc212602680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:18.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.590+0000 7fc212602680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:18.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.590+0000 7fc212602680 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 2023-10-05T21:15:18.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.590+0000 7fc212602680 20 get_obj_state: rctx=0x7ffd7baadc70 obj=myfoo:four state=0x563a14a703a8 s->prefetch_data=0 2023-10-05T21:15:18.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.590+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:106 3.3e 3:7e4b8039:::193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a71460 con 0x7fc1f8007030 2023-10-05T21:15:18.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.590+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(106 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1_four [getxattrs out=849b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 234+0+865 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.590+0000 7fc212602680 10 manifest: total_size = 4 2023-10-05T21:15:18.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.590+0000 7fc212602680 20 get_obj_state: setting s->obj_tag to 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4220.6431562400111453517 2023-10-05T21:15:18.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.590+0000 7fc212602680 20 get_obj_state: rctx=0x7ffd7baadc70 obj=myfoo:four state=0x563a14a703a8 s->prefetch_data=0 2023-10-05T21:15:18.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.590+0000 7fc212602680 20 prepare_atomic_modification: state is not atomic. state=0x563a14a703a8 2023-10-05T21:15:18.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.590+0000 7fc212602680 20 bucket index object: default.rgw.buckets.index:.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.6 2023-10-05T21:15:18.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.590+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 4.14 4:2bb8f6a0:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a71d70 con 0x563a149d6150 2023-10-05T21:15:18.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.591+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(107 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.6 [stat,call,call] v29'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fc1fc014070 con 0x563a149d6150 2023-10-05T21:15:18.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.591+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:108 3.3e 3:7e4b8039:::193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a71d70 con 0x7fc1f8007030 2023-10-05T21:15:18.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.592+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(108 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1_four [call] v29'2 uv2 ondisk = 0) v8 ==== 192+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.592+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:109 4.14 4:2bb8f6a0:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a771c0 con 0x563a149d6150 2023-10-05T21:15:18.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.592+0000 7fc212602680 10 cache get: name=default.rgw.log++bucket.sync-source-hints.myfoo : miss 2023-10-05T21:15:18.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.592+0000 7fc212602680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.592+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 6.18 6:1df25bda:::bucket.sync-source-hints.myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a798a0 con 0x7fc1f8007030 2023-10-05T21:15:18.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.592+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(110 bucket.sync-source-hints.myfoo [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 216+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.592+0000 7fc212602680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.592+0000 7fc212602680 10 cache put: name=default.rgw.log++bucket.sync-source-hints.myfoo info.flags=0x0 2023-10-05T21:15:18.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.592+0000 7fc212602680 10 adding default.rgw.log++bucket.sync-source-hints.myfoo to cache LRU end 2023-10-05T21:15:18.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.592+0000 7fc212602680 10 cache get: name=default.rgw.log++bucket.sync-target-hints.myfoo : miss 2023-10-05T21:15:18.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.592+0000 7fc212602680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.592+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:111 6.4 6:26e4c4bc:::bucket.sync-target-hints.myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a798a0 con 0x563a149a3bf0 2023-10-05T21:15:18.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.592+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(111 bucket.sync-target-hints.myfoo [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 216+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.593+0000 7fc212602680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.593+0000 7fc212602680 10 cache put: name=default.rgw.log++bucket.sync-target-hints.myfoo info.flags=0x0 2023-10-05T21:15:18.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.593+0000 7fc212602680 10 adding default.rgw.log++bucket.sync-target-hints.myfoo to cache LRU end 2023-10-05T21:15:18.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.593+0000 7fc212602680 10 chain_cache_entry: cache_locator= 2023-10-05T21:15:18.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.593+0000 7fc212602680 20 chain_cache_entry: couldn't find cache locator 2023-10-05T21:15:18.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.593+0000 7fc212602680 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2023-10-05T21:15:18.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.593+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:112 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94807453979600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a14a701c0 con 0x7fc1fc016730 2023-10-05T21:15:18.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.593+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== osd_op_reply(109 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.6 [stat,call,call] v29'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fc1fc014070 con 0x563a149d6150 2023-10-05T21:15:18.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.593+0000 7fc1f6ffd700 20 handle_completion(): completion ok for obj=four 2023-10-05T21:15:18.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.594+0000 7fc204ed9700 1 -- 172.21.15.153:0/2254680612 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(112 notify.0 [watch unwatch cookie 94807453979600] v29'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1f805c0a0 con 0x7fc1fc016730 2023-10-05T21:15:18.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.594+0000 7fc212602680 20 remove_watcher() i=0 2023-10-05T21:15:18.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.594+0000 7fc212602680 2 removed watcher, disabling cache 2023-10-05T21:15:18.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.594+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:113 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94807453985408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149dd3d0 con 0x563a149a3bf0 2023-10-05T21:15:18.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.594+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(113 notify.1 [watch unwatch cookie 94807453985408] v29'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.594+0000 7fc212602680 20 remove_watcher() i=1 2023-10-05T21:15:18.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.594+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:114 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94807453988320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149dd3d0 con 0x563a149d6150 2023-10-05T21:15:18.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.595+0000 7fc2056da700 1 -- 172.21.15.153:0/2254680612 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(114 notify.2 [watch unwatch cookie 94807453988320] v29'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1fc014070 con 0x563a149d6150 2023-10-05T21:15:18.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.595+0000 7fc212602680 20 remove_watcher() i=2 2023-10-05T21:15:18.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.595+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:115 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94807453992016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149df5e0 con 0x7fc1fc016730 2023-10-05T21:15:18.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.596+0000 7fc204ed9700 1 -- 172.21.15.153:0/2254680612 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(115 notify.3 [watch unwatch cookie 94807453992016] v29'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1f805c0a0 con 0x7fc1fc016730 2023-10-05T21:15:18.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.596+0000 7fc212602680 20 remove_watcher() i=3 2023-10-05T21:15:18.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.596+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:116 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94807453995536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149dd3d0 con 0x563a149a3bf0 2023-10-05T21:15:18.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.596+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(116 notify.4 [watch unwatch cookie 94807453995536] v29'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.596+0000 7fc212602680 20 remove_watcher() i=4 2023-10-05T21:15:18.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.596+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:117 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94807453997200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149e1210 con 0x7fc1f8007030 2023-10-05T21:15:18.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.597+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(117 notify.5 [watch unwatch cookie 94807453997200] v29'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.597+0000 7fc212602680 20 remove_watcher() i=5 2023-10-05T21:15:18.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.597+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:118 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94807453999216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149e1890 con 0x7fc1f8007030 2023-10-05T21:15:18.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.598+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 31 ==== osd_op_reply(118 notify.6 [watch unwatch cookie 94807453999216] v29'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.598+0000 7fc212602680 20 remove_watcher() i=6 2023-10-05T21:15:18.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.598+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:119 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94807454003136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149e1210 con 0x7fc1f8007030 2023-10-05T21:15:18.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.599+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.0 v2:172.21.15.111:6800/111394 32 ==== osd_op_reply(119 notify.7 [watch unwatch cookie 94807454003136] v29'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x7fc1f8007030 2023-10-05T21:15:18.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.599+0000 7fc212602680 20 remove_watcher() i=7 2023-10-05T21:15:18.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.599+0000 7fc1d67e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:18.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.599+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:120 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94807454005136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563a149e2fc0 con 0x563a149a3bf0 2023-10-05T21:15:18.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.600+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(120 data_loggenerations_metadata [watch unwatch cookie 94807454005136] v29'143 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc20000a570 con 0x563a149a3bf0 2023-10-05T21:15:18.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.600+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc1f8007030 msgr2=0x7fc1f801d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.600+0000 7fc212602680 1 --2- 172.21.15.153:0/2254680612 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc1f8007030 0x7fc1f801d420 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.600+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x563a149a3bf0 msgr2=0x563a149d3d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.600+0000 7fc212602680 1 --2- 172.21.15.153:0/2254680612 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x563a149a3bf0 0x563a149d3d30 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.600+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc1fc016730 msgr2=0x7fc1fc0235f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.600+0000 7fc212602680 1 --2- 172.21.15.153:0/2254680612 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc1fc016730 0x7fc1fc0235f0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.600+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x563a149d6150 msgr2=0x563a149d8530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.600+0000 7fc212602680 1 --2- 172.21.15.153:0/2254680612 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x563a149d6150 0x563a149d8530 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.600+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc1e8034140 msgr2=0x7fc1e80365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.600+0000 7fc212602680 1 --2- 172.21.15.153:0/2254680612 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc1e8034140 0x7fc1e80365f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8003080 tx=0x7fc1f8015000 comp rx=0 tx=0).stop 2023-10-05T21:15:18.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.600+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563a1499d7c0 msgr2=0x563a149c8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.600+0000 7fc205edb700 1 -- 172.21.15.153:0/2254680612 reap_dead start 2023-10-05T21:15:18.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.600+0000 7fc212602680 1 --2- 172.21.15.153:0/2254680612 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563a1499d7c0 0x563a149c8010 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc0017d0 tx=0x7fc1fc016000 comp rx=0 tx=0).stop 2023-10-05T21:15:18.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.601+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 shutdown_connections 2023-10-05T21:15:18.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.601+0000 7fc212602680 1 --2- 172.21.15.153:0/2254680612 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563a1499d7c0 0x563a149c8010 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.601+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 >> 172.21.15.153:0/2254680612 conn(0x563a14999310 msgr2=0x563a149b9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.601+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 shutdown_connections 2023-10-05T21:15:18.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.601+0000 7fc212602680 1 -- 172.21.15.153:0/2254680612 wait complete. 2023-10-05T21:15:18.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.601+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x563a14a05d80 msgr2=0x563a14a081c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.601+0000 7fc212602680 1 --2- 172.21.15.153:0/2507857546 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x563a14a05d80 0x563a14a081c0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.601+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x563a14a02530 msgr2=0x563a14a049e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.601+0000 7fc212602680 1 --2- 172.21.15.153:0/2507857546 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x563a14a02530 0x563a14a049e0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.601+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x563a14a0d710 msgr2=0x563a14a0faf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.601+0000 7fc212602680 1 --2- 172.21.15.153:0/2507857546 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x563a14a0d710 0x563a14a0faf0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.601+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x563a14a09680 msgr2=0x563a14a0bb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.601+0000 7fc212602680 1 --2- 172.21.15.153:0/2507857546 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x563a14a09680 0x563a14a0bb10 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.601+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc14c034190 msgr2=0x7fc14c036640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.601+0000 7fc212602680 1 --2- 172.21.15.153:0/2507857546 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc14c034190 0x7fc14c036640 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x563a149e6df0 tx=0x7fc200037450 comp rx=0 tx=0).stop 2023-10-05T21:15:18.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.601+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563a149f0b40 msgr2=0x563a149f7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.601+0000 7fc212602680 1 --2- 172.21.15.153:0/2507857546 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563a149f0b40 0x563a149f7760 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x563a149ec3b0 tx=0x7fc1f8030000 comp rx=0 tx=0).stop 2023-10-05T21:15:18.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.601+0000 7fc2056da700 1 -- 172.21.15.153:0/2507857546 reap_dead start 2023-10-05T21:15:18.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.601+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 shutdown_connections 2023-10-05T21:15:18.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.601+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 >> 172.21.15.153:0/2507857546 conn(0x563a149ece40 msgr2=0x563a149eaf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.601+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 shutdown_connections 2023-10-05T21:15:18.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.601+0000 7fc212602680 1 -- 172.21.15.153:0/2507857546 wait complete. 2023-10-05T21:15:18.628 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2023-10-05T21:15:18.628 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2023-10-05T21:15:18.628 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2023-10-05T21:15:18.672 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:18.672 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:18.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.671+0000 7f518b63a680 1 Processor -- start 2023-10-05T21:15:18.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.671+0000 7f518b63a680 1 -- start start 2023-10-05T21:15:18.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.671+0000 7f518b63a680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55d9cad71bb0 0x55d9cad73f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.671+0000 7f518b63a680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d9cacb8990 con 0x55d9cacdf0a0 2023-10-05T21:15:18.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.671+0000 7f518b63a680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d9cac78db0 con 0x55d9cad71bb0 2023-10-05T21:15:18.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.671+0000 7f517df11700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55d9cad71bb0 0x55d9cad73f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.671+0000 7f517e712700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55d9cacdf0a0 0x55d9cad70490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:55250/0 (socket says 172.21.15.153:55250) 2023-10-05T21:15:18.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.671+0000 7f517e712700 1 -- 172.21.15.153:0/1453906799 learned_addr learned my addr 172.21.15.153:0/1453906799 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:18.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.671+0000 7f517df11700 1 -- 172.21.15.153:0/1453906799 >> v1:172.21.15.111:6789/0 conn(0x55d9cacdf0a0 legacy=0x55d9cad70490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.671+0000 7f517d710700 1 -- 172.21.15.153:0/1453906799 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1538124462 0 0) 0x55d9cacb8990 con 0x55d9cacdf0a0 2023-10-05T21:15:18.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.671+0000 7f517df11700 1 -- 172.21.15.153:0/1453906799 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9cad754e0 con 0x55d9cad71bb0 2023-10-05T21:15:18.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.672+0000 7f517df11700 1 --2- 172.21.15.153:0/1453906799 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d9cad71bb0 0x55d9cad73f90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f517400a5d0 tx=0x7f5174005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be55a34ad75f30f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.672+0000 7f517d710700 1 -- 172.21.15.153:0/1453906799 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51740086a0 con 0x55d9cad71bb0 2023-10-05T21:15:18.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.672+0000 7f517d710700 1 -- 172.21.15.153:0/1453906799 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5174008800 con 0x55d9cad71bb0 2023-10-05T21:15:18.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.672+0000 7f517d710700 1 -- 172.21.15.153:0/1453906799 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5174008ad0 con 0x55d9cad71bb0 2023-10-05T21:15:18.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.672+0000 7f518b63a680 1 -- 172.21.15.153:0/1453906799 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d9cad71bb0 msgr2=0x55d9cad73f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.672+0000 7f518b63a680 1 --2- 172.21.15.153:0/1453906799 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d9cad71bb0 0x55d9cad73f90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f517400a5d0 tx=0x7f5174005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:18.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.672+0000 7f518b63a680 1 -- 172.21.15.153:0/1453906799 shutdown_connections 2023-10-05T21:15:18.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.672+0000 7f518b63a680 1 --2- 172.21.15.153:0/1453906799 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d9cad71bb0 0x55d9cad73f90 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.672+0000 7f518b63a680 1 -- 172.21.15.153:0/1453906799 >> 172.21.15.153:0/1453906799 conn(0x55d9cad65b80 msgr2=0x55d9cad67f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.672+0000 7f518b63a680 1 -- 172.21.15.153:0/1453906799 shutdown_connections 2023-10-05T21:15:18.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.672+0000 7f518b63a680 1 -- 172.21.15.153:0/1453906799 wait complete. 2023-10-05T21:15:18.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.673+0000 7f518b63a680 1 Processor -- start 2023-10-05T21:15:18.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.673+0000 7f518b63a680 1 -- start start 2023-10-05T21:15:18.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.673+0000 7f518b63a680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d9cacdf0a0 0x55d9cad8c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.673+0000 7f518b63a680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9cac18ea0 con 0x55d9cacdf0a0 2023-10-05T21:15:18.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.673+0000 7f517e712700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d9cacdf0a0 0x55d9cad8c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.673+0000 7f517e712700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d9cacdf0a0 0x55d9cad8c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38010/0 (socket says 172.21.15.153:38010) 2023-10-05T21:15:18.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.673+0000 7f517e712700 1 -- 172.21.15.153:0/1120809955 learned_addr learned my addr 172.21.15.153:0/1120809955 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:18.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.674+0000 7f517e712700 1 -- 172.21.15.153:0/1120809955 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5174005cf0 con 0x55d9cacdf0a0 2023-10-05T21:15:18.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.674+0000 7f517e712700 1 --2- 172.21.15.153:0/1120809955 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d9cacdf0a0 0x55d9cad8c920 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5170001d70 tx=0x7f5170001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b30b079c66180d95 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.674+0000 7f516ffff700 1 -- 172.21.15.153:0/1120809955 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f517000bcc0 con 0x55d9cacdf0a0 2023-10-05T21:15:18.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.674+0000 7f516ffff700 1 -- 172.21.15.153:0/1120809955 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517000be20 con 0x55d9cacdf0a0 2023-10-05T21:15:18.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.674+0000 7f516ffff700 1 -- 172.21.15.153:0/1120809955 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f517000e5f0 con 0x55d9cacdf0a0 2023-10-05T21:15:18.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.674+0000 7f518b63a680 1 -- 172.21.15.153:0/1120809955 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d9cacdf0a0 msgr2=0x55d9cad8c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.674+0000 7f518b63a680 1 --2- 172.21.15.153:0/1120809955 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d9cacdf0a0 0x55d9cad8c920 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5170001d70 tx=0x7f5170001770 comp rx=0 tx=0).stop 2023-10-05T21:15:18.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.674+0000 7f518b63a680 1 -- 172.21.15.153:0/1120809955 shutdown_connections 2023-10-05T21:15:18.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.674+0000 7f518b63a680 1 --2- 172.21.15.153:0/1120809955 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d9cacdf0a0 0x55d9cad8c920 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.674+0000 7f518b63a680 1 -- 172.21.15.153:0/1120809955 >> 172.21.15.153:0/1120809955 conn(0x55d9cad65b80 msgr2=0x55d9cad883f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.674+0000 7f518b63a680 1 -- 172.21.15.153:0/1120809955 shutdown_connections 2023-10-05T21:15:18.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.674+0000 7f518b63a680 1 -- 172.21.15.153:0/1120809955 wait complete. 2023-10-05T21:15:18.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.675+0000 7f518b63a680 1 Processor -- start 2023-10-05T21:15:18.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.675+0000 7f518b63a680 1 -- start start 2023-10-05T21:15:18.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.675+0000 7f518b63a680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d9cacdf0a0 0x55d9cad93dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.675+0000 7f518b63a680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9cac0fc80 con 0x55d9cacdf0a0 2023-10-05T21:15:18.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.675+0000 7f517e712700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d9cacdf0a0 0x55d9cad93dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.675+0000 7f517e712700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d9cacdf0a0 0x55d9cad93dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38016/0 (socket says 172.21.15.153:38016) 2023-10-05T21:15:18.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.675+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 learned_addr learned my addr 172.21.15.153:0/1312375521 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:18.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.675+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5170001a50 con 0x55d9cacdf0a0 2023-10-05T21:15:18.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.675+0000 7f517e712700 1 --2- 172.21.15.153:0/1312375521 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d9cacdf0a0 0x55d9cad93dc0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f51700017b0 tx=0x7f5170016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.676+0000 7f516e7fc700 1 -- 172.21.15.153:0/1312375521 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f517001f070 con 0x55d9cacdf0a0 2023-10-05T21:15:18.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.676+0000 7f516e7fc700 1 -- 172.21.15.153:0/1312375521 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517001a2e0 con 0x55d9cacdf0a0 2023-10-05T21:15:18.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.676+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d9cad94300 con 0x55d9cacdf0a0 2023-10-05T21:15:18.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.676+0000 7f516e7fc700 1 -- 172.21.15.153:0/1312375521 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f517001a650 con 0x55d9cacdf0a0 2023-10-05T21:15:18.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.676+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d9cad94750 con 0x55d9cacdf0a0 2023-10-05T21:15:18.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.676+0000 7f516e7fc700 1 -- 172.21.15.153:0/1312375521 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f517001a7b0 con 0x55d9cacdf0a0 2023-10-05T21:15:18.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.676+0000 7f518b63a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.677+0000 7f516e7fc700 1 --2- 172.21.15.153:0/1312375521 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5160034140 0x7f51600365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.677+0000 7f516e7fc700 1 -- 172.21.15.153:0/1312375521 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f5170048f40 con 0x55d9cacdf0a0 2023-10-05T21:15:18.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.677+0000 7f517df11700 1 --2- 172.21.15.153:0/1312375521 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5160034140 0x7f51600365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.677+0000 7f518b63a680 1 --2- 172.21.15.153:0/1312375521 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d9cad71bb0 0x55d9cad9fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.677+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada02b0 con 0x55d9cad71bb0 2023-10-05T21:15:18.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.677+0000 7f517ef13700 1 --2- 172.21.15.153:0/1312375521 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d9cad71bb0 0x55d9cad9fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.677+0000 7f517df11700 1 --2- 172.21.15.153:0/1312375521 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5160034140 0x7f51600365f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5174003080 tx=0x7f5174015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.677+0000 7f517ef13700 1 --2- 172.21.15.153:0/1312375521 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d9cad71bb0 0x55d9cad9fb20 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.678+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.678+0000 7f518b63a680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.678+0000 7f518b63a680 20 realm 2023-10-05T21:15:18.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.678+0000 7f518b63a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.678+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cad9d100 con 0x55d9cad71bb0 2023-10-05T21:15:18.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.678+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.678+0000 7f518b63a680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.678+0000 7f518b63a680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:18.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.678+0000 7f518b63a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.678+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada0db0 con 0x55d9cad71bb0 2023-10-05T21:15:18.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.678+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.678+0000 7f518b63a680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.678+0000 7f518b63a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.678+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada16d0 con 0x55d9cad71bb0 2023-10-05T21:15:18.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.678+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.678+0000 7f518b63a680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:18.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.678+0000 7f518b63a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.678+0000 7f518b63a680 1 --2- 172.21.15.153:0/1312375521 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d9cada1f90 0x55d9cada4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.678+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada4940 con 0x55d9cada1f90 2023-10-05T21:15:18.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.679+0000 7f517e712700 1 --2- 172.21.15.153:0/1312375521 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d9cada1f90 0x55d9cada4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.679+0000 7f517e712700 1 --2- 172.21.15.153:0/1312375521 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d9cada1f90 0x55d9cada4370 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.679+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.679+0000 7f518b63a680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:18.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.679+0000 7f518b63a680 20 searching for the correct realm 2023-10-05T21:15:18.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.679+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada6260 con 0x55d9cada1f90 2023-10-05T21:15:18.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.679+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.679+0000 7f517e712700 1 --2- 172.21.15.153:0/1312375521 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f517000d750 0x7f5170017430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.679+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f517003e040 con 0x7f517000d750 2023-10-05T21:15:18.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.680+0000 7f517df11700 1 --2- 172.21.15.153:0/1312375521 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f517000d750 0x7f5170017430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.680+0000 7f517df11700 1 --2- 172.21.15.153:0/1312375521 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f517000d750 0x7f5170017430 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.680+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5174019040 con 0x7f517000d750 2023-10-05T21:15:18.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.680+0000 7f517df11700 1 --2- 172.21.15.153:0/1312375521 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f5174007030 0x7f517401d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.680+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f517003e040 con 0x7f5174007030 2023-10-05T21:15:18.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.680+0000 7f517ef13700 1 --2- 172.21.15.153:0/1312375521 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f5174007030 0x7f517401d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.681+0000 7f517ef13700 1 --2- 172.21.15.153:0/1312375521 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f5174007030 0x7f517401d420 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.681+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517800a570 con 0x7f5174007030 2023-10-05T21:15:18.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.681+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f517003e040 con 0x55d9cad71bb0 2023-10-05T21:15:18.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.681+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.681+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f517003e040 con 0x55d9cad71bb0 2023-10-05T21:15:18.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.681+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.681+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f517003e040 con 0x7f5174007030 2023-10-05T21:15:18.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.682+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517800a570 con 0x7f5174007030 2023-10-05T21:15:18.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.682+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f517003e040 con 0x7f5174007030 2023-10-05T21:15:18.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.682+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517800a570 con 0x7f5174007030 2023-10-05T21:15:18.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.682+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f517003e040 con 0x7f517000d750 2023-10-05T21:15:18.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.682+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5174019040 con 0x7f517000d750 2023-10-05T21:15:18.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.682+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f517003e040 con 0x55d9cada1f90 2023-10-05T21:15:18.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.682+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.682+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f517003e040 con 0x55d9cad71bb0 2023-10-05T21:15:18.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.683+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.683+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f517003e040 con 0x7f5174007030 2023-10-05T21:15:18.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.683+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517800a570 con 0x7f5174007030 2023-10-05T21:15:18.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.683+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f517003e040 con 0x55d9cad71bb0 2023-10-05T21:15:18.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.683+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.683+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f517003e040 con 0x7f517000d750 2023-10-05T21:15:18.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.683+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5174019040 con 0x7f517000d750 2023-10-05T21:15:18.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.683+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f517003e040 con 0x55d9cada1f90 2023-10-05T21:15:18.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.684+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.684+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f517003e040 con 0x55d9cada1f90 2023-10-05T21:15:18.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.684+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.684+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f517003e040 con 0x7f5174007030 2023-10-05T21:15:18.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.684+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517800a570 con 0x7f5174007030 2023-10-05T21:15:18.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.684+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f517003e040 con 0x55d9cada1f90 2023-10-05T21:15:18.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.684+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.684+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f517003e040 con 0x55d9cada1f90 2023-10-05T21:15:18.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.684+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.684+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f517003e040 con 0x55d9cad71bb0 2023-10-05T21:15:18.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.685+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.685+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f517003e040 con 0x55d9cad71bb0 2023-10-05T21:15:18.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.685+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.685+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f517003e040 con 0x7f5174007030 2023-10-05T21:15:18.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.685+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517800a570 con 0x7f5174007030 2023-10-05T21:15:18.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.685+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f517003e040 con 0x55d9cada1f90 2023-10-05T21:15:18.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.685+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.685+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f517003e040 con 0x7f517000d750 2023-10-05T21:15:18.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.686+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5174019040 con 0x7f517000d750 2023-10-05T21:15:18.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.686+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f517003e040 con 0x55d9cad71bb0 2023-10-05T21:15:18.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.686+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.686+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f517003e040 con 0x7f5174007030 2023-10-05T21:15:18.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.686+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517800a570 con 0x7f5174007030 2023-10-05T21:15:18.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.686+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f517003e040 con 0x55d9cada1f90 2023-10-05T21:15:18.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.686+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.686+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f517003e040 con 0x7f5174007030 2023-10-05T21:15:18.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.687+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517800a570 con 0x7f5174007030 2023-10-05T21:15:18.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.687+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f517003e040 con 0x7f517000d750 2023-10-05T21:15:18.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.687+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5174019040 con 0x7f517000d750 2023-10-05T21:15:18.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.687+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f517003e040 con 0x55d9cada1f90 2023-10-05T21:15:18.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.687+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.687+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f517003e040 con 0x7f5174007030 2023-10-05T21:15:18.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.687+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517800a570 con 0x7f5174007030 2023-10-05T21:15:18.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.687+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f517003e040 con 0x55d9cad71bb0 2023-10-05T21:15:18.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.688+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.688+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f517003e040 con 0x7f517000d750 2023-10-05T21:15:18.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.688+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5174019040 con 0x7f517000d750 2023-10-05T21:15:18.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.688+0000 7f518b63a680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:18.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.688+0000 7f518b63a680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:18.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.688+0000 7f518b63a680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:18.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.688+0000 7f518b63a680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:18.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.688+0000 7f518b63a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.688+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada5480 con 0x55d9cad71bb0 2023-10-05T21:15:18.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.688+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.688+0000 7f518b63a680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.688+0000 7f518b63a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.688+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada58b0 con 0x55d9cad71bb0 2023-10-05T21:15:18.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.688+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.688+0000 7f518b63a680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:18.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.688+0000 7f518b63a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.688+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada5ce0 con 0x55d9cad71bb0 2023-10-05T21:15:18.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.689+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.689+0000 7f518b63a680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:18.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.689+0000 7f518b63a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.689+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada6610 con 0x55d9cada1f90 2023-10-05T21:15:18.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.689+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.689+0000 7f518b63a680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.689+0000 7f518b63a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.689+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada4fc0 con 0x55d9cad71bb0 2023-10-05T21:15:18.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.689+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.689+0000 7f518b63a680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.689+0000 7f518b63a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.689+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada6f00 con 0x55d9cad71bb0 2023-10-05T21:15:18.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.689+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.689+0000 7f518b63a680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:18.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.689+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada7f10 con 0x55d9cada1f90 2023-10-05T21:15:18.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.689+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.689+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada7f10 con 0x7f517000d750 2023-10-05T21:15:18.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.690+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5174019040 con 0x7f517000d750 2023-10-05T21:15:18.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.690+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada7f10 con 0x7f5174007030 2023-10-05T21:15:18.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.690+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517800a570 con 0x7f5174007030 2023-10-05T21:15:18.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.690+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada5ce0 con 0x55d9cad71bb0 2023-10-05T21:15:18.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.690+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.690+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada5ce0 con 0x55d9cad71bb0 2023-10-05T21:15:18.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.691+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.691+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada5ce0 con 0x7f5174007030 2023-10-05T21:15:18.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.691+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517800a570 con 0x7f5174007030 2023-10-05T21:15:18.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.691+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada5ce0 con 0x7f5174007030 2023-10-05T21:15:18.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.691+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517800a570 con 0x7f5174007030 2023-10-05T21:15:18.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.691+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada5ce0 con 0x7f517000d750 2023-10-05T21:15:18.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.692+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5174019040 con 0x7f517000d750 2023-10-05T21:15:18.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.692+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada5ce0 con 0x55d9cada1f90 2023-10-05T21:15:18.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.692+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.692+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada5ce0 con 0x55d9cad71bb0 2023-10-05T21:15:18.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.692+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.692+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada5ce0 con 0x7f5174007030 2023-10-05T21:15:18.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.692+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517800a570 con 0x7f5174007030 2023-10-05T21:15:18.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.692+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada5ce0 con 0x55d9cad71bb0 2023-10-05T21:15:18.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.692+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.692+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada5ce0 con 0x7f517000d750 2023-10-05T21:15:18.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.693+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5174019040 con 0x7f517000d750 2023-10-05T21:15:18.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.693+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada5ce0 con 0x55d9cada1f90 2023-10-05T21:15:18.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.693+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.693+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada5ce0 con 0x55d9cada1f90 2023-10-05T21:15:18.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.693+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.693+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada5ce0 con 0x7f5174007030 2023-10-05T21:15:18.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.693+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517800a570 con 0x7f5174007030 2023-10-05T21:15:18.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.693+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada5ce0 con 0x55d9cada1f90 2023-10-05T21:15:18.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.693+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.693+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada5ce0 con 0x55d9cada1f90 2023-10-05T21:15:18.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.694+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.694+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada5ce0 con 0x55d9cad71bb0 2023-10-05T21:15:18.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.694+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.694+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada5ce0 con 0x55d9cad71bb0 2023-10-05T21:15:18.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.694+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.694+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada5ce0 con 0x7f5174007030 2023-10-05T21:15:18.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.694+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517800a570 con 0x7f5174007030 2023-10-05T21:15:18.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.694+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada5ce0 con 0x55d9cada1f90 2023-10-05T21:15:18.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.694+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.694+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada5ce0 con 0x7f517000d750 2023-10-05T21:15:18.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.695+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5174019040 con 0x7f517000d750 2023-10-05T21:15:18.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.695+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada5ce0 con 0x55d9cad71bb0 2023-10-05T21:15:18.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.695+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.695+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada5ce0 con 0x7f5174007030 2023-10-05T21:15:18.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.695+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517800a570 con 0x7f5174007030 2023-10-05T21:15:18.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.695+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada5ce0 con 0x55d9cada1f90 2023-10-05T21:15:18.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.695+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.695+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada5ce0 con 0x7f5174007030 2023-10-05T21:15:18.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.696+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517800a570 con 0x7f5174007030 2023-10-05T21:15:18.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.696+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada5ce0 con 0x7f517000d750 2023-10-05T21:15:18.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.696+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5174019040 con 0x7f517000d750 2023-10-05T21:15:18.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.696+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada5ce0 con 0x55d9cada1f90 2023-10-05T21:15:18.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.696+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.696+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada5ce0 con 0x7f5174007030 2023-10-05T21:15:18.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.696+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517800a570 con 0x7f5174007030 2023-10-05T21:15:18.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.696+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada5ce0 con 0x55d9cad71bb0 2023-10-05T21:15:18.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.696+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.696+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada5ce0 con 0x7f517000d750 2023-10-05T21:15:18.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.697+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5174019040 con 0x7f517000d750 2023-10-05T21:15:18.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.697+0000 7f518b63a680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:18.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.697+0000 7f518b63a680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:18.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.697+0000 7f518b63a680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:18.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.697+0000 7f518b63a680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:18.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.697+0000 7f518b63a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.697+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada6f00 con 0x55d9cad71bb0 2023-10-05T21:15:18.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.697+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.697+0000 7f518b63a680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:18.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.697+0000 7f518b63a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.697+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada72b0 con 0x55d9cada1f90 2023-10-05T21:15:18.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.697+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.697+0000 7f518b63a680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:18.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.697+0000 7f518b63a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.697+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada7660 con 0x55d9cad71bb0 2023-10-05T21:15:18.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.697+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.697+0000 7f518b63a680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:18.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.698+0000 7f518b63a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.698+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada7660 con 0x55d9cad71bb0 2023-10-05T21:15:18.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.698+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.698+0000 7f518b63a680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:18.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.698+0000 7f518b63a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.698+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada7a60 con 0x7f5174007030 2023-10-05T21:15:18.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.698+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f517800a570 con 0x7f5174007030 2023-10-05T21:15:18.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.698+0000 7f518b63a680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.698+0000 7f518b63a680 20 zone default found 2023-10-05T21:15:18.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.698+0000 7f518b63a680 4 Realm: () 2023-10-05T21:15:18.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.698+0000 7f518b63a680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:18.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.698+0000 7f518b63a680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:18.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.698+0000 7f518b63a680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:18.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.698+0000 7f518b63a680 20 zonegroup default 2023-10-05T21:15:18.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.698+0000 7f518b63a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.698+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada7a60 con 0x7f5174007030 2023-10-05T21:15:18.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.698+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f517800a570 con 0x7f5174007030 2023-10-05T21:15:18.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.698+0000 7f518b63a680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.698+0000 7f518b63a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.698+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada9290 con 0x55d9cada1f90 2023-10-05T21:15:18.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.699+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.699+0000 7f518b63a680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.699+0000 7f518b63a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.699+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada9640 con 0x55d9cada1f90 2023-10-05T21:15:18.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.699+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.699+0000 7f518b63a680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.699+0000 7f518b63a680 20 started sync module instance, tier type = 2023-10-05T21:15:18.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.699+0000 7f518b63a680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:18.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.699+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada8950 con 0x7f517000d750 2023-10-05T21:15:18.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.700+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5174019040 con 0x7f517000d750 2023-10-05T21:15:18.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.700+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94393899584768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cada9ee0 con 0x7f517000d750 2023-10-05T21:15:18.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.700+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cadaa780 con 0x55d9cad71bb0 2023-10-05T21:15:18.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.700+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.700+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94393899584768] v29'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5174019040 con 0x7f517000d750 2023-10-05T21:15:18.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.700+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94393899588080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cadaa7e0 con 0x55d9cad71bb0 2023-10-05T21:15:18.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.700+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cadab3e0 con 0x55d9cada1f90 2023-10-05T21:15:18.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.701+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94393899588080] v29'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.701+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.701+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94393899593328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cadab7e0 con 0x55d9cada1f90 2023-10-05T21:15:18.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.701+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cadac1f0 con 0x7f517000d750 2023-10-05T21:15:18.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.702+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94393899593328] v29'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.702+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5174019040 con 0x7f517000d750 2023-10-05T21:15:18.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.702+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94393899597056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cadac5a0 con 0x7f517000d750 2023-10-05T21:15:18.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.702+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cadacfb0 con 0x55d9cad71bb0 2023-10-05T21:15:18.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.703+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.703+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94393899601136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cadad710 con 0x55d9cad71bb0 2023-10-05T21:15:18.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.703+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94393899597056] v29'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5174019040 con 0x7f517000d750 2023-10-05T21:15:18.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.703+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cadadda0 con 0x7f5174007030 2023-10-05T21:15:18.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.704+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94393899601136] v29'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.704+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f517800a570 con 0x7f5174007030 2023-10-05T21:15:18.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.704+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94393899590288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cadadda0 con 0x7f5174007030 2023-10-05T21:15:18.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.704+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cadae7b0 con 0x7f5174007030 2023-10-05T21:15:18.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.704+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(96 notify.6 [create] v29'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f517800a570 con 0x7f5174007030 2023-10-05T21:15:18.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.704+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94393899606720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cadae710 con 0x7f5174007030 2023-10-05T21:15:18.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.704+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cadaf820 con 0x7f5174007030 2023-10-05T21:15:18.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.704+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(95 notify.5 [watch watch cookie 94393899590288] v29'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f517800a570 con 0x7f5174007030 2023-10-05T21:15:18.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.705+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94393899606720] v29'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f517800a570 con 0x7f5174007030 2023-10-05T21:15:18.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.705+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f517800a570 con 0x7f5174007030 2023-10-05T21:15:18.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.705+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94393899610832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cadaebb0 con 0x7f5174007030 2023-10-05T21:15:18.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.705+0000 7f518b63a680 20 add_watcher() i=0 2023-10-05T21:15:18.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.705+0000 7f518b63a680 20 add_watcher() i=1 2023-10-05T21:15:18.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.705+0000 7f518b63a680 20 add_watcher() i=2 2023-10-05T21:15:18.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.705+0000 7f518b63a680 20 add_watcher() i=3 2023-10-05T21:15:18.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.705+0000 7f518b63a680 20 add_watcher() i=4 2023-10-05T21:15:18.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.705+0000 7f518b63a680 20 add_watcher() i=5 2023-10-05T21:15:18.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.705+0000 7f518b63a680 20 add_watcher() i=6 2023-10-05T21:15:18.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.706+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94393899610832] v29'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f517800a570 con 0x7f5174007030 2023-10-05T21:15:18.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.706+0000 7f518b63a680 20 add_watcher() i=7 2023-10-05T21:15:18.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.706+0000 7f518b63a680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:18.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.706+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cadb2810 con 0x55d9cad71bb0 2023-10-05T21:15:18.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.706+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.706+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94393899602240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cadafcd0 con 0x55d9cad71bb0 2023-10-05T21:15:18.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.707+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94393899602240] v29'144 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.707+0000 7f514ffdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:18.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.707+0000 7f518b63a680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:18.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.707+0000 7f518b63a680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:18.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.707+0000 7f518b63a680 1 Processor -- start 2023-10-05T21:15:18.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.707+0000 7f518b63a680 1 -- start start 2023-10-05T21:15:18.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.707+0000 7f518b63a680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d9cadbcff0 0x55d9cadbd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.707+0000 7f518b63a680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9cadbd9d0 con 0x55d9cadbcff0 2023-10-05T21:15:18.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.708+0000 7f517df11700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d9cadbcff0 0x55d9cadbd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.708+0000 7f517df11700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d9cadbcff0 0x55d9cadbd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38026/0 (socket says 172.21.15.153:38026) 2023-10-05T21:15:18.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.708+0000 7f517df11700 1 -- 172.21.15.153:0/4242614094 learned_addr learned my addr 172.21.15.153:0/4242614094 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:18.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.708+0000 7f517df11700 1 -- 172.21.15.153:0/4242614094 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9cadbdb10 con 0x55d9cadbcff0 2023-10-05T21:15:18.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.708+0000 7f517df11700 1 --2- 172.21.15.153:0/4242614094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d9cadbcff0 0x55d9cadbd400 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x55d9cad6bf50 tx=0x7f5174012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac61d706e5537b09 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.708+0000 7f514f7de700 1 -- 172.21.15.153:0/4242614094 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f517401ddc0 con 0x55d9cadbcff0 2023-10-05T21:15:18.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.708+0000 7f514f7de700 1 -- 172.21.15.153:0/4242614094 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517402b450 con 0x55d9cadbcff0 2023-10-05T21:15:18.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.708+0000 7f514f7de700 1 -- 172.21.15.153:0/4242614094 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f517402b600 con 0x55d9cadbcff0 2023-10-05T21:15:18.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.709+0000 7f518b63a680 1 -- 172.21.15.153:0/4242614094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d9cadbcff0 msgr2=0x55d9cadbd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.709+0000 7f518b63a680 1 --2- 172.21.15.153:0/4242614094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d9cadbcff0 0x55d9cadbd400 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x55d9cad6bf50 tx=0x7f5174012000 comp rx=0 tx=0).stop 2023-10-05T21:15:18.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.709+0000 7f518b63a680 1 -- 172.21.15.153:0/4242614094 shutdown_connections 2023-10-05T21:15:18.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.709+0000 7f518b63a680 1 --2- 172.21.15.153:0/4242614094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d9cadbcff0 0x55d9cadbd400 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.709+0000 7f518b63a680 1 -- 172.21.15.153:0/4242614094 >> 172.21.15.153:0/4242614094 conn(0x55d9cadb81f0 msgr2=0x55d9cadb6350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.709+0000 7f518b63a680 1 -- 172.21.15.153:0/4242614094 shutdown_connections 2023-10-05T21:15:18.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.709+0000 7f518b63a680 1 -- 172.21.15.153:0/4242614094 wait complete. 2023-10-05T21:15:18.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.709+0000 7f518b63a680 1 Processor -- start 2023-10-05T21:15:18.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.710+0000 7f518b63a680 1 -- start start 2023-10-05T21:15:18.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.710+0000 7f518b63a680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d9cadbcff0 0x55d9cadc2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.710+0000 7f518b63a680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9cadc30f0 con 0x55d9cadbcff0 2023-10-05T21:15:18.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.710+0000 7f517df11700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d9cadbcff0 0x55d9cadc2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.710+0000 7f517df11700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d9cadbcff0 0x55d9cadc2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38032/0 (socket says 172.21.15.153:38032) 2023-10-05T21:15:18.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.710+0000 7f517df11700 1 -- 172.21.15.153:0/2960939984 learned_addr learned my addr 172.21.15.153:0/2960939984 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:18.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.710+0000 7f517df11700 1 -- 172.21.15.153:0/2960939984 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9cad754e0 con 0x55d9cadbcff0 2023-10-05T21:15:18.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.710+0000 7f517df11700 1 --2- 172.21.15.153:0/2960939984 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d9cadbcff0 0x55d9cadc2bb0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x55d9cadb7760 tx=0x7f5174031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.710+0000 7f514dfdb700 1 -- 172.21.15.153:0/2960939984 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5174037910 con 0x55d9cadbcff0 2023-10-05T21:15:18.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.710+0000 7f514dfdb700 1 -- 172.21.15.153:0/2960939984 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5174037a70 con 0x55d9cadbcff0 2023-10-05T21:15:18.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.710+0000 7f518b63a680 1 -- 172.21.15.153:0/2960939984 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d9cadc32f0 con 0x55d9cadbcff0 2023-10-05T21:15:18.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.710+0000 7f514dfdb700 1 -- 172.21.15.153:0/2960939984 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5174037d60 con 0x55d9cadbcff0 2023-10-05T21:15:18.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.711+0000 7f518b63a680 1 -- 172.21.15.153:0/2960939984 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d9cadc3740 con 0x55d9cadbcff0 2023-10-05T21:15:18.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.711+0000 7f514dfdb700 1 -- 172.21.15.153:0/2960939984 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f5174026040 con 0x55d9cadbcff0 2023-10-05T21:15:18.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.711+0000 7f514dfdb700 1 --2- 172.21.15.153:0/2960939984 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f50c4034190 0x7f50c4036640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.711+0000 7f514dfdb700 1 -- 172.21.15.153:0/2960939984 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f5174045020 con 0x55d9cadbcff0 2023-10-05T21:15:18.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.712+0000 7f517ef13700 1 --2- 172.21.15.153:0/2960939984 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f50c4034190 0x7f50c4036640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.712+0000 7f518b63a680 5 note: GC not initialized 2023-10-05T21:15:18.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.712+0000 7f517ef13700 1 --2- 172.21.15.153:0/2960939984 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f50c4034190 0x7f50c4036640 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55d9cadaeca0 tx=0x7f517800aee0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.712+0000 7f50beffd700 20 reqs_thread_entry: start 2023-10-05T21:15:18.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.713+0000 7f50bcff9700 20 reqs_thread_entry: start 2023-10-05T21:15:18.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.713+0000 7f518b63a680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:18.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.713+0000 7f518b63a680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:18.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.713+0000 7f50aeffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:48 2023 2023-10-05T21:15:18.749 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:18.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.713+0000 7f50ae7fc700 20 reqs_thread_entry: start 2023-10-05T21:15:18.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.713+0000 7f518b63a680 20 get_system_obj_state: rctx=0x7fff8988efb0 obj=default.rgw.meta:root:myfoo state=0x55d9cac1e240 s->prefetch_data=0 2023-10-05T21:15:18.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.713+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:102 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cae28db0 con 0x7f517000d750 2023-10-05T21:15:18.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.713+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(102 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv27 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f5174034040 con 0x7f517000d750 2023-10-05T21:15:18.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.713+0000 7f518b63a680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:18.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.713+0000 7f518b63a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.713+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:103 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cae2add0 con 0x7f517000d750 2023-10-05T21:15:18.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.714+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(103 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7f5174034040 con 0x7f517000d750 2023-10-05T21:15:18.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.714+0000 7f518b63a680 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T21:15:18.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.714+0000 7f518b63a680 20 get_system_obj_state: rctx=0x7fff8988efb0 obj=default.rgw.meta:root:.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 state=0x55d9cac1e500 s->prefetch_data=0 2023-10-05T21:15:18.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.714+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:104 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cae29130 con 0x55d9cada1f90 2023-10-05T21:15:18.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.714+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(104 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.714+0000 7f518b63a680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:18.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.714+0000 7f518b63a680 20 Read xattr: user.rgw.acl 2023-10-05T21:15:18.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.714+0000 7f518b63a680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:18.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.714+0000 7f518b63a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.714+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:105 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cae2bcf0 con 0x55d9cada1f90 2023-10-05T21:15:18.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.715+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(105 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.715+0000 7f518b63a680 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T21:15:18.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.715+0000 7f518b63a680 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T21:15:18.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.715+0000 7f518b63a680 20 get_system_obj_state: rctx=0x7fff8988ef00 obj=default.rgw.meta:root:myfoo state=0x55d9cac1e500 s->prefetch_data=0 2023-10-05T21:15:18.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.715+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:106 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cae2b010 con 0x7f517000d750 2023-10-05T21:15:18.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.715+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(106 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv27 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f5174034040 con 0x7f517000d750 2023-10-05T21:15:18.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.715+0000 7f518b63a680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:18.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.715+0000 7f518b63a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.715+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:107 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cae2b5c0 con 0x7f517000d750 2023-10-05T21:15:18.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.715+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(107 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7f5174034040 con 0x7f517000d750 2023-10-05T21:15:18.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.715+0000 7f518b63a680 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T21:15:18.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.715+0000 7f518b63a680 20 get_system_obj_state: rctx=0x7fff8988ef00 obj=default.rgw.meta:root:.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 state=0x55d9cac1e240 s->prefetch_data=0 2023-10-05T21:15:18.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.715+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:108 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cae2bbc0 con 0x55d9cada1f90 2023-10-05T21:15:18.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.716+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(108 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.716+0000 7f518b63a680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:18.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.716+0000 7f518b63a680 20 Read xattr: user.rgw.acl 2023-10-05T21:15:18.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.716+0000 7f518b63a680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:18.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.716+0000 7f518b63a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.716+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:109 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cae2e330 con 0x55d9cada1f90 2023-10-05T21:15:18.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.716+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== osd_op_reply(109 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.716+0000 7f518b63a680 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T21:15:18.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.716+0000 7f518b63a680 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T21:15:18.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.716+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:110 4.6 4:63e054bc:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cae2a6f0 con 0x55d9cada1f90 2023-10-05T21:15:18.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.716+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:111 4.18 4:1a996cea:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cae30e60 con 0x7f517000d750 2023-10-05T21:15:18.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.716+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:112 4.18 4:198ebb7d:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cae2a6f0 con 0x7f517000d750 2023-10-05T21:15:18.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.716+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:113 4.1e 4:7ac3851f:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cae35d70 con 0x7f5174007030 2023-10-05T21:15:18.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.716+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:114 4.20 4:0486cb16:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cae38630 con 0x55d9cad71bb0 2023-10-05T21:15:18.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.716+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:115 4.1a 4:5b58f5c0:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cae3aff0 con 0x7f517000d750 2023-10-05T21:15:18.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.716+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:116 4.14 4:2bb8f6a0:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cae3dae0 con 0x55d9cada1f90 2023-10-05T21:15:18.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.716+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:117 4.3f 4:fc00c6e8:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cae40970 con 0x7f517000d750 2023-10-05T21:15:18.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.716+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:118 4.35 4:afba4511:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cae43470 con 0x55d9cad71bb0 2023-10-05T21:15:18.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.716+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:119 4.5 4:a0455ddf:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cae45ef0 con 0x55d9cada1f90 2023-10-05T21:15:18.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.716+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:120 4.a 4:50c49731:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cae48a30 con 0x7f517000d750 2023-10-05T21:15:18.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.716+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(110 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.717+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 31 ==== osd_op_reply(116 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.6 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.717+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 32 ==== osd_op_reply(119 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.717+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(113 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f517800a570 con 0x7f5174007030 2023-10-05T21:15:18.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.717+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(118 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.8 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.717+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(114 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.717+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== osd_op_reply(111 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5174034040 con 0x7f517000d750 2023-10-05T21:15:18.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.717+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 <== osd.2 v2:172.21.15.153:6807/140454 22 ==== osd_op_reply(117 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5174034040 con 0x7f517000d750 2023-10-05T21:15:18.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.717+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 <== osd.2 v2:172.21.15.153:6807/140454 23 ==== osd_op_reply(115 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.5 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f5174034040 con 0x7f517000d750 2023-10-05T21:15:18.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.717+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 <== osd.2 v2:172.21.15.153:6807/140454 24 ==== osd_op_reply(112 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.2 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f5174034040 con 0x7f517000d750 2023-10-05T21:15:18.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.717+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 <== osd.2 v2:172.21.15.153:6807/140454 25 ==== osd_op_reply(120 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f5174034040 con 0x7f517000d750 2023-10-05T21:15:18.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.718+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:121 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94393899584768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cae45ef0 con 0x7f517000d750 2023-10-05T21:15:18.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.719+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 <== osd.2 v2:172.21.15.153:6807/140454 26 ==== osd_op_reply(121 notify.0 [watch unwatch cookie 94393899584768] v29'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5174034040 con 0x7f517000d750 2023-10-05T21:15:18.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.719+0000 7f518b63a680 20 remove_watcher() i=0 2023-10-05T21:15:18.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.719+0000 7f518b63a680 2 removed watcher, disabling cache 2023-10-05T21:15:18.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.719+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:122 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94393899588080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cae45ef0 con 0x55d9cad71bb0 2023-10-05T21:15:18.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.720+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(122 notify.1 [watch unwatch cookie 94393899588080] v29'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.720+0000 7f518b63a680 20 remove_watcher() i=1 2023-10-05T21:15:18.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.720+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:123 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94393899593328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cae45ef0 con 0x55d9cada1f90 2023-10-05T21:15:18.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.721+0000 7f517e712700 1 -- 172.21.15.153:0/1312375521 <== osd.3 v2:172.21.15.153:6800/140455 33 ==== osd_op_reply(123 notify.2 [watch unwatch cookie 94393899593328] v29'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5170014070 con 0x55d9cada1f90 2023-10-05T21:15:18.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.721+0000 7f518b63a680 20 remove_watcher() i=2 2023-10-05T21:15:18.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.721+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:124 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94393899597056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cae45ef0 con 0x7f517000d750 2023-10-05T21:15:18.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.721+0000 7f517df11700 1 -- 172.21.15.153:0/1312375521 <== osd.2 v2:172.21.15.153:6807/140454 27 ==== osd_op_reply(124 notify.3 [watch unwatch cookie 94393899597056] v29'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5174034040 con 0x7f517000d750 2023-10-05T21:15:18.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.721+0000 7f518b63a680 20 remove_watcher() i=3 2023-10-05T21:15:18.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.721+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:125 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94393899601136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cae45ef0 con 0x55d9cad71bb0 2023-10-05T21:15:18.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.722+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(125 notify.4 [watch unwatch cookie 94393899601136] v29'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.722+0000 7f518b63a680 20 remove_watcher() i=4 2023-10-05T21:15:18.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.722+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:126 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94393899590288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cae45ef0 con 0x7f5174007030 2023-10-05T21:15:18.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.723+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(126 notify.5 [watch unwatch cookie 94393899590288] v29'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f517800a570 con 0x7f5174007030 2023-10-05T21:15:18.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.723+0000 7f518b63a680 20 remove_watcher() i=5 2023-10-05T21:15:18.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.723+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:127 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94393899606720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cae45ef0 con 0x7f5174007030 2023-10-05T21:15:18.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.724+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(127 notify.6 [watch unwatch cookie 94393899606720] v29'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f517800a570 con 0x7f5174007030 2023-10-05T21:15:18.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.724+0000 7f518b63a680 20 remove_watcher() i=6 2023-10-05T21:15:18.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.724+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:128 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94393899610832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cae45ef0 con 0x7f5174007030 2023-10-05T21:15:18.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.725+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(128 notify.7 [watch unwatch cookie 94393899610832] v29'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f517800a570 con 0x7f5174007030 2023-10-05T21:15:18.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.725+0000 7f518b63a680 20 remove_watcher() i=7 2023-10-05T21:15:18.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.725+0000 7f514ffdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:18.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.725+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:129 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94393899602240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d9cae45ef0 con 0x55d9cad71bb0 2023-10-05T21:15:18.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.726+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(129 data_loggenerations_metadata [watch unwatch cookie 94393899602240] v29'145 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f517800a570 con 0x55d9cad71bb0 2023-10-05T21:15:18.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.726+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f5174007030 msgr2=0x7f517401d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.726+0000 7f518b63a680 1 --2- 172.21.15.153:0/1312375521 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f5174007030 0x7f517401d420 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.726+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d9cad71bb0 msgr2=0x55d9cad9fb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.726+0000 7f518b63a680 1 --2- 172.21.15.153:0/1312375521 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d9cad71bb0 0x55d9cad9fb20 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.726+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f517000d750 msgr2=0x7f5170017430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.726+0000 7f518b63a680 1 --2- 172.21.15.153:0/1312375521 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f517000d750 0x7f5170017430 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.726+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d9cada1f90 msgr2=0x55d9cada4370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.726+0000 7f518b63a680 1 --2- 172.21.15.153:0/1312375521 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d9cada1f90 0x55d9cada4370 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.726+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5160034140 msgr2=0x7f51600365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.726+0000 7f518b63a680 1 --2- 172.21.15.153:0/1312375521 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5160034140 0x7f51600365f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5174003080 tx=0x7f5174015000 comp rx=0 tx=0).stop 2023-10-05T21:15:18.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.726+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d9cacdf0a0 msgr2=0x55d9cad93dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.726+0000 7f518b63a680 1 --2- 172.21.15.153:0/1312375521 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d9cacdf0a0 0x55d9cad93dc0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f51700017b0 tx=0x7f5170016000 comp rx=0 tx=0).stop 2023-10-05T21:15:18.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.726+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 reap_dead start 2023-10-05T21:15:18.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.726+0000 7f517ef13700 1 -- 172.21.15.153:0/1312375521 reap_dead start 2023-10-05T21:15:18.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.726+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 shutdown_connections 2023-10-05T21:15:18.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.726+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 >> 172.21.15.153:0/1312375521 conn(0x55d9cad65b80 msgr2=0x55d9cad86c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.726+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 shutdown_connections 2023-10-05T21:15:18.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.726+0000 7f518b63a680 1 -- 172.21.15.153:0/1312375521 wait complete. 2023-10-05T21:15:18.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.727+0000 7f518b63a680 1 -- 172.21.15.153:0/2960939984 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f50c4034190 msgr2=0x7f50c4036640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.727+0000 7f518b63a680 1 --2- 172.21.15.153:0/2960939984 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f50c4034190 0x7f50c4036640 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55d9cadaeca0 tx=0x7f517800aee0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.727+0000 7f518b63a680 1 -- 172.21.15.153:0/2960939984 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d9cadbcff0 msgr2=0x55d9cadc2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.727+0000 7f518b63a680 1 --2- 172.21.15.153:0/2960939984 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d9cadbcff0 0x55d9cadc2bb0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x55d9cadb7760 tx=0x7f5174031000 comp rx=0 tx=0).stop 2023-10-05T21:15:18.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.727+0000 7f518b63a680 1 -- 172.21.15.153:0/2960939984 shutdown_connections 2023-10-05T21:15:18.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.727+0000 7f518b63a680 1 --2- 172.21.15.153:0/2960939984 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f50c4034190 0x7f50c4036640 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.727+0000 7f518b63a680 1 --2- 172.21.15.153:0/2960939984 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d9cadbcff0 0x55d9cadc2bb0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.727+0000 7f518b63a680 1 -- 172.21.15.153:0/2960939984 >> 172.21.15.153:0/2960939984 conn(0x55d9cadb81f0 msgr2=0x55d9cadb6320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.727+0000 7f518b63a680 1 -- 172.21.15.153:0/2960939984 shutdown_connections 2023-10-05T21:15:18.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.727+0000 7f518b63a680 1 -- 172.21.15.153:0/2960939984 wait complete. 2023-10-05T21:15:18.760 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:18.761 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo", 2023-10-05T21:15:18.761 INFO:teuthology.orchestra.run.smithi153.stdout: "num_shards": 11, 2023-10-05T21:15:18.761 INFO:teuthology.orchestra.run.smithi153.stdout: "tenant": "", 2023-10-05T21:15:18.761 INFO:teuthology.orchestra.run.smithi153.stdout: "zonegroup": "371967c9-8a2e-480a-9a00-92e7f0730f89", 2023-10-05T21:15:18.761 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_rule": "default-placement", 2023-10-05T21:15:18.761 INFO:teuthology.orchestra.run.smithi153.stdout: "explicit_placement": { 2023-10-05T21:15:18.761 INFO:teuthology.orchestra.run.smithi153.stdout: "data_pool": "", 2023-10-05T21:15:18.761 INFO:teuthology.orchestra.run.smithi153.stdout: "data_extra_pool": "", 2023-10-05T21:15:18.761 INFO:teuthology.orchestra.run.smithi153.stdout: "index_pool": "" 2023-10-05T21:15:18.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:18.761 INFO:teuthology.orchestra.run.smithi153.stdout: "id": "193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1", 2023-10-05T21:15:18.762 INFO:teuthology.orchestra.run.smithi153.stdout: "marker": "193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1", 2023-10-05T21:15:18.762 INFO:teuthology.orchestra.run.smithi153.stdout: "index_type": "Normal", 2023-10-05T21:15:18.762 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:15:18.762 INFO:teuthology.orchestra.run.smithi153.stdout: "ver": "0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1", 2023-10-05T21:15:18.762 INFO:teuthology.orchestra.run.smithi153.stdout: "master_ver": "0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0", 2023-10-05T21:15:18.762 INFO:teuthology.orchestra.run.smithi153.stdout: "mtime": "2023-10-05T21:15:18.253745Z", 2023-10-05T21:15:18.762 INFO:teuthology.orchestra.run.smithi153.stdout: "creation_time": "2023-10-05T21:15:15.576323Z", 2023-10-05T21:15:18.762 INFO:teuthology.orchestra.run.smithi153.stdout: "max_marker": "0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#", 2023-10-05T21:15:18.762 INFO:teuthology.orchestra.run.smithi153.stdout: "usage": { 2023-10-05T21:15:18.762 INFO:teuthology.orchestra.run.smithi153.stdout: "rgw.main": { 2023-10-05T21:15:18.762 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 0, 2023-10-05T21:15:18.762 INFO:teuthology.orchestra.run.smithi153.stdout: "size_actual": 0, 2023-10-05T21:15:18.763 INFO:teuthology.orchestra.run.smithi153.stdout: "size_utilized": 0, 2023-10-05T21:15:18.763 INFO:teuthology.orchestra.run.smithi153.stdout: "size_kb": 0, 2023-10-05T21:15:18.763 INFO:teuthology.orchestra.run.smithi153.stdout: "size_kb_actual": 0, 2023-10-05T21:15:18.763 INFO:teuthology.orchestra.run.smithi153.stdout: "size_kb_utilized": 0, 2023-10-05T21:15:18.763 INFO:teuthology.orchestra.run.smithi153.stdout: "num_objects": 0 2023-10-05T21:15:18.763 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:18.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:18.763 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:15:18.763 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:18.763 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:18.764 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:18.764 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:18.764 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:18.764 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:18.764 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:18.764 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '371967c9-8a2e-480a-9a00-92e7f0730f89', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1', 'marker': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1', 'index_type': 'Normal', 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2023-10-05T21:15:18.253745Z', 'creation_time': '2023-10-05T21:15:15.576323Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2023-10-05T21:15:18.764 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2023-10-05T21:15:18.764 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2023-10-05T21:15:18.765 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2023-10-05T21:15:18.806 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:18.806 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:18.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.805+0000 7fdd9418f680 1 Processor -- start 2023-10-05T21:15:18.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.805+0000 7fdd9418f680 1 -- start start 2023-10-05T21:15:18.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.805+0000 7fdd9418f680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5652002337c0 0x565200235ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.805+0000 7fdd9418f680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56520017d970 con 0x56520022f290 2023-10-05T21:15:18.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.805+0000 7fdd9418f680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x56520013ddb0 con 0x5652002337c0 2023-10-05T21:15:18.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.805+0000 7fdd86a66700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5652002337c0 0x565200235ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.805+0000 7fdd87267700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x56520022f290 0x56520022f6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:55254/0 (socket says 172.21.15.153:55254) 2023-10-05T21:15:18.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.805+0000 7fdd87267700 1 -- 172.21.15.153:0/2663292066 learned_addr learned my addr 172.21.15.153:0/2663292066 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:18.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.805+0000 7fdd86a66700 1 -- 172.21.15.153:0/2663292066 >> v1:172.21.15.111:6789/0 conn(0x56520022f290 legacy=0x56520022f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.805+0000 7fdd86265700 1 -- 172.21.15.153:0/2663292066 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1852567246 0 0) 0x56520017d970 con 0x56520022f290 2023-10-05T21:15:18.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.805+0000 7fdd86a66700 1 -- 172.21.15.153:0/2663292066 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652002370f0 con 0x5652002337c0 2023-10-05T21:15:18.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.806+0000 7fdd86a66700 1 --2- 172.21.15.153:0/2663292066 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5652002337c0 0x565200235ba0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c00a5d0 tx=0x7fdd7c005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=393e0d3c4cb68701 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.806+0000 7fdd86265700 1 -- 172.21.15.153:0/2663292066 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd7c0086a0 con 0x5652002337c0 2023-10-05T21:15:18.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.806+0000 7fdd86265700 1 -- 172.21.15.153:0/2663292066 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7c008800 con 0x5652002337c0 2023-10-05T21:15:18.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.806+0000 7fdd86265700 1 -- 172.21.15.153:0/2663292066 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd7c008ad0 con 0x5652002337c0 2023-10-05T21:15:18.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.806+0000 7fdd9418f680 1 -- 172.21.15.153:0/2663292066 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5652002337c0 msgr2=0x565200235ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.806+0000 7fdd9418f680 1 --2- 172.21.15.153:0/2663292066 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5652002337c0 0x565200235ba0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c00a5d0 tx=0x7fdd7c005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:18.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.806+0000 7fdd9418f680 1 -- 172.21.15.153:0/2663292066 shutdown_connections 2023-10-05T21:15:18.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.806+0000 7fdd9418f680 1 --2- 172.21.15.153:0/2663292066 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5652002337c0 0x565200235ba0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.806+0000 7fdd9418f680 1 -- 172.21.15.153:0/2663292066 >> 172.21.15.153:0/2663292066 conn(0x56520022ab60 msgr2=0x56520022cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.806+0000 7fdd9418f680 1 -- 172.21.15.153:0/2663292066 shutdown_connections 2023-10-05T21:15:18.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.806+0000 7fdd9418f680 1 -- 172.21.15.153:0/2663292066 wait complete. 2023-10-05T21:15:18.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.807+0000 7fdd9418f680 1 Processor -- start 2023-10-05T21:15:18.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.807+0000 7fdd9418f680 1 -- start start 2023-10-05T21:15:18.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.807+0000 7fdd9418f680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56520022f290 0x56520024e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.807+0000 7fdd9418f680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652000ddea0 con 0x56520022f290 2023-10-05T21:15:18.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.807+0000 7fdd87267700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56520022f290 0x56520024e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.807+0000 7fdd87267700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56520022f290 0x56520024e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38052/0 (socket says 172.21.15.153:38052) 2023-10-05T21:15:18.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.807+0000 7fdd87267700 1 -- 172.21.15.153:0/2877989819 learned_addr learned my addr 172.21.15.153:0/2877989819 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:18.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.808+0000 7fdd87267700 1 -- 172.21.15.153:0/2877989819 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd7c005cf0 con 0x56520022f290 2023-10-05T21:15:18.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.808+0000 7fdd87267700 1 --2- 172.21.15.153:0/2877989819 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56520022f290 0x56520024e5b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fdd78001dc0 tx=0x7fdd78001790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4590aa652335fe0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.808+0000 7fdd85263700 1 -- 172.21.15.153:0/2877989819 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd7800bce0 con 0x56520022f290 2023-10-05T21:15:18.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.808+0000 7fdd85263700 1 -- 172.21.15.153:0/2877989819 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7800be40 con 0x56520022f290 2023-10-05T21:15:18.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.808+0000 7fdd85263700 1 -- 172.21.15.153:0/2877989819 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd7800e5d0 con 0x56520022f290 2023-10-05T21:15:18.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.808+0000 7fdd9418f680 1 -- 172.21.15.153:0/2877989819 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56520022f290 msgr2=0x56520024e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.808+0000 7fdd9418f680 1 --2- 172.21.15.153:0/2877989819 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56520022f290 0x56520024e5b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fdd78001dc0 tx=0x7fdd78001790 comp rx=0 tx=0).stop 2023-10-05T21:15:18.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.808+0000 7fdd9418f680 1 -- 172.21.15.153:0/2877989819 shutdown_connections 2023-10-05T21:15:18.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.808+0000 7fdd9418f680 1 --2- 172.21.15.153:0/2877989819 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56520022f290 0x56520024e5b0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.808+0000 7fdd9418f680 1 -- 172.21.15.153:0/2877989819 >> 172.21.15.153:0/2877989819 conn(0x56520022ab60 msgr2=0x56520024a080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.808+0000 7fdd9418f680 1 -- 172.21.15.153:0/2877989819 shutdown_connections 2023-10-05T21:15:18.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.808+0000 7fdd9418f680 1 -- 172.21.15.153:0/2877989819 wait complete. 2023-10-05T21:15:18.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.809+0000 7fdd9418f680 1 Processor -- start 2023-10-05T21:15:18.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.809+0000 7fdd9418f680 1 -- start start 2023-10-05T21:15:18.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.809+0000 7fdd9418f680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56520022f290 0x5652002597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.809+0000 7fdd9418f680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652000d4c80 con 0x56520022f290 2023-10-05T21:15:18.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.809+0000 7fdd87267700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56520022f290 0x5652002597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.809+0000 7fdd87267700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56520022f290 0x5652002597f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38054/0 (socket says 172.21.15.153:38054) 2023-10-05T21:15:18.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.809+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 learned_addr learned my addr 172.21.15.153:0/2561313195 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:18.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.809+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd78001a70 con 0x56520022f290 2023-10-05T21:15:18.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.810+0000 7fdd87267700 1 --2- 172.21.15.153:0/2561313195 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56520022f290 0x5652002597f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fdd780017d0 tx=0x7fdd78016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.810+0000 7fdd777fe700 1 -- 172.21.15.153:0/2561313195 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd7801f070 con 0x56520022f290 2023-10-05T21:15:18.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.810+0000 7fdd777fe700 1 -- 172.21.15.153:0/2561313195 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7801a4d0 con 0x56520022f290 2023-10-05T21:15:18.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.810+0000 7fdd777fe700 1 -- 172.21.15.153:0/2561313195 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd7801a7a0 con 0x56520022f290 2023-10-05T21:15:18.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.810+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5652001a4950 con 0x56520022f290 2023-10-05T21:15:18.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.810+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565200259d30 con 0x56520022f290 2023-10-05T21:15:18.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.811+0000 7fdd777fe700 1 -- 172.21.15.153:0/2561313195 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fdd7801a900 con 0x56520022f290 2023-10-05T21:15:18.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.811+0000 7fdd9418f680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.811+0000 7fdd777fe700 1 --2- 172.21.15.153:0/2561313195 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fdd6c034140 0x7fdd6c0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.811+0000 7fdd777fe700 1 -- 172.21.15.153:0/2561313195 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fdd78048eb0 con 0x56520022f290 2023-10-05T21:15:18.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.811+0000 7fdd86a66700 1 --2- 172.21.15.153:0/2561313195 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fdd6c034140 0x7fdd6c0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.811+0000 7fdd9418f680 1 --2- 172.21.15.153:0/2561313195 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5652002337c0 0x565200262890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.811+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200263020 con 0x5652002337c0 2023-10-05T21:15:18.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.811+0000 7fdd87a68700 1 --2- 172.21.15.153:0/2561313195 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5652002337c0 0x565200262890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.812+0000 7fdd86a66700 1 --2- 172.21.15.153:0/2561313195 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fdd6c034140 0x7fdd6c0365f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c003080 tx=0x7fdd7c015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.812+0000 7fdd87a68700 1 --2- 172.21.15.153:0/2561313195 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5652002337c0 0x565200262890 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.812+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.812+0000 7fdd9418f680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.812+0000 7fdd9418f680 20 realm 2023-10-05T21:15:18.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.812+0000 7fdd9418f680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.812+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56520025feb0 con 0x5652002337c0 2023-10-05T21:15:18.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.812+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.812+0000 7fdd9418f680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.812+0000 7fdd9418f680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:18.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.812+0000 7fdd9418f680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.812+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200263b20 con 0x5652002337c0 2023-10-05T21:15:18.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.812+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.812+0000 7fdd9418f680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.812+0000 7fdd9418f680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.812+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200264440 con 0x5652002337c0 2023-10-05T21:15:18.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.813+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.813+0000 7fdd9418f680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:18.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.813+0000 7fdd9418f680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.813+0000 7fdd9418f680 1 --2- 172.21.15.153:0/2561313195 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x565200264d00 0x5652002670e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.813+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5652002676b0 con 0x565200264d00 2023-10-05T21:15:18.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.813+0000 7fdd87267700 1 --2- 172.21.15.153:0/2561313195 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x565200264d00 0x5652002670e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.813+0000 7fdd87267700 1 --2- 172.21.15.153:0/2561313195 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x565200264d00 0x5652002670e0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.813+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fdd78014070 con 0x565200264d00 2023-10-05T21:15:18.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.813+0000 7fdd9418f680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:18.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.813+0000 7fdd9418f680 20 searching for the correct realm 2023-10-05T21:15:18.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.813+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x565200264d00 2023-10-05T21:15:18.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.813+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd78014070 con 0x565200264d00 2023-10-05T21:15:18.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.814+0000 7fdd87267700 1 --2- 172.21.15.153:0/2561313195 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fdd7802d020 0x7fdd7802c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.814+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x7fdd7802d020 2023-10-05T21:15:18.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.814+0000 7fdd86a66700 1 --2- 172.21.15.153:0/2561313195 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fdd7802d020 0x7fdd7802c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.814+0000 7fdd86a66700 1 --2- 172.21.15.153:0/2561313195 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fdd7802d020 0x7fdd7802c5d0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.814+0000 7fdd86a66700 1 -- 172.21.15.153:0/2561313195 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd7c019040 con 0x7fdd7802d020 2023-10-05T21:15:18.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.814+0000 7fdd86a66700 1 --2- 172.21.15.153:0/2561313195 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fdd7c007030 0x7fdd7c01d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.814+0000 7fdd86a66700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x7fdd7c007030 2023-10-05T21:15:18.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.815+0000 7fdd87a68700 1 --2- 172.21.15.153:0/2561313195 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fdd7c007030 0x7fdd7c01d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.815+0000 7fdd87a68700 1 --2- 172.21.15.153:0/2561313195 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fdd7c007030 0x7fdd7c01d420 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.815+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd7c007030 2023-10-05T21:15:18.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.815+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x5652002337c0 2023-10-05T21:15:18.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.815+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.815+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x5652002337c0 2023-10-05T21:15:18.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.816+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.816+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x7fdd7c007030 2023-10-05T21:15:18.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.816+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd7c007030 2023-10-05T21:15:18.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.816+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x7fdd7c007030 2023-10-05T21:15:18.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.816+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd7c007030 2023-10-05T21:15:18.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.816+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x7fdd7802d020 2023-10-05T21:15:18.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.816+0000 7fdd86a66700 1 -- 172.21.15.153:0/2561313195 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd7c019040 con 0x7fdd7802d020 2023-10-05T21:15:18.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.816+0000 7fdd86a66700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x565200264d00 2023-10-05T21:15:18.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.817+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fdd78014070 con 0x565200264d00 2023-10-05T21:15:18.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.817+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x5652002337c0 2023-10-05T21:15:18.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.817+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.817+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x7fdd7c007030 2023-10-05T21:15:18.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.817+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd7c007030 2023-10-05T21:15:18.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.817+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x5652002337c0 2023-10-05T21:15:18.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.817+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.817+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x7fdd7802d020 2023-10-05T21:15:18.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.817+0000 7fdd86a66700 1 -- 172.21.15.153:0/2561313195 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd7c019040 con 0x7fdd7802d020 2023-10-05T21:15:18.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.818+0000 7fdd86a66700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x565200264d00 2023-10-05T21:15:18.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.818+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd78014070 con 0x565200264d00 2023-10-05T21:15:18.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.818+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x565200264d00 2023-10-05T21:15:18.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.818+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd78014070 con 0x565200264d00 2023-10-05T21:15:18.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.818+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x7fdd7c007030 2023-10-05T21:15:18.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.818+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd7c007030 2023-10-05T21:15:18.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.818+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x565200264d00 2023-10-05T21:15:18.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.818+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd78014070 con 0x565200264d00 2023-10-05T21:15:18.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.818+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x565200264d00 2023-10-05T21:15:18.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.819+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd78014070 con 0x565200264d00 2023-10-05T21:15:18.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.819+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x5652002337c0 2023-10-05T21:15:18.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.819+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.819+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x5652002337c0 2023-10-05T21:15:18.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.819+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.819+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x7fdd7c007030 2023-10-05T21:15:18.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.819+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd7c007030 2023-10-05T21:15:18.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.819+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x565200264d00 2023-10-05T21:15:18.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.819+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd78014070 con 0x565200264d00 2023-10-05T21:15:18.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.819+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x7fdd7802d020 2023-10-05T21:15:18.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.820+0000 7fdd86a66700 1 -- 172.21.15.153:0/2561313195 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd7c019040 con 0x7fdd7802d020 2023-10-05T21:15:18.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.820+0000 7fdd86a66700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x5652002337c0 2023-10-05T21:15:18.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.820+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.820+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x7fdd7c007030 2023-10-05T21:15:18.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.820+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd7c007030 2023-10-05T21:15:18.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.820+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x565200264d00 2023-10-05T21:15:18.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.820+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd78014070 con 0x565200264d00 2023-10-05T21:15:18.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.820+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x7fdd7c007030 2023-10-05T21:15:18.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.821+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd7c007030 2023-10-05T21:15:18.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.821+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x7fdd7802d020 2023-10-05T21:15:18.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.821+0000 7fdd86a66700 1 -- 172.21.15.153:0/2561313195 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd7c019040 con 0x7fdd7802d020 2023-10-05T21:15:18.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.821+0000 7fdd86a66700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x565200264d00 2023-10-05T21:15:18.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.821+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd78014070 con 0x565200264d00 2023-10-05T21:15:18.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.821+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x7fdd7c007030 2023-10-05T21:15:18.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.821+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd7c007030 2023-10-05T21:15:18.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.821+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x5652002337c0 2023-10-05T21:15:18.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.821+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.821+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268fd0 con 0x7fdd7802d020 2023-10-05T21:15:18.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.822+0000 7fdd86a66700 1 -- 172.21.15.153:0/2561313195 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd7c019040 con 0x7fdd7802d020 2023-10-05T21:15:18.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.822+0000 7fdd9418f680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:18.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.822+0000 7fdd9418f680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:18.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.822+0000 7fdd9418f680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:18.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.822+0000 7fdd9418f680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:18.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.822+0000 7fdd9418f680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.822+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268140 con 0x5652002337c0 2023-10-05T21:15:18.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.822+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.822+0000 7fdd9418f680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.822+0000 7fdd9418f680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.822+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200267d40 con 0x5652002337c0 2023-10-05T21:15:18.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.822+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.822+0000 7fdd9418f680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:18.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.822+0000 7fdd9418f680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.822+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268a80 con 0x5652002337c0 2023-10-05T21:15:18.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.822+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.822+0000 7fdd9418f680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:18.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.822+0000 7fdd9418f680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.822+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268570 con 0x565200264d00 2023-10-05T21:15:18.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.822+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fdd78014070 con 0x565200264d00 2023-10-05T21:15:18.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.823+0000 7fdd9418f680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.823+0000 7fdd9418f680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.823+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200269870 con 0x5652002337c0 2023-10-05T21:15:18.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.823+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.823+0000 7fdd9418f680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.823+0000 7fdd9418f680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.823+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200269c70 con 0x5652002337c0 2023-10-05T21:15:18.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.823+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.823+0000 7fdd9418f680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:18.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.823+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56520026ac80 con 0x565200264d00 2023-10-05T21:15:18.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.823+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd78014070 con 0x565200264d00 2023-10-05T21:15:18.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.823+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56520026ac80 con 0x7fdd7802d020 2023-10-05T21:15:18.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.823+0000 7fdd86a66700 1 -- 172.21.15.153:0/2561313195 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd7c019040 con 0x7fdd7802d020 2023-10-05T21:15:18.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.823+0000 7fdd86a66700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56520026ac80 con 0x7fdd7c007030 2023-10-05T21:15:18.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.824+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd7c007030 2023-10-05T21:15:18.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.824+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268a80 con 0x5652002337c0 2023-10-05T21:15:18.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.824+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.824+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268a80 con 0x5652002337c0 2023-10-05T21:15:18.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.824+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.824+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268a80 con 0x7fdd7c007030 2023-10-05T21:15:18.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.825+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd7c007030 2023-10-05T21:15:18.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.825+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268a80 con 0x7fdd7c007030 2023-10-05T21:15:18.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.825+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd7c007030 2023-10-05T21:15:18.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.825+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268a80 con 0x7fdd7802d020 2023-10-05T21:15:18.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.825+0000 7fdd86a66700 1 -- 172.21.15.153:0/2561313195 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd7c019040 con 0x7fdd7802d020 2023-10-05T21:15:18.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.825+0000 7fdd86a66700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268a80 con 0x565200264d00 2023-10-05T21:15:18.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.825+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fdd78014070 con 0x565200264d00 2023-10-05T21:15:18.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.825+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268a80 con 0x5652002337c0 2023-10-05T21:15:18.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.825+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.825+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268a80 con 0x7fdd7c007030 2023-10-05T21:15:18.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.826+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd7c007030 2023-10-05T21:15:18.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.826+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268a80 con 0x5652002337c0 2023-10-05T21:15:18.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.826+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.826+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268a80 con 0x7fdd7802d020 2023-10-05T21:15:18.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.826+0000 7fdd86a66700 1 -- 172.21.15.153:0/2561313195 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd7c019040 con 0x7fdd7802d020 2023-10-05T21:15:18.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.826+0000 7fdd86a66700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268a80 con 0x565200264d00 2023-10-05T21:15:18.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.826+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd78014070 con 0x565200264d00 2023-10-05T21:15:18.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.826+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268a80 con 0x565200264d00 2023-10-05T21:15:18.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.827+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd78014070 con 0x565200264d00 2023-10-05T21:15:18.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.827+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268a80 con 0x7fdd7c007030 2023-10-05T21:15:18.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.827+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd7c007030 2023-10-05T21:15:18.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.827+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268a80 con 0x565200264d00 2023-10-05T21:15:18.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.827+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd78014070 con 0x565200264d00 2023-10-05T21:15:18.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.827+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268a80 con 0x565200264d00 2023-10-05T21:15:18.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.827+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd78014070 con 0x565200264d00 2023-10-05T21:15:18.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.827+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268a80 con 0x5652002337c0 2023-10-05T21:15:18.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.827+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.827+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268a80 con 0x5652002337c0 2023-10-05T21:15:18.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.828+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.828+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268a80 con 0x7fdd7c007030 2023-10-05T21:15:18.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.828+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd7c007030 2023-10-05T21:15:18.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.828+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268a80 con 0x565200264d00 2023-10-05T21:15:18.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.828+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd78014070 con 0x565200264d00 2023-10-05T21:15:18.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.828+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268a80 con 0x7fdd7802d020 2023-10-05T21:15:18.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.828+0000 7fdd86a66700 1 -- 172.21.15.153:0/2561313195 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd7c019040 con 0x7fdd7802d020 2023-10-05T21:15:18.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.828+0000 7fdd86a66700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268a80 con 0x5652002337c0 2023-10-05T21:15:18.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.828+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.828+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268a80 con 0x7fdd7c007030 2023-10-05T21:15:18.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.829+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd7c007030 2023-10-05T21:15:18.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.829+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268a80 con 0x565200264d00 2023-10-05T21:15:18.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.829+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd78014070 con 0x565200264d00 2023-10-05T21:15:18.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.829+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268a80 con 0x7fdd7c007030 2023-10-05T21:15:18.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.829+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd7c007030 2023-10-05T21:15:18.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.829+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268a80 con 0x7fdd7802d020 2023-10-05T21:15:18.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.829+0000 7fdd86a66700 1 -- 172.21.15.153:0/2561313195 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd7c019040 con 0x7fdd7802d020 2023-10-05T21:15:18.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.829+0000 7fdd86a66700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268a80 con 0x565200264d00 2023-10-05T21:15:18.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.830+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd78014070 con 0x565200264d00 2023-10-05T21:15:18.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.830+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268a80 con 0x7fdd7c007030 2023-10-05T21:15:18.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.830+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd7c007030 2023-10-05T21:15:18.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.830+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268a80 con 0x5652002337c0 2023-10-05T21:15:18.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.830+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.830+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200268a80 con 0x7fdd7802d020 2023-10-05T21:15:18.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.830+0000 7fdd86a66700 1 -- 172.21.15.153:0/2561313195 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdd7c019040 con 0x7fdd7802d020 2023-10-05T21:15:18.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.830+0000 7fdd9418f680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:18.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.830+0000 7fdd9418f680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:18.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.830+0000 7fdd9418f680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:18.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.830+0000 7fdd9418f680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:18.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.830+0000 7fdd9418f680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.830+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200269c70 con 0x5652002337c0 2023-10-05T21:15:18.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.830+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.830+0000 7fdd9418f680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:18.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.830+0000 7fdd9418f680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.830+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56520026a020 con 0x565200264d00 2023-10-05T21:15:18.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.831+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fdd78014070 con 0x565200264d00 2023-10-05T21:15:18.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.831+0000 7fdd9418f680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:18.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.831+0000 7fdd9418f680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.831+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56520026a3d0 con 0x5652002337c0 2023-10-05T21:15:18.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.831+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.831+0000 7fdd9418f680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:18.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.831+0000 7fdd9418f680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.831+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56520026a3d0 con 0x5652002337c0 2023-10-05T21:15:18.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.831+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.831+0000 7fdd9418f680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:18.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.831+0000 7fdd9418f680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.831+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56520026a820 con 0x7fdd7c007030 2023-10-05T21:15:18.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.832+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd7c007030 2023-10-05T21:15:18.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.832+0000 7fdd9418f680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.832+0000 7fdd9418f680 20 zone default found 2023-10-05T21:15:18.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.832+0000 7fdd9418f680 4 Realm: () 2023-10-05T21:15:18.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.832+0000 7fdd9418f680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:18.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.832+0000 7fdd9418f680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:18.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.832+0000 7fdd9418f680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:18.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.832+0000 7fdd9418f680 20 zonegroup default 2023-10-05T21:15:18.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.832+0000 7fdd9418f680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.832+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56520026a820 con 0x7fdd7c007030 2023-10-05T21:15:18.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.832+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd7c007030 2023-10-05T21:15:18.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.832+0000 7fdd9418f680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.832+0000 7fdd9418f680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.832+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56520026c150 con 0x565200264d00 2023-10-05T21:15:18.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.832+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fdd78014070 con 0x565200264d00 2023-10-05T21:15:18.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.832+0000 7fdd9418f680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.832+0000 7fdd9418f680 20 rados->read ofs=0 len=0 2023-10-05T21:15:18.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.832+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56520026c500 con 0x565200264d00 2023-10-05T21:15:18.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.832+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fdd78014070 con 0x565200264d00 2023-10-05T21:15:18.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.832+0000 7fdd9418f680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:18.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.832+0000 7fdd9418f680 20 started sync module instance, tier type = 2023-10-05T21:15:18.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.832+0000 7fdd9418f680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:18.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.832+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56520026b810 con 0x7fdd7802d020 2023-10-05T21:15:18.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.833+0000 7fdd86a66700 1 -- 172.21.15.153:0/2561313195 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd7c019040 con 0x7fdd7802d020 2023-10-05T21:15:18.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.833+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94910189845520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56520026cda0 con 0x7fdd7802d020 2023-10-05T21:15:18.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.833+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56520026d640 con 0x5652002337c0 2023-10-05T21:15:18.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.834+0000 7fdd86a66700 1 -- 172.21.15.153:0/2561313195 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94910189845520] v29'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd7c019040 con 0x7fdd7802d020 2023-10-05T21:15:18.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.834+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.834+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94910189848752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56520026d640 con 0x5652002337c0 2023-10-05T21:15:18.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.834+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56520026e200 con 0x565200264d00 2023-10-05T21:15:18.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.835+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94910189848752] v29'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.835+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd78014070 con 0x565200264d00 2023-10-05T21:15:18.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.835+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94910189850960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56520026d5a0 con 0x565200264d00 2023-10-05T21:15:18.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.835+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56520026efe0 con 0x7fdd7802d020 2023-10-05T21:15:18.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.835+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94910189850960] v29'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd78014070 con 0x565200264d00 2023-10-05T21:15:18.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.836+0000 7fdd86a66700 1 -- 172.21.15.153:0/2561313195 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd7c019040 con 0x7fdd7802d020 2023-10-05T21:15:18.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.836+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94910189856544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56520026ebf0 con 0x7fdd7802d020 2023-10-05T21:15:18.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.836+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200270090 con 0x5652002337c0 2023-10-05T21:15:18.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.836+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.836+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94910189861728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200270980 con 0x5652002337c0 2023-10-05T21:15:18.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.836+0000 7fdd86a66700 1 -- 172.21.15.153:0/2561313195 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94910189856544] v29'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd7c019040 con 0x7fdd7802d020 2023-10-05T21:15:18.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.836+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56520026f3d0 con 0x7fdd7c007030 2023-10-05T21:15:18.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.837+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94910189861728] v29'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.837+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd7c007030 2023-10-05T21:15:18.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.837+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94910189863904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200270f30 con 0x7fdd7c007030 2023-10-05T21:15:18.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.837+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200271980 con 0x7fdd7c007030 2023-10-05T21:15:18.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.838+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94910189863904] v29'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd7c007030 2023-10-05T21:15:18.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.838+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd7c007030 2023-10-05T21:15:18.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.838+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94910189865008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200271940 con 0x7fdd7c007030 2023-10-05T21:15:18.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.838+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200272420 con 0x7fdd7c007030 2023-10-05T21:15:18.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.838+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(98 notify.7 [create] v29'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd7c007030 2023-10-05T21:15:18.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.839+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(97 notify.6 [watch watch cookie 94910189865008] v29'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd7c007030 2023-10-05T21:15:18.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.839+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94910189870736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5652002728d0 con 0x7fdd7c007030 2023-10-05T21:15:18.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.839+0000 7fdd9418f680 20 add_watcher() i=0 2023-10-05T21:15:18.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.839+0000 7fdd9418f680 20 add_watcher() i=1 2023-10-05T21:15:18.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.839+0000 7fdd9418f680 20 add_watcher() i=2 2023-10-05T21:15:18.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.839+0000 7fdd9418f680 20 add_watcher() i=3 2023-10-05T21:15:18.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.839+0000 7fdd9418f680 20 add_watcher() i=4 2023-10-05T21:15:18.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.839+0000 7fdd9418f680 20 add_watcher() i=5 2023-10-05T21:15:18.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.839+0000 7fdd9418f680 20 add_watcher() i=6 2023-10-05T21:15:18.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.839+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94910189870736] v29'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd7c007030 2023-10-05T21:15:18.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.839+0000 7fdd9418f680 20 add_watcher() i=7 2023-10-05T21:15:18.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.839+0000 7fdd9418f680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:18.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.839+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5652002728d0 con 0x5652002337c0 2023-10-05T21:15:18.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.839+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.839+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94910189872096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200272830 con 0x5652002337c0 2023-10-05T21:15:18.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.840+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94910189872096] v29'146 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.840+0000 7fdcd3fff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:18.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.840+0000 7fdd9418f680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:18.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.840+0000 7fdd9418f680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:18.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.841+0000 7fdd9418f680 1 Processor -- start 2023-10-05T21:15:18.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.841+0000 7fdd9418f680 1 -- start start 2023-10-05T21:15:18.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.841+0000 7fdd9418f680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x565200256d50 0x565200257160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.841+0000 7fdd9418f680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652002576a0 con 0x565200256d50 2023-10-05T21:15:18.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.841+0000 7fdd86a66700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x565200256d50 0x565200257160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.841+0000 7fdd86a66700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x565200256d50 0x565200257160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38062/0 (socket says 172.21.15.153:38062) 2023-10-05T21:15:18.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.841+0000 7fdd86a66700 1 -- 172.21.15.153:0/2946112326 learned_addr learned my addr 172.21.15.153:0/2946112326 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:18.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.841+0000 7fdd86a66700 1 -- 172.21.15.153:0/2946112326 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652002555d0 con 0x565200256d50 2023-10-05T21:15:18.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.842+0000 7fdd86a66700 1 --2- 172.21.15.153:0/2946112326 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x565200256d50 0x565200257160 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x56520022ff60 tx=0x7fdd7c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ba5aaa4446f0eb server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.842+0000 7fdcd37fe700 1 -- 172.21.15.153:0/2946112326 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd7c02b440 con 0x565200256d50 2023-10-05T21:15:18.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.842+0000 7fdcd37fe700 1 -- 172.21.15.153:0/2946112326 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7c02b5c0 con 0x565200256d50 2023-10-05T21:15:18.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.842+0000 7fdcd37fe700 1 -- 172.21.15.153:0/2946112326 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd7c02b770 con 0x565200256d50 2023-10-05T21:15:18.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.842+0000 7fdd9418f680 1 -- 172.21.15.153:0/2946112326 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x565200256d50 msgr2=0x565200257160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.842+0000 7fdd9418f680 1 --2- 172.21.15.153:0/2946112326 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x565200256d50 0x565200257160 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x56520022ff60 tx=0x7fdd7c012000 comp rx=0 tx=0).stop 2023-10-05T21:15:18.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.842+0000 7fdd9418f680 1 -- 172.21.15.153:0/2946112326 shutdown_connections 2023-10-05T21:15:18.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.843+0000 7fdd9418f680 1 --2- 172.21.15.153:0/2946112326 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x565200256d50 0x565200257160 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.843+0000 7fdd9418f680 1 -- 172.21.15.153:0/2946112326 >> 172.21.15.153:0/2946112326 conn(0x56520027b3b0 msgr2=0x565200279510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.843+0000 7fdd9418f680 1 -- 172.21.15.153:0/2946112326 shutdown_connections 2023-10-05T21:15:18.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.843+0000 7fdd9418f680 1 -- 172.21.15.153:0/2946112326 wait complete. 2023-10-05T21:15:18.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.843+0000 7fdd9418f680 1 Processor -- start 2023-10-05T21:15:18.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.843+0000 7fdd9418f680 1 -- start start 2023-10-05T21:15:18.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.843+0000 7fdd9418f680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x565200256d50 0x565200287ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.843+0000 7fdd9418f680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x565200288430 con 0x565200256d50 2023-10-05T21:15:18.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.843+0000 7fdd86a66700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x565200256d50 0x565200287ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.843+0000 7fdd86a66700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x565200256d50 0x565200287ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38066/0 (socket says 172.21.15.153:38066) 2023-10-05T21:15:18.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.843+0000 7fdd86a66700 1 -- 172.21.15.153:0/92712895 learned_addr learned my addr 172.21.15.153:0/92712895 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:18.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.844+0000 7fdd86a66700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652002370f0 con 0x565200256d50 2023-10-05T21:15:18.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.844+0000 7fdd86a66700 1 --2- 172.21.15.153:0/92712895 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x565200256d50 0x565200287ef0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x56520027a290 tx=0x7fdd7c030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.844+0000 7fdcd1ffb700 1 -- 172.21.15.153:0/92712895 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd7c03f860 con 0x565200256d50 2023-10-05T21:15:18.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.844+0000 7fdcd1ffb700 1 -- 172.21.15.153:0/92712895 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7c03f9c0 con 0x565200256d50 2023-10-05T21:15:18.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.844+0000 7fdd9418f680 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x565200288630 con 0x565200256d50 2023-10-05T21:15:18.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.844+0000 7fdcd1ffb700 1 -- 172.21.15.153:0/92712895 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd7c03fb70 con 0x565200256d50 2023-10-05T21:15:18.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.844+0000 7fdd9418f680 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565200288a20 con 0x565200256d50 2023-10-05T21:15:18.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.845+0000 7fdcd1ffb700 1 -- 172.21.15.153:0/92712895 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fdd7c03fcd0 con 0x565200256d50 2023-10-05T21:15:18.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.845+0000 7fdcd1ffb700 1 --2- 172.21.15.153:0/92712895 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fdcc4034140 0x7fdcc40365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.845+0000 7fdcd1ffb700 1 -- 172.21.15.153:0/92712895 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fdd7c030070 con 0x565200256d50 2023-10-05T21:15:18.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.845+0000 7fdd87a68700 1 --2- 172.21.15.153:0/92712895 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fdcc4034140 0x7fdcc40365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.845+0000 7fdd9418f680 5 note: GC not initialized 2023-10-05T21:15:18.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.845+0000 7fdd87a68700 1 --2- 172.21.15.153:0/92712895 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fdcc4034140 0x7fdcc40365f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x565200271180 tx=0x7fdd8000aea0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.846+0000 7fdccaffd700 20 reqs_thread_entry: start 2023-10-05T21:15:18.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.846+0000 7fdcc8ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:18.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.846+0000 7fdd9418f680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:18.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.846+0000 7fdd9418f680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:18.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.846+0000 7fdcb6ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:49 2023 2023-10-05T21:15:18.883 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:18.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.846+0000 7fdcb67fc700 20 reqs_thread_entry: start 2023-10-05T21:15:18.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.846+0000 7fdd9418f680 1 --2- 172.21.15.153:0/92712895 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x5652002ed8d0 0x5652002efcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.846+0000 7fdd9418f680 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:1 6.0 6:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5652002f01f0 con 0x5652002ed8d0 2023-10-05T21:15:18.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.847+0000 7fdd87267700 1 --2- 172.21.15.153:0/92712895 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x5652002ed8d0 0x5652002efcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.847+0000 7fdd87267700 1 --2- 172.21.15.153:0/92712895 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x5652002ed8d0 0x5652002efcb0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.847+0000 7fdd87267700 1 -- 172.21.15.153:0/92712895 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(1 [pgnls start_epoch 29 out=254b] v29'34 uv18 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7fdd78014070 con 0x5652002ed8d0 2023-10-05T21:15:18.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.847+0000 7fdd87267700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:2 6.10 6:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56520026d5a0 con 0x5652002ed8d0 2023-10-05T21:15:18.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.847+0000 7fdd87267700 1 -- 172.21.15.153:0/92712895 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(2 [pgnls start_epoch 29 out=131b] v29'4 uv4 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7fdd78014070 con 0x5652002ed8d0 2023-10-05T21:15:18.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.847+0000 7fdd87267700 1 --2- 172.21.15.153:0/92712895 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x7fdd7804d040 0x7fdd78055630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.847+0000 7fdd87267700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:3 6.8 6:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56520026d5a0 con 0x7fdd7804d040 2023-10-05T21:15:18.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.848+0000 7fdd86a66700 1 --2- 172.21.15.153:0/92712895 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x7fdd7804d040 0x7fdd78055630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.848+0000 7fdd86a66700 1 --2- 172.21.15.153:0/92712895 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x7fdd7804d040 0x7fdd78055630 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.848+0000 7fdd86a66700 1 -- 172.21.15.153:0/92712895 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(3 [pgnls start_epoch 29 out=295b] v29'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7fdd7c033040 con 0x7fdd7804d040 2023-10-05T21:15:18.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.848+0000 7fdd86a66700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:4 6.18 6:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56520026ebf0 con 0x5652002ed8d0 2023-10-05T21:15:18.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.848+0000 7fdd87267700 1 -- 172.21.15.153:0/92712895 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(4 [pgnls start_epoch 29 out=172b] v29'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7fdd78014070 con 0x5652002ed8d0 2023-10-05T21:15:18.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.848+0000 7fdd87267700 1 --2- 172.21.15.153:0/92712895 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x7fdd780413c0 0x7fdd78047a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.849+0000 7fdd87267700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:5 6.4 6:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x56520026ebf0 con 0x7fdd780413c0 2023-10-05T21:15:18.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.849+0000 7fdd87a68700 1 --2- 172.21.15.153:0/92712895 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x7fdd780413c0 0x7fdd78047a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.849+0000 7fdd87a68700 1 --2- 172.21.15.153:0/92712895 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x7fdd780413c0 0x7fdd78047a90 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.849+0000 7fdd87a68700 1 -- 172.21.15.153:0/92712895 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(5 [pgnls start_epoch 29 out=335b] v29'146 uv23 ondisk = 1) v8 ==== 144+0+335 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd780413c0 2023-10-05T21:15:18.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.849+0000 7fdd87a68700 1 --2- 172.21.15.153:0/92712895 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fdd80050040 0x7fdd80015430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.849+0000 7fdd87a68700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:6 6.14 6:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200269c70 con 0x7fdd80050040 2023-10-05T21:15:18.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.849+0000 7fdd87267700 1 --2- 172.21.15.153:0/92712895 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fdd80050040 0x7fdd80015430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.850+0000 7fdd87267700 1 --2- 172.21.15.153:0/92712895 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fdd80050040 0x7fdd80015430 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.850+0000 7fdd87267700 1 -- 172.21.15.153:0/92712895 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=213b] v29'10 uv10 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7fdd78014070 con 0x7fdd80050040 2023-10-05T21:15:18.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.850+0000 7fdd87267700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:7 6.c 6:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200269c70 con 0x7fdd7804d040 2023-10-05T21:15:18.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.850+0000 7fdd86a66700 1 -- 172.21.15.153:0/92712895 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=254b] v29'10 uv10 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7fdd7c033040 con 0x7fdd7804d040 2023-10-05T21:15:18.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.850+0000 7fdd86a66700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:8 6.1c 6:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200269c70 con 0x7fdd7804d040 2023-10-05T21:15:18.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.850+0000 7fdd86a66700 1 -- 172.21.15.153:0/92712895 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(8 [pgnls start_epoch 29 out=295b] v29'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7fdd7c033040 con 0x7fdd7804d040 2023-10-05T21:15:18.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.850+0000 7fdd86a66700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:9 6.2 6:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200269c70 con 0x7fdd7804d040 2023-10-05T21:15:18.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.851+0000 7fdd86a66700 1 -- 172.21.15.153:0/92712895 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(9 [pgnls start_epoch 29 out=213b] v29'11 uv10 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7fdd7c033040 con 0x7fdd7804d040 2023-10-05T21:15:18.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.851+0000 7fdd86a66700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:10 6.12 6:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200269c70 con 0x7fdd80050040 2023-10-05T21:15:18.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.851+0000 7fdd87267700 1 -- 172.21.15.153:0/92712895 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(10 [pgnls start_epoch 29 out=172b] v29'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7fdd78014070 con 0x7fdd80050040 2023-10-05T21:15:18.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.851+0000 7fdd87267700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:11 6.a 6:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200269c70 con 0x7fdd80050040 2023-10-05T21:15:18.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.851+0000 7fdd87267700 1 -- 172.21.15.153:0/92712895 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=363b] v29'32 uv28 ondisk = 1) v8 ==== 144+0+363 (crc 0 0 0) 0x7fdd78014070 con 0x7fdd80050040 2023-10-05T21:15:18.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.851+0000 7fdd87267700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:12 6.1a 6:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200269c70 con 0x7fdd7804d040 2023-10-05T21:15:18.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.852+0000 7fdd86a66700 1 -- 172.21.15.153:0/92712895 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(12 [pgnls start_epoch 29 out=131b] v29'17 uv9 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7fdd7c033040 con 0x7fdd7804d040 2023-10-05T21:15:18.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.852+0000 7fdd86a66700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:13 6.6 6:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200269c70 con 0x7fdd7804d040 2023-10-05T21:15:18.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.852+0000 7fdd86a66700 1 -- 172.21.15.153:0/92712895 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(13 [pgnls start_epoch 29 out=254b] v29'12 uv12 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7fdd7c033040 con 0x7fdd7804d040 2023-10-05T21:15:18.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.852+0000 7fdd86a66700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 6.16 6:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200269c70 con 0x7fdd7804d040 2023-10-05T21:15:18.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.852+0000 7fdd86a66700 1 -- 172.21.15.153:0/92712895 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(14 [pgnls start_epoch 29 out=90b] v29'17 uv9 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x7fdd7c033040 con 0x7fdd7804d040 2023-10-05T21:15:18.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.852+0000 7fdd86a66700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 6.e 6:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200269c70 con 0x7fdd780413c0 2023-10-05T21:15:18.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.852+0000 7fdd87a68700 1 -- 172.21.15.153:0/92712895 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(15 [pgnls start_epoch 29 out=213b] v29'19 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd780413c0 2023-10-05T21:15:18.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.852+0000 7fdd87a68700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:16 6.1e 6:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200269c70 con 0x7fdd7804d040 2023-10-05T21:15:18.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.853+0000 7fdd86a66700 1 -- 172.21.15.153:0/92712895 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(16 [pgnls start_epoch 29 out=254b] v29'10 uv10 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7fdd7c067040 con 0x7fdd7804d040 2023-10-05T21:15:18.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.853+0000 7fdd86a66700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 6.1 6:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200269c70 con 0x7fdd780413c0 2023-10-05T21:15:18.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.853+0000 7fdd87a68700 1 -- 172.21.15.153:0/92712895 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(17 [pgnls start_epoch 29 out=254b] v29'14 uv14 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd780413c0 2023-10-05T21:15:18.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.853+0000 7fdd87a68700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:18 6.11 6:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200269c70 con 0x7fdd7804d040 2023-10-05T21:15:18.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.853+0000 7fdd86a66700 1 -- 172.21.15.153:0/92712895 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(18 [pgnls start_epoch 29 out=213b] v29'22 uv18 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7fdd7c067040 con 0x7fdd7804d040 2023-10-05T21:15:18.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.853+0000 7fdd86a66700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 6.9 6:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200269c70 con 0x7fdd7804d040 2023-10-05T21:15:18.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.853+0000 7fdd86a66700 1 -- 172.21.15.153:0/92712895 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(19 [pgnls start_epoch 29 out=172b] v29'28 uv12 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7fdd7c067040 con 0x7fdd7804d040 2023-10-05T21:15:18.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.854+0000 7fdd86a66700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:20 6.19 6:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200269c70 con 0x7fdd780413c0 2023-10-05T21:15:18.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.854+0000 7fdd87a68700 1 -- 172.21.15.153:0/92712895 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=295b] v29'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd780413c0 2023-10-05T21:15:18.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.854+0000 7fdd87a68700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:21 6.5 6:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200269c70 con 0x7fdd80050040 2023-10-05T21:15:18.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.854+0000 7fdd87267700 1 -- 172.21.15.153:0/92712895 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=276b] v29'13 uv13 ondisk = 1) v8 ==== 144+0+276 (crc 0 0 0) 0x7fdd78014070 con 0x7fdd80050040 2023-10-05T21:15:18.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.854+0000 7fdd87267700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:22 6.15 6:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200269c70 con 0x7fdd80050040 2023-10-05T21:15:18.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.854+0000 7fdd87267700 1 -- 172.21.15.153:0/92712895 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=172b] v29'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7fdd78014070 con 0x7fdd80050040 2023-10-05T21:15:18.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.854+0000 7fdd87267700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:23 6.d 6:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200269c70 con 0x7fdd780413c0 2023-10-05T21:15:18.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.855+0000 7fdd87a68700 1 -- 172.21.15.153:0/92712895 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(23 [pgnls start_epoch 29 out=371b] v29'27 uv23 ondisk = 1) v8 ==== 144+0+371 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd780413c0 2023-10-05T21:15:18.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.855+0000 7fdd87a68700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:24 6.1d 6:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200269c70 con 0x5652002ed8d0 2023-10-05T21:15:18.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.855+0000 7fdd87267700 1 -- 172.21.15.153:0/92712895 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(24 [pgnls start_epoch 29 out=248b] v29'31 uv23 ondisk = 1) v8 ==== 144+0+248 (crc 0 0 0) 0x7fdd78014070 con 0x5652002ed8d0 2023-10-05T21:15:18.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.855+0000 7fdd87267700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:25 6.3 6:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200269c70 con 0x7fdd80050040 2023-10-05T21:15:18.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.855+0000 7fdd87267700 1 -- 172.21.15.153:0/92712895 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(25 [pgnls start_epoch 29 out=213b] v29'46 uv34 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7fdd78014070 con 0x7fdd80050040 2023-10-05T21:15:18.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.855+0000 7fdd87267700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 6.13 6:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200269c70 con 0x5652002ed8d0 2023-10-05T21:15:18.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.856+0000 7fdd87267700 1 -- 172.21.15.153:0/92712895 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=248b] v29'21 uv17 ondisk = 1) v8 ==== 144+0+248 (crc 0 0 0) 0x7fdd78014070 con 0x5652002ed8d0 2023-10-05T21:15:18.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.856+0000 7fdd87267700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 6.b 6:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200269c70 con 0x7fdd7804d040 2023-10-05T21:15:18.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.856+0000 7fdd86a66700 1 -- 172.21.15.153:0/92712895 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(27 [pgnls start_epoch 29 out=172b] v29'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7fdd7c067040 con 0x7fdd7804d040 2023-10-05T21:15:18.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.856+0000 7fdd86a66700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:28 6.1b 6:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200269c70 con 0x7fdd7804d040 2023-10-05T21:15:18.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.856+0000 7fdd86a66700 1 -- 172.21.15.153:0/92712895 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(28 [pgnls start_epoch 29 out=165b] v29'21 uv20 ondisk = 1) v8 ==== 144+0+165 (crc 0 0 0) 0x7fdd7c067040 con 0x7fdd7804d040 2023-10-05T21:15:18.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.856+0000 7fdd86a66700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:29 6.7 6:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200269c70 con 0x7fdd7804d040 2023-10-05T21:15:18.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.857+0000 7fdd86a66700 1 -- 172.21.15.153:0/92712895 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(29 [pgnls start_epoch 29 out=90b] v29'37 uv13 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x7fdd7c067040 con 0x7fdd7804d040 2023-10-05T21:15:18.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.857+0000 7fdd86a66700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:30 6.17 6:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200269c70 con 0x7fdd780413c0 2023-10-05T21:15:18.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.857+0000 7fdd87a68700 1 -- 172.21.15.153:0/92712895 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=131b] v29'6 uv6 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd780413c0 2023-10-05T21:15:18.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.857+0000 7fdd87a68700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:31 6.f 6:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200269c70 con 0x7fdd80050040 2023-10-05T21:15:18.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.857+0000 7fdd87267700 1 -- 172.21.15.153:0/92712895 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(31 [pgnls start_epoch 29 out=295b] v29'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7fdd78014070 con 0x7fdd80050040 2023-10-05T21:15:18.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.857+0000 7fdd87267700 1 -- 172.21.15.153:0/92712895 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 6.1f 6:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x565200269c70 con 0x5652002ed8d0 2023-10-05T21:15:18.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.858+0000 7fdd87267700 1 -- 172.21.15.153:0/92712895 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(32 [pgnls start_epoch 29 out=213b] v29'20 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7fdd78014070 con 0x5652002ed8d0 2023-10-05T21:15:18.892 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2023-10-05T21:15:18.892 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000078", 2023-10-05T21:15:18.892 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000070", 2023-10-05T21:15:18.892 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000104", 2023-10-05T21:15:18.892 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000026", 2023-10-05T21:15:18.893 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000028", 2023-10-05T21:15:18.893 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000040", 2023-10-05T21:15:18.893 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000015", 2023-10-05T21:15:18.893 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000069", 2023-10-05T21:15:18.893 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000095", 2023-10-05T21:15:18.893 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000003", 2023-10-05T21:15:18.893 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000047", 2023-10-05T21:15:18.893 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000035", 2023-10-05T21:15:18.893 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000037", 2023-10-05T21:15:18.893 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000024", 2023-10-05T21:15:18.893 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000000", 2023-10-05T21:15:18.893 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000031", 2023-10-05T21:15:18.894 INFO:teuthology.orchestra.run.smithi153.stdout: "data_loggenerations_metadata", 2023-10-05T21:15:18.894 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000076", 2023-10-05T21:15:18.894 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000113", 2023-10-05T21:15:18.894 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000005", 2023-10-05T21:15:18.894 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000011", 2023-10-05T21:15:18.894 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000058", 2023-10-05T21:15:18.894 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000052", 2023-10-05T21:15:18.894 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000088", 2023-10-05T21:15:18.894 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000080", 2023-10-05T21:15:18.894 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000090", 2023-10-05T21:15:18.894 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000110", 2023-10-05T21:15:18.894 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000096", 2023-10-05T21:15:18.895 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000087", 2023-10-05T21:15:18.895 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000008", 2023-10-05T21:15:18.895 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000006", 2023-10-05T21:15:18.895 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000029", 2023-10-05T21:15:18.895 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000089", 2023-10-05T21:15:18.895 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000022", 2023-10-05T21:15:18.895 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000016", 2023-10-05T21:15:18.895 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000041", 2023-10-05T21:15:18.895 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000018", 2023-10-05T21:15:18.895 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000092", 2023-10-05T21:15:18.895 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000014", 2023-10-05T21:15:18.895 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000112", 2023-10-05T21:15:18.896 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000007", 2023-10-05T21:15:18.896 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000021", 2023-10-05T21:15:18.896 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000064", 2023-10-05T21:15:18.896 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000071", 2023-10-05T21:15:18.896 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000074", 2023-10-05T21:15:18.896 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000081", 2023-10-05T21:15:18.896 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000009", 2023-10-05T21:15:18.896 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000121", 2023-10-05T21:15:18.896 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000125", 2023-10-05T21:15:18.896 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000082", 2023-10-05T21:15:18.896 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000105", 2023-10-05T21:15:18.896 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000059", 2023-10-05T21:15:18.897 INFO:teuthology.orchestra.run.smithi153.stdout: "2023-10-05-21--", 2023-10-05T21:15:18.897 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000077", 2023-10-05T21:15:18.897 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000032", 2023-10-05T21:15:18.897 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000053", 2023-10-05T21:15:18.897 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000091", 2023-10-05T21:15:18.897 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000065", 2023-10-05T21:15:18.897 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000083", 2023-10-05T21:15:18.897 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000010", 2023-10-05T21:15:18.897 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000045", 2023-10-05T21:15:18.897 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000002", 2023-10-05T21:15:18.897 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000116", 2023-10-05T21:15:18.897 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000034", 2023-10-05T21:15:18.897 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000101", 2023-10-05T21:15:18.898 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000079", 2023-10-05T21:15:18.898 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000049", 2023-10-05T21:15:18.898 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000117", 2023-10-05T21:15:18.898 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000044", 2023-10-05T21:15:18.898 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000066", 2023-10-05T21:15:18.898 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000068", 2023-10-05T21:15:18.898 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000085", 2023-10-05T21:15:18.898 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000073", 2023-10-05T21:15:18.898 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000038", 2023-10-05T21:15:18.898 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000118", 2023-10-05T21:15:18.898 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000036", 2023-10-05T21:15:18.899 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000103", 2023-10-05T21:15:18.899 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000119", 2023-10-05T21:15:18.899 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000098", 2023-10-05T21:15:18.899 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000027", 2023-10-05T21:15:18.899 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000019", 2023-10-05T21:15:18.899 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000039", 2023-10-05T21:15:18.899 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000100", 2023-10-05T21:15:18.899 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000093", 2023-10-05T21:15:18.899 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000004", 2023-10-05T21:15:18.899 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000063", 2023-10-05T21:15:18.899 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000122", 2023-10-05T21:15:18.899 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000057", 2023-10-05T21:15:18.900 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000054", 2023-10-05T21:15:18.900 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000114", 2023-10-05T21:15:18.900 INFO:teuthology.orchestra.run.smithi153.stdout: "data_log.0", 2023-10-05T21:15:18.900 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000012", 2023-10-05T21:15:18.900 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000084", 2023-10-05T21:15:18.900 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000043", 2023-10-05T21:15:18.900 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000111", 2023-10-05T21:15:18.900 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000048", 2023-10-05T21:15:18.900 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000020", 2023-10-05T21:15:18.900 INFO:teuthology.orchestra.run.smithi153.stdout: "2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.4-myfoo4", 2023-10-05T21:15:18.900 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000099", 2023-10-05T21:15:18.900 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000056", 2023-10-05T21:15:18.900 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000072", 2023-10-05T21:15:18.901 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000062", 2023-10-05T21:15:18.901 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000115", 2023-10-05T21:15:18.901 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000033", 2023-10-05T21:15:18.901 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000025", 2023-10-05T21:15:18.901 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000123", 2023-10-05T21:15:18.901 INFO:teuthology.orchestra.run.smithi153.stdout: "2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.3-myfoo3", 2023-10-05T21:15:18.901 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000108", 2023-10-05T21:15:18.901 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000094", 2023-10-05T21:15:18.901 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000060", 2023-10-05T21:15:18.901 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000109", 2023-10-05T21:15:18.901 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000013", 2023-10-05T21:15:18.901 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000051", 2023-10-05T21:15:18.902 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000106", 2023-10-05T21:15:18.902 INFO:teuthology.orchestra.run.smithi153.stdout: "2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.2-myfoo2", 2023-10-05T21:15:18.902 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000017", 2023-10-05T21:15:18.902 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000023", 2023-10-05T21:15:18.902 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000107", 2023-10-05T21:15:18.902 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000046", 2023-10-05T21:15:18.902 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000067", 2023-10-05T21:15:18.902 INFO:teuthology.orchestra.run.smithi153.stdout: "2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1-myfoo", 2023-10-05T21:15:18.902 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000086", 2023-10-05T21:15:18.902 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000050", 2023-10-05T21:15:18.902 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000102", 2023-10-05T21:15:18.903 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000124", 2023-10-05T21:15:18.903 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000001", 2023-10-05T21:15:18.903 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000126", 2023-10-05T21:15:18.903 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000055", 2023-10-05T21:15:18.903 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000061", 2023-10-05T21:15:18.903 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000097", 2023-10-05T21:15:18.903 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000042", 2023-10-05T21:15:18.903 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000075", 2023-10-05T21:15:18.903 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000120", 2023-10-05T21:15:18.903 INFO:teuthology.orchestra.run.smithi153.stdout: "obj_delete_at_hint.0000000030" 2023-10-05T21:15:18.904 INFO:teuthology.orchestra.run.smithi153.stdout:] 2023-10-05T21:15:18.904 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:15:18.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.859+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94910189845520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56520026ebf0 con 0x7fdd7802d020 2023-10-05T21:15:18.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.859+0000 7fdd86a66700 1 -- 172.21.15.153:0/2561313195 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(102 notify.0 [watch unwatch cookie 94910189845520] v29'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd7c067040 con 0x7fdd7802d020 2023-10-05T21:15:18.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.859+0000 7fdd9418f680 20 remove_watcher() i=0 2023-10-05T21:15:18.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.859+0000 7fdd9418f680 2 removed watcher, disabling cache 2023-10-05T21:15:18.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.859+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94910189848752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56520026d5a0 con 0x5652002337c0 2023-10-05T21:15:18.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.860+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(103 notify.1 [watch unwatch cookie 94910189848752] v29'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.860+0000 7fdd9418f680 20 remove_watcher() i=1 2023-10-05T21:15:18.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.860+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:104 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94910189850960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5652002f2a80 con 0x565200264d00 2023-10-05T21:15:18.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.861+0000 7fdd87267700 1 -- 172.21.15.153:0/2561313195 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(104 notify.2 [watch unwatch cookie 94910189850960] v29'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd78014070 con 0x565200264d00 2023-10-05T21:15:18.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.861+0000 7fdd9418f680 20 remove_watcher() i=2 2023-10-05T21:15:18.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.861+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94910189856544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5652002f2a80 con 0x7fdd7802d020 2023-10-05T21:15:18.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.862+0000 7fdd86a66700 1 -- 172.21.15.153:0/2561313195 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(105 notify.3 [watch unwatch cookie 94910189856544] v29'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd7c067040 con 0x7fdd7802d020 2023-10-05T21:15:18.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.862+0000 7fdd9418f680 20 remove_watcher() i=3 2023-10-05T21:15:18.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.862+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94910189861728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5652002f2a80 con 0x5652002337c0 2023-10-05T21:15:18.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.863+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(106 notify.4 [watch unwatch cookie 94910189861728] v29'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.863+0000 7fdd9418f680 20 remove_watcher() i=4 2023-10-05T21:15:18.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.863+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:107 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94910189863904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5652002f2a80 con 0x7fdd7c007030 2023-10-05T21:15:18.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.863+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(107 notify.5 [watch unwatch cookie 94910189863904] v29'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd7c007030 2023-10-05T21:15:18.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.863+0000 7fdd9418f680 20 remove_watcher() i=5 2023-10-05T21:15:18.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.863+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94910189865008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5652002f2a80 con 0x7fdd7c007030 2023-10-05T21:15:18.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.864+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(108 notify.6 [watch unwatch cookie 94910189865008] v29'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd7c007030 2023-10-05T21:15:18.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.864+0000 7fdd9418f680 20 remove_watcher() i=6 2023-10-05T21:15:18.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.864+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94910189870736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5652002f2a80 con 0x7fdd7c007030 2023-10-05T21:15:18.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.865+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(109 notify.7 [watch unwatch cookie 94910189870736] v29'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdd8000a570 con 0x7fdd7c007030 2023-10-05T21:15:18.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.865+0000 7fdd9418f680 20 remove_watcher() i=7 2023-10-05T21:15:18.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.865+0000 7fdcd3fff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:18.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.865+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:110 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94910189872096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5652002f2a80 con 0x5652002337c0 2023-10-05T21:15:18.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.866+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(110 data_loggenerations_metadata [watch unwatch cookie 94910189872096] v29'147 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fdd8000a570 con 0x5652002337c0 2023-10-05T21:15:18.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.866+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fdd7c007030 msgr2=0x7fdd7c01d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.866+0000 7fdd9418f680 1 --2- 172.21.15.153:0/2561313195 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fdd7c007030 0x7fdd7c01d420 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.866+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5652002337c0 msgr2=0x565200262890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.866+0000 7fdd9418f680 1 --2- 172.21.15.153:0/2561313195 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5652002337c0 0x565200262890 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.866+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fdd7802d020 msgr2=0x7fdd7802c5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.866+0000 7fdd9418f680 1 --2- 172.21.15.153:0/2561313195 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fdd7802d020 0x7fdd7802c5d0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.866+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x565200264d00 msgr2=0x5652002670e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.866+0000 7fdd9418f680 1 --2- 172.21.15.153:0/2561313195 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x565200264d00 0x5652002670e0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.866+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fdd6c034140 msgr2=0x7fdd6c0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.866+0000 7fdd9418f680 1 --2- 172.21.15.153:0/2561313195 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fdd6c034140 0x7fdd6c0365f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c003080 tx=0x7fdd7c015000 comp rx=0 tx=0).stop 2023-10-05T21:15:18.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.866+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56520022f290 msgr2=0x5652002597f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.866+0000 7fdd87a68700 1 -- 172.21.15.153:0/2561313195 reap_dead start 2023-10-05T21:15:18.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.866+0000 7fdd9418f680 1 --2- 172.21.15.153:0/2561313195 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56520022f290 0x5652002597f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fdd780017d0 tx=0x7fdd78016000 comp rx=0 tx=0).stop 2023-10-05T21:15:18.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.866+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 shutdown_connections 2023-10-05T21:15:18.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.866+0000 7fdd9418f680 1 --2- 172.21.15.153:0/2561313195 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56520022f290 0x5652002597f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.866+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 >> 172.21.15.153:0/2561313195 conn(0x56520022ab60 msgr2=0x565200248960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.866+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 shutdown_connections 2023-10-05T21:15:18.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.866+0000 7fdd9418f680 1 -- 172.21.15.153:0/2561313195 wait complete. 2023-10-05T21:15:18.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.867+0000 7fdd9418f680 1 -- 172.21.15.153:0/92712895 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x5652002ed8d0 msgr2=0x5652002efcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.867+0000 7fdd9418f680 1 --2- 172.21.15.153:0/92712895 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x5652002ed8d0 0x5652002efcb0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.867+0000 7fdd9418f680 1 -- 172.21.15.153:0/92712895 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x7fdd780413c0 msgr2=0x7fdd78047a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.867+0000 7fdd9418f680 1 --2- 172.21.15.153:0/92712895 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x7fdd780413c0 0x7fdd78047a90 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.867+0000 7fdd9418f680 1 -- 172.21.15.153:0/92712895 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fdd80050040 msgr2=0x7fdd80015430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.867+0000 7fdd9418f680 1 --2- 172.21.15.153:0/92712895 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fdd80050040 0x7fdd80015430 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.867+0000 7fdd9418f680 1 -- 172.21.15.153:0/92712895 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x7fdd7804d040 msgr2=0x7fdd78055630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.867+0000 7fdd9418f680 1 --2- 172.21.15.153:0/92712895 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x7fdd7804d040 0x7fdd78055630 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.867+0000 7fdd9418f680 1 -- 172.21.15.153:0/92712895 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fdcc4034140 msgr2=0x7fdcc40365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.867+0000 7fdd9418f680 1 --2- 172.21.15.153:0/92712895 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fdcc4034140 0x7fdcc40365f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x565200271180 tx=0x7fdd8000aea0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.867+0000 7fdd9418f680 1 -- 172.21.15.153:0/92712895 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x565200256d50 msgr2=0x565200287ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.867+0000 7fdd87267700 1 -- 172.21.15.153:0/92712895 reap_dead start 2023-10-05T21:15:18.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.867+0000 7fdd9418f680 1 --2- 172.21.15.153:0/92712895 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x565200256d50 0x565200287ef0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x56520027a290 tx=0x7fdd7c030000 comp rx=0 tx=0).stop 2023-10-05T21:15:18.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.867+0000 7fdd9418f680 1 -- 172.21.15.153:0/92712895 shutdown_connections 2023-10-05T21:15:18.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.867+0000 7fdd9418f680 1 --2- 172.21.15.153:0/92712895 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x565200256d50 0x565200287ef0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.867+0000 7fdd9418f680 1 -- 172.21.15.153:0/92712895 >> 172.21.15.153:0/92712895 conn(0x56520027b3b0 msgr2=0x5652002794e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.867+0000 7fdd9418f680 1 -- 172.21.15.153:0/92712895 shutdown_connections 2023-10-05T21:15:18.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.867+0000 7fdd9418f680 1 -- 172.21.15.153:0/92712895 wait complete. 2023-10-05T21:15:18.915 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', '2023-10-05-21--', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', '2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.4-myfoo4', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', '2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.3-myfoo3', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', '2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.2-myfoo2', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', '2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1-myfoo', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2023-10-05T21:15:18.915 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'show', '--object', '2023-10-05-21--'] 2023-10-05T21:15:18.915 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'show', '--object', '2023-10-05-21--'] 2023-10-05T21:15:18.915 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log show --object 2023-10-05-21-- 2023-10-05T21:15:18.993 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:18.993 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:18.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.991+0000 7f183f3ba680 1 Processor -- start 2023-10-05T21:15:18.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.991+0000 7f183f3ba680 1 -- start start 2023-10-05T21:15:18.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.991+0000 7f183f3ba680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55cd95f350a0 0x55cd95fc6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:18.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.991+0000 7f183f3ba680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55cd95f0e990 con 0x55cd95fc69d0 2023-10-05T21:15:18.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.991+0000 7f183f3ba680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55cd95ecedb0 con 0x55cd95f350a0 2023-10-05T21:15:18.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.992+0000 7f1832492700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55cd95f350a0 0x55cd95fc6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:18.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.992+0000 7f1832492700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55cd95f350a0 0x55cd95fc6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38070/0 (socket says 172.21.15.153:38070) 2023-10-05T21:15:18.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.992+0000 7f1831c91700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55cd95fc69d0 0x55cd95fc8db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:55260/0 (socket says 172.21.15.153:55260) 2023-10-05T21:15:18.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.992+0000 7f1832492700 1 -- 172.21.15.153:0/212702737 learned_addr learned my addr 172.21.15.153:0/212702737 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:18.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.992+0000 7f1832492700 1 -- 172.21.15.153:0/212702737 >> v1:172.21.15.111:6789/0 conn(0x55cd95fc69d0 legacy=0x55cd95fc8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.992+0000 7f1831490700 1 -- 172.21.15.153:0/212702737 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2872847285 0 0) 0x55cd95f0e990 con 0x55cd95fc69d0 2023-10-05T21:15:18.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.992+0000 7f1832492700 1 -- 172.21.15.153:0/212702737 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd95fcb4e0 con 0x55cd95f350a0 2023-10-05T21:15:18.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.992+0000 7f1832492700 1 --2- 172.21.15.153:0/212702737 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd95f350a0 0x55cd95fc6490 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f182800a650 tx=0x7f1828005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc28e5055121bf6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:18.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.992+0000 7f1831490700 1 -- 172.21.15.153:0/212702737 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1828008760 con 0x55cd95f350a0 2023-10-05T21:15:18.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.992+0000 7f1831490700 1 -- 172.21.15.153:0/212702737 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18280088c0 con 0x55cd95f350a0 2023-10-05T21:15:18.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.992+0000 7f1831490700 1 -- 172.21.15.153:0/212702737 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1828008bb0 con 0x55cd95f350a0 2023-10-05T21:15:18.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.993+0000 7f183f3ba680 1 -- 172.21.15.153:0/212702737 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd95f350a0 msgr2=0x55cd95fc6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:18.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.993+0000 7f183f3ba680 1 --2- 172.21.15.153:0/212702737 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd95f350a0 0x55cd95fc6490 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f182800a650 tx=0x7f1828005b10 comp rx=0 tx=0).stop 2023-10-05T21:15:18.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.993+0000 7f183f3ba680 1 -- 172.21.15.153:0/212702737 shutdown_connections 2023-10-05T21:15:18.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.993+0000 7f183f3ba680 1 --2- 172.21.15.153:0/212702737 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd95f350a0 0x55cd95fc6490 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:18.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.993+0000 7f183f3ba680 1 -- 172.21.15.153:0/212702737 >> 172.21.15.153:0/212702737 conn(0x55cd95fbbb80 msgr2=0x55cd95fbdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:18.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.993+0000 7f183f3ba680 1 -- 172.21.15.153:0/212702737 shutdown_connections 2023-10-05T21:15:18.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.993+0000 7f183f3ba680 1 -- 172.21.15.153:0/212702737 wait complete. 2023-10-05T21:15:19.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.994+0000 7f183f3ba680 1 Processor -- start 2023-10-05T21:15:19.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.994+0000 7f183f3ba680 1 -- start start 2023-10-05T21:15:19.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.994+0000 7f183f3ba680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd95f350a0 0x55cd95fe2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.994+0000 7f183f3ba680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd95e6eea0 con 0x55cd95f350a0 2023-10-05T21:15:19.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.994+0000 7f1832492700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd95f350a0 0x55cd95fe2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.994+0000 7f1832492700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd95f350a0 0x55cd95fe2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38072/0 (socket says 172.21.15.153:38072) 2023-10-05T21:15:19.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.994+0000 7f1832492700 1 -- 172.21.15.153:0/2887557638 learned_addr learned my addr 172.21.15.153:0/2887557638 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.995+0000 7f1832492700 1 -- 172.21.15.153:0/2887557638 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1828005db0 con 0x55cd95f350a0 2023-10-05T21:15:19.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.995+0000 7f1832492700 1 --2- 172.21.15.153:0/2887557638 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd95f350a0 0x55cd95fe2920 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f182800a5a0 tx=0x7f1828015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684d4cb3349977f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.995+0000 7f1823fff700 1 -- 172.21.15.153:0/2887557638 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18280055f0 con 0x55cd95f350a0 2023-10-05T21:15:19.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.995+0000 7f1823fff700 1 -- 172.21.15.153:0/2887557638 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1828008a30 con 0x55cd95f350a0 2023-10-05T21:15:19.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.995+0000 7f1823fff700 1 -- 172.21.15.153:0/2887557638 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1828008d00 con 0x55cd95f350a0 2023-10-05T21:15:19.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.995+0000 7f183f3ba680 1 -- 172.21.15.153:0/2887557638 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd95f350a0 msgr2=0x55cd95fe2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.995+0000 7f183f3ba680 1 --2- 172.21.15.153:0/2887557638 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd95f350a0 0x55cd95fe2920 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f182800a5a0 tx=0x7f1828015000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.995+0000 7f183f3ba680 1 -- 172.21.15.153:0/2887557638 shutdown_connections 2023-10-05T21:15:19.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.995+0000 7f183f3ba680 1 --2- 172.21.15.153:0/2887557638 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd95f350a0 0x55cd95fe2920 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.995+0000 7f183f3ba680 1 -- 172.21.15.153:0/2887557638 >> 172.21.15.153:0/2887557638 conn(0x55cd95fbbb80 msgr2=0x55cd95fde3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.995+0000 7f183f3ba680 1 -- 172.21.15.153:0/2887557638 shutdown_connections 2023-10-05T21:15:19.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.995+0000 7f183f3ba680 1 -- 172.21.15.153:0/2887557638 wait complete. 2023-10-05T21:15:19.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.996+0000 7f183f3ba680 1 Processor -- start 2023-10-05T21:15:19.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.996+0000 7f183f3ba680 1 -- start start 2023-10-05T21:15:19.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.996+0000 7f183f3ba680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd95f350a0 0x55cd95fe9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.996+0000 7f183f3ba680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd95e65c80 con 0x55cd95f350a0 2023-10-05T21:15:19.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.996+0000 7f1832492700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd95f350a0 0x55cd95fe9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.996+0000 7f1832492700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd95f350a0 0x55cd95fe9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38074/0 (socket says 172.21.15.153:38074) 2023-10-05T21:15:19.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.996+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 learned_addr learned my addr 172.21.15.153:0/2423396366 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.996+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd95fcb4e0 con 0x55cd95f350a0 2023-10-05T21:15:19.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.996+0000 7f1832492700 1 --2- 172.21.15.153:0/2423396366 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd95f350a0 0x55cd95fe9c80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1828020040 tx=0x7f182801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.997+0000 7f18227fc700 1 -- 172.21.15.153:0/2423396366 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1828027850 con 0x55cd95f350a0 2023-10-05T21:15:19.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.997+0000 7f18227fc700 1 -- 172.21.15.153:0/2423396366 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18280279d0 con 0x55cd95f350a0 2023-10-05T21:15:19.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.997+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cd95fea1c0 con 0x55cd95f350a0 2023-10-05T21:15:19.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.997+0000 7f18227fc700 1 -- 172.21.15.153:0/2423396366 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1828027cc0 con 0x55cd95f350a0 2023-10-05T21:15:19.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.997+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cd95fea610 con 0x55cd95f350a0 2023-10-05T21:15:19.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.997+0000 7f18227fc700 1 -- 172.21.15.153:0/2423396366 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f182802f070 con 0x55cd95f350a0 2023-10-05T21:15:19.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.997+0000 7f183f3ba680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.998+0000 7f18227fc700 1 --2- 172.21.15.153:0/2423396366 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1814034140 0x7f18140365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.998+0000 7f18227fc700 1 -- 172.21.15.153:0/2423396366 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f182804a180 con 0x55cd95f350a0 2023-10-05T21:15:19.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.998+0000 7f1831c91700 1 --2- 172.21.15.153:0/2423396366 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1814034140 0x7f18140365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.998+0000 7f183f3ba680 1 --2- 172.21.15.153:0/2423396366 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55cd95fc69d0 0x55cd95ff59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.998+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ff6140 con 0x55cd95fc69d0 2023-10-05T21:15:19.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.998+0000 7f1832c93700 1 --2- 172.21.15.153:0/2423396366 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55cd95fc69d0 0x55cd95ff59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.998+0000 7f1831c91700 1 --2- 172.21.15.153:0/2423396366 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1814034140 0x7f18140365f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f18240011e0 tx=0x7f1824001460 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.998+0000 7f1832c93700 1 --2- 172.21.15.153:0/2423396366 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55cd95fc69d0 0x55cd95ff59b0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.998+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f182c00a570 con 0x55cd95fc69d0 2023-10-05T21:15:19.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.999+0000 7f183f3ba680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.999+0000 7f183f3ba680 20 realm 2023-10-05T21:15:19.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.999+0000 7f183f3ba680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.999+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ff2f90 con 0x55cd95fc69d0 2023-10-05T21:15:19.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.999+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f182c00a570 con 0x55cd95fc69d0 2023-10-05T21:15:19.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.999+0000 7f183f3ba680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.999+0000 7f183f3ba680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:19.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.999+0000 7f183f3ba680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.999+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ff6c40 con 0x55cd95fc69d0 2023-10-05T21:15:19.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.999+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f182c00a570 con 0x55cd95fc69d0 2023-10-05T21:15:19.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.999+0000 7f183f3ba680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.999+0000 7f183f3ba680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.999+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ff6860 con 0x55cd95fc69d0 2023-10-05T21:15:19.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.999+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f182c00a570 con 0x55cd95fc69d0 2023-10-05T21:15:19.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.999+0000 7f183f3ba680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.999+0000 7f183f3ba680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.999+0000 7f183f3ba680 1 --2- 172.21.15.153:0/2423396366 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55cd95ff7fe0 0x55cd95ffa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.999+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffa900 con 0x55cd95ff7fe0 2023-10-05T21:15:19.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:18.999+0000 7f1832492700 1 --2- 172.21.15.153:0/2423396366 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55cd95ff7fe0 0x55cd95ffa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.000+0000 7f1832492700 1 --2- 172.21.15.153:0/2423396366 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55cd95ff7fe0 0x55cd95ffa3c0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.000+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f1828037070 con 0x55cd95ff7fe0 2023-10-05T21:15:19.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.000+0000 7f183f3ba680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:19.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.000+0000 7f183f3ba680 20 searching for the correct realm 2023-10-05T21:15:19.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.000+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffc1b0 con 0x55cd95ff7fe0 2023-10-05T21:15:19.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.000+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1828037070 con 0x55cd95ff7fe0 2023-10-05T21:15:19.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.000+0000 7f1832492700 1 --2- 172.21.15.153:0/2423396366 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f182803a030 0x7f18280395d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.000+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffc1b0 con 0x7f182803a030 2023-10-05T21:15:19.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.000+0000 7f1831c91700 1 --2- 172.21.15.153:0/2423396366 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f182803a030 0x7f18280395d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.001+0000 7f1831c91700 1 --2- 172.21.15.153:0/2423396366 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f182803a030 0x7f18280395d0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.001+0000 7f1831c91700 1 -- 172.21.15.153:0/2423396366 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182400f600 con 0x7f182803a030 2023-10-05T21:15:19.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.001+0000 7f1831c91700 1 --2- 172.21.15.153:0/2423396366 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f182400e8c0 0x7f182400d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.001+0000 7f1831c91700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffc1b0 con 0x7f182400e8c0 2023-10-05T21:15:19.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.001+0000 7f1832c93700 1 --2- 172.21.15.153:0/2423396366 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f182400e8c0 0x7f182400d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.001+0000 7f1832c93700 1 --2- 172.21.15.153:0/2423396366 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f182400e8c0 0x7f182400d310 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.002+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182c00a570 con 0x7f182400e8c0 2023-10-05T21:15:19.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.002+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffc1b0 con 0x55cd95fc69d0 2023-10-05T21:15:19.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.002+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182c00a570 con 0x55cd95fc69d0 2023-10-05T21:15:19.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.002+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffc1b0 con 0x55cd95fc69d0 2023-10-05T21:15:19.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.002+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182c00a570 con 0x55cd95fc69d0 2023-10-05T21:15:19.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.002+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffc1b0 con 0x7f182400e8c0 2023-10-05T21:15:19.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.002+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182c00a570 con 0x7f182400e8c0 2023-10-05T21:15:19.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.002+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffc1b0 con 0x7f182400e8c0 2023-10-05T21:15:19.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.003+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182c00a570 con 0x7f182400e8c0 2023-10-05T21:15:19.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.003+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffc1b0 con 0x7f182803a030 2023-10-05T21:15:19.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.003+0000 7f1831c91700 1 -- 172.21.15.153:0/2423396366 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182400f600 con 0x7f182803a030 2023-10-05T21:15:19.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.003+0000 7f1831c91700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffc1b0 con 0x55cd95ff7fe0 2023-10-05T21:15:19.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.003+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1828037070 con 0x55cd95ff7fe0 2023-10-05T21:15:19.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.003+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffc1b0 con 0x55cd95fc69d0 2023-10-05T21:15:19.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.003+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182c00a570 con 0x55cd95fc69d0 2023-10-05T21:15:19.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.003+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffc1b0 con 0x7f182400e8c0 2023-10-05T21:15:19.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.003+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182c00a570 con 0x7f182400e8c0 2023-10-05T21:15:19.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.003+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffc1b0 con 0x55cd95fc69d0 2023-10-05T21:15:19.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.004+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182c00a570 con 0x55cd95fc69d0 2023-10-05T21:15:19.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.004+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffc1b0 con 0x7f182803a030 2023-10-05T21:15:19.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.004+0000 7f1831c91700 1 -- 172.21.15.153:0/2423396366 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182400f600 con 0x7f182803a030 2023-10-05T21:15:19.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.004+0000 7f1831c91700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f182401f040 con 0x55cd95ff7fe0 2023-10-05T21:15:19.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.004+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1828037070 con 0x55cd95ff7fe0 2023-10-05T21:15:19.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.004+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f182401f040 con 0x55cd95ff7fe0 2023-10-05T21:15:19.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.004+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1828037070 con 0x55cd95ff7fe0 2023-10-05T21:15:19.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.004+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f182401f040 con 0x7f182400e8c0 2023-10-05T21:15:19.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.005+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182c00a570 con 0x7f182400e8c0 2023-10-05T21:15:19.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.005+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f182401f040 con 0x55cd95ff7fe0 2023-10-05T21:15:19.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.005+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1828037070 con 0x55cd95ff7fe0 2023-10-05T21:15:19.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.005+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f182401f040 con 0x55cd95ff7fe0 2023-10-05T21:15:19.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.005+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1828037070 con 0x55cd95ff7fe0 2023-10-05T21:15:19.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.005+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f182401f040 con 0x55cd95fc69d0 2023-10-05T21:15:19.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.005+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182c00a570 con 0x55cd95fc69d0 2023-10-05T21:15:19.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.005+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f182401f040 con 0x55cd95fc69d0 2023-10-05T21:15:19.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.006+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f182c00a570 con 0x55cd95fc69d0 2023-10-05T21:15:19.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.006+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f182401f040 con 0x7f182400e8c0 2023-10-05T21:15:19.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.006+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182c00a570 con 0x7f182400e8c0 2023-10-05T21:15:19.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.006+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f182401f040 con 0x55cd95ff7fe0 2023-10-05T21:15:19.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.006+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1828037070 con 0x55cd95ff7fe0 2023-10-05T21:15:19.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.006+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f182401f040 con 0x7f182803a030 2023-10-05T21:15:19.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.006+0000 7f1831c91700 1 -- 172.21.15.153:0/2423396366 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182400f600 con 0x7f182803a030 2023-10-05T21:15:19.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.006+0000 7f1831c91700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f182401f040 con 0x55cd95fc69d0 2023-10-05T21:15:19.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.007+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182c00a570 con 0x55cd95fc69d0 2023-10-05T21:15:19.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.007+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f182401f040 con 0x7f182400e8c0 2023-10-05T21:15:19.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.007+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182c00a570 con 0x7f182400e8c0 2023-10-05T21:15:19.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.007+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f182401f040 con 0x55cd95ff7fe0 2023-10-05T21:15:19.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.007+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1828037070 con 0x55cd95ff7fe0 2023-10-05T21:15:19.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.007+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f182401f040 con 0x7f182400e8c0 2023-10-05T21:15:19.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.007+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182c00a570 con 0x7f182400e8c0 2023-10-05T21:15:19.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.007+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f182401f040 con 0x7f182803a030 2023-10-05T21:15:19.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.008+0000 7f1831c91700 1 -- 172.21.15.153:0/2423396366 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182400f600 con 0x7f182803a030 2023-10-05T21:15:19.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.008+0000 7f1831c91700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f182401f040 con 0x55cd95ff7fe0 2023-10-05T21:15:19.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.008+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1828037070 con 0x55cd95ff7fe0 2023-10-05T21:15:19.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.008+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f182401f040 con 0x7f182400e8c0 2023-10-05T21:15:19.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.008+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182c00a570 con 0x7f182400e8c0 2023-10-05T21:15:19.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.008+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f182401f040 con 0x55cd95fc69d0 2023-10-05T21:15:19.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.008+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f182c00a570 con 0x55cd95fc69d0 2023-10-05T21:15:19.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.008+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f182401f040 con 0x7f182803a030 2023-10-05T21:15:19.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.008+0000 7f1831c91700 1 -- 172.21.15.153:0/2423396366 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182400f600 con 0x7f182803a030 2023-10-05T21:15:19.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.009+0000 7f183f3ba680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:19.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.009+0000 7f183f3ba680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:19.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.009+0000 7f183f3ba680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:19.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.009+0000 7f183f3ba680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:19.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.009+0000 7f183f3ba680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.009+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffb2d0 con 0x55cd95fc69d0 2023-10-05T21:15:19.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.009+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f182c00a570 con 0x55cd95fc69d0 2023-10-05T21:15:19.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.009+0000 7f183f3ba680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.009+0000 7f183f3ba680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.009+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffb760 con 0x55cd95fc69d0 2023-10-05T21:15:19.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.009+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f182c00a570 con 0x55cd95fc69d0 2023-10-05T21:15:19.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.009+0000 7f183f3ba680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.009+0000 7f183f3ba680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.009+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffbb90 con 0x55cd95fc69d0 2023-10-05T21:15:19.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.009+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f182c02e180 con 0x55cd95fc69d0 2023-10-05T21:15:19.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.009+0000 7f183f3ba680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:19.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.009+0000 7f183f3ba680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.009+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffc560 con 0x55cd95ff7fe0 2023-10-05T21:15:19.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.009+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f1828037070 con 0x55cd95ff7fe0 2023-10-05T21:15:19.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.009+0000 7f183f3ba680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.009+0000 7f183f3ba680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.009+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffc910 con 0x55cd95fc69d0 2023-10-05T21:15:19.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.010+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f182c02e180 con 0x55cd95fc69d0 2023-10-05T21:15:19.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.010+0000 7f183f3ba680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.010+0000 7f183f3ba680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.010+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffcd10 con 0x55cd95fc69d0 2023-10-05T21:15:19.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.010+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f182c02e180 con 0x55cd95fc69d0 2023-10-05T21:15:19.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.010+0000 7f183f3ba680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.010+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffdd20 con 0x55cd95ff7fe0 2023-10-05T21:15:19.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.010+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1828037070 con 0x55cd95ff7fe0 2023-10-05T21:15:19.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.010+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffdd20 con 0x7f182803a030 2023-10-05T21:15:19.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.010+0000 7f1831c91700 1 -- 172.21.15.153:0/2423396366 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182400f600 con 0x7f182803a030 2023-10-05T21:15:19.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.010+0000 7f1831c91700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffdd20 con 0x7f182400e8c0 2023-10-05T21:15:19.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.011+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182c02e180 con 0x7f182400e8c0 2023-10-05T21:15:19.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.011+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffbb90 con 0x55cd95fc69d0 2023-10-05T21:15:19.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.011+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182c02e180 con 0x55cd95fc69d0 2023-10-05T21:15:19.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.011+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffbb90 con 0x55cd95fc69d0 2023-10-05T21:15:19.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.011+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182c02e180 con 0x55cd95fc69d0 2023-10-05T21:15:19.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.011+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffbb90 con 0x7f182400e8c0 2023-10-05T21:15:19.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.011+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182c02e180 con 0x7f182400e8c0 2023-10-05T21:15:19.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.011+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffbb90 con 0x7f182400e8c0 2023-10-05T21:15:19.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.011+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182c02e180 con 0x7f182400e8c0 2023-10-05T21:15:19.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.011+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffbb90 con 0x7f182803a030 2023-10-05T21:15:19.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.012+0000 7f1831c91700 1 -- 172.21.15.153:0/2423396366 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182400f600 con 0x7f182803a030 2023-10-05T21:15:19.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.012+0000 7f1831c91700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffbb90 con 0x55cd95ff7fe0 2023-10-05T21:15:19.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.012+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1828037070 con 0x55cd95ff7fe0 2023-10-05T21:15:19.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.012+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffbb90 con 0x55cd95fc69d0 2023-10-05T21:15:19.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.012+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182c02e180 con 0x55cd95fc69d0 2023-10-05T21:15:19.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.012+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffbb90 con 0x7f182400e8c0 2023-10-05T21:15:19.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.012+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182c02e180 con 0x7f182400e8c0 2023-10-05T21:15:19.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.012+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffbb90 con 0x55cd95fc69d0 2023-10-05T21:15:19.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.012+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182c02e180 con 0x55cd95fc69d0 2023-10-05T21:15:19.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.012+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffbb90 con 0x7f182803a030 2023-10-05T21:15:19.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.013+0000 7f1831c91700 1 -- 172.21.15.153:0/2423396366 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182400f600 con 0x7f182803a030 2023-10-05T21:15:19.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.013+0000 7f1831c91700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffbb90 con 0x55cd95ff7fe0 2023-10-05T21:15:19.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.013+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1828037070 con 0x55cd95ff7fe0 2023-10-05T21:15:19.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.013+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffbb90 con 0x55cd95ff7fe0 2023-10-05T21:15:19.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.013+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1828037070 con 0x55cd95ff7fe0 2023-10-05T21:15:19.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.013+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffbb90 con 0x7f182400e8c0 2023-10-05T21:15:19.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.013+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182c02e180 con 0x7f182400e8c0 2023-10-05T21:15:19.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.013+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffbb90 con 0x55cd95ff7fe0 2023-10-05T21:15:19.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.014+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1828037070 con 0x55cd95ff7fe0 2023-10-05T21:15:19.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.014+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffbb90 con 0x55cd95ff7fe0 2023-10-05T21:15:19.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.014+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1828037070 con 0x55cd95ff7fe0 2023-10-05T21:15:19.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.014+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffbb90 con 0x55cd95fc69d0 2023-10-05T21:15:19.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.014+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182c02e180 con 0x55cd95fc69d0 2023-10-05T21:15:19.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.014+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffbb90 con 0x55cd95fc69d0 2023-10-05T21:15:19.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.014+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f182c02e180 con 0x55cd95fc69d0 2023-10-05T21:15:19.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.014+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffbb90 con 0x7f182400e8c0 2023-10-05T21:15:19.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.015+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182c02e180 con 0x7f182400e8c0 2023-10-05T21:15:19.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.015+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffbb90 con 0x55cd95ff7fe0 2023-10-05T21:15:19.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.015+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1828037070 con 0x55cd95ff7fe0 2023-10-05T21:15:19.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.015+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffbb90 con 0x7f182803a030 2023-10-05T21:15:19.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.015+0000 7f1831c91700 1 -- 172.21.15.153:0/2423396366 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182400f600 con 0x7f182803a030 2023-10-05T21:15:19.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.015+0000 7f1831c91700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffbb90 con 0x55cd95fc69d0 2023-10-05T21:15:19.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.015+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182c02e180 con 0x55cd95fc69d0 2023-10-05T21:15:19.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.015+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffbb90 con 0x7f182400e8c0 2023-10-05T21:15:19.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.016+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182c02e180 con 0x7f182400e8c0 2023-10-05T21:15:19.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.016+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffbb90 con 0x55cd95ff7fe0 2023-10-05T21:15:19.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.016+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1828037070 con 0x55cd95ff7fe0 2023-10-05T21:15:19.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.016+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffbb90 con 0x7f182400e8c0 2023-10-05T21:15:19.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.016+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182c02e180 con 0x7f182400e8c0 2023-10-05T21:15:19.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.016+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffbb90 con 0x7f182803a030 2023-10-05T21:15:19.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.016+0000 7f1831c91700 1 -- 172.21.15.153:0/2423396366 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182400f600 con 0x7f182803a030 2023-10-05T21:15:19.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.016+0000 7f1831c91700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffbb90 con 0x55cd95ff7fe0 2023-10-05T21:15:19.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.017+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1828037070 con 0x55cd95ff7fe0 2023-10-05T21:15:19.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.017+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffbb90 con 0x7f182400e8c0 2023-10-05T21:15:19.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.017+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182c02e180 con 0x7f182400e8c0 2023-10-05T21:15:19.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.017+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffbb90 con 0x55cd95fc69d0 2023-10-05T21:15:19.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.017+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f182c02e180 con 0x55cd95fc69d0 2023-10-05T21:15:19.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.017+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffbb90 con 0x7f182803a030 2023-10-05T21:15:19.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.017+0000 7f1831c91700 1 -- 172.21.15.153:0/2423396366 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f182400f600 con 0x7f182803a030 2023-10-05T21:15:19.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.017+0000 7f183f3ba680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:19.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.017+0000 7f183f3ba680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:19.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.017+0000 7f183f3ba680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:19.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.017+0000 7f183f3ba680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:19.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.017+0000 7f183f3ba680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.017+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffcd10 con 0x55cd95fc69d0 2023-10-05T21:15:19.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.017+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f182c02e180 con 0x55cd95fc69d0 2023-10-05T21:15:19.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.018+0000 7f183f3ba680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.018+0000 7f183f3ba680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.018+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffd0c0 con 0x55cd95ff7fe0 2023-10-05T21:15:19.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.018+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f1828037070 con 0x55cd95ff7fe0 2023-10-05T21:15:19.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.018+0000 7f183f3ba680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:19.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.018+0000 7f183f3ba680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.018+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffd960 con 0x55cd95fc69d0 2023-10-05T21:15:19.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.018+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f182c02e180 con 0x55cd95fc69d0 2023-10-05T21:15:19.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.018+0000 7f183f3ba680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.018+0000 7f183f3ba680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.018+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffd960 con 0x55cd95fc69d0 2023-10-05T21:15:19.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.018+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f182c02e180 con 0x55cd95fc69d0 2023-10-05T21:15:19.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.018+0000 7f183f3ba680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:19.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.018+0000 7f183f3ba680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.018+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffd960 con 0x7f182400e8c0 2023-10-05T21:15:19.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.019+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f182c02e180 con 0x7f182400e8c0 2023-10-05T21:15:19.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.019+0000 7f183f3ba680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.019+0000 7f183f3ba680 20 zone default found 2023-10-05T21:15:19.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.019+0000 7f183f3ba680 4 Realm: () 2023-10-05T21:15:19.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.019+0000 7f183f3ba680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:19.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.019+0000 7f183f3ba680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:19.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.019+0000 7f183f3ba680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:19.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.019+0000 7f183f3ba680 20 zonegroup default 2023-10-05T21:15:19.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.019+0000 7f183f3ba680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.019+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffd960 con 0x7f182400e8c0 2023-10-05T21:15:19.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.019+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f182c02e180 con 0x7f182400e8c0 2023-10-05T21:15:19.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.019+0000 7f183f3ba680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.019+0000 7f183f3ba680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.019+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95fff2e0 con 0x55cd95ff7fe0 2023-10-05T21:15:19.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.019+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1828037070 con 0x55cd95ff7fe0 2023-10-05T21:15:19.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.019+0000 7f183f3ba680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.019+0000 7f183f3ba680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.019+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95fff690 con 0x55cd95ff7fe0 2023-10-05T21:15:19.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.019+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1828037070 con 0x55cd95ff7fe0 2023-10-05T21:15:19.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.019+0000 7f183f3ba680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.019+0000 7f183f3ba680 20 started sync module instance, tier type = 2023-10-05T21:15:19.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.019+0000 7f183f3ba680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:19.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.019+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffe9a0 con 0x7f182803a030 2023-10-05T21:15:19.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.020+0000 7f1831c91700 1 -- 172.21.15.153:0/2423396366 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182400f600 con 0x7f182803a030 2023-10-05T21:15:19.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.020+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94341473234256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffff30 con 0x7f182803a030 2023-10-05T21:15:19.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.020+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd960007d0 con 0x55cd95fc69d0 2023-10-05T21:15:19.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.021+0000 7f1831c91700 1 -- 172.21.15.153:0/2423396366 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94341473234256] v29'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182400f600 con 0x7f182803a030 2023-10-05T21:15:19.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.021+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182c02e180 con 0x55cd95fc69d0 2023-10-05T21:15:19.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.021+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94341473237568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd96000810 con 0x55cd95fc69d0 2023-10-05T21:15:19.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.021+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd960013d0 con 0x55cd95ff7fe0 2023-10-05T21:15:19.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.022+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1828037070 con 0x55cd95ff7fe0 2023-10-05T21:15:19.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.022+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94341473237568] v29'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182c02e180 con 0x55cd95fc69d0 2023-10-05T21:15:19.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.022+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94341473239776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd96001390 con 0x55cd95ff7fe0 2023-10-05T21:15:19.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.022+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd96001de0 con 0x7f182803a030 2023-10-05T21:15:19.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.022+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94341473239776] v29'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1828037070 con 0x55cd95ff7fe0 2023-10-05T21:15:19.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.023+0000 7f1831c91700 1 -- 172.21.15.153:0/2423396366 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182400f600 con 0x7f182803a030 2023-10-05T21:15:19.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.023+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94341473242784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd960012f0 con 0x7f182803a030 2023-10-05T21:15:19.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.023+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd96002bc0 con 0x55cd95fc69d0 2023-10-05T21:15:19.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.023+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182c02e180 con 0x55cd95fc69d0 2023-10-05T21:15:19.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.023+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94341473249536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd960033a0 con 0x55cd95fc69d0 2023-10-05T21:15:19.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.023+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd96003fa0 con 0x7f182400e8c0 2023-10-05T21:15:19.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.023+0000 7f1831c91700 1 -- 172.21.15.153:0/2423396366 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94341473242784] v29'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182400f600 con 0x7f182803a030 2023-10-05T21:15:19.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.024+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94341473249536] v29'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182c02e180 con 0x55cd95fc69d0 2023-10-05T21:15:19.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.024+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182c02e180 con 0x7f182400e8c0 2023-10-05T21:15:19.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.024+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94341473253936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd96003f60 con 0x7f182400e8c0 2023-10-05T21:15:19.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.024+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd96002f20 con 0x7f182400e8c0 2023-10-05T21:15:19.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.025+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94341473253936] v29'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182c02e180 con 0x7f182400e8c0 2023-10-05T21:15:19.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.025+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182c02e180 con 0x7f182400e8c0 2023-10-05T21:15:19.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.025+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94341473255264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd960048a0 con 0x7f182400e8c0 2023-10-05T21:15:19.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.025+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd960048a0 con 0x7f182400e8c0 2023-10-05T21:15:19.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.026+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94341473255264] v29'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182c02e180 con 0x7f182400e8c0 2023-10-05T21:15:19.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.026+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182c02e180 con 0x7f182400e8c0 2023-10-05T21:15:19.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.026+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94341473256928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd960052b0 con 0x7f182400e8c0 2023-10-05T21:15:19.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.026+0000 7f183f3ba680 20 add_watcher() i=0 2023-10-05T21:15:19.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.026+0000 7f183f3ba680 20 add_watcher() i=1 2023-10-05T21:15:19.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.026+0000 7f183f3ba680 20 add_watcher() i=2 2023-10-05T21:15:19.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.026+0000 7f183f3ba680 20 add_watcher() i=3 2023-10-05T21:15:19.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.026+0000 7f183f3ba680 20 add_watcher() i=4 2023-10-05T21:15:19.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.026+0000 7f183f3ba680 20 add_watcher() i=5 2023-10-05T21:15:19.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.026+0000 7f183f3ba680 20 add_watcher() i=6 2023-10-05T21:15:19.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.026+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94341473256928] v29'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182c02e180 con 0x7f182400e8c0 2023-10-05T21:15:19.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.026+0000 7f183f3ba680 20 add_watcher() i=7 2023-10-05T21:15:19.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.026+0000 7f183f3ba680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:19.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.026+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd96008590 con 0x55cd95fc69d0 2023-10-05T21:15:19.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.027+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f182c02e180 con 0x55cd95fc69d0 2023-10-05T21:15:19.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.027+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94341473259312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd96005870 con 0x55cd95fc69d0 2023-10-05T21:15:19.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.028+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94341473259312] v29'148 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f182c02e180 con 0x55cd95fc69d0 2023-10-05T21:15:19.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.028+0000 7f1803fdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:19.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.028+0000 7f183f3ba680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:19.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.028+0000 7f183f3ba680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:19.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.028+0000 7f183f3ba680 1 Processor -- start 2023-10-05T21:15:19.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.028+0000 7f183f3ba680 1 -- start start 2023-10-05T21:15:19.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.028+0000 7f183f3ba680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd960130c0 0x55cd960134d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.028+0000 7f183f3ba680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd96013aa0 con 0x55cd960130c0 2023-10-05T21:15:19.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.028+0000 7f1831c91700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd960130c0 0x55cd960134d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.028+0000 7f1831c91700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd960130c0 0x55cd960134d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38076/0 (socket says 172.21.15.153:38076) 2023-10-05T21:15:19.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.028+0000 7f1831c91700 1 -- 172.21.15.153:0/677371601 learned_addr learned my addr 172.21.15.153:0/677371601 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.029+0000 7f1831c91700 1 -- 172.21.15.153:0/677371601 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd96013be0 con 0x55cd960130c0 2023-10-05T21:15:19.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.029+0000 7f1831c91700 1 --2- 172.21.15.153:0/677371601 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd960130c0 0x55cd960134d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x55cd95ff7780 tx=0x7f1824006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97a79ed29cbc0773 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.029+0000 7f18037de700 1 -- 172.21.15.153:0/677371601 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f182400dae0 con 0x55cd960130c0 2023-10-05T21:15:19.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.029+0000 7f18037de700 1 -- 172.21.15.153:0/677371601 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182400dc60 con 0x55cd960130c0 2023-10-05T21:15:19.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.029+0000 7f18037de700 1 -- 172.21.15.153:0/677371601 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f182400de10 con 0x55cd960130c0 2023-10-05T21:15:19.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.030+0000 7f183f3ba680 1 -- 172.21.15.153:0/677371601 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd960130c0 msgr2=0x55cd960134d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.030+0000 7f183f3ba680 1 --2- 172.21.15.153:0/677371601 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd960130c0 0x55cd960134d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x55cd95ff7780 tx=0x7f1824006000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.030+0000 7f183f3ba680 1 -- 172.21.15.153:0/677371601 shutdown_connections 2023-10-05T21:15:19.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.030+0000 7f183f3ba680 1 --2- 172.21.15.153:0/677371601 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd960130c0 0x55cd960134d0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.030+0000 7f183f3ba680 1 -- 172.21.15.153:0/677371601 >> 172.21.15.153:0/677371601 conn(0x55cd9600e2c0 msgr2=0x55cd9600c420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.030+0000 7f183f3ba680 1 -- 172.21.15.153:0/677371601 shutdown_connections 2023-10-05T21:15:19.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.030+0000 7f183f3ba680 1 -- 172.21.15.153:0/677371601 wait complete. 2023-10-05T21:15:19.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.030+0000 7f183f3ba680 1 Processor -- start 2023-10-05T21:15:19.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.030+0000 7f183f3ba680 1 -- start start 2023-10-05T21:15:19.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.030+0000 7f183f3ba680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd960130c0 0x55cd96018be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.030+0000 7f183f3ba680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd96019120 con 0x55cd960130c0 2023-10-05T21:15:19.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.030+0000 7f1831c91700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd960130c0 0x55cd96018be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.030+0000 7f1831c91700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd960130c0 0x55cd96018be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38078/0 (socket says 172.21.15.153:38078) 2023-10-05T21:15:19.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.030+0000 7f1831c91700 1 -- 172.21.15.153:0/565469540 learned_addr learned my addr 172.21.15.153:0/565469540 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.031+0000 7f1831c91700 1 -- 172.21.15.153:0/565469540 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1824006070 con 0x55cd960130c0 2023-10-05T21:15:19.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.031+0000 7f1831c91700 1 --2- 172.21.15.153:0/565469540 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd960130c0 0x55cd96018be0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f182400f550 tx=0x7f1824032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.031+0000 7f1801fdb700 1 -- 172.21.15.153:0/565469540 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f182403da50 con 0x55cd960130c0 2023-10-05T21:15:19.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.031+0000 7f1801fdb700 1 -- 172.21.15.153:0/565469540 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182403dbb0 con 0x55cd960130c0 2023-10-05T21:15:19.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.031+0000 7f183f3ba680 1 -- 172.21.15.153:0/565469540 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cd96019320 con 0x55cd960130c0 2023-10-05T21:15:19.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.031+0000 7f1801fdb700 1 -- 172.21.15.153:0/565469540 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f182403dd20 con 0x55cd960130c0 2023-10-05T21:15:19.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.031+0000 7f183f3ba680 1 -- 172.21.15.153:0/565469540 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cd96019770 con 0x55cd960130c0 2023-10-05T21:15:19.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.032+0000 7f1801fdb700 1 -- 172.21.15.153:0/565469540 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f182401a040 con 0x55cd960130c0 2023-10-05T21:15:19.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.032+0000 7f1801fdb700 1 --2- 172.21.15.153:0/565469540 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1778034140 0x7f17780365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.032+0000 7f1801fdb700 1 -- 172.21.15.153:0/565469540 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f1824052b00 con 0x55cd960130c0 2023-10-05T21:15:19.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.032+0000 7f1832c93700 1 --2- 172.21.15.153:0/565469540 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1778034140 0x7f17780365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.032+0000 7f183f3ba680 5 note: GC not initialized 2023-10-05T21:15:19.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.032+0000 7f1832c93700 1 --2- 172.21.15.153:0/565469540 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1778034140 0x7f17780365f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55cd960085c0 tx=0x7f182c00af80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.033+0000 7f1772ffd700 20 reqs_thread_entry: start 2023-10-05T21:15:19.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.033+0000 7f1770ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:19.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.033+0000 7f183f3ba680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:19.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.033+0000 7f183f3ba680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:19.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.033+0000 7f1762ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:49 2023 2023-10-05T21:15:19.064 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:19.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.033+0000 7f17627fc700 20 reqs_thread_entry: start 2023-10-05T21:15:19.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.033+0000 7f183f3ba680 10 log_show_next pos 0 bl 0 off 0 eof 0 2023-10-05T21:15:19.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.033+0000 7f183f3ba680 1 --2- 172.21.15.153:0/565469540 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55cd9607d480 0x55cd9607f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.033+0000 7f183f3ba680 1 -- 172.21.15.153:0/565469540 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:1 6.a 6:577d78d5:::2023-10-05-21--:head [read 0~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd9607fda0 con 0x55cd9607d480 2023-10-05T21:15:19.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.033+0000 7f1832492700 1 --2- 172.21.15.153:0/565469540 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55cd9607d480 0x55cd9607f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.034+0000 7f1832492700 1 --2- 172.21.15.153:0/565469540 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55cd9607d480 0x55cd9607f860 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.034+0000 7f1832492700 1 -- 172.21.15.153:0/565469540 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(1 2023-10-05-21-- [read 0~658 out=658b] v0'0 uv25 ondisk = 0) v8 ==== 159+0+658 (crc 0 0 0) 0x7f1828037070 con 0x55cd9607d480 2023-10-05T21:15:19.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.034+0000 7f183f3ba680 10 read 658 2023-10-05T21:15:19.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.034+0000 7f183f3ba680 10 log_show_next pos 658 bl 658 off 304 eof 1 2023-10-05T21:15:19.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.034+0000 7f183f3ba680 10 log_show_next pos 658 bl 658 off 658 eof 1 2023-10-05T21:15:19.065 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:19.065 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_id": "", 2023-10-05T21:15:19.066 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_owner": "", 2023-10-05T21:15:19.066 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "", 2023-10-05T21:15:19.066 INFO:teuthology.orchestra.run.smithi153.stdout: "log_entries": [ 2023-10-05T21:15:19.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:19.066 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "", 2023-10-05T21:15:19.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:15:11.252116Z", 2023-10-05T21:15:19.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time_local": "2023-10-05T21:15:11.252116+0000", 2023-10-05T21:15:19.066 INFO:teuthology.orchestra.run.smithi153.stdout: "remote_addr": "172.21.15.153", 2023-10-05T21:15:19.066 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "anonymous", 2023-10-05T21:15:19.067 INFO:teuthology.orchestra.run.smithi153.stdout: "operation": "list_buckets", 2023-10-05T21:15:19.067 INFO:teuthology.orchestra.run.smithi153.stdout: "uri": "GET / HTTP/1.1", 2023-10-05T21:15:19.067 INFO:teuthology.orchestra.run.smithi153.stdout: "http_status": "200", 2023-10-05T21:15:19.067 INFO:teuthology.orchestra.run.smithi153.stdout: "error_code": "", 2023-10-05T21:15:19.067 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 231, 2023-10-05T21:15:19.067 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:15:19.067 INFO:teuthology.orchestra.run.smithi153.stdout: "object_size": 0, 2023-10-05T21:15:19.067 INFO:teuthology.orchestra.run.smithi153.stdout: "total_time": 1, 2023-10-05T21:15:19.067 INFO:teuthology.orchestra.run.smithi153.stdout: "user_agent": "curl/7.61.1", 2023-10-05T21:15:19.068 INFO:teuthology.orchestra.run.smithi153.stdout: "referrer": "", 2023-10-05T21:15:19.068 INFO:teuthology.orchestra.run.smithi153.stdout: "trans_id": "tx00000fb25fb0c08758937-00651f275f-107c-default", 2023-10-05T21:15:19.068 INFO:teuthology.orchestra.run.smithi153.stdout: "authentication_type": "Local", 2023-10-05T21:15:19.068 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url": false 2023-10-05T21:15:19.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:19.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:19.068 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "", 2023-10-05T21:15:19.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:15:15.711038Z", 2023-10-05T21:15:19.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time_local": "2023-10-05T21:15:15.711038+0000", 2023-10-05T21:15:19.069 INFO:teuthology.orchestra.run.smithi153.stdout: "remote_addr": "172.21.0.51", 2023-10-05T21:15:19.069 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:19.069 INFO:teuthology.orchestra.run.smithi153.stdout: "operation": "list_buckets", 2023-10-05T21:15:19.069 INFO:teuthology.orchestra.run.smithi153.stdout: "uri": "GET / HTTP/1.1", 2023-10-05T21:15:19.069 INFO:teuthology.orchestra.run.smithi153.stdout: "http_status": "200", 2023-10-05T21:15:19.069 INFO:teuthology.orchestra.run.smithi153.stdout: "error_code": "", 2023-10-05T21:15:19.069 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 322, 2023-10-05T21:15:19.069 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:15:19.069 INFO:teuthology.orchestra.run.smithi153.stdout: "object_size": 0, 2023-10-05T21:15:19.070 INFO:teuthology.orchestra.run.smithi153.stdout: "total_time": 0, 2023-10-05T21:15:19.070 INFO:teuthology.orchestra.run.smithi153.stdout: "user_agent": "Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic", 2023-10-05T21:15:19.070 INFO:teuthology.orchestra.run.smithi153.stdout: "referrer": "", 2023-10-05T21:15:19.070 INFO:teuthology.orchestra.run.smithi153.stdout: "trans_id": "tx0000064eacd0fd2cfe4bc-00651f2763-107c-default", 2023-10-05T21:15:19.070 INFO:teuthology.orchestra.run.smithi153.stdout: "authentication_type": "Local", 2023-10-05T21:15:19.070 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key_id": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:19.070 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url": false 2023-10-05T21:15:19.070 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:19.070 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:19.070 INFO:teuthology.orchestra.run.smithi153.stdout: "log_sum": { 2023-10-05T21:15:19.071 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 553, 2023-10-05T21:15:19.071 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:15:19.071 INFO:teuthology.orchestra.run.smithi153.stdout: "total_time": 1, 2023-10-05T21:15:19.071 INFO:teuthology.orchestra.run.smithi153.stdout: "total_entries": 2 2023-10-05T21:15:19.071 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:19.071 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:19.071 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:15:19.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.034+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94341473234256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd9603d1d0 con 0x7f182803a030 2023-10-05T21:15:19.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.035+0000 7f1831c91700 1 -- 172.21.15.153:0/2423396366 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(102 notify.0 [watch unwatch cookie 94341473234256] v29'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182400f600 con 0x7f182803a030 2023-10-05T21:15:19.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.035+0000 7f183f3ba680 20 remove_watcher() i=0 2023-10-05T21:15:19.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.035+0000 7f183f3ba680 2 removed watcher, disabling cache 2023-10-05T21:15:19.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.035+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94341473237568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffed50 con 0x55cd95fc69d0 2023-10-05T21:15:19.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.036+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(103 notify.1 [watch unwatch cookie 94341473237568] v29'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182c02e180 con 0x55cd95fc69d0 2023-10-05T21:15:19.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.036+0000 7f183f3ba680 20 remove_watcher() i=1 2023-10-05T21:15:19.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.036+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:104 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94341473239776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffed50 con 0x55cd95ff7fe0 2023-10-05T21:15:19.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.037+0000 7f1832492700 1 -- 172.21.15.153:0/2423396366 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(104 notify.2 [watch unwatch cookie 94341473239776] v29'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1828037070 con 0x55cd95ff7fe0 2023-10-05T21:15:19.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.037+0000 7f183f3ba680 20 remove_watcher() i=2 2023-10-05T21:15:19.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.037+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94341473242784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffed50 con 0x7f182803a030 2023-10-05T21:15:19.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.038+0000 7f1831c91700 1 -- 172.21.15.153:0/2423396366 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(105 notify.3 [watch unwatch cookie 94341473242784] v29'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182400f600 con 0x7f182803a030 2023-10-05T21:15:19.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.038+0000 7f183f3ba680 20 remove_watcher() i=3 2023-10-05T21:15:19.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.038+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94341473249536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd96000ea0 con 0x55cd95fc69d0 2023-10-05T21:15:19.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.038+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(106 notify.4 [watch unwatch cookie 94341473249536] v29'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182c02e180 con 0x55cd95fc69d0 2023-10-05T21:15:19.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.038+0000 7f183f3ba680 20 remove_watcher() i=4 2023-10-05T21:15:19.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.038+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:107 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94341473253936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd95ffed50 con 0x7f182400e8c0 2023-10-05T21:15:19.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.039+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(107 notify.5 [watch unwatch cookie 94341473253936] v29'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182c02e180 con 0x7f182400e8c0 2023-10-05T21:15:19.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.039+0000 7f183f3ba680 20 remove_watcher() i=5 2023-10-05T21:15:19.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.039+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94341473255264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd96002900 con 0x7f182400e8c0 2023-10-05T21:15:19.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.040+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(108 notify.6 [watch unwatch cookie 94341473255264] v29'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182c02e180 con 0x7f182400e8c0 2023-10-05T21:15:19.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.040+0000 7f183f3ba680 20 remove_watcher() i=6 2023-10-05T21:15:19.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.040+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94341473256928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd96000ea0 con 0x7f182400e8c0 2023-10-05T21:15:19.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.041+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(109 notify.7 [watch unwatch cookie 94341473256928] v29'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f182c02e180 con 0x7f182400e8c0 2023-10-05T21:15:19.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.041+0000 7f183f3ba680 20 remove_watcher() i=7 2023-10-05T21:15:19.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.041+0000 7f1803fdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:19.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.041+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:110 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94341473259312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55cd96000ea0 con 0x55cd95fc69d0 2023-10-05T21:15:19.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.042+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(110 data_loggenerations_metadata [watch unwatch cookie 94341473259312] v29'149 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f182c02e180 con 0x55cd95fc69d0 2023-10-05T21:15:19.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.042+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f182400e8c0 msgr2=0x7f182400d310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.042+0000 7f183f3ba680 1 --2- 172.21.15.153:0/2423396366 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f182400e8c0 0x7f182400d310 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.042+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55cd95fc69d0 msgr2=0x55cd95ff59b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.042+0000 7f183f3ba680 1 --2- 172.21.15.153:0/2423396366 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55cd95fc69d0 0x55cd95ff59b0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.042+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f182803a030 msgr2=0x7f18280395d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.042+0000 7f183f3ba680 1 --2- 172.21.15.153:0/2423396366 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f182803a030 0x7f18280395d0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.042+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55cd95ff7fe0 msgr2=0x55cd95ffa3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.042+0000 7f183f3ba680 1 --2- 172.21.15.153:0/2423396366 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55cd95ff7fe0 0x55cd95ffa3c0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.042+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1814034140 msgr2=0x7f18140365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.042+0000 7f183f3ba680 1 --2- 172.21.15.153:0/2423396366 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1814034140 0x7f18140365f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f18240011e0 tx=0x7f1824001460 comp rx=0 tx=0).stop 2023-10-05T21:15:19.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.042+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd95f350a0 msgr2=0x55cd95fe9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.042+0000 7f183f3ba680 1 --2- 172.21.15.153:0/2423396366 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd95f350a0 0x55cd95fe9c80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1828020040 tx=0x7f182801d000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.042+0000 7f1832c93700 1 -- 172.21.15.153:0/2423396366 reap_dead start 2023-10-05T21:15:19.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.043+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 shutdown_connections 2023-10-05T21:15:19.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.043+0000 7f183f3ba680 1 --2- 172.21.15.153:0/2423396366 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd95f350a0 0x55cd95fe9c80 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.043+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 >> 172.21.15.153:0/2423396366 conn(0x55cd95fbbb80 msgr2=0x55cd95fdcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.043+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 shutdown_connections 2023-10-05T21:15:19.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.043+0000 7f183f3ba680 1 -- 172.21.15.153:0/2423396366 wait complete. 2023-10-05T21:15:19.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.043+0000 7f183f3ba680 1 -- 172.21.15.153:0/565469540 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55cd9607d480 msgr2=0x55cd9607f860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.043+0000 7f183f3ba680 1 --2- 172.21.15.153:0/565469540 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55cd9607d480 0x55cd9607f860 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.043+0000 7f183f3ba680 1 -- 172.21.15.153:0/565469540 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1778034140 msgr2=0x7f17780365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.043+0000 7f183f3ba680 1 --2- 172.21.15.153:0/565469540 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1778034140 0x7f17780365f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55cd960085c0 tx=0x7f182c00af80 comp rx=0 tx=0).stop 2023-10-05T21:15:19.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.043+0000 7f183f3ba680 1 -- 172.21.15.153:0/565469540 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd960130c0 msgr2=0x55cd96018be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.043+0000 7f183f3ba680 1 --2- 172.21.15.153:0/565469540 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd960130c0 0x55cd96018be0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f182400f550 tx=0x7f1824032000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.043+0000 7f183f3ba680 1 -- 172.21.15.153:0/565469540 shutdown_connections 2023-10-05T21:15:19.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.043+0000 7f183f3ba680 1 --2- 172.21.15.153:0/565469540 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55cd9607d480 0x55cd9607f860 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.043+0000 7f183f3ba680 1 --2- 172.21.15.153:0/565469540 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cd960130c0 0x55cd96018be0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.043+0000 7f183f3ba680 1 --2- 172.21.15.153:0/565469540 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1778034140 0x7f17780365f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.043+0000 7f183f3ba680 1 -- 172.21.15.153:0/565469540 >> 172.21.15.153:0/565469540 conn(0x55cd9600e2c0 msgr2=0x55cd9600c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.043+0000 7f183f3ba680 1 -- 172.21.15.153:0/565469540 shutdown_connections 2023-10-05T21:15:19.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.043+0000 7f183f3ba680 1 -- 172.21.15.153:0/565469540 wait complete. 2023-10-05T21:15:19.082 DEBUG:tasks.util.rgw: json result: {'bucket_id': '', 'bucket_owner': '', 'bucket': '', 'log_entries': [{'bucket': '', 'time': '2023-10-05T21:15:11.252116Z', 'time_local': '2023-10-05T21:15:11.252116+0000', 'remote_addr': '172.21.15.153', 'user': 'anonymous', 'operation': 'list_buckets', 'uri': 'GET / HTTP/1.1', 'http_status': '200', 'error_code': '', 'bytes_sent': 231, 'bytes_received': 0, 'object_size': 0, 'total_time': 1, 'user_agent': 'curl/7.61.1', 'referrer': '', 'trans_id': 'tx00000fb25fb0c08758937-00651f275f-107c-default', 'authentication_type': 'Local', 'temp_url': False}, {'bucket': '', 'time': '2023-10-05T21:15:15.711038Z', 'time_local': '2023-10-05T21:15:15.711038+0000', 'remote_addr': '172.21.0.51', 'user': 'foo', 'operation': 'list_buckets', 'uri': 'GET / HTTP/1.1', 'http_status': '200', 'error_code': '', 'bytes_sent': 322, 'bytes_received': 0, 'object_size': 0, 'total_time': 0, 'user_agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic', 'referrer': '', 'trans_id': 'tx0000064eacd0fd2cfe4bc-00651f2763-107c-default', 'authentication_type': 'Local', 'access_key_id': '9te6NH5mcdcq0Tc5i8i1', 'temp_url': False}], 'log_sum': {'bytes_sent': 553, 'bytes_received': 0, 'total_time': 1, 'total_entries': 2}} 2023-10-05T21:15:19.082 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'rm', '--object', '2023-10-05-21--'] 2023-10-05T21:15:19.082 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'rm', '--object', '2023-10-05-21--'] 2023-10-05T21:15:19.082 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log rm --object 2023-10-05-21-- 2023-10-05T21:15:19.126 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:19.126 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:19.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.124+0000 7f00689a0680 1 Processor -- start 2023-10-05T21:15:19.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.124+0000 7f00689a0680 1 -- start start 2023-10-05T21:15:19.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.124+0000 7f00689a0680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55ebef568f60 0x55ebef56b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.124+0000 7f00689a0680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ebef4b3990 con 0x55ebef564a30 2023-10-05T21:15:19.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.124+0000 7f00689a0680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ebef473db0 con 0x55ebef568f60 2023-10-05T21:15:19.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.125+0000 7f005ba78700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55ebef564a30 0x55ebef564e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:55264/0 (socket says 172.21.15.153:55264) 2023-10-05T21:15:19.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.125+0000 7f005ba78700 1 -- 172.21.15.153:0/1219366379 learned_addr learned my addr 172.21.15.153:0/1219366379 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:19.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.125+0000 7f005b277700 1 --2- 172.21.15.153:0/1219366379 >> v2:172.21.15.111:3300/0 conn(0x55ebef568f60 0x55ebef56b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.125+0000 7f005b277700 1 -- 172.21.15.153:0/1219366379 >> v1:172.21.15.111:6789/0 conn(0x55ebef564a30 legacy=0x55ebef564e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.125+0000 7f005aa76700 1 -- 172.21.15.153:0/1219366379 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4073311848 0 0) 0x55ebef4b3990 con 0x55ebef564a30 2023-10-05T21:15:19.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.125+0000 7f005b277700 1 -- 172.21.15.153:0/1219366379 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ebef56c890 con 0x55ebef568f60 2023-10-05T21:15:19.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.125+0000 7f005b277700 1 --2- 172.21.15.153:0/1219366379 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef568f60 0x55ebef56b340 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f004c00a5d0 tx=0x7f004c005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=664e1d388b8a0d04 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.125+0000 7f005aa76700 1 -- 172.21.15.153:0/1219366379 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f004c0086a0 con 0x55ebef568f60 2023-10-05T21:15:19.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.125+0000 7f005aa76700 1 -- 172.21.15.153:0/1219366379 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c008800 con 0x55ebef568f60 2023-10-05T21:15:19.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.125+0000 7f005aa76700 1 -- 172.21.15.153:0/1219366379 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f004c008ad0 con 0x55ebef568f60 2023-10-05T21:15:19.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.126+0000 7f00689a0680 1 -- 172.21.15.153:0/1219366379 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef568f60 msgr2=0x55ebef56b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.126+0000 7f00689a0680 1 --2- 172.21.15.153:0/1219366379 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef568f60 0x55ebef56b340 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f004c00a5d0 tx=0x7f004c005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:19.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.126+0000 7f00689a0680 1 -- 172.21.15.153:0/1219366379 shutdown_connections 2023-10-05T21:15:19.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.126+0000 7f00689a0680 1 --2- 172.21.15.153:0/1219366379 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef568f60 0x55ebef56b340 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.126+0000 7f00689a0680 1 -- 172.21.15.153:0/1219366379 >> 172.21.15.153:0/1219366379 conn(0x55ebef560300 msgr2=0x55ebef562710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.126+0000 7f00689a0680 1 -- 172.21.15.153:0/1219366379 shutdown_connections 2023-10-05T21:15:19.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.126+0000 7f00689a0680 1 -- 172.21.15.153:0/1219366379 wait complete. 2023-10-05T21:15:19.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.127+0000 7f00689a0680 1 Processor -- start 2023-10-05T21:15:19.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.127+0000 7f00689a0680 1 -- start start 2023-10-05T21:15:19.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.127+0000 7f00689a0680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef564a30 0x55ebef57e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.127+0000 7f00689a0680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebef413ea0 con 0x55ebef564a30 2023-10-05T21:15:19.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.127+0000 7f005ba78700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef564a30 0x55ebef57e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.127+0000 7f005ba78700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef564a30 0x55ebef57e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38084/0 (socket says 172.21.15.153:38084) 2023-10-05T21:15:19.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.127+0000 7f005ba78700 1 -- 172.21.15.153:0/2457696403 learned_addr learned my addr 172.21.15.153:0/2457696403 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.127+0000 7f005ba78700 1 -- 172.21.15.153:0/2457696403 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004c005cf0 con 0x55ebef564a30 2023-10-05T21:15:19.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.127+0000 7f005ba78700 1 --2- 172.21.15.153:0/2457696403 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef564a30 0x55ebef57e9a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0050001dc0 tx=0x7f0050001790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a766c1bbf8df0e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.127+0000 7f0059a74700 1 -- 172.21.15.153:0/2457696403 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f005000bd70 con 0x55ebef564a30 2023-10-05T21:15:19.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.128+0000 7f0059a74700 1 -- 172.21.15.153:0/2457696403 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005000e470 con 0x55ebef564a30 2023-10-05T21:15:19.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.128+0000 7f0059a74700 1 -- 172.21.15.153:0/2457696403 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f005000e740 con 0x55ebef564a30 2023-10-05T21:15:19.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.128+0000 7f00689a0680 1 -- 172.21.15.153:0/2457696403 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef564a30 msgr2=0x55ebef57e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.128+0000 7f00689a0680 1 --2- 172.21.15.153:0/2457696403 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef564a30 0x55ebef57e9a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0050001dc0 tx=0x7f0050001790 comp rx=0 tx=0).stop 2023-10-05T21:15:19.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.128+0000 7f00689a0680 1 -- 172.21.15.153:0/2457696403 shutdown_connections 2023-10-05T21:15:19.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.128+0000 7f00689a0680 1 --2- 172.21.15.153:0/2457696403 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef564a30 0x55ebef57e9a0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.128+0000 7f00689a0680 1 -- 172.21.15.153:0/2457696403 >> 172.21.15.153:0/2457696403 conn(0x55ebef560300 msgr2=0x55ebef5800c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.128+0000 7f00689a0680 1 -- 172.21.15.153:0/2457696403 shutdown_connections 2023-10-05T21:15:19.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.128+0000 7f00689a0680 1 -- 172.21.15.153:0/2457696403 wait complete. 2023-10-05T21:15:19.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.128+0000 7f00689a0680 1 Processor -- start 2023-10-05T21:15:19.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.128+0000 7f00689a0680 1 -- start start 2023-10-05T21:15:19.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.128+0000 7f00689a0680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef564a30 0x55ebef585d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.128+0000 7f00689a0680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebef40ac80 con 0x55ebef564a30 2023-10-05T21:15:19.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.129+0000 7f005ba78700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef564a30 0x55ebef585d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.129+0000 7f005ba78700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef564a30 0x55ebef585d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38090/0 (socket says 172.21.15.153:38090) 2023-10-05T21:15:19.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.129+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 learned_addr learned my addr 172.21.15.153:0/1863832662 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.129+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0050001a70 con 0x55ebef564a30 2023-10-05T21:15:19.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.129+0000 7f005ba78700 1 --2- 172.21.15.153:0/1863832662 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef564a30 0x55ebef585d90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f00500017d0 tx=0x7f0050016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.129+0000 7f0043fff700 1 -- 172.21.15.153:0/1863832662 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f005001f070 con 0x55ebef564a30 2023-10-05T21:15:19.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.129+0000 7f0043fff700 1 -- 172.21.15.153:0/1863832662 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005001a640 con 0x55ebef564a30 2023-10-05T21:15:19.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.129+0000 7f0043fff700 1 -- 172.21.15.153:0/1863832662 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f005001a910 con 0x55ebef564a30 2023-10-05T21:15:19.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.129+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ebef5843b0 con 0x55ebef564a30 2023-10-05T21:15:19.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.129+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ebef584800 con 0x55ebef564a30 2023-10-05T21:15:19.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.130+0000 7f0043fff700 1 -- 172.21.15.153:0/1863832662 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f005001aa70 con 0x55ebef564a30 2023-10-05T21:15:19.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.130+0000 7f00689a0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.130+0000 7f0043fff700 1 --2- 172.21.15.153:0/1863832662 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0048034140 0x7f00480365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.130+0000 7f0043fff700 1 -- 172.21.15.153:0/1863832662 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f0050048ff0 con 0x55ebef564a30 2023-10-05T21:15:19.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.131+0000 7f005b277700 1 --2- 172.21.15.153:0/1863832662 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0048034140 0x7f00480365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.131+0000 7f00689a0680 1 --2- 172.21.15.153:0/1863832662 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ebef568f60 0x55ebef59ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.131+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef59b2e0 con 0x55ebef568f60 2023-10-05T21:15:19.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.131+0000 7f005c279700 1 --2- 172.21.15.153:0/1863832662 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ebef568f60 0x55ebef59ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.131+0000 7f005b277700 1 --2- 172.21.15.153:0/1863832662 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0048034140 0x7f00480365f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f004c003080 tx=0x7f004c015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.131+0000 7f005c279700 1 --2- 172.21.15.153:0/1863832662 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ebef568f60 0x55ebef59ab50 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.131+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.131+0000 7f00689a0680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.131+0000 7f00689a0680 20 realm 2023-10-05T21:15:19.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.131+0000 7f00689a0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.131+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef598170 con 0x55ebef568f60 2023-10-05T21:15:19.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.132+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.132+0000 7f00689a0680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.132+0000 7f00689a0680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:19.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.132+0000 7f00689a0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.132+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef59bde0 con 0x55ebef568f60 2023-10-05T21:15:19.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.132+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.132+0000 7f00689a0680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.132+0000 7f00689a0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.132+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef59c700 con 0x55ebef568f60 2023-10-05T21:15:19.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.132+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.132+0000 7f00689a0680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.132+0000 7f00689a0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.132+0000 7f00689a0680 1 --2- 172.21.15.153:0/1863832662 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ebef59cfc0 0x55ebef59f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.132+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef59f9f0 con 0x55ebef59cfc0 2023-10-05T21:15:19.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.132+0000 7f005ba78700 1 --2- 172.21.15.153:0/1863832662 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ebef59cfc0 0x55ebef59f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.132+0000 7f005ba78700 1 --2- 172.21.15.153:0/1863832662 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ebef59cfc0 0x55ebef59f3a0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.133+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f0050014070 con 0x55ebef59cfc0 2023-10-05T21:15:19.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.133+0000 7f00689a0680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:19.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.133+0000 7f00689a0680 20 searching for the correct realm 2023-10-05T21:15:19.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.133+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x55ebef59cfc0 2023-10-05T21:15:19.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.133+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0050014070 con 0x55ebef59cfc0 2023-10-05T21:15:19.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.133+0000 7f005ba78700 1 --2- 172.21.15.153:0/1863832662 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f005002d020 0x7f005002c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.133+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x7f005002d020 2023-10-05T21:15:19.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.133+0000 7f005b277700 1 --2- 172.21.15.153:0/1863832662 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f005002d020 0x7f005002c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.133+0000 7f005b277700 1 --2- 172.21.15.153:0/1863832662 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f005002d020 0x7f005002c5d0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.134+0000 7f005b277700 1 -- 172.21.15.153:0/1863832662 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f004c019040 con 0x7f005002d020 2023-10-05T21:15:19.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.134+0000 7f005b277700 1 --2- 172.21.15.153:0/1863832662 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f004c007030 0x7f004c01d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.134+0000 7f005b277700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x7f004c007030 2023-10-05T21:15:19.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.134+0000 7f005c279700 1 --2- 172.21.15.153:0/1863832662 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f004c007030 0x7f004c01d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.134+0000 7f005c279700 1 --2- 172.21.15.153:0/1863832662 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f004c007030 0x7f004c01d420 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.135+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f005400a570 con 0x7f004c007030 2023-10-05T21:15:19.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.135+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x55ebef568f60 2023-10-05T21:15:19.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.135+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.135+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x55ebef568f60 2023-10-05T21:15:19.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.135+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.135+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x7f004c007030 2023-10-05T21:15:19.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.135+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f005400a570 con 0x7f004c007030 2023-10-05T21:15:19.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.135+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x7f004c007030 2023-10-05T21:15:19.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.135+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f005400a570 con 0x7f004c007030 2023-10-05T21:15:19.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.135+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x7f005002d020 2023-10-05T21:15:19.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.136+0000 7f005b277700 1 -- 172.21.15.153:0/1863832662 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f004c019040 con 0x7f005002d020 2023-10-05T21:15:19.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.136+0000 7f005b277700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x55ebef59cfc0 2023-10-05T21:15:19.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.136+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0050014070 con 0x55ebef59cfc0 2023-10-05T21:15:19.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.136+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x55ebef568f60 2023-10-05T21:15:19.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.136+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.136+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x7f004c007030 2023-10-05T21:15:19.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.136+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f005400a570 con 0x7f004c007030 2023-10-05T21:15:19.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.136+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x55ebef568f60 2023-10-05T21:15:19.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.136+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.136+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x7f005002d020 2023-10-05T21:15:19.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.137+0000 7f005b277700 1 -- 172.21.15.153:0/1863832662 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f004c019040 con 0x7f005002d020 2023-10-05T21:15:19.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.137+0000 7f005b277700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x55ebef59cfc0 2023-10-05T21:15:19.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.137+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0050014070 con 0x55ebef59cfc0 2023-10-05T21:15:19.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.137+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x55ebef59cfc0 2023-10-05T21:15:19.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.137+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0050014070 con 0x55ebef59cfc0 2023-10-05T21:15:19.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.137+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x7f004c007030 2023-10-05T21:15:19.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.137+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f005400a570 con 0x7f004c007030 2023-10-05T21:15:19.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.137+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x55ebef59cfc0 2023-10-05T21:15:19.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.137+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0050014070 con 0x55ebef59cfc0 2023-10-05T21:15:19.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.137+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x55ebef59cfc0 2023-10-05T21:15:19.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.138+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0050014070 con 0x55ebef59cfc0 2023-10-05T21:15:19.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.138+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x55ebef568f60 2023-10-05T21:15:19.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.138+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.138+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x55ebef568f60 2023-10-05T21:15:19.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.138+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.138+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x7f004c007030 2023-10-05T21:15:19.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.138+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f005400a570 con 0x7f004c007030 2023-10-05T21:15:19.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.138+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x55ebef59cfc0 2023-10-05T21:15:19.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.138+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0050014070 con 0x55ebef59cfc0 2023-10-05T21:15:19.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.138+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x7f005002d020 2023-10-05T21:15:19.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.139+0000 7f005b277700 1 -- 172.21.15.153:0/1863832662 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f004c019040 con 0x7f005002d020 2023-10-05T21:15:19.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.139+0000 7f005b277700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x55ebef568f60 2023-10-05T21:15:19.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.139+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.139+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x7f004c007030 2023-10-05T21:15:19.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.139+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f005400a570 con 0x7f004c007030 2023-10-05T21:15:19.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.139+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x55ebef59cfc0 2023-10-05T21:15:19.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.139+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0050014070 con 0x55ebef59cfc0 2023-10-05T21:15:19.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.139+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x7f004c007030 2023-10-05T21:15:19.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.140+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f005400a570 con 0x7f004c007030 2023-10-05T21:15:19.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.140+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x7f005002d020 2023-10-05T21:15:19.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.140+0000 7f005b277700 1 -- 172.21.15.153:0/1863832662 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f004c019040 con 0x7f005002d020 2023-10-05T21:15:19.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.140+0000 7f005b277700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x55ebef59cfc0 2023-10-05T21:15:19.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.140+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0050014070 con 0x55ebef59cfc0 2023-10-05T21:15:19.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.140+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x7f004c007030 2023-10-05T21:15:19.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.140+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f005400a570 con 0x7f004c007030 2023-10-05T21:15:19.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.140+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x55ebef568f60 2023-10-05T21:15:19.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.140+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.140+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1560 con 0x7f005002d020 2023-10-05T21:15:19.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.141+0000 7f005b277700 1 -- 172.21.15.153:0/1863832662 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f004c019040 con 0x7f005002d020 2023-10-05T21:15:19.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.141+0000 7f00689a0680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:19.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.141+0000 7f00689a0680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:19.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.141+0000 7f00689a0680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:19.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.141+0000 7f00689a0680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:19.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.141+0000 7f00689a0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.141+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a04b0 con 0x55ebef568f60 2023-10-05T21:15:19.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.141+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.141+0000 7f00689a0680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.141+0000 7f00689a0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.141+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a08b0 con 0x55ebef568f60 2023-10-05T21:15:19.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.141+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.141+0000 7f00689a0680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.141+0000 7f00689a0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.141+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a19f0 con 0x55ebef568f60 2023-10-05T21:15:19.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.141+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.141+0000 7f00689a0680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:19.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.141+0000 7f00689a0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.141+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a1da0 con 0x55ebef59cfc0 2023-10-05T21:15:19.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.142+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f0050014070 con 0x55ebef59cfc0 2023-10-05T21:15:19.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.142+0000 7f00689a0680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.142+0000 7f00689a0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.142+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a2150 con 0x55ebef568f60 2023-10-05T21:15:19.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.142+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.142+0000 7f00689a0680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.142+0000 7f00689a0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.142+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a2150 con 0x55ebef568f60 2023-10-05T21:15:19.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.142+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.142+0000 7f00689a0680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.142+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a2150 con 0x55ebef59cfc0 2023-10-05T21:15:19.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.142+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0050014070 con 0x55ebef59cfc0 2023-10-05T21:15:19.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.142+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a2150 con 0x7f005002d020 2023-10-05T21:15:19.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.142+0000 7f005b277700 1 -- 172.21.15.153:0/1863832662 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f004c019040 con 0x7f005002d020 2023-10-05T21:15:19.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.142+0000 7f005b277700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a2150 con 0x7f004c007030 2023-10-05T21:15:19.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.143+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f005400a570 con 0x7f004c007030 2023-10-05T21:15:19.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.143+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a19f0 con 0x55ebef568f60 2023-10-05T21:15:19.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.143+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.143+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a19f0 con 0x55ebef568f60 2023-10-05T21:15:19.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.143+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.143+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a19f0 con 0x7f004c007030 2023-10-05T21:15:19.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.144+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f005400a570 con 0x7f004c007030 2023-10-05T21:15:19.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.144+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a19f0 con 0x7f004c007030 2023-10-05T21:15:19.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.144+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f005400a570 con 0x7f004c007030 2023-10-05T21:15:19.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.144+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a19f0 con 0x7f005002d020 2023-10-05T21:15:19.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.144+0000 7f005b277700 1 -- 172.21.15.153:0/1863832662 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f004c019040 con 0x7f005002d020 2023-10-05T21:15:19.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.144+0000 7f005b277700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a19f0 con 0x55ebef59cfc0 2023-10-05T21:15:19.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.144+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0050014070 con 0x55ebef59cfc0 2023-10-05T21:15:19.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.144+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a19f0 con 0x55ebef568f60 2023-10-05T21:15:19.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.144+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.144+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a19f0 con 0x7f004c007030 2023-10-05T21:15:19.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.145+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f005400a570 con 0x7f004c007030 2023-10-05T21:15:19.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.145+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a19f0 con 0x55ebef568f60 2023-10-05T21:15:19.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.145+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.145+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a19f0 con 0x7f005002d020 2023-10-05T21:15:19.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.145+0000 7f005b277700 1 -- 172.21.15.153:0/1863832662 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f004c019040 con 0x7f005002d020 2023-10-05T21:15:19.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.145+0000 7f005b277700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a19f0 con 0x55ebef59cfc0 2023-10-05T21:15:19.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.145+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0050014070 con 0x55ebef59cfc0 2023-10-05T21:15:19.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.145+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a19f0 con 0x55ebef59cfc0 2023-10-05T21:15:19.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.145+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0050014070 con 0x55ebef59cfc0 2023-10-05T21:15:19.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.145+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a19f0 con 0x7f004c007030 2023-10-05T21:15:19.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.146+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f005400a570 con 0x7f004c007030 2023-10-05T21:15:19.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.146+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a19f0 con 0x55ebef59cfc0 2023-10-05T21:15:19.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.146+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0050014070 con 0x55ebef59cfc0 2023-10-05T21:15:19.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.146+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a19f0 con 0x55ebef59cfc0 2023-10-05T21:15:19.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.146+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0050014070 con 0x55ebef59cfc0 2023-10-05T21:15:19.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.146+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a19f0 con 0x55ebef568f60 2023-10-05T21:15:19.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.147+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.147+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a19f0 con 0x55ebef568f60 2023-10-05T21:15:19.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.147+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.147+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a19f0 con 0x7f004c007030 2023-10-05T21:15:19.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.147+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f005400a570 con 0x7f004c007030 2023-10-05T21:15:19.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.147+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a19f0 con 0x55ebef59cfc0 2023-10-05T21:15:19.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.147+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0050014070 con 0x55ebef59cfc0 2023-10-05T21:15:19.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.147+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a19f0 con 0x7f005002d020 2023-10-05T21:15:19.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.147+0000 7f005b277700 1 -- 172.21.15.153:0/1863832662 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f004c019040 con 0x7f005002d020 2023-10-05T21:15:19.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.147+0000 7f005b277700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a19f0 con 0x55ebef568f60 2023-10-05T21:15:19.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.148+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.148+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a19f0 con 0x7f004c007030 2023-10-05T21:15:19.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.148+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f005400a570 con 0x7f004c007030 2023-10-05T21:15:19.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.148+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a19f0 con 0x55ebef59cfc0 2023-10-05T21:15:19.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.148+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0050014070 con 0x55ebef59cfc0 2023-10-05T21:15:19.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.148+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a19f0 con 0x7f004c007030 2023-10-05T21:15:19.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.148+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f005400a570 con 0x7f004c007030 2023-10-05T21:15:19.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.148+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a19f0 con 0x7f005002d020 2023-10-05T21:15:19.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.149+0000 7f005b277700 1 -- 172.21.15.153:0/1863832662 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f004c019040 con 0x7f005002d020 2023-10-05T21:15:19.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.149+0000 7f005b277700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a19f0 con 0x55ebef59cfc0 2023-10-05T21:15:19.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.149+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0050014070 con 0x55ebef59cfc0 2023-10-05T21:15:19.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.149+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a19f0 con 0x7f004c007030 2023-10-05T21:15:19.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.149+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f005400a570 con 0x7f004c007030 2023-10-05T21:15:19.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.149+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a19f0 con 0x55ebef568f60 2023-10-05T21:15:19.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.149+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.149+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a19f0 con 0x7f005002d020 2023-10-05T21:15:19.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.150+0000 7f005b277700 1 -- 172.21.15.153:0/1863832662 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f004c019040 con 0x7f005002d020 2023-10-05T21:15:19.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.150+0000 7f00689a0680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:19.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.150+0000 7f00689a0680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:19.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.150+0000 7f00689a0680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:19.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.150+0000 7f00689a0680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:19.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.150+0000 7f00689a0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.150+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a2150 con 0x55ebef568f60 2023-10-05T21:15:19.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.150+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.150+0000 7f00689a0680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.150+0000 7f00689a0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.150+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a2550 con 0x55ebef59cfc0 2023-10-05T21:15:19.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.150+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f0050014070 con 0x55ebef59cfc0 2023-10-05T21:15:19.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.150+0000 7f00689a0680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:19.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.150+0000 7f00689a0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.150+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a2e40 con 0x55ebef568f60 2023-10-05T21:15:19.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.150+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.150+0000 7f00689a0680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.150+0000 7f00689a0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.150+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a00e0 con 0x55ebef568f60 2023-10-05T21:15:19.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.151+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.151+0000 7f00689a0680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:19.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.151+0000 7f00689a0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.151+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a2e40 con 0x7f004c007030 2023-10-05T21:15:19.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.151+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f005400a570 con 0x7f004c007030 2023-10-05T21:15:19.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.151+0000 7f00689a0680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.151+0000 7f00689a0680 20 zone default found 2023-10-05T21:15:19.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.151+0000 7f00689a0680 4 Realm: () 2023-10-05T21:15:19.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.151+0000 7f00689a0680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:19.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.151+0000 7f00689a0680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:19.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.151+0000 7f00689a0680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:19.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.151+0000 7f00689a0680 20 zonegroup default 2023-10-05T21:15:19.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.151+0000 7f00689a0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.151+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a2e40 con 0x7f004c007030 2023-10-05T21:15:19.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.151+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f005400a570 con 0x7f004c007030 2023-10-05T21:15:19.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.151+0000 7f00689a0680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.151+0000 7f00689a0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.151+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a2e40 con 0x55ebef59cfc0 2023-10-05T21:15:19.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.151+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0050014070 con 0x55ebef59cfc0 2023-10-05T21:15:19.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.151+0000 7f00689a0680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.151+0000 7f00689a0680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.151+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a4c70 con 0x55ebef59cfc0 2023-10-05T21:15:19.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.152+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0050014070 con 0x55ebef59cfc0 2023-10-05T21:15:19.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.152+0000 7f00689a0680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.152+0000 7f00689a0680 20 started sync module instance, tier type = 2023-10-05T21:15:19.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.152+0000 7f00689a0680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:19.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.152+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a4330 con 0x7f005002d020 2023-10-05T21:15:19.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.152+0000 7f005b277700 1 -- 172.21.15.153:0/1863832662 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f004c019040 con 0x7f005002d020 2023-10-05T21:15:19.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.152+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94471821346528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a5510 con 0x7f005002d020 2023-10-05T21:15:19.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.153+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a5db0 con 0x55ebef568f60 2023-10-05T21:15:19.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.153+0000 7f005b277700 1 -- 172.21.15.153:0/1863832662 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94471821346528] v29'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f004c019040 con 0x7f005002d020 2023-10-05T21:15:19.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.153+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.153+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94471821348896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a5db0 con 0x55ebef568f60 2023-10-05T21:15:19.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.153+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a6910 con 0x55ebef59cfc0 2023-10-05T21:15:19.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.154+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94471821348896] v29'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.154+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0050014070 con 0x55ebef59cfc0 2023-10-05T21:15:19.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.154+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94471821351104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a5d10 con 0x55ebef59cfc0 2023-10-05T21:15:19.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.154+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a76f0 con 0x7f005002d020 2023-10-05T21:15:19.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.155+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94471821351104] v29'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0050014070 con 0x55ebef59cfc0 2023-10-05T21:15:19.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.155+0000 7f005b277700 1 -- 172.21.15.153:0/1863832662 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f004c019040 con 0x7f005002d020 2023-10-05T21:15:19.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.155+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94471821356656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a7fe0 con 0x7f005002d020 2023-10-05T21:15:19.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.155+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a8880 con 0x55ebef568f60 2023-10-05T21:15:19.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.156+0000 7f005b277700 1 -- 172.21.15.153:0/1863832662 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94471821356656] v29'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f004c019040 con 0x7f005002d020 2023-10-05T21:15:19.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.156+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.156+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94471821362064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a87e0 con 0x55ebef568f60 2023-10-05T21:15:19.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.156+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a97d0 con 0x7f004c007030 2023-10-05T21:15:19.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.156+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94471821362064] v29'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.157+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f005400a570 con 0x7f004c007030 2023-10-05T21:15:19.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.157+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94471821364272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a97d0 con 0x7f004c007030 2023-10-05T21:15:19.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.157+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5aa1e0 con 0x7f004c007030 2023-10-05T21:15:19.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.157+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94471821364272] v29'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f005400a570 con 0x7f004c007030 2023-10-05T21:15:19.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.157+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f005400a570 con 0x7f004c007030 2023-10-05T21:15:19.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.157+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94471821366544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5aa1e0 con 0x7f004c007030 2023-10-05T21:15:19.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.157+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5aabf0 con 0x7f004c007030 2023-10-05T21:15:19.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.158+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(98 notify.7 [create] v29'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f005400a570 con 0x7f004c007030 2023-10-05T21:15:19.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.158+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94471821371136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5ab080 con 0x7f004c007030 2023-10-05T21:15:19.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.158+0000 7f00689a0680 20 add_watcher() i=0 2023-10-05T21:15:19.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.158+0000 7f00689a0680 20 add_watcher() i=1 2023-10-05T21:15:19.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.158+0000 7f00689a0680 20 add_watcher() i=2 2023-10-05T21:15:19.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.158+0000 7f00689a0680 20 add_watcher() i=3 2023-10-05T21:15:19.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.158+0000 7f00689a0680 20 add_watcher() i=4 2023-10-05T21:15:19.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.158+0000 7f00689a0680 20 add_watcher() i=5 2023-10-05T21:15:19.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.158+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(97 notify.6 [watch watch cookie 94471821366544] v29'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f005400a570 con 0x7f004c007030 2023-10-05T21:15:19.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.158+0000 7f00689a0680 20 add_watcher() i=6 2023-10-05T21:15:19.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.159+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94471821371136] v29'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f005400a570 con 0x7f004c007030 2023-10-05T21:15:19.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.159+0000 7f00689a0680 20 add_watcher() i=7 2023-10-05T21:15:19.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.159+0000 7f00689a0680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:19.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.159+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a9cf0 con 0x55ebef568f60 2023-10-05T21:15:19.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.159+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.159+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94471821372240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a9cf0 con 0x55ebef568f60 2023-10-05T21:15:19.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.160+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94471821372240] v29'150 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.160+0000 7f002d7e2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:19.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.160+0000 7f00689a0680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:19.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.160+0000 7f00689a0680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:19.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.160+0000 7f00689a0680 1 Processor -- start 2023-10-05T21:15:19.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.160+0000 7f00689a0680 1 -- start start 2023-10-05T21:15:19.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.160+0000 7f00689a0680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef5b7c40 0x55ebef5b8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.160+0000 7f00689a0680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebef5b8660 con 0x55ebef5b7c40 2023-10-05T21:15:19.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.161+0000 7f005b277700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef5b7c40 0x55ebef5b8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.161+0000 7f005b277700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef5b7c40 0x55ebef5b8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38098/0 (socket says 172.21.15.153:38098) 2023-10-05T21:15:19.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.161+0000 7f005b277700 1 -- 172.21.15.153:0/3386422411 learned_addr learned my addr 172.21.15.153:0/3386422411 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.161+0000 7f005b277700 1 -- 172.21.15.153:0/3386422411 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ebef5b8b40 con 0x55ebef5b7c40 2023-10-05T21:15:19.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.161+0000 7f005b277700 1 --2- 172.21.15.153:0/3386422411 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef5b7c40 0x55ebef5b8050 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x55ebef565700 tx=0x7f004c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb3a5020f5e68b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.161+0000 7f002cfe1700 1 -- 172.21.15.153:0/3386422411 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f004c01ddc0 con 0x55ebef5b7c40 2023-10-05T21:15:19.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.161+0000 7f002cfe1700 1 -- 172.21.15.153:0/3386422411 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c02b440 con 0x55ebef5b7c40 2023-10-05T21:15:19.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.161+0000 7f002cfe1700 1 -- 172.21.15.153:0/3386422411 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f004c02b5f0 con 0x55ebef5b7c40 2023-10-05T21:15:19.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.162+0000 7f00689a0680 1 -- 172.21.15.153:0/3386422411 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef5b7c40 msgr2=0x55ebef5b8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.162+0000 7f00689a0680 1 --2- 172.21.15.153:0/3386422411 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef5b7c40 0x55ebef5b8050 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x55ebef565700 tx=0x7f004c012000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.162+0000 7f00689a0680 1 -- 172.21.15.153:0/3386422411 shutdown_connections 2023-10-05T21:15:19.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.162+0000 7f00689a0680 1 --2- 172.21.15.153:0/3386422411 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef5b7c40 0x55ebef5b8050 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.162+0000 7f00689a0680 1 -- 172.21.15.153:0/3386422411 >> 172.21.15.153:0/3386422411 conn(0x55ebef5b3f40 msgr2=0x55ebef5b2040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.162+0000 7f00689a0680 1 -- 172.21.15.153:0/3386422411 shutdown_connections 2023-10-05T21:15:19.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.162+0000 7f00689a0680 1 -- 172.21.15.153:0/3386422411 wait complete. 2023-10-05T21:15:19.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.162+0000 7f00689a0680 1 Processor -- start 2023-10-05T21:15:19.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.162+0000 7f00689a0680 1 -- start start 2023-10-05T21:15:19.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.163+0000 7f00689a0680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef5b7c40 0x55ebef5be970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.163+0000 7f00689a0680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebef5beeb0 con 0x55ebef5b7c40 2023-10-05T21:15:19.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.163+0000 7f005b277700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef5b7c40 0x55ebef5be970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.163+0000 7f005b277700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef5b7c40 0x55ebef5be970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38108/0 (socket says 172.21.15.153:38108) 2023-10-05T21:15:19.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.163+0000 7f005b277700 1 -- 172.21.15.153:0/3619197716 learned_addr learned my addr 172.21.15.153:0/3619197716 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.163+0000 7f005b277700 1 -- 172.21.15.153:0/3619197716 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ebef56c890 con 0x55ebef5b7c40 2023-10-05T21:15:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.163+0000 7f005b277700 1 --2- 172.21.15.153:0/3619197716 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef5b7c40 0x55ebef5be970 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x55ebef5b34b0 tx=0x7f004c030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.163+0000 7effa6ffd700 1 -- 172.21.15.153:0/3619197716 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f004c03f500 con 0x55ebef5b7c40 2023-10-05T21:15:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.163+0000 7effa6ffd700 1 -- 172.21.15.153:0/3619197716 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c03f660 con 0x55ebef5b7c40 2023-10-05T21:15:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.163+0000 7f00689a0680 1 -- 172.21.15.153:0/3619197716 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ebef5bf0b0 con 0x55ebef5b7c40 2023-10-05T21:15:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.163+0000 7effa6ffd700 1 -- 172.21.15.153:0/3619197716 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f004c03f810 con 0x55ebef5b7c40 2023-10-05T21:15:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.163+0000 7f00689a0680 1 -- 172.21.15.153:0/3619197716 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ebef5bf500 con 0x55ebef5b7c40 2023-10-05T21:15:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.164+0000 7effa6ffd700 1 -- 172.21.15.153:0/3619197716 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f004c047070 con 0x55ebef5b7c40 2023-10-05T21:15:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.164+0000 7effa6ffd700 1 --2- 172.21.15.153:0/3619197716 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7eff9c034190 0x7eff9c036640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.164+0000 7effa6ffd700 1 -- 172.21.15.153:0/3619197716 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f004c030070 con 0x55ebef5b7c40 2023-10-05T21:15:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.164+0000 7f005c279700 1 --2- 172.21.15.153:0/3619197716 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7eff9c034190 0x7eff9c036640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.164+0000 7f00689a0680 5 note: GC not initialized 2023-10-05T21:15:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.165+0000 7f005c279700 1 --2- 172.21.15.153:0/3619197716 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7eff9c034190 0x7eff9c036640 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x55ebef5a9990 tx=0x7f0054037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.165+0000 7eff9bfff700 20 reqs_thread_entry: start 2023-10-05T21:15:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.165+0000 7eff99ffb700 20 reqs_thread_entry: start 2023-10-05T21:15:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.165+0000 7f00689a0680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.166+0000 7f00689a0680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.166+0000 7eff87fff700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:49 2023 2023-10-05T21:15:19.197 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.166+0000 7eff877fe700 20 reqs_thread_entry: start 2023-10-05T21:15:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.166+0000 7f00689a0680 1 --2- 172.21.15.153:0/3619197716 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55ebef6232e0 0x55ebef6256c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.166+0000 7f00689a0680 1 -- 172.21.15.153:0/3619197716 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:1 6.a 6:577d78d5:::2023-10-05-21--:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef625c00 con 0x55ebef6232e0 2023-10-05T21:15:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.166+0000 7f005ba78700 1 --2- 172.21.15.153:0/3619197716 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55ebef6232e0 0x55ebef6256c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.166+0000 7f005ba78700 1 --2- 172.21.15.153:0/3619197716 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55ebef6232e0 0x55ebef6256c0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.167+0000 7f005ba78700 1 -- 172.21.15.153:0/3619197716 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(1 2023-10-05-21-- [delete] v29'33 uv33 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f0050014070 con 0x55ebef6232e0 2023-10-05T21:15:19.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.167+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94471821346528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5e29e0 con 0x7f005002d020 2023-10-05T21:15:19.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.168+0000 7f005b277700 1 -- 172.21.15.153:0/1863832662 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(102 notify.0 [watch unwatch cookie 94471821346528] v29'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f004c04f070 con 0x7f005002d020 2023-10-05T21:15:19.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.168+0000 7f00689a0680 20 remove_watcher() i=0 2023-10-05T21:15:19.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.168+0000 7f00689a0680 2 removed watcher, disabling cache 2023-10-05T21:15:19.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.168+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94471821348896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a46e0 con 0x55ebef568f60 2023-10-05T21:15:19.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.169+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(103 notify.1 [watch unwatch cookie 94471821348896] v29'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.169+0000 7f00689a0680 20 remove_watcher() i=1 2023-10-05T21:15:19.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.169+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:104 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94471821351104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a46e0 con 0x55ebef59cfc0 2023-10-05T21:15:19.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.170+0000 7f005ba78700 1 -- 172.21.15.153:0/1863832662 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(104 notify.2 [watch unwatch cookie 94471821351104] v29'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0050014070 con 0x55ebef59cfc0 2023-10-05T21:15:19.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.170+0000 7f00689a0680 20 remove_watcher() i=2 2023-10-05T21:15:19.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.170+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94471821356656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a46e0 con 0x7f005002d020 2023-10-05T21:15:19.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.170+0000 7f005b277700 1 -- 172.21.15.153:0/1863832662 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(105 notify.3 [watch unwatch cookie 94471821356656] v29'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f004c04f070 con 0x7f005002d020 2023-10-05T21:15:19.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.170+0000 7f00689a0680 20 remove_watcher() i=3 2023-10-05T21:15:19.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.171+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94471821362064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a6e70 con 0x55ebef568f60 2023-10-05T21:15:19.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.171+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(106 notify.4 [watch unwatch cookie 94471821362064] v29'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.171+0000 7f00689a0680 20 remove_watcher() i=4 2023-10-05T21:15:19.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.171+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:107 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94471821364272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a46e0 con 0x7f004c007030 2023-10-05T21:15:19.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.172+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(107 notify.5 [watch unwatch cookie 94471821364272] v29'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f005400a570 con 0x7f004c007030 2023-10-05T21:15:19.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.172+0000 7f00689a0680 20 remove_watcher() i=5 2023-10-05T21:15:19.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.172+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94471821366544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a8390 con 0x7f004c007030 2023-10-05T21:15:19.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.173+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(108 notify.6 [watch unwatch cookie 94471821366544] v29'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f005400a570 con 0x7f004c007030 2023-10-05T21:15:19.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.173+0000 7f00689a0680 20 remove_watcher() i=6 2023-10-05T21:15:19.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.173+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94471821371136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a8390 con 0x7f004c007030 2023-10-05T21:15:19.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.173+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(109 notify.7 [watch unwatch cookie 94471821371136] v29'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f005400a570 con 0x7f004c007030 2023-10-05T21:15:19.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.173+0000 7f00689a0680 20 remove_watcher() i=7 2023-10-05T21:15:19.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.174+0000 7f002d7e2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:19.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.174+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:110 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94471821372240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ebef5a8390 con 0x55ebef568f60 2023-10-05T21:15:19.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.175+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(110 data_loggenerations_metadata [watch unwatch cookie 94471821372240] v29'151 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f005400a570 con 0x55ebef568f60 2023-10-05T21:15:19.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.175+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f004c007030 msgr2=0x7f004c01d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.175+0000 7f00689a0680 1 --2- 172.21.15.153:0/1863832662 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f004c007030 0x7f004c01d420 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.175+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ebef568f60 msgr2=0x55ebef59ab50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.175+0000 7f00689a0680 1 --2- 172.21.15.153:0/1863832662 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ebef568f60 0x55ebef59ab50 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.175+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f005002d020 msgr2=0x7f005002c5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.175+0000 7f00689a0680 1 --2- 172.21.15.153:0/1863832662 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f005002d020 0x7f005002c5d0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.175+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ebef59cfc0 msgr2=0x55ebef59f3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.175+0000 7f00689a0680 1 --2- 172.21.15.153:0/1863832662 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ebef59cfc0 0x55ebef59f3a0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.175+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0048034140 msgr2=0x7f00480365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.175+0000 7f00689a0680 1 --2- 172.21.15.153:0/1863832662 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0048034140 0x7f00480365f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f004c003080 tx=0x7f004c015000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.175+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef564a30 msgr2=0x55ebef585d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.175+0000 7f00689a0680 1 --2- 172.21.15.153:0/1863832662 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef564a30 0x55ebef585d90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f00500017d0 tx=0x7f0050016000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.175+0000 7f005c279700 1 -- 172.21.15.153:0/1863832662 reap_dead start 2023-10-05T21:15:19.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.175+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 shutdown_connections 2023-10-05T21:15:19.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.175+0000 7f00689a0680 1 --2- 172.21.15.153:0/1863832662 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef564a30 0x55ebef585d90 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.175+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 >> 172.21.15.153:0/1863832662 conn(0x55ebef560300 msgr2=0x55ebef57fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.175+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 shutdown_connections 2023-10-05T21:15:19.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.175+0000 7f00689a0680 1 -- 172.21.15.153:0/1863832662 wait complete. 2023-10-05T21:15:19.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.176+0000 7f00689a0680 1 -- 172.21.15.153:0/3619197716 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55ebef6232e0 msgr2=0x55ebef6256c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.176+0000 7f00689a0680 1 --2- 172.21.15.153:0/3619197716 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55ebef6232e0 0x55ebef6256c0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.176+0000 7f00689a0680 1 -- 172.21.15.153:0/3619197716 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7eff9c034190 msgr2=0x7eff9c036640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.176+0000 7f00689a0680 1 --2- 172.21.15.153:0/3619197716 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7eff9c034190 0x7eff9c036640 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x55ebef5a9990 tx=0x7f0054037450 comp rx=0 tx=0).stop 2023-10-05T21:15:19.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.176+0000 7f00689a0680 1 -- 172.21.15.153:0/3619197716 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef5b7c40 msgr2=0x55ebef5be970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.176+0000 7f00689a0680 1 --2- 172.21.15.153:0/3619197716 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef5b7c40 0x55ebef5be970 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x55ebef5b34b0 tx=0x7f004c030000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.176+0000 7f00689a0680 1 -- 172.21.15.153:0/3619197716 shutdown_connections 2023-10-05T21:15:19.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.176+0000 7f00689a0680 1 --2- 172.21.15.153:0/3619197716 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55ebef6232e0 0x55ebef6256c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.176+0000 7f00689a0680 1 --2- 172.21.15.153:0/3619197716 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ebef5b7c40 0x55ebef5be970 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.176+0000 7f00689a0680 1 --2- 172.21.15.153:0/3619197716 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7eff9c034190 0x7eff9c036640 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.176+0000 7f00689a0680 1 -- 172.21.15.153:0/3619197716 >> 172.21.15.153:0/3619197716 conn(0x55ebef5b3f40 msgr2=0x55ebef5b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.176+0000 7f00689a0680 1 -- 172.21.15.153:0/3619197716 shutdown_connections 2023-10-05T21:15:19.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.176+0000 7f00689a0680 1 -- 172.21.15.153:0/3619197716 wait complete. 2023-10-05T21:15:19.203 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'show', '--object', '2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.4-myfoo4'] 2023-10-05T21:15:19.203 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'show', '--object', '2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.4-myfoo4'] 2023-10-05T21:15:19.203 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log show --object 2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.4-myfoo4 2023-10-05T21:15:19.249 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:19.249 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:19.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.246+0000 7f178fb8e680 1 Processor -- start 2023-10-05T21:15:19.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.246+0000 7f178fb8e680 1 -- start start 2023-10-05T21:15:19.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.246+0000 7f178fb8e680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55ed90a6c7b0 0x55ed90a6cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.246+0000 7f178fb8e680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ed909bb990 con 0x55ed90a6d100 2023-10-05T21:15:19.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.246+0000 7f178fb8e680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ed9097bdb0 con 0x55ed90a6c7b0 2023-10-05T21:15:19.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.246+0000 7f1782c66700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55ed90a6c7b0 0x55ed90a6cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.246+0000 7f1782465700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55ed90a6d100 0x55ed90a6f9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:55278/0 (socket says 172.21.15.153:55278) 2023-10-05T21:15:19.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.246+0000 7f1782465700 1 -- 172.21.15.153:0/3489254023 learned_addr learned my addr 172.21.15.153:0/3489254023 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:19.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.246+0000 7f1782c66700 1 -- 172.21.15.153:0/3489254023 >> v1:172.21.15.111:6789/0 conn(0x55ed90a6d100 legacy=0x55ed90a6f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.246+0000 7f1781c64700 1 -- 172.21.15.153:0/3489254023 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3440141490 0 0) 0x55ed909bb990 con 0x55ed90a6d100 2023-10-05T21:15:19.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.246+0000 7f1782c66700 1 -- 172.21.15.153:0/3489254023 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed90a701b0 con 0x55ed90a6c7b0 2023-10-05T21:15:19.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.247+0000 7f1782c66700 1 --2- 172.21.15.153:0/3489254023 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6c7b0 0x55ed90a6cbc0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f177800a5d0 tx=0x7f1778005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47845ef5e8dca511 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.247+0000 7f1781c64700 1 -- 172.21.15.153:0/3489254023 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f17780086a0 con 0x55ed90a6c7b0 2023-10-05T21:15:19.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.247+0000 7f1781c64700 1 -- 172.21.15.153:0/3489254023 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1778008800 con 0x55ed90a6c7b0 2023-10-05T21:15:19.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.247+0000 7f1781c64700 1 -- 172.21.15.153:0/3489254023 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1778008ad0 con 0x55ed90a6c7b0 2023-10-05T21:15:19.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.247+0000 7f178fb8e680 1 -- 172.21.15.153:0/3489254023 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6c7b0 msgr2=0x55ed90a6cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.247+0000 7f178fb8e680 1 --2- 172.21.15.153:0/3489254023 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6c7b0 0x55ed90a6cbc0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f177800a5d0 tx=0x7f1778005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:19.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.247+0000 7f178fb8e680 1 -- 172.21.15.153:0/3489254023 shutdown_connections 2023-10-05T21:15:19.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.247+0000 7f178fb8e680 1 --2- 172.21.15.153:0/3489254023 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6c7b0 0x55ed90a6cbc0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.247+0000 7f178fb8e680 1 -- 172.21.15.153:0/3489254023 >> 172.21.15.153:0/3489254023 conn(0x55ed90a68300 msgr2=0x55ed90a6a710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.247+0000 7f178fb8e680 1 -- 172.21.15.153:0/3489254023 shutdown_connections 2023-10-05T21:15:19.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.247+0000 7f178fb8e680 1 -- 172.21.15.153:0/3489254023 wait complete. 2023-10-05T21:15:19.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.248+0000 7f178fb8e680 1 Processor -- start 2023-10-05T21:15:19.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.248+0000 7f178fb8e680 1 -- start start 2023-10-05T21:15:19.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.248+0000 7f178fb8e680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6c7b0 0x55ed90a8d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.248+0000 7f178fb8e680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed9091bea0 con 0x55ed90a6c7b0 2023-10-05T21:15:19.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.248+0000 7f1782c66700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6c7b0 0x55ed90a8d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.248+0000 7f1782c66700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6c7b0 0x55ed90a8d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38122/0 (socket says 172.21.15.153:38122) 2023-10-05T21:15:19.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.248+0000 7f1782c66700 1 -- 172.21.15.153:0/4203854579 learned_addr learned my addr 172.21.15.153:0/4203854579 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.249+0000 7f1782c66700 1 -- 172.21.15.153:0/4203854579 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1778005cf0 con 0x55ed90a6c7b0 2023-10-05T21:15:19.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.249+0000 7f1782c66700 1 --2- 172.21.15.153:0/4203854579 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6c7b0 0x55ed90a8d9b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1778000c00 tx=0x7f1778015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d111da3f91dafbcc server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.249+0000 7f1780c62700 1 -- 172.21.15.153:0/4203854579 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f17780086a0 con 0x55ed90a6c7b0 2023-10-05T21:15:19.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.249+0000 7f1780c62700 1 -- 172.21.15.153:0/4203854579 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1778008970 con 0x55ed90a6c7b0 2023-10-05T21:15:19.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.249+0000 7f1780c62700 1 -- 172.21.15.153:0/4203854579 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1778008b20 con 0x55ed90a6c7b0 2023-10-05T21:15:19.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.249+0000 7f178fb8e680 1 -- 172.21.15.153:0/4203854579 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6c7b0 msgr2=0x55ed90a8d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.249+0000 7f178fb8e680 1 --2- 172.21.15.153:0/4203854579 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6c7b0 0x55ed90a8d9b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1778000c00 tx=0x7f1778015000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.249+0000 7f178fb8e680 1 -- 172.21.15.153:0/4203854579 shutdown_connections 2023-10-05T21:15:19.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.249+0000 7f178fb8e680 1 --2- 172.21.15.153:0/4203854579 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6c7b0 0x55ed90a8d9b0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.249+0000 7f178fb8e680 1 -- 172.21.15.153:0/4203854579 >> 172.21.15.153:0/4203854579 conn(0x55ed90a68300 msgr2=0x55ed90a89480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.249+0000 7f178fb8e680 1 -- 172.21.15.153:0/4203854579 shutdown_connections 2023-10-05T21:15:19.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.249+0000 7f178fb8e680 1 -- 172.21.15.153:0/4203854579 wait complete. 2023-10-05T21:15:19.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.250+0000 7f178fb8e680 1 Processor -- start 2023-10-05T21:15:19.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.250+0000 7f178fb8e680 1 -- start start 2023-10-05T21:15:19.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.250+0000 7f178fb8e680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6c7b0 0x55ed90a94d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.250+0000 7f178fb8e680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed90912c80 con 0x55ed90a6c7b0 2023-10-05T21:15:19.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.250+0000 7f1782c66700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6c7b0 0x55ed90a94d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.250+0000 7f1782c66700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6c7b0 0x55ed90a94d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38132/0 (socket says 172.21.15.153:38132) 2023-10-05T21:15:19.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.250+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 learned_addr learned my addr 172.21.15.153:0/772116576 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.250+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed90a701b0 con 0x55ed90a6c7b0 2023-10-05T21:15:19.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.251+0000 7f1782c66700 1 --2- 172.21.15.153:0/772116576 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6c7b0 0x55ed90a94d70 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f177801f040 tx=0x7f177801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.251+0000 7f1772ffd700 1 -- 172.21.15.153:0/772116576 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f177801d420 con 0x55ed90a6c7b0 2023-10-05T21:15:19.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.251+0000 7f1772ffd700 1 -- 172.21.15.153:0/772116576 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177801d580 con 0x55ed90a6c7b0 2023-10-05T21:15:19.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.251+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ed90a952b0 con 0x55ed90a6c7b0 2023-10-05T21:15:19.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.251+0000 7f1772ffd700 1 -- 172.21.15.153:0/772116576 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f177801d6f0 con 0x55ed90a6c7b0 2023-10-05T21:15:19.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.251+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ed90a956a0 con 0x55ed90a6c7b0 2023-10-05T21:15:19.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.251+0000 7f178fb8e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.252+0000 7f1772ffd700 1 -- 172.21.15.153:0/772116576 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f177801d850 con 0x55ed90a6c7b0 2023-10-05T21:15:19.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.252+0000 7f1772ffd700 1 --2- 172.21.15.153:0/772116576 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1768034140 0x7f17680365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.252+0000 7f1772ffd700 1 -- 172.21.15.153:0/772116576 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f177804a180 con 0x55ed90a6c7b0 2023-10-05T21:15:19.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.252+0000 7f1782465700 1 --2- 172.21.15.153:0/772116576 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1768034140 0x7f17680365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.252+0000 7f178fb8e680 1 --2- 172.21.15.153:0/772116576 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ed90a6d100 0x55ed90aa0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.252+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa12e0 con 0x55ed90a6d100 2023-10-05T21:15:19.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.252+0000 7f1783467700 1 --2- 172.21.15.153:0/772116576 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ed90a6d100 0x55ed90aa0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.252+0000 7f1782465700 1 --2- 172.21.15.153:0/772116576 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1768034140 0x7f17680365f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f17740011e0 tx=0x7f1774001340 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.252+0000 7f1783467700 1 --2- 172.21.15.153:0/772116576 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ed90a6d100 0x55ed90aa0b50 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.253+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.253+0000 7f178fb8e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.253+0000 7f178fb8e680 20 realm 2023-10-05T21:15:19.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.253+0000 7f178fb8e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.253+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90a9e070 con 0x55ed90a6d100 2023-10-05T21:15:19.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.253+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.253+0000 7f178fb8e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.253+0000 7f178fb8e680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:19.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.253+0000 7f178fb8e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.253+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa1d90 con 0x55ed90a6d100 2023-10-05T21:15:19.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.253+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.253+0000 7f178fb8e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.253+0000 7f178fb8e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.253+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa19c0 con 0x55ed90a6d100 2023-10-05T21:15:19.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.253+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.253+0000 7f178fb8e680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.253+0000 7f178fb8e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.253+0000 7f178fb8e680 1 --2- 172.21.15.153:0/772116576 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ed90aa3100 0x55ed90aa54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.253+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa5a20 con 0x55ed90aa3100 2023-10-05T21:15:19.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.254+0000 7f1782c66700 1 --2- 172.21.15.153:0/772116576 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ed90aa3100 0x55ed90aa54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.254+0000 7f1782c66700 1 --2- 172.21.15.153:0/772116576 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ed90aa3100 0x55ed90aa54e0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.254+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f1778036070 con 0x55ed90aa3100 2023-10-05T21:15:19.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.254+0000 7f178fb8e680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:19.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.254+0000 7f178fb8e680 20 searching for the correct realm 2023-10-05T21:15:19.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.254+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x55ed90aa3100 2023-10-05T21:15:19.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.254+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1778036070 con 0x55ed90aa3100 2023-10-05T21:15:19.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.254+0000 7f1782c66700 1 --2- 172.21.15.153:0/772116576 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f1778030020 0x7f17780065d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.254+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x7f1778030020 2023-10-05T21:15:19.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.255+0000 7f1782465700 1 --2- 172.21.15.153:0/772116576 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f1778030020 0x7f17780065d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.255+0000 7f1782465700 1 --2- 172.21.15.153:0/772116576 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f1778030020 0x7f17780065d0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.255+0000 7f1782465700 1 -- 172.21.15.153:0/772116576 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1774006070 con 0x7f1778030020 2023-10-05T21:15:19.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.255+0000 7f1782465700 1 --2- 172.21.15.153:0/772116576 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f177400d8e0 0x7f177400c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.255+0000 7f1782465700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x7f177400d8e0 2023-10-05T21:15:19.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.255+0000 7f1783467700 1 --2- 172.21.15.153:0/772116576 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f177400d8e0 0x7f177400c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.256+0000 7f1783467700 1 --2- 172.21.15.153:0/772116576 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f177400d8e0 0x7f177400c360 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.256+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f177c00a570 con 0x7f177400d8e0 2023-10-05T21:15:19.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.256+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x55ed90a6d100 2023-10-05T21:15:19.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.256+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.256+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x55ed90a6d100 2023-10-05T21:15:19.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.256+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.256+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x7f177400d8e0 2023-10-05T21:15:19.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.256+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f177c00a570 con 0x7f177400d8e0 2023-10-05T21:15:19.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.256+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x7f177400d8e0 2023-10-05T21:15:19.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.257+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f177c00a570 con 0x7f177400d8e0 2023-10-05T21:15:19.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.257+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x7f1778030020 2023-10-05T21:15:19.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.257+0000 7f1782465700 1 -- 172.21.15.153:0/772116576 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1774006070 con 0x7f1778030020 2023-10-05T21:15:19.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.257+0000 7f1782465700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x55ed90aa3100 2023-10-05T21:15:19.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.257+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1778036070 con 0x55ed90aa3100 2023-10-05T21:15:19.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.257+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x55ed90a6d100 2023-10-05T21:15:19.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.257+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.257+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x7f177400d8e0 2023-10-05T21:15:19.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.258+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f177c00a570 con 0x7f177400d8e0 2023-10-05T21:15:19.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.258+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x55ed90a6d100 2023-10-05T21:15:19.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.258+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.258+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x7f1778030020 2023-10-05T21:15:19.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.258+0000 7f1782465700 1 -- 172.21.15.153:0/772116576 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1774006070 con 0x7f1778030020 2023-10-05T21:15:19.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.258+0000 7f1782465700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x55ed90aa3100 2023-10-05T21:15:19.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.258+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1778036070 con 0x55ed90aa3100 2023-10-05T21:15:19.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.258+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x55ed90aa3100 2023-10-05T21:15:19.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.258+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1778036070 con 0x55ed90aa3100 2023-10-05T21:15:19.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.258+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x7f177400d8e0 2023-10-05T21:15:19.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.259+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f177c00a570 con 0x7f177400d8e0 2023-10-05T21:15:19.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.259+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x55ed90aa3100 2023-10-05T21:15:19.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.259+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1778036070 con 0x55ed90aa3100 2023-10-05T21:15:19.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.259+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x55ed90aa3100 2023-10-05T21:15:19.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.259+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1778036070 con 0x55ed90aa3100 2023-10-05T21:15:19.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.259+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x55ed90a6d100 2023-10-05T21:15:19.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.260+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.260+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x55ed90a6d100 2023-10-05T21:15:19.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.260+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.260+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x7f177400d8e0 2023-10-05T21:15:19.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.260+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f177c00a570 con 0x7f177400d8e0 2023-10-05T21:15:19.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.260+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x55ed90aa3100 2023-10-05T21:15:19.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.260+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1778036070 con 0x55ed90aa3100 2023-10-05T21:15:19.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.260+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x7f1778030020 2023-10-05T21:15:19.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.260+0000 7f1782465700 1 -- 172.21.15.153:0/772116576 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1774006070 con 0x7f1778030020 2023-10-05T21:15:19.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.260+0000 7f1782465700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x55ed90a6d100 2023-10-05T21:15:19.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.261+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.261+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x7f177400d8e0 2023-10-05T21:15:19.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.261+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f177c00a570 con 0x7f177400d8e0 2023-10-05T21:15:19.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.261+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x55ed90aa3100 2023-10-05T21:15:19.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.261+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1778036070 con 0x55ed90aa3100 2023-10-05T21:15:19.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.261+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x7f177400d8e0 2023-10-05T21:15:19.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.261+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f177c00a570 con 0x7f177400d8e0 2023-10-05T21:15:19.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.261+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x7f1778030020 2023-10-05T21:15:19.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.262+0000 7f1782465700 1 -- 172.21.15.153:0/772116576 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1774006070 con 0x7f1778030020 2023-10-05T21:15:19.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.262+0000 7f1782465700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x55ed90aa3100 2023-10-05T21:15:19.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.262+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1778036070 con 0x55ed90aa3100 2023-10-05T21:15:19.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.262+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x7f177400d8e0 2023-10-05T21:15:19.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.262+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f177c00a570 con 0x7f177400d8e0 2023-10-05T21:15:19.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.262+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x55ed90a6d100 2023-10-05T21:15:19.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.262+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.262+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa72d0 con 0x7f1778030020 2023-10-05T21:15:19.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.263+0000 7f1782465700 1 -- 172.21.15.153:0/772116576 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1774006070 con 0x7f1778030020 2023-10-05T21:15:19.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.263+0000 7f178fb8e680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:19.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.263+0000 7f178fb8e680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:19.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.263+0000 7f178fb8e680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:19.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.263+0000 7f178fb8e680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:19.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.263+0000 7f178fb8e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.263+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa63f0 con 0x55ed90a6d100 2023-10-05T21:15:19.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.263+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.263+0000 7f178fb8e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.263+0000 7f178fb8e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.263+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6880 con 0x55ed90a6d100 2023-10-05T21:15:19.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.263+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.263+0000 7f178fb8e680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.263+0000 7f178fb8e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.263+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6cb0 con 0x55ed90a6d100 2023-10-05T21:15:19.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.263+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.263+0000 7f178fb8e680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:19.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.263+0000 7f178fb8e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.263+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa7680 con 0x55ed90aa3100 2023-10-05T21:15:19.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.263+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f1778036070 con 0x55ed90aa3100 2023-10-05T21:15:19.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.263+0000 7f178fb8e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.263+0000 7f178fb8e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.263+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa7a30 con 0x55ed90a6d100 2023-10-05T21:15:19.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.264+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.264+0000 7f178fb8e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.264+0000 7f178fb8e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.264+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa7e30 con 0x55ed90a6d100 2023-10-05T21:15:19.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.264+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.264+0000 7f178fb8e680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.264+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa8e40 con 0x55ed90aa3100 2023-10-05T21:15:19.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.264+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1778036070 con 0x55ed90aa3100 2023-10-05T21:15:19.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.264+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa8e40 con 0x7f1778030020 2023-10-05T21:15:19.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.264+0000 7f1782465700 1 -- 172.21.15.153:0/772116576 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1774006070 con 0x7f1778030020 2023-10-05T21:15:19.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.264+0000 7f1782465700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa8e40 con 0x7f177400d8e0 2023-10-05T21:15:19.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.265+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f177c00a570 con 0x7f177400d8e0 2023-10-05T21:15:19.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.265+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6cb0 con 0x55ed90a6d100 2023-10-05T21:15:19.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.265+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.265+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6cb0 con 0x55ed90a6d100 2023-10-05T21:15:19.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.265+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.265+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6cb0 con 0x7f177400d8e0 2023-10-05T21:15:19.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.265+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f177c00a570 con 0x7f177400d8e0 2023-10-05T21:15:19.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.265+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6cb0 con 0x7f177400d8e0 2023-10-05T21:15:19.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.266+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f177c00a570 con 0x7f177400d8e0 2023-10-05T21:15:19.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.266+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6cb0 con 0x7f1778030020 2023-10-05T21:15:19.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.266+0000 7f1782465700 1 -- 172.21.15.153:0/772116576 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1774006070 con 0x7f1778030020 2023-10-05T21:15:19.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.266+0000 7f1782465700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6cb0 con 0x55ed90aa3100 2023-10-05T21:15:19.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.266+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1778036070 con 0x55ed90aa3100 2023-10-05T21:15:19.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.266+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6cb0 con 0x55ed90a6d100 2023-10-05T21:15:19.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.266+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.266+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6cb0 con 0x7f177400d8e0 2023-10-05T21:15:19.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.266+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f177c00a570 con 0x7f177400d8e0 2023-10-05T21:15:19.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.266+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6cb0 con 0x55ed90a6d100 2023-10-05T21:15:19.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.267+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.267+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6cb0 con 0x7f1778030020 2023-10-05T21:15:19.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.267+0000 7f1782465700 1 -- 172.21.15.153:0/772116576 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1774006070 con 0x7f1778030020 2023-10-05T21:15:19.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.267+0000 7f1782465700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6cb0 con 0x55ed90aa3100 2023-10-05T21:15:19.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.267+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1778036070 con 0x55ed90aa3100 2023-10-05T21:15:19.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.267+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6cb0 con 0x55ed90aa3100 2023-10-05T21:15:19.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.267+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1778036070 con 0x55ed90aa3100 2023-10-05T21:15:19.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.267+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6cb0 con 0x7f177400d8e0 2023-10-05T21:15:19.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.268+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f177c00a570 con 0x7f177400d8e0 2023-10-05T21:15:19.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.268+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6cb0 con 0x55ed90aa3100 2023-10-05T21:15:19.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.268+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1778036070 con 0x55ed90aa3100 2023-10-05T21:15:19.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.268+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6cb0 con 0x55ed90aa3100 2023-10-05T21:15:19.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.268+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1778036070 con 0x55ed90aa3100 2023-10-05T21:15:19.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.268+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6cb0 con 0x55ed90a6d100 2023-10-05T21:15:19.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.268+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.268+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6cb0 con 0x55ed90a6d100 2023-10-05T21:15:19.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.269+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.269+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6cb0 con 0x7f177400d8e0 2023-10-05T21:15:19.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.269+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f177c00a570 con 0x7f177400d8e0 2023-10-05T21:15:19.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.269+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6cb0 con 0x55ed90aa3100 2023-10-05T21:15:19.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.269+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1778036070 con 0x55ed90aa3100 2023-10-05T21:15:19.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.269+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6cb0 con 0x7f1778030020 2023-10-05T21:15:19.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.269+0000 7f1782465700 1 -- 172.21.15.153:0/772116576 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1774006070 con 0x7f1778030020 2023-10-05T21:15:19.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.269+0000 7f1782465700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6cb0 con 0x55ed90a6d100 2023-10-05T21:15:19.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.270+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.270+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6cb0 con 0x7f177400d8e0 2023-10-05T21:15:19.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.270+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f177c00a570 con 0x7f177400d8e0 2023-10-05T21:15:19.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.270+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6cb0 con 0x55ed90aa3100 2023-10-05T21:15:19.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.270+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1778036070 con 0x55ed90aa3100 2023-10-05T21:15:19.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.270+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6cb0 con 0x7f177400d8e0 2023-10-05T21:15:19.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.270+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f177c00a570 con 0x7f177400d8e0 2023-10-05T21:15:19.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.270+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6cb0 con 0x7f1778030020 2023-10-05T21:15:19.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.271+0000 7f1782465700 1 -- 172.21.15.153:0/772116576 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1774006070 con 0x7f1778030020 2023-10-05T21:15:19.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.271+0000 7f1782465700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6cb0 con 0x55ed90aa3100 2023-10-05T21:15:19.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.271+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1778036070 con 0x55ed90aa3100 2023-10-05T21:15:19.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.271+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6cb0 con 0x7f177400d8e0 2023-10-05T21:15:19.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.271+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f177c00a570 con 0x7f177400d8e0 2023-10-05T21:15:19.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.271+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6cb0 con 0x55ed90a6d100 2023-10-05T21:15:19.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.271+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.271+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6cb0 con 0x7f1778030020 2023-10-05T21:15:19.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.272+0000 7f1782465700 1 -- 172.21.15.153:0/772116576 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1774006070 con 0x7f1778030020 2023-10-05T21:15:19.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.272+0000 7f178fb8e680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:19.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.272+0000 7f178fb8e680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:19.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.272+0000 7f178fb8e680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:19.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.272+0000 7f178fb8e680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:19.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.272+0000 7f178fb8e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.272+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa7e30 con 0x55ed90a6d100 2023-10-05T21:15:19.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.272+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.272+0000 7f178fb8e680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.272+0000 7f178fb8e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.272+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa81e0 con 0x55ed90aa3100 2023-10-05T21:15:19.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.272+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f1778036070 con 0x55ed90aa3100 2023-10-05T21:15:19.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.272+0000 7f178fb8e680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:19.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.272+0000 7f178fb8e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.272+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa6020 con 0x55ed90a6d100 2023-10-05T21:15:19.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.272+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.272+0000 7f178fb8e680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.272+0000 7f178fb8e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.272+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa5ff0 con 0x55ed90a6d100 2023-10-05T21:15:19.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.272+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.272+0000 7f178fb8e680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:19.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.273+0000 7f178fb8e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.273+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa8b00 con 0x7f177400d8e0 2023-10-05T21:15:19.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.273+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f177c00a570 con 0x7f177400d8e0 2023-10-05T21:15:19.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.273+0000 7f178fb8e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.273+0000 7f178fb8e680 20 zone default found 2023-10-05T21:15:19.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.273+0000 7f178fb8e680 4 Realm: () 2023-10-05T21:15:19.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.273+0000 7f178fb8e680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:19.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.273+0000 7f178fb8e680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:19.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.273+0000 7f178fb8e680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:19.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.273+0000 7f178fb8e680 20 zonegroup default 2023-10-05T21:15:19.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.273+0000 7f178fb8e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.273+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa8a80 con 0x7f177400d8e0 2023-10-05T21:15:19.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.273+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f177c00a570 con 0x7f177400d8e0 2023-10-05T21:15:19.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.273+0000 7f178fb8e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.273+0000 7f178fb8e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.273+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aaa400 con 0x55ed90aa3100 2023-10-05T21:15:19.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.273+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1778036070 con 0x55ed90aa3100 2023-10-05T21:15:19.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.273+0000 7f178fb8e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.273+0000 7f178fb8e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.273+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aaa7b0 con 0x55ed90aa3100 2023-10-05T21:15:19.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.274+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1778036070 con 0x55ed90aa3100 2023-10-05T21:15:19.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.274+0000 7f178fb8e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.274+0000 7f178fb8e680 20 started sync module instance, tier type = 2023-10-05T21:15:19.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.274+0000 7f178fb8e680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:19.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.274+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa9ac0 con 0x7f1778030020 2023-10-05T21:15:19.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.274+0000 7f1782465700 1 -- 172.21.15.153:0/772116576 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1774006070 con 0x7f1778030020 2023-10-05T21:15:19.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.274+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94478822710976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aab050 con 0x7f1778030020 2023-10-05T21:15:19.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.274+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aab8f0 con 0x55ed90a6d100 2023-10-05T21:15:19.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.275+0000 7f1782465700 1 -- 172.21.15.153:0/772116576 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94478822710976] v29'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1774006070 con 0x7f1778030020 2023-10-05T21:15:19.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.275+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.275+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94478822714208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aab8f0 con 0x55ed90a6d100 2023-10-05T21:15:19.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.275+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aac4d0 con 0x55ed90aa3100 2023-10-05T21:15:19.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.276+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94478822714208] v29'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.276+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1778036070 con 0x55ed90aa3100 2023-10-05T21:15:19.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.276+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94478822716416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aab850 con 0x55ed90aa3100 2023-10-05T21:15:19.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.276+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aad2a0 con 0x7f1778030020 2023-10-05T21:15:19.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.277+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94478822716416] v29'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1778036070 con 0x55ed90aa3100 2023-10-05T21:15:19.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.277+0000 7f1782465700 1 -- 172.21.15.153:0/772116576 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1774006070 con 0x7f1778030020 2023-10-05T21:15:19.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.277+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94478822721664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aad6a0 con 0x7f1778030020 2023-10-05T21:15:19.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.277+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aae0b0 con 0x55ed90a6d100 2023-10-05T21:15:19.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.278+0000 7f1782465700 1 -- 172.21.15.153:0/772116576 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94478822721664] v29'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1774006070 con 0x7f1778030020 2023-10-05T21:15:19.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.278+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.278+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94478822726592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aae010 con 0x55ed90a6d100 2023-10-05T21:15:19.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.278+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aaeef0 con 0x7f177400d8e0 2023-10-05T21:15:19.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.279+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94478822726592] v29'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.279+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f177c00a570 con 0x7f177400d8e0 2023-10-05T21:15:19.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.279+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94478822728800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aaeeb0 con 0x7f177400d8e0 2023-10-05T21:15:19.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.279+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aaf970 con 0x7f177400d8e0 2023-10-05T21:15:19.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.279+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94478822728800] v29'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f177c00a570 con 0x7f177400d8e0 2023-10-05T21:15:19.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.279+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f177c00a570 con 0x7f177400d8e0 2023-10-05T21:15:19.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.279+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94478822732896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aaf970 con 0x7f177400d8e0 2023-10-05T21:15:19.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.279+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90ab03c0 con 0x7f177400d8e0 2023-10-05T21:15:19.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.280+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(98 notify.7 [create] v29'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f177c00a570 con 0x7f177400d8e0 2023-10-05T21:15:19.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.280+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(97 notify.6 [watch watch cookie 94478822732896] v29'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f177c00a570 con 0x7f177400d8e0 2023-10-05T21:15:19.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.280+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94478822735504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90ab0830 con 0x7f177400d8e0 2023-10-05T21:15:19.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.280+0000 7f178fb8e680 20 add_watcher() i=0 2023-10-05T21:15:19.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.280+0000 7f178fb8e680 20 add_watcher() i=1 2023-10-05T21:15:19.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.280+0000 7f178fb8e680 20 add_watcher() i=2 2023-10-05T21:15:19.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.280+0000 7f178fb8e680 20 add_watcher() i=3 2023-10-05T21:15:19.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.280+0000 7f178fb8e680 20 add_watcher() i=4 2023-10-05T21:15:19.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.280+0000 7f178fb8e680 20 add_watcher() i=5 2023-10-05T21:15:19.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.280+0000 7f178fb8e680 20 add_watcher() i=6 2023-10-05T21:15:19.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.281+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94478822735504] v29'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f177c00a570 con 0x7f177400d8e0 2023-10-05T21:15:19.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.281+0000 7f178fb8e680 20 add_watcher() i=7 2023-10-05T21:15:19.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.281+0000 7f178fb8e680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:19.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.281+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aae940 con 0x55ed90a6d100 2023-10-05T21:15:19.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.281+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.281+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94478822736608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aae940 con 0x55ed90a6d100 2023-10-05T21:15:19.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.282+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94478822736608] v29'152 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f177c00a570 con 0x55ed90a6d100 2023-10-05T21:15:19.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.282+0000 7f1753fe7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:19.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.282+0000 7f178fb8e680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:19.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.282+0000 7f178fb8e680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:19.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.282+0000 7f178fb8e680 1 Processor -- start 2023-10-05T21:15:19.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.282+0000 7f178fb8e680 1 -- start start 2023-10-05T21:15:19.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.282+0000 7f178fb8e680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6ee40 0x55ed90a6f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.282+0000 7f178fb8e680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed90a6f790 con 0x55ed90a6ee40 2023-10-05T21:15:19.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.283+0000 7f1782465700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6ee40 0x55ed90a6f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.283+0000 7f1782465700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6ee40 0x55ed90a6f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38148/0 (socket says 172.21.15.153:38148) 2023-10-05T21:15:19.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.283+0000 7f1782465700 1 -- 172.21.15.153:0/864532364 learned_addr learned my addr 172.21.15.153:0/864532364 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.283+0000 7f1782465700 1 -- 172.21.15.153:0/864532364 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed90a6d6c0 con 0x55ed90a6ee40 2023-10-05T21:15:19.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.283+0000 7f1782465700 1 --2- 172.21.15.153:0/864532364 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6ee40 0x55ed90a6f250 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1774000fb0 tx=0x7f1774006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a47edce477b77d79 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.283+0000 7f17537e6700 1 -- 172.21.15.153:0/864532364 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1774023040 con 0x55ed90a6ee40 2023-10-05T21:15:19.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.283+0000 7f17537e6700 1 -- 172.21.15.153:0/864532364 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1774024040 con 0x55ed90a6ee40 2023-10-05T21:15:19.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.283+0000 7f17537e6700 1 -- 172.21.15.153:0/864532364 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1774013040 con 0x55ed90a6ee40 2023-10-05T21:15:19.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.284+0000 7f178fb8e680 1 -- 172.21.15.153:0/864532364 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6ee40 msgr2=0x55ed90a6f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.284+0000 7f178fb8e680 1 --2- 172.21.15.153:0/864532364 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6ee40 0x55ed90a6f250 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1774000fb0 tx=0x7f1774006000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.284+0000 7f178fb8e680 1 -- 172.21.15.153:0/864532364 shutdown_connections 2023-10-05T21:15:19.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.284+0000 7f178fb8e680 1 --2- 172.21.15.153:0/864532364 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6ee40 0x55ed90a6f250 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.284+0000 7f178fb8e680 1 -- 172.21.15.153:0/864532364 >> 172.21.15.153:0/864532364 conn(0x55ed90ab9360 msgr2=0x55ed90ab74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.284+0000 7f178fb8e680 1 -- 172.21.15.153:0/864532364 shutdown_connections 2023-10-05T21:15:19.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.284+0000 7f178fb8e680 1 -- 172.21.15.153:0/864532364 wait complete. 2023-10-05T21:15:19.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.284+0000 7f178fb8e680 1 Processor -- start 2023-10-05T21:15:19.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.285+0000 7f178fb8e680 1 -- start start 2023-10-05T21:15:19.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.285+0000 7f178fb8e680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6ee40 0x55ed90ac5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.285+0000 7f178fb8e680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed90ac63e0 con 0x55ed90a6ee40 2023-10-05T21:15:19.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.285+0000 7f1782465700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6ee40 0x55ed90ac5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.285+0000 7f1782465700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6ee40 0x55ed90ac5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38158/0 (socket says 172.21.15.153:38158) 2023-10-05T21:15:19.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.285+0000 7f1782465700 1 -- 172.21.15.153:0/293335965 learned_addr learned my addr 172.21.15.153:0/293335965 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.285+0000 7f1782465700 1 -- 172.21.15.153:0/293335965 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f177400ed60 con 0x55ed90a6ee40 2023-10-05T21:15:19.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.285+0000 7f1782465700 1 --2- 172.21.15.153:0/293335965 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6ee40 0x55ed90ac5ea0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1774000fb0 tx=0x7f1774030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.285+0000 7f1751fe3700 1 -- 172.21.15.153:0/293335965 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1774023040 con 0x55ed90a6ee40 2023-10-05T21:15:19.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.285+0000 7f1751fe3700 1 -- 172.21.15.153:0/293335965 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177403b650 con 0x55ed90a6ee40 2023-10-05T21:15:19.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.285+0000 7f178fb8e680 1 -- 172.21.15.153:0/293335965 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ed90ac65e0 con 0x55ed90a6ee40 2023-10-05T21:15:19.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.285+0000 7f1751fe3700 1 -- 172.21.15.153:0/293335965 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f177403b7e0 con 0x55ed90a6ee40 2023-10-05T21:15:19.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.285+0000 7f178fb8e680 1 -- 172.21.15.153:0/293335965 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ed90ac6a30 con 0x55ed90a6ee40 2023-10-05T21:15:19.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.286+0000 7f1751fe3700 1 -- 172.21.15.153:0/293335965 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f177403b940 con 0x55ed90a6ee40 2023-10-05T21:15:19.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.286+0000 7f1751fe3700 1 --2- 172.21.15.153:0/293335965 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f16c8034140 0x7f16c80365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.286+0000 7f1751fe3700 1 -- 172.21.15.153:0/293335965 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f1774044ab0 con 0x55ed90a6ee40 2023-10-05T21:15:19.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.286+0000 7f178fb8e680 5 note: GC not initialized 2023-10-05T21:15:19.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.286+0000 7f1783467700 1 --2- 172.21.15.153:0/293335965 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f16c8034140 0x7f16c80365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.287+0000 7f1783467700 1 --2- 172.21.15.153:0/293335965 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f16c8034140 0x7f16c80365f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55ed90ab0760 tx=0x7f177c00af00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.287+0000 7f16c2ffd700 20 reqs_thread_entry: start 2023-10-05T21:15:19.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.287+0000 7f16c0ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:19.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.287+0000 7f178fb8e680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:19.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.288+0000 7f178fb8e680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:19.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.288+0000 7f16b2ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:49 2023 2023-10-05T21:15:19.317 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:19.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.288+0000 7f16b27fc700 20 reqs_thread_entry: start 2023-10-05T21:15:19.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.288+0000 7f178fb8e680 10 log_show_next pos 0 bl 0 off 0 eof 0 2023-10-05T21:15:19.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.288+0000 7f178fb8e680 1 --2- 172.21.15.153:0/293335965 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ed90b2a870 0x55ed90b2cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.288+0000 7f178fb8e680 1 -- 172.21.15.153:0/293335965 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 6.d 6:b00f7326:::2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.4-myfoo4:head [read 0~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90b2d190 con 0x55ed90b2a870 2023-10-05T21:15:19.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.288+0000 7f1782c66700 1 --2- 172.21.15.153:0/293335965 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ed90b2a870 0x55ed90b2cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.288+0000 7f1782c66700 1 --2- 172.21.15.153:0/293335965 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ed90b2a870 0x55ed90b2cc50 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.288+0000 7f1782c66700 1 -- 172.21.15.153:0/293335965 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.4-myfoo4 [read 0~850 out=850b] v0'0 uv23 ondisk = 0) v8 ==== 208+0+850 (crc 0 0 0) 0x7f1778036070 con 0x55ed90b2a870 2023-10-05T21:15:19.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.288+0000 7f178fb8e680 10 read 850 2023-10-05T21:15:19.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.288+0000 7f178fb8e680 10 log_show_next pos 850 bl 850 off 419 eof 1 2023-10-05T21:15:19.318 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:19.318 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_id": "193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.4", 2023-10-05T21:15:19.318 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_owner": "foo", 2023-10-05T21:15:19.318 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo4", 2023-10-05T21:15:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: "log_entries": [ 2023-10-05T21:15:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo4", 2023-10-05T21:15:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:15:15.864035Z", 2023-10-05T21:15:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time_local": "2023-10-05T21:15:15.864035+0000", 2023-10-05T21:15:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: "remote_addr": "172.21.0.51", 2023-10-05T21:15:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: "operation": "create_bucket", 2023-10-05T21:15:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: "uri": "PUT /myfoo4/ HTTP/1.1", 2023-10-05T21:15:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: "http_status": "200", 2023-10-05T21:15:19.319 INFO:teuthology.orchestra.run.smithi153.stdout: "error_code": "", 2023-10-05T21:15:19.320 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:15:19.320 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:15:19.320 INFO:teuthology.orchestra.run.smithi153.stdout: "object_size": 0, 2023-10-05T21:15:19.320 INFO:teuthology.orchestra.run.smithi153.stdout: "total_time": 6, 2023-10-05T21:15:19.320 INFO:teuthology.orchestra.run.smithi153.stdout: "user_agent": "Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic", 2023-10-05T21:15:19.320 INFO:teuthology.orchestra.run.smithi153.stdout: "referrer": "", 2023-10-05T21:15:19.320 INFO:teuthology.orchestra.run.smithi153.stdout: "trans_id": "tx00000e7820b0df7431ba6-00651f2763-107c-default", 2023-10-05T21:15:19.320 INFO:teuthology.orchestra.run.smithi153.stdout: "authentication_type": "Local", 2023-10-05T21:15:19.320 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key_id": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:19.320 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url": false 2023-10-05T21:15:19.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:19.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:19.321 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo4", 2023-10-05T21:15:19.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:15:15.971033Z", 2023-10-05T21:15:19.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time_local": "2023-10-05T21:15:15.971033+0000", 2023-10-05T21:15:19.321 INFO:teuthology.orchestra.run.smithi153.stdout: "remote_addr": "172.21.0.51", 2023-10-05T21:15:19.321 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:19.321 INFO:teuthology.orchestra.run.smithi153.stdout: "operation": "delete_bucket", 2023-10-05T21:15:19.321 INFO:teuthology.orchestra.run.smithi153.stdout: "uri": "DELETE /myfoo4/ HTTP/1.1", 2023-10-05T21:15:19.321 INFO:teuthology.orchestra.run.smithi153.stdout: "http_status": "204", 2023-10-05T21:15:19.321 INFO:teuthology.orchestra.run.smithi153.stdout: "error_code": "NoContent", 2023-10-05T21:15:19.321 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:15:19.322 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:15:19.322 INFO:teuthology.orchestra.run.smithi153.stdout: "object_size": 0, 2023-10-05T21:15:19.322 INFO:teuthology.orchestra.run.smithi153.stdout: "total_time": 26, 2023-10-05T21:15:19.322 INFO:teuthology.orchestra.run.smithi153.stdout: "user_agent": "Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic", 2023-10-05T21:15:19.322 INFO:teuthology.orchestra.run.smithi153.stdout: "referrer": "", 2023-10-05T21:15:19.322 INFO:teuthology.orchestra.run.smithi153.stdout: "trans_id": "tx0000016e2f4c5c0dc6c5c-00651f2763-107c-default", 2023-10-05T21:15:19.322 INFO:teuthology.orchestra.run.smithi153.stdout: "authentication_type": "Local", 2023-10-05T21:15:19.322 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key_id": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:19.322 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url": false 2023-10-05T21:15:19.322 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:19.322 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:19.322 INFO:teuthology.orchestra.run.smithi153.stdout: "log_sum": { 2023-10-05T21:15:19.323 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:15:19.323 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:15:19.323 INFO:teuthology.orchestra.run.smithi153.stdout: "total_time": 32, 2023-10-05T21:15:19.323 INFO:teuthology.orchestra.run.smithi153.stdout: "total_entries": 2 2023-10-05T21:15:19.323 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:19.323 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:19.323 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:15:19.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.288+0000 7f178fb8e680 10 log_show_next pos 850 bl 850 off 850 eof 1 2023-10-05T21:15:19.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.289+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94478822710976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aea460 con 0x7f1778030020 2023-10-05T21:15:19.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.290+0000 7f1782465700 1 -- 172.21.15.153:0/772116576 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(102 notify.0 [watch unwatch cookie 94478822710976] v29'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1774006070 con 0x7f1778030020 2023-10-05T21:15:19.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.290+0000 7f178fb8e680 20 remove_watcher() i=0 2023-10-05T21:15:19.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.290+0000 7f178fb8e680 2 removed watcher, disabling cache 2023-10-05T21:15:19.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.290+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94478822714208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa9ec0 con 0x55ed90a6d100 2023-10-05T21:15:19.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.290+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(103 notify.1 [watch unwatch cookie 94478822714208] v29'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f177c04c040 con 0x55ed90a6d100 2023-10-05T21:15:19.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.290+0000 7f178fb8e680 20 remove_watcher() i=1 2023-10-05T21:15:19.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.290+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:104 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94478822716416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa9ec0 con 0x55ed90aa3100 2023-10-05T21:15:19.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.291+0000 7f1782c66700 1 -- 172.21.15.153:0/772116576 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(104 notify.2 [watch unwatch cookie 94478822716416] v29'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1778036070 con 0x55ed90aa3100 2023-10-05T21:15:19.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.291+0000 7f178fb8e680 20 remove_watcher() i=2 2023-10-05T21:15:19.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.291+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94478822721664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aab400 con 0x7f1778030020 2023-10-05T21:15:19.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.292+0000 7f1782465700 1 -- 172.21.15.153:0/772116576 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(105 notify.3 [watch unwatch cookie 94478822721664] v29'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1774006070 con 0x7f1778030020 2023-10-05T21:15:19.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.292+0000 7f178fb8e680 20 remove_watcher() i=3 2023-10-05T21:15:19.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.292+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94478822726592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa9ec0 con 0x55ed90a6d100 2023-10-05T21:15:19.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.293+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(106 notify.4 [watch unwatch cookie 94478822726592] v29'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f177c04c040 con 0x55ed90a6d100 2023-10-05T21:15:19.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.293+0000 7f178fb8e680 20 remove_watcher() i=4 2023-10-05T21:15:19.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.293+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:107 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94478822728800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aac880 con 0x7f177400d8e0 2023-10-05T21:15:19.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.293+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(107 notify.5 [watch unwatch cookie 94478822728800] v29'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f177c04c040 con 0x7f177400d8e0 2023-10-05T21:15:19.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.293+0000 7f178fb8e680 20 remove_watcher() i=5 2023-10-05T21:15:19.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.293+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94478822732896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aab400 con 0x7f177400d8e0 2023-10-05T21:15:19.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.294+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(108 notify.6 [watch unwatch cookie 94478822732896] v29'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f177c04c040 con 0x7f177400d8e0 2023-10-05T21:15:19.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.294+0000 7f178fb8e680 20 remove_watcher() i=6 2023-10-05T21:15:19.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.294+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94478822735504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aadbc0 con 0x7f177400d8e0 2023-10-05T21:15:19.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.295+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(109 notify.7 [watch unwatch cookie 94478822735504] v29'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f177c04c040 con 0x7f177400d8e0 2023-10-05T21:15:19.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.295+0000 7f178fb8e680 20 remove_watcher() i=7 2023-10-05T21:15:19.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.296+0000 7f1753fe7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:19.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.296+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:110 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94478822736608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ed90aa9ec0 con 0x55ed90a6d100 2023-10-05T21:15:19.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.296+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(110 data_loggenerations_metadata [watch unwatch cookie 94478822736608] v29'153 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f177c04c040 con 0x55ed90a6d100 2023-10-05T21:15:19.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.297+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f177400d8e0 msgr2=0x7f177400c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.297+0000 7f178fb8e680 1 --2- 172.21.15.153:0/772116576 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f177400d8e0 0x7f177400c360 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.297+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ed90a6d100 msgr2=0x55ed90aa0b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.297+0000 7f178fb8e680 1 --2- 172.21.15.153:0/772116576 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ed90a6d100 0x55ed90aa0b50 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.297+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f1778030020 msgr2=0x7f17780065d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.297+0000 7f178fb8e680 1 --2- 172.21.15.153:0/772116576 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f1778030020 0x7f17780065d0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.297+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ed90aa3100 msgr2=0x55ed90aa54e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.297+0000 7f178fb8e680 1 --2- 172.21.15.153:0/772116576 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ed90aa3100 0x55ed90aa54e0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.297+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1768034140 msgr2=0x7f17680365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.297+0000 7f178fb8e680 1 --2- 172.21.15.153:0/772116576 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1768034140 0x7f17680365f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f17740011e0 tx=0x7f1774001340 comp rx=0 tx=0).stop 2023-10-05T21:15:19.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.297+0000 7f1783467700 1 -- 172.21.15.153:0/772116576 reap_dead start 2023-10-05T21:15:19.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.297+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6c7b0 msgr2=0x55ed90a94d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.297+0000 7f178fb8e680 1 --2- 172.21.15.153:0/772116576 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6c7b0 0x55ed90a94d70 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f177801f040 tx=0x7f177801d000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.297+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 shutdown_connections 2023-10-05T21:15:19.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.297+0000 7f178fb8e680 1 --2- 172.21.15.153:0/772116576 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6c7b0 0x55ed90a94d70 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.297+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 >> 172.21.15.153:0/772116576 conn(0x55ed90a68300 msgr2=0x55ed90a87cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.297+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 shutdown_connections 2023-10-05T21:15:19.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.297+0000 7f178fb8e680 1 -- 172.21.15.153:0/772116576 wait complete. 2023-10-05T21:15:19.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.297+0000 7f178fb8e680 1 -- 172.21.15.153:0/293335965 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ed90b2a870 msgr2=0x55ed90b2cc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.297+0000 7f178fb8e680 1 --2- 172.21.15.153:0/293335965 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ed90b2a870 0x55ed90b2cc50 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.297+0000 7f178fb8e680 1 -- 172.21.15.153:0/293335965 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f16c8034140 msgr2=0x7f16c80365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.297+0000 7f178fb8e680 1 --2- 172.21.15.153:0/293335965 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f16c8034140 0x7f16c80365f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55ed90ab0760 tx=0x7f177c00af00 comp rx=0 tx=0).stop 2023-10-05T21:15:19.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.297+0000 7f178fb8e680 1 -- 172.21.15.153:0/293335965 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6ee40 msgr2=0x55ed90ac5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.297+0000 7f178fb8e680 1 --2- 172.21.15.153:0/293335965 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6ee40 0x55ed90ac5ea0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1774000fb0 tx=0x7f1774030000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.297+0000 7f178fb8e680 1 -- 172.21.15.153:0/293335965 shutdown_connections 2023-10-05T21:15:19.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.297+0000 7f178fb8e680 1 --2- 172.21.15.153:0/293335965 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ed90b2a870 0x55ed90b2cc50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.297+0000 7f178fb8e680 1 --2- 172.21.15.153:0/293335965 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90a6ee40 0x55ed90ac5ea0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.297+0000 7f178fb8e680 1 --2- 172.21.15.153:0/293335965 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f16c8034140 0x7f16c80365f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.297+0000 7f178fb8e680 1 -- 172.21.15.153:0/293335965 >> 172.21.15.153:0/293335965 conn(0x55ed90ab9360 msgr2=0x55ed90ab7490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.297+0000 7f178fb8e680 1 -- 172.21.15.153:0/293335965 shutdown_connections 2023-10-05T21:15:19.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.297+0000 7f178fb8e680 1 -- 172.21.15.153:0/293335965 wait complete. 2023-10-05T21:15:19.334 DEBUG:tasks.util.rgw: json result: {'bucket_id': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.4', 'bucket_owner': 'foo', 'bucket': 'myfoo4', 'log_entries': [{'bucket': 'myfoo4', 'time': '2023-10-05T21:15:15.864035Z', 'time_local': '2023-10-05T21:15:15.864035+0000', 'remote_addr': '172.21.0.51', 'user': 'foo', 'operation': 'create_bucket', 'uri': 'PUT /myfoo4/ HTTP/1.1', 'http_status': '200', 'error_code': '', 'bytes_sent': 0, 'bytes_received': 0, 'object_size': 0, 'total_time': 6, 'user_agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic', 'referrer': '', 'trans_id': 'tx00000e7820b0df7431ba6-00651f2763-107c-default', 'authentication_type': 'Local', 'access_key_id': '9te6NH5mcdcq0Tc5i8i1', 'temp_url': False}, {'bucket': 'myfoo4', 'time': '2023-10-05T21:15:15.971033Z', 'time_local': '2023-10-05T21:15:15.971033+0000', 'remote_addr': '172.21.0.51', 'user': 'foo', 'operation': 'delete_bucket', 'uri': 'DELETE /myfoo4/ HTTP/1.1', 'http_status': '204', 'error_code': 'NoContent', 'bytes_sent': 0, 'bytes_received': 0, 'object_size': 0, 'total_time': 26, 'user_agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic', 'referrer': '', 'trans_id': 'tx0000016e2f4c5c0dc6c5c-00651f2763-107c-default', 'authentication_type': 'Local', 'access_key_id': '9te6NH5mcdcq0Tc5i8i1', 'temp_url': False}], 'log_sum': {'bytes_sent': 0, 'bytes_received': 0, 'total_time': 32, 'total_entries': 2}} 2023-10-05T21:15:19.334 DEBUG:tasks.radosgw_admin:checking log entry: 2023-10-05T21:15:19.334 DEBUG:tasks.radosgw_admin:checking log entry: 2023-10-05T21:15:19.334 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'rm', '--object', '2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.4-myfoo4'] 2023-10-05T21:15:19.334 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'rm', '--object', '2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.4-myfoo4'] 2023-10-05T21:15:19.334 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log rm --object 2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.4-myfoo4 2023-10-05T21:15:19.379 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:19.379 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:19.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.377+0000 7f3851572680 1 Processor -- start 2023-10-05T21:15:19.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.377+0000 7f3851572680 1 -- start start 2023-10-05T21:15:19.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.377+0000 7f3851572680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55dcc7abdbb0 0x55dcc7abff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.377+0000 7f3851572680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55dcc7a04990 con 0x55dcc7a2b930 2023-10-05T21:15:19.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.377+0000 7f3851572680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55dcc79c4db0 con 0x55dcc7abdbb0 2023-10-05T21:15:19.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.378+0000 7f3843e49700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55dcc7abdbb0 0x55dcc7abff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.378+0000 7f384464a700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55dcc7a2b930 0x55dcc7abc490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:55288/0 (socket says 172.21.15.153:55288) 2023-10-05T21:15:19.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.378+0000 7f384464a700 1 -- 172.21.15.153:0/2455408637 learned_addr learned my addr 172.21.15.153:0/2455408637 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:19.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.378+0000 7f3843e49700 1 -- 172.21.15.153:0/2455408637 >> v1:172.21.15.111:6789/0 conn(0x55dcc7a2b930 legacy=0x55dcc7abc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.378+0000 7f3843648700 1 -- 172.21.15.153:0/2455408637 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1879171177 0 0) 0x55dcc7a04990 con 0x55dcc7a2b930 2023-10-05T21:15:19.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.378+0000 7f3843e49700 1 -- 172.21.15.153:0/2455408637 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcc7ac14e0 con 0x55dcc7abdbb0 2023-10-05T21:15:19.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.378+0000 7f3843e49700 1 --2- 172.21.15.153:0/2455408637 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7abdbb0 0x55dcc7abff90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f383400a5d0 tx=0x7f3834005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10497b6f4f680f17 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.378+0000 7f3843648700 1 -- 172.21.15.153:0/2455408637 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38340086a0 con 0x55dcc7abdbb0 2023-10-05T21:15:19.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.378+0000 7f3843648700 1 -- 172.21.15.153:0/2455408637 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3834008800 con 0x55dcc7abdbb0 2023-10-05T21:15:19.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.378+0000 7f3843648700 1 -- 172.21.15.153:0/2455408637 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3834008ad0 con 0x55dcc7abdbb0 2023-10-05T21:15:19.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.379+0000 7f3851572680 1 -- 172.21.15.153:0/2455408637 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7abdbb0 msgr2=0x55dcc7abff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.379+0000 7f3851572680 1 --2- 172.21.15.153:0/2455408637 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7abdbb0 0x55dcc7abff90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f383400a5d0 tx=0x7f3834005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:19.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.379+0000 7f3851572680 1 -- 172.21.15.153:0/2455408637 shutdown_connections 2023-10-05T21:15:19.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.379+0000 7f3851572680 1 --2- 172.21.15.153:0/2455408637 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7abdbb0 0x55dcc7abff90 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.379+0000 7f3851572680 1 -- 172.21.15.153:0/2455408637 >> 172.21.15.153:0/2455408637 conn(0x55dcc7ab1b80 msgr2=0x55dcc7ab3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.379+0000 7f3851572680 1 -- 172.21.15.153:0/2455408637 shutdown_connections 2023-10-05T21:15:19.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.379+0000 7f3851572680 1 -- 172.21.15.153:0/2455408637 wait complete. 2023-10-05T21:15:19.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.379+0000 7f3851572680 1 Processor -- start 2023-10-05T21:15:19.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.380+0000 7f3851572680 1 -- start start 2023-10-05T21:15:19.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.380+0000 7f3851572680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7a2b930 0x55dcc7ad89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.380+0000 7f3851572680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc7964ea0 con 0x55dcc7a2b930 2023-10-05T21:15:19.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.380+0000 7f384464a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7a2b930 0x55dcc7ad89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.380+0000 7f384464a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7a2b930 0x55dcc7ad89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38168/0 (socket says 172.21.15.153:38168) 2023-10-05T21:15:19.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.380+0000 7f384464a700 1 -- 172.21.15.153:0/1604643714 learned_addr learned my addr 172.21.15.153:0/1604643714 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.380+0000 7f384464a700 1 -- 172.21.15.153:0/1604643714 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3834005cf0 con 0x55dcc7a2b930 2023-10-05T21:15:19.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.380+0000 7f384464a700 1 --2- 172.21.15.153:0/1604643714 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7a2b930 0x55dcc7ad89d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3838001d70 tx=0x7f3838001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd0d2d07041b8f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.380+0000 7f3842646700 1 -- 172.21.15.153:0/1604643714 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f383800bcc0 con 0x55dcc7a2b930 2023-10-05T21:15:19.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.380+0000 7f3842646700 1 -- 172.21.15.153:0/1604643714 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383800be20 con 0x55dcc7a2b930 2023-10-05T21:15:19.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.380+0000 7f3842646700 1 -- 172.21.15.153:0/1604643714 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f383800e5f0 con 0x55dcc7a2b930 2023-10-05T21:15:19.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.381+0000 7f3851572680 1 -- 172.21.15.153:0/1604643714 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7a2b930 msgr2=0x55dcc7ad89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.381+0000 7f3851572680 1 --2- 172.21.15.153:0/1604643714 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7a2b930 0x55dcc7ad89d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3838001d70 tx=0x7f3838001770 comp rx=0 tx=0).stop 2023-10-05T21:15:19.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.381+0000 7f3851572680 1 -- 172.21.15.153:0/1604643714 shutdown_connections 2023-10-05T21:15:19.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.381+0000 7f3851572680 1 --2- 172.21.15.153:0/1604643714 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7a2b930 0x55dcc7ad89d0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.381+0000 7f3851572680 1 -- 172.21.15.153:0/1604643714 >> 172.21.15.153:0/1604643714 conn(0x55dcc7ab1b80 msgr2=0x55dcc7ad44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.381+0000 7f3851572680 1 -- 172.21.15.153:0/1604643714 shutdown_connections 2023-10-05T21:15:19.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.381+0000 7f3851572680 1 -- 172.21.15.153:0/1604643714 wait complete. 2023-10-05T21:15:19.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.381+0000 7f3851572680 1 Processor -- start 2023-10-05T21:15:19.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.381+0000 7f3851572680 1 -- start start 2023-10-05T21:15:19.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.381+0000 7f3851572680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7a2b930 0x55dcc7adfea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.381+0000 7f3851572680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc795bc80 con 0x55dcc7a2b930 2023-10-05T21:15:19.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.382+0000 7f384464a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7a2b930 0x55dcc7adfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.382+0000 7f384464a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7a2b930 0x55dcc7adfea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38184/0 (socket says 172.21.15.153:38184) 2023-10-05T21:15:19.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.382+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 learned_addr learned my addr 172.21.15.153:0/2033087717 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.382+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3838001a50 con 0x55dcc7a2b930 2023-10-05T21:15:19.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.382+0000 7f384464a700 1 --2- 172.21.15.153:0/2033087717 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7a2b930 0x55dcc7adfea0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f38380017b0 tx=0x7f3838016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.382+0000 7f3840e43700 1 -- 172.21.15.153:0/2033087717 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f383801f070 con 0x55dcc7a2b930 2023-10-05T21:15:19.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.382+0000 7f3840e43700 1 -- 172.21.15.153:0/2033087717 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383801a2e0 con 0x55dcc7a2b930 2023-10-05T21:15:19.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.382+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dcc7ae03e0 con 0x55dcc7a2b930 2023-10-05T21:15:19.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.382+0000 7f3840e43700 1 -- 172.21.15.153:0/2033087717 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f383801a650 con 0x55dcc7a2b930 2023-10-05T21:15:19.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.382+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dcc7ae0830 con 0x55dcc7a2b930 2023-10-05T21:15:19.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.383+0000 7f3840e43700 1 -- 172.21.15.153:0/2033087717 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f383801a7b0 con 0x55dcc7a2b930 2023-10-05T21:15:19.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.383+0000 7f3851572680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.383+0000 7f3840e43700 1 --2- 172.21.15.153:0/2033087717 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3830034140 0x7f38300365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.383+0000 7f3840e43700 1 -- 172.21.15.153:0/2033087717 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f3838048f80 con 0x55dcc7a2b930 2023-10-05T21:15:19.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.383+0000 7f3843e49700 1 --2- 172.21.15.153:0/2033087717 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3830034140 0x7f38300365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.384+0000 7f3851572680 1 --2- 172.21.15.153:0/2033087717 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55dcc7abdbb0 0x55dcc7aebbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.384+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7aec380 con 0x55dcc7abdbb0 2023-10-05T21:15:19.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.384+0000 7f3844e4b700 1 --2- 172.21.15.153:0/2033087717 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55dcc7abdbb0 0x55dcc7aebbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.384+0000 7f3843e49700 1 --2- 172.21.15.153:0/2033087717 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3830034140 0x7f38300365f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3834003080 tx=0x7f3834015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.384+0000 7f3844e4b700 1 --2- 172.21.15.153:0/2033087717 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55dcc7abdbb0 0x55dcc7aebbf0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.384+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.384+0000 7f3851572680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.384+0000 7f3851572680 20 realm 2023-10-05T21:15:19.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.384+0000 7f3851572680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.384+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7ae9210 con 0x55dcc7abdbb0 2023-10-05T21:15:19.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.384+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.384+0000 7f3851572680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.384+0000 7f3851572680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:19.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.384+0000 7f3851572680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.384+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7aece80 con 0x55dcc7abdbb0 2023-10-05T21:15:19.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.385+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.385+0000 7f3851572680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.385+0000 7f3851572680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.385+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7aed7a0 con 0x55dcc7abdbb0 2023-10-05T21:15:19.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.385+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.385+0000 7f3851572680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.385+0000 7f3851572680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.385+0000 7f3851572680 1 --2- 172.21.15.153:0/2033087717 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55dcc7aee060 0x55dcc7af0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.385+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af0a90 con 0x55dcc7aee060 2023-10-05T21:15:19.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.385+0000 7f384464a700 1 --2- 172.21.15.153:0/2033087717 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55dcc7aee060 0x55dcc7af0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.385+0000 7f384464a700 1 --2- 172.21.15.153:0/2033087717 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55dcc7aee060 0x55dcc7af0440 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.386+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f3838014070 con 0x55dcc7aee060 2023-10-05T21:15:19.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.386+0000 7f3851572680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:19.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.386+0000 7f3851572680 20 searching for the correct realm 2023-10-05T21:15:19.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.386+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2600 con 0x55dcc7aee060 2023-10-05T21:15:19.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.386+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3838014070 con 0x55dcc7aee060 2023-10-05T21:15:19.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.386+0000 7f384464a700 1 --2- 172.21.15.153:0/2033087717 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f383800d750 0x7f3838017430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.386+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f383803e040 con 0x7f383800d750 2023-10-05T21:15:19.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.386+0000 7f3843e49700 1 --2- 172.21.15.153:0/2033087717 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f383800d750 0x7f3838017430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.386+0000 7f3843e49700 1 --2- 172.21.15.153:0/2033087717 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f383800d750 0x7f3838017430 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.387+0000 7f3843e49700 1 -- 172.21.15.153:0/2033087717 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3834019040 con 0x7f383800d750 2023-10-05T21:15:19.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.387+0000 7f3843e49700 1 --2- 172.21.15.153:0/2033087717 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f3834007030 0x7f383401d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.387+0000 7f3843e49700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f383803e040 con 0x7f3834007030 2023-10-05T21:15:19.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.387+0000 7f3844e4b700 1 --2- 172.21.15.153:0/2033087717 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f3834007030 0x7f383401d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.387+0000 7f3844e4b700 1 --2- 172.21.15.153:0/2033087717 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f3834007030 0x7f383401d420 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.387+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383c00a570 con 0x7f3834007030 2023-10-05T21:15:19.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.387+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f383803e040 con 0x55dcc7abdbb0 2023-10-05T21:15:19.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.387+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.388+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f383803e040 con 0x55dcc7abdbb0 2023-10-05T21:15:19.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.388+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.388+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f383803e040 con 0x7f3834007030 2023-10-05T21:15:19.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.388+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383c00a570 con 0x7f3834007030 2023-10-05T21:15:19.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.388+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f383803e040 con 0x7f3834007030 2023-10-05T21:15:19.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.388+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383c00a570 con 0x7f3834007030 2023-10-05T21:15:19.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.388+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f383803e040 con 0x7f383800d750 2023-10-05T21:15:19.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.388+0000 7f3843e49700 1 -- 172.21.15.153:0/2033087717 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3834019040 con 0x7f383800d750 2023-10-05T21:15:19.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.388+0000 7f3843e49700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f383803e040 con 0x55dcc7aee060 2023-10-05T21:15:19.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.389+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3838014070 con 0x55dcc7aee060 2023-10-05T21:15:19.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.389+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f383803e040 con 0x55dcc7abdbb0 2023-10-05T21:15:19.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.389+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.389+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f383803e040 con 0x7f3834007030 2023-10-05T21:15:19.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.389+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383c00a570 con 0x7f3834007030 2023-10-05T21:15:19.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.389+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f383803e040 con 0x55dcc7abdbb0 2023-10-05T21:15:19.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.389+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.389+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f383803e040 con 0x7f383800d750 2023-10-05T21:15:19.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.390+0000 7f3843e49700 1 -- 172.21.15.153:0/2033087717 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3834019040 con 0x7f383800d750 2023-10-05T21:15:19.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.390+0000 7f3843e49700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f383803e040 con 0x55dcc7aee060 2023-10-05T21:15:19.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.390+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3838014070 con 0x55dcc7aee060 2023-10-05T21:15:19.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.390+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f383803e040 con 0x55dcc7aee060 2023-10-05T21:15:19.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.390+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3838014070 con 0x55dcc7aee060 2023-10-05T21:15:19.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.390+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f383803e040 con 0x7f3834007030 2023-10-05T21:15:19.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.390+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383c00a570 con 0x7f3834007030 2023-10-05T21:15:19.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.390+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f383803e040 con 0x55dcc7aee060 2023-10-05T21:15:19.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.390+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3838014070 con 0x55dcc7aee060 2023-10-05T21:15:19.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.390+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f383803e040 con 0x55dcc7aee060 2023-10-05T21:15:19.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.391+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3838014070 con 0x55dcc7aee060 2023-10-05T21:15:19.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.391+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f383803e040 con 0x55dcc7abdbb0 2023-10-05T21:15:19.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.391+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.391+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f383803e040 con 0x55dcc7abdbb0 2023-10-05T21:15:19.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.391+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.391+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f383803e040 con 0x7f3834007030 2023-10-05T21:15:19.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.391+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383c00a570 con 0x7f3834007030 2023-10-05T21:15:19.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.391+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f383803e040 con 0x55dcc7aee060 2023-10-05T21:15:19.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.391+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3838014070 con 0x55dcc7aee060 2023-10-05T21:15:19.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.391+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f383803e040 con 0x7f383800d750 2023-10-05T21:15:19.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.392+0000 7f3843e49700 1 -- 172.21.15.153:0/2033087717 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3834019040 con 0x7f383800d750 2023-10-05T21:15:19.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.392+0000 7f3843e49700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f383803e040 con 0x55dcc7abdbb0 2023-10-05T21:15:19.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.392+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.392+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f383803e040 con 0x7f3834007030 2023-10-05T21:15:19.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.392+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383c00a570 con 0x7f3834007030 2023-10-05T21:15:19.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.392+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f383803e040 con 0x55dcc7aee060 2023-10-05T21:15:19.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.392+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3838014070 con 0x55dcc7aee060 2023-10-05T21:15:19.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.392+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f383803e040 con 0x7f3834007030 2023-10-05T21:15:19.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.393+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383c00a570 con 0x7f3834007030 2023-10-05T21:15:19.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.393+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f383803e040 con 0x7f383800d750 2023-10-05T21:15:19.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.393+0000 7f3843e49700 1 -- 172.21.15.153:0/2033087717 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3834019040 con 0x7f383800d750 2023-10-05T21:15:19.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.393+0000 7f3843e49700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f383803e040 con 0x55dcc7aee060 2023-10-05T21:15:19.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.393+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3838014070 con 0x55dcc7aee060 2023-10-05T21:15:19.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.393+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f383803e040 con 0x7f3834007030 2023-10-05T21:15:19.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.393+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383c00a570 con 0x7f3834007030 2023-10-05T21:15:19.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.393+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f383803e040 con 0x55dcc7abdbb0 2023-10-05T21:15:19.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.393+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.393+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f383803e040 con 0x7f383800d750 2023-10-05T21:15:19.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.394+0000 7f3843e49700 1 -- 172.21.15.153:0/2033087717 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3834019040 con 0x7f383800d750 2023-10-05T21:15:19.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.394+0000 7f3851572680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:19.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.394+0000 7f3851572680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:19.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.394+0000 7f3851572680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:19.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.394+0000 7f3851572680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:19.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.394+0000 7f3851572680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.394+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af1550 con 0x55dcc7abdbb0 2023-10-05T21:15:19.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.394+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.394+0000 7f3851572680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.394+0000 7f3851572680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.394+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af1950 con 0x55dcc7abdbb0 2023-10-05T21:15:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.394+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.394+0000 7f3851572680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.394+0000 7f3851572680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.394+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2a90 con 0x55dcc7abdbb0 2023-10-05T21:15:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.394+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.394+0000 7f3851572680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.394+0000 7f3851572680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.394+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2e40 con 0x55dcc7aee060 2023-10-05T21:15:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.395+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f3838014070 con 0x55dcc7aee060 2023-10-05T21:15:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.395+0000 7f3851572680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.395+0000 7f3851572680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.395+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af31f0 con 0x55dcc7abdbb0 2023-10-05T21:15:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.395+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.395+0000 7f3851572680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.395+0000 7f3851572680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.395+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af31f0 con 0x55dcc7abdbb0 2023-10-05T21:15:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.395+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.395+0000 7f3851572680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.395+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af31f0 con 0x55dcc7aee060 2023-10-05T21:15:19.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.395+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3838014070 con 0x55dcc7aee060 2023-10-05T21:15:19.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.395+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af31f0 con 0x7f383800d750 2023-10-05T21:15:19.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.395+0000 7f3843e49700 1 -- 172.21.15.153:0/2033087717 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3834019040 con 0x7f383800d750 2023-10-05T21:15:19.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.395+0000 7f3843e49700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af31f0 con 0x7f3834007030 2023-10-05T21:15:19.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.396+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383c00a570 con 0x7f3834007030 2023-10-05T21:15:19.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.396+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2a90 con 0x55dcc7abdbb0 2023-10-05T21:15:19.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.396+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.396+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2a90 con 0x55dcc7abdbb0 2023-10-05T21:15:19.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.396+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.396+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2a90 con 0x7f3834007030 2023-10-05T21:15:19.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.397+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383c00a570 con 0x7f3834007030 2023-10-05T21:15:19.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.397+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2a90 con 0x7f3834007030 2023-10-05T21:15:19.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.397+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383c00a570 con 0x7f3834007030 2023-10-05T21:15:19.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.397+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2a90 con 0x7f383800d750 2023-10-05T21:15:19.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.397+0000 7f3843e49700 1 -- 172.21.15.153:0/2033087717 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3834019040 con 0x7f383800d750 2023-10-05T21:15:19.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.397+0000 7f3843e49700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2a90 con 0x55dcc7aee060 2023-10-05T21:15:19.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.397+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3838014070 con 0x55dcc7aee060 2023-10-05T21:15:19.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.397+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2a90 con 0x55dcc7abdbb0 2023-10-05T21:15:19.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.397+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.397+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2a90 con 0x7f3834007030 2023-10-05T21:15:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.398+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383c00a570 con 0x7f3834007030 2023-10-05T21:15:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.398+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2a90 con 0x55dcc7abdbb0 2023-10-05T21:15:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.398+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.398+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2a90 con 0x7f383800d750 2023-10-05T21:15:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.398+0000 7f3843e49700 1 -- 172.21.15.153:0/2033087717 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3834019040 con 0x7f383800d750 2023-10-05T21:15:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.398+0000 7f3843e49700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2a90 con 0x55dcc7aee060 2023-10-05T21:15:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.398+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3838014070 con 0x55dcc7aee060 2023-10-05T21:15:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.398+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2a90 con 0x55dcc7aee060 2023-10-05T21:15:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.398+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3838014070 con 0x55dcc7aee060 2023-10-05T21:15:19.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.398+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2a90 con 0x7f3834007030 2023-10-05T21:15:19.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.399+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383c00a570 con 0x7f3834007030 2023-10-05T21:15:19.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.399+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2a90 con 0x55dcc7aee060 2023-10-05T21:15:19.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.399+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3838014070 con 0x55dcc7aee060 2023-10-05T21:15:19.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.399+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2a90 con 0x55dcc7aee060 2023-10-05T21:15:19.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.399+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3838014070 con 0x55dcc7aee060 2023-10-05T21:15:19.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.399+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2a90 con 0x55dcc7abdbb0 2023-10-05T21:15:19.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.399+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.399+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2a90 con 0x55dcc7abdbb0 2023-10-05T21:15:19.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.400+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.400+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2a90 con 0x7f3834007030 2023-10-05T21:15:19.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.400+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383c00a570 con 0x7f3834007030 2023-10-05T21:15:19.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.400+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2a90 con 0x55dcc7aee060 2023-10-05T21:15:19.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.400+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3838014070 con 0x55dcc7aee060 2023-10-05T21:15:19.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.400+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2a90 con 0x7f383800d750 2023-10-05T21:15:19.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.400+0000 7f3843e49700 1 -- 172.21.15.153:0/2033087717 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3834019040 con 0x7f383800d750 2023-10-05T21:15:19.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.400+0000 7f3843e49700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2a90 con 0x55dcc7abdbb0 2023-10-05T21:15:19.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.401+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.401+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2a90 con 0x7f3834007030 2023-10-05T21:15:19.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.401+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383c00a570 con 0x7f3834007030 2023-10-05T21:15:19.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.401+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2a90 con 0x55dcc7aee060 2023-10-05T21:15:19.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.401+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3838014070 con 0x55dcc7aee060 2023-10-05T21:15:19.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.401+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2a90 con 0x7f3834007030 2023-10-05T21:15:19.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.402+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383c00a570 con 0x7f3834007030 2023-10-05T21:15:19.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.402+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2a90 con 0x7f383800d750 2023-10-05T21:15:19.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.402+0000 7f3843e49700 1 -- 172.21.15.153:0/2033087717 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3834019040 con 0x7f383800d750 2023-10-05T21:15:19.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.402+0000 7f3843e49700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2a90 con 0x55dcc7aee060 2023-10-05T21:15:19.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.402+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3838014070 con 0x55dcc7aee060 2023-10-05T21:15:19.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.402+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2a90 con 0x7f3834007030 2023-10-05T21:15:19.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.402+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383c00a570 con 0x7f3834007030 2023-10-05T21:15:19.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.402+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2a90 con 0x55dcc7abdbb0 2023-10-05T21:15:19.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.402+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.402+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af2a90 con 0x7f383800d750 2023-10-05T21:15:19.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.403+0000 7f3843e49700 1 -- 172.21.15.153:0/2033087717 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3834019040 con 0x7f383800d750 2023-10-05T21:15:19.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.403+0000 7f3851572680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:19.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.403+0000 7f3851572680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:19.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.403+0000 7f3851572680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:19.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.403+0000 7f3851572680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:19.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.403+0000 7f3851572680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.403+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af31f0 con 0x55dcc7abdbb0 2023-10-05T21:15:19.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.403+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.403+0000 7f3851572680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.403+0000 7f3851572680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.403+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af35f0 con 0x55dcc7aee060 2023-10-05T21:15:19.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.403+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f3838014070 con 0x55dcc7aee060 2023-10-05T21:15:19.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.403+0000 7f3851572680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:19.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.403+0000 7f3851572680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.403+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af3e90 con 0x55dcc7abdbb0 2023-10-05T21:15:19.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.403+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.403+0000 7f3851572680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.403+0000 7f3851572680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.403+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af3e90 con 0x55dcc7abdbb0 2023-10-05T21:15:19.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.404+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.404+0000 7f3851572680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:19.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.404+0000 7f3851572680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.404+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af3e90 con 0x7f3834007030 2023-10-05T21:15:19.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.404+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f383c00a570 con 0x7f3834007030 2023-10-05T21:15:19.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.404+0000 7f3851572680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.404+0000 7f3851572680 20 zone default found 2023-10-05T21:15:19.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.404+0000 7f3851572680 4 Realm: () 2023-10-05T21:15:19.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.404+0000 7f3851572680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:19.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.404+0000 7f3851572680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:19.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.404+0000 7f3851572680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:19.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.404+0000 7f3851572680 20 zonegroup default 2023-10-05T21:15:19.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.404+0000 7f3851572680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.404+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af3e90 con 0x7f3834007030 2023-10-05T21:15:19.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.404+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f383c00a570 con 0x7f3834007030 2023-10-05T21:15:19.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.404+0000 7f3851572680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.404+0000 7f3851572680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.404+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af5810 con 0x55dcc7aee060 2023-10-05T21:15:19.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.404+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3838014070 con 0x55dcc7aee060 2023-10-05T21:15:19.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.405+0000 7f3851572680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.405+0000 7f3851572680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.405+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af5bc0 con 0x55dcc7aee060 2023-10-05T21:15:19.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.405+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3838014070 con 0x55dcc7aee060 2023-10-05T21:15:19.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.405+0000 7f3851572680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.405+0000 7f3851572680 20 started sync module instance, tier type = 2023-10-05T21:15:19.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.405+0000 7f3851572680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:19.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.405+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af4ed0 con 0x7f383800d750 2023-10-05T21:15:19.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.406+0000 7f3843e49700 1 -- 172.21.15.153:0/2033087717 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3834019040 con 0x7f383800d750 2023-10-05T21:15:19.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.406+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94406731322064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af6460 con 0x7f383800d750 2023-10-05T21:15:19.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.406+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af6d00 con 0x55dcc7abdbb0 2023-10-05T21:15:19.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.406+0000 7f3843e49700 1 -- 172.21.15.153:0/2033087717 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94406731322064] v29'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3834019040 con 0x7f383800d750 2023-10-05T21:15:19.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.406+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.406+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94406731327504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af60b0 con 0x55dcc7abdbb0 2023-10-05T21:15:19.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.406+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af79a0 con 0x55dcc7aee060 2023-10-05T21:15:19.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.407+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94406731327504] v29'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.407+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3838014070 con 0x55dcc7aee060 2023-10-05T21:15:19.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.407+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94406731330608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af7da0 con 0x55dcc7aee060 2023-10-05T21:15:19.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.407+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af87b0 con 0x7f383800d750 2023-10-05T21:15:19.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.408+0000 7f3843e49700 1 -- 172.21.15.153:0/2033087717 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3834019040 con 0x7f383800d750 2023-10-05T21:15:19.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.408+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94406731334336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af9050 con 0x7f383800d750 2023-10-05T21:15:19.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.408+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af9a60 con 0x55dcc7abdbb0 2023-10-05T21:15:19.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.408+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94406731330608] v29'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3838014070 con 0x55dcc7aee060 2023-10-05T21:15:19.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.409+0000 7f3843e49700 1 -- 172.21.15.153:0/2033087717 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94406731334336] v29'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3834019040 con 0x7f383800d750 2023-10-05T21:15:19.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.409+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.409+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94406731328608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af9a60 con 0x55dcc7abdbb0 2023-10-05T21:15:19.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.409+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7afa350 con 0x7f3834007030 2023-10-05T21:15:19.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.410+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94406731328608] v29'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.410+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f383c00a570 con 0x7f3834007030 2023-10-05T21:15:19.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.410+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94406731339680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7afa140 con 0x7f3834007030 2023-10-05T21:15:19.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.410+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7afad20 con 0x7f3834007030 2023-10-05T21:15:19.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.410+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94406731339680] v29'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f383c00a570 con 0x7f3834007030 2023-10-05T21:15:19.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.410+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f383c00a570 con 0x7f3834007030 2023-10-05T21:15:19.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.410+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94406731343824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7aface0 con 0x7f3834007030 2023-10-05T21:15:19.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.410+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7afb780 con 0x7f3834007030 2023-10-05T21:15:19.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.411+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94406731343824] v29'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f383c00a570 con 0x7f3834007030 2023-10-05T21:15:19.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.411+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f383c00a570 con 0x7f3834007030 2023-10-05T21:15:19.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.411+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94406731340784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7afb780 con 0x7f3834007030 2023-10-05T21:15:19.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.411+0000 7f3851572680 20 add_watcher() i=0 2023-10-05T21:15:19.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.411+0000 7f3851572680 20 add_watcher() i=1 2023-10-05T21:15:19.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.411+0000 7f3851572680 20 add_watcher() i=2 2023-10-05T21:15:19.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.411+0000 7f3851572680 20 add_watcher() i=3 2023-10-05T21:15:19.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.411+0000 7f3851572680 20 add_watcher() i=4 2023-10-05T21:15:19.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.411+0000 7f3851572680 20 add_watcher() i=5 2023-10-05T21:15:19.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.411+0000 7f3851572680 20 add_watcher() i=6 2023-10-05T21:15:19.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.412+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94406731340784] v29'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f383c00a570 con 0x7f3834007030 2023-10-05T21:15:19.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.412+0000 7f3851572680 20 add_watcher() i=7 2023-10-05T21:15:19.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.412+0000 7f3851572680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:19.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.412+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7afebb0 con 0x55dcc7abdbb0 2023-10-05T21:15:19.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.412+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.412+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94406731347040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7afc060 con 0x55dcc7abdbb0 2023-10-05T21:15:19.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.413+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94406731347040] v29'154 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.413+0000 7f3815fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:19.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.413+0000 7f3851572680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:19.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.413+0000 7f3851572680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:19.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.413+0000 7f3851572680 1 Processor -- start 2023-10-05T21:15:19.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.413+0000 7f3851572680 1 -- start start 2023-10-05T21:15:19.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.414+0000 7f3851572680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7b08830 0x55dcc7b08c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.414+0000 7f3851572680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc7b09250 con 0x55dcc7b08830 2023-10-05T21:15:19.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.414+0000 7f3843e49700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7b08830 0x55dcc7b08c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.414+0000 7f3843e49700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7b08830 0x55dcc7b08c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38194/0 (socket says 172.21.15.153:38194) 2023-10-05T21:15:19.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.414+0000 7f3843e49700 1 -- 172.21.15.153:0/4076989797 learned_addr learned my addr 172.21.15.153:0/4076989797 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.414+0000 7f3843e49700 1 -- 172.21.15.153:0/4076989797 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcc7b09730 con 0x55dcc7b08830 2023-10-05T21:15:19.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.414+0000 7f3843e49700 1 --2- 172.21.15.153:0/4076989797 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7b08830 0x55dcc7b08c40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x55dcc7ab7f50 tx=0x7f3834012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147deccadc92aa5a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.414+0000 7f38157e2700 1 -- 172.21.15.153:0/4076989797 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f383401ddc0 con 0x55dcc7b08830 2023-10-05T21:15:19.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.414+0000 7f38157e2700 1 -- 172.21.15.153:0/4076989797 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383402b450 con 0x55dcc7b08830 2023-10-05T21:15:19.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.414+0000 7f38157e2700 1 -- 172.21.15.153:0/4076989797 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f383402b600 con 0x55dcc7b08830 2023-10-05T21:15:19.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.415+0000 7f3851572680 1 -- 172.21.15.153:0/4076989797 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7b08830 msgr2=0x55dcc7b08c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.415+0000 7f3851572680 1 --2- 172.21.15.153:0/4076989797 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7b08830 0x55dcc7b08c40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x55dcc7ab7f50 tx=0x7f3834012000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.415+0000 7f3851572680 1 -- 172.21.15.153:0/4076989797 shutdown_connections 2023-10-05T21:15:19.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.415+0000 7f3851572680 1 --2- 172.21.15.153:0/4076989797 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7b08830 0x55dcc7b08c40 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.415+0000 7f3851572680 1 -- 172.21.15.153:0/4076989797 >> 172.21.15.153:0/4076989797 conn(0x55dcc7b04b30 msgr2=0x55dcc7b02c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.415+0000 7f3851572680 1 -- 172.21.15.153:0/4076989797 shutdown_connections 2023-10-05T21:15:19.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.415+0000 7f3851572680 1 -- 172.21.15.153:0/4076989797 wait complete. 2023-10-05T21:15:19.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.416+0000 7f3851572680 1 Processor -- start 2023-10-05T21:15:19.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.416+0000 7f3851572680 1 -- start start 2023-10-05T21:15:19.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.416+0000 7f3851572680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7b08830 0x55dcc7b0f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.416+0000 7f3851572680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc7b0fac0 con 0x55dcc7b08830 2023-10-05T21:15:19.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.416+0000 7f3843e49700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7b08830 0x55dcc7b0f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.416+0000 7f3843e49700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7b08830 0x55dcc7b0f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38206/0 (socket says 172.21.15.153:38206) 2023-10-05T21:15:19.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.416+0000 7f3843e49700 1 -- 172.21.15.153:0/125333505 learned_addr learned my addr 172.21.15.153:0/125333505 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.416+0000 7f3843e49700 1 -- 172.21.15.153:0/125333505 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcc7ac14e0 con 0x55dcc7b08830 2023-10-05T21:15:19.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.416+0000 7f3843e49700 1 --2- 172.21.15.153:0/125333505 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7b08830 0x55dcc7b0f580 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x55dcc7b040a0 tx=0x7f3834031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.416+0000 7f378f7fe700 1 -- 172.21.15.153:0/125333505 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3834041660 con 0x55dcc7b08830 2023-10-05T21:15:19.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.416+0000 7f378f7fe700 1 -- 172.21.15.153:0/125333505 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38340417c0 con 0x55dcc7b08830 2023-10-05T21:15:19.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.416+0000 7f378f7fe700 1 -- 172.21.15.153:0/125333505 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3834041af0 con 0x55dcc7b08830 2023-10-05T21:15:19.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.416+0000 7f3851572680 1 -- 172.21.15.153:0/125333505 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dcc7b0fcc0 con 0x55dcc7b08830 2023-10-05T21:15:19.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.417+0000 7f3851572680 1 -- 172.21.15.153:0/125333505 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dcc7b10110 con 0x55dcc7b08830 2023-10-05T21:15:19.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.417+0000 7f378f7fe700 1 -- 172.21.15.153:0/125333505 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f3834026040 con 0x55dcc7b08830 2023-10-05T21:15:19.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.417+0000 7f378f7fe700 1 --2- 172.21.15.153:0/125333505 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f37840340f0 0x7f37840365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.417+0000 7f378f7fe700 1 -- 172.21.15.153:0/125333505 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f3834031070 con 0x55dcc7b08830 2023-10-05T21:15:19.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.417+0000 7f3844e4b700 1 --2- 172.21.15.153:0/125333505 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f37840340f0 0x7f37840365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.417+0000 7f3851572680 5 note: GC not initialized 2023-10-05T21:15:19.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.418+0000 7f3844e4b700 1 --2- 172.21.15.153:0/125333505 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f37840340f0 0x7f37840365a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55dcc7afbfc0 tx=0x7f383c037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.418+0000 7f378cff9700 20 reqs_thread_entry: start 2023-10-05T21:15:19.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.419+0000 7f37827fc700 20 reqs_thread_entry: start 2023-10-05T21:15:19.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.419+0000 7f3851572680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:19.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.419+0000 7f3851572680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:19.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.419+0000 7f3780ff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:49 2023 2023-10-05T21:15:19.451 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:19.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.419+0000 7f3767fff700 20 reqs_thread_entry: start 2023-10-05T21:15:19.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.419+0000 7f3851572680 1 --2- 172.21.15.153:0/125333505 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55dcc7b73d90 0x55dcc7b76170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.419+0000 7f3851572680 1 -- 172.21.15.153:0/125333505 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 6.d 6:b00f7326:::2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.4-myfoo4:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7b766b0 con 0x55dcc7b73d90 2023-10-05T21:15:19.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.419+0000 7f384464a700 1 --2- 172.21.15.153:0/125333505 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55dcc7b73d90 0x55dcc7b76170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.419+0000 7f384464a700 1 --2- 172.21.15.153:0/125333505 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55dcc7b73d90 0x55dcc7b76170 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.420+0000 7f384464a700 1 -- 172.21.15.153:0/125333505 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.4-myfoo4 [delete] v29'28 uv28 ondisk = 0) v8 ==== 208+0+0 (crc 0 0 0) 0x7f3838014070 con 0x55dcc7b73d90 2023-10-05T21:15:19.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.420+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94406731322064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7b335f0 con 0x7f383800d750 2023-10-05T21:15:19.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.421+0000 7f3843e49700 1 -- 172.21.15.153:0/2033087717 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(102 notify.0 [watch unwatch cookie 94406731322064] v29'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3834034040 con 0x7f383800d750 2023-10-05T21:15:19.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.421+0000 7f3851572680 20 remove_watcher() i=0 2023-10-05T21:15:19.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.421+0000 7f3851572680 2 removed watcher, disabling cache 2023-10-05T21:15:19.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.421+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94406731327504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af52d0 con 0x55dcc7abdbb0 2023-10-05T21:15:19.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.422+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(103 notify.1 [watch unwatch cookie 94406731327504] v29'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.422+0000 7f3851572680 20 remove_watcher() i=1 2023-10-05T21:15:19.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.422+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:104 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94406731330608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af52d0 con 0x55dcc7aee060 2023-10-05T21:15:19.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.423+0000 7f384464a700 1 -- 172.21.15.153:0/2033087717 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(104 notify.2 [watch unwatch cookie 94406731330608] v29'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3838014070 con 0x55dcc7aee060 2023-10-05T21:15:19.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.423+0000 7f3851572680 20 remove_watcher() i=2 2023-10-05T21:15:19.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.423+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94406731334336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af7430 con 0x7f383800d750 2023-10-05T21:15:19.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.424+0000 7f3843e49700 1 -- 172.21.15.153:0/2033087717 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(105 notify.3 [watch unwatch cookie 94406731334336] v29'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3834034040 con 0x7f383800d750 2023-10-05T21:15:19.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.424+0000 7f3851572680 20 remove_watcher() i=3 2023-10-05T21:15:19.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.424+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94406731328608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af52d0 con 0x55dcc7abdbb0 2023-10-05T21:15:19.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.425+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(106 notify.4 [watch unwatch cookie 94406731328608] v29'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.425+0000 7f3851572680 20 remove_watcher() i=4 2023-10-05T21:15:19.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.425+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:107 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94406731339680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af82c0 con 0x7f3834007030 2023-10-05T21:15:19.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.426+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(107 notify.5 [watch unwatch cookie 94406731339680] v29'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f383c00a570 con 0x7f3834007030 2023-10-05T21:15:19.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.426+0000 7f3851572680 20 remove_watcher() i=5 2023-10-05T21:15:19.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.426+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94406731343824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af52d0 con 0x7f3834007030 2023-10-05T21:15:19.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.426+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(108 notify.6 [watch unwatch cookie 94406731343824] v29'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f383c00a570 con 0x7f3834007030 2023-10-05T21:15:19.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.427+0000 7f3851572680 20 remove_watcher() i=6 2023-10-05T21:15:19.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.427+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94406731340784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af97a0 con 0x7f3834007030 2023-10-05T21:15:19.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.427+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(109 notify.7 [watch unwatch cookie 94406731340784] v29'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f383c00a570 con 0x7f3834007030 2023-10-05T21:15:19.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.427+0000 7f3851572680 20 remove_watcher() i=7 2023-10-05T21:15:19.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.428+0000 7f3815fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:19.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.428+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:110 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94406731347040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55dcc7af82c0 con 0x55dcc7abdbb0 2023-10-05T21:15:19.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.429+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(110 data_loggenerations_metadata [watch unwatch cookie 94406731347040] v29'155 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f383c00a570 con 0x55dcc7abdbb0 2023-10-05T21:15:19.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.429+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f3834007030 msgr2=0x7f383401d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.429+0000 7f3851572680 1 --2- 172.21.15.153:0/2033087717 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f3834007030 0x7f383401d420 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.429+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55dcc7abdbb0 msgr2=0x55dcc7aebbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.429+0000 7f3851572680 1 --2- 172.21.15.153:0/2033087717 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55dcc7abdbb0 0x55dcc7aebbf0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.429+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f383800d750 msgr2=0x7f3838017430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.429+0000 7f3851572680 1 --2- 172.21.15.153:0/2033087717 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f383800d750 0x7f3838017430 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.429+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55dcc7aee060 msgr2=0x55dcc7af0440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.429+0000 7f3851572680 1 --2- 172.21.15.153:0/2033087717 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55dcc7aee060 0x55dcc7af0440 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.429+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3830034140 msgr2=0x7f38300365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.429+0000 7f3851572680 1 --2- 172.21.15.153:0/2033087717 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3830034140 0x7f38300365f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3834003080 tx=0x7f3834015000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.429+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7a2b930 msgr2=0x55dcc7adfea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.429+0000 7f3844e4b700 1 -- 172.21.15.153:0/2033087717 reap_dead start 2023-10-05T21:15:19.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.429+0000 7f3851572680 1 --2- 172.21.15.153:0/2033087717 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7a2b930 0x55dcc7adfea0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f38380017b0 tx=0x7f3838016000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.429+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 shutdown_connections 2023-10-05T21:15:19.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.429+0000 7f3851572680 1 --2- 172.21.15.153:0/2033087717 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7a2b930 0x55dcc7adfea0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.429+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 >> 172.21.15.153:0/2033087717 conn(0x55dcc7ab1b80 msgr2=0x55dcc7ad2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.429+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 shutdown_connections 2023-10-05T21:15:19.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.429+0000 7f3851572680 1 -- 172.21.15.153:0/2033087717 wait complete. 2023-10-05T21:15:19.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.429+0000 7f3851572680 1 -- 172.21.15.153:0/125333505 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55dcc7b73d90 msgr2=0x55dcc7b76170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.429+0000 7f3851572680 1 --2- 172.21.15.153:0/125333505 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55dcc7b73d90 0x55dcc7b76170 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.429+0000 7f3851572680 1 -- 172.21.15.153:0/125333505 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f37840340f0 msgr2=0x7f37840365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.429+0000 7f3851572680 1 --2- 172.21.15.153:0/125333505 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f37840340f0 0x7f37840365a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55dcc7afbfc0 tx=0x7f383c037450 comp rx=0 tx=0).stop 2023-10-05T21:15:19.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.429+0000 7f3851572680 1 -- 172.21.15.153:0/125333505 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7b08830 msgr2=0x55dcc7b0f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.429+0000 7f3851572680 1 --2- 172.21.15.153:0/125333505 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7b08830 0x55dcc7b0f580 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x55dcc7b040a0 tx=0x7f3834031000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.430+0000 7f3851572680 1 -- 172.21.15.153:0/125333505 shutdown_connections 2023-10-05T21:15:19.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.430+0000 7f3851572680 1 --2- 172.21.15.153:0/125333505 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55dcc7b73d90 0x55dcc7b76170 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.430+0000 7f3851572680 1 --2- 172.21.15.153:0/125333505 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55dcc7b08830 0x55dcc7b0f580 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.430+0000 7f3851572680 1 --2- 172.21.15.153:0/125333505 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f37840340f0 0x7f37840365a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.430+0000 7f3851572680 1 -- 172.21.15.153:0/125333505 >> 172.21.15.153:0/125333505 conn(0x55dcc7b04b30 msgr2=0x55dcc7b02c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.430+0000 7f3851572680 1 -- 172.21.15.153:0/125333505 shutdown_connections 2023-10-05T21:15:19.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.430+0000 7f3851572680 1 -- 172.21.15.153:0/125333505 wait complete. 2023-10-05T21:15:19.462 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'show', '--object', '2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.3-myfoo3'] 2023-10-05T21:15:19.462 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'show', '--object', '2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.3-myfoo3'] 2023-10-05T21:15:19.462 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log show --object 2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.3-myfoo3 2023-10-05T21:15:19.506 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:19.506 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:19.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.505+0000 7f7ed4294680 1 Processor -- start 2023-10-05T21:15:19.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.505+0000 7f7ed4294680 1 -- start start 2023-10-05T21:15:19.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.505+0000 7f7ed4294680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55c1e64030a0 0x55c1e6494490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.505+0000 7f7ed4294680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c1e63dc990 con 0x55c1e64949d0 2023-10-05T21:15:19.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.505+0000 7f7ed4294680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c1e639cdb0 con 0x55c1e64030a0 2023-10-05T21:15:19.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.505+0000 7f7ec736c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55c1e64030a0 0x55c1e6494490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.505+0000 7f7ec6b6b700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55c1e64949d0 0x55c1e6496db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:55300/0 (socket says 172.21.15.153:55300) 2023-10-05T21:15:19.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.505+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/2343690420 learned_addr learned my addr 172.21.15.153:0/2343690420 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:19.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.505+0000 7f7ec736c700 1 -- 172.21.15.153:0/2343690420 >> v1:172.21.15.111:6789/0 conn(0x55c1e64949d0 legacy=0x55c1e6496db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.505+0000 7f7ec636a700 1 -- 172.21.15.153:0/2343690420 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2587488807 0 0) 0x55c1e63dc990 con 0x55c1e64949d0 2023-10-05T21:15:19.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.505+0000 7f7ec736c700 1 -- 172.21.15.153:0/2343690420 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1e64994e0 con 0x55c1e64030a0 2023-10-05T21:15:19.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.506+0000 7f7ec736c700 1 --2- 172.21.15.153:0/2343690420 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64030a0 0x55c1e6494490 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00a5d0 tx=0x7f7ebc005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd4504e18792d8f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.506+0000 7f7ec636a700 1 -- 172.21.15.153:0/2343690420 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ebc0086a0 con 0x55c1e64030a0 2023-10-05T21:15:19.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.506+0000 7f7ec636a700 1 -- 172.21.15.153:0/2343690420 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ebc008800 con 0x55c1e64030a0 2023-10-05T21:15:19.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.506+0000 7f7ec636a700 1 -- 172.21.15.153:0/2343690420 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ebc008ad0 con 0x55c1e64030a0 2023-10-05T21:15:19.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.506+0000 7f7ed4294680 1 -- 172.21.15.153:0/2343690420 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64030a0 msgr2=0x55c1e6494490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.506+0000 7f7ed4294680 1 --2- 172.21.15.153:0/2343690420 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64030a0 0x55c1e6494490 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00a5d0 tx=0x7f7ebc005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:19.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.506+0000 7f7ed4294680 1 -- 172.21.15.153:0/2343690420 shutdown_connections 2023-10-05T21:15:19.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.506+0000 7f7ed4294680 1 --2- 172.21.15.153:0/2343690420 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64030a0 0x55c1e6494490 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.506+0000 7f7ed4294680 1 -- 172.21.15.153:0/2343690420 >> 172.21.15.153:0/2343690420 conn(0x55c1e6489b80 msgr2=0x55c1e648bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.506+0000 7f7ed4294680 1 -- 172.21.15.153:0/2343690420 shutdown_connections 2023-10-05T21:15:19.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.506+0000 7f7ed4294680 1 -- 172.21.15.153:0/2343690420 wait complete. 2023-10-05T21:15:19.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.507+0000 7f7ed4294680 1 Processor -- start 2023-10-05T21:15:19.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.507+0000 7f7ed4294680 1 -- start start 2023-10-05T21:15:19.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.507+0000 7f7ed4294680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64030a0 0x55c1e64b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.507+0000 7f7ed4294680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1e633cea0 con 0x55c1e64030a0 2023-10-05T21:15:19.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.507+0000 7f7ec736c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64030a0 0x55c1e64b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.507+0000 7f7ec736c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64030a0 0x55c1e64b09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38218/0 (socket says 172.21.15.153:38218) 2023-10-05T21:15:19.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.507+0000 7f7ec736c700 1 -- 172.21.15.153:0/3426166095 learned_addr learned my addr 172.21.15.153:0/3426166095 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.507+0000 7f7ec736c700 1 -- 172.21.15.153:0/3426166095 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ebc005cf0 con 0x55c1e64030a0 2023-10-05T21:15:19.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.508+0000 7f7ec736c700 1 --2- 172.21.15.153:0/3426166095 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64030a0 0x55c1e64b09c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc000c00 tx=0x7f7ebc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b6eb222f352048 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.508+0000 7f7ec5368700 1 -- 172.21.15.153:0/3426166095 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ebc0086a0 con 0x55c1e64030a0 2023-10-05T21:15:19.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.508+0000 7f7ec5368700 1 -- 172.21.15.153:0/3426166095 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ebc008970 con 0x55c1e64030a0 2023-10-05T21:15:19.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.508+0000 7f7ec5368700 1 -- 172.21.15.153:0/3426166095 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ebc008b20 con 0x55c1e64030a0 2023-10-05T21:15:19.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.508+0000 7f7ed4294680 1 -- 172.21.15.153:0/3426166095 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64030a0 msgr2=0x55c1e64b09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.508+0000 7f7ed4294680 1 --2- 172.21.15.153:0/3426166095 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64030a0 0x55c1e64b09c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc000c00 tx=0x7f7ebc015000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.508+0000 7f7ed4294680 1 -- 172.21.15.153:0/3426166095 shutdown_connections 2023-10-05T21:15:19.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.508+0000 7f7ed4294680 1 --2- 172.21.15.153:0/3426166095 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64030a0 0x55c1e64b09c0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.508+0000 7f7ed4294680 1 -- 172.21.15.153:0/3426166095 >> 172.21.15.153:0/3426166095 conn(0x55c1e6489b80 msgr2=0x55c1e64ac490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.508+0000 7f7ed4294680 1 -- 172.21.15.153:0/3426166095 shutdown_connections 2023-10-05T21:15:19.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.508+0000 7f7ed4294680 1 -- 172.21.15.153:0/3426166095 wait complete. 2023-10-05T21:15:19.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.509+0000 7f7ed4294680 1 Processor -- start 2023-10-05T21:15:19.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.509+0000 7f7ed4294680 1 -- start start 2023-10-05T21:15:19.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.509+0000 7f7ed4294680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64949d0 0x55c1e64b7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.509+0000 7f7ed4294680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1e6333c80 con 0x55c1e64949d0 2023-10-05T21:15:19.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.509+0000 7f7ec736c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64949d0 0x55c1e64b7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.509+0000 7f7ec736c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64949d0 0x55c1e64b7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38220/0 (socket says 172.21.15.153:38220) 2023-10-05T21:15:19.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.509+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 learned_addr learned my addr 172.21.15.153:0/2327340854 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.509+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1e64994e0 con 0x55c1e64949d0 2023-10-05T21:15:19.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.509+0000 7f7ec736c700 1 --2- 172.21.15.153:0/2327340854 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64949d0 0x55c1e64b7e60 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00a520 tx=0x7f7ebc01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.510+0000 7f7eb77fe700 1 -- 172.21.15.153:0/2327340854 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ebc01d420 con 0x55c1e64949d0 2023-10-05T21:15:19.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.510+0000 7f7eb77fe700 1 -- 172.21.15.153:0/2327340854 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ebc01d5a0 con 0x55c1e64949d0 2023-10-05T21:15:19.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.510+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c1e64b83a0 con 0x55c1e64949d0 2023-10-05T21:15:19.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.510+0000 7f7eb77fe700 1 -- 172.21.15.153:0/2327340854 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ebc01d750 con 0x55c1e64949d0 2023-10-05T21:15:19.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.510+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c1e64b8790 con 0x55c1e64949d0 2023-10-05T21:15:19.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.510+0000 7f7eb77fe700 1 -- 172.21.15.153:0/2327340854 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f7ebc01d8b0 con 0x55c1e64949d0 2023-10-05T21:15:19.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.510+0000 7f7eb77fe700 1 --2- 172.21.15.153:0/2327340854 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7eac034140 0x7f7eac0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.510+0000 7f7ed4294680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.510+0000 7f7eb77fe700 1 -- 172.21.15.153:0/2327340854 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f7ebc04a1c0 con 0x55c1e64949d0 2023-10-05T21:15:19.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.511+0000 7f7ec6b6b700 1 --2- 172.21.15.153:0/2327340854 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7eac034140 0x7f7eac0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.511+0000 7f7ed4294680 1 --2- 172.21.15.153:0/2327340854 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55c1e64c1b00 0x55c1e64c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.511+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64c46f0 con 0x55c1e64c1b00 2023-10-05T21:15:19.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.511+0000 7f7ec7b6d700 1 --2- 172.21.15.153:0/2327340854 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55c1e64c1b00 0x55c1e64c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.511+0000 7f7ec6b6b700 1 --2- 172.21.15.153:0/2327340854 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7eac034140 0x7f7eac0365f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7eb80011e0 tx=0x7f7eb80013a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.511+0000 7f7ec7b6d700 1 --2- 172.21.15.153:0/2327340854 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55c1e64c1b00 0x55c1e64c3f60 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.511+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.511+0000 7f7ed4294680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.511+0000 7f7ed4294680 20 realm 2023-10-05T21:15:19.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.511+0000 7f7ed4294680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.511+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64c1170 con 0x55c1e64c1b00 2023-10-05T21:15:19.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.512+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.512+0000 7f7ed4294680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.512+0000 7f7ed4294680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:19.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.512+0000 7f7ed4294680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.512+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64c51a0 con 0x55c1e64c1b00 2023-10-05T21:15:19.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.512+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.512+0000 7f7ed4294680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.512+0000 7f7ed4294680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.512+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64c4dc0 con 0x55c1e64c1b00 2023-10-05T21:15:19.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.512+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.512+0000 7f7ed4294680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.512+0000 7f7ed4294680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.512+0000 7f7ed4294680 1 --2- 172.21.15.153:0/2327340854 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55c1e64c6540 0x55c1e64c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.512+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64c8e60 con 0x55c1e64c6540 2023-10-05T21:15:19.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.512+0000 7f7ec736c700 1 --2- 172.21.15.153:0/2327340854 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55c1e64c6540 0x55c1e64c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.512+0000 7f7ec736c700 1 --2- 172.21.15.153:0/2327340854 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55c1e64c6540 0x55c1e64c8920 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.513+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f7ebc036070 con 0x55c1e64c6540 2023-10-05T21:15:19.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.513+0000 7f7ed4294680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:19.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.513+0000 7f7ed4294680 20 searching for the correct realm 2023-10-05T21:15:19.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.513+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x55c1e64c6540 2023-10-05T21:15:19.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.513+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ebc041040 con 0x55c1e64c6540 2023-10-05T21:15:19.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.513+0000 7f7ec736c700 1 --2- 172.21.15.153:0/2327340854 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f7ebc030020 0x7f7ebc0065d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.513+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x7f7ebc030020 2023-10-05T21:15:19.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.513+0000 7f7ec6b6b700 1 --2- 172.21.15.153:0/2327340854 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f7ebc030020 0x7f7ebc0065d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.513+0000 7f7ec6b6b700 1 --2- 172.21.15.153:0/2327340854 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f7ebc030020 0x7f7ebc0065d0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.514+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/2327340854 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7eb8006070 con 0x7f7ebc030020 2023-10-05T21:15:19.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.514+0000 7f7ec6b6b700 1 --2- 172.21.15.153:0/2327340854 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f7eb800d8e0 0x7f7eb800c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.514+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x7f7eb800d8e0 2023-10-05T21:15:19.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.514+0000 7f7ec7b6d700 1 --2- 172.21.15.153:0/2327340854 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f7eb800d8e0 0x7f7eb800c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.514+0000 7f7ec7b6d700 1 --2- 172.21.15.153:0/2327340854 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f7eb800d8e0 0x7f7eb800c360 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.515+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ec000a570 con 0x7f7eb800d8e0 2023-10-05T21:15:19.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.515+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x55c1e64c1b00 2023-10-05T21:15:19.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.515+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.515+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x55c1e64c1b00 2023-10-05T21:15:19.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.515+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.515+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x7f7eb800d8e0 2023-10-05T21:15:19.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.515+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ec000a570 con 0x7f7eb800d8e0 2023-10-05T21:15:19.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.515+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x7f7eb800d8e0 2023-10-05T21:15:19.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.515+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ec000a570 con 0x7f7eb800d8e0 2023-10-05T21:15:19.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.515+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x7f7ebc030020 2023-10-05T21:15:19.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.516+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/2327340854 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7eb8006070 con 0x7f7ebc030020 2023-10-05T21:15:19.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.516+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x55c1e64c6540 2023-10-05T21:15:19.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.516+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f7ebc041040 con 0x55c1e64c6540 2023-10-05T21:15:19.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.516+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x55c1e64c1b00 2023-10-05T21:15:19.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.516+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.516+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x7f7eb800d8e0 2023-10-05T21:15:19.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.516+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ec000a570 con 0x7f7eb800d8e0 2023-10-05T21:15:19.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.516+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x55c1e64c1b00 2023-10-05T21:15:19.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.517+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.517+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x7f7ebc030020 2023-10-05T21:15:19.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.517+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/2327340854 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7eb8006070 con 0x7f7ebc030020 2023-10-05T21:15:19.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.517+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x55c1e64c6540 2023-10-05T21:15:19.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.517+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ebc041040 con 0x55c1e64c6540 2023-10-05T21:15:19.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.517+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x55c1e64c6540 2023-10-05T21:15:19.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.517+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ebc041040 con 0x55c1e64c6540 2023-10-05T21:15:19.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.517+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x7f7eb800d8e0 2023-10-05T21:15:19.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.518+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ec000a570 con 0x7f7eb800d8e0 2023-10-05T21:15:19.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.518+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x55c1e64c6540 2023-10-05T21:15:19.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.518+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ebc041040 con 0x55c1e64c6540 2023-10-05T21:15:19.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.518+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x55c1e64c6540 2023-10-05T21:15:19.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.518+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ebc041040 con 0x55c1e64c6540 2023-10-05T21:15:19.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.518+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x55c1e64c1b00 2023-10-05T21:15:19.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.518+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.518+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x55c1e64c1b00 2023-10-05T21:15:19.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.518+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.518+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x7f7eb800d8e0 2023-10-05T21:15:19.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.519+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ec000a570 con 0x7f7eb800d8e0 2023-10-05T21:15:19.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.519+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x55c1e64c6540 2023-10-05T21:15:19.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.519+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ebc041040 con 0x55c1e64c6540 2023-10-05T21:15:19.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.519+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x7f7ebc030020 2023-10-05T21:15:19.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.519+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/2327340854 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7eb8006070 con 0x7f7ebc030020 2023-10-05T21:15:19.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.519+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x55c1e64c1b00 2023-10-05T21:15:19.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.520+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.520+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x7f7eb800d8e0 2023-10-05T21:15:19.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.520+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ec000a570 con 0x7f7eb800d8e0 2023-10-05T21:15:19.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.520+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x55c1e64c6540 2023-10-05T21:15:19.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.520+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ebc041040 con 0x55c1e64c6540 2023-10-05T21:15:19.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.520+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x7f7eb800d8e0 2023-10-05T21:15:19.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.521+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ec000a570 con 0x7f7eb800d8e0 2023-10-05T21:15:19.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.521+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x7f7ebc030020 2023-10-05T21:15:19.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.521+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/2327340854 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7eb8006070 con 0x7f7ebc030020 2023-10-05T21:15:19.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.521+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x55c1e64c6540 2023-10-05T21:15:19.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.521+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ebc041040 con 0x55c1e64c6540 2023-10-05T21:15:19.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.521+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x7f7eb800d8e0 2023-10-05T21:15:19.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.521+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ec000a570 con 0x7f7eb800d8e0 2023-10-05T21:15:19.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.521+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x55c1e64c1b00 2023-10-05T21:15:19.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.521+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.521+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca710 con 0x7f7ebc030020 2023-10-05T21:15:19.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.522+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/2327340854 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7eb8006070 con 0x7f7ebc030020 2023-10-05T21:15:19.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.522+0000 7f7ed4294680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:19.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.522+0000 7f7ed4294680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:19.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.522+0000 7f7ed4294680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:19.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.522+0000 7f7ed4294680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:19.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.522+0000 7f7ed4294680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.522+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64c9830 con 0x55c1e64c1b00 2023-10-05T21:15:19.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.522+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.522+0000 7f7ed4294680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.522+0000 7f7ed4294680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.522+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64c9cc0 con 0x55c1e64c1b00 2023-10-05T21:15:19.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.522+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.522+0000 7f7ed4294680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.522+0000 7f7ed4294680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.522+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca0f0 con 0x55c1e64c1b00 2023-10-05T21:15:19.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.522+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.522+0000 7f7ed4294680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:19.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.522+0000 7f7ed4294680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.522+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64caac0 con 0x55c1e64c6540 2023-10-05T21:15:19.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.523+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f7ebc041040 con 0x55c1e64c6540 2023-10-05T21:15:19.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.523+0000 7f7ed4294680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.523+0000 7f7ed4294680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.523+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64cae70 con 0x55c1e64c1b00 2023-10-05T21:15:19.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.523+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.523+0000 7f7ed4294680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.523+0000 7f7ed4294680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.523+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64cb2a0 con 0x55c1e64c1b00 2023-10-05T21:15:19.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.523+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.523+0000 7f7ed4294680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.523+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64cc2b0 con 0x55c1e64c6540 2023-10-05T21:15:19.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.523+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ebc041040 con 0x55c1e64c6540 2023-10-05T21:15:19.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.523+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64cc2b0 con 0x7f7ebc030020 2023-10-05T21:15:19.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.524+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/2327340854 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7eb8006070 con 0x7f7ebc030020 2023-10-05T21:15:19.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.524+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64cc2b0 con 0x7f7eb800d8e0 2023-10-05T21:15:19.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.524+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ec000a570 con 0x7f7eb800d8e0 2023-10-05T21:15:19.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.524+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca0f0 con 0x55c1e64c1b00 2023-10-05T21:15:19.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.524+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.524+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca0f0 con 0x55c1e64c1b00 2023-10-05T21:15:19.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.524+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.524+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca0f0 con 0x7f7eb800d8e0 2023-10-05T21:15:19.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.525+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ec000a570 con 0x7f7eb800d8e0 2023-10-05T21:15:19.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.525+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca0f0 con 0x7f7eb800d8e0 2023-10-05T21:15:19.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.525+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ec000a570 con 0x7f7eb800d8e0 2023-10-05T21:15:19.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.525+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca0f0 con 0x7f7ebc030020 2023-10-05T21:15:19.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.525+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/2327340854 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7eb8006070 con 0x7f7ebc030020 2023-10-05T21:15:19.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.525+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca0f0 con 0x55c1e64c6540 2023-10-05T21:15:19.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.525+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f7ebc041040 con 0x55c1e64c6540 2023-10-05T21:15:19.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.525+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca0f0 con 0x55c1e64c1b00 2023-10-05T21:15:19.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.525+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.525+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca0f0 con 0x7f7eb800d8e0 2023-10-05T21:15:19.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.526+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ec000a570 con 0x7f7eb800d8e0 2023-10-05T21:15:19.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.526+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca0f0 con 0x55c1e64c1b00 2023-10-05T21:15:19.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.526+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.526+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca0f0 con 0x7f7ebc030020 2023-10-05T21:15:19.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.526+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/2327340854 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7eb8006070 con 0x7f7ebc030020 2023-10-05T21:15:19.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.526+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca0f0 con 0x55c1e64c6540 2023-10-05T21:15:19.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.526+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ebc041040 con 0x55c1e64c6540 2023-10-05T21:15:19.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.526+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca0f0 con 0x55c1e64c6540 2023-10-05T21:15:19.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.526+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ebc041040 con 0x55c1e64c6540 2023-10-05T21:15:19.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.526+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca0f0 con 0x7f7eb800d8e0 2023-10-05T21:15:19.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.527+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ec000a570 con 0x7f7eb800d8e0 2023-10-05T21:15:19.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.527+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca0f0 con 0x55c1e64c6540 2023-10-05T21:15:19.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.527+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ebc041040 con 0x55c1e64c6540 2023-10-05T21:15:19.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.527+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca0f0 con 0x55c1e64c6540 2023-10-05T21:15:19.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.527+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ebc052040 con 0x55c1e64c6540 2023-10-05T21:15:19.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.527+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca0f0 con 0x55c1e64c1b00 2023-10-05T21:15:19.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.527+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.527+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca0f0 con 0x55c1e64c1b00 2023-10-05T21:15:19.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.527+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.527+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca0f0 con 0x7f7eb800d8e0 2023-10-05T21:15:19.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.528+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ec000a570 con 0x7f7eb800d8e0 2023-10-05T21:15:19.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.528+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca0f0 con 0x55c1e64c6540 2023-10-05T21:15:19.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.528+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ebc052040 con 0x55c1e64c6540 2023-10-05T21:15:19.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.528+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca0f0 con 0x7f7ebc030020 2023-10-05T21:15:19.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.528+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/2327340854 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7eb8006070 con 0x7f7ebc030020 2023-10-05T21:15:19.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.528+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca0f0 con 0x55c1e64c1b00 2023-10-05T21:15:19.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.528+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.528+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca0f0 con 0x7f7eb800d8e0 2023-10-05T21:15:19.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.529+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ec000a570 con 0x7f7eb800d8e0 2023-10-05T21:15:19.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.529+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca0f0 con 0x55c1e64c6540 2023-10-05T21:15:19.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.529+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ebc052040 con 0x55c1e64c6540 2023-10-05T21:15:19.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.529+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca0f0 con 0x7f7eb800d8e0 2023-10-05T21:15:19.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.529+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ec000a570 con 0x7f7eb800d8e0 2023-10-05T21:15:19.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.529+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca0f0 con 0x7f7ebc030020 2023-10-05T21:15:19.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.530+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/2327340854 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7eb8006070 con 0x7f7ebc030020 2023-10-05T21:15:19.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.530+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca0f0 con 0x55c1e64c6540 2023-10-05T21:15:19.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.530+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ebc052040 con 0x55c1e64c6540 2023-10-05T21:15:19.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.530+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca0f0 con 0x7f7eb800d8e0 2023-10-05T21:15:19.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.531+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ec000a570 con 0x7f7eb800d8e0 2023-10-05T21:15:19.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.531+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca0f0 con 0x55c1e64c1b00 2023-10-05T21:15:19.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.531+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.531+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ca0f0 con 0x7f7ebc030020 2023-10-05T21:15:19.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.531+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/2327340854 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7eb8006070 con 0x7f7ebc030020 2023-10-05T21:15:19.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.531+0000 7f7ed4294680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:19.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.531+0000 7f7ed4294680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:19.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.531+0000 7f7ed4294680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:19.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.531+0000 7f7ed4294680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:19.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.531+0000 7f7ed4294680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.531+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64cb2a0 con 0x55c1e64c1b00 2023-10-05T21:15:19.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.531+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.531+0000 7f7ed4294680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.531+0000 7f7ed4294680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.531+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64cb650 con 0x55c1e64c6540 2023-10-05T21:15:19.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.532+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f7ebc052040 con 0x55c1e64c6540 2023-10-05T21:15:19.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.532+0000 7f7ed4294680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:19.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.532+0000 7f7ed4294680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.532+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64c9430 con 0x55c1e64c1b00 2023-10-05T21:15:19.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.532+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.532+0000 7f7ed4294680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.532+0000 7f7ed4294680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.532+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64c9400 con 0x55c1e64c1b00 2023-10-05T21:15:19.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.532+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.532+0000 7f7ed4294680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:19.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.532+0000 7f7ed4294680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.532+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64cbf40 con 0x7f7eb800d8e0 2023-10-05T21:15:19.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.533+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f7ec000a570 con 0x7f7eb800d8e0 2023-10-05T21:15:19.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.533+0000 7f7ed4294680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.533+0000 7f7ed4294680 20 zone default found 2023-10-05T21:15:19.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.533+0000 7f7ed4294680 4 Realm: () 2023-10-05T21:15:19.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.533+0000 7f7ed4294680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:19.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.533+0000 7f7ed4294680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:19.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.533+0000 7f7ed4294680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:19.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.533+0000 7f7ed4294680 20 zonegroup default 2023-10-05T21:15:19.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.533+0000 7f7ed4294680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.533+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64cbef0 con 0x7f7eb800d8e0 2023-10-05T21:15:19.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.533+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f7ec000a570 con 0x7f7eb800d8e0 2023-10-05T21:15:19.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.533+0000 7f7ed4294680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.533+0000 7f7ed4294680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.533+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64cd870 con 0x55c1e64c6540 2023-10-05T21:15:19.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.533+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7ebc052040 con 0x55c1e64c6540 2023-10-05T21:15:19.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.533+0000 7f7ed4294680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.533+0000 7f7ed4294680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.533+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64cdc20 con 0x55c1e64c6540 2023-10-05T21:15:19.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.533+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7ebc052040 con 0x55c1e64c6540 2023-10-05T21:15:19.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.533+0000 7f7ed4294680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.533+0000 7f7ed4294680 20 started sync module instance, tier type = 2023-10-05T21:15:19.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.533+0000 7f7ed4294680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:19.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.533+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ccf30 con 0x7f7ebc030020 2023-10-05T21:15:19.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.534+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/2327340854 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7eb8006070 con 0x7f7ebc030020 2023-10-05T21:15:19.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.534+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94291280841280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64cd4b0 con 0x7f7ebc030020 2023-10-05T21:15:19.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.534+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ceba0 con 0x55c1e64c1b00 2023-10-05T21:15:19.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.535+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/2327340854 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94291280841280] v29'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7eb8006070 con 0x7f7ebc030020 2023-10-05T21:15:19.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.535+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.535+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94291280848432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64cefa0 con 0x55c1e64c1b00 2023-10-05T21:15:19.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.535+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64cf9b0 con 0x55c1e64c6540 2023-10-05T21:15:19.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.536+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94291280848432] v29'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.536+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ebc052040 con 0x55c1e64c6540 2023-10-05T21:15:19.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.536+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94291280852160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64cfdb0 con 0x55c1e64c6540 2023-10-05T21:15:19.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.536+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64d07c0 con 0x7f7ebc030020 2023-10-05T21:15:19.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.537+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94291280852160] v29'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ebc052040 con 0x55c1e64c6540 2023-10-05T21:15:19.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.537+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/2327340854 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7eb8006070 con 0x7f7ebc030020 2023-10-05T21:15:19.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.537+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94291280855760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64d0b70 con 0x7f7ebc030020 2023-10-05T21:15:19.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.537+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64d1580 con 0x55c1e64c1b00 2023-10-05T21:15:19.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.537+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.537+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/2327340854 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94291280855760] v29'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7eb8006070 con 0x7f7ebc030020 2023-10-05T21:15:19.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.538+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94291280846800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64d17b0 con 0x55c1e64c1b00 2023-10-05T21:15:19.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.538+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64d2310 con 0x7f7eb800d8e0 2023-10-05T21:15:19.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.538+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94291280846800] v29'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.539+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ec000a570 con 0x7f7eb800d8e0 2023-10-05T21:15:19.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.539+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94291280862656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64d17b0 con 0x7f7eb800d8e0 2023-10-05T21:15:19.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.539+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64d2d70 con 0x7f7eb800d8e0 2023-10-05T21:15:19.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.539+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94291280862656] v29'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ec000a570 con 0x7f7eb800d8e0 2023-10-05T21:15:19.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.539+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ec000a570 con 0x7f7eb800d8e0 2023-10-05T21:15:19.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.539+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94291280859840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64d2d70 con 0x7f7eb800d8e0 2023-10-05T21:15:19.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.539+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64d37f0 con 0x7f7eb800d8e0 2023-10-05T21:15:19.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.540+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94291280859840] v29'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ec000a570 con 0x7f7eb800d8e0 2023-10-05T21:15:19.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.540+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ec000a570 con 0x7f7eb800d8e0 2023-10-05T21:15:19.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.540+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94291280868032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64d2d70 con 0x7f7eb800d8e0 2023-10-05T21:15:19.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.540+0000 7f7ed4294680 20 add_watcher() i=0 2023-10-05T21:15:19.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.540+0000 7f7ed4294680 20 add_watcher() i=1 2023-10-05T21:15:19.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.540+0000 7f7ed4294680 20 add_watcher() i=2 2023-10-05T21:15:19.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.540+0000 7f7ed4294680 20 add_watcher() i=3 2023-10-05T21:15:19.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.540+0000 7f7ed4294680 20 add_watcher() i=4 2023-10-05T21:15:19.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.540+0000 7f7ed4294680 20 add_watcher() i=5 2023-10-05T21:15:19.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.540+0000 7f7ed4294680 20 add_watcher() i=6 2023-10-05T21:15:19.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.541+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94291280868032] v29'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ec000a570 con 0x7f7eb800d8e0 2023-10-05T21:15:19.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.541+0000 7f7ed4294680 20 add_watcher() i=7 2023-10-05T21:15:19.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.541+0000 7f7ed4294680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:19.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.541+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64d6c20 con 0x55c1e64c1b00 2023-10-05T21:15:19.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.541+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.541+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94291280865872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64d40c0 con 0x55c1e64c1b00 2023-10-05T21:15:19.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.542+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94291280865872] v29'156 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.542+0000 7f7e13fff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:19.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.542+0000 7f7ed4294680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:19.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.542+0000 7f7ed4294680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:19.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.542+0000 7f7ed4294680 1 Processor -- start 2023-10-05T21:15:19.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.542+0000 7f7ed4294680 1 -- start start 2023-10-05T21:15:19.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.542+0000 7f7ed4294680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64e1580 0x55c1e64e1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.542+0000 7f7ed4294680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1e64e1f60 con 0x55c1e64e1580 2023-10-05T21:15:19.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.543+0000 7f7ec6b6b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64e1580 0x55c1e64e1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.543+0000 7f7ec6b6b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64e1580 0x55c1e64e1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38232/0 (socket says 172.21.15.153:38232) 2023-10-05T21:15:19.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.543+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/1095762026 learned_addr learned my addr 172.21.15.153:0/1095762026 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.543+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/1095762026 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1e64e20a0 con 0x55c1e64e1580 2023-10-05T21:15:19.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.543+0000 7f7ec6b6b700 1 --2- 172.21.15.153:0/1095762026 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64e1580 0x55c1e64e1990 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x55c1e64c5ce0 tx=0x7f7eb8006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df73c1dfd3af2072 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.543+0000 7f7e137fe700 1 -- 172.21.15.153:0/1095762026 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7eb8023040 con 0x55c1e64e1580 2023-10-05T21:15:19.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.543+0000 7f7e137fe700 1 -- 172.21.15.153:0/1095762026 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb8024040 con 0x55c1e64e1580 2023-10-05T21:15:19.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.543+0000 7f7e137fe700 1 -- 172.21.15.153:0/1095762026 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7eb8013040 con 0x55c1e64e1580 2023-10-05T21:15:19.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.544+0000 7f7ed4294680 1 -- 172.21.15.153:0/1095762026 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64e1580 msgr2=0x55c1e64e1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.544+0000 7f7ed4294680 1 --2- 172.21.15.153:0/1095762026 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64e1580 0x55c1e64e1990 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x55c1e64c5ce0 tx=0x7f7eb8006000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.544+0000 7f7ed4294680 1 -- 172.21.15.153:0/1095762026 shutdown_connections 2023-10-05T21:15:19.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.544+0000 7f7ed4294680 1 --2- 172.21.15.153:0/1095762026 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64e1580 0x55c1e64e1990 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.544+0000 7f7ed4294680 1 -- 172.21.15.153:0/1095762026 >> 172.21.15.153:0/1095762026 conn(0x55c1e64dc780 msgr2=0x55c1e64da8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.544+0000 7f7ed4294680 1 -- 172.21.15.153:0/1095762026 shutdown_connections 2023-10-05T21:15:19.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.544+0000 7f7ed4294680 1 -- 172.21.15.153:0/1095762026 wait complete. 2023-10-05T21:15:19.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.544+0000 7f7ed4294680 1 Processor -- start 2023-10-05T21:15:19.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.545+0000 7f7ed4294680 1 -- start start 2023-10-05T21:15:19.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.545+0000 7f7ed4294680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64e1580 0x55c1e64e7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.545+0000 7f7ed4294680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1e64e75c0 con 0x55c1e64e1580 2023-10-05T21:15:19.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.545+0000 7f7ec6b6b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64e1580 0x55c1e64e7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.545+0000 7f7ec6b6b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64e1580 0x55c1e64e7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38236/0 (socket says 172.21.15.153:38236) 2023-10-05T21:15:19.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.545+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/892440786 learned_addr learned my addr 172.21.15.153:0/892440786 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.545+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/892440786 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb800ed60 con 0x55c1e64e1580 2023-10-05T21:15:19.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.545+0000 7f7ec6b6b700 1 --2- 172.21.15.153:0/892440786 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64e1580 0x55c1e64e7080 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x55c1e64c5550 tx=0x7f7eb8030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.545+0000 7f7e11ffb700 1 -- 172.21.15.153:0/892440786 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7eb8023040 con 0x55c1e64e1580 2023-10-05T21:15:19.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.545+0000 7f7e11ffb700 1 -- 172.21.15.153:0/892440786 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb801e4f0 con 0x55c1e64e1580 2023-10-05T21:15:19.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.545+0000 7f7ed4294680 1 -- 172.21.15.153:0/892440786 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c1e64e77c0 con 0x55c1e64e1580 2023-10-05T21:15:19.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.545+0000 7f7e11ffb700 1 -- 172.21.15.153:0/892440786 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7eb801e6c0 con 0x55c1e64e1580 2023-10-05T21:15:19.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.545+0000 7f7ed4294680 1 -- 172.21.15.153:0/892440786 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c1e64e7c10 con 0x55c1e64e1580 2023-10-05T21:15:19.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.546+0000 7f7e11ffb700 1 -- 172.21.15.153:0/892440786 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f7eb801e820 con 0x55c1e64e1580 2023-10-05T21:15:19.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.546+0000 7f7e11ffb700 1 --2- 172.21.15.153:0/892440786 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7e04034140 0x7f7e040365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.546+0000 7f7e11ffb700 1 -- 172.21.15.153:0/892440786 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f7eb8044ab0 con 0x55c1e64e1580 2023-10-05T21:15:19.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.546+0000 7f7ec7b6d700 1 --2- 172.21.15.153:0/892440786 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7e04034140 0x7f7e040365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.546+0000 7f7ed4294680 5 note: GC not initialized 2023-10-05T21:15:19.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.547+0000 7f7ec7b6d700 1 --2- 172.21.15.153:0/892440786 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7e04034140 0x7f7e040365f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55c1e64d2fb0 tx=0x7f7ec000af10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.547+0000 7f7e0affd700 20 reqs_thread_entry: start 2023-10-05T21:15:19.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.547+0000 7f7e08ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:19.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.547+0000 7f7ed4294680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:19.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.548+0000 7f7ed4294680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:19.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.548+0000 7f7df6ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:49 2023 2023-10-05T21:15:19.574 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:19.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.548+0000 7f7df67fc700 20 reqs_thread_entry: start 2023-10-05T21:15:19.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.548+0000 7f7ed4294680 10 log_show_next pos 0 bl 0 off 0 eof 0 2023-10-05T21:15:19.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.548+0000 7f7ed4294680 1 --2- 172.21.15.153:0/892440786 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55c1e654b8f0 0x55c1e654dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.548+0000 7f7ed4294680 1 -- 172.21.15.153:0/892440786 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:1 6.1d 6:be4cd13f:::2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.3-myfoo3:head [read 0~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e654e210 con 0x55c1e654b8f0 2023-10-05T21:15:19.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.548+0000 7f7ec736c700 1 --2- 172.21.15.153:0/892440786 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55c1e654b8f0 0x55c1e654dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.548+0000 7f7ec736c700 1 --2- 172.21.15.153:0/892440786 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55c1e654b8f0 0x55c1e654dcd0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.549+0000 7f7ec736c700 1 -- 172.21.15.153:0/892440786 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(1 2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.3-myfoo3 [read 0~850 out=850b] v0'0 uv23 ondisk = 0) v8 ==== 208+0+850 (crc 0 0 0) 0x7f7ebc052040 con 0x55c1e654b8f0 2023-10-05T21:15:19.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.549+0000 7f7ed4294680 10 read 850 2023-10-05T21:15:19.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.549+0000 7f7ed4294680 10 log_show_next pos 850 bl 850 off 419 eof 1 2023-10-05T21:15:19.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.549+0000 7f7ed4294680 10 log_show_next pos 850 bl 850 off 850 eof 1 2023-10-05T21:15:19.575 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:19.575 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_id": "193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.3", 2023-10-05T21:15:19.575 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_owner": "foo", 2023-10-05T21:15:19.576 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo3", 2023-10-05T21:15:19.576 INFO:teuthology.orchestra.run.smithi153.stdout: "log_entries": [ 2023-10-05T21:15:19.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:19.576 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo3", 2023-10-05T21:15:19.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:15:15.856035Z", 2023-10-05T21:15:19.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time_local": "2023-10-05T21:15:15.856035+0000", 2023-10-05T21:15:19.576 INFO:teuthology.orchestra.run.smithi153.stdout: "remote_addr": "172.21.0.51", 2023-10-05T21:15:19.576 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:19.576 INFO:teuthology.orchestra.run.smithi153.stdout: "operation": "create_bucket", 2023-10-05T21:15:19.576 INFO:teuthology.orchestra.run.smithi153.stdout: "uri": "PUT /myfoo3/ HTTP/1.1", 2023-10-05T21:15:19.576 INFO:teuthology.orchestra.run.smithi153.stdout: "http_status": "200", 2023-10-05T21:15:19.576 INFO:teuthology.orchestra.run.smithi153.stdout: "error_code": "", 2023-10-05T21:15:19.577 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:15:19.577 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:15:19.577 INFO:teuthology.orchestra.run.smithi153.stdout: "object_size": 0, 2023-10-05T21:15:19.577 INFO:teuthology.orchestra.run.smithi153.stdout: "total_time": 6, 2023-10-05T21:15:19.577 INFO:teuthology.orchestra.run.smithi153.stdout: "user_agent": "Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic", 2023-10-05T21:15:19.577 INFO:teuthology.orchestra.run.smithi153.stdout: "referrer": "", 2023-10-05T21:15:19.577 INFO:teuthology.orchestra.run.smithi153.stdout: "trans_id": "tx00000b8a787601ab60c58-00651f2763-107c-default", 2023-10-05T21:15:19.577 INFO:teuthology.orchestra.run.smithi153.stdout: "authentication_type": "Local", 2023-10-05T21:15:19.577 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key_id": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:19.577 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url": false 2023-10-05T21:15:19.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:19.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:19.578 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo3", 2023-10-05T21:15:19.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:15:15.943033Z", 2023-10-05T21:15:19.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time_local": "2023-10-05T21:15:15.943033+0000", 2023-10-05T21:15:19.578 INFO:teuthology.orchestra.run.smithi153.stdout: "remote_addr": "172.21.0.51", 2023-10-05T21:15:19.578 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:19.578 INFO:teuthology.orchestra.run.smithi153.stdout: "operation": "delete_bucket", 2023-10-05T21:15:19.578 INFO:teuthology.orchestra.run.smithi153.stdout: "uri": "DELETE /myfoo3/ HTTP/1.1", 2023-10-05T21:15:19.578 INFO:teuthology.orchestra.run.smithi153.stdout: "http_status": "204", 2023-10-05T21:15:19.578 INFO:teuthology.orchestra.run.smithi153.stdout: "error_code": "NoContent", 2023-10-05T21:15:19.578 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:15:19.578 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:15:19.579 INFO:teuthology.orchestra.run.smithi153.stdout: "object_size": 0, 2023-10-05T21:15:19.579 INFO:teuthology.orchestra.run.smithi153.stdout: "total_time": 26, 2023-10-05T21:15:19.579 INFO:teuthology.orchestra.run.smithi153.stdout: "user_agent": "Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic", 2023-10-05T21:15:19.579 INFO:teuthology.orchestra.run.smithi153.stdout: "referrer": "", 2023-10-05T21:15:19.579 INFO:teuthology.orchestra.run.smithi153.stdout: "trans_id": "tx000008b4c05a0aadd1c51-00651f2763-107c-default", 2023-10-05T21:15:19.579 INFO:teuthology.orchestra.run.smithi153.stdout: "authentication_type": "Local", 2023-10-05T21:15:19.579 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key_id": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:19.579 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url": false 2023-10-05T21:15:19.579 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:19.581 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:19.581 INFO:teuthology.orchestra.run.smithi153.stdout: "log_sum": { 2023-10-05T21:15:19.581 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:15:19.581 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:15:19.581 INFO:teuthology.orchestra.run.smithi153.stdout: "total_time": 32, 2023-10-05T21:15:19.582 INFO:teuthology.orchestra.run.smithi153.stdout: "total_entries": 2 2023-10-05T21:15:19.582 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:19.582 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:19.582 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:15:19.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.549+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94291280841280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e650b640 con 0x7f7ebc030020 2023-10-05T21:15:19.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.550+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/2327340854 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(102 notify.0 [watch unwatch cookie 94291280841280] v29'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7eb8006070 con 0x7f7ebc030020 2023-10-05T21:15:19.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.550+0000 7f7ed4294680 20 remove_watcher() i=0 2023-10-05T21:15:19.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.550+0000 7f7ed4294680 2 removed watcher, disabling cache 2023-10-05T21:15:19.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.550+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94291280848432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64cca40 con 0x55c1e64c1b00 2023-10-05T21:15:19.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.551+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(103 notify.1 [watch unwatch cookie 94291280848432] v29'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.551+0000 7f7ed4294680 20 remove_watcher() i=1 2023-10-05T21:15:19.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.551+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:104 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94291280852160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64ce630 con 0x55c1e64c6540 2023-10-05T21:15:19.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.551+0000 7f7ec736c700 1 -- 172.21.15.153:0/2327340854 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(104 notify.2 [watch unwatch cookie 94291280852160] v29'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ebc052040 con 0x55c1e64c6540 2023-10-05T21:15:19.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.551+0000 7f7ed4294680 20 remove_watcher() i=2 2023-10-05T21:15:19.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.551+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94291280855760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64cf4c0 con 0x7f7ebc030020 2023-10-05T21:15:19.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.552+0000 7f7ec6b6b700 1 -- 172.21.15.153:0/2327340854 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(105 notify.3 [watch unwatch cookie 94291280855760] v29'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7eb8006070 con 0x7f7ebc030020 2023-10-05T21:15:19.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.552+0000 7f7ed4294680 20 remove_watcher() i=3 2023-10-05T21:15:19.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.552+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94291280846800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64d02d0 con 0x55c1e64c1b00 2023-10-05T21:15:19.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.553+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(106 notify.4 [watch unwatch cookie 94291280846800] v29'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.553+0000 7f7ed4294680 20 remove_watcher() i=4 2023-10-05T21:15:19.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.553+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:107 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94291280862656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64d02d0 con 0x7f7eb800d8e0 2023-10-05T21:15:19.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.553+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(107 notify.5 [watch unwatch cookie 94291280862656] v29'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ec000a570 con 0x7f7eb800d8e0 2023-10-05T21:15:19.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.554+0000 7f7ed4294680 20 remove_watcher() i=5 2023-10-05T21:15:19.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.554+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94291280859840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64d1dc0 con 0x7f7eb800d8e0 2023-10-05T21:15:19.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.554+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(108 notify.6 [watch unwatch cookie 94291280859840] v29'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ec000a570 con 0x7f7eb800d8e0 2023-10-05T21:15:19.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.554+0000 7f7ed4294680 20 remove_watcher() i=6 2023-10-05T21:15:19.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.554+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94291280868032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64d02d0 con 0x7f7eb800d8e0 2023-10-05T21:15:19.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.555+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(109 notify.7 [watch unwatch cookie 94291280868032] v29'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ec000a570 con 0x7f7eb800d8e0 2023-10-05T21:15:19.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.555+0000 7f7ed4294680 20 remove_watcher() i=7 2023-10-05T21:15:19.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.556+0000 7f7e13fff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:19.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.556+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:110 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94291280865872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c1e64d1dc0 con 0x55c1e64c1b00 2023-10-05T21:15:19.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.556+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(110 data_loggenerations_metadata [watch unwatch cookie 94291280865872] v29'157 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7ec000a570 con 0x55c1e64c1b00 2023-10-05T21:15:19.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.557+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f7eb800d8e0 msgr2=0x7f7eb800c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.557+0000 7f7ed4294680 1 --2- 172.21.15.153:0/2327340854 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f7eb800d8e0 0x7f7eb800c360 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.557+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55c1e64c1b00 msgr2=0x55c1e64c3f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.557+0000 7f7ed4294680 1 --2- 172.21.15.153:0/2327340854 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55c1e64c1b00 0x55c1e64c3f60 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.557+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f7ebc030020 msgr2=0x7f7ebc0065d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.557+0000 7f7ed4294680 1 --2- 172.21.15.153:0/2327340854 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f7ebc030020 0x7f7ebc0065d0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.557+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55c1e64c6540 msgr2=0x55c1e64c8920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.557+0000 7f7ed4294680 1 --2- 172.21.15.153:0/2327340854 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55c1e64c6540 0x55c1e64c8920 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.557+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7eac034140 msgr2=0x7f7eac0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.557+0000 7f7ed4294680 1 --2- 172.21.15.153:0/2327340854 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7eac034140 0x7f7eac0365f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7eb80011e0 tx=0x7f7eb80013a0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.557+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64949d0 msgr2=0x55c1e64b7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.557+0000 7f7ec7b6d700 1 -- 172.21.15.153:0/2327340854 reap_dead start 2023-10-05T21:15:19.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.557+0000 7f7ed4294680 1 --2- 172.21.15.153:0/2327340854 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64949d0 0x55c1e64b7e60 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00a520 tx=0x7f7ebc01d000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.557+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 shutdown_connections 2023-10-05T21:15:19.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.557+0000 7f7ed4294680 1 --2- 172.21.15.153:0/2327340854 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64949d0 0x55c1e64b7e60 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.557+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 >> 172.21.15.153:0/2327340854 conn(0x55c1e6489b80 msgr2=0x55c1e64aacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.557+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 shutdown_connections 2023-10-05T21:15:19.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.557+0000 7f7ed4294680 1 -- 172.21.15.153:0/2327340854 wait complete. 2023-10-05T21:15:19.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.557+0000 7f7ed4294680 1 -- 172.21.15.153:0/892440786 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55c1e654b8f0 msgr2=0x55c1e654dcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.557+0000 7f7ed4294680 1 --2- 172.21.15.153:0/892440786 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55c1e654b8f0 0x55c1e654dcd0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.557+0000 7f7ed4294680 1 -- 172.21.15.153:0/892440786 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7e04034140 msgr2=0x7f7e040365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.557+0000 7f7ed4294680 1 --2- 172.21.15.153:0/892440786 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7e04034140 0x7f7e040365f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55c1e64d2fb0 tx=0x7f7ec000af10 comp rx=0 tx=0).stop 2023-10-05T21:15:19.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.557+0000 7f7ed4294680 1 -- 172.21.15.153:0/892440786 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64e1580 msgr2=0x55c1e64e7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.557+0000 7f7ed4294680 1 --2- 172.21.15.153:0/892440786 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64e1580 0x55c1e64e7080 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x55c1e64c5550 tx=0x7f7eb8030000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.557+0000 7f7ed4294680 1 -- 172.21.15.153:0/892440786 shutdown_connections 2023-10-05T21:15:19.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.557+0000 7f7ed4294680 1 --2- 172.21.15.153:0/892440786 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55c1e654b8f0 0x55c1e654dcd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.557+0000 7f7ed4294680 1 --2- 172.21.15.153:0/892440786 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c1e64e1580 0x55c1e64e7080 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.557+0000 7f7ed4294680 1 --2- 172.21.15.153:0/892440786 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f7e04034140 0x7f7e040365f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.557+0000 7f7ed4294680 1 -- 172.21.15.153:0/892440786 >> 172.21.15.153:0/892440786 conn(0x55c1e64dc780 msgr2=0x55c1e64da8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.557+0000 7f7ed4294680 1 -- 172.21.15.153:0/892440786 shutdown_connections 2023-10-05T21:15:19.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.557+0000 7f7ed4294680 1 -- 172.21.15.153:0/892440786 wait complete. 2023-10-05T21:15:19.592 DEBUG:tasks.util.rgw: json result: {'bucket_id': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.3', 'bucket_owner': 'foo', 'bucket': 'myfoo3', 'log_entries': [{'bucket': 'myfoo3', 'time': '2023-10-05T21:15:15.856035Z', 'time_local': '2023-10-05T21:15:15.856035+0000', 'remote_addr': '172.21.0.51', 'user': 'foo', 'operation': 'create_bucket', 'uri': 'PUT /myfoo3/ HTTP/1.1', 'http_status': '200', 'error_code': '', 'bytes_sent': 0, 'bytes_received': 0, 'object_size': 0, 'total_time': 6, 'user_agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic', 'referrer': '', 'trans_id': 'tx00000b8a787601ab60c58-00651f2763-107c-default', 'authentication_type': 'Local', 'access_key_id': '9te6NH5mcdcq0Tc5i8i1', 'temp_url': False}, {'bucket': 'myfoo3', 'time': '2023-10-05T21:15:15.943033Z', 'time_local': '2023-10-05T21:15:15.943033+0000', 'remote_addr': '172.21.0.51', 'user': 'foo', 'operation': 'delete_bucket', 'uri': 'DELETE /myfoo3/ HTTP/1.1', 'http_status': '204', 'error_code': 'NoContent', 'bytes_sent': 0, 'bytes_received': 0, 'object_size': 0, 'total_time': 26, 'user_agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic', 'referrer': '', 'trans_id': 'tx000008b4c05a0aadd1c51-00651f2763-107c-default', 'authentication_type': 'Local', 'access_key_id': '9te6NH5mcdcq0Tc5i8i1', 'temp_url': False}], 'log_sum': {'bytes_sent': 0, 'bytes_received': 0, 'total_time': 32, 'total_entries': 2}} 2023-10-05T21:15:19.592 DEBUG:tasks.radosgw_admin:checking log entry: 2023-10-05T21:15:19.593 DEBUG:tasks.radosgw_admin:checking log entry: 2023-10-05T21:15:19.593 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'rm', '--object', '2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.3-myfoo3'] 2023-10-05T21:15:19.593 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'rm', '--object', '2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.3-myfoo3'] 2023-10-05T21:15:19.593 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log rm --object 2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.3-myfoo3 2023-10-05T21:15:19.637 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:19.637 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:19.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.635+0000 7f2be7c40680 1 Processor -- start 2023-10-05T21:15:19.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.635+0000 7f2be7c40680 1 -- start start 2023-10-05T21:15:19.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.635+0000 7f2be7c40680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x556ddd2b57e0 0x556ddd2b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.635+0000 7f2be7c40680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556ddd1ff990 con 0x556ddd2b12b0 2023-10-05T21:15:19.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.635+0000 7f2be7c40680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x556ddd1bfdb0 con 0x556ddd2b57e0 2023-10-05T21:15:19.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.636+0000 7f2bda517700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x556ddd2b57e0 0x556ddd2b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.636+0000 7f2bdad18700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x556ddd2b12b0 0x556ddd2b16c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:55314/0 (socket says 172.21.15.153:55314) 2023-10-05T21:15:19.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.636+0000 7f2bdad18700 1 -- 172.21.15.153:0/3337392577 learned_addr learned my addr 172.21.15.153:0/3337392577 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:19.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.636+0000 7f2bda517700 1 -- 172.21.15.153:0/3337392577 >> v1:172.21.15.111:6789/0 conn(0x556ddd2b12b0 legacy=0x556ddd2b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.636+0000 7f2bda517700 1 -- 172.21.15.153:0/3337392577 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ddd2b9110 con 0x556ddd2b57e0 2023-10-05T21:15:19.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.636+0000 7f2bd9d16700 1 -- 172.21.15.153:0/3337392577 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3363158471 0 0) 0x556ddd1ff990 con 0x556ddd2b12b0 2023-10-05T21:15:19.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.636+0000 7f2bda517700 1 --2- 172.21.15.153:0/3337392577 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd2b57e0 0x556ddd2b7bc0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc00a5d0 tx=0x7f2bcc005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=259615f6aaa0685 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.636+0000 7f2bd9d16700 1 -- 172.21.15.153:0/3337392577 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bcc0086a0 con 0x556ddd2b57e0 2023-10-05T21:15:19.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.636+0000 7f2bd9d16700 1 -- 172.21.15.153:0/3337392577 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bcc008800 con 0x556ddd2b57e0 2023-10-05T21:15:19.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.636+0000 7f2bd9d16700 1 -- 172.21.15.153:0/3337392577 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bcc008ad0 con 0x556ddd2b57e0 2023-10-05T21:15:19.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.637+0000 7f2be7c40680 1 -- 172.21.15.153:0/3337392577 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd2b57e0 msgr2=0x556ddd2b7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.637+0000 7f2be7c40680 1 --2- 172.21.15.153:0/3337392577 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd2b57e0 0x556ddd2b7bc0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc00a5d0 tx=0x7f2bcc005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:19.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.637+0000 7f2be7c40680 1 -- 172.21.15.153:0/3337392577 shutdown_connections 2023-10-05T21:15:19.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.637+0000 7f2be7c40680 1 --2- 172.21.15.153:0/3337392577 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd2b57e0 0x556ddd2b7bc0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.637+0000 7f2be7c40680 1 -- 172.21.15.153:0/3337392577 >> 172.21.15.153:0/3337392577 conn(0x556ddd2acb80 msgr2=0x556ddd2aef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.637+0000 7f2be7c40680 1 -- 172.21.15.153:0/3337392577 shutdown_connections 2023-10-05T21:15:19.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.637+0000 7f2be7c40680 1 -- 172.21.15.153:0/3337392577 wait complete. 2023-10-05T21:15:19.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.638+0000 7f2be7c40680 1 Processor -- start 2023-10-05T21:15:19.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.638+0000 7f2be7c40680 1 -- start start 2023-10-05T21:15:19.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.638+0000 7f2be7c40680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd2b12b0 0x556ddd226870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.638+0000 7f2be7c40680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ddd15fea0 con 0x556ddd2b12b0 2023-10-05T21:15:19.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.638+0000 7f2bdad18700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd2b12b0 0x556ddd226870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.638+0000 7f2bdad18700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd2b12b0 0x556ddd226870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38248/0 (socket says 172.21.15.153:38248) 2023-10-05T21:15:19.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.638+0000 7f2bdad18700 1 -- 172.21.15.153:0/2461359832 learned_addr learned my addr 172.21.15.153:0/2461359832 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.638+0000 7f2bdad18700 1 -- 172.21.15.153:0/2461359832 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bcc005cf0 con 0x556ddd2b12b0 2023-10-05T21:15:19.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.638+0000 7f2bdad18700 1 --2- 172.21.15.153:0/2461359832 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd2b12b0 0x556ddd226870 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0001de0 tx=0x7f2bd00017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd885b3a3022146 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.638+0000 7f2bd8d14700 1 -- 172.21.15.153:0/2461359832 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bd000bdb0 con 0x556ddd2b12b0 2023-10-05T21:15:19.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.638+0000 7f2bd8d14700 1 -- 172.21.15.153:0/2461359832 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd000e470 con 0x556ddd2b12b0 2023-10-05T21:15:19.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.638+0000 7f2bd8d14700 1 -- 172.21.15.153:0/2461359832 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bd000e760 con 0x556ddd2b12b0 2023-10-05T21:15:19.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.639+0000 7f2be7c40680 1 -- 172.21.15.153:0/2461359832 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd2b12b0 msgr2=0x556ddd226870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.639+0000 7f2be7c40680 1 --2- 172.21.15.153:0/2461359832 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd2b12b0 0x556ddd226870 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0001de0 tx=0x7f2bd00017b0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.639+0000 7f2be7c40680 1 -- 172.21.15.153:0/2461359832 shutdown_connections 2023-10-05T21:15:19.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.639+0000 7f2be7c40680 1 --2- 172.21.15.153:0/2461359832 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd2b12b0 0x556ddd226870 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.639+0000 7f2be7c40680 1 -- 172.21.15.153:0/2461359832 >> 172.21.15.153:0/2461359832 conn(0x556ddd2acb80 msgr2=0x556ddd2cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.639+0000 7f2be7c40680 1 -- 172.21.15.153:0/2461359832 shutdown_connections 2023-10-05T21:15:19.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.639+0000 7f2be7c40680 1 -- 172.21.15.153:0/2461359832 wait complete. 2023-10-05T21:15:19.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.639+0000 7f2be7c40680 1 Processor -- start 2023-10-05T21:15:19.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.639+0000 7f2be7c40680 1 -- start start 2023-10-05T21:15:19.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.640+0000 7f2be7c40680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd2b12b0 0x556ddd2d8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.640+0000 7f2be7c40680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ddd156c80 con 0x556ddd2b12b0 2023-10-05T21:15:19.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.640+0000 7f2bdad18700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd2b12b0 0x556ddd2d8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.640+0000 7f2bdad18700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd2b12b0 0x556ddd2d8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38254/0 (socket says 172.21.15.153:38254) 2023-10-05T21:15:19.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.640+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 learned_addr learned my addr 172.21.15.153:0/3402933332 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.640+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd0001a90 con 0x556ddd2b12b0 2023-10-05T21:15:19.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.640+0000 7f2bdad18700 1 --2- 172.21.15.153:0/3402933332 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd2b12b0 0x556ddd2d8d30 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2bd00017f0 tx=0x7f2bd0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.640+0000 7f2bcaffd700 1 -- 172.21.15.153:0/3402933332 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bd001f070 con 0x556ddd2b12b0 2023-10-05T21:15:19.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.640+0000 7f2bcaffd700 1 -- 172.21.15.153:0/3402933332 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd001a5d0 con 0x556ddd2b12b0 2023-10-05T21:15:19.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.640+0000 7f2bcaffd700 1 -- 172.21.15.153:0/3402933332 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bd001a8a0 con 0x556ddd2b12b0 2023-10-05T21:15:19.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.640+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556ddd2d9270 con 0x556ddd2b12b0 2023-10-05T21:15:19.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.641+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556ddd2d96c0 con 0x556ddd2b12b0 2023-10-05T21:15:19.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.641+0000 7f2bcaffd700 1 -- 172.21.15.153:0/3402933332 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f2bd001aa90 con 0x556ddd2b12b0 2023-10-05T21:15:19.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.641+0000 7f2be7c40680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.641+0000 7f2bcaffd700 1 --2- 172.21.15.153:0/3402933332 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2bc00340f0 0x7f2bc00365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.642+0000 7f2bcaffd700 1 -- 172.21.15.153:0/3402933332 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f2bd00490c0 con 0x556ddd2b12b0 2023-10-05T21:15:19.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.642+0000 7f2bda517700 1 --2- 172.21.15.153:0/3402933332 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2bc00340f0 0x7f2bc00365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.642+0000 7f2be7c40680 1 --2- 172.21.15.153:0/3402933332 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x556ddd2e2a00 0x556ddd2e4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.642+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2e55f0 con 0x556ddd2e2a00 2023-10-05T21:15:19.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.642+0000 7f2bdb519700 1 --2- 172.21.15.153:0/3402933332 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x556ddd2e2a00 0x556ddd2e4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.642+0000 7f2bda517700 1 --2- 172.21.15.153:0/3402933332 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2bc00340f0 0x7f2bc00365a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x556ddd2b2270 tx=0x7f2bcc015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.642+0000 7f2bdb519700 1 --2- 172.21.15.153:0/3402933332 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x556ddd2e2a00 0x556ddd2e4e60 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.642+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.642+0000 7f2be7c40680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.643+0000 7f2be7c40680 20 realm 2023-10-05T21:15:19.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.643+0000 7f2be7c40680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.643+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2e2070 con 0x556ddd2e2a00 2023-10-05T21:15:19.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.643+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.643+0000 7f2be7c40680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.643+0000 7f2be7c40680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:19.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.643+0000 7f2be7c40680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.643+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2e60f0 con 0x556ddd2e2a00 2023-10-05T21:15:19.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.643+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.643+0000 7f2be7c40680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.643+0000 7f2be7c40680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.643+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2e6a10 con 0x556ddd2e2a00 2023-10-05T21:15:19.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.643+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.643+0000 7f2be7c40680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.643+0000 7f2be7c40680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.643+0000 7f2be7c40680 1 --2- 172.21.15.153:0/3402933332 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x556ddd2e72d0 0x556ddd2e96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.643+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2e9d00 con 0x556ddd2e72d0 2023-10-05T21:15:19.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.643+0000 7f2bdad18700 1 --2- 172.21.15.153:0/3402933332 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x556ddd2e72d0 0x556ddd2e96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.644+0000 7f2bdad18700 1 --2- 172.21.15.153:0/3402933332 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x556ddd2e72d0 0x556ddd2e96b0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.644+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f2bd0014070 con 0x556ddd2e72d0 2023-10-05T21:15:19.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.644+0000 7f2be7c40680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:19.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.644+0000 7f2be7c40680 20 searching for the correct realm 2023-10-05T21:15:19.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.644+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x556ddd2e72d0 2023-10-05T21:15:19.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.644+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd0014070 con 0x556ddd2e72d0 2023-10-05T21:15:19.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.644+0000 7f2bdad18700 1 --2- 172.21.15.153:0/3402933332 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f2bd002d020 0x7f2bd002c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.644+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x7f2bd002d020 2023-10-05T21:15:19.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.644+0000 7f2bda517700 1 --2- 172.21.15.153:0/3402933332 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f2bd002d020 0x7f2bd002c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.645+0000 7f2bda517700 1 --2- 172.21.15.153:0/3402933332 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f2bd002d020 0x7f2bd002c5d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.645+0000 7f2bda517700 1 -- 172.21.15.153:0/3402933332 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bcc019040 con 0x7f2bd002d020 2023-10-05T21:15:19.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.645+0000 7f2bda517700 1 --2- 172.21.15.153:0/3402933332 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x556ddd2b57e0 0x7f2bcc01d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.645+0000 7f2bda517700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x556ddd2b57e0 2023-10-05T21:15:19.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.645+0000 7f2bdb519700 1 --2- 172.21.15.153:0/3402933332 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x556ddd2b57e0 0x7f2bcc01d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.645+0000 7f2bdb519700 1 --2- 172.21.15.153:0/3402933332 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x556ddd2b57e0 0x7f2bcc01d420 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.646+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2b57e0 2023-10-05T21:15:19.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.646+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x556ddd2e2a00 2023-10-05T21:15:19.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.646+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.646+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x556ddd2e2a00 2023-10-05T21:15:19.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.646+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.646+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x556ddd2b57e0 2023-10-05T21:15:19.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.646+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2b57e0 2023-10-05T21:15:19.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.646+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x556ddd2b57e0 2023-10-05T21:15:19.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.646+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2b57e0 2023-10-05T21:15:19.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.646+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x7f2bd002d020 2023-10-05T21:15:19.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.647+0000 7f2bda517700 1 -- 172.21.15.153:0/3402933332 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bcc019040 con 0x7f2bd002d020 2023-10-05T21:15:19.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.647+0000 7f2bda517700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x556ddd2e72d0 2023-10-05T21:15:19.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.647+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2bd0014070 con 0x556ddd2e72d0 2023-10-05T21:15:19.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.647+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x556ddd2e2a00 2023-10-05T21:15:19.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.647+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.647+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x556ddd2b57e0 2023-10-05T21:15:19.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.647+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2b57e0 2023-10-05T21:15:19.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.647+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x556ddd2e2a00 2023-10-05T21:15:19.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.648+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.648+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x7f2bd002d020 2023-10-05T21:15:19.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.648+0000 7f2bda517700 1 -- 172.21.15.153:0/3402933332 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bcc019040 con 0x7f2bd002d020 2023-10-05T21:15:19.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.648+0000 7f2bda517700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x556ddd2e72d0 2023-10-05T21:15:19.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.648+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd0014070 con 0x556ddd2e72d0 2023-10-05T21:15:19.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.648+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x556ddd2e72d0 2023-10-05T21:15:19.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.648+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd0014070 con 0x556ddd2e72d0 2023-10-05T21:15:19.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.648+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x556ddd2b57e0 2023-10-05T21:15:19.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.649+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2b57e0 2023-10-05T21:15:19.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.649+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x556ddd2e72d0 2023-10-05T21:15:19.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.649+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd0014070 con 0x556ddd2e72d0 2023-10-05T21:15:19.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.649+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x556ddd2e72d0 2023-10-05T21:15:19.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.649+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd0014070 con 0x556ddd2e72d0 2023-10-05T21:15:19.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.649+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x556ddd2e2a00 2023-10-05T21:15:19.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.649+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.649+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x556ddd2e2a00 2023-10-05T21:15:19.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.650+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.650+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x556ddd2b57e0 2023-10-05T21:15:19.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.650+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2b57e0 2023-10-05T21:15:19.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.650+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x556ddd2e72d0 2023-10-05T21:15:19.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.650+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd0014070 con 0x556ddd2e72d0 2023-10-05T21:15:19.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.650+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x7f2bd002d020 2023-10-05T21:15:19.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.650+0000 7f2bda517700 1 -- 172.21.15.153:0/3402933332 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bcc019040 con 0x7f2bd002d020 2023-10-05T21:15:19.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.650+0000 7f2bda517700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x556ddd2e2a00 2023-10-05T21:15:19.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.650+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.651+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x556ddd2b57e0 2023-10-05T21:15:19.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.651+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2b57e0 2023-10-05T21:15:19.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.651+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x556ddd2e72d0 2023-10-05T21:15:19.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.651+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd0014070 con 0x556ddd2e72d0 2023-10-05T21:15:19.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.651+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x556ddd2b57e0 2023-10-05T21:15:19.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.651+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2b57e0 2023-10-05T21:15:19.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.651+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x7f2bd002d020 2023-10-05T21:15:19.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.652+0000 7f2bda517700 1 -- 172.21.15.153:0/3402933332 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bcc019040 con 0x7f2bd002d020 2023-10-05T21:15:19.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.652+0000 7f2bda517700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x556ddd2e72d0 2023-10-05T21:15:19.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.652+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd0014070 con 0x556ddd2e72d0 2023-10-05T21:15:19.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.652+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x556ddd2b57e0 2023-10-05T21:15:19.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.652+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2b57e0 2023-10-05T21:15:19.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.652+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x556ddd2e2a00 2023-10-05T21:15:19.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.652+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.652+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eb870 con 0x7f2bd002d020 2023-10-05T21:15:19.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.652+0000 7f2bda517700 1 -- 172.21.15.153:0/3402933332 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bcc019040 con 0x7f2bd002d020 2023-10-05T21:15:19.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.653+0000 7f2be7c40680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:19.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.653+0000 7f2be7c40680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:19.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.653+0000 7f2be7c40680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:19.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.653+0000 7f2be7c40680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:19.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.653+0000 7f2be7c40680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.653+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ea7c0 con 0x556ddd2e2a00 2023-10-05T21:15:19.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.653+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.653+0000 7f2be7c40680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.653+0000 7f2be7c40680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.653+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2eabc0 con 0x556ddd2e2a00 2023-10-05T21:15:19.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.653+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.653+0000 7f2be7c40680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.653+0000 7f2be7c40680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.653+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ebd00 con 0x556ddd2e2a00 2023-10-05T21:15:19.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.653+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.653+0000 7f2be7c40680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:19.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.653+0000 7f2be7c40680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.653+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ec0b0 con 0x556ddd2e72d0 2023-10-05T21:15:19.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.653+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f2bd0014070 con 0x556ddd2e72d0 2023-10-05T21:15:19.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.653+0000 7f2be7c40680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.653+0000 7f2be7c40680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.653+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ec460 con 0x556ddd2e2a00 2023-10-05T21:15:19.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.654+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.654+0000 7f2be7c40680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.654+0000 7f2be7c40680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.654+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ec460 con 0x556ddd2e2a00 2023-10-05T21:15:19.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.654+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.654+0000 7f2be7c40680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.654+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ec460 con 0x556ddd2e72d0 2023-10-05T21:15:19.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.654+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd0014070 con 0x556ddd2e72d0 2023-10-05T21:15:19.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.654+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ec460 con 0x7f2bd002d020 2023-10-05T21:15:19.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.654+0000 7f2bda517700 1 -- 172.21.15.153:0/3402933332 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bcc019040 con 0x7f2bd002d020 2023-10-05T21:15:19.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.654+0000 7f2bda517700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ec460 con 0x556ddd2b57e0 2023-10-05T21:15:19.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.654+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2b57e0 2023-10-05T21:15:19.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.654+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ebd00 con 0x556ddd2e2a00 2023-10-05T21:15:19.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.655+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.655+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ebd00 con 0x556ddd2e2a00 2023-10-05T21:15:19.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.655+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.655+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ebd00 con 0x556ddd2b57e0 2023-10-05T21:15:19.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.655+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2b57e0 2023-10-05T21:15:19.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.655+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ebd00 con 0x556ddd2b57e0 2023-10-05T21:15:19.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.655+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2b57e0 2023-10-05T21:15:19.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.655+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ebd00 con 0x7f2bd002d020 2023-10-05T21:15:19.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.656+0000 7f2bda517700 1 -- 172.21.15.153:0/3402933332 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bcc019040 con 0x7f2bd002d020 2023-10-05T21:15:19.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.656+0000 7f2bda517700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ebd00 con 0x556ddd2e72d0 2023-10-05T21:15:19.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.656+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2bd0014070 con 0x556ddd2e72d0 2023-10-05T21:15:19.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.656+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ebd00 con 0x556ddd2e2a00 2023-10-05T21:15:19.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.656+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.656+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ebd00 con 0x556ddd2b57e0 2023-10-05T21:15:19.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.656+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2b57e0 2023-10-05T21:15:19.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.656+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ebd00 con 0x556ddd2e2a00 2023-10-05T21:15:19.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.656+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.656+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ebd00 con 0x7f2bd002d020 2023-10-05T21:15:19.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.657+0000 7f2bda517700 1 -- 172.21.15.153:0/3402933332 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bcc019040 con 0x7f2bd002d020 2023-10-05T21:15:19.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.657+0000 7f2bda517700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ebd00 con 0x556ddd2e72d0 2023-10-05T21:15:19.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.657+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd0014070 con 0x556ddd2e72d0 2023-10-05T21:15:19.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.657+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ebd00 con 0x556ddd2e72d0 2023-10-05T21:15:19.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.657+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd0014070 con 0x556ddd2e72d0 2023-10-05T21:15:19.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.657+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ebd00 con 0x556ddd2b57e0 2023-10-05T21:15:19.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.657+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2b57e0 2023-10-05T21:15:19.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.657+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ebd00 con 0x556ddd2e72d0 2023-10-05T21:15:19.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.657+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd0014070 con 0x556ddd2e72d0 2023-10-05T21:15:19.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.657+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ebd00 con 0x556ddd2e72d0 2023-10-05T21:15:19.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.658+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd0014070 con 0x556ddd2e72d0 2023-10-05T21:15:19.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.658+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ebd00 con 0x556ddd2e2a00 2023-10-05T21:15:19.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.658+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.658+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ebd00 con 0x556ddd2e2a00 2023-10-05T21:15:19.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.658+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.658+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ebd00 con 0x556ddd2b57e0 2023-10-05T21:15:19.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.658+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2b57e0 2023-10-05T21:15:19.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.658+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ebd00 con 0x556ddd2e72d0 2023-10-05T21:15:19.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.658+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd0014070 con 0x556ddd2e72d0 2023-10-05T21:15:19.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.658+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ebd00 con 0x7f2bd002d020 2023-10-05T21:15:19.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.659+0000 7f2bda517700 1 -- 172.21.15.153:0/3402933332 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bcc019040 con 0x7f2bd002d020 2023-10-05T21:15:19.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.659+0000 7f2bda517700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ebd00 con 0x556ddd2e2a00 2023-10-05T21:15:19.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.659+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.659+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ebd00 con 0x556ddd2b57e0 2023-10-05T21:15:19.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.659+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2b57e0 2023-10-05T21:15:19.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.659+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ebd00 con 0x556ddd2e72d0 2023-10-05T21:15:19.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.659+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd0014070 con 0x556ddd2e72d0 2023-10-05T21:15:19.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.659+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ebd00 con 0x556ddd2b57e0 2023-10-05T21:15:19.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.660+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2b57e0 2023-10-05T21:15:19.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.660+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ebd00 con 0x7f2bd002d020 2023-10-05T21:15:19.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.660+0000 7f2bda517700 1 -- 172.21.15.153:0/3402933332 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bcc019040 con 0x7f2bd002d020 2023-10-05T21:15:19.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.660+0000 7f2bda517700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ebd00 con 0x556ddd2e72d0 2023-10-05T21:15:19.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.660+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd0014070 con 0x556ddd2e72d0 2023-10-05T21:15:19.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.660+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ebd00 con 0x556ddd2b57e0 2023-10-05T21:15:19.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.660+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2b57e0 2023-10-05T21:15:19.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.660+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ebd00 con 0x556ddd2e2a00 2023-10-05T21:15:19.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.660+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.660+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ebd00 con 0x7f2bd002d020 2023-10-05T21:15:19.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.661+0000 7f2bda517700 1 -- 172.21.15.153:0/3402933332 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bcc019040 con 0x7f2bd002d020 2023-10-05T21:15:19.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.661+0000 7f2be7c40680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:19.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.661+0000 7f2be7c40680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:19.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.661+0000 7f2be7c40680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:19.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.661+0000 7f2be7c40680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:19.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.661+0000 7f2be7c40680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.661+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ec460 con 0x556ddd2e2a00 2023-10-05T21:15:19.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.661+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.661+0000 7f2be7c40680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.661+0000 7f2be7c40680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.661+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ec890 con 0x556ddd2e72d0 2023-10-05T21:15:19.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.661+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f2bd0014070 con 0x556ddd2e72d0 2023-10-05T21:15:19.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.661+0000 7f2be7c40680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:19.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.661+0000 7f2be7c40680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.661+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ed180 con 0x556ddd2e2a00 2023-10-05T21:15:19.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.661+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.661+0000 7f2be7c40680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.661+0000 7f2be7c40680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.661+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ed180 con 0x556ddd2e2a00 2023-10-05T21:15:19.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.662+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.662+0000 7f2be7c40680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:19.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.662+0000 7f2be7c40680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.662+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ed180 con 0x556ddd2b57e0 2023-10-05T21:15:19.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.662+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2b57e0 2023-10-05T21:15:19.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.662+0000 7f2be7c40680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.662+0000 7f2be7c40680 20 zone default found 2023-10-05T21:15:19.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.662+0000 7f2be7c40680 4 Realm: () 2023-10-05T21:15:19.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.662+0000 7f2be7c40680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:19.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.662+0000 7f2be7c40680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:19.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.662+0000 7f2be7c40680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:19.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.662+0000 7f2be7c40680 20 zonegroup default 2023-10-05T21:15:19.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.662+0000 7f2be7c40680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.662+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ed180 con 0x556ddd2b57e0 2023-10-05T21:15:19.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.662+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2b57e0 2023-10-05T21:15:19.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.662+0000 7f2be7c40680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.662+0000 7f2be7c40680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.662+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ed180 con 0x556ddd2e72d0 2023-10-05T21:15:19.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.662+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2bd0014070 con 0x556ddd2e72d0 2023-10-05T21:15:19.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.662+0000 7f2be7c40680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.662+0000 7f2be7c40680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.662+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ef000 con 0x556ddd2e72d0 2023-10-05T21:15:19.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.663+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2bd0014070 con 0x556ddd2e72d0 2023-10-05T21:15:19.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.663+0000 7f2be7c40680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.663+0000 7f2be7c40680 20 started sync module instance, tier type = 2023-10-05T21:15:19.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.663+0000 7f2be7c40680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:19.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.663+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ee6c0 con 0x7f2bd002d020 2023-10-05T21:15:19.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.663+0000 7f2bda517700 1 -- 172.21.15.153:0/3402933332 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bcc019040 con 0x7f2bd002d020 2023-10-05T21:15:19.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.663+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93930350627984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ef470 con 0x7f2bd002d020 2023-10-05T21:15:19.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.664+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2efee0 con 0x556ddd2e2a00 2023-10-05T21:15:19.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.664+0000 7f2bda517700 1 -- 172.21.15.153:0/3402933332 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 93930350627984] v29'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bcc019040 con 0x7f2bd002d020 2023-10-05T21:15:19.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.664+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.664+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93930350639504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2f02e0 con 0x556ddd2e2a00 2023-10-05T21:15:19.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.664+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2f0cf0 con 0x556ddd2e72d0 2023-10-05T21:15:19.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.665+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 93930350639504] v29'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.665+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bd0014070 con 0x556ddd2e72d0 2023-10-05T21:15:19.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.665+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93930350643200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2f10a0 con 0x556ddd2e72d0 2023-10-05T21:15:19.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.665+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2f1ab0 con 0x7f2bd002d020 2023-10-05T21:15:19.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.666+0000 7f2bda517700 1 -- 172.21.15.153:0/3402933332 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bcc019040 con 0x7f2bd002d020 2023-10-05T21:15:19.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.666+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 93930350643200] v29'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bd0014070 con 0x556ddd2e72d0 2023-10-05T21:15:19.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.666+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 93930350646720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2f2350 con 0x7f2bd002d020 2023-10-05T21:15:19.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.666+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2f2bf0 con 0x556ddd2e2a00 2023-10-05T21:15:19.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.667+0000 7f2bda517700 1 -- 172.21.15.153:0/3402933332 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 93930350646720] v29'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bcc019040 con 0x7f2bd002d020 2023-10-05T21:15:19.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.667+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.667+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 93930350651136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2f3040 con 0x556ddd2e2a00 2023-10-05T21:15:19.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.667+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2f3a50 con 0x556ddd2b57e0 2023-10-05T21:15:19.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.667+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2b57e0 2023-10-05T21:15:19.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.667+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 93930350651136] v29'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.668+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 93930350654816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2f39b0 con 0x556ddd2b57e0 2023-10-05T21:15:19.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.668+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2f2b50 con 0x556ddd2b57e0 2023-10-05T21:15:19.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.668+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 93930350654816] v29'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2b57e0 2023-10-05T21:15:19.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.668+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2b57e0 2023-10-05T21:15:19.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.668+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93930350652240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2f45a0 con 0x556ddd2b57e0 2023-10-05T21:15:19.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.668+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2f4ff0 con 0x556ddd2b57e0 2023-10-05T21:15:19.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.669+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 93930350652240] v29'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2b57e0 2023-10-05T21:15:19.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.669+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2b57e0 2023-10-05T21:15:19.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.669+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93930350657024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2f4fb0 con 0x556ddd2b57e0 2023-10-05T21:15:19.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.669+0000 7f2be7c40680 20 add_watcher() i=0 2023-10-05T21:15:19.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.669+0000 7f2be7c40680 20 add_watcher() i=1 2023-10-05T21:15:19.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.669+0000 7f2be7c40680 20 add_watcher() i=2 2023-10-05T21:15:19.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.669+0000 7f2be7c40680 20 add_watcher() i=3 2023-10-05T21:15:19.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.669+0000 7f2be7c40680 20 add_watcher() i=4 2023-10-05T21:15:19.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.669+0000 7f2be7c40680 20 add_watcher() i=5 2023-10-05T21:15:19.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.669+0000 7f2be7c40680 20 add_watcher() i=6 2023-10-05T21:15:19.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.670+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 93930350657024] v29'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2b57e0 2023-10-05T21:15:19.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.670+0000 7f2be7c40680 20 add_watcher() i=7 2023-10-05T21:15:19.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.670+0000 7f2be7c40680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:19.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.670+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2f81c0 con 0x556ddd2e2a00 2023-10-05T21:15:19.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.670+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.670+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93930350660656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2f5570 con 0x556ddd2e2a00 2023-10-05T21:15:19.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.671+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 93930350660656] v29'158 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.671+0000 7f2babfe7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:19.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.671+0000 7f2be7c40680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:19.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.671+0000 7f2be7c40680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:19.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.671+0000 7f2be7c40680 1 Processor -- start 2023-10-05T21:15:19.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.671+0000 7f2be7c40680 1 -- start start 2023-10-05T21:15:19.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.671+0000 7f2be7c40680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd301f70 0x556ddd302380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.671+0000 7f2be7c40680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ddd302990 con 0x556ddd301f70 2023-10-05T21:15:19.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.672+0000 7f2bda517700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd301f70 0x556ddd302380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.672+0000 7f2bda517700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd301f70 0x556ddd302380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38270/0 (socket says 172.21.15.153:38270) 2023-10-05T21:15:19.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.672+0000 7f2bda517700 1 -- 172.21.15.153:0/1431972397 learned_addr learned my addr 172.21.15.153:0/1431972397 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.672+0000 7f2bda517700 1 -- 172.21.15.153:0/1431972397 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ddd302e70 con 0x556ddd301f70 2023-10-05T21:15:19.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.672+0000 7f2bda517700 1 --2- 172.21.15.153:0/1431972397 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd301f70 0x556ddd302380 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x556ddd2b1f80 tx=0x7f2bcc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d80131a30cd8c14 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.672+0000 7f2bab7e6700 1 -- 172.21.15.153:0/1431972397 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bcc0127e0 con 0x556ddd301f70 2023-10-05T21:15:19.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.672+0000 7f2bab7e6700 1 -- 172.21.15.153:0/1431972397 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bcc01ddc0 con 0x556ddd301f70 2023-10-05T21:15:19.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.672+0000 7f2bab7e6700 1 -- 172.21.15.153:0/1431972397 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bcc02b440 con 0x556ddd301f70 2023-10-05T21:15:19.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.673+0000 7f2be7c40680 1 -- 172.21.15.153:0/1431972397 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd301f70 msgr2=0x556ddd302380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.673+0000 7f2be7c40680 1 --2- 172.21.15.153:0/1431972397 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd301f70 0x556ddd302380 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x556ddd2b1f80 tx=0x7f2bcc012000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.673+0000 7f2be7c40680 1 -- 172.21.15.153:0/1431972397 shutdown_connections 2023-10-05T21:15:19.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.673+0000 7f2be7c40680 1 --2- 172.21.15.153:0/1431972397 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd301f70 0x556ddd302380 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.673+0000 7f2be7c40680 1 -- 172.21.15.153:0/1431972397 >> 172.21.15.153:0/1431972397 conn(0x556ddd2fe270 msgr2=0x556ddd2fc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.673+0000 7f2be7c40680 1 -- 172.21.15.153:0/1431972397 shutdown_connections 2023-10-05T21:15:19.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.673+0000 7f2be7c40680 1 -- 172.21.15.153:0/1431972397 wait complete. 2023-10-05T21:15:19.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.673+0000 7f2be7c40680 1 Processor -- start 2023-10-05T21:15:19.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.673+0000 7f2be7c40680 1 -- start start 2023-10-05T21:15:19.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.674+0000 7f2be7c40680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd301f70 0x556ddd308c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.674+0000 7f2be7c40680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ddd309180 con 0x556ddd301f70 2023-10-05T21:15:19.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.674+0000 7f2bda517700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd301f70 0x556ddd308c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.674+0000 7f2bda517700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd301f70 0x556ddd308c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38272/0 (socket says 172.21.15.153:38272) 2023-10-05T21:15:19.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.674+0000 7f2bda517700 1 -- 172.21.15.153:0/1881082072 learned_addr learned my addr 172.21.15.153:0/1881082072 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.674+0000 7f2bda517700 1 -- 172.21.15.153:0/1881082072 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ddd2b9110 con 0x556ddd301f70 2023-10-05T21:15:19.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.674+0000 7f2bda517700 1 --2- 172.21.15.153:0/1881082072 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd301f70 0x556ddd308c40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc037000 tx=0x7f2bcc030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.674+0000 7f2ba9fe3700 1 -- 172.21.15.153:0/1881082072 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bcc03f480 con 0x556ddd301f70 2023-10-05T21:15:19.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.674+0000 7f2ba9fe3700 1 -- 172.21.15.153:0/1881082072 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bcc03f5e0 con 0x556ddd301f70 2023-10-05T21:15:19.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.674+0000 7f2be7c40680 1 -- 172.21.15.153:0/1881082072 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556ddd309380 con 0x556ddd301f70 2023-10-05T21:15:19.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.674+0000 7f2ba9fe3700 1 -- 172.21.15.153:0/1881082072 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bcc03f790 con 0x556ddd301f70 2023-10-05T21:15:19.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.674+0000 7f2be7c40680 1 -- 172.21.15.153:0/1881082072 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556ddd309770 con 0x556ddd301f70 2023-10-05T21:15:19.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.675+0000 7f2ba9fe3700 1 -- 172.21.15.153:0/1881082072 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f2bcc047070 con 0x556ddd301f70 2023-10-05T21:15:19.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.675+0000 7f2ba9fe3700 1 --2- 172.21.15.153:0/1881082072 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2b20034140 0x7f2b200365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.675+0000 7f2ba9fe3700 1 -- 172.21.15.153:0/1881082072 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f2bcc030070 con 0x556ddd301f70 2023-10-05T21:15:19.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.675+0000 7f2be7c40680 5 note: GC not initialized 2023-10-05T21:15:19.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.675+0000 7f2bdb519700 1 --2- 172.21.15.153:0/1881082072 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2b20034140 0x7f2b200365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.676+0000 7f2bdb519700 1 --2- 172.21.15.153:0/1881082072 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2b20034140 0x7f2b200365f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x556ddd2f8240 tx=0x7f2bd4037470 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.676+0000 7f2b1affd700 20 reqs_thread_entry: start 2023-10-05T21:15:19.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.677+0000 7f2b18ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:19.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.677+0000 7f2be7c40680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:19.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.677+0000 7f2be7c40680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:19.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.677+0000 7f2b0affd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:49 2023 2023-10-05T21:15:19.713 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:19.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.677+0000 7f2b0a7fc700 20 reqs_thread_entry: start 2023-10-05T21:15:19.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.677+0000 7f2be7c40680 1 --2- 172.21.15.153:0/1881082072 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x556ddd36d520 0x556ddd36f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.677+0000 7f2be7c40680 1 -- 172.21.15.153:0/1881082072 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:1 6.1d 6:be4cd13f:::2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.3-myfoo3:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd36fe40 con 0x556ddd36d520 2023-10-05T21:15:19.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.677+0000 7f2bdad18700 1 --2- 172.21.15.153:0/1881082072 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x556ddd36d520 0x556ddd36f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.678+0000 7f2bdad18700 1 --2- 172.21.15.153:0/1881082072 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x556ddd36d520 0x556ddd36f900 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.678+0000 7f2bdad18700 1 -- 172.21.15.153:0/1881082072 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(1 2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.3-myfoo3 [delete] v29'32 uv32 ondisk = 0) v8 ==== 208+0+0 (crc 0 0 0) 0x7f2bd0014070 con 0x556ddd36d520 2023-10-05T21:15:19.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.679+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93930350627984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd32cc20 con 0x7f2bd002d020 2023-10-05T21:15:19.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.679+0000 7f2bda517700 1 -- 172.21.15.153:0/3402933332 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(102 notify.0 [watch unwatch cookie 93930350627984] v29'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bcc033040 con 0x7f2bd002d020 2023-10-05T21:15:19.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.680+0000 7f2be7c40680 20 remove_watcher() i=0 2023-10-05T21:15:19.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.680+0000 7f2be7c40680 2 removed watcher, disabling cache 2023-10-05T21:15:19.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.680+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93930350639504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ecc90 con 0x556ddd2e2a00 2023-10-05T21:15:19.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.681+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(103 notify.1 [watch unwatch cookie 93930350639504] v29'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.681+0000 7f2be7c40680 20 remove_watcher() i=1 2023-10-05T21:15:19.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.681+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:104 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93930350643200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ecc90 con 0x556ddd2e72d0 2023-10-05T21:15:19.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.682+0000 7f2bdad18700 1 -- 172.21.15.153:0/3402933332 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(104 notify.2 [watch unwatch cookie 93930350643200] v29'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bd0014070 con 0x556ddd2e72d0 2023-10-05T21:15:19.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.682+0000 7f2be7c40680 20 remove_watcher() i=2 2023-10-05T21:15:19.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.682+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93930350646720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ecc90 con 0x7f2bd002d020 2023-10-05T21:15:19.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.683+0000 7f2bda517700 1 -- 172.21.15.153:0/3402933332 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(105 notify.3 [watch unwatch cookie 93930350646720] v29'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bcc033040 con 0x7f2bd002d020 2023-10-05T21:15:19.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.683+0000 7f2be7c40680 20 remove_watcher() i=3 2023-10-05T21:15:19.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.683+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93930350651136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2f15c0 con 0x556ddd2e2a00 2023-10-05T21:15:19.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.683+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(106 notify.4 [watch unwatch cookie 93930350651136] v29'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.683+0000 7f2be7c40680 20 remove_watcher() i=4 2023-10-05T21:15:19.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.683+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:107 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93930350654816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2ecc90 con 0x556ddd2b57e0 2023-10-05T21:15:19.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.684+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(107 notify.5 [watch unwatch cookie 93930350654816] v29'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2b57e0 2023-10-05T21:15:19.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.684+0000 7f2be7c40680 20 remove_watcher() i=5 2023-10-05T21:15:19.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.684+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93930350652240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2f3560 con 0x556ddd2b57e0 2023-10-05T21:15:19.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.685+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(108 notify.6 [watch unwatch cookie 93930350652240] v29'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2b57e0 2023-10-05T21:15:19.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.685+0000 7f2be7c40680 20 remove_watcher() i=6 2023-10-05T21:15:19.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.685+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93930350657024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2f3560 con 0x556ddd2b57e0 2023-10-05T21:15:19.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.686+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(109 notify.7 [watch unwatch cookie 93930350657024] v29'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2b57e0 2023-10-05T21:15:19.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.686+0000 7f2be7c40680 20 remove_watcher() i=7 2023-10-05T21:15:19.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.687+0000 7f2babfe7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:19.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.687+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:110 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93930350660656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x556ddd2f3560 con 0x556ddd2e2a00 2023-10-05T21:15:19.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.687+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(110 data_loggenerations_metadata [watch unwatch cookie 93930350660656] v29'159 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2bd400a570 con 0x556ddd2e2a00 2023-10-05T21:15:19.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.687+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x556ddd2b57e0 msgr2=0x7f2bcc01d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.687+0000 7f2be7c40680 1 --2- 172.21.15.153:0/3402933332 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x556ddd2b57e0 0x7f2bcc01d420 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.687+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x556ddd2e2a00 msgr2=0x556ddd2e4e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.687+0000 7f2be7c40680 1 --2- 172.21.15.153:0/3402933332 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x556ddd2e2a00 0x556ddd2e4e60 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.687+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f2bd002d020 msgr2=0x7f2bd002c5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.687+0000 7f2be7c40680 1 --2- 172.21.15.153:0/3402933332 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f2bd002d020 0x7f2bd002c5d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.687+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x556ddd2e72d0 msgr2=0x556ddd2e96b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.687+0000 7f2be7c40680 1 --2- 172.21.15.153:0/3402933332 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x556ddd2e72d0 0x556ddd2e96b0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.688+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2bc00340f0 msgr2=0x7f2bc00365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.688+0000 7f2be7c40680 1 --2- 172.21.15.153:0/3402933332 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2bc00340f0 0x7f2bc00365a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x556ddd2b2270 tx=0x7f2bcc015000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.688+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd2b12b0 msgr2=0x556ddd2d8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.688+0000 7f2bdb519700 1 -- 172.21.15.153:0/3402933332 reap_dead start 2023-10-05T21:15:19.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.688+0000 7f2be7c40680 1 --2- 172.21.15.153:0/3402933332 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd2b12b0 0x556ddd2d8d30 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2bd00017f0 tx=0x7f2bd0016000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.688+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 shutdown_connections 2023-10-05T21:15:19.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.688+0000 7f2be7c40680 1 --2- 172.21.15.153:0/3402933332 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd2b12b0 0x556ddd2d8d30 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.688+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 >> 172.21.15.153:0/3402933332 conn(0x556ddd2acb80 msgr2=0x556ddd2caac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.688+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 shutdown_connections 2023-10-05T21:15:19.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.688+0000 7f2be7c40680 1 -- 172.21.15.153:0/3402933332 wait complete. 2023-10-05T21:15:19.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.688+0000 7f2be7c40680 1 -- 172.21.15.153:0/1881082072 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x556ddd36d520 msgr2=0x556ddd36f900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.688+0000 7f2be7c40680 1 --2- 172.21.15.153:0/1881082072 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x556ddd36d520 0x556ddd36f900 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.688+0000 7f2be7c40680 1 -- 172.21.15.153:0/1881082072 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2b20034140 msgr2=0x7f2b200365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.688+0000 7f2be7c40680 1 --2- 172.21.15.153:0/1881082072 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2b20034140 0x7f2b200365f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x556ddd2f8240 tx=0x7f2bd4037470 comp rx=0 tx=0).stop 2023-10-05T21:15:19.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.688+0000 7f2be7c40680 1 -- 172.21.15.153:0/1881082072 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd301f70 msgr2=0x556ddd308c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.688+0000 7f2be7c40680 1 --2- 172.21.15.153:0/1881082072 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd301f70 0x556ddd308c40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc037000 tx=0x7f2bcc030000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.688+0000 7f2be7c40680 1 -- 172.21.15.153:0/1881082072 shutdown_connections 2023-10-05T21:15:19.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.688+0000 7f2be7c40680 1 --2- 172.21.15.153:0/1881082072 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x556ddd36d520 0x556ddd36f900 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.688+0000 7f2be7c40680 1 --2- 172.21.15.153:0/1881082072 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556ddd301f70 0x556ddd308c40 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.688+0000 7f2be7c40680 1 --2- 172.21.15.153:0/1881082072 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2b20034140 0x7f2b200365f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.688+0000 7f2be7c40680 1 -- 172.21.15.153:0/1881082072 >> 172.21.15.153:0/1881082072 conn(0x556ddd2fe270 msgr2=0x556ddd2fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.688+0000 7f2be7c40680 1 -- 172.21.15.153:0/1881082072 shutdown_connections 2023-10-05T21:15:19.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.688+0000 7f2be7c40680 1 -- 172.21.15.153:0/1881082072 wait complete. 2023-10-05T21:15:19.719 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'show', '--object', '2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.2-myfoo2'] 2023-10-05T21:15:19.719 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'show', '--object', '2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.2-myfoo2'] 2023-10-05T21:15:19.719 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log show --object 2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.2-myfoo2 2023-10-05T21:15:19.763 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:19.763 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:19.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.762+0000 7eff23d6a680 1 Processor -- start 2023-10-05T21:15:19.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.762+0000 7eff23d6a680 1 -- start start 2023-10-05T21:15:19.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.762+0000 7eff23d6a680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55ff746686a0 0x55ff746fc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.762+0000 7eff23d6a680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ff74640990 con 0x55ff74669a30 2023-10-05T21:15:19.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.762+0000 7eff23d6a680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ff74600db0 con 0x55ff746686a0 2023-10-05T21:15:19.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.762+0000 7eff16641700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55ff746686a0 0x55ff746fc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.762+0000 7eff16e42700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55ff74669a30 0x55ff74667f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:55320/0 (socket says 172.21.15.153:55320) 2023-10-05T21:15:19.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.762+0000 7eff16e42700 1 -- 172.21.15.153:0/4097997666 learned_addr learned my addr 172.21.15.153:0/4097997666 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:19.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.762+0000 7eff16641700 1 -- 172.21.15.153:0/4097997666 >> v1:172.21.15.111:6789/0 conn(0x55ff74669a30 legacy=0x55ff74667f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.763+0000 7eff16641700 1 -- 172.21.15.153:0/4097997666 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff74668b40 con 0x55ff746686a0 2023-10-05T21:15:19.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.763+0000 7eff15e40700 1 -- 172.21.15.153:0/4097997666 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1400764896 0 0) 0x55ff74640990 con 0x55ff74669a30 2023-10-05T21:15:19.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.763+0000 7eff16641700 1 --2- 172.21.15.153:0/4097997666 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff746686a0 0x55ff746fc3d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7eff0800a5d0 tx=0x7eff08005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=924382c1d36f73a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.763+0000 7eff15e40700 1 -- 172.21.15.153:0/4097997666 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff080086a0 con 0x55ff746686a0 2023-10-05T21:15:19.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.763+0000 7eff15e40700 1 -- 172.21.15.153:0/4097997666 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff08008800 con 0x55ff746686a0 2023-10-05T21:15:19.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.763+0000 7eff15e40700 1 -- 172.21.15.153:0/4097997666 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff08008ad0 con 0x55ff746686a0 2023-10-05T21:15:19.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.763+0000 7eff23d6a680 1 -- 172.21.15.153:0/4097997666 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff746686a0 msgr2=0x55ff746fc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.763+0000 7eff23d6a680 1 --2- 172.21.15.153:0/4097997666 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff746686a0 0x55ff746fc3d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7eff0800a5d0 tx=0x7eff08005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:19.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.763+0000 7eff23d6a680 1 -- 172.21.15.153:0/4097997666 shutdown_connections 2023-10-05T21:15:19.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.763+0000 7eff23d6a680 1 --2- 172.21.15.153:0/4097997666 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff746686a0 0x55ff746fc3d0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.763+0000 7eff23d6a680 1 -- 172.21.15.153:0/4097997666 >> 172.21.15.153:0/4097997666 conn(0x55ff746eeca0 msgr2=0x55ff746f10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.763+0000 7eff23d6a680 1 -- 172.21.15.153:0/4097997666 shutdown_connections 2023-10-05T21:15:19.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.763+0000 7eff23d6a680 1 -- 172.21.15.153:0/4097997666 wait complete. 2023-10-05T21:15:19.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.764+0000 7eff23d6a680 1 Processor -- start 2023-10-05T21:15:19.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.764+0000 7eff23d6a680 1 -- start start 2023-10-05T21:15:19.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.764+0000 7eff23d6a680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff746686a0 0x55ff747149b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.764+0000 7eff23d6a680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff745a0ea0 con 0x55ff746686a0 2023-10-05T21:15:19.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.765+0000 7eff16e42700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff746686a0 0x55ff747149b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.765+0000 7eff16e42700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff746686a0 0x55ff747149b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38284/0 (socket says 172.21.15.153:38284) 2023-10-05T21:15:19.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.765+0000 7eff16e42700 1 -- 172.21.15.153:0/3613654513 learned_addr learned my addr 172.21.15.153:0/3613654513 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.765+0000 7eff16e42700 1 -- 172.21.15.153:0/3613654513 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff08005cf0 con 0x55ff746686a0 2023-10-05T21:15:19.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.765+0000 7eff16e42700 1 --2- 172.21.15.153:0/3613654513 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff746686a0 0x55ff747149b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7eff0c001d90 tx=0x7eff0c001790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc7f5f8faaf48f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.765+0000 7eff14e3e700 1 -- 172.21.15.153:0/3613654513 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff0c00bcc0 con 0x55ff746686a0 2023-10-05T21:15:19.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.765+0000 7eff14e3e700 1 -- 172.21.15.153:0/3613654513 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0c00be40 con 0x55ff746686a0 2023-10-05T21:15:19.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.765+0000 7eff14e3e700 1 -- 172.21.15.153:0/3613654513 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff0c00e5f0 con 0x55ff746686a0 2023-10-05T21:15:19.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.766+0000 7eff23d6a680 1 -- 172.21.15.153:0/3613654513 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff746686a0 msgr2=0x55ff747149b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.766+0000 7eff23d6a680 1 --2- 172.21.15.153:0/3613654513 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff746686a0 0x55ff747149b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7eff0c001d90 tx=0x7eff0c001790 comp rx=0 tx=0).stop 2023-10-05T21:15:19.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.766+0000 7eff23d6a680 1 -- 172.21.15.153:0/3613654513 shutdown_connections 2023-10-05T21:15:19.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.766+0000 7eff23d6a680 1 --2- 172.21.15.153:0/3613654513 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff746686a0 0x55ff747149b0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.766+0000 7eff23d6a680 1 -- 172.21.15.153:0/3613654513 >> 172.21.15.153:0/3613654513 conn(0x55ff746eeca0 msgr2=0x55ff74710480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.766+0000 7eff23d6a680 1 -- 172.21.15.153:0/3613654513 shutdown_connections 2023-10-05T21:15:19.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.766+0000 7eff23d6a680 1 -- 172.21.15.153:0/3613654513 wait complete. 2023-10-05T21:15:19.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.766+0000 7eff23d6a680 1 Processor -- start 2023-10-05T21:15:19.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.766+0000 7eff23d6a680 1 -- start start 2023-10-05T21:15:19.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.766+0000 7eff23d6a680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff746686a0 0x55ff7471be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.766+0000 7eff23d6a680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff74597c80 con 0x55ff746686a0 2023-10-05T21:15:19.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.766+0000 7eff16e42700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff746686a0 0x55ff7471be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.766+0000 7eff16e42700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff746686a0 0x55ff7471be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38294/0 (socket says 172.21.15.153:38294) 2023-10-05T21:15:19.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.766+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 learned_addr learned my addr 172.21.15.153:0/2187054001 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.767+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0c001a70 con 0x55ff746686a0 2023-10-05T21:15:19.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.767+0000 7eff16e42700 1 --2- 172.21.15.153:0/2187054001 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff746686a0 0x55ff7471be50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7eff0c0017d0 tx=0x7eff0c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.767+0000 7eff06ffd700 1 -- 172.21.15.153:0/2187054001 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff0c01f070 con 0x55ff746686a0 2023-10-05T21:15:19.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.767+0000 7eff06ffd700 1 -- 172.21.15.153:0/2187054001 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0c01a4d0 con 0x55ff746686a0 2023-10-05T21:15:19.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.767+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ff7471c390 con 0x55ff746686a0 2023-10-05T21:15:19.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.767+0000 7eff06ffd700 1 -- 172.21.15.153:0/2187054001 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff0c01a7a0 con 0x55ff746686a0 2023-10-05T21:15:19.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.767+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ff7471c7e0 con 0x55ff746686a0 2023-10-05T21:15:19.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.768+0000 7eff23d6a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.768+0000 7eff06ffd700 1 -- 172.21.15.153:0/2187054001 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7eff0c01a900 con 0x55ff746686a0 2023-10-05T21:15:19.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.768+0000 7eff06ffd700 1 --2- 172.21.15.153:0/2187054001 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7efefc034190 0x7efefc036640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.768+0000 7eff06ffd700 1 -- 172.21.15.153:0/2187054001 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7eff0c048e10 con 0x55ff746686a0 2023-10-05T21:15:19.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.768+0000 7eff16641700 1 --2- 172.21.15.153:0/2187054001 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7efefc034190 0x7efefc036640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.768+0000 7eff23d6a680 1 --2- 172.21.15.153:0/2187054001 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ff74669a30 0x55ff74727bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.769+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff74728340 con 0x55ff74669a30 2023-10-05T21:15:19.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.769+0000 7eff17643700 1 --2- 172.21.15.153:0/2187054001 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ff74669a30 0x55ff74727bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.769+0000 7eff16641700 1 --2- 172.21.15.153:0/2187054001 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7efefc034190 0x7efefc036640 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7eff08003080 tx=0x7eff08015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.769+0000 7eff17643700 1 --2- 172.21.15.153:0/2187054001 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ff74669a30 0x55ff74727bb0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.769+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.769+0000 7eff23d6a680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.769+0000 7eff23d6a680 20 realm 2023-10-05T21:15:19.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.769+0000 7eff23d6a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.769+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff74725190 con 0x55ff74669a30 2023-10-05T21:15:19.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.769+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.769+0000 7eff23d6a680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.769+0000 7eff23d6a680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:19.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.769+0000 7eff23d6a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.769+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff74728e40 con 0x55ff74669a30 2023-10-05T21:15:19.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.770+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.770+0000 7eff23d6a680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.770+0000 7eff23d6a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.770+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff74728a80 con 0x55ff74669a30 2023-10-05T21:15:19.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.770+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.770+0000 7eff23d6a680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.770+0000 7eff23d6a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.770+0000 7eff23d6a680 1 --2- 172.21.15.153:0/2187054001 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ff7472a200 0x55ff7472c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.770+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472cb20 con 0x55ff7472a200 2023-10-05T21:15:19.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.770+0000 7eff16e42700 1 --2- 172.21.15.153:0/2187054001 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ff7472a200 0x55ff7472c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.770+0000 7eff16e42700 1 --2- 172.21.15.153:0/2187054001 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ff7472a200 0x55ff7472c5e0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.771+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7eff0c014070 con 0x55ff7472a200 2023-10-05T21:15:19.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.771+0000 7eff23d6a680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:19.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.771+0000 7eff23d6a680 20 searching for the correct realm 2023-10-05T21:15:19.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.771+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x55ff7472a200 2023-10-05T21:15:19.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.771+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff0c014070 con 0x55ff7472a200 2023-10-05T21:15:19.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.771+0000 7eff16e42700 1 --2- 172.21.15.153:0/2187054001 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7eff0c02d020 0x7eff0c02d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.771+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x7eff0c02d020 2023-10-05T21:15:19.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.771+0000 7eff16641700 1 --2- 172.21.15.153:0/2187054001 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7eff0c02d020 0x7eff0c02d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.771+0000 7eff16641700 1 --2- 172.21.15.153:0/2187054001 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7eff0c02d020 0x7eff0c02d3f0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.772+0000 7eff16641700 1 -- 172.21.15.153:0/2187054001 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff08019040 con 0x7eff0c02d020 2023-10-05T21:15:19.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.772+0000 7eff16641700 1 --2- 172.21.15.153:0/2187054001 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7eff08007030 0x7eff0801d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.772+0000 7eff16641700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x7eff08007030 2023-10-05T21:15:19.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.772+0000 7eff17643700 1 --2- 172.21.15.153:0/2187054001 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7eff08007030 0x7eff0801d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.772+0000 7eff17643700 1 --2- 172.21.15.153:0/2187054001 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7eff08007030 0x7eff0801d420 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.773+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1000a570 con 0x7eff08007030 2023-10-05T21:15:19.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.773+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x55ff74669a30 2023-10-05T21:15:19.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.773+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.773+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x55ff74669a30 2023-10-05T21:15:19.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.773+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.773+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x7eff08007030 2023-10-05T21:15:19.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.773+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1000a570 con 0x7eff08007030 2023-10-05T21:15:19.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.773+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x7eff08007030 2023-10-05T21:15:19.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.774+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1000a570 con 0x7eff08007030 2023-10-05T21:15:19.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.774+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x7eff0c02d020 2023-10-05T21:15:19.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.774+0000 7eff16641700 1 -- 172.21.15.153:0/2187054001 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff08019040 con 0x7eff0c02d020 2023-10-05T21:15:19.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.774+0000 7eff16641700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x55ff7472a200 2023-10-05T21:15:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.774+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7eff0c014070 con 0x55ff7472a200 2023-10-05T21:15:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.774+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x55ff74669a30 2023-10-05T21:15:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.774+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.774+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x7eff08007030 2023-10-05T21:15:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.775+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1000a570 con 0x7eff08007030 2023-10-05T21:15:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.775+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x55ff74669a30 2023-10-05T21:15:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.775+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.775+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x7eff0c02d020 2023-10-05T21:15:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.775+0000 7eff16641700 1 -- 172.21.15.153:0/2187054001 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff08019040 con 0x7eff0c02d020 2023-10-05T21:15:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.775+0000 7eff16641700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x55ff7472a200 2023-10-05T21:15:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.775+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff0c014070 con 0x55ff7472a200 2023-10-05T21:15:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.775+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x55ff7472a200 2023-10-05T21:15:19.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.775+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff0c014070 con 0x55ff7472a200 2023-10-05T21:15:19.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.775+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x7eff08007030 2023-10-05T21:15:19.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.776+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1000a570 con 0x7eff08007030 2023-10-05T21:15:19.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.776+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x55ff7472a200 2023-10-05T21:15:19.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.776+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff0c014070 con 0x55ff7472a200 2023-10-05T21:15:19.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.776+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x55ff7472a200 2023-10-05T21:15:19.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.776+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff0c014070 con 0x55ff7472a200 2023-10-05T21:15:19.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.776+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x55ff74669a30 2023-10-05T21:15:19.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.777+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.777+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x55ff74669a30 2023-10-05T21:15:19.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.777+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.777+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x7eff08007030 2023-10-05T21:15:19.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.777+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1000a570 con 0x7eff08007030 2023-10-05T21:15:19.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.777+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x55ff7472a200 2023-10-05T21:15:19.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.778+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff0c014070 con 0x55ff7472a200 2023-10-05T21:15:19.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.778+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x7eff0c02d020 2023-10-05T21:15:19.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.778+0000 7eff16641700 1 -- 172.21.15.153:0/2187054001 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff08019040 con 0x7eff0c02d020 2023-10-05T21:15:19.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.778+0000 7eff16641700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x55ff74669a30 2023-10-05T21:15:19.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.778+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.778+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x7eff08007030 2023-10-05T21:15:19.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.779+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1000a570 con 0x7eff08007030 2023-10-05T21:15:19.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.779+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x55ff7472a200 2023-10-05T21:15:19.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.779+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff0c014070 con 0x55ff7472a200 2023-10-05T21:15:19.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.779+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x7eff08007030 2023-10-05T21:15:19.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.779+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1000a570 con 0x7eff08007030 2023-10-05T21:15:19.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.779+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x7eff0c02d020 2023-10-05T21:15:19.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.779+0000 7eff16641700 1 -- 172.21.15.153:0/2187054001 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff08019040 con 0x7eff0c02d020 2023-10-05T21:15:19.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.779+0000 7eff16641700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x55ff7472a200 2023-10-05T21:15:19.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.779+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff0c014070 con 0x55ff7472a200 2023-10-05T21:15:19.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.779+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x7eff08007030 2023-10-05T21:15:19.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.780+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1000a570 con 0x7eff08007030 2023-10-05T21:15:19.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.780+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x55ff74669a30 2023-10-05T21:15:19.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.780+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.780+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e3d0 con 0x7eff0c02d020 2023-10-05T21:15:19.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.780+0000 7eff16641700 1 -- 172.21.15.153:0/2187054001 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff08019040 con 0x7eff0c02d020 2023-10-05T21:15:19.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.780+0000 7eff23d6a680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:19.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.780+0000 7eff23d6a680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:19.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.780+0000 7eff23d6a680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:19.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.780+0000 7eff23d6a680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:19.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.780+0000 7eff23d6a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.780+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472d440 con 0x55ff74669a30 2023-10-05T21:15:19.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.780+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.780+0000 7eff23d6a680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.780+0000 7eff23d6a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.780+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472d040 con 0x55ff74669a30 2023-10-05T21:15:19.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.781+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.781+0000 7eff23d6a680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.781+0000 7eff23d6a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.781+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472dd80 con 0x55ff74669a30 2023-10-05T21:15:19.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.781+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.781+0000 7eff23d6a680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:19.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.781+0000 7eff23d6a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.781+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472e780 con 0x55ff7472a200 2023-10-05T21:15:19.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.781+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7eff0c014070 con 0x55ff7472a200 2023-10-05T21:15:19.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.781+0000 7eff23d6a680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.781+0000 7eff23d6a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.781+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472eb30 con 0x55ff74669a30 2023-10-05T21:15:19.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.781+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.781+0000 7eff23d6a680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.781+0000 7eff23d6a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.781+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472d930 con 0x55ff74669a30 2023-10-05T21:15:19.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.782+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.782+0000 7eff23d6a680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.782+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472d900 con 0x55ff7472a200 2023-10-05T21:15:19.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.782+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff0c014070 con 0x55ff7472a200 2023-10-05T21:15:19.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.782+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472d900 con 0x7eff0c02d020 2023-10-05T21:15:19.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.782+0000 7eff16641700 1 -- 172.21.15.153:0/2187054001 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff08019040 con 0x7eff0c02d020 2023-10-05T21:15:19.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.782+0000 7eff16641700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472d900 con 0x7eff08007030 2023-10-05T21:15:19.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.782+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1000a570 con 0x7eff08007030 2023-10-05T21:15:19.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.782+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472eb30 con 0x55ff74669a30 2023-10-05T21:15:19.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.782+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.782+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472eb30 con 0x55ff74669a30 2023-10-05T21:15:19.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.783+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.783+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472eb30 con 0x7eff08007030 2023-10-05T21:15:19.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.783+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1000a570 con 0x7eff08007030 2023-10-05T21:15:19.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.783+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472eb30 con 0x7eff08007030 2023-10-05T21:15:19.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.783+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1000a570 con 0x7eff08007030 2023-10-05T21:15:19.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.783+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472eb30 con 0x7eff0c02d020 2023-10-05T21:15:19.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.783+0000 7eff16641700 1 -- 172.21.15.153:0/2187054001 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff08019040 con 0x7eff0c02d020 2023-10-05T21:15:19.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.783+0000 7eff16641700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472eb30 con 0x55ff7472a200 2023-10-05T21:15:19.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.784+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7eff0c014070 con 0x55ff7472a200 2023-10-05T21:15:19.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.784+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472eb30 con 0x55ff74669a30 2023-10-05T21:15:19.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.784+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.784+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472eb30 con 0x7eff08007030 2023-10-05T21:15:19.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.784+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1000a570 con 0x7eff08007030 2023-10-05T21:15:19.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.784+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472eb30 con 0x55ff74669a30 2023-10-05T21:15:19.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.784+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.784+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472eb30 con 0x7eff0c02d020 2023-10-05T21:15:19.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.784+0000 7eff16641700 1 -- 172.21.15.153:0/2187054001 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff08019040 con 0x7eff0c02d020 2023-10-05T21:15:19.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.784+0000 7eff16641700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472eb30 con 0x55ff7472a200 2023-10-05T21:15:19.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.785+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff0c04b040 con 0x55ff7472a200 2023-10-05T21:15:19.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.785+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472eb30 con 0x55ff7472a200 2023-10-05T21:15:19.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.785+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff0c04b040 con 0x55ff7472a200 2023-10-05T21:15:19.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.785+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472eb30 con 0x7eff08007030 2023-10-05T21:15:19.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.785+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1000a570 con 0x7eff08007030 2023-10-05T21:15:19.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.785+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472eb30 con 0x55ff7472a200 2023-10-05T21:15:19.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.785+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff0c04b040 con 0x55ff7472a200 2023-10-05T21:15:19.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.785+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472eb30 con 0x55ff7472a200 2023-10-05T21:15:19.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.785+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff0c04b040 con 0x55ff7472a200 2023-10-05T21:15:19.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.785+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472eb30 con 0x55ff74669a30 2023-10-05T21:15:19.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.786+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.786+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472eb30 con 0x55ff74669a30 2023-10-05T21:15:19.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.786+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.786+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472eb30 con 0x7eff08007030 2023-10-05T21:15:19.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.786+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1000a570 con 0x7eff08007030 2023-10-05T21:15:19.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.786+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472eb30 con 0x55ff7472a200 2023-10-05T21:15:19.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.786+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff0c04b040 con 0x55ff7472a200 2023-10-05T21:15:19.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.786+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472eb30 con 0x7eff0c02d020 2023-10-05T21:15:19.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.786+0000 7eff16641700 1 -- 172.21.15.153:0/2187054001 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff08019040 con 0x7eff0c02d020 2023-10-05T21:15:19.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.786+0000 7eff16641700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472eb30 con 0x55ff74669a30 2023-10-05T21:15:19.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.787+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.787+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472eb30 con 0x7eff08007030 2023-10-05T21:15:19.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.787+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1000a570 con 0x7eff08007030 2023-10-05T21:15:19.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.787+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472eb30 con 0x55ff7472a200 2023-10-05T21:15:19.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.787+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff0c04b040 con 0x55ff7472a200 2023-10-05T21:15:19.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.787+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472eb30 con 0x7eff08007030 2023-10-05T21:15:19.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.787+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1000a570 con 0x7eff08007030 2023-10-05T21:15:19.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.787+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472eb30 con 0x7eff0c02d020 2023-10-05T21:15:19.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.788+0000 7eff16641700 1 -- 172.21.15.153:0/2187054001 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff08019040 con 0x7eff0c02d020 2023-10-05T21:15:19.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.788+0000 7eff16641700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472eb30 con 0x55ff7472a200 2023-10-05T21:15:19.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.788+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff0c04b040 con 0x55ff7472a200 2023-10-05T21:15:19.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.788+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472eb30 con 0x7eff08007030 2023-10-05T21:15:19.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.788+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff1000a570 con 0x7eff08007030 2023-10-05T21:15:19.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.788+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472eb30 con 0x55ff74669a30 2023-10-05T21:15:19.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.788+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.788+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472eb30 con 0x7eff0c02d020 2023-10-05T21:15:19.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.789+0000 7eff16641700 1 -- 172.21.15.153:0/2187054001 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff08019040 con 0x7eff0c02d020 2023-10-05T21:15:19.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.789+0000 7eff23d6a680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:19.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.789+0000 7eff23d6a680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:19.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.789+0000 7eff23d6a680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:19.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.789+0000 7eff23d6a680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:19.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.789+0000 7eff23d6a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.789+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472d900 con 0x55ff74669a30 2023-10-05T21:15:19.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.789+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.789+0000 7eff23d6a680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.789+0000 7eff23d6a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.789+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472f4a0 con 0x55ff7472a200 2023-10-05T21:15:19.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.789+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7eff0c04b040 con 0x55ff7472a200 2023-10-05T21:15:19.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.789+0000 7eff23d6a680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:19.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.789+0000 7eff23d6a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.789+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472fd40 con 0x55ff74669a30 2023-10-05T21:15:19.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.789+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.789+0000 7eff23d6a680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.789+0000 7eff23d6a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.789+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472fd40 con 0x55ff74669a30 2023-10-05T21:15:19.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.790+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.790+0000 7eff23d6a680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:19.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.790+0000 7eff23d6a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.790+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472fd40 con 0x7eff08007030 2023-10-05T21:15:19.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.790+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7eff1000a570 con 0x7eff08007030 2023-10-05T21:15:19.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.790+0000 7eff23d6a680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.790+0000 7eff23d6a680 20 zone default found 2023-10-05T21:15:19.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.790+0000 7eff23d6a680 4 Realm: () 2023-10-05T21:15:19.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.790+0000 7eff23d6a680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:19.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.790+0000 7eff23d6a680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:19.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.790+0000 7eff23d6a680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:19.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.790+0000 7eff23d6a680 20 zonegroup default 2023-10-05T21:15:19.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.790+0000 7eff23d6a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.790+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7472fd40 con 0x7eff08007030 2023-10-05T21:15:19.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.790+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7eff1000a570 con 0x7eff08007030 2023-10-05T21:15:19.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.790+0000 7eff23d6a680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.790+0000 7eff23d6a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.790+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff747316c0 con 0x55ff7472a200 2023-10-05T21:15:19.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.791+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7eff0c04b040 con 0x55ff7472a200 2023-10-05T21:15:19.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.791+0000 7eff23d6a680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.791+0000 7eff23d6a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.791+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff74731a70 con 0x55ff7472a200 2023-10-05T21:15:19.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.791+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7eff0c04b040 con 0x55ff7472a200 2023-10-05T21:15:19.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.791+0000 7eff23d6a680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.791+0000 7eff23d6a680 20 started sync module instance, tier type = 2023-10-05T21:15:19.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.791+0000 7eff23d6a680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:19.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.791+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff74730de0 con 0x7eff0c02d020 2023-10-05T21:15:19.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.792+0000 7eff16641700 1 -- 172.21.15.153:0/2187054001 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff08019040 con 0x7eff0c02d020 2023-10-05T21:15:19.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.792+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94555658717328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff74732310 con 0x7eff0c02d020 2023-10-05T21:15:19.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.792+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff74732bb0 con 0x55ff74669a30 2023-10-05T21:15:19.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.792+0000 7eff16641700 1 -- 172.21.15.153:0/2187054001 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94555658717328] v29'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff08019040 con 0x7eff0c02d020 2023-10-05T21:15:19.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.792+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.793+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94555658725056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff74733000 con 0x55ff74669a30 2023-10-05T21:15:19.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.793+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff74733a10 con 0x55ff7472a200 2023-10-05T21:15:19.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.793+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94555658725056] v29'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.793+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff0c04b040 con 0x55ff7472a200 2023-10-05T21:15:19.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.793+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94555658726160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff74732f60 con 0x55ff7472a200 2023-10-05T21:15:19.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.793+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff747347a0 con 0x7eff0c02d020 2023-10-05T21:15:19.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.794+0000 7eff16641700 1 -- 172.21.15.153:0/2187054001 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff08019040 con 0x7eff0c02d020 2023-10-05T21:15:19.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.794+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94555658734416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff74735490 con 0x7eff0c02d020 2023-10-05T21:15:19.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.794+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff74735ea0 con 0x55ff74669a30 2023-10-05T21:15:19.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.794+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94555658726160] v29'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff0c04b040 con 0x55ff7472a200 2023-10-05T21:15:19.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.795+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.795+0000 7eff16641700 1 -- 172.21.15.153:0/2187054001 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94555658734416] v29'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff08019040 con 0x7eff0c02d020 2023-10-05T21:15:19.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.795+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94555658738096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff747362f0 con 0x55ff74669a30 2023-10-05T21:15:19.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.795+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff747366a0 con 0x7eff08007030 2023-10-05T21:15:19.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.796+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94555658738096] v29'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.796+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff1000a570 con 0x7eff08007030 2023-10-05T21:15:19.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.796+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94555658739200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff74736740 con 0x7eff08007030 2023-10-05T21:15:19.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.796+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff74737080 con 0x7eff08007030 2023-10-05T21:15:19.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.796+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94555658739200] v29'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff1000a570 con 0x7eff08007030 2023-10-05T21:15:19.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.796+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff1000a570 con 0x7eff08007030 2023-10-05T21:15:19.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.796+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94555658740864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff74737040 con 0x7eff08007030 2023-10-05T21:15:19.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.796+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff74737a90 con 0x7eff08007030 2023-10-05T21:15:19.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.797+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(98 notify.7 [create] v29'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff1000a570 con 0x7eff08007030 2023-10-05T21:15:19.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.797+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94555658745184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff74737f20 con 0x7eff08007030 2023-10-05T21:15:19.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.797+0000 7eff23d6a680 20 add_watcher() i=0 2023-10-05T21:15:19.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.797+0000 7eff23d6a680 20 add_watcher() i=1 2023-10-05T21:15:19.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.797+0000 7eff23d6a680 20 add_watcher() i=2 2023-10-05T21:15:19.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.797+0000 7eff23d6a680 20 add_watcher() i=3 2023-10-05T21:15:19.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.797+0000 7eff23d6a680 20 add_watcher() i=4 2023-10-05T21:15:19.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.797+0000 7eff23d6a680 20 add_watcher() i=5 2023-10-05T21:15:19.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.797+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(97 notify.6 [watch watch cookie 94555658740864] v29'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff1000a570 con 0x7eff08007030 2023-10-05T21:15:19.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.797+0000 7eff23d6a680 20 add_watcher() i=6 2023-10-05T21:15:19.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.798+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94555658745184] v29'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff1000a570 con 0x7eff08007030 2023-10-05T21:15:19.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.798+0000 7eff23d6a680 20 add_watcher() i=7 2023-10-05T21:15:19.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.798+0000 7eff23d6a680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:19.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.798+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff747368d0 con 0x55ff74669a30 2023-10-05T21:15:19.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.798+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.798+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94555658746288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff747368d0 con 0x55ff74669a30 2023-10-05T21:15:19.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.799+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94555658746288] v29'160 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.799+0000 7efee7fe7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:19.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.799+0000 7eff23d6a680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:19.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.799+0000 7eff23d6a680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:19.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.799+0000 7eff23d6a680 1 Processor -- start 2023-10-05T21:15:19.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.799+0000 7eff23d6a680 1 -- start start 2023-10-05T21:15:19.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.799+0000 7eff23d6a680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff74745970 0x55ff74745d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.799+0000 7eff23d6a680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff74746350 con 0x55ff74745970 2023-10-05T21:15:19.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.800+0000 7eff16641700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff74745970 0x55ff74745d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.800+0000 7eff16641700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff74745970 0x55ff74745d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38306/0 (socket says 172.21.15.153:38306) 2023-10-05T21:15:19.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.800+0000 7eff16641700 1 -- 172.21.15.153:0/1657606074 learned_addr learned my addr 172.21.15.153:0/1657606074 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.800+0000 7eff16641700 1 -- 172.21.15.153:0/1657606074 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff74746490 con 0x55ff74745970 2023-10-05T21:15:19.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.800+0000 7eff16641700 1 --2- 172.21.15.153:0/1657606074 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff74745970 0x55ff74745d80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x55ff74669270 tx=0x7eff08012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=758b4581bed55e65 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.800+0000 7efee77e6700 1 -- 172.21.15.153:0/1657606074 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff0801de90 con 0x55ff74745970 2023-10-05T21:15:19.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.800+0000 7efee77e6700 1 -- 172.21.15.153:0/1657606074 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0802b440 con 0x55ff74745970 2023-10-05T21:15:19.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.800+0000 7efee77e6700 1 -- 172.21.15.153:0/1657606074 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff0802b5f0 con 0x55ff74745970 2023-10-05T21:15:19.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.801+0000 7eff23d6a680 1 -- 172.21.15.153:0/1657606074 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff74745970 msgr2=0x55ff74745d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.801+0000 7eff23d6a680 1 --2- 172.21.15.153:0/1657606074 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff74745970 0x55ff74745d80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x55ff74669270 tx=0x7eff08012000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.801+0000 7eff23d6a680 1 -- 172.21.15.153:0/1657606074 shutdown_connections 2023-10-05T21:15:19.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.801+0000 7eff23d6a680 1 --2- 172.21.15.153:0/1657606074 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff74745970 0x55ff74745d80 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.801+0000 7eff23d6a680 1 -- 172.21.15.153:0/1657606074 >> 172.21.15.153:0/1657606074 conn(0x55ff74740b70 msgr2=0x55ff7473ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.801+0000 7eff23d6a680 1 -- 172.21.15.153:0/1657606074 shutdown_connections 2023-10-05T21:15:19.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.801+0000 7eff23d6a680 1 -- 172.21.15.153:0/1657606074 wait complete. 2023-10-05T21:15:19.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.801+0000 7eff23d6a680 1 Processor -- start 2023-10-05T21:15:19.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.801+0000 7eff23d6a680 1 -- start start 2023-10-05T21:15:19.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.801+0000 7eff23d6a680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff74745970 0x55ff7474b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.801+0000 7eff23d6a680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff7474ba10 con 0x55ff74745970 2023-10-05T21:15:19.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.802+0000 7eff16641700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff74745970 0x55ff7474b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.802+0000 7eff16641700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff74745970 0x55ff7474b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38312/0 (socket says 172.21.15.153:38312) 2023-10-05T21:15:19.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.802+0000 7eff16641700 1 -- 172.21.15.153:0/3644445694 learned_addr learned my addr 172.21.15.153:0/3644445694 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.802+0000 7eff16641700 1 -- 172.21.15.153:0/3644445694 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff74668b40 con 0x55ff74745970 2023-10-05T21:15:19.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.802+0000 7eff16641700 1 --2- 172.21.15.153:0/3644445694 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff74745970 0x55ff7474b4d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7eff0800af20 tx=0x7eff08030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.802+0000 7efee5fe3700 1 -- 172.21.15.153:0/3644445694 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff0803f690 con 0x55ff74745970 2023-10-05T21:15:19.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.802+0000 7efee5fe3700 1 -- 172.21.15.153:0/3644445694 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0803f7f0 con 0x55ff74745970 2023-10-05T21:15:19.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.802+0000 7eff23d6a680 1 -- 172.21.15.153:0/3644445694 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ff7474bc10 con 0x55ff74745970 2023-10-05T21:15:19.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.802+0000 7efee5fe3700 1 -- 172.21.15.153:0/3644445694 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff0803f980 con 0x55ff74745970 2023-10-05T21:15:19.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.802+0000 7eff23d6a680 1 -- 172.21.15.153:0/3644445694 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ff7474c060 con 0x55ff74745970 2023-10-05T21:15:19.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.803+0000 7efee5fe3700 1 -- 172.21.15.153:0/3644445694 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7eff08047070 con 0x55ff74745970 2023-10-05T21:15:19.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.803+0000 7efee5fe3700 1 --2- 172.21.15.153:0/3644445694 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7efe5c034140 0x7efe5c0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.803+0000 7efee5fe3700 1 -- 172.21.15.153:0/3644445694 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7eff08030070 con 0x55ff74745970 2023-10-05T21:15:19.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.803+0000 7eff17643700 1 --2- 172.21.15.153:0/3644445694 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7efe5c034140 0x7efe5c0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.803+0000 7eff23d6a680 5 note: GC not initialized 2023-10-05T21:15:19.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.804+0000 7eff17643700 1 --2- 172.21.15.153:0/3644445694 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7efe5c034140 0x7efe5c0365f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x55ff74737e00 tx=0x7eff10036620 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.804+0000 7efe56ffd700 20 reqs_thread_entry: start 2023-10-05T21:15:19.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.804+0000 7efe54ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:19.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.804+0000 7eff23d6a680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:19.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.804+0000 7eff23d6a680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:19.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.804+0000 7efe46ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:50 2023 2023-10-05T21:15:19.831 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:19.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.805+0000 7efe467fc700 20 reqs_thread_entry: start 2023-10-05T21:15:19.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.805+0000 7eff23d6a680 10 log_show_next pos 0 bl 0 off 0 eof 0 2023-10-05T21:15:19.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.805+0000 7eff23d6a680 1 --2- 172.21.15.153:0/3644445694 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55ff747afe40 0x55ff747b2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.805+0000 7eff23d6a680 1 -- 172.21.15.153:0/3644445694 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:1 6.13 6:cdb034dd:::2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.2-myfoo2:head [read 0~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff747b2760 con 0x55ff747afe40 2023-10-05T21:15:19.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.805+0000 7eff16e42700 1 --2- 172.21.15.153:0/3644445694 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55ff747afe40 0x55ff747b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.805+0000 7eff16e42700 1 --2- 172.21.15.153:0/3644445694 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55ff747afe40 0x55ff747b2220 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.805+0000 7eff16e42700 1 -- 172.21.15.153:0/3644445694 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(1 2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.2-myfoo2 [read 0~850 out=850b] v0'0 uv17 ondisk = 0) v8 ==== 208+0+850 (crc 0 0 0) 0x7eff0c04b040 con 0x55ff747afe40 2023-10-05T21:15:19.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.805+0000 7eff23d6a680 10 read 850 2023-10-05T21:15:19.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.805+0000 7eff23d6a680 10 log_show_next pos 850 bl 850 off 419 eof 1 2023-10-05T21:15:19.832 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:19.832 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_id": "193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.2", 2023-10-05T21:15:19.832 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_owner": "foo", 2023-10-05T21:15:19.832 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo2", 2023-10-05T21:15:19.832 INFO:teuthology.orchestra.run.smithi153.stdout: "log_entries": [ 2023-10-05T21:15:19.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:19.832 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo2", 2023-10-05T21:15:19.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:15:15.848035Z", 2023-10-05T21:15:19.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time_local": "2023-10-05T21:15:15.848035+0000", 2023-10-05T21:15:19.833 INFO:teuthology.orchestra.run.smithi153.stdout: "remote_addr": "172.21.0.51", 2023-10-05T21:15:19.833 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:19.833 INFO:teuthology.orchestra.run.smithi153.stdout: "operation": "create_bucket", 2023-10-05T21:15:19.833 INFO:teuthology.orchestra.run.smithi153.stdout: "uri": "PUT /myfoo2/ HTTP/1.1", 2023-10-05T21:15:19.833 INFO:teuthology.orchestra.run.smithi153.stdout: "http_status": "200", 2023-10-05T21:15:19.833 INFO:teuthology.orchestra.run.smithi153.stdout: "error_code": "", 2023-10-05T21:15:19.833 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:15:19.833 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:15:19.833 INFO:teuthology.orchestra.run.smithi153.stdout: "object_size": 0, 2023-10-05T21:15:19.833 INFO:teuthology.orchestra.run.smithi153.stdout: "total_time": 6, 2023-10-05T21:15:19.833 INFO:teuthology.orchestra.run.smithi153.stdout: "user_agent": "Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic", 2023-10-05T21:15:19.834 INFO:teuthology.orchestra.run.smithi153.stdout: "referrer": "", 2023-10-05T21:15:19.834 INFO:teuthology.orchestra.run.smithi153.stdout: "trans_id": "tx000000967187a79540e34-00651f2763-107c-default", 2023-10-05T21:15:19.834 INFO:teuthology.orchestra.run.smithi153.stdout: "authentication_type": "Local", 2023-10-05T21:15:19.834 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key_id": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:19.834 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url": false 2023-10-05T21:15:19.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:19.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:19.834 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo2", 2023-10-05T21:15:19.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:15:15.915034Z", 2023-10-05T21:15:19.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time_local": "2023-10-05T21:15:15.915034+0000", 2023-10-05T21:15:19.834 INFO:teuthology.orchestra.run.smithi153.stdout: "remote_addr": "172.21.0.51", 2023-10-05T21:15:19.834 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:19.835 INFO:teuthology.orchestra.run.smithi153.stdout: "operation": "delete_bucket", 2023-10-05T21:15:19.835 INFO:teuthology.orchestra.run.smithi153.stdout: "uri": "DELETE /myfoo2/ HTTP/1.1", 2023-10-05T21:15:19.835 INFO:teuthology.orchestra.run.smithi153.stdout: "http_status": "204", 2023-10-05T21:15:19.835 INFO:teuthology.orchestra.run.smithi153.stdout: "error_code": "NoContent", 2023-10-05T21:15:19.835 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:15:19.835 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:15:19.835 INFO:teuthology.orchestra.run.smithi153.stdout: "object_size": 0, 2023-10-05T21:15:19.835 INFO:teuthology.orchestra.run.smithi153.stdout: "total_time": 26, 2023-10-05T21:15:19.835 INFO:teuthology.orchestra.run.smithi153.stdout: "user_agent": "Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic", 2023-10-05T21:15:19.835 INFO:teuthology.orchestra.run.smithi153.stdout: "referrer": "", 2023-10-05T21:15:19.835 INFO:teuthology.orchestra.run.smithi153.stdout: "trans_id": "tx0000085e68fe8304ba5f3-00651f2763-107c-default", 2023-10-05T21:15:19.835 INFO:teuthology.orchestra.run.smithi153.stdout: "authentication_type": "Local", 2023-10-05T21:15:19.836 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key_id": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:19.836 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url": false 2023-10-05T21:15:19.836 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:19.836 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:19.836 INFO:teuthology.orchestra.run.smithi153.stdout: "log_sum": { 2023-10-05T21:15:19.836 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:15:19.836 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:15:19.836 INFO:teuthology.orchestra.run.smithi153.stdout: "total_time": 32, 2023-10-05T21:15:19.836 INFO:teuthology.orchestra.run.smithi153.stdout: "total_entries": 2 2023-10-05T21:15:19.836 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:19.836 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:19.836 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:15:19.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.805+0000 7eff23d6a680 10 log_show_next pos 850 bl 850 off 850 eof 1 2023-10-05T21:15:19.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.806+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94555658717328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff7476fa30 con 0x7eff0c02d020 2023-10-05T21:15:19.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.806+0000 7eff16641700 1 -- 172.21.15.153:0/2187054001 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(102 notify.0 [watch unwatch cookie 94555658717328] v29'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff0804f070 con 0x7eff0c02d020 2023-10-05T21:15:19.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.806+0000 7eff23d6a680 20 remove_watcher() i=0 2023-10-05T21:15:19.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.806+0000 7eff23d6a680 2 removed watcher, disabling cache 2023-10-05T21:15:19.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.806+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94555658725056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff74730890 con 0x55ff74669a30 2023-10-05T21:15:19.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.807+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(103 notify.1 [watch unwatch cookie 94555658725056] v29'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.807+0000 7eff23d6a680 20 remove_watcher() i=1 2023-10-05T21:15:19.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.807+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:104 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94555658726160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff747326c0 con 0x55ff7472a200 2023-10-05T21:15:19.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.808+0000 7eff16e42700 1 -- 172.21.15.153:0/2187054001 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(104 notify.2 [watch unwatch cookie 94555658726160] v29'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff0c04b040 con 0x55ff7472a200 2023-10-05T21:15:19.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.808+0000 7eff23d6a680 20 remove_watcher() i=2 2023-10-05T21:15:19.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.808+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94555658734416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff74732bb0 con 0x7eff0c02d020 2023-10-05T21:15:19.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.809+0000 7eff16641700 1 -- 172.21.15.153:0/2187054001 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(105 notify.3 [watch unwatch cookie 94555658734416] v29'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff0804f070 con 0x7eff0c02d020 2023-10-05T21:15:19.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.809+0000 7eff23d6a680 20 remove_watcher() i=3 2023-10-05T21:15:19.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.809+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94555658738096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff74732bb0 con 0x55ff74669a30 2023-10-05T21:15:19.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.810+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(106 notify.4 [watch unwatch cookie 94555658738096] v29'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.810+0000 7eff23d6a680 20 remove_watcher() i=4 2023-10-05T21:15:19.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.810+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:107 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94555658739200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff74732bb0 con 0x7eff08007030 2023-10-05T21:15:19.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.810+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(107 notify.5 [watch unwatch cookie 94555658739200] v29'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff1000a570 con 0x7eff08007030 2023-10-05T21:15:19.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.810+0000 7eff23d6a680 20 remove_watcher() i=5 2023-10-05T21:15:19.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.810+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94555658740864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff74732bb0 con 0x7eff08007030 2023-10-05T21:15:19.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.811+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(108 notify.6 [watch unwatch cookie 94555658740864] v29'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff1000a570 con 0x7eff08007030 2023-10-05T21:15:19.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.811+0000 7eff23d6a680 20 remove_watcher() i=6 2023-10-05T21:15:19.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.811+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94555658745184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff74732bb0 con 0x7eff08007030 2023-10-05T21:15:19.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.812+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(109 notify.7 [watch unwatch cookie 94555658745184] v29'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff1000a570 con 0x7eff08007030 2023-10-05T21:15:19.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.812+0000 7eff23d6a680 20 remove_watcher() i=7 2023-10-05T21:15:19.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.813+0000 7efee7fe7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:19.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.813+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:110 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94555658746288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ff74736480 con 0x55ff74669a30 2023-10-05T21:15:19.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.813+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(110 data_loggenerations_metadata [watch unwatch cookie 94555658746288] v29'161 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7eff1000a570 con 0x55ff74669a30 2023-10-05T21:15:19.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.813+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7eff08007030 msgr2=0x7eff0801d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.813+0000 7eff23d6a680 1 --2- 172.21.15.153:0/2187054001 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7eff08007030 0x7eff0801d420 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.813+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ff74669a30 msgr2=0x55ff74727bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.813+0000 7eff23d6a680 1 --2- 172.21.15.153:0/2187054001 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ff74669a30 0x55ff74727bb0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.813+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7eff0c02d020 msgr2=0x7eff0c02d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.813+0000 7eff23d6a680 1 --2- 172.21.15.153:0/2187054001 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7eff0c02d020 0x7eff0c02d3f0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.813+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ff7472a200 msgr2=0x55ff7472c5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.813+0000 7eff23d6a680 1 --2- 172.21.15.153:0/2187054001 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ff7472a200 0x55ff7472c5e0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.814+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7efefc034190 msgr2=0x7efefc036640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.814+0000 7eff23d6a680 1 --2- 172.21.15.153:0/2187054001 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7efefc034190 0x7efefc036640 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7eff08003080 tx=0x7eff08015000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.814+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff746686a0 msgr2=0x55ff7471be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.814+0000 7eff17643700 1 -- 172.21.15.153:0/2187054001 reap_dead start 2023-10-05T21:15:19.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.814+0000 7eff23d6a680 1 --2- 172.21.15.153:0/2187054001 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff746686a0 0x55ff7471be50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7eff0c0017d0 tx=0x7eff0c014000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.814+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 shutdown_connections 2023-10-05T21:15:19.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.814+0000 7eff23d6a680 1 --2- 172.21.15.153:0/2187054001 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff746686a0 0x55ff7471be50 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.814+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 >> 172.21.15.153:0/2187054001 conn(0x55ff746eeca0 msgr2=0x55ff7470ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.814+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 shutdown_connections 2023-10-05T21:15:19.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.814+0000 7eff23d6a680 1 -- 172.21.15.153:0/2187054001 wait complete. 2023-10-05T21:15:19.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.814+0000 7eff23d6a680 1 -- 172.21.15.153:0/3644445694 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55ff747afe40 msgr2=0x55ff747b2220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.814+0000 7eff23d6a680 1 --2- 172.21.15.153:0/3644445694 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55ff747afe40 0x55ff747b2220 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.814+0000 7eff23d6a680 1 -- 172.21.15.153:0/3644445694 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7efe5c034140 msgr2=0x7efe5c0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.814+0000 7eff23d6a680 1 --2- 172.21.15.153:0/3644445694 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7efe5c034140 0x7efe5c0365f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x55ff74737e00 tx=0x7eff10036620 comp rx=0 tx=0).stop 2023-10-05T21:15:19.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.814+0000 7eff23d6a680 1 -- 172.21.15.153:0/3644445694 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff74745970 msgr2=0x55ff7474b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.814+0000 7eff23d6a680 1 --2- 172.21.15.153:0/3644445694 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff74745970 0x55ff7474b4d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7eff0800af20 tx=0x7eff08030000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.814+0000 7eff23d6a680 1 -- 172.21.15.153:0/3644445694 shutdown_connections 2023-10-05T21:15:19.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.814+0000 7eff23d6a680 1 --2- 172.21.15.153:0/3644445694 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55ff747afe40 0x55ff747b2220 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.814+0000 7eff23d6a680 1 --2- 172.21.15.153:0/3644445694 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff74745970 0x55ff7474b4d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.814+0000 7eff23d6a680 1 --2- 172.21.15.153:0/3644445694 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7efe5c034140 0x7efe5c0365f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.814+0000 7eff23d6a680 1 -- 172.21.15.153:0/3644445694 >> 172.21.15.153:0/3644445694 conn(0x55ff74740b70 msgr2=0x55ff7473eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.814+0000 7eff23d6a680 1 -- 172.21.15.153:0/3644445694 shutdown_connections 2023-10-05T21:15:19.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.814+0000 7eff23d6a680 1 -- 172.21.15.153:0/3644445694 wait complete. 2023-10-05T21:15:19.847 DEBUG:tasks.util.rgw: json result: {'bucket_id': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.2', 'bucket_owner': 'foo', 'bucket': 'myfoo2', 'log_entries': [{'bucket': 'myfoo2', 'time': '2023-10-05T21:15:15.848035Z', 'time_local': '2023-10-05T21:15:15.848035+0000', 'remote_addr': '172.21.0.51', 'user': 'foo', 'operation': 'create_bucket', 'uri': 'PUT /myfoo2/ HTTP/1.1', 'http_status': '200', 'error_code': '', 'bytes_sent': 0, 'bytes_received': 0, 'object_size': 0, 'total_time': 6, 'user_agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic', 'referrer': '', 'trans_id': 'tx000000967187a79540e34-00651f2763-107c-default', 'authentication_type': 'Local', 'access_key_id': '9te6NH5mcdcq0Tc5i8i1', 'temp_url': False}, {'bucket': 'myfoo2', 'time': '2023-10-05T21:15:15.915034Z', 'time_local': '2023-10-05T21:15:15.915034+0000', 'remote_addr': '172.21.0.51', 'user': 'foo', 'operation': 'delete_bucket', 'uri': 'DELETE /myfoo2/ HTTP/1.1', 'http_status': '204', 'error_code': 'NoContent', 'bytes_sent': 0, 'bytes_received': 0, 'object_size': 0, 'total_time': 26, 'user_agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic', 'referrer': '', 'trans_id': 'tx0000085e68fe8304ba5f3-00651f2763-107c-default', 'authentication_type': 'Local', 'access_key_id': '9te6NH5mcdcq0Tc5i8i1', 'temp_url': False}], 'log_sum': {'bytes_sent': 0, 'bytes_received': 0, 'total_time': 32, 'total_entries': 2}} 2023-10-05T21:15:19.847 DEBUG:tasks.radosgw_admin:checking log entry: 2023-10-05T21:15:19.847 DEBUG:tasks.radosgw_admin:checking log entry: 2023-10-05T21:15:19.847 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'rm', '--object', '2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.2-myfoo2'] 2023-10-05T21:15:19.847 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'rm', '--object', '2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.2-myfoo2'] 2023-10-05T21:15:19.848 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log rm --object 2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.2-myfoo2 2023-10-05T21:15:19.892 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:19.892 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:19.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.890+0000 7feffd61d680 1 Processor -- start 2023-10-05T21:15:19.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.890+0000 7feffd61d680 1 -- start start 2023-10-05T21:15:19.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.890+0000 7feffd61d680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55c36d2a6d30 0x55c36d2a9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.890+0000 7feffd61d680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c36d1ed990 con 0x55c36d2a0a40 2023-10-05T21:15:19.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.890+0000 7feffd61d680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c36d1addb0 con 0x55c36d2a6d30 2023-10-05T21:15:19.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.890+0000 7fefefef4700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55c36d2a6d30 0x55c36d2a9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.890+0000 7feff06f5700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55c36d2a0a40 0x55c36d2a0e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:55328/0 (socket says 172.21.15.153:55328) 2023-10-05T21:15:19.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.890+0000 7feff06f5700 1 -- 172.21.15.153:0/1047788035 learned_addr learned my addr 172.21.15.153:0/1047788035 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:19.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.891+0000 7fefef6f3700 1 -- 172.21.15.153:0/1047788035 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2279301715 0 0) 0x55c36d1ed990 con 0x55c36d2a0a40 2023-10-05T21:15:19.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.891+0000 7fefef6f3700 1 -- 172.21.15.153:0/1047788035 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefd8001e10 con 0x55c36d2a0a40 2023-10-05T21:15:19.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.891+0000 7fefefef4700 1 -- 172.21.15.153:0/1047788035 >> v1:172.21.15.111:6789/0 conn(0x55c36d2a0a40 legacy=0x55c36d2a0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.891+0000 7fefefef4700 1 -- 172.21.15.153:0/1047788035 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c36d2a1620 con 0x55c36d2a6d30 2023-10-05T21:15:19.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.891+0000 7fefefef4700 1 --2- 172.21.15.153:0/1047788035 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2a6d30 0x55c36d2a9110 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fefe000a5d0 tx=0x7fefe0005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b98a17e14fa2c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.891+0000 7fefef6f3700 1 -- 172.21.15.153:0/1047788035 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefe0007610 con 0x55c36d2a6d30 2023-10-05T21:15:19.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.891+0000 7fefef6f3700 1 -- 172.21.15.153:0/1047788035 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe0007770 con 0x55c36d2a6d30 2023-10-05T21:15:19.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.891+0000 7fefef6f3700 1 -- 172.21.15.153:0/1047788035 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefe0007a40 con 0x55c36d2a6d30 2023-10-05T21:15:19.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.891+0000 7feffd61d680 1 -- 172.21.15.153:0/1047788035 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2a6d30 msgr2=0x55c36d2a9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.891+0000 7feffd61d680 1 --2- 172.21.15.153:0/1047788035 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2a6d30 0x55c36d2a9110 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fefe000a5d0 tx=0x7fefe0005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:19.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.891+0000 7feffd61d680 1 -- 172.21.15.153:0/1047788035 shutdown_connections 2023-10-05T21:15:19.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.891+0000 7feffd61d680 1 --2- 172.21.15.153:0/1047788035 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2a6d30 0x55c36d2a9110 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.891+0000 7feffd61d680 1 -- 172.21.15.153:0/1047788035 >> 172.21.15.153:0/1047788035 conn(0x55c36d29a300 msgr2=0x55c36d29c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.891+0000 7feffd61d680 1 -- 172.21.15.153:0/1047788035 shutdown_connections 2023-10-05T21:15:19.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.891+0000 7feffd61d680 1 -- 172.21.15.153:0/1047788035 wait complete. 2023-10-05T21:15:19.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.892+0000 7feffd61d680 1 Processor -- start 2023-10-05T21:15:19.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.892+0000 7feffd61d680 1 -- start start 2023-10-05T21:15:19.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.892+0000 7feffd61d680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2a0a40 0x55c36d2c1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.892+0000 7feffd61d680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c36d14dea0 con 0x55c36d2a0a40 2023-10-05T21:15:19.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.892+0000 7feff06f5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2a0a40 0x55c36d2c1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.892+0000 7feff06f5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2a0a40 0x55c36d2c1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38338/0 (socket says 172.21.15.153:38338) 2023-10-05T21:15:19.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.892+0000 7feff06f5700 1 -- 172.21.15.153:0/1002052837 learned_addr learned my addr 172.21.15.153:0/1002052837 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.893+0000 7feff06f5700 1 -- 172.21.15.153:0/1002052837 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe0005cf0 con 0x55c36d2a0a40 2023-10-05T21:15:19.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.893+0000 7feff06f5700 1 --2- 172.21.15.153:0/1002052837 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2a0a40 0x55c36d2c1960 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fefe4001c70 tx=0x7fefe4001820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7649c0bfef208c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.893+0000 7fefee6f1700 1 -- 172.21.15.153:0/1002052837 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefe400bbf0 con 0x55c36d2a0a40 2023-10-05T21:15:19.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.893+0000 7fefee6f1700 1 -- 172.21.15.153:0/1002052837 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe400bd70 con 0x55c36d2a0a40 2023-10-05T21:15:19.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.893+0000 7fefee6f1700 1 -- 172.21.15.153:0/1002052837 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefe400e5f0 con 0x55c36d2a0a40 2023-10-05T21:15:19.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.893+0000 7feffd61d680 1 -- 172.21.15.153:0/1002052837 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2a0a40 msgr2=0x55c36d2c1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.893+0000 7feffd61d680 1 --2- 172.21.15.153:0/1002052837 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2a0a40 0x55c36d2c1960 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fefe4001c70 tx=0x7fefe4001820 comp rx=0 tx=0).stop 2023-10-05T21:15:19.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.893+0000 7feffd61d680 1 -- 172.21.15.153:0/1002052837 shutdown_connections 2023-10-05T21:15:19.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.893+0000 7feffd61d680 1 --2- 172.21.15.153:0/1002052837 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2a0a40 0x55c36d2c1960 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.893+0000 7feffd61d680 1 -- 172.21.15.153:0/1002052837 >> 172.21.15.153:0/1002052837 conn(0x55c36d29a300 msgr2=0x55c36d2bd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.893+0000 7feffd61d680 1 -- 172.21.15.153:0/1002052837 shutdown_connections 2023-10-05T21:15:19.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.893+0000 7feffd61d680 1 -- 172.21.15.153:0/1002052837 wait complete. 2023-10-05T21:15:19.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.894+0000 7feffd61d680 1 Processor -- start 2023-10-05T21:15:19.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.894+0000 7feffd61d680 1 -- start start 2023-10-05T21:15:19.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.894+0000 7feffd61d680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2a0a40 0x55c36d2c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.894+0000 7feffd61d680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c36d144c80 con 0x55c36d2a0a40 2023-10-05T21:15:19.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.894+0000 7feff06f5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2a0a40 0x55c36d2c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.894+0000 7feff06f5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2a0a40 0x55c36d2c8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38348/0 (socket says 172.21.15.153:38348) 2023-10-05T21:15:19.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.894+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 learned_addr learned my addr 172.21.15.153:0/2686019685 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.894+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd8001e10 con 0x55c36d2a0a40 2023-10-05T21:15:19.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.895+0000 7feff06f5700 1 --2- 172.21.15.153:0/2686019685 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2a0a40 0x55c36d2c8e40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fefe4010000 tx=0x7fefe4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.895+0000 7fefeceee700 1 -- 172.21.15.153:0/2686019685 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefe401f070 con 0x55c36d2a0a40 2023-10-05T21:15:19.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.895+0000 7fefeceee700 1 -- 172.21.15.153:0/2686019685 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe4018640 con 0x55c36d2a0a40 2023-10-05T21:15:19.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.895+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c36d2c9380 con 0x55c36d2a0a40 2023-10-05T21:15:19.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.895+0000 7fefeceee700 1 -- 172.21.15.153:0/2686019685 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefe4018910 con 0x55c36d2a0a40 2023-10-05T21:15:19.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.895+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c36d2c97d0 con 0x55c36d2a0a40 2023-10-05T21:15:19.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.895+0000 7fefeceee700 1 -- 172.21.15.153:0/2686019685 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fefe4018a70 con 0x55c36d2a0a40 2023-10-05T21:15:19.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.896+0000 7fefeceee700 1 --2- 172.21.15.153:0/2686019685 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fefdc034140 0x7fefdc0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.896+0000 7fefeceee700 1 -- 172.21.15.153:0/2686019685 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fefe4048d00 con 0x55c36d2a0a40 2023-10-05T21:15:19.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.896+0000 7feffd61d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.896+0000 7fefefef4700 1 --2- 172.21.15.153:0/2686019685 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fefdc034140 0x7fefdc0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.896+0000 7feffd61d680 1 --2- 172.21.15.153:0/2686019685 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55c36d2a6d30 0x55c36d2d4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.896+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2d5340 con 0x55c36d2a6d30 2023-10-05T21:15:19.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.896+0000 7feff0ef6700 1 --2- 172.21.15.153:0/2686019685 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55c36d2a6d30 0x55c36d2d4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.896+0000 7fefefef4700 1 --2- 172.21.15.153:0/2686019685 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fefdc034140 0x7fefdc0365f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fefe000afd0 tx=0x7fefe0014000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.896+0000 7feff0ef6700 1 --2- 172.21.15.153:0/2686019685 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55c36d2a6d30 0x55c36d2d4bb0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.897+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.897+0000 7feffd61d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.897+0000 7feffd61d680 20 realm 2023-10-05T21:15:19.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.897+0000 7feffd61d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.897+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2d2160 con 0x55c36d2a6d30 2023-10-05T21:15:19.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.897+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.897+0000 7feffd61d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.897+0000 7feffd61d680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:19.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.897+0000 7feffd61d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.897+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2d5e40 con 0x55c36d2a6d30 2023-10-05T21:15:19.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.897+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.897+0000 7feffd61d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.897+0000 7feffd61d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.897+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2d6760 con 0x55c36d2a6d30 2023-10-05T21:15:19.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.897+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.897+0000 7feffd61d680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.897+0000 7feffd61d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.897+0000 7feffd61d680 1 --2- 172.21.15.153:0/2686019685 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55c36d2d7020 0x55c36d2d9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.897+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2d9a50 con 0x55c36d2d7020 2023-10-05T21:15:19.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.897+0000 7feff06f5700 1 --2- 172.21.15.153:0/2686019685 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55c36d2d7020 0x55c36d2d9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.898+0000 7feff06f5700 1 --2- 172.21.15.153:0/2686019685 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55c36d2d7020 0x55c36d2d9400 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.898+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fefe4014070 con 0x55c36d2d7020 2023-10-05T21:15:19.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.898+0000 7feffd61d680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:19.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.898+0000 7feffd61d680 20 searching for the correct realm 2023-10-05T21:15:19.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.898+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x55c36d2d7020 2023-10-05T21:15:19.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.898+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe4014070 con 0x55c36d2d7020 2023-10-05T21:15:19.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.898+0000 7feff06f5700 1 --2- 172.21.15.153:0/2686019685 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fefe4016730 0x7fefe4041670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.898+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x7fefe4016730 2023-10-05T21:15:19.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.898+0000 7fefefef4700 1 --2- 172.21.15.153:0/2686019685 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fefe4016730 0x7fefe4041670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.899+0000 7fefefef4700 1 --2- 172.21.15.153:0/2686019685 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fefe4016730 0x7fefe4041670 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.899+0000 7fefefef4700 1 -- 172.21.15.153:0/2686019685 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe0007ce0 con 0x7fefe4016730 2023-10-05T21:15:19.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.899+0000 7fefefef4700 1 --2- 172.21.15.153:0/2686019685 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fefe0007030 0x7fefe001d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.899+0000 7fefefef4700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x7fefe0007030 2023-10-05T21:15:19.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.899+0000 7feff0ef6700 1 --2- 172.21.15.153:0/2686019685 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fefe0007030 0x7fefe001d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.900+0000 7feff0ef6700 1 --2- 172.21.15.153:0/2686019685 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fefe0007030 0x7fefe001d430 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.900+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe800a570 con 0x7fefe0007030 2023-10-05T21:15:19.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.900+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x55c36d2a6d30 2023-10-05T21:15:19.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.900+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.900+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x55c36d2a6d30 2023-10-05T21:15:19.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.900+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.900+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x7fefe0007030 2023-10-05T21:15:19.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.900+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe800a570 con 0x7fefe0007030 2023-10-05T21:15:19.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.900+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x7fefe0007030 2023-10-05T21:15:19.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.901+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe800a570 con 0x7fefe0007030 2023-10-05T21:15:19.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.901+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x7fefe4016730 2023-10-05T21:15:19.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.901+0000 7fefefef4700 1 -- 172.21.15.153:0/2686019685 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe0029040 con 0x7fefe4016730 2023-10-05T21:15:19.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.901+0000 7fefefef4700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x55c36d2d7020 2023-10-05T21:15:19.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.901+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fefe4014070 con 0x55c36d2d7020 2023-10-05T21:15:19.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.901+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x55c36d2a6d30 2023-10-05T21:15:19.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.901+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.901+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x7fefe0007030 2023-10-05T21:15:19.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.902+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe800a570 con 0x7fefe0007030 2023-10-05T21:15:19.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.902+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x55c36d2a6d30 2023-10-05T21:15:19.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.902+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.902+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x7fefe4016730 2023-10-05T21:15:19.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.902+0000 7fefefef4700 1 -- 172.21.15.153:0/2686019685 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe0029040 con 0x7fefe4016730 2023-10-05T21:15:19.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.902+0000 7fefefef4700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x55c36d2d7020 2023-10-05T21:15:19.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.902+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe4014070 con 0x55c36d2d7020 2023-10-05T21:15:19.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.902+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x55c36d2d7020 2023-10-05T21:15:19.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.902+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe4014070 con 0x55c36d2d7020 2023-10-05T21:15:19.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.902+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x7fefe0007030 2023-10-05T21:15:19.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.903+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe800a570 con 0x7fefe0007030 2023-10-05T21:15:19.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.903+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x55c36d2d7020 2023-10-05T21:15:19.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.903+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe4014070 con 0x55c36d2d7020 2023-10-05T21:15:19.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.903+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x55c36d2d7020 2023-10-05T21:15:19.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.903+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe4014070 con 0x55c36d2d7020 2023-10-05T21:15:19.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.903+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x55c36d2a6d30 2023-10-05T21:15:19.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.903+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.903+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x55c36d2a6d30 2023-10-05T21:15:19.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.903+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.903+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x7fefe0007030 2023-10-05T21:15:19.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.904+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe800a570 con 0x7fefe0007030 2023-10-05T21:15:19.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.904+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x55c36d2d7020 2023-10-05T21:15:19.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.904+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe4014070 con 0x55c36d2d7020 2023-10-05T21:15:19.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.904+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x7fefe4016730 2023-10-05T21:15:19.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.904+0000 7fefefef4700 1 -- 172.21.15.153:0/2686019685 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe0029040 con 0x7fefe4016730 2023-10-05T21:15:19.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.904+0000 7fefefef4700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x55c36d2a6d30 2023-10-05T21:15:19.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.904+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.904+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x7fefe0007030 2023-10-05T21:15:19.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.905+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe800a570 con 0x7fefe0007030 2023-10-05T21:15:19.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.905+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x55c36d2d7020 2023-10-05T21:15:19.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.905+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe4014070 con 0x55c36d2d7020 2023-10-05T21:15:19.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.905+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x7fefe0007030 2023-10-05T21:15:19.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.905+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe800a570 con 0x7fefe0007030 2023-10-05T21:15:19.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.905+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x7fefe4016730 2023-10-05T21:15:19.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.906+0000 7fefefef4700 1 -- 172.21.15.153:0/2686019685 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe0029040 con 0x7fefe4016730 2023-10-05T21:15:19.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.906+0000 7fefefef4700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x55c36d2d7020 2023-10-05T21:15:19.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.906+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe4014070 con 0x55c36d2d7020 2023-10-05T21:15:19.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.906+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x7fefe0007030 2023-10-05T21:15:19.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.906+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe800a570 con 0x7fefe0007030 2023-10-05T21:15:19.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.906+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x55c36d2a6d30 2023-10-05T21:15:19.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.906+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.906+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2db580 con 0x7fefe4016730 2023-10-05T21:15:19.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.907+0000 7fefefef4700 1 -- 172.21.15.153:0/2686019685 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe0029040 con 0x7fefe4016730 2023-10-05T21:15:19.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.907+0000 7feffd61d680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:19.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.907+0000 7feffd61d680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:19.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.907+0000 7feffd61d680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:19.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.907+0000 7feffd61d680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:19.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.907+0000 7feffd61d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.907+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2da4d0 con 0x55c36d2a6d30 2023-10-05T21:15:19.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.907+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.907+0000 7feffd61d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.907+0000 7feffd61d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.907+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2da8d0 con 0x55c36d2a6d30 2023-10-05T21:15:19.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.907+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.907+0000 7feffd61d680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.907+0000 7feffd61d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.907+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2dba10 con 0x55c36d2a6d30 2023-10-05T21:15:19.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.907+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.907+0000 7feffd61d680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:19.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.907+0000 7feffd61d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.907+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2dbdc0 con 0x55c36d2d7020 2023-10-05T21:15:19.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.908+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fefe4014070 con 0x55c36d2d7020 2023-10-05T21:15:19.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.908+0000 7feffd61d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.908+0000 7feffd61d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.908+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2dc170 con 0x55c36d2a6d30 2023-10-05T21:15:19.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.908+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.908+0000 7feffd61d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.908+0000 7feffd61d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.908+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2dc170 con 0x55c36d2a6d30 2023-10-05T21:15:19.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.908+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.908+0000 7feffd61d680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.908+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2dd180 con 0x55c36d2d7020 2023-10-05T21:15:19.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.908+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe4014070 con 0x55c36d2d7020 2023-10-05T21:15:19.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.908+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2dd180 con 0x7fefe4016730 2023-10-05T21:15:19.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.908+0000 7fefefef4700 1 -- 172.21.15.153:0/2686019685 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe0029040 con 0x7fefe4016730 2023-10-05T21:15:19.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.908+0000 7fefefef4700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2dd180 con 0x7fefe0007030 2023-10-05T21:15:19.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.909+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe800a570 con 0x7fefe0007030 2023-10-05T21:15:19.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.909+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2dba10 con 0x55c36d2a6d30 2023-10-05T21:15:19.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.909+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.909+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2dba10 con 0x55c36d2a6d30 2023-10-05T21:15:19.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.909+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.909+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2dba10 con 0x7fefe0007030 2023-10-05T21:15:19.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.910+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe800a570 con 0x7fefe0007030 2023-10-05T21:15:19.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.910+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2dba10 con 0x7fefe0007030 2023-10-05T21:15:19.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.910+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe800a570 con 0x7fefe0007030 2023-10-05T21:15:19.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.910+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2dba10 con 0x7fefe4016730 2023-10-05T21:15:19.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.910+0000 7fefefef4700 1 -- 172.21.15.153:0/2686019685 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe0029040 con 0x7fefe4016730 2023-10-05T21:15:19.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.910+0000 7fefefef4700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2dba10 con 0x55c36d2d7020 2023-10-05T21:15:19.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.910+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fefe4014070 con 0x55c36d2d7020 2023-10-05T21:15:19.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.910+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2dba10 con 0x55c36d2a6d30 2023-10-05T21:15:19.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.910+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.910+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2dba10 con 0x7fefe0007030 2023-10-05T21:15:19.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.911+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe800a570 con 0x7fefe0007030 2023-10-05T21:15:19.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.911+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2dba10 con 0x55c36d2a6d30 2023-10-05T21:15:19.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.911+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.911+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2dba10 con 0x7fefe4016730 2023-10-05T21:15:19.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.911+0000 7fefefef4700 1 -- 172.21.15.153:0/2686019685 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe0029040 con 0x7fefe4016730 2023-10-05T21:15:19.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.911+0000 7fefefef4700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2dba10 con 0x55c36d2d7020 2023-10-05T21:15:19.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.911+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe4014070 con 0x55c36d2d7020 2023-10-05T21:15:19.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.911+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2dba10 con 0x55c36d2d7020 2023-10-05T21:15:19.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.911+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe4014070 con 0x55c36d2d7020 2023-10-05T21:15:19.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.911+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2dba10 con 0x7fefe0007030 2023-10-05T21:15:19.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.912+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe800a570 con 0x7fefe0007030 2023-10-05T21:15:19.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.912+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2dba10 con 0x55c36d2d7020 2023-10-05T21:15:19.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.912+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe4014070 con 0x55c36d2d7020 2023-10-05T21:15:19.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.912+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fefe4050040 con 0x55c36d2d7020 2023-10-05T21:15:19.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.912+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe4014070 con 0x55c36d2d7020 2023-10-05T21:15:19.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.912+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fefe4050040 con 0x55c36d2a6d30 2023-10-05T21:15:19.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.912+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.912+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fefe4050040 con 0x55c36d2a6d30 2023-10-05T21:15:19.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.913+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.913+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fefe4050040 con 0x7fefe0007030 2023-10-05T21:15:19.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.913+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe800a570 con 0x7fefe0007030 2023-10-05T21:15:19.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.913+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fefe4050040 con 0x55c36d2d7020 2023-10-05T21:15:19.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.913+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe4014070 con 0x55c36d2d7020 2023-10-05T21:15:19.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.913+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fefe4050040 con 0x7fefe4016730 2023-10-05T21:15:19.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.913+0000 7fefefef4700 1 -- 172.21.15.153:0/2686019685 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe0029040 con 0x7fefe4016730 2023-10-05T21:15:19.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.913+0000 7fefefef4700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fefe4050040 con 0x55c36d2a6d30 2023-10-05T21:15:19.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.914+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.914+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fefe4050040 con 0x7fefe0007030 2023-10-05T21:15:19.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.914+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe800a570 con 0x7fefe0007030 2023-10-05T21:15:19.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.914+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fefe4050040 con 0x55c36d2d7020 2023-10-05T21:15:19.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.914+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe4014070 con 0x55c36d2d7020 2023-10-05T21:15:19.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.914+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fefe4050040 con 0x7fefe0007030 2023-10-05T21:15:19.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.914+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe800a570 con 0x7fefe0007030 2023-10-05T21:15:19.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.914+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fefe4050040 con 0x7fefe4016730 2023-10-05T21:15:19.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.914+0000 7fefefef4700 1 -- 172.21.15.153:0/2686019685 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe0029040 con 0x7fefe4016730 2023-10-05T21:15:19.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.914+0000 7fefefef4700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fefe4050040 con 0x55c36d2d7020 2023-10-05T21:15:19.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.915+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe4014070 con 0x55c36d2d7020 2023-10-05T21:15:19.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.915+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fefe4050040 con 0x7fefe0007030 2023-10-05T21:15:19.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.915+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe800a570 con 0x7fefe0007030 2023-10-05T21:15:19.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.915+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fefe4050040 con 0x55c36d2a6d30 2023-10-05T21:15:19.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.915+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.915+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fefe4050040 con 0x7fefe4016730 2023-10-05T21:15:19.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.915+0000 7fefefef4700 1 -- 172.21.15.153:0/2686019685 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fefe0029040 con 0x7fefe4016730 2023-10-05T21:15:19.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.915+0000 7feffd61d680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:19.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.915+0000 7feffd61d680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:19.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.915+0000 7feffd61d680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:19.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.915+0000 7feffd61d680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:19.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.915+0000 7feffd61d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.915+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2dc170 con 0x55c36d2a6d30 2023-10-05T21:15:19.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.916+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.916+0000 7feffd61d680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.916+0000 7feffd61d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.916+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2dc520 con 0x55c36d2d7020 2023-10-05T21:15:19.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.916+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fefe4014070 con 0x55c36d2d7020 2023-10-05T21:15:19.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.916+0000 7feffd61d680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:19.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.916+0000 7feffd61d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.916+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2dcdc0 con 0x55c36d2a6d30 2023-10-05T21:15:19.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.916+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.916+0000 7feffd61d680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:19.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.916+0000 7feffd61d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.916+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2dcdc0 con 0x55c36d2a6d30 2023-10-05T21:15:19.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.916+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.916+0000 7feffd61d680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:19.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.916+0000 7feffd61d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.916+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2dcdc0 con 0x7fefe0007030 2023-10-05T21:15:19.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.917+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fefe800a570 con 0x7fefe0007030 2023-10-05T21:15:19.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.917+0000 7feffd61d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.917+0000 7feffd61d680 20 zone default found 2023-10-05T21:15:19.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.917+0000 7feffd61d680 4 Realm: () 2023-10-05T21:15:19.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.917+0000 7feffd61d680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:19.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.917+0000 7feffd61d680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:19.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.917+0000 7feffd61d680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:19.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.917+0000 7feffd61d680 20 zonegroup default 2023-10-05T21:15:19.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.917+0000 7feffd61d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.917+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2dcdc0 con 0x7fefe0007030 2023-10-05T21:15:19.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.917+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fefe800a570 con 0x7fefe0007030 2023-10-05T21:15:19.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.917+0000 7feffd61d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.917+0000 7feffd61d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.917+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2de740 con 0x55c36d2d7020 2023-10-05T21:15:19.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.917+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fefe4014070 con 0x55c36d2d7020 2023-10-05T21:15:19.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.917+0000 7feffd61d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.917+0000 7feffd61d680 20 rados->read ofs=0 len=0 2023-10-05T21:15:19.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.917+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2deaf0 con 0x55c36d2d7020 2023-10-05T21:15:19.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.917+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fefe4014070 con 0x55c36d2d7020 2023-10-05T21:15:19.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.917+0000 7feffd61d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:19.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.917+0000 7feffd61d680 20 started sync module instance, tier type = 2023-10-05T21:15:19.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.917+0000 7feffd61d680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:19.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.917+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2dde50 con 0x7fefe4016730 2023-10-05T21:15:19.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.918+0000 7fefefef4700 1 -- 172.21.15.153:0/2686019685 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe0029040 con 0x7fefe4016730 2023-10-05T21:15:19.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.918+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94297838707280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2df3e0 con 0x7fefe4016730 2023-10-05T21:15:19.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.918+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2dfc80 con 0x55c36d2a6d30 2023-10-05T21:15:19.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.919+0000 7fefefef4700 1 -- 172.21.15.153:0/2686019685 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94297838707280] v29'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe0029040 con 0x7fefe4016730 2023-10-05T21:15:19.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.919+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.919+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94297838710512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2dfd40 con 0x55c36d2a6d30 2023-10-05T21:15:19.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.919+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2e0920 con 0x55c36d2d7020 2023-10-05T21:15:19.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.920+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94297838710512] v29'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.920+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe4014070 con 0x55c36d2d7020 2023-10-05T21:15:19.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.920+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94297838715856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2e0d20 con 0x55c36d2d7020 2023-10-05T21:15:19.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.920+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2e1730 con 0x7fefe4016730 2023-10-05T21:15:19.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.921+0000 7fefefef4700 1 -- 172.21.15.153:0/2686019685 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe0029040 con 0x7fefe4016730 2023-10-05T21:15:19.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.921+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94297838719552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2e1fd0 con 0x7fefe4016730 2023-10-05T21:15:19.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.921+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2e29e0 con 0x55c36d2a6d30 2023-10-05T21:15:19.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.921+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94297838715856] v29'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe4014070 con 0x55c36d2d7020 2023-10-05T21:15:19.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.921+0000 7fefefef4700 1 -- 172.21.15.153:0/2686019685 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94297838719552] v29'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe0029040 con 0x7fefe4016730 2023-10-05T21:15:19.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.921+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.921+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94297838712720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2e1c20 con 0x55c36d2a6d30 2023-10-05T21:15:19.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.921+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2e29e0 con 0x7fefe0007030 2023-10-05T21:15:19.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.922+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94297838712720] v29'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.922+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe800a570 con 0x7fefe0007030 2023-10-05T21:15:19.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.922+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94297838727136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2e29e0 con 0x7fefe0007030 2023-10-05T21:15:19.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.922+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2e3bb0 con 0x7fefe0007030 2023-10-05T21:15:19.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.923+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94297838727136] v29'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe800a570 con 0x7fefe0007030 2023-10-05T21:15:19.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.923+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe800a570 con 0x7fefe0007030 2023-10-05T21:15:19.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.923+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94297838724336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2e3da0 con 0x7fefe0007030 2023-10-05T21:15:19.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.923+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2e4640 con 0x7fefe0007030 2023-10-05T21:15:19.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.924+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94297838724336] v29'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe800a570 con 0x7fefe0007030 2023-10-05T21:15:19.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.924+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe800a570 con 0x7fefe0007030 2023-10-05T21:15:19.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.924+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94297838729952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2e4480 con 0x7fefe0007030 2023-10-05T21:15:19.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.924+0000 7feffd61d680 20 add_watcher() i=0 2023-10-05T21:15:19.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.924+0000 7feffd61d680 20 add_watcher() i=1 2023-10-05T21:15:19.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.924+0000 7feffd61d680 20 add_watcher() i=2 2023-10-05T21:15:19.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.924+0000 7feffd61d680 20 add_watcher() i=3 2023-10-05T21:15:19.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.924+0000 7feffd61d680 20 add_watcher() i=4 2023-10-05T21:15:19.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.924+0000 7feffd61d680 20 add_watcher() i=5 2023-10-05T21:15:19.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.924+0000 7feffd61d680 20 add_watcher() i=6 2023-10-05T21:15:19.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.924+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94297838729952] v29'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe800a570 con 0x7fefe0007030 2023-10-05T21:15:19.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.924+0000 7feffd61d680 20 add_watcher() i=7 2023-10-05T21:15:19.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.924+0000 7feffd61d680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:19.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.924+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2e79a0 con 0x55c36d2a6d30 2023-10-05T21:15:19.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.925+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.925+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94297838731056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2e4e90 con 0x55c36d2a6d30 2023-10-05T21:15:19.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.926+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94297838731056] v29'162 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.926+0000 7fefc1fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:19.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.926+0000 7feffd61d680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:19.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.926+0000 7feffd61d680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:19.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.926+0000 7feffd61d680 1 Processor -- start 2023-10-05T21:15:19.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.926+0000 7feffd61d680 1 -- start start 2023-10-05T21:15:19.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.926+0000 7feffd61d680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2f1790 0x55c36d2f1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.926+0000 7feffd61d680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c36d2f21b0 con 0x55c36d2f1790 2023-10-05T21:15:19.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.926+0000 7fefefef4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2f1790 0x55c36d2f1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.926+0000 7fefefef4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2f1790 0x55c36d2f1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38360/0 (socket says 172.21.15.153:38360) 2023-10-05T21:15:19.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.926+0000 7fefefef4700 1 -- 172.21.15.153:0/4236973913 learned_addr learned my addr 172.21.15.153:0/4236973913 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.927+0000 7fefefef4700 1 -- 172.21.15.153:0/4236973913 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c36d2f2690 con 0x55c36d2f1790 2023-10-05T21:15:19.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.927+0000 7fefefef4700 1 --2- 172.21.15.153:0/4236973913 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2f1790 0x55c36d2f1ba0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x55c36d2a15f0 tx=0x7fefe0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ead7b3d0442b82 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.927+0000 7fefc17e2700 1 -- 172.21.15.153:0/4236973913 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefe0025040 con 0x55c36d2f1790 2023-10-05T21:15:19.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.927+0000 7fefc17e2700 1 -- 172.21.15.153:0/4236973913 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe0039450 con 0x55c36d2f1790 2023-10-05T21:15:19.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.927+0000 7fefc17e2700 1 -- 172.21.15.153:0/4236973913 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefe0039760 con 0x55c36d2f1790 2023-10-05T21:15:19.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.928+0000 7feffd61d680 1 -- 172.21.15.153:0/4236973913 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2f1790 msgr2=0x55c36d2f1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.928+0000 7feffd61d680 1 --2- 172.21.15.153:0/4236973913 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2f1790 0x55c36d2f1ba0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x55c36d2a15f0 tx=0x7fefe0011000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.928+0000 7feffd61d680 1 -- 172.21.15.153:0/4236973913 shutdown_connections 2023-10-05T21:15:19.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.928+0000 7feffd61d680 1 --2- 172.21.15.153:0/4236973913 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2f1790 0x55c36d2f1ba0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.928+0000 7feffd61d680 1 -- 172.21.15.153:0/4236973913 >> 172.21.15.153:0/4236973913 conn(0x55c36d2eda90 msgr2=0x55c36d2ebb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.928+0000 7feffd61d680 1 -- 172.21.15.153:0/4236973913 shutdown_connections 2023-10-05T21:15:19.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.928+0000 7feffd61d680 1 -- 172.21.15.153:0/4236973913 wait complete. 2023-10-05T21:15:19.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.928+0000 7feffd61d680 1 Processor -- start 2023-10-05T21:15:19.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.928+0000 7feffd61d680 1 -- start start 2023-10-05T21:15:19.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.928+0000 7feffd61d680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2f1790 0x55c36d2f84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.928+0000 7feffd61d680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c36d2f8a00 con 0x55c36d2f1790 2023-10-05T21:15:19.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.928+0000 7fefefef4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2f1790 0x55c36d2f84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.928+0000 7fefefef4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2f1790 0x55c36d2f84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38366/0 (socket says 172.21.15.153:38366) 2023-10-05T21:15:19.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.928+0000 7fefefef4700 1 -- 172.21.15.153:0/2952958449 learned_addr learned my addr 172.21.15.153:0/2952958449 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:19.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.929+0000 7fefefef4700 1 -- 172.21.15.153:0/2952958449 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c36d2a1620 con 0x55c36d2f1790 2023-10-05T21:15:19.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.929+0000 7fefefef4700 1 --2- 172.21.15.153:0/2952958449 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2f1790 0x55c36d2f84c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x55c36d2ed000 tx=0x7fefe0039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.929+0000 7fef3b7fe700 1 -- 172.21.15.153:0/2952958449 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefe0025040 con 0x55c36d2f1790 2023-10-05T21:15:19.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.929+0000 7fef3b7fe700 1 -- 172.21.15.153:0/2952958449 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe0047070 con 0x55c36d2f1790 2023-10-05T21:15:19.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.929+0000 7feffd61d680 1 -- 172.21.15.153:0/2952958449 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c36d2f8c00 con 0x55c36d2f1790 2023-10-05T21:15:19.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.929+0000 7fef3b7fe700 1 -- 172.21.15.153:0/2952958449 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefe004c5d0 con 0x55c36d2f1790 2023-10-05T21:15:19.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.929+0000 7feffd61d680 1 -- 172.21.15.153:0/2952958449 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c36d2f90b0 con 0x55c36d2f1790 2023-10-05T21:15:19.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.930+0000 7fef3b7fe700 1 -- 172.21.15.153:0/2952958449 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fefe0049070 con 0x55c36d2f1790 2023-10-05T21:15:19.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.930+0000 7fef3b7fe700 1 --2- 172.21.15.153:0/2952958449 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fef30034140 0x7fef300365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.930+0000 7fef3b7fe700 1 -- 172.21.15.153:0/2952958449 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fefe0032030 con 0x55c36d2f1790 2023-10-05T21:15:19.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.930+0000 7feff0ef6700 1 --2- 172.21.15.153:0/2952958449 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fef30034140 0x7fef300365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.930+0000 7feffd61d680 5 note: GC not initialized 2023-10-05T21:15:19.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.930+0000 7feff0ef6700 1 --2- 172.21.15.153:0/2952958449 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fef30034140 0x7fef300365f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55c36d2e43b0 tx=0x7fefe8037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.931+0000 7fef38ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:19.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.931+0000 7fef2e7fc700 20 reqs_thread_entry: start 2023-10-05T21:15:19.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.931+0000 7feffd61d680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:19.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.931+0000 7feffd61d680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:19.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.931+0000 7fef2cff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:50 2023 2023-10-05T21:15:19.978 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:19.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.931+0000 7fef13fff700 20 reqs_thread_entry: start 2023-10-05T21:15:19.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.931+0000 7feffd61d680 1 --2- 172.21.15.153:0/2952958449 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55c36d35ccc0 0x55c36d35f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:19.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.931+0000 7feffd61d680 1 -- 172.21.15.153:0/2952958449 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:1 6.13 6:cdb034dd:::2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.2-myfoo2:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d35f5e0 con 0x55c36d35ccc0 2023-10-05T21:15:19.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.932+0000 7feff06f5700 1 --2- 172.21.15.153:0/2952958449 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55c36d35ccc0 0x55c36d35f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:19.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.932+0000 7feff06f5700 1 --2- 172.21.15.153:0/2952958449 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55c36d35ccc0 0x55c36d35f0a0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:19.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.933+0000 7feff06f5700 1 -- 172.21.15.153:0/2952958449 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(1 2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.2-myfoo2 [delete] v29'22 uv22 ondisk = 0) v8 ==== 208+0+0 (crc 0 0 0) 0x7fefe4014070 con 0x55c36d35ccc0 2023-10-05T21:15:19.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.933+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94297838707280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d31c520 con 0x7fefe4016730 2023-10-05T21:15:19.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.934+0000 7fefefef4700 1 -- 172.21.15.153:0/2686019685 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(102 notify.0 [watch unwatch cookie 94297838707280] v29'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe003f020 con 0x7fefe4016730 2023-10-05T21:15:19.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.934+0000 7feffd61d680 20 remove_watcher() i=0 2023-10-05T21:15:19.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.934+0000 7feffd61d680 2 removed watcher, disabling cache 2023-10-05T21:15:19.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.934+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94297838710512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2de250 con 0x55c36d2a6d30 2023-10-05T21:15:19.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.935+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(103 notify.1 [watch unwatch cookie 94297838710512] v29'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.935+0000 7feffd61d680 20 remove_watcher() i=1 2023-10-05T21:15:19.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.935+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:104 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94297838715856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2de250 con 0x55c36d2d7020 2023-10-05T21:15:19.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.936+0000 7feff06f5700 1 -- 172.21.15.153:0/2686019685 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(104 notify.2 [watch unwatch cookie 94297838715856] v29'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe4014070 con 0x55c36d2d7020 2023-10-05T21:15:19.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.936+0000 7feffd61d680 20 remove_watcher() i=2 2023-10-05T21:15:19.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.936+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94297838719552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2e03d0 con 0x7fefe4016730 2023-10-05T21:15:19.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.936+0000 7fefefef4700 1 -- 172.21.15.153:0/2686019685 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(105 notify.3 [watch unwatch cookie 94297838719552] v29'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe003f020 con 0x7fefe4016730 2023-10-05T21:15:19.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.936+0000 7feffd61d680 20 remove_watcher() i=3 2023-10-05T21:15:19.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.936+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94297838712720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2e1240 con 0x55c36d2a6d30 2023-10-05T21:15:19.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.937+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(106 notify.4 [watch unwatch cookie 94297838712720] v29'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.937+0000 7feffd61d680 20 remove_watcher() i=4 2023-10-05T21:15:19.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.937+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:107 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94297838727136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2e03d0 con 0x7fefe0007030 2023-10-05T21:15:19.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.938+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(107 notify.5 [watch unwatch cookie 94297838727136] v29'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe800a570 con 0x7fefe0007030 2023-10-05T21:15:19.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.938+0000 7feffd61d680 20 remove_watcher() i=5 2023-10-05T21:15:19.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.938+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94297838724336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2e2fe0 con 0x7fefe0007030 2023-10-05T21:15:19.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.939+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(108 notify.6 [watch unwatch cookie 94297838724336] v29'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe800a570 con 0x7fefe0007030 2023-10-05T21:15:19.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.939+0000 7feffd61d680 20 remove_watcher() i=6 2023-10-05T21:15:19.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.939+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94297838729952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2e24f0 con 0x7fefe0007030 2023-10-05T21:15:19.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.940+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(109 notify.7 [watch unwatch cookie 94297838729952] v29'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fefe800a570 con 0x7fefe0007030 2023-10-05T21:15:19.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.940+0000 7feffd61d680 20 remove_watcher() i=7 2023-10-05T21:15:19.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.941+0000 7fefc1fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:19.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.941+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:110 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94297838731056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55c36d2e24f0 con 0x55c36d2a6d30 2023-10-05T21:15:19.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.941+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(110 data_loggenerations_metadata [watch unwatch cookie 94297838731056] v29'163 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fefe800a570 con 0x55c36d2a6d30 2023-10-05T21:15:19.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.941+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fefe0007030 msgr2=0x7fefe001d430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.941+0000 7feffd61d680 1 --2- 172.21.15.153:0/2686019685 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fefe0007030 0x7fefe001d430 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.941+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55c36d2a6d30 msgr2=0x55c36d2d4bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.941+0000 7feffd61d680 1 --2- 172.21.15.153:0/2686019685 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55c36d2a6d30 0x55c36d2d4bb0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.941+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fefe4016730 msgr2=0x7fefe4041670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.941+0000 7feffd61d680 1 --2- 172.21.15.153:0/2686019685 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fefe4016730 0x7fefe4041670 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.942+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55c36d2d7020 msgr2=0x55c36d2d9400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.942+0000 7feffd61d680 1 --2- 172.21.15.153:0/2686019685 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55c36d2d7020 0x55c36d2d9400 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.942+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fefdc034140 msgr2=0x7fefdc0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.942+0000 7feffd61d680 1 --2- 172.21.15.153:0/2686019685 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fefdc034140 0x7fefdc0365f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fefe000afd0 tx=0x7fefe0014000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.942+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2a0a40 msgr2=0x55c36d2c8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.942+0000 7feff0ef6700 1 -- 172.21.15.153:0/2686019685 reap_dead start 2023-10-05T21:15:19.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.942+0000 7feffd61d680 1 --2- 172.21.15.153:0/2686019685 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2a0a40 0x55c36d2c8e40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fefe4010000 tx=0x7fefe4016000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.942+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 shutdown_connections 2023-10-05T21:15:19.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.942+0000 7feffd61d680 1 --2- 172.21.15.153:0/2686019685 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2a0a40 0x55c36d2c8e40 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.942+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 >> 172.21.15.153:0/2686019685 conn(0x55c36d29a300 msgr2=0x55c36d2bbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.942+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 shutdown_connections 2023-10-05T21:15:19.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.942+0000 7feffd61d680 1 -- 172.21.15.153:0/2686019685 wait complete. 2023-10-05T21:15:19.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.942+0000 7feffd61d680 1 -- 172.21.15.153:0/2952958449 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55c36d35ccc0 msgr2=0x55c36d35f0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.942+0000 7feffd61d680 1 --2- 172.21.15.153:0/2952958449 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55c36d35ccc0 0x55c36d35f0a0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.942+0000 7feffd61d680 1 -- 172.21.15.153:0/2952958449 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fef30034140 msgr2=0x7fef300365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.942+0000 7feffd61d680 1 --2- 172.21.15.153:0/2952958449 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fef30034140 0x7fef300365f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55c36d2e43b0 tx=0x7fefe8037450 comp rx=0 tx=0).stop 2023-10-05T21:15:19.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.942+0000 7feffd61d680 1 -- 172.21.15.153:0/2952958449 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2f1790 msgr2=0x55c36d2f84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:19.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.942+0000 7feffd61d680 1 --2- 172.21.15.153:0/2952958449 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2f1790 0x55c36d2f84c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x55c36d2ed000 tx=0x7fefe0039000 comp rx=0 tx=0).stop 2023-10-05T21:15:19.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.942+0000 7feffd61d680 1 -- 172.21.15.153:0/2952958449 shutdown_connections 2023-10-05T21:15:19.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.942+0000 7feffd61d680 1 --2- 172.21.15.153:0/2952958449 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55c36d35ccc0 0x55c36d35f0a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.942+0000 7feffd61d680 1 --2- 172.21.15.153:0/2952958449 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36d2f1790 0x55c36d2f84c0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.942+0000 7feffd61d680 1 --2- 172.21.15.153:0/2952958449 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fef30034140 0x7fef300365f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:19.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.942+0000 7feffd61d680 1 -- 172.21.15.153:0/2952958449 >> 172.21.15.153:0/2952958449 conn(0x55c36d2eda90 msgr2=0x55c36d2ebb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:19.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.942+0000 7feffd61d680 1 -- 172.21.15.153:0/2952958449 shutdown_connections 2023-10-05T21:15:19.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:19.942+0000 7feffd61d680 1 -- 172.21.15.153:0/2952958449 wait complete. 2023-10-05T21:15:19.988 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'show', '--object', '2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1-myfoo'] 2023-10-05T21:15:19.988 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'show', '--object', '2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1-myfoo'] 2023-10-05T21:15:19.988 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log show --object 2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1-myfoo 2023-10-05T21:15:20.033 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:20.033 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:20.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.031+0000 7f3248714680 1 Processor -- start 2023-10-05T21:15:20.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.031+0000 7f3248714680 1 -- start start 2023-10-05T21:15:20.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.031+0000 7f3248714680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55ac5efc60a0 0x55ac5f057490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.031+0000 7f3248714680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ac5ef9f990 con 0x55ac5f0579d0 2023-10-05T21:15:20.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.031+0000 7f3248714680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ac5ef5fdb0 con 0x55ac5efc60a0 2023-10-05T21:15:20.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.031+0000 7f323b7ec700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55ac5efc60a0 0x55ac5f057490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.031+0000 7f323afeb700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55ac5f0579d0 0x55ac5f059db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:55336/0 (socket says 172.21.15.153:55336) 2023-10-05T21:15:20.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.031+0000 7f323afeb700 1 -- 172.21.15.153:0/730769687 learned_addr learned my addr 172.21.15.153:0/730769687 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:20.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.031+0000 7f323b7ec700 1 -- 172.21.15.153:0/730769687 >> v1:172.21.15.111:6789/0 conn(0x55ac5f0579d0 legacy=0x55ac5f059db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.031+0000 7f323b7ec700 1 -- 172.21.15.153:0/730769687 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac5f05c4e0 con 0x55ac5efc60a0 2023-10-05T21:15:20.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.031+0000 7f323a7ea700 1 -- 172.21.15.153:0/730769687 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626213943 0 0) 0x55ac5ef9f990 con 0x55ac5f0579d0 2023-10-05T21:15:20.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.032+0000 7f323b7ec700 1 --2- 172.21.15.153:0/730769687 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5efc60a0 0x55ac5f057490 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f322c00a5d0 tx=0x7f322c005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bde3ab89e49a03dc server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.032+0000 7f323a7ea700 1 -- 172.21.15.153:0/730769687 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f322c0086a0 con 0x55ac5efc60a0 2023-10-05T21:15:20.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.032+0000 7f323a7ea700 1 -- 172.21.15.153:0/730769687 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322c008800 con 0x55ac5efc60a0 2023-10-05T21:15:20.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.032+0000 7f323a7ea700 1 -- 172.21.15.153:0/730769687 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f322c008ad0 con 0x55ac5efc60a0 2023-10-05T21:15:20.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.032+0000 7f3248714680 1 -- 172.21.15.153:0/730769687 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5efc60a0 msgr2=0x55ac5f057490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.032+0000 7f3248714680 1 --2- 172.21.15.153:0/730769687 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5efc60a0 0x55ac5f057490 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f322c00a5d0 tx=0x7f322c005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:20.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.032+0000 7f3248714680 1 -- 172.21.15.153:0/730769687 shutdown_connections 2023-10-05T21:15:20.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.032+0000 7f3248714680 1 --2- 172.21.15.153:0/730769687 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5efc60a0 0x55ac5f057490 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.032+0000 7f3248714680 1 -- 172.21.15.153:0/730769687 >> 172.21.15.153:0/730769687 conn(0x55ac5f04cb80 msgr2=0x55ac5f04ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:20.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.032+0000 7f3248714680 1 -- 172.21.15.153:0/730769687 shutdown_connections 2023-10-05T21:15:20.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.032+0000 7f3248714680 1 -- 172.21.15.153:0/730769687 wait complete. 2023-10-05T21:15:20.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.033+0000 7f3248714680 1 Processor -- start 2023-10-05T21:15:20.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.033+0000 7f3248714680 1 -- start start 2023-10-05T21:15:20.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.033+0000 7f3248714680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5efc60a0 0x55ac5f0739c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.033+0000 7f3248714680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac5eeffea0 con 0x55ac5efc60a0 2023-10-05T21:15:20.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.034+0000 7f323b7ec700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5efc60a0 0x55ac5f0739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.034+0000 7f323b7ec700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5efc60a0 0x55ac5f0739c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38382/0 (socket says 172.21.15.153:38382) 2023-10-05T21:15:20.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.034+0000 7f323b7ec700 1 -- 172.21.15.153:0/1088261677 learned_addr learned my addr 172.21.15.153:0/1088261677 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:20.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.034+0000 7f323b7ec700 1 -- 172.21.15.153:0/1088261677 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322c005cf0 con 0x55ac5efc60a0 2023-10-05T21:15:20.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.034+0000 7f323b7ec700 1 --2- 172.21.15.153:0/1088261677 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5efc60a0 0x55ac5f0739c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f322c000c00 tx=0x7f322c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69dcd4a29aa7dd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.034+0000 7f32397e8700 1 -- 172.21.15.153:0/1088261677 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f322c0086a0 con 0x55ac5efc60a0 2023-10-05T21:15:20.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.034+0000 7f32397e8700 1 -- 172.21.15.153:0/1088261677 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322c008970 con 0x55ac5efc60a0 2023-10-05T21:15:20.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.034+0000 7f32397e8700 1 -- 172.21.15.153:0/1088261677 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f322c008b20 con 0x55ac5efc60a0 2023-10-05T21:15:20.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.035+0000 7f3248714680 1 -- 172.21.15.153:0/1088261677 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5efc60a0 msgr2=0x55ac5f0739c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.035+0000 7f3248714680 1 --2- 172.21.15.153:0/1088261677 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5efc60a0 0x55ac5f0739c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f322c000c00 tx=0x7f322c015000 comp rx=0 tx=0).stop 2023-10-05T21:15:20.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.035+0000 7f3248714680 1 -- 172.21.15.153:0/1088261677 shutdown_connections 2023-10-05T21:15:20.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.035+0000 7f3248714680 1 --2- 172.21.15.153:0/1088261677 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5efc60a0 0x55ac5f0739c0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.035+0000 7f3248714680 1 -- 172.21.15.153:0/1088261677 >> 172.21.15.153:0/1088261677 conn(0x55ac5f04cb80 msgr2=0x55ac5f06f490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:20.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.035+0000 7f3248714680 1 -- 172.21.15.153:0/1088261677 shutdown_connections 2023-10-05T21:15:20.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.035+0000 7f3248714680 1 -- 172.21.15.153:0/1088261677 wait complete. 2023-10-05T21:15:20.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.035+0000 7f3248714680 1 Processor -- start 2023-10-05T21:15:20.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.035+0000 7f3248714680 1 -- start start 2023-10-05T21:15:20.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.035+0000 7f3248714680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5efc60a0 0x55ac5f07ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.035+0000 7f3248714680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac5eef6c80 con 0x55ac5efc60a0 2023-10-05T21:15:20.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.035+0000 7f323b7ec700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5efc60a0 0x55ac5f07ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.035+0000 7f323b7ec700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5efc60a0 0x55ac5f07ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38396/0 (socket says 172.21.15.153:38396) 2023-10-05T21:15:20.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.035+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 learned_addr learned my addr 172.21.15.153:0/3277143712 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:20.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.036+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac5f05c4e0 con 0x55ac5efc60a0 2023-10-05T21:15:20.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.036+0000 7f323b7ec700 1 --2- 172.21.15.153:0/3277143712 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5efc60a0 0x55ac5f07ad70 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f322c00a520 tx=0x7f322c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.036+0000 7f322b7fe700 1 -- 172.21.15.153:0/3277143712 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f322c01d420 con 0x55ac5efc60a0 2023-10-05T21:15:20.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.036+0000 7f322b7fe700 1 -- 172.21.15.153:0/3277143712 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322c01d580 con 0x55ac5efc60a0 2023-10-05T21:15:20.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.036+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ac5f07b2b0 con 0x55ac5efc60a0 2023-10-05T21:15:20.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.036+0000 7f322b7fe700 1 -- 172.21.15.153:0/3277143712 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f322c01d730 con 0x55ac5efc60a0 2023-10-05T21:15:20.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.036+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ac5f07b6a0 con 0x55ac5efc60a0 2023-10-05T21:15:20.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.037+0000 7f3248714680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.037+0000 7f322b7fe700 1 -- 172.21.15.153:0/3277143712 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f322c01d9a0 con 0x55ac5efc60a0 2023-10-05T21:15:20.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.037+0000 7f322b7fe700 1 --2- 172.21.15.153:0/3277143712 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3220034140 0x7f32200365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.037+0000 7f322b7fe700 1 -- 172.21.15.153:0/3277143712 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f322c04a2f0 con 0x55ac5efc60a0 2023-10-05T21:15:20.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.037+0000 7f323afeb700 1 --2- 172.21.15.153:0/3277143712 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3220034140 0x7f32200365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.037+0000 7f3248714680 1 --2- 172.21.15.153:0/3277143712 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ac5f0579d0 0x55ac5f086b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.037+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f0872b0 con 0x55ac5f0579d0 2023-10-05T21:15:20.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.038+0000 7f323bfed700 1 --2- 172.21.15.153:0/3277143712 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ac5f0579d0 0x55ac5f086b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.038+0000 7f323afeb700 1 --2- 172.21.15.153:0/3277143712 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3220034140 0x7f32200365f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f32300011e0 tx=0x7f32300013a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.038+0000 7f323bfed700 1 --2- 172.21.15.153:0/3277143712 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ac5f0579d0 0x55ac5f086b20 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.038+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.038+0000 7f3248714680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.038+0000 7f3248714680 20 realm 2023-10-05T21:15:20.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.038+0000 7f3248714680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.038+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f0840b0 con 0x55ac5f0579d0 2023-10-05T21:15:20.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.038+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.038+0000 7f3248714680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.038+0000 7f3248714680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:20.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.038+0000 7f3248714680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.038+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f087db0 con 0x55ac5f0579d0 2023-10-05T21:15:20.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.039+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.039+0000 7f3248714680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.039+0000 7f3248714680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.039+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f0879d0 con 0x55ac5f0579d0 2023-10-05T21:15:20.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.039+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.039+0000 7f3248714680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:20.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.039+0000 7f3248714680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.039+0000 7f3248714680 1 --2- 172.21.15.153:0/3277143712 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ac5f089150 0x55ac5f08b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.039+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08ba70 con 0x55ac5f089150 2023-10-05T21:15:20.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.039+0000 7f323b7ec700 1 --2- 172.21.15.153:0/3277143712 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ac5f089150 0x55ac5f08b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.039+0000 7f323b7ec700 1 --2- 172.21.15.153:0/3277143712 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ac5f089150 0x55ac5f08b530 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.040+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f322c036070 con 0x55ac5f089150 2023-10-05T21:15:20.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.040+0000 7f3248714680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:20.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.040+0000 7f3248714680 20 searching for the correct realm 2023-10-05T21:15:20.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.040+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x55ac5f089150 2023-10-05T21:15:20.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.040+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f322c036070 con 0x55ac5f089150 2023-10-05T21:15:20.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.040+0000 7f323b7ec700 1 --2- 172.21.15.153:0/3277143712 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f322c039030 0x7f322c048a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.040+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x7f322c039030 2023-10-05T21:15:20.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.040+0000 7f323afeb700 1 --2- 172.21.15.153:0/3277143712 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f322c039030 0x7f322c048a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.040+0000 7f323afeb700 1 --2- 172.21.15.153:0/3277143712 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f322c039030 0x7f322c048a00 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.041+0000 7f323afeb700 1 -- 172.21.15.153:0/3277143712 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3230006070 con 0x7f322c039030 2023-10-05T21:15:20.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.041+0000 7f323afeb700 1 --2- 172.21.15.153:0/3277143712 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f323000d8e0 0x7f323000c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.041+0000 7f323afeb700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x7f323000d8e0 2023-10-05T21:15:20.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.041+0000 7f323bfed700 1 --2- 172.21.15.153:0/3277143712 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f323000d8e0 0x7f323000c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.041+0000 7f323bfed700 1 --2- 172.21.15.153:0/3277143712 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f323000d8e0 0x7f323000c360 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.041+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f323400a570 con 0x7f323000d8e0 2023-10-05T21:15:20.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.041+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x55ac5f0579d0 2023-10-05T21:15:20.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.042+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.042+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x55ac5f0579d0 2023-10-05T21:15:20.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.042+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.042+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x7f323000d8e0 2023-10-05T21:15:20.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.042+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f323400a570 con 0x7f323000d8e0 2023-10-05T21:15:20.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.042+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x7f323000d8e0 2023-10-05T21:15:20.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.042+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f323400a570 con 0x7f323000d8e0 2023-10-05T21:15:20.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.042+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x7f322c039030 2023-10-05T21:15:20.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.042+0000 7f323afeb700 1 -- 172.21.15.153:0/3277143712 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3230006070 con 0x7f322c039030 2023-10-05T21:15:20.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.042+0000 7f323afeb700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x55ac5f089150 2023-10-05T21:15:20.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.043+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f322c036070 con 0x55ac5f089150 2023-10-05T21:15:20.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.043+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x55ac5f0579d0 2023-10-05T21:15:20.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.043+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.043+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x7f323000d8e0 2023-10-05T21:15:20.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.043+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f323400a570 con 0x7f323000d8e0 2023-10-05T21:15:20.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.043+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x55ac5f0579d0 2023-10-05T21:15:20.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.043+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.043+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x7f322c039030 2023-10-05T21:15:20.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.043+0000 7f323afeb700 1 -- 172.21.15.153:0/3277143712 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3230006070 con 0x7f322c039030 2023-10-05T21:15:20.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.043+0000 7f323afeb700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x55ac5f089150 2023-10-05T21:15:20.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.044+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f322c036070 con 0x55ac5f089150 2023-10-05T21:15:20.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.044+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x55ac5f089150 2023-10-05T21:15:20.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.044+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f322c036070 con 0x55ac5f089150 2023-10-05T21:15:20.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.044+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x7f323000d8e0 2023-10-05T21:15:20.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.044+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f323400a570 con 0x7f323000d8e0 2023-10-05T21:15:20.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.044+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x55ac5f089150 2023-10-05T21:15:20.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.044+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f322c036070 con 0x55ac5f089150 2023-10-05T21:15:20.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.044+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x55ac5f089150 2023-10-05T21:15:20.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.044+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f322c036070 con 0x55ac5f089150 2023-10-05T21:15:20.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.045+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x55ac5f0579d0 2023-10-05T21:15:20.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.045+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.045+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x55ac5f0579d0 2023-10-05T21:15:20.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.045+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.045+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x7f323000d8e0 2023-10-05T21:15:20.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.045+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f323400a570 con 0x7f323000d8e0 2023-10-05T21:15:20.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.045+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x55ac5f089150 2023-10-05T21:15:20.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.045+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f322c036070 con 0x55ac5f089150 2023-10-05T21:15:20.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.045+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x7f322c039030 2023-10-05T21:15:20.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.046+0000 7f323afeb700 1 -- 172.21.15.153:0/3277143712 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3230006070 con 0x7f322c039030 2023-10-05T21:15:20.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.046+0000 7f323afeb700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x55ac5f0579d0 2023-10-05T21:15:20.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.046+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.046+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x7f323000d8e0 2023-10-05T21:15:20.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.046+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f323400a570 con 0x7f323000d8e0 2023-10-05T21:15:20.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.046+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x55ac5f089150 2023-10-05T21:15:20.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.046+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f322c036070 con 0x55ac5f089150 2023-10-05T21:15:20.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.047+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x7f323000d8e0 2023-10-05T21:15:20.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.047+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f323400a570 con 0x7f323000d8e0 2023-10-05T21:15:20.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.047+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x7f322c039030 2023-10-05T21:15:20.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.047+0000 7f323afeb700 1 -- 172.21.15.153:0/3277143712 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3230006070 con 0x7f322c039030 2023-10-05T21:15:20.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.047+0000 7f323afeb700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x55ac5f089150 2023-10-05T21:15:20.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.047+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f322c036070 con 0x55ac5f089150 2023-10-05T21:15:20.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.047+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x7f323000d8e0 2023-10-05T21:15:20.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.047+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f323400a570 con 0x7f323000d8e0 2023-10-05T21:15:20.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.047+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x55ac5f0579d0 2023-10-05T21:15:20.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.048+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.048+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d320 con 0x7f322c039030 2023-10-05T21:15:20.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.048+0000 7f323afeb700 1 -- 172.21.15.153:0/3277143712 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3230006070 con 0x7f322c039030 2023-10-05T21:15:20.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.048+0000 7f3248714680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:20.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.048+0000 7f3248714680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:20.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.048+0000 7f3248714680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:20.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.048+0000 7f3248714680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:20.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.048+0000 7f3248714680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.048+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08c310 con 0x55ac5f0579d0 2023-10-05T21:15:20.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.048+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.048+0000 7f3248714680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.048+0000 7f3248714680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.048+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08bf40 con 0x55ac5f0579d0 2023-10-05T21:15:20.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.048+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.048+0000 7f3248714680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:20.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.048+0000 7f3248714680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.048+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08cc80 con 0x55ac5f0579d0 2023-10-05T21:15:20.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.049+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.049+0000 7f3248714680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:20.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.049+0000 7f3248714680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.049+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08d6d0 con 0x55ac5f089150 2023-10-05T21:15:20.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.049+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f322c036070 con 0x55ac5f089150 2023-10-05T21:15:20.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.049+0000 7f3248714680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.049+0000 7f3248714680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.049+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08da80 con 0x55ac5f0579d0 2023-10-05T21:15:20.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.049+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.049+0000 7f3248714680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.049+0000 7f3248714680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.049+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08de80 con 0x55ac5f0579d0 2023-10-05T21:15:20.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.049+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.049+0000 7f3248714680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:20.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.049+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08ee90 con 0x55ac5f089150 2023-10-05T21:15:20.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.050+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f322c036070 con 0x55ac5f089150 2023-10-05T21:15:20.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.050+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08ee90 con 0x7f322c039030 2023-10-05T21:15:20.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.050+0000 7f323afeb700 1 -- 172.21.15.153:0/3277143712 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3230006070 con 0x7f322c039030 2023-10-05T21:15:20.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.050+0000 7f323afeb700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08ee90 con 0x7f323000d8e0 2023-10-05T21:15:20.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.050+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f323400a570 con 0x7f323000d8e0 2023-10-05T21:15:20.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.050+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08cc80 con 0x55ac5f0579d0 2023-10-05T21:15:20.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.050+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.050+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08cc80 con 0x55ac5f0579d0 2023-10-05T21:15:20.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.050+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.050+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08cc80 con 0x7f323000d8e0 2023-10-05T21:15:20.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.051+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f323400a570 con 0x7f323000d8e0 2023-10-05T21:15:20.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.051+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08cc80 con 0x7f323000d8e0 2023-10-05T21:15:20.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.051+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f323400a570 con 0x7f323000d8e0 2023-10-05T21:15:20.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.051+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08cc80 con 0x7f322c039030 2023-10-05T21:15:20.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.051+0000 7f323afeb700 1 -- 172.21.15.153:0/3277143712 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3230006070 con 0x7f322c039030 2023-10-05T21:15:20.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.051+0000 7f323afeb700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08cc80 con 0x55ac5f089150 2023-10-05T21:15:20.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.051+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f322c036070 con 0x55ac5f089150 2023-10-05T21:15:20.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.051+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08cc80 con 0x55ac5f0579d0 2023-10-05T21:15:20.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.051+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.051+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08cc80 con 0x7f323000d8e0 2023-10-05T21:15:20.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.052+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f323400a570 con 0x7f323000d8e0 2023-10-05T21:15:20.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.052+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08cc80 con 0x55ac5f0579d0 2023-10-05T21:15:20.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.052+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.052+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08cc80 con 0x7f322c039030 2023-10-05T21:15:20.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.052+0000 7f323afeb700 1 -- 172.21.15.153:0/3277143712 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3230006070 con 0x7f322c039030 2023-10-05T21:15:20.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.052+0000 7f323afeb700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08cc80 con 0x55ac5f089150 2023-10-05T21:15:20.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.052+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f322c036070 con 0x55ac5f089150 2023-10-05T21:15:20.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.052+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08cc80 con 0x55ac5f089150 2023-10-05T21:15:20.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.053+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f322c036070 con 0x55ac5f089150 2023-10-05T21:15:20.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.053+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08cc80 con 0x7f323000d8e0 2023-10-05T21:15:20.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.053+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f323400a570 con 0x7f323000d8e0 2023-10-05T21:15:20.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.053+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08cc80 con 0x55ac5f089150 2023-10-05T21:15:20.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.053+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f322c036070 con 0x55ac5f089150 2023-10-05T21:15:20.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.053+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08cc80 con 0x55ac5f089150 2023-10-05T21:15:20.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.053+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f322c036070 con 0x55ac5f089150 2023-10-05T21:15:20.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.053+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08cc80 con 0x55ac5f0579d0 2023-10-05T21:15:20.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.053+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.053+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08cc80 con 0x55ac5f0579d0 2023-10-05T21:15:20.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.054+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.054+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08cc80 con 0x7f323000d8e0 2023-10-05T21:15:20.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.054+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f323400a570 con 0x7f323000d8e0 2023-10-05T21:15:20.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.054+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08cc80 con 0x55ac5f089150 2023-10-05T21:15:20.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.054+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f322c036070 con 0x55ac5f089150 2023-10-05T21:15:20.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.054+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08cc80 con 0x7f322c039030 2023-10-05T21:15:20.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.054+0000 7f323afeb700 1 -- 172.21.15.153:0/3277143712 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3230006070 con 0x7f322c039030 2023-10-05T21:15:20.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.054+0000 7f323afeb700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08cc80 con 0x55ac5f0579d0 2023-10-05T21:15:20.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.054+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.054+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08cc80 con 0x7f323000d8e0 2023-10-05T21:15:20.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.055+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f323400a570 con 0x7f323000d8e0 2023-10-05T21:15:20.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.055+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08cc80 con 0x55ac5f089150 2023-10-05T21:15:20.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.055+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f322c036070 con 0x55ac5f089150 2023-10-05T21:15:20.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.055+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08cc80 con 0x7f323000d8e0 2023-10-05T21:15:20.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.055+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f323400a570 con 0x7f323000d8e0 2023-10-05T21:15:20.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.055+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08cc80 con 0x7f322c039030 2023-10-05T21:15:20.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.055+0000 7f323afeb700 1 -- 172.21.15.153:0/3277143712 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3230006070 con 0x7f322c039030 2023-10-05T21:15:20.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.055+0000 7f323afeb700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08cc80 con 0x55ac5f089150 2023-10-05T21:15:20.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.055+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f322c036070 con 0x55ac5f089150 2023-10-05T21:15:20.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.056+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08cc80 con 0x7f323000d8e0 2023-10-05T21:15:20.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.056+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f323400a570 con 0x7f323000d8e0 2023-10-05T21:15:20.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.056+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08cc80 con 0x55ac5f0579d0 2023-10-05T21:15:20.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.056+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.056+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08cc80 con 0x7f322c039030 2023-10-05T21:15:20.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.056+0000 7f323afeb700 1 -- 172.21.15.153:0/3277143712 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3230006070 con 0x7f322c039030 2023-10-05T21:15:20.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.056+0000 7f3248714680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:20.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.056+0000 7f3248714680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:20.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.056+0000 7f3248714680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:20.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.056+0000 7f3248714680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:20.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.056+0000 7f3248714680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.056+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08de80 con 0x55ac5f0579d0 2023-10-05T21:15:20.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.056+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.056+0000 7f3248714680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:20.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.057+0000 7f3248714680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.057+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08e230 con 0x55ac5f089150 2023-10-05T21:15:20.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.057+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f322c036070 con 0x55ac5f089150 2023-10-05T21:15:20.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.057+0000 7f3248714680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:20.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.057+0000 7f3248714680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.057+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08c800 con 0x55ac5f0579d0 2023-10-05T21:15:20.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.057+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.057+0000 7f3248714680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:20.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.057+0000 7f3248714680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.057+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08c800 con 0x55ac5f0579d0 2023-10-05T21:15:20.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.057+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.057+0000 7f3248714680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:20.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.057+0000 7f3248714680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.057+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08eb20 con 0x7f323000d8e0 2023-10-05T21:15:20.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.057+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f323400a570 con 0x7f323000d8e0 2023-10-05T21:15:20.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.057+0000 7f3248714680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.057+0000 7f3248714680 20 zone default found 2023-10-05T21:15:20.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.057+0000 7f3248714680 4 Realm: () 2023-10-05T21:15:20.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.057+0000 7f3248714680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:20.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.057+0000 7f3248714680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:20.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.057+0000 7f3248714680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:20.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.057+0000 7f3248714680 20 zonegroup default 2023-10-05T21:15:20.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.057+0000 7f3248714680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.058+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08eb20 con 0x7f323000d8e0 2023-10-05T21:15:20.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.058+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f323400a570 con 0x7f323000d8e0 2023-10-05T21:15:20.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.058+0000 7f3248714680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.058+0000 7f3248714680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.058+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f090450 con 0x55ac5f089150 2023-10-05T21:15:20.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.058+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f322c036070 con 0x55ac5f089150 2023-10-05T21:15:20.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.058+0000 7f3248714680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.058+0000 7f3248714680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.058+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f090800 con 0x55ac5f089150 2023-10-05T21:15:20.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.058+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f322c036070 con 0x55ac5f089150 2023-10-05T21:15:20.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.058+0000 7f3248714680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.058+0000 7f3248714680 20 started sync module instance, tier type = 2023-10-05T21:15:20.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.058+0000 7f3248714680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:20.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.058+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08fb10 con 0x7f322c039030 2023-10-05T21:15:20.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.059+0000 7f323afeb700 1 -- 172.21.15.153:0/3277143712 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3230006070 con 0x7f322c039030 2023-10-05T21:15:20.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.059+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94198817160976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f0910a0 con 0x7f322c039030 2023-10-05T21:15:20.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.059+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f091940 con 0x55ac5f0579d0 2023-10-05T21:15:20.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.060+0000 7f323afeb700 1 -- 172.21.15.153:0/3277143712 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94198817160976] v29'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3230006070 con 0x7f322c039030 2023-10-05T21:15:20.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.060+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.060+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94198817164208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f091980 con 0x55ac5f0579d0 2023-10-05T21:15:20.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.060+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f092560 con 0x55ac5f089150 2023-10-05T21:15:20.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.061+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94198817164208] v29'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.061+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f322c036070 con 0x55ac5f089150 2023-10-05T21:15:20.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.061+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94198817169424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f092960 con 0x55ac5f089150 2023-10-05T21:15:20.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.061+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f093370 con 0x7f322c039030 2023-10-05T21:15:20.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.062+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94198817169424] v29'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f322c036070 con 0x55ac5f089150 2023-10-05T21:15:20.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.062+0000 7f323afeb700 1 -- 172.21.15.153:0/3277143712 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3230006070 con 0x7f322c039030 2023-10-05T21:15:20.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.062+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94198817173120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f093720 con 0x7f322c039030 2023-10-05T21:15:20.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.062+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f094130 con 0x55ac5f0579d0 2023-10-05T21:15:20.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.062+0000 7f323afeb700 1 -- 172.21.15.153:0/3277143712 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94198817173120] v29'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3230006070 con 0x7f322c039030 2023-10-05T21:15:20.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.063+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.063+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94198817176640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f094580 con 0x55ac5f0579d0 2023-10-05T21:15:20.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.063+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f094f90 con 0x7f323000d8e0 2023-10-05T21:15:20.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.063+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94198817176640] v29'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.063+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f323400a570 con 0x7f323000d8e0 2023-10-05T21:15:20.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.063+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94198817178304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f094f90 con 0x7f323000d8e0 2023-10-05T21:15:20.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.063+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f0959a0 con 0x7f323000d8e0 2023-10-05T21:15:20.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.064+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94198817178304] v29'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f323400a570 con 0x7f323000d8e0 2023-10-05T21:15:20.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.064+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f323400a570 con 0x7f323000d8e0 2023-10-05T21:15:20.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.064+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94198817180912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f0959a0 con 0x7f323000d8e0 2023-10-05T21:15:20.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.064+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f0963b0 con 0x7f323000d8e0 2023-10-05T21:15:20.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.065+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94198817180912] v29'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f323400a570 con 0x7f323000d8e0 2023-10-05T21:15:20.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.065+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f323400a570 con 0x7f323000d8e0 2023-10-05T21:15:20.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.065+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94198817183456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f0963b0 con 0x7f323000d8e0 2023-10-05T21:15:20.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.065+0000 7f3248714680 20 add_watcher() i=0 2023-10-05T21:15:20.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.065+0000 7f3248714680 20 add_watcher() i=1 2023-10-05T21:15:20.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.065+0000 7f3248714680 20 add_watcher() i=2 2023-10-05T21:15:20.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.065+0000 7f3248714680 20 add_watcher() i=3 2023-10-05T21:15:20.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.065+0000 7f3248714680 20 add_watcher() i=4 2023-10-05T21:15:20.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.065+0000 7f3248714680 20 add_watcher() i=5 2023-10-05T21:15:20.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.065+0000 7f3248714680 20 add_watcher() i=6 2023-10-05T21:15:20.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.066+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94198817183456] v29'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f323400a570 con 0x7f323000d8e0 2023-10-05T21:15:20.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.066+0000 7f3248714680 20 add_watcher() i=7 2023-10-05T21:15:20.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.066+0000 7f3248714680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:20.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.066+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f099630 con 0x55ac5f0579d0 2023-10-05T21:15:20.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.066+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.066+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94198817185840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f096970 con 0x55ac5f0579d0 2023-10-05T21:15:20.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.067+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94198817185840] v29'164 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.067+0000 7f3187fff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:20.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.067+0000 7f3248714680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:20.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.067+0000 7f3248714680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:20.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.067+0000 7f3248714680 1 Processor -- start 2023-10-05T21:15:20.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.067+0000 7f3248714680 1 -- start start 2023-10-05T21:15:20.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.067+0000 7f3248714680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5f0a41d0 0x55ac5f0a45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.067+0000 7f3248714680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac5f0a4bb0 con 0x55ac5f0a41d0 2023-10-05T21:15:20.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.067+0000 7f323afeb700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5f0a41d0 0x55ac5f0a45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.068+0000 7f323afeb700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5f0a41d0 0x55ac5f0a45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38400/0 (socket says 172.21.15.153:38400) 2023-10-05T21:15:20.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.068+0000 7f323afeb700 1 -- 172.21.15.153:0/3106549428 learned_addr learned my addr 172.21.15.153:0/3106549428 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:20.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.068+0000 7f323afeb700 1 -- 172.21.15.153:0/3106549428 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac5f0a4cf0 con 0x55ac5f0a41d0 2023-10-05T21:15:20.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.068+0000 7f323afeb700 1 --2- 172.21.15.153:0/3106549428 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5f0a41d0 0x55ac5f0a45e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x55ac5f0888a0 tx=0x7f3230006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab37808ae50ced6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.068+0000 7f31877fe700 1 -- 172.21.15.153:0/3106549428 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3230023040 con 0x55ac5f0a41d0 2023-10-05T21:15:20.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.068+0000 7f31877fe700 1 -- 172.21.15.153:0/3106549428 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3230024040 con 0x55ac5f0a41d0 2023-10-05T21:15:20.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.068+0000 7f31877fe700 1 -- 172.21.15.153:0/3106549428 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3230013040 con 0x55ac5f0a41d0 2023-10-05T21:15:20.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.069+0000 7f3248714680 1 -- 172.21.15.153:0/3106549428 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5f0a41d0 msgr2=0x55ac5f0a45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.069+0000 7f3248714680 1 --2- 172.21.15.153:0/3106549428 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5f0a41d0 0x55ac5f0a45e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x55ac5f0888a0 tx=0x7f3230006000 comp rx=0 tx=0).stop 2023-10-05T21:15:20.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.069+0000 7f3248714680 1 -- 172.21.15.153:0/3106549428 shutdown_connections 2023-10-05T21:15:20.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.069+0000 7f3248714680 1 --2- 172.21.15.153:0/3106549428 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5f0a41d0 0x55ac5f0a45e0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.069+0000 7f3248714680 1 -- 172.21.15.153:0/3106549428 >> 172.21.15.153:0/3106549428 conn(0x55ac5f09f3d0 msgr2=0x55ac5f09d530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:20.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.069+0000 7f3248714680 1 -- 172.21.15.153:0/3106549428 shutdown_connections 2023-10-05T21:15:20.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.069+0000 7f3248714680 1 -- 172.21.15.153:0/3106549428 wait complete. 2023-10-05T21:15:20.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.069+0000 7f3248714680 1 Processor -- start 2023-10-05T21:15:20.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.069+0000 7f3248714680 1 -- start start 2023-10-05T21:15:20.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.069+0000 7f3248714680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5f0a41d0 0x55ac5f0a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.069+0000 7f3248714680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac5f0aa250 con 0x55ac5f0a41d0 2023-10-05T21:15:20.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.070+0000 7f323afeb700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5f0a41d0 0x55ac5f0a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.070+0000 7f323afeb700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5f0a41d0 0x55ac5f0a9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38408/0 (socket says 172.21.15.153:38408) 2023-10-05T21:15:20.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.070+0000 7f323afeb700 1 -- 172.21.15.153:0/2463330472 learned_addr learned my addr 172.21.15.153:0/2463330472 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:20.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.070+0000 7f323afeb700 1 -- 172.21.15.153:0/2463330472 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323000ed00 con 0x55ac5f0a41d0 2023-10-05T21:15:20.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.070+0000 7f323afeb700 1 --2- 172.21.15.153:0/2463330472 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5f0a41d0 0x55ac5f0a9d10 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x55ac5f09e940 tx=0x7f3230030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.070+0000 7f3185ffb700 1 -- 172.21.15.153:0/2463330472 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3230023040 con 0x55ac5f0a41d0 2023-10-05T21:15:20.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.070+0000 7f3185ffb700 1 -- 172.21.15.153:0/2463330472 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323001e5f0 con 0x55ac5f0a41d0 2023-10-05T21:15:20.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.070+0000 7f3185ffb700 1 -- 172.21.15.153:0/2463330472 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f323001e780 con 0x55ac5f0a41d0 2023-10-05T21:15:20.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.070+0000 7f3248714680 1 -- 172.21.15.153:0/2463330472 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ac5f0aa450 con 0x55ac5f0a41d0 2023-10-05T21:15:20.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.070+0000 7f3248714680 1 -- 172.21.15.153:0/2463330472 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ac5f0aa8a0 con 0x55ac5f0a41d0 2023-10-05T21:15:20.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.071+0000 7f3185ffb700 1 -- 172.21.15.153:0/2463330472 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f323001e8e0 con 0x55ac5f0a41d0 2023-10-05T21:15:20.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.071+0000 7f3185ffb700 1 --2- 172.21.15.153:0/2463330472 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3178034190 0x7f3178036640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.071+0000 7f3185ffb700 1 -- 172.21.15.153:0/2463330472 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f323004fb00 con 0x55ac5f0a41d0 2023-10-05T21:15:20.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.071+0000 7f323bfed700 1 --2- 172.21.15.153:0/2463330472 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3178034190 0x7f3178036640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.071+0000 7f3248714680 5 note: GC not initialized 2023-10-05T21:15:20.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.072+0000 7f323bfed700 1 --2- 172.21.15.153:0/2463330472 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3178034190 0x7f3178036640 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x55ac5f099660 tx=0x7f3234037710 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.072+0000 7f3176ffd700 20 reqs_thread_entry: start 2023-10-05T21:15:20.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.072+0000 7f3174ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:20.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.072+0000 7f3248714680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:20.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.073+0000 7f3248714680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:20.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.073+0000 7f316effd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:50 2023 2023-10-05T21:15:20.105 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:20.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.073+0000 7f316e7fc700 20 reqs_thread_entry: start 2023-10-05T21:15:20.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.073+0000 7f3248714680 10 log_show_next pos 0 bl 0 off 0 eof 0 2023-10-05T21:15:20.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.073+0000 7f3248714680 1 --2- 172.21.15.153:0/2463330472 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ac5f10e590 0x55ac5f110970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.073+0000 7f3248714680 1 -- 172.21.15.153:0/2463330472 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:1 6.1b 6:dfe7776a:::2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1-myfoo:head [read 0~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f110eb0 con 0x55ac5f10e590 2023-10-05T21:15:20.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.073+0000 7f323b7ec700 1 --2- 172.21.15.153:0/2463330472 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ac5f10e590 0x55ac5f110970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.073+0000 7f323b7ec700 1 --2- 172.21.15.153:0/2463330472 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ac5f10e590 0x55ac5f110970 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.073+0000 7f323b7ec700 1 -- 172.21.15.153:0/2463330472 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(1 2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1-myfoo [read 0~3730 out=3730b] v0'0 uv20 ondisk = 0) v8 ==== 207+0+3730 (crc 0 0 0) 0x7f322c036070 con 0x55ac5f10e590 2023-10-05T21:15:20.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.073+0000 7f3248714680 10 read 3730 2023-10-05T21:15:20.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.073+0000 7f3248714680 10 log_show_next pos 3730 bl 3730 off 417 eof 1 2023-10-05T21:15:20.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.073+0000 7f3248714680 10 log_show_next pos 3730 bl 3730 off 922 eof 1 2023-10-05T21:15:20.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.073+0000 7f3248714680 10 log_show_next pos 3730 bl 3730 off 1442 eof 1 2023-10-05T21:15:20.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.073+0000 7f3248714680 10 log_show_next pos 3730 bl 3730 off 1947 eof 1 2023-10-05T21:15:20.106 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:20.106 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_id": "193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1", 2023-10-05T21:15:20.107 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_owner": "foo", 2023-10-05T21:15:20.107 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo", 2023-10-05T21:15:20.107 INFO:teuthology.orchestra.run.smithi153.stdout: "log_entries": [ 2023-10-05T21:15:20.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:20.107 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo", 2023-10-05T21:15:20.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:15:15.574040Z", 2023-10-05T21:15:20.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time_local": "2023-10-05T21:15:15.574040+0000", 2023-10-05T21:15:20.107 INFO:teuthology.orchestra.run.smithi153.stdout: "remote_addr": "172.21.0.51", 2023-10-05T21:15:20.107 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:20.107 INFO:teuthology.orchestra.run.smithi153.stdout: "operation": "create_bucket", 2023-10-05T21:15:20.107 INFO:teuthology.orchestra.run.smithi153.stdout: "uri": "PUT /myfoo/ HTTP/1.1", 2023-10-05T21:15:20.107 INFO:teuthology.orchestra.run.smithi153.stdout: "http_status": "200", 2023-10-05T21:15:20.108 INFO:teuthology.orchestra.run.smithi153.stdout: "error_code": "", 2023-10-05T21:15:20.108 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:15:20.108 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:15:20.108 INFO:teuthology.orchestra.run.smithi153.stdout: "object_size": 0, 2023-10-05T21:15:20.108 INFO:teuthology.orchestra.run.smithi153.stdout: "total_time": 6, 2023-10-05T21:15:20.108 INFO:teuthology.orchestra.run.smithi153.stdout: "user_agent": "Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic", 2023-10-05T21:15:20.108 INFO:teuthology.orchestra.run.smithi153.stdout: "referrer": "", 2023-10-05T21:15:20.108 INFO:teuthology.orchestra.run.smithi153.stdout: "trans_id": "tx0000078ca8e5f1169889a-00651f2763-107c-default", 2023-10-05T21:15:20.108 INFO:teuthology.orchestra.run.smithi153.stdout: "authentication_type": "Local", 2023-10-05T21:15:20.108 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key_id": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:20.108 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url": false 2023-10-05T21:15:20.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:20.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:20.109 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo", 2023-10-05T21:15:20.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:15:16.271028Z", 2023-10-05T21:15:20.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time_local": "2023-10-05T21:15:16.271028+0000", 2023-10-05T21:15:20.109 INFO:teuthology.orchestra.run.smithi153.stdout: "remote_addr": "172.21.0.51", 2023-10-05T21:15:20.109 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:20.109 INFO:teuthology.orchestra.run.smithi153.stdout: "operation": "put_obj", 2023-10-05T21:15:20.109 INFO:teuthology.orchestra.run.smithi153.stdout: "uri": "PUT /myfoo/f97c5d29941bfb1b2fdab0874906ab82 HTTP/1.1", 2023-10-05T21:15:20.109 INFO:teuthology.orchestra.run.smithi153.stdout: "http_status": "200", 2023-10-05T21:15:20.109 INFO:teuthology.orchestra.run.smithi153.stdout: "error_code": "", 2023-10-05T21:15:20.109 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:15:20.109 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 3, 2023-10-05T21:15:20.109 INFO:teuthology.orchestra.run.smithi153.stdout: "object_size": 3, 2023-10-05T21:15:20.110 INFO:teuthology.orchestra.run.smithi153.stdout: "total_time": 3, 2023-10-05T21:15:20.110 INFO:teuthology.orchestra.run.smithi153.stdout: "user_agent": "Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic", 2023-10-05T21:15:20.110 INFO:teuthology.orchestra.run.smithi153.stdout: "referrer": "", 2023-10-05T21:15:20.110 INFO:teuthology.orchestra.run.smithi153.stdout: "trans_id": "tx00000516f511f00b1aa16-00651f2764-107c-default", 2023-10-05T21:15:20.110 INFO:teuthology.orchestra.run.smithi153.stdout: "authentication_type": "Local", 2023-10-05T21:15:20.110 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key_id": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:20.110 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url": false 2023-10-05T21:15:20.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:20.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:20.110 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo", 2023-10-05T21:15:20.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:15:16.542023Z", 2023-10-05T21:15:20.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time_local": "2023-10-05T21:15:16.542023+0000", 2023-10-05T21:15:20.111 INFO:teuthology.orchestra.run.smithi153.stdout: "remote_addr": "172.21.0.51", 2023-10-05T21:15:20.111 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:20.111 INFO:teuthology.orchestra.run.smithi153.stdout: "operation": "delete_obj", 2023-10-05T21:15:20.111 INFO:teuthology.orchestra.run.smithi153.stdout: "uri": "DELETE /myfoo/f97c5d29941bfb1b2fdab0874906ab82 HTTP/1.1", 2023-10-05T21:15:20.111 INFO:teuthology.orchestra.run.smithi153.stdout: "http_status": "204", 2023-10-05T21:15:20.111 INFO:teuthology.orchestra.run.smithi153.stdout: "error_code": "NoContent", 2023-10-05T21:15:20.111 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:15:20.111 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:15:20.111 INFO:teuthology.orchestra.run.smithi153.stdout: "object_size": 0, 2023-10-05T21:15:20.111 INFO:teuthology.orchestra.run.smithi153.stdout: "total_time": 2, 2023-10-05T21:15:20.111 INFO:teuthology.orchestra.run.smithi153.stdout: "user_agent": "Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic", 2023-10-05T21:15:20.112 INFO:teuthology.orchestra.run.smithi153.stdout: "referrer": "", 2023-10-05T21:15:20.112 INFO:teuthology.orchestra.run.smithi153.stdout: "trans_id": "tx00000cc71bf92cdecba0a-00651f2764-107c-default", 2023-10-05T21:15:20.112 INFO:teuthology.orchestra.run.smithi153.stdout: "authentication_type": "Local", 2023-10-05T21:15:20.112 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key_id": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:20.112 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url": false 2023-10-05T21:15:20.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:20.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:20.112 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo", 2023-10-05T21:15:20.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:15:16.857017Z", 2023-10-05T21:15:20.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time_local": "2023-10-05T21:15:16.857017+0000", 2023-10-05T21:15:20.112 INFO:teuthology.orchestra.run.smithi153.stdout: "remote_addr": "172.21.0.51", 2023-10-05T21:15:20.112 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:20.112 INFO:teuthology.orchestra.run.smithi153.stdout: "operation": "put_obj", 2023-10-05T21:15:20.113 INFO:teuthology.orchestra.run.smithi153.stdout: "uri": "PUT /myfoo/b8a9f715dbb64fd5c56e7783c6820a61 HTTP/1.1", 2023-10-05T21:15:20.113 INFO:teuthology.orchestra.run.smithi153.stdout: "http_status": "200", 2023-10-05T21:15:20.113 INFO:teuthology.orchestra.run.smithi153.stdout: "error_code": "", 2023-10-05T21:15:20.113 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:15:20.113 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 3, 2023-10-05T21:15:20.113 INFO:teuthology.orchestra.run.smithi153.stdout: "object_size": 3, 2023-10-05T21:15:20.113 INFO:teuthology.orchestra.run.smithi153.stdout: "total_time": 1, 2023-10-05T21:15:20.113 INFO:teuthology.orchestra.run.smithi153.stdout: "user_agent": "Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic", 2023-10-05T21:15:20.113 INFO:teuthology.orchestra.run.smithi153.stdout: "referrer": "", 2023-10-05T21:15:20.113 INFO:teuthology.orchestra.run.smithi153.stdout: "trans_id": "tx0000043ad8b035e4e03e1-00651f2764-107c-default", 2023-10-05T21:15:20.113 INFO:teuthology.orchestra.run.smithi153.stdout: "authentication_type": "Local", 2023-10-05T21:15:20.113 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key_id": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:20.114 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url": false 2023-10-05T21:15:20.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:20.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:20.114 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo", 2023-10-05T21:15:20.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:15:16.861017Z", 2023-10-05T21:15:20.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time_local": "2023-10-05T21:15:16.861017+0000", 2023-10-05T21:15:20.114 INFO:teuthology.orchestra.run.smithi153.stdout: "remote_addr": "172.21.0.51", 2023-10-05T21:15:20.114 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:20.114 INFO:teuthology.orchestra.run.smithi153.stdout: "operation": "delete_obj", 2023-10-05T21:15:20.114 INFO:teuthology.orchestra.run.smithi153.stdout: "uri": "DELETE /myfoo/b8a9f715dbb64fd5c56e7783c6820a61 HTTP/1.1", 2023-10-05T21:15:20.114 INFO:teuthology.orchestra.run.smithi153.stdout: "http_status": "204", 2023-10-05T21:15:20.114 INFO:teuthology.orchestra.run.smithi153.stdout: "error_code": "NoContent", 2023-10-05T21:15:20.115 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:15:20.115 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:15:20.115 INFO:teuthology.orchestra.run.smithi153.stdout: "object_size": 0, 2023-10-05T21:15:20.115 INFO:teuthology.orchestra.run.smithi153.stdout: "total_time": 1, 2023-10-05T21:15:20.115 INFO:teuthology.orchestra.run.smithi153.stdout: "user_agent": "Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic", 2023-10-05T21:15:20.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.073+0000 7f3248714680 10 log_show_next pos 3730 bl 3730 off 2467 eof 1 2023-10-05T21:15:20.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.073+0000 7f3248714680 10 log_show_next pos 3730 bl 3730 off 2888 eof 1 2023-10-05T21:15:20.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.073+0000 7f3248714680 10 log_show_next pos 3730 bl 3730 off 3315 eof 1 2023-10-05T21:15:20.116 INFO:teuthology.orchestra.run.smithi153.stdout: "referrer": "", 2023-10-05T21:15:20.116 INFO:teuthology.orchestra.run.smithi153.stdout: "trans_id": "tx00000fdde6b42b33220e8-00651f2764-107c-default", 2023-10-05T21:15:20.116 INFO:teuthology.orchestra.run.smithi153.stdout: "authentication_type": "Local", 2023-10-05T21:15:20.116 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key_id": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:20.116 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url": false 2023-10-05T21:15:20.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:20.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:20.116 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo", 2023-10-05T21:15:20.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:15:18.467989Z", 2023-10-05T21:15:20.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time_local": "2023-10-05T21:15:18.467989+0000", 2023-10-05T21:15:20.117 INFO:teuthology.orchestra.run.smithi153.stdout: "remote_addr": "172.21.0.51", 2023-10-05T21:15:20.117 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:20.117 INFO:teuthology.orchestra.run.smithi153.stdout: "operation": "put_obj", 2023-10-05T21:15:20.117 INFO:teuthology.orchestra.run.smithi153.stdout: "uri": "PUT /myfoo/four HTTP/1.1", 2023-10-05T21:15:20.117 INFO:teuthology.orchestra.run.smithi153.stdout: "http_status": "200", 2023-10-05T21:15:20.117 INFO:teuthology.orchestra.run.smithi153.stdout: "error_code": "", 2023-10-05T21:15:20.117 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:15:20.117 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 4, 2023-10-05T21:15:20.117 INFO:teuthology.orchestra.run.smithi153.stdout: "object_size": 4, 2023-10-05T21:15:20.117 INFO:teuthology.orchestra.run.smithi153.stdout: "total_time": 2, 2023-10-05T21:15:20.117 INFO:teuthology.orchestra.run.smithi153.stdout: "user_agent": "Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic", 2023-10-05T21:15:20.118 INFO:teuthology.orchestra.run.smithi153.stdout: "referrer": "", 2023-10-05T21:15:20.118 INFO:teuthology.orchestra.run.smithi153.stdout: "trans_id": "tx0000059417fed5166e54d-00651f2766-107c-default", 2023-10-05T21:15:20.118 INFO:teuthology.orchestra.run.smithi153.stdout: "authentication_type": "Local", 2023-10-05T21:15:20.118 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key_id": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:20.118 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url": false 2023-10-05T21:15:20.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:20.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:20.118 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo", 2023-10-05T21:15:20.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:15:18.471989Z", 2023-10-05T21:15:20.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time_local": "2023-10-05T21:15:18.471989+0000", 2023-10-05T21:15:20.118 INFO:teuthology.orchestra.run.smithi153.stdout: "remote_addr": "172.21.0.51", 2023-10-05T21:15:20.118 INFO:teuthology.orchestra.run.smithi153.stdout: "object_owner": "foo", 2023-10-05T21:15:20.119 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:20.119 INFO:teuthology.orchestra.run.smithi153.stdout: "operation": "get_obj", 2023-10-05T21:15:20.119 INFO:teuthology.orchestra.run.smithi153.stdout: "uri": "GET /myfoo/four HTTP/1.1", 2023-10-05T21:15:20.119 INFO:teuthology.orchestra.run.smithi153.stdout: "http_status": "200", 2023-10-05T21:15:20.119 INFO:teuthology.orchestra.run.smithi153.stdout: "error_code": "", 2023-10-05T21:15:20.119 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 4, 2023-10-05T21:15:20.119 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:15:20.119 INFO:teuthology.orchestra.run.smithi153.stdout: "object_size": 4, 2023-10-05T21:15:20.119 INFO:teuthology.orchestra.run.smithi153.stdout: "total_time": 0, 2023-10-05T21:15:20.119 INFO:teuthology.orchestra.run.smithi153.stdout: "user_agent": "Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic", 2023-10-05T21:15:20.119 INFO:teuthology.orchestra.run.smithi153.stdout: "referrer": "", 2023-10-05T21:15:20.119 INFO:teuthology.orchestra.run.smithi153.stdout: "trans_id": "tx00000a297f94cc482e994-00651f2766-107c-default", 2023-10-05T21:15:20.120 INFO:teuthology.orchestra.run.smithi153.stdout: "authentication_type": "Local", 2023-10-05T21:15:20.120 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key_id": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:20.120 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url": false 2023-10-05T21:15:20.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:20.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:20.120 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo", 2023-10-05T21:15:20.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:15:18.473989Z", 2023-10-05T21:15:20.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time_local": "2023-10-05T21:15:18.473989+0000", 2023-10-05T21:15:20.120 INFO:teuthology.orchestra.run.smithi153.stdout: "remote_addr": "172.21.0.51", 2023-10-05T21:15:20.120 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:20.120 INFO:teuthology.orchestra.run.smithi153.stdout: "operation": "list_bucket", 2023-10-05T21:15:20.120 INFO:teuthology.orchestra.run.smithi153.stdout: "uri": "GET /myfoo/ HTTP/1.1", 2023-10-05T21:15:20.121 INFO:teuthology.orchestra.run.smithi153.stdout: "http_status": "200", 2023-10-05T21:15:20.121 INFO:teuthology.orchestra.run.smithi153.stdout: "error_code": "", 2023-10-05T21:15:20.121 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 515, 2023-10-05T21:15:20.121 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:15:20.121 INFO:teuthology.orchestra.run.smithi153.stdout: "object_size": 0, 2023-10-05T21:15:20.121 INFO:teuthology.orchestra.run.smithi153.stdout: "total_time": 1, 2023-10-05T21:15:20.121 INFO:teuthology.orchestra.run.smithi153.stdout: "user_agent": "Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic", 2023-10-05T21:15:20.121 INFO:teuthology.orchestra.run.smithi153.stdout: "referrer": "", 2023-10-05T21:15:20.121 INFO:teuthology.orchestra.run.smithi153.stdout: "trans_id": "tx00000b6fa9e98a39caa75-00651f2766-107c-default", 2023-10-05T21:15:20.121 INFO:teuthology.orchestra.run.smithi153.stdout: "authentication_type": "Local", 2023-10-05T21:15:20.121 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key_id": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:20.121 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url": false 2023-10-05T21:15:20.122 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:20.122 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:20.122 INFO:teuthology.orchestra.run.smithi153.stdout: "log_sum": { 2023-10-05T21:15:20.122 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 519, 2023-10-05T21:15:20.122 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 10, 2023-10-05T21:15:20.122 INFO:teuthology.orchestra.run.smithi153.stdout: "total_time": 16, 2023-10-05T21:15:20.122 INFO:teuthology.orchestra.run.smithi153.stdout: "total_entries": 8 2023-10-05T21:15:20.122 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:20.122 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:20.122 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:15:20.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.073+0000 7f3248714680 10 log_show_next pos 3730 bl 3730 off 3730 eof 1 2023-10-05T21:15:20.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.074+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94198817160976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f0ce2e0 con 0x7f322c039030 2023-10-05T21:15:20.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.074+0000 7f323afeb700 1 -- 172.21.15.153:0/3277143712 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(102 notify.0 [watch unwatch cookie 94198817160976] v29'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3230006070 con 0x7f322c039030 2023-10-05T21:15:20.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.074+0000 7f3248714680 20 remove_watcher() i=0 2023-10-05T21:15:20.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.074+0000 7f3248714680 2 removed watcher, disabling cache 2023-10-05T21:15:20.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.074+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94198817164208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08ff10 con 0x55ac5f0579d0 2023-10-05T21:15:20.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.075+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(103 notify.1 [watch unwatch cookie 94198817164208] v29'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.075+0000 7f3248714680 20 remove_watcher() i=1 2023-10-05T21:15:20.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.075+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:104 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94198817169424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08ff10 con 0x55ac5f089150 2023-10-05T21:15:20.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.076+0000 7f323b7ec700 1 -- 172.21.15.153:0/3277143712 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(104 notify.2 [watch unwatch cookie 94198817169424] v29'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f322c036070 con 0x55ac5f089150 2023-10-05T21:15:20.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.076+0000 7f3248714680 20 remove_watcher() i=2 2023-10-05T21:15:20.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.076+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94198817173120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f08ff10 con 0x7f322c039030 2023-10-05T21:15:20.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.077+0000 7f323afeb700 1 -- 172.21.15.153:0/3277143712 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(105 notify.3 [watch unwatch cookie 94198817173120] v29'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3230006070 con 0x7f322c039030 2023-10-05T21:15:20.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.077+0000 7f3248714680 20 remove_watcher() i=3 2023-10-05T21:15:20.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.077+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94198817176640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f092e80 con 0x55ac5f0579d0 2023-10-05T21:15:20.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.078+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(106 notify.4 [watch unwatch cookie 94198817176640] v29'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.078+0000 7f3248714680 20 remove_watcher() i=4 2023-10-05T21:15:20.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.078+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:107 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94198817178304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f093c40 con 0x7f323000d8e0 2023-10-05T21:15:20.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.079+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(107 notify.5 [watch unwatch cookie 94198817178304] v29'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f323400a570 con 0x7f323000d8e0 2023-10-05T21:15:20.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.079+0000 7f3248714680 20 remove_watcher() i=5 2023-10-05T21:15:20.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.079+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94198817180912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f0942c0 con 0x7f323000d8e0 2023-10-05T21:15:20.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.079+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(108 notify.6 [watch unwatch cookie 94198817180912] v29'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f323400a570 con 0x7f323000d8e0 2023-10-05T21:15:20.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.079+0000 7f3248714680 20 remove_watcher() i=6 2023-10-05T21:15:20.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.079+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94198817183456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f093c40 con 0x7f323000d8e0 2023-10-05T21:15:20.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.080+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(109 notify.7 [watch unwatch cookie 94198817183456] v29'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f323400a570 con 0x7f323000d8e0 2023-10-05T21:15:20.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.080+0000 7f3248714680 20 remove_watcher() i=7 2023-10-05T21:15:20.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.081+0000 7f3187fff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:20.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.081+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:110 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94198817185840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55ac5f094cf0 con 0x55ac5f0579d0 2023-10-05T21:15:20.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.082+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(110 data_loggenerations_metadata [watch unwatch cookie 94198817185840] v29'165 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f323400a570 con 0x55ac5f0579d0 2023-10-05T21:15:20.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.082+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f323000d8e0 msgr2=0x7f323000c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.082+0000 7f3248714680 1 --2- 172.21.15.153:0/3277143712 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f323000d8e0 0x7f323000c360 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.082+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ac5f0579d0 msgr2=0x55ac5f086b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.082+0000 7f3248714680 1 --2- 172.21.15.153:0/3277143712 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ac5f0579d0 0x55ac5f086b20 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.082+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f322c039030 msgr2=0x7f322c048a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.082+0000 7f3248714680 1 --2- 172.21.15.153:0/3277143712 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f322c039030 0x7f322c048a00 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.082+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ac5f089150 msgr2=0x55ac5f08b530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.082+0000 7f3248714680 1 --2- 172.21.15.153:0/3277143712 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ac5f089150 0x55ac5f08b530 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.082+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3220034140 msgr2=0x7f32200365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.082+0000 7f3248714680 1 --2- 172.21.15.153:0/3277143712 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3220034140 0x7f32200365f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f32300011e0 tx=0x7f32300013a0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.082+0000 7f323bfed700 1 -- 172.21.15.153:0/3277143712 reap_dead start 2023-10-05T21:15:20.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.082+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5efc60a0 msgr2=0x55ac5f07ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.082+0000 7f3248714680 1 --2- 172.21.15.153:0/3277143712 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5efc60a0 0x55ac5f07ad70 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f322c00a520 tx=0x7f322c01d000 comp rx=0 tx=0).stop 2023-10-05T21:15:20.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.082+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 shutdown_connections 2023-10-05T21:15:20.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.082+0000 7f3248714680 1 --2- 172.21.15.153:0/3277143712 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5efc60a0 0x55ac5f07ad70 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.082+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 >> 172.21.15.153:0/3277143712 conn(0x55ac5f04cb80 msgr2=0x55ac5f06dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:20.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.082+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 shutdown_connections 2023-10-05T21:15:20.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.082+0000 7f3248714680 1 -- 172.21.15.153:0/3277143712 wait complete. 2023-10-05T21:15:20.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.082+0000 7f3248714680 1 -- 172.21.15.153:0/2463330472 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ac5f10e590 msgr2=0x55ac5f110970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.082+0000 7f3248714680 1 --2- 172.21.15.153:0/2463330472 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ac5f10e590 0x55ac5f110970 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.082+0000 7f3248714680 1 -- 172.21.15.153:0/2463330472 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3178034190 msgr2=0x7f3178036640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.082+0000 7f3248714680 1 --2- 172.21.15.153:0/2463330472 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3178034190 0x7f3178036640 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x55ac5f099660 tx=0x7f3234037710 comp rx=0 tx=0).stop 2023-10-05T21:15:20.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.082+0000 7f3248714680 1 -- 172.21.15.153:0/2463330472 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5f0a41d0 msgr2=0x55ac5f0a9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.082+0000 7f3248714680 1 --2- 172.21.15.153:0/2463330472 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5f0a41d0 0x55ac5f0a9d10 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x55ac5f09e940 tx=0x7f3230030000 comp rx=0 tx=0).stop 2023-10-05T21:15:20.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.083+0000 7f3248714680 1 -- 172.21.15.153:0/2463330472 shutdown_connections 2023-10-05T21:15:20.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.083+0000 7f3248714680 1 --2- 172.21.15.153:0/2463330472 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ac5f10e590 0x55ac5f110970 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.083+0000 7f3248714680 1 --2- 172.21.15.153:0/2463330472 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ac5f0a41d0 0x55ac5f0a9d10 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.083+0000 7f3248714680 1 --2- 172.21.15.153:0/2463330472 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3178034190 0x7f3178036640 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.083+0000 7f3248714680 1 -- 172.21.15.153:0/2463330472 >> 172.21.15.153:0/2463330472 conn(0x55ac5f09f3d0 msgr2=0x55ac5f09d500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:20.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.083+0000 7f3248714680 1 -- 172.21.15.153:0/2463330472 shutdown_connections 2023-10-05T21:15:20.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.083+0000 7f3248714680 1 -- 172.21.15.153:0/2463330472 wait complete. 2023-10-05T21:15:20.133 DEBUG:tasks.util.rgw: json result: {'bucket_id': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1', 'bucket_owner': 'foo', 'bucket': 'myfoo', 'log_entries': [{'bucket': 'myfoo', 'time': '2023-10-05T21:15:15.574040Z', 'time_local': '2023-10-05T21:15:15.574040+0000', 'remote_addr': '172.21.0.51', 'user': 'foo', 'operation': 'create_bucket', 'uri': 'PUT /myfoo/ HTTP/1.1', 'http_status': '200', 'error_code': '', 'bytes_sent': 0, 'bytes_received': 0, 'object_size': 0, 'total_time': 6, 'user_agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic', 'referrer': '', 'trans_id': 'tx0000078ca8e5f1169889a-00651f2763-107c-default', 'authentication_type': 'Local', 'access_key_id': '9te6NH5mcdcq0Tc5i8i1', 'temp_url': False}, {'bucket': 'myfoo', 'time': '2023-10-05T21:15:16.271028Z', 'time_local': '2023-10-05T21:15:16.271028+0000', 'remote_addr': '172.21.0.51', 'user': 'foo', 'operation': 'put_obj', 'uri': 'PUT /myfoo/f97c5d29941bfb1b2fdab0874906ab82 HTTP/1.1', 'http_status': '200', 'error_code': '', 'bytes_sent': 0, 'bytes_received': 3, 'object_size': 3, 'total_time': 3, 'user_agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic', 'referrer': '', 'trans_id': 'tx00000516f511f00b1aa16-00651f2764-107c-default', 'authentication_type': 'Local', 'access_key_id': '9te6NH5mcdcq0Tc5i8i1', 'temp_url': False}, {'bucket': 'myfoo', 'time': '2023-10-05T21:15:16.542023Z', 'time_local': '2023-10-05T21:15:16.542023+0000', 'remote_addr': '172.21.0.51', 'user': 'foo', 'operation': 'delete_obj', 'uri': 'DELETE /myfoo/f97c5d29941bfb1b2fdab0874906ab82 HTTP/1.1', 'http_status': '204', 'error_code': 'NoContent', 'bytes_sent': 0, 'bytes_received': 0, 'object_size': 0, 'total_time': 2, 'user_agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic', 'referrer': '', 'trans_id': 'tx00000cc71bf92cdecba0a-00651f2764-107c-default', 'authentication_type': 'Local', 'access_key_id': '9te6NH5mcdcq0Tc5i8i1', 'temp_url': False}, {'bucket': 'myfoo', 'time': '2023-10-05T21:15:16.857017Z', 'time_local': '2023-10-05T21:15:16.857017+0000', 'remote_addr': '172.21.0.51', 'user': 'foo', 'operation': 'put_obj', 'uri': 'PUT /myfoo/b8a9f715dbb64fd5c56e7783c6820a61 HTTP/1.1', 'http_status': '200', 'error_code': '', 'bytes_sent': 0, 'bytes_received': 3, 'object_size': 3, 'total_time': 1, 'user_agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic', 'referrer': '', 'trans_id': 'tx0000043ad8b035e4e03e1-00651f2764-107c-default', 'authentication_type': 'Local', 'access_key_id': '9te6NH5mcdcq0Tc5i8i1', 'temp_url': False}, {'bucket': 'myfoo', 'time': '2023-10-05T21:15:16.861017Z', 'time_local': '2023-10-05T21:15:16.861017+0000', 'remote_addr': '172.21.0.51', 'user': 'foo', 'operation': 'delete_obj', 'uri': 'DELETE /myfoo/b8a9f715dbb64fd5c56e7783c6820a61 HTTP/1.1', 'http_status': '204', 'error_code': 'NoContent', 'bytes_sent': 0, 'bytes_received': 0, 'object_size': 0, 'total_time': 1, 'user_agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic', 'referrer': '', 'trans_id': 'tx00000fdde6b42b33220e8-00651f2764-107c-default', 'authentication_type': 'Local', 'access_key_id': '9te6NH5mcdcq0Tc5i8i1', 'temp_url': False}, {'bucket': 'myfoo', 'time': '2023-10-05T21:15:18.467989Z', 'time_local': '2023-10-05T21:15:18.467989+0000', 'remote_addr': '172.21.0.51', 'user': 'foo', 'operation': 'put_obj', 'uri': 'PUT /myfoo/four HTTP/1.1', 'http_status': '200', 'error_code': '', 'bytes_sent': 0, 'bytes_received': 4, 'object_size': 4, 'total_time': 2, 'user_agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic', 'referrer': '', 'trans_id': 'tx0000059417fed5166e54d-00651f2766-107c-default', 'authentication_type': 'Local', 'access_key_id': '9te6NH5mcdcq0Tc5i8i1', 'temp_url': False}, {'bucket': 'myfoo', 'time': '2023-10-05T21:15:18.471989Z', 'time_local': '2023-10-05T21:15:18.471989+0000', 'remote_addr': '172.21.0.51', 'object_owner': 'foo', 'user': 'foo', 'operation': 'get_obj', 'uri': 'GET /myfoo/four HTTP/1.1', 'http_status': '200', 'error_code': '', 'bytes_sent': 4, 'bytes_received': 0, 'object_size': 4, 'total_time': 0, 'user_agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic', 'referrer': '', 'trans_id': 'tx00000a297f94cc482e994-00651f2766-107c-default', 'authentication_type': 'Local', 'access_key_id': '9te6NH5mcdcq0Tc5i8i1', 'temp_url': False}, {'bucket': 'myfoo', 'time': '2023-10-05T21:15:18.473989Z', 'time_local': '2023-10-05T21:15:18.473989+0000', 'remote_addr': '172.21.0.51', 'user': 'foo', 'operation': 'list_bucket', 'uri': 'GET /myfoo/ HTTP/1.1', 'http_status': '200', 'error_code': '', 'bytes_sent': 515, 'bytes_received': 0, 'object_size': 0, 'total_time': 1, 'user_agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic', 'referrer': '', 'trans_id': 'tx00000b6fa9e98a39caa75-00651f2766-107c-default', 'authentication_type': 'Local', 'access_key_id': '9te6NH5mcdcq0Tc5i8i1', 'temp_url': False}], 'log_sum': {'bytes_sent': 519, 'bytes_received': 10, 'total_time': 16, 'total_entries': 8}} 2023-10-05T21:15:20.133 DEBUG:tasks.radosgw_admin:checking log entry: 2023-10-05T21:15:20.133 DEBUG:tasks.radosgw_admin:checking log entry: 2023-10-05T21:15:20.133 DEBUG:tasks.radosgw_admin:checking log entry: 2023-10-05T21:15:20.133 DEBUG:tasks.radosgw_admin:checking log entry: 2023-10-05T21:15:20.133 DEBUG:tasks.radosgw_admin:checking log entry: 2023-10-05T21:15:20.133 DEBUG:tasks.radosgw_admin:checking log entry: 2023-10-05T21:15:20.134 DEBUG:tasks.radosgw_admin:checking log entry: 2023-10-05T21:15:20.134 DEBUG:tasks.radosgw_admin:checking log entry: 2023-10-05T21:15:20.134 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'rm', '--object', '2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1-myfoo'] 2023-10-05T21:15:20.134 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'rm', '--object', '2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1-myfoo'] 2023-10-05T21:15:20.134 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log rm --object 2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1-myfoo 2023-10-05T21:15:20.178 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:20.178 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:20.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.176+0000 7f8760441680 1 Processor -- start 2023-10-05T21:15:20.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.177+0000 7f8760441680 1 -- start start 2023-10-05T21:15:20.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.177+0000 7f8760441680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55b3d1930bb0 0x55b3d1932f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.177+0000 7f8760441680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b3d1877990 con 0x55b3d189e930 2023-10-05T21:15:20.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.177+0000 7f8760441680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b3d1837db0 con 0x55b3d1930bb0 2023-10-05T21:15:20.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.177+0000 7f8752d18700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55b3d1930bb0 0x55b3d1932f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.177+0000 7f8753519700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55b3d189e930 0x55b3d192f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:55344/0 (socket says 172.21.15.153:55344) 2023-10-05T21:15:20.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.177+0000 7f8753519700 1 -- 172.21.15.153:0/291520755 learned_addr learned my addr 172.21.15.153:0/291520755 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:20.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.177+0000 7f8752d18700 1 -- 172.21.15.153:0/291520755 >> v1:172.21.15.111:6789/0 conn(0x55b3d189e930 legacy=0x55b3d192f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.177+0000 7f8752d18700 1 -- 172.21.15.153:0/291520755 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3d19344e0 con 0x55b3d1930bb0 2023-10-05T21:15:20.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.177+0000 7f8752517700 1 -- 172.21.15.153:0/291520755 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3285574396 0 0) 0x55b3d1877990 con 0x55b3d189e930 2023-10-05T21:15:20.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.177+0000 7f8752d18700 1 --2- 172.21.15.153:0/291520755 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d1930bb0 0x55b3d1932f90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f874400a5d0 tx=0x7f8744005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0292f9c5f474891 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.178+0000 7f8752517700 1 -- 172.21.15.153:0/291520755 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87440086a0 con 0x55b3d1930bb0 2023-10-05T21:15:20.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.178+0000 7f8752517700 1 -- 172.21.15.153:0/291520755 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8744008800 con 0x55b3d1930bb0 2023-10-05T21:15:20.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.178+0000 7f8752517700 1 -- 172.21.15.153:0/291520755 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8744008ad0 con 0x55b3d1930bb0 2023-10-05T21:15:20.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.178+0000 7f8760441680 1 -- 172.21.15.153:0/291520755 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d1930bb0 msgr2=0x55b3d1932f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.178+0000 7f8760441680 1 --2- 172.21.15.153:0/291520755 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d1930bb0 0x55b3d1932f90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f874400a5d0 tx=0x7f8744005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:20.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.178+0000 7f8760441680 1 -- 172.21.15.153:0/291520755 shutdown_connections 2023-10-05T21:15:20.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.178+0000 7f8760441680 1 --2- 172.21.15.153:0/291520755 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d1930bb0 0x55b3d1932f90 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.178+0000 7f8760441680 1 -- 172.21.15.153:0/291520755 >> 172.21.15.153:0/291520755 conn(0x55b3d1924b80 msgr2=0x55b3d1926f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:20.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.178+0000 7f8760441680 1 -- 172.21.15.153:0/291520755 shutdown_connections 2023-10-05T21:15:20.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.178+0000 7f8760441680 1 -- 172.21.15.153:0/291520755 wait complete. 2023-10-05T21:15:20.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.179+0000 7f8760441680 1 Processor -- start 2023-10-05T21:15:20.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.179+0000 7f8760441680 1 -- start start 2023-10-05T21:15:20.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.179+0000 7f8760441680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d189e930 0x55b3d194b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.179+0000 7f8760441680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3d17d7ea0 con 0x55b3d189e930 2023-10-05T21:15:20.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.179+0000 7f8753519700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d189e930 0x55b3d194b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.179+0000 7f8753519700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d189e930 0x55b3d194b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38434/0 (socket says 172.21.15.153:38434) 2023-10-05T21:15:20.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.179+0000 7f8753519700 1 -- 172.21.15.153:0/446389798 learned_addr learned my addr 172.21.15.153:0/446389798 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:20.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.179+0000 7f8753519700 1 -- 172.21.15.153:0/446389798 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8744005cf0 con 0x55b3d189e930 2023-10-05T21:15:20.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.180+0000 7f8753519700 1 --2- 172.21.15.153:0/446389798 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d189e930 0x55b3d194b960 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f8748001d70 tx=0x7f8748001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd52eca9a9163688 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.180+0000 7f8751515700 1 -- 172.21.15.153:0/446389798 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f874800bcc0 con 0x55b3d189e930 2023-10-05T21:15:20.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.180+0000 7f8751515700 1 -- 172.21.15.153:0/446389798 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874800be20 con 0x55b3d189e930 2023-10-05T21:15:20.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.180+0000 7f8751515700 1 -- 172.21.15.153:0/446389798 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f874800e5f0 con 0x55b3d189e930 2023-10-05T21:15:20.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.180+0000 7f8760441680 1 -- 172.21.15.153:0/446389798 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d189e930 msgr2=0x55b3d194b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.180+0000 7f8760441680 1 --2- 172.21.15.153:0/446389798 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d189e930 0x55b3d194b960 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f8748001d70 tx=0x7f8748001770 comp rx=0 tx=0).stop 2023-10-05T21:15:20.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.180+0000 7f8760441680 1 -- 172.21.15.153:0/446389798 shutdown_connections 2023-10-05T21:15:20.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.180+0000 7f8760441680 1 --2- 172.21.15.153:0/446389798 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d189e930 0x55b3d194b960 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.180+0000 7f8760441680 1 -- 172.21.15.153:0/446389798 >> 172.21.15.153:0/446389798 conn(0x55b3d1924b80 msgr2=0x55b3d1947430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:20.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.180+0000 7f8760441680 1 -- 172.21.15.153:0/446389798 shutdown_connections 2023-10-05T21:15:20.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.180+0000 7f8760441680 1 -- 172.21.15.153:0/446389798 wait complete. 2023-10-05T21:15:20.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.180+0000 7f8760441680 1 Processor -- start 2023-10-05T21:15:20.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.181+0000 7f8760441680 1 -- start start 2023-10-05T21:15:20.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.181+0000 7f8760441680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d189e930 0x55b3d1952e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.181+0000 7f8760441680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3d17cec80 con 0x55b3d189e930 2023-10-05T21:15:20.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.181+0000 7f8753519700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d189e930 0x55b3d1952e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.181+0000 7f8753519700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d189e930 0x55b3d1952e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38446/0 (socket says 172.21.15.153:38446) 2023-10-05T21:15:20.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.181+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 learned_addr learned my addr 172.21.15.153:0/734263102 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:20.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.181+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8748001a50 con 0x55b3d189e930 2023-10-05T21:15:20.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.181+0000 7f8753519700 1 --2- 172.21.15.153:0/734263102 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d189e930 0x55b3d1952e10 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f87480017b0 tx=0x7f8748016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.181+0000 7f87437fe700 1 -- 172.21.15.153:0/734263102 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f874801f070 con 0x55b3d189e930 2023-10-05T21:15:20.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.182+0000 7f87437fe700 1 -- 172.21.15.153:0/734263102 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874801a2e0 con 0x55b3d189e930 2023-10-05T21:15:20.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.182+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b3d1953350 con 0x55b3d189e930 2023-10-05T21:15:20.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.182+0000 7f87437fe700 1 -- 172.21.15.153:0/734263102 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f874801a650 con 0x55b3d189e930 2023-10-05T21:15:20.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.182+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b3d19537a0 con 0x55b3d189e930 2023-10-05T21:15:20.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.182+0000 7f87437fe700 1 -- 172.21.15.153:0/734263102 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f874801a7b0 con 0x55b3d189e930 2023-10-05T21:15:20.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.182+0000 7f8760441680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.183+0000 7f87437fe700 1 --2- 172.21.15.153:0/734263102 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8738034140 0x7f87380365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.183+0000 7f87437fe700 1 -- 172.21.15.153:0/734263102 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f8748048f80 con 0x55b3d189e930 2023-10-05T21:15:20.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.183+0000 7f8752d18700 1 --2- 172.21.15.153:0/734263102 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8738034140 0x7f87380365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.183+0000 7f8760441680 1 --2- 172.21.15.153:0/734263102 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55b3d1930bb0 0x55b3d195eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.183+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d195f2f0 con 0x55b3d1930bb0 2023-10-05T21:15:20.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.183+0000 7f8753d1a700 1 --2- 172.21.15.153:0/734263102 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55b3d1930bb0 0x55b3d195eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.183+0000 7f8752d18700 1 --2- 172.21.15.153:0/734263102 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8738034140 0x7f87380365f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8744003080 tx=0x7f8744015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.183+0000 7f8753d1a700 1 --2- 172.21.15.153:0/734263102 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55b3d1930bb0 0x55b3d195eb60 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.183+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.183+0000 7f8760441680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.184+0000 7f8760441680 20 realm 2023-10-05T21:15:20.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.184+0000 7f8760441680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.184+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d195c180 con 0x55b3d1930bb0 2023-10-05T21:15:20.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.184+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.184+0000 7f8760441680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.184+0000 7f8760441680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:20.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.184+0000 7f8760441680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.184+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d195fdf0 con 0x55b3d1930bb0 2023-10-05T21:15:20.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.184+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.184+0000 7f8760441680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.184+0000 7f8760441680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.184+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1960710 con 0x55b3d1930bb0 2023-10-05T21:15:20.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.184+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.184+0000 7f8760441680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:20.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.184+0000 7f8760441680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.184+0000 7f8760441680 1 --2- 172.21.15.153:0/734263102 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b3d1960fd0 0x55b3d19633b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.184+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1963a00 con 0x55b3d1960fd0 2023-10-05T21:15:20.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.184+0000 7f8753519700 1 --2- 172.21.15.153:0/734263102 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b3d1960fd0 0x55b3d19633b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.185+0000 7f8753519700 1 --2- 172.21.15.153:0/734263102 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b3d1960fd0 0x55b3d19633b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.185+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f8748014070 con 0x55b3d1960fd0 2023-10-05T21:15:20.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.185+0000 7f8760441680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:20.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.185+0000 7f8760441680 20 searching for the correct realm 2023-10-05T21:15:20.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.185+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965570 con 0x55b3d1960fd0 2023-10-05T21:15:20.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.185+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8748014070 con 0x55b3d1960fd0 2023-10-05T21:15:20.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.185+0000 7f8753519700 1 --2- 172.21.15.153:0/734263102 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f874800d750 0x7f8748017430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.185+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f874803e040 con 0x7f874800d750 2023-10-05T21:15:20.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.185+0000 7f8752d18700 1 --2- 172.21.15.153:0/734263102 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f874800d750 0x7f8748017430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.186+0000 7f8752d18700 1 --2- 172.21.15.153:0/734263102 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f874800d750 0x7f8748017430 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.186+0000 7f8752d18700 1 -- 172.21.15.153:0/734263102 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8744019040 con 0x7f874800d750 2023-10-05T21:15:20.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.186+0000 7f8752d18700 1 --2- 172.21.15.153:0/734263102 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f8744007030 0x7f874401d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.186+0000 7f8752d18700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f874803e040 con 0x7f8744007030 2023-10-05T21:15:20.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.186+0000 7f8753d1a700 1 --2- 172.21.15.153:0/734263102 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f8744007030 0x7f874401d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.186+0000 7f8753d1a700 1 --2- 172.21.15.153:0/734263102 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f8744007030 0x7f874401d420 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.187+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874c00a570 con 0x7f8744007030 2023-10-05T21:15:20.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.187+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f874803e040 con 0x55b3d1930bb0 2023-10-05T21:15:20.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.187+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.187+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f874803e040 con 0x55b3d1930bb0 2023-10-05T21:15:20.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.187+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.187+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f874803e040 con 0x7f8744007030 2023-10-05T21:15:20.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.187+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874c00a570 con 0x7f8744007030 2023-10-05T21:15:20.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.187+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f874803e040 con 0x7f8744007030 2023-10-05T21:15:20.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.188+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874c00a570 con 0x7f8744007030 2023-10-05T21:15:20.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.188+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f874803e040 con 0x7f874800d750 2023-10-05T21:15:20.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.188+0000 7f8752d18700 1 -- 172.21.15.153:0/734263102 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8744019040 con 0x7f874800d750 2023-10-05T21:15:20.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.188+0000 7f8752d18700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f874803e040 con 0x55b3d1960fd0 2023-10-05T21:15:20.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.188+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f8748014070 con 0x55b3d1960fd0 2023-10-05T21:15:20.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.188+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f874803e040 con 0x55b3d1930bb0 2023-10-05T21:15:20.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.188+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.188+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f874803e040 con 0x7f8744007030 2023-10-05T21:15:20.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.188+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874c00a570 con 0x7f8744007030 2023-10-05T21:15:20.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.189+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f874803e040 con 0x55b3d1930bb0 2023-10-05T21:15:20.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.189+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.189+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f874803e040 con 0x7f874800d750 2023-10-05T21:15:20.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.189+0000 7f8752d18700 1 -- 172.21.15.153:0/734263102 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8744019040 con 0x7f874800d750 2023-10-05T21:15:20.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.189+0000 7f8752d18700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f874803e040 con 0x55b3d1960fd0 2023-10-05T21:15:20.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.189+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8748014070 con 0x55b3d1960fd0 2023-10-05T21:15:20.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.189+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f874803e040 con 0x55b3d1960fd0 2023-10-05T21:15:20.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.189+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8748014070 con 0x55b3d1960fd0 2023-10-05T21:15:20.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.189+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f874803e040 con 0x7f8744007030 2023-10-05T21:15:20.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.190+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874c00a570 con 0x7f8744007030 2023-10-05T21:15:20.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.190+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f874803e040 con 0x55b3d1960fd0 2023-10-05T21:15:20.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.190+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8748014070 con 0x55b3d1960fd0 2023-10-05T21:15:20.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.190+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f874803e040 con 0x55b3d1960fd0 2023-10-05T21:15:20.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.190+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8748014070 con 0x55b3d1960fd0 2023-10-05T21:15:20.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.190+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f874803e040 con 0x55b3d1930bb0 2023-10-05T21:15:20.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.190+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.191+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f874803e040 con 0x55b3d1930bb0 2023-10-05T21:15:20.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.191+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.191+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f874803e040 con 0x7f8744007030 2023-10-05T21:15:20.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.191+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874c00a570 con 0x7f8744007030 2023-10-05T21:15:20.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.191+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f874803e040 con 0x55b3d1960fd0 2023-10-05T21:15:20.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.191+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8748014070 con 0x55b3d1960fd0 2023-10-05T21:15:20.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.191+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f874803e040 con 0x7f874800d750 2023-10-05T21:15:20.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.192+0000 7f8752d18700 1 -- 172.21.15.153:0/734263102 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8744019040 con 0x7f874800d750 2023-10-05T21:15:20.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.192+0000 7f8752d18700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f874803e040 con 0x55b3d1930bb0 2023-10-05T21:15:20.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.192+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.192+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f874803e040 con 0x7f8744007030 2023-10-05T21:15:20.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.192+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874c00a570 con 0x7f8744007030 2023-10-05T21:15:20.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.192+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f874803e040 con 0x55b3d1960fd0 2023-10-05T21:15:20.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.192+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8748014070 con 0x55b3d1960fd0 2023-10-05T21:15:20.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.192+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f874803e040 con 0x7f8744007030 2023-10-05T21:15:20.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.192+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874c00a570 con 0x7f8744007030 2023-10-05T21:15:20.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.192+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f874803e040 con 0x7f874800d750 2023-10-05T21:15:20.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.193+0000 7f8752d18700 1 -- 172.21.15.153:0/734263102 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8744019040 con 0x7f874800d750 2023-10-05T21:15:20.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.193+0000 7f8752d18700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f874803e040 con 0x55b3d1960fd0 2023-10-05T21:15:20.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.193+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8748014070 con 0x55b3d1960fd0 2023-10-05T21:15:20.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.193+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f874803e040 con 0x7f8744007030 2023-10-05T21:15:20.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.193+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874c00a570 con 0x7f8744007030 2023-10-05T21:15:20.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.193+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f874803e040 con 0x55b3d1930bb0 2023-10-05T21:15:20.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.193+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.193+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f874803e040 con 0x7f874800d750 2023-10-05T21:15:20.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.194+0000 7f8752d18700 1 -- 172.21.15.153:0/734263102 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8744019040 con 0x7f874800d750 2023-10-05T21:15:20.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.194+0000 7f8760441680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:20.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.194+0000 7f8760441680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:20.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.194+0000 7f8760441680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:20.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.194+0000 7f8760441680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:20.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.194+0000 7f8760441680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.194+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d19644c0 con 0x55b3d1930bb0 2023-10-05T21:15:20.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.194+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.194+0000 7f8760441680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.194+0000 7f8760441680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.194+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d19648c0 con 0x55b3d1930bb0 2023-10-05T21:15:20.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.194+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.194+0000 7f8760441680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:20.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.194+0000 7f8760441680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.194+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965a00 con 0x55b3d1930bb0 2023-10-05T21:15:20.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.194+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.194+0000 7f8760441680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:20.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.194+0000 7f8760441680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.194+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965db0 con 0x55b3d1960fd0 2023-10-05T21:15:20.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.195+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f8748014070 con 0x55b3d1960fd0 2023-10-05T21:15:20.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.195+0000 7f8760441680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.195+0000 7f8760441680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.195+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1966160 con 0x55b3d1930bb0 2023-10-05T21:15:20.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.195+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.195+0000 7f8760441680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.195+0000 7f8760441680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.195+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1966160 con 0x55b3d1930bb0 2023-10-05T21:15:20.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.195+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.195+0000 7f8760441680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:20.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.195+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1966160 con 0x55b3d1960fd0 2023-10-05T21:15:20.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.195+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8748014070 con 0x55b3d1960fd0 2023-10-05T21:15:20.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.195+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1966160 con 0x7f874800d750 2023-10-05T21:15:20.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.195+0000 7f8752d18700 1 -- 172.21.15.153:0/734263102 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8744019040 con 0x7f874800d750 2023-10-05T21:15:20.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.195+0000 7f8752d18700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1966160 con 0x7f8744007030 2023-10-05T21:15:20.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.196+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874c00a570 con 0x7f8744007030 2023-10-05T21:15:20.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.196+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965a00 con 0x55b3d1930bb0 2023-10-05T21:15:20.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.196+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.196+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965a00 con 0x55b3d1930bb0 2023-10-05T21:15:20.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.196+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.196+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965a00 con 0x7f8744007030 2023-10-05T21:15:20.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.196+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874c00a570 con 0x7f8744007030 2023-10-05T21:15:20.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.196+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965a00 con 0x7f8744007030 2023-10-05T21:15:20.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.197+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874c00a570 con 0x7f8744007030 2023-10-05T21:15:20.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.197+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965a00 con 0x7f874800d750 2023-10-05T21:15:20.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.197+0000 7f8752d18700 1 -- 172.21.15.153:0/734263102 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8744019040 con 0x7f874800d750 2023-10-05T21:15:20.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.197+0000 7f8752d18700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965a00 con 0x55b3d1960fd0 2023-10-05T21:15:20.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.197+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f8748014070 con 0x55b3d1960fd0 2023-10-05T21:15:20.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.197+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965a00 con 0x55b3d1930bb0 2023-10-05T21:15:20.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.197+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.197+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965a00 con 0x7f8744007030 2023-10-05T21:15:20.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.197+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874c00a570 con 0x7f8744007030 2023-10-05T21:15:20.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.198+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965a00 con 0x55b3d1930bb0 2023-10-05T21:15:20.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.198+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.198+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965a00 con 0x7f874800d750 2023-10-05T21:15:20.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.198+0000 7f8752d18700 1 -- 172.21.15.153:0/734263102 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8744019040 con 0x7f874800d750 2023-10-05T21:15:20.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.198+0000 7f8752d18700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965a00 con 0x55b3d1960fd0 2023-10-05T21:15:20.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.198+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8748014070 con 0x55b3d1960fd0 2023-10-05T21:15:20.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.198+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965a00 con 0x55b3d1960fd0 2023-10-05T21:15:20.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.198+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8748014070 con 0x55b3d1960fd0 2023-10-05T21:15:20.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.198+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965a00 con 0x7f8744007030 2023-10-05T21:15:20.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.199+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874c00a570 con 0x7f8744007030 2023-10-05T21:15:20.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.199+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965a00 con 0x55b3d1960fd0 2023-10-05T21:15:20.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.199+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8748014070 con 0x55b3d1960fd0 2023-10-05T21:15:20.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.199+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965a00 con 0x55b3d1960fd0 2023-10-05T21:15:20.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.199+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8748014070 con 0x55b3d1960fd0 2023-10-05T21:15:20.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.199+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965a00 con 0x55b3d1930bb0 2023-10-05T21:15:20.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.199+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.199+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965a00 con 0x55b3d1930bb0 2023-10-05T21:15:20.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.200+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.200+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965a00 con 0x7f8744007030 2023-10-05T21:15:20.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.200+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874c00a570 con 0x7f8744007030 2023-10-05T21:15:20.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.200+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965a00 con 0x55b3d1960fd0 2023-10-05T21:15:20.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.200+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8748014070 con 0x55b3d1960fd0 2023-10-05T21:15:20.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.200+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965a00 con 0x7f874800d750 2023-10-05T21:15:20.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.200+0000 7f8752d18700 1 -- 172.21.15.153:0/734263102 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8744019040 con 0x7f874800d750 2023-10-05T21:15:20.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.200+0000 7f8752d18700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965a00 con 0x55b3d1930bb0 2023-10-05T21:15:20.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.200+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.200+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965a00 con 0x7f8744007030 2023-10-05T21:15:20.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.201+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874c00a570 con 0x7f8744007030 2023-10-05T21:15:20.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.201+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965a00 con 0x55b3d1960fd0 2023-10-05T21:15:20.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.201+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8748014070 con 0x55b3d1960fd0 2023-10-05T21:15:20.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.201+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965a00 con 0x7f8744007030 2023-10-05T21:15:20.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.201+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874c00a570 con 0x7f8744007030 2023-10-05T21:15:20.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.201+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965a00 con 0x7f874800d750 2023-10-05T21:15:20.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.201+0000 7f8752d18700 1 -- 172.21.15.153:0/734263102 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8744019040 con 0x7f874800d750 2023-10-05T21:15:20.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.201+0000 7f8752d18700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965a00 con 0x55b3d1960fd0 2023-10-05T21:15:20.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.202+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8748014070 con 0x55b3d1960fd0 2023-10-05T21:15:20.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.202+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965a00 con 0x7f8744007030 2023-10-05T21:15:20.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.202+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874c00a570 con 0x7f8744007030 2023-10-05T21:15:20.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.202+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965a00 con 0x55b3d1930bb0 2023-10-05T21:15:20.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.202+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.202+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1965a00 con 0x7f874800d750 2023-10-05T21:15:20.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.202+0000 7f8752d18700 1 -- 172.21.15.153:0/734263102 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8744019040 con 0x7f874800d750 2023-10-05T21:15:20.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.202+0000 7f8760441680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:20.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.202+0000 7f8760441680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:20.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.202+0000 7f8760441680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:20.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.202+0000 7f8760441680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:20.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.202+0000 7f8760441680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.202+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1966160 con 0x55b3d1930bb0 2023-10-05T21:15:20.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.203+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.203+0000 7f8760441680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:20.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.203+0000 7f8760441680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.203+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1966560 con 0x55b3d1960fd0 2023-10-05T21:15:20.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.203+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f8748014070 con 0x55b3d1960fd0 2023-10-05T21:15:20.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.203+0000 7f8760441680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:20.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.203+0000 7f8760441680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.203+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1966e00 con 0x55b3d1930bb0 2023-10-05T21:15:20.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.203+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.203+0000 7f8760441680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:20.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.203+0000 7f8760441680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.203+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1966e00 con 0x55b3d1930bb0 2023-10-05T21:15:20.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.203+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.203+0000 7f8760441680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:20.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.203+0000 7f8760441680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.203+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1966e00 con 0x7f8744007030 2023-10-05T21:15:20.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.204+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f874c00a570 con 0x7f8744007030 2023-10-05T21:15:20.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.204+0000 7f8760441680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.204+0000 7f8760441680 20 zone default found 2023-10-05T21:15:20.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.204+0000 7f8760441680 4 Realm: () 2023-10-05T21:15:20.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.204+0000 7f8760441680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:20.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.204+0000 7f8760441680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:20.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.204+0000 7f8760441680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:20.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.204+0000 7f8760441680 20 zonegroup default 2023-10-05T21:15:20.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.204+0000 7f8760441680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.204+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1966e00 con 0x7f8744007030 2023-10-05T21:15:20.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.204+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f874c00a570 con 0x7f8744007030 2023-10-05T21:15:20.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.204+0000 7f8760441680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.204+0000 7f8760441680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.204+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1968780 con 0x55b3d1960fd0 2023-10-05T21:15:20.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.204+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8748014070 con 0x55b3d1960fd0 2023-10-05T21:15:20.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.204+0000 7f8760441680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.204+0000 7f8760441680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.204+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1968b30 con 0x55b3d1960fd0 2023-10-05T21:15:20.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.204+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8748014070 con 0x55b3d1960fd0 2023-10-05T21:15:20.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.204+0000 7f8760441680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.204+0000 7f8760441680 20 started sync module instance, tier type = 2023-10-05T21:15:20.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.204+0000 7f8760441680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:20.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.204+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1967e40 con 0x7f874800d750 2023-10-05T21:15:20.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.205+0000 7f8752d18700 1 -- 172.21.15.153:0/734263102 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8744019040 con 0x7f874800d750 2023-10-05T21:15:20.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.205+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94230803808832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d19693d0 con 0x7f874800d750 2023-10-05T21:15:20.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.205+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1969c70 con 0x55b3d1930bb0 2023-10-05T21:15:20.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.206+0000 7f8752d18700 1 -- 172.21.15.153:0/734263102 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94230803808832] v29'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8744019040 con 0x7f874800d750 2023-10-05T21:15:20.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.206+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.206+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94230803814272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d196a0c0 con 0x55b3d1930bb0 2023-10-05T21:15:20.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.206+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d196a960 con 0x55b3d1960fd0 2023-10-05T21:15:20.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.207+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94230803814272] v29'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.207+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8748014070 con 0x55b3d1960fd0 2023-10-05T21:15:20.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.207+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94230803815696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d196ad60 con 0x55b3d1960fd0 2023-10-05T21:15:20.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.207+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d196b770 con 0x7f874800d750 2023-10-05T21:15:20.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.208+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94230803815696] v29'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8748014070 con 0x55b3d1960fd0 2023-10-05T21:15:20.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.208+0000 7f8752d18700 1 -- 172.21.15.153:0/734263102 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8744019040 con 0x7f874800d750 2023-10-05T21:15:20.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.208+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94230803821184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d196bb20 con 0x7f874800d750 2023-10-05T21:15:20.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.208+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d196c530 con 0x55b3d1930bb0 2023-10-05T21:15:20.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.208+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.208+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94230803825264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d196cd30 con 0x55b3d1930bb0 2023-10-05T21:15:20.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.208+0000 7f8752d18700 1 -- 172.21.15.153:0/734263102 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94230803821184] v29'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8744019040 con 0x7f874800d750 2023-10-05T21:15:20.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.208+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d196a180 con 0x7f8744007030 2023-10-05T21:15:20.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.209+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94230803825264] v29'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.209+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f874c00a570 con 0x7f8744007030 2023-10-05T21:15:20.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.209+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94230803826496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d196ccf0 con 0x7f8744007030 2023-10-05T21:15:20.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.209+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d196df10 con 0x7f8744007030 2023-10-05T21:15:20.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.210+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94230803826496] v29'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f874c00a570 con 0x7f8744007030 2023-10-05T21:15:20.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.210+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f874c00a570 con 0x7f8744007030 2023-10-05T21:15:20.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.210+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94230803829696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d196df10 con 0x7f8744007030 2023-10-05T21:15:20.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.210+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d196e920 con 0x7f8744007030 2023-10-05T21:15:20.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.211+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94230803829696] v29'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f874c00a570 con 0x7f8744007030 2023-10-05T21:15:20.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.211+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f874c00a570 con 0x7f8744007030 2023-10-05T21:15:20.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.211+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94230803831920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d196e920 con 0x7f8744007030 2023-10-05T21:15:20.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.211+0000 7f8760441680 20 add_watcher() i=0 2023-10-05T21:15:20.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.211+0000 7f8760441680 20 add_watcher() i=1 2023-10-05T21:15:20.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.211+0000 7f8760441680 20 add_watcher() i=2 2023-10-05T21:15:20.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.211+0000 7f8760441680 20 add_watcher() i=3 2023-10-05T21:15:20.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.211+0000 7f8760441680 20 add_watcher() i=4 2023-10-05T21:15:20.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.211+0000 7f8760441680 20 add_watcher() i=5 2023-10-05T21:15:20.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.211+0000 7f8760441680 20 add_watcher() i=6 2023-10-05T21:15:20.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.211+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94230803831920] v29'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f874c00a570 con 0x7f8744007030 2023-10-05T21:15:20.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.211+0000 7f8760441680 20 add_watcher() i=7 2023-10-05T21:15:20.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.211+0000 7f8760441680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:20.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.211+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1971d30 con 0x55b3d1930bb0 2023-10-05T21:15:20.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.212+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.212+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94230803834368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d196f1f0 con 0x55b3d1930bb0 2023-10-05T21:15:20.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.212+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94230803834368] v29'166 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.212+0000 7f869ffff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:20.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.213+0000 7f8760441680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:20.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.213+0000 7f8760441680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:20.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.213+0000 7f8760441680 1 Processor -- start 2023-10-05T21:15:20.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.213+0000 7f8760441680 1 -- start start 2023-10-05T21:15:20.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.213+0000 7f8760441680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d197b9c0 0x55b3d197bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.213+0000 7f8760441680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3d197c3e0 con 0x55b3d197b9c0 2023-10-05T21:15:20.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.213+0000 7f8752d18700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d197b9c0 0x55b3d197bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.213+0000 7f8752d18700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d197b9c0 0x55b3d197bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38448/0 (socket says 172.21.15.153:38448) 2023-10-05T21:15:20.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.213+0000 7f8752d18700 1 -- 172.21.15.153:0/2114429451 learned_addr learned my addr 172.21.15.153:0/2114429451 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:20.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.214+0000 7f8752d18700 1 -- 172.21.15.153:0/2114429451 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3d197c8c0 con 0x55b3d197b9c0 2023-10-05T21:15:20.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.214+0000 7f8752d18700 1 --2- 172.21.15.153:0/2114429451 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d197b9c0 0x55b3d197bdd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x55b3d192af50 tx=0x7f8744012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26422e92ed30cb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.214+0000 7f869f7fe700 1 -- 172.21.15.153:0/2114429451 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f874401ddc0 con 0x55b3d197b9c0 2023-10-05T21:15:20.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.214+0000 7f869f7fe700 1 -- 172.21.15.153:0/2114429451 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874402b450 con 0x55b3d197b9c0 2023-10-05T21:15:20.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.214+0000 7f869f7fe700 1 -- 172.21.15.153:0/2114429451 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f874402b5e0 con 0x55b3d197b9c0 2023-10-05T21:15:20.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.214+0000 7f8760441680 1 -- 172.21.15.153:0/2114429451 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d197b9c0 msgr2=0x55b3d197bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.215+0000 7f8760441680 1 --2- 172.21.15.153:0/2114429451 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d197b9c0 0x55b3d197bdd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x55b3d192af50 tx=0x7f8744012000 comp rx=0 tx=0).stop 2023-10-05T21:15:20.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.215+0000 7f8760441680 1 -- 172.21.15.153:0/2114429451 shutdown_connections 2023-10-05T21:15:20.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.215+0000 7f8760441680 1 --2- 172.21.15.153:0/2114429451 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d197b9c0 0x55b3d197bdd0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.215+0000 7f8760441680 1 -- 172.21.15.153:0/2114429451 >> 172.21.15.153:0/2114429451 conn(0x55b3d1977cc0 msgr2=0x55b3d1975dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:20.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.215+0000 7f8760441680 1 -- 172.21.15.153:0/2114429451 shutdown_connections 2023-10-05T21:15:20.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.215+0000 7f8760441680 1 -- 172.21.15.153:0/2114429451 wait complete. 2023-10-05T21:15:20.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.215+0000 7f8760441680 1 Processor -- start 2023-10-05T21:15:20.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.215+0000 7f8760441680 1 -- start start 2023-10-05T21:15:20.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.215+0000 7f8760441680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d197b9c0 0x55b3d1982680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.215+0000 7f8760441680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3d1982bc0 con 0x55b3d197b9c0 2023-10-05T21:15:20.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.215+0000 7f8752d18700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d197b9c0 0x55b3d1982680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.215+0000 7f8752d18700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d197b9c0 0x55b3d1982680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38450/0 (socket says 172.21.15.153:38450) 2023-10-05T21:15:20.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.215+0000 7f8752d18700 1 -- 172.21.15.153:0/579527847 learned_addr learned my addr 172.21.15.153:0/579527847 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:20.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.216+0000 7f8752d18700 1 -- 172.21.15.153:0/579527847 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3d19344e0 con 0x55b3d197b9c0 2023-10-05T21:15:20.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.216+0000 7f8752d18700 1 --2- 172.21.15.153:0/579527847 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d197b9c0 0x55b3d1982680 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x55b3d1977230 tx=0x7f8744031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.216+0000 7f869dffb700 1 -- 172.21.15.153:0/579527847 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8744037840 con 0x55b3d197b9c0 2023-10-05T21:15:20.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.216+0000 7f869dffb700 1 -- 172.21.15.153:0/579527847 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87440379c0 con 0x55b3d197b9c0 2023-10-05T21:15:20.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.216+0000 7f8760441680 1 -- 172.21.15.153:0/579527847 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b3d1982dc0 con 0x55b3d197b9c0 2023-10-05T21:15:20.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.216+0000 7f869dffb700 1 -- 172.21.15.153:0/579527847 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8744037cb0 con 0x55b3d197b9c0 2023-10-05T21:15:20.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.216+0000 7f8760441680 1 -- 172.21.15.153:0/579527847 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b3d1983210 con 0x55b3d197b9c0 2023-10-05T21:15:20.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.217+0000 7f869dffb700 1 -- 172.21.15.153:0/579527847 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f8744026040 con 0x55b3d197b9c0 2023-10-05T21:15:20.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.217+0000 7f869dffb700 1 --2- 172.21.15.153:0/579527847 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8690034140 0x7f86900365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.217+0000 7f869dffb700 1 -- 172.21.15.153:0/579527847 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f8744031070 con 0x55b3d197b9c0 2023-10-05T21:15:20.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.217+0000 7f8760441680 5 note: GC not initialized 2023-10-05T21:15:20.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.217+0000 7f8753d1a700 1 --2- 172.21.15.153:0/579527847 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8690034140 0x7f86900365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.217+0000 7f8753d1a700 1 --2- 172.21.15.153:0/579527847 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8690034140 0x7f86900365f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55b3d196ea80 tx=0x7f874c037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.218+0000 7f8696ffd700 20 reqs_thread_entry: start 2023-10-05T21:15:20.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.218+0000 7f8694ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:20.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.218+0000 7f8760441680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:20.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.218+0000 7f8760441680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:20.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.218+0000 7f8682ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:50 2023 2023-10-05T21:15:20.252 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:20.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.218+0000 7f86827fc700 20 reqs_thread_entry: start 2023-10-05T21:15:20.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.218+0000 7f8760441680 1 --2- 172.21.15.153:0/579527847 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b3d19e7020 0x55b3d19e9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.218+0000 7f8760441680 1 -- 172.21.15.153:0/579527847 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:1 6.1b 6:dfe7776a:::2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1-myfoo:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d19e9940 con 0x55b3d19e7020 2023-10-05T21:15:20.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.218+0000 7f8753519700 1 --2- 172.21.15.153:0/579527847 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b3d19e7020 0x55b3d19e9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.219+0000 7f8753519700 1 --2- 172.21.15.153:0/579527847 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b3d19e7020 0x55b3d19e9400 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.220+0000 7f8753519700 1 -- 172.21.15.153:0/579527847 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(1 2023-10-05-21-193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1-myfoo [delete] v29'22 uv22 ondisk = 0) v8 ==== 207+0+0 (crc 0 0 0) 0x7f8748014070 con 0x55b3d19e7020 2023-10-05T21:15:20.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.220+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94230803808832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d19a6720 con 0x7f874800d750 2023-10-05T21:15:20.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.220+0000 7f8752d18700 1 -- 172.21.15.153:0/734263102 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(102 notify.0 [watch unwatch cookie 94230803808832] v29'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8744046070 con 0x7f874800d750 2023-10-05T21:15:20.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.220+0000 7f8760441680 20 remove_watcher() i=0 2023-10-05T21:15:20.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.220+0000 7f8760441680 2 removed watcher, disabling cache 2023-10-05T21:15:20.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.220+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94230803814272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1968240 con 0x55b3d1930bb0 2023-10-05T21:15:20.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.221+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(103 notify.1 [watch unwatch cookie 94230803814272] v29'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.221+0000 7f8760441680 20 remove_watcher() i=1 2023-10-05T21:15:20.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.221+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:104 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94230803815696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1968240 con 0x55b3d1960fd0 2023-10-05T21:15:20.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.222+0000 7f8753519700 1 -- 172.21.15.153:0/734263102 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(104 notify.2 [watch unwatch cookie 94230803815696] v29'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8748014070 con 0x55b3d1960fd0 2023-10-05T21:15:20.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.222+0000 7f8760441680 20 remove_watcher() i=2 2023-10-05T21:15:20.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.222+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94230803821184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1969d10 con 0x7f874800d750 2023-10-05T21:15:20.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.223+0000 7f8752d18700 1 -- 172.21.15.153:0/734263102 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(105 notify.3 [watch unwatch cookie 94230803821184] v29'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8744046070 con 0x7f874800d750 2023-10-05T21:15:20.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.223+0000 7f8760441680 20 remove_watcher() i=3 2023-10-05T21:15:20.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.223+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94230803825264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1968240 con 0x55b3d1930bb0 2023-10-05T21:15:20.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.224+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(106 notify.4 [watch unwatch cookie 94230803825264] v29'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.224+0000 7f8760441680 20 remove_watcher() i=4 2023-10-05T21:15:20.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.224+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:107 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94230803826496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1969d10 con 0x7f8744007030 2023-10-05T21:15:20.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.224+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(107 notify.5 [watch unwatch cookie 94230803826496] v29'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f874c00a570 con 0x7f8744007030 2023-10-05T21:15:20.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.224+0000 7f8760441680 20 remove_watcher() i=5 2023-10-05T21:15:20.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.224+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94230803829696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d196c270 con 0x7f8744007030 2023-10-05T21:15:20.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.225+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(108 notify.6 [watch unwatch cookie 94230803829696] v29'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f874c00a570 con 0x7f8744007030 2023-10-05T21:15:20.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.225+0000 7f8760441680 20 remove_watcher() i=6 2023-10-05T21:15:20.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.225+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94230803831920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1968240 con 0x7f8744007030 2023-10-05T21:15:20.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.226+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(109 notify.7 [watch unwatch cookie 94230803831920] v29'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f874c00a570 con 0x7f8744007030 2023-10-05T21:15:20.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.226+0000 7f8760441680 20 remove_watcher() i=7 2023-10-05T21:15:20.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.226+0000 7f869ffff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:20.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.227+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:110 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94230803834368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b3d1968240 con 0x55b3d1930bb0 2023-10-05T21:15:20.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.227+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(110 data_loggenerations_metadata [watch unwatch cookie 94230803834368] v29'167 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f874c00a570 con 0x55b3d1930bb0 2023-10-05T21:15:20.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.227+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f8744007030 msgr2=0x7f874401d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.227+0000 7f8760441680 1 --2- 172.21.15.153:0/734263102 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f8744007030 0x7f874401d420 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.227+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55b3d1930bb0 msgr2=0x55b3d195eb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.227+0000 7f8760441680 1 --2- 172.21.15.153:0/734263102 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55b3d1930bb0 0x55b3d195eb60 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.227+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f874800d750 msgr2=0x7f8748017430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.227+0000 7f8760441680 1 --2- 172.21.15.153:0/734263102 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f874800d750 0x7f8748017430 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.227+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b3d1960fd0 msgr2=0x55b3d19633b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.227+0000 7f8760441680 1 --2- 172.21.15.153:0/734263102 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b3d1960fd0 0x55b3d19633b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.227+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8738034140 msgr2=0x7f87380365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.227+0000 7f8760441680 1 --2- 172.21.15.153:0/734263102 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8738034140 0x7f87380365f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8744003080 tx=0x7f8744015000 comp rx=0 tx=0).stop 2023-10-05T21:15:20.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.227+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d189e930 msgr2=0x55b3d1952e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.227+0000 7f8753d1a700 1 -- 172.21.15.153:0/734263102 reap_dead start 2023-10-05T21:15:20.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.227+0000 7f8760441680 1 --2- 172.21.15.153:0/734263102 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d189e930 0x55b3d1952e10 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f87480017b0 tx=0x7f8748016000 comp rx=0 tx=0).stop 2023-10-05T21:15:20.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.227+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 shutdown_connections 2023-10-05T21:15:20.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.228+0000 7f8760441680 1 --2- 172.21.15.153:0/734263102 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d189e930 0x55b3d1952e10 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.228+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 >> 172.21.15.153:0/734263102 conn(0x55b3d1924b80 msgr2=0x55b3d1945c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:20.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.228+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 shutdown_connections 2023-10-05T21:15:20.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.228+0000 7f8760441680 1 -- 172.21.15.153:0/734263102 wait complete. 2023-10-05T21:15:20.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.228+0000 7f8760441680 1 -- 172.21.15.153:0/579527847 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b3d19e7020 msgr2=0x55b3d19e9400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.228+0000 7f8760441680 1 --2- 172.21.15.153:0/579527847 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b3d19e7020 0x55b3d19e9400 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.228+0000 7f8760441680 1 -- 172.21.15.153:0/579527847 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8690034140 msgr2=0x7f86900365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.228+0000 7f8760441680 1 --2- 172.21.15.153:0/579527847 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8690034140 0x7f86900365f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55b3d196ea80 tx=0x7f874c037450 comp rx=0 tx=0).stop 2023-10-05T21:15:20.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.228+0000 7f8760441680 1 -- 172.21.15.153:0/579527847 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d197b9c0 msgr2=0x55b3d1982680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.228+0000 7f8760441680 1 --2- 172.21.15.153:0/579527847 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d197b9c0 0x55b3d1982680 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x55b3d1977230 tx=0x7f8744031000 comp rx=0 tx=0).stop 2023-10-05T21:15:20.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.228+0000 7f8760441680 1 -- 172.21.15.153:0/579527847 shutdown_connections 2023-10-05T21:15:20.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.228+0000 7f8760441680 1 --2- 172.21.15.153:0/579527847 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b3d19e7020 0x55b3d19e9400 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.228+0000 7f8760441680 1 --2- 172.21.15.153:0/579527847 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b3d197b9c0 0x55b3d1982680 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.228+0000 7f8760441680 1 --2- 172.21.15.153:0/579527847 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8690034140 0x7f86900365f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.228+0000 7f8760441680 1 -- 172.21.15.153:0/579527847 >> 172.21.15.153:0/579527847 conn(0x55b3d1977cc0 msgr2=0x55b3d1975d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:20.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.228+0000 7f8760441680 1 -- 172.21.15.153:0/579527847 shutdown_connections 2023-10-05T21:15:20.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.228+0000 7f8760441680 1 -- 172.21.15.153:0/579527847 wait complete. 2023-10-05T21:15:20.258 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2023-10-05T21:15:20.258 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2023-10-05T21:15:20.258 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2023-10-05T21:15:20.302 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:20.302 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:20.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.301+0000 7f008ddc4680 1 Processor -- start 2023-10-05T21:15:20.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.301+0000 7f008ddc4680 1 -- start start 2023-10-05T21:15:20.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.301+0000 7f008ddc4680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x557a50f0fbb0 0x557a50f11f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.301+0000 7f008ddc4680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557a50e56990 con 0x557a50e7d0a0 2023-10-05T21:15:20.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.301+0000 7f008ddc4680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x557a50e16db0 con 0x557a50f0fbb0 2023-10-05T21:15:20.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.301+0000 7f007bfff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x557a50f0fbb0 0x557a50f11f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.301+0000 7f0080e9c700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x557a50e7d0a0 0x557a50f0e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:55346/0 (socket says 172.21.15.153:55346) 2023-10-05T21:15:20.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.301+0000 7f0080e9c700 1 -- 172.21.15.153:0/375174080 learned_addr learned my addr 172.21.15.153:0/375174080 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:20.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.301+0000 7f007b7fe700 1 -- 172.21.15.153:0/375174080 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569014239 0 0) 0x557a50e56990 con 0x557a50e7d0a0 2023-10-05T21:15:20.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.301+0000 7f007b7fe700 1 -- 172.21.15.153:0/375174080 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0070001e10 con 0x557a50e7d0a0 2023-10-05T21:15:20.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.301+0000 7f007bfff700 1 -- 172.21.15.153:0/375174080 >> v1:172.21.15.111:6789/0 conn(0x557a50e7d0a0 legacy=0x557a50f0e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.301+0000 7f007bfff700 1 -- 172.21.15.153:0/375174080 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a50f134e0 con 0x557a50f0fbb0 2023-10-05T21:15:20.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.302+0000 7f007bfff700 1 --2- 172.21.15.153:0/375174080 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557a50f0fbb0 0x557a50f11f90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f006c00a5d0 tx=0x7f006c005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f5b855165e3387 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.302+0000 7f007b7fe700 1 -- 172.21.15.153:0/375174080 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f006c007610 con 0x557a50f0fbb0 2023-10-05T21:15:20.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.302+0000 7f007b7fe700 1 -- 172.21.15.153:0/375174080 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c007770 con 0x557a50f0fbb0 2023-10-05T21:15:20.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.302+0000 7f007b7fe700 1 -- 172.21.15.153:0/375174080 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f006c007a40 con 0x557a50f0fbb0 2023-10-05T21:15:20.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.302+0000 7f008ddc4680 1 -- 172.21.15.153:0/375174080 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557a50f0fbb0 msgr2=0x557a50f11f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.302+0000 7f008ddc4680 1 --2- 172.21.15.153:0/375174080 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557a50f0fbb0 0x557a50f11f90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f006c00a5d0 tx=0x7f006c005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:20.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.302+0000 7f008ddc4680 1 -- 172.21.15.153:0/375174080 shutdown_connections 2023-10-05T21:15:20.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.302+0000 7f008ddc4680 1 --2- 172.21.15.153:0/375174080 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557a50f0fbb0 0x557a50f11f90 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.302+0000 7f008ddc4680 1 -- 172.21.15.153:0/375174080 >> 172.21.15.153:0/375174080 conn(0x557a50f03b80 msgr2=0x557a50f05f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:20.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.302+0000 7f008ddc4680 1 -- 172.21.15.153:0/375174080 shutdown_connections 2023-10-05T21:15:20.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.302+0000 7f008ddc4680 1 -- 172.21.15.153:0/375174080 wait complete. 2023-10-05T21:15:20.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.303+0000 7f008ddc4680 1 Processor -- start 2023-10-05T21:15:20.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.303+0000 7f008ddc4680 1 -- start start 2023-10-05T21:15:20.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.303+0000 7f008ddc4680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557a50e7d0a0 0x557a50f2a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.303+0000 7f008ddc4680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a50db6ea0 con 0x557a50e7d0a0 2023-10-05T21:15:20.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.304+0000 7f0080e9c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557a50e7d0a0 0x557a50f2a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.304+0000 7f0080e9c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557a50e7d0a0 0x557a50f2a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38476/0 (socket says 172.21.15.153:38476) 2023-10-05T21:15:20.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.304+0000 7f0080e9c700 1 -- 172.21.15.153:0/3859408806 learned_addr learned my addr 172.21.15.153:0/3859408806 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:20.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.304+0000 7f0080e9c700 1 -- 172.21.15.153:0/3859408806 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006c005cf0 con 0x557a50e7d0a0 2023-10-05T21:15:20.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.304+0000 7f0080e9c700 1 --2- 172.21.15.153:0/3859408806 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557a50e7d0a0 0x557a50f2a8c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0074001c40 tx=0x7f00740017f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52fbfb036e4ab53b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.304+0000 7f007a7fc700 1 -- 172.21.15.153:0/3859408806 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f007400bbf0 con 0x557a50e7d0a0 2023-10-05T21:15:20.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.304+0000 7f007a7fc700 1 -- 172.21.15.153:0/3859408806 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007400bd70 con 0x557a50e7d0a0 2023-10-05T21:15:20.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.304+0000 7f007a7fc700 1 -- 172.21.15.153:0/3859408806 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f007400e5f0 con 0x557a50e7d0a0 2023-10-05T21:15:20.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.305+0000 7f008ddc4680 1 -- 172.21.15.153:0/3859408806 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557a50e7d0a0 msgr2=0x557a50f2a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.305+0000 7f008ddc4680 1 --2- 172.21.15.153:0/3859408806 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557a50e7d0a0 0x557a50f2a8c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0074001c40 tx=0x7f00740017f0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.305+0000 7f008ddc4680 1 -- 172.21.15.153:0/3859408806 shutdown_connections 2023-10-05T21:15:20.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.305+0000 7f008ddc4680 1 --2- 172.21.15.153:0/3859408806 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557a50e7d0a0 0x557a50f2a8c0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.305+0000 7f008ddc4680 1 -- 172.21.15.153:0/3859408806 >> 172.21.15.153:0/3859408806 conn(0x557a50f03b80 msgr2=0x557a50f26390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:20.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.305+0000 7f008ddc4680 1 -- 172.21.15.153:0/3859408806 shutdown_connections 2023-10-05T21:15:20.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.305+0000 7f008ddc4680 1 -- 172.21.15.153:0/3859408806 wait complete. 2023-10-05T21:15:20.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.305+0000 7f008ddc4680 1 Processor -- start 2023-10-05T21:15:20.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.305+0000 7f008ddc4680 1 -- start start 2023-10-05T21:15:20.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.306+0000 7f008ddc4680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557a50e7d0a0 0x557a50f31d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.306+0000 7f008ddc4680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a50dadc80 con 0x557a50e7d0a0 2023-10-05T21:15:20.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.306+0000 7f0080e9c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557a50e7d0a0 0x557a50f31d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.306+0000 7f0080e9c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557a50e7d0a0 0x557a50f31d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38484/0 (socket says 172.21.15.153:38484) 2023-10-05T21:15:20.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.306+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 learned_addr learned my addr 172.21.15.153:0/2829432543 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:20.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.306+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0070001e10 con 0x557a50e7d0a0 2023-10-05T21:15:20.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.306+0000 7f0080e9c700 1 --2- 172.21.15.153:0/2829432543 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557a50e7d0a0 0x557a50f31d90 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x557a50f2b660 tx=0x7f0074016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.306+0000 7f0078ff9700 1 -- 172.21.15.153:0/2829432543 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f007401f070 con 0x557a50e7d0a0 2023-10-05T21:15:20.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.306+0000 7f0078ff9700 1 -- 172.21.15.153:0/2829432543 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0074018640 con 0x557a50e7d0a0 2023-10-05T21:15:20.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.306+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557a50f322d0 con 0x557a50e7d0a0 2023-10-05T21:15:20.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.306+0000 7f0078ff9700 1 -- 172.21.15.153:0/2829432543 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0074018910 con 0x557a50e7d0a0 2023-10-05T21:15:20.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.306+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557a50f32720 con 0x557a50e7d0a0 2023-10-05T21:15:20.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.307+0000 7f0078ff9700 1 -- 172.21.15.153:0/2829432543 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f0074018a70 con 0x557a50e7d0a0 2023-10-05T21:15:20.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.307+0000 7f0078ff9700 1 --2- 172.21.15.153:0/2829432543 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0064034140 0x7f00640365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.307+0000 7f0078ff9700 1 -- 172.21.15.153:0/2829432543 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f0074048d00 con 0x557a50e7d0a0 2023-10-05T21:15:20.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.307+0000 7f007bfff700 1 --2- 172.21.15.153:0/2829432543 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0064034140 0x7f00640365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.308+0000 7f008ddc4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.308+0000 7f007bfff700 1 --2- 172.21.15.153:0/2829432543 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0064034140 0x7f00640365f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f006c00afd0 tx=0x7f006c014000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.308+0000 7f008ddc4680 1 --2- 172.21.15.153:0/2829432543 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x557a50f0fbb0 0x557a50f3da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.308+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f3e220 con 0x557a50f0fbb0 2023-10-05T21:15:20.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.308+0000 7f008169d700 1 --2- 172.21.15.153:0/2829432543 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x557a50f0fbb0 0x557a50f3da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.308+0000 7f008169d700 1 --2- 172.21.15.153:0/2829432543 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x557a50f0fbb0 0x557a50f3da90 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.308+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.308+0000 7f008ddc4680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.308+0000 7f008ddc4680 20 realm 2023-10-05T21:15:20.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.308+0000 7f008ddc4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.308+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f3b010 con 0x557a50f0fbb0 2023-10-05T21:15:20.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.309+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.309+0000 7f008ddc4680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.309+0000 7f008ddc4680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:20.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.309+0000 7f008ddc4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.309+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f3ecd0 con 0x557a50f0fbb0 2023-10-05T21:15:20.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.309+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.309+0000 7f008ddc4680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.309+0000 7f008ddc4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.309+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f3f5f0 con 0x557a50f0fbb0 2023-10-05T21:15:20.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.309+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.309+0000 7f008ddc4680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:20.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.309+0000 7f008ddc4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.309+0000 7f008ddc4680 1 --2- 172.21.15.153:0/2829432543 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x557a50f3feb0 0x557a50f42290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.309+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f428e0 con 0x557a50f3feb0 2023-10-05T21:15:20.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.309+0000 7f0080e9c700 1 --2- 172.21.15.153:0/2829432543 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x557a50f3feb0 0x557a50f42290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.310+0000 7f0080e9c700 1 --2- 172.21.15.153:0/2829432543 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x557a50f3feb0 0x557a50f42290 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.310+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f0074014070 con 0x557a50f3feb0 2023-10-05T21:15:20.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.310+0000 7f008ddc4680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:20.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.310+0000 7f008ddc4680 20 searching for the correct realm 2023-10-05T21:15:20.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.310+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x557a50f3feb0 2023-10-05T21:15:20.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.310+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0074014070 con 0x557a50f3feb0 2023-10-05T21:15:20.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.310+0000 7f0080e9c700 1 --2- 172.21.15.153:0/2829432543 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f0074016730 0x7f00740460c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.310+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x7f0074016730 2023-10-05T21:15:20.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.310+0000 7f007bfff700 1 --2- 172.21.15.153:0/2829432543 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f0074016730 0x7f00740460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.311+0000 7f007bfff700 1 --2- 172.21.15.153:0/2829432543 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f0074016730 0x7f00740460c0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.311+0000 7f007bfff700 1 -- 172.21.15.153:0/2829432543 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f006c0079b0 con 0x7f0074016730 2023-10-05T21:15:20.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.311+0000 7f007bfff700 1 --2- 172.21.15.153:0/2829432543 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f006c007030 0x7f006c01d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.311+0000 7f007bfff700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x7f006c007030 2023-10-05T21:15:20.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.311+0000 7f008169d700 1 --2- 172.21.15.153:0/2829432543 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f006c007030 0x7f006c01d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.311+0000 7f008169d700 1 --2- 172.21.15.153:0/2829432543 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f006c007030 0x7f006c01d430 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.311+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c00a570 con 0x7f006c007030 2023-10-05T21:15:20.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.312+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x557a50f0fbb0 2023-10-05T21:15:20.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.312+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.312+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x557a50f0fbb0 2023-10-05T21:15:20.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.312+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.312+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x7f006c007030 2023-10-05T21:15:20.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.312+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c00a570 con 0x7f006c007030 2023-10-05T21:15:20.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.312+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x7f006c007030 2023-10-05T21:15:20.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.312+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c00a570 con 0x7f006c007030 2023-10-05T21:15:20.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.312+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x7f0074016730 2023-10-05T21:15:20.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.313+0000 7f007bfff700 1 -- 172.21.15.153:0/2829432543 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f006c029040 con 0x7f0074016730 2023-10-05T21:15:20.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.313+0000 7f007bfff700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x557a50f3feb0 2023-10-05T21:15:20.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.313+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0074014070 con 0x557a50f3feb0 2023-10-05T21:15:20.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.313+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x557a50f0fbb0 2023-10-05T21:15:20.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.313+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.313+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x7f006c007030 2023-10-05T21:15:20.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.313+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c00a570 con 0x7f006c007030 2023-10-05T21:15:20.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.313+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x557a50f0fbb0 2023-10-05T21:15:20.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.313+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.313+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x7f0074016730 2023-10-05T21:15:20.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.314+0000 7f007bfff700 1 -- 172.21.15.153:0/2829432543 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f006c029040 con 0x7f0074016730 2023-10-05T21:15:20.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.314+0000 7f007bfff700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x557a50f3feb0 2023-10-05T21:15:20.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.314+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0074014070 con 0x557a50f3feb0 2023-10-05T21:15:20.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.314+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x557a50f3feb0 2023-10-05T21:15:20.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.314+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0074014070 con 0x557a50f3feb0 2023-10-05T21:15:20.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.314+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x7f006c007030 2023-10-05T21:15:20.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.314+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c00a570 con 0x7f006c007030 2023-10-05T21:15:20.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.314+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x557a50f3feb0 2023-10-05T21:15:20.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.314+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0074014070 con 0x557a50f3feb0 2023-10-05T21:15:20.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.314+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x557a50f3feb0 2023-10-05T21:15:20.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.315+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0074014070 con 0x557a50f3feb0 2023-10-05T21:15:20.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.315+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x557a50f0fbb0 2023-10-05T21:15:20.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.315+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.315+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x557a50f0fbb0 2023-10-05T21:15:20.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.315+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.315+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x7f006c007030 2023-10-05T21:15:20.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.315+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c00a570 con 0x7f006c007030 2023-10-05T21:15:20.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.315+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x557a50f3feb0 2023-10-05T21:15:20.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.315+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0074014070 con 0x557a50f3feb0 2023-10-05T21:15:20.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.315+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x7f0074016730 2023-10-05T21:15:20.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.316+0000 7f007bfff700 1 -- 172.21.15.153:0/2829432543 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f006c029040 con 0x7f0074016730 2023-10-05T21:15:20.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.316+0000 7f007bfff700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x557a50f0fbb0 2023-10-05T21:15:20.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.316+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.316+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x7f006c007030 2023-10-05T21:15:20.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.316+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c00a570 con 0x7f006c007030 2023-10-05T21:15:20.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.316+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x557a50f3feb0 2023-10-05T21:15:20.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.316+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0074014070 con 0x557a50f3feb0 2023-10-05T21:15:20.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.316+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x7f006c007030 2023-10-05T21:15:20.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.317+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c00a570 con 0x7f006c007030 2023-10-05T21:15:20.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.317+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x7f0074016730 2023-10-05T21:15:20.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.317+0000 7f007bfff700 1 -- 172.21.15.153:0/2829432543 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f006c029040 con 0x7f0074016730 2023-10-05T21:15:20.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.317+0000 7f007bfff700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x557a50f3feb0 2023-10-05T21:15:20.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.317+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0074014070 con 0x557a50f3feb0 2023-10-05T21:15:20.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.317+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x7f006c007030 2023-10-05T21:15:20.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.317+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c00a570 con 0x7f006c007030 2023-10-05T21:15:20.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.317+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x557a50f0fbb0 2023-10-05T21:15:20.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.318+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.318+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44410 con 0x7f0074016730 2023-10-05T21:15:20.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.318+0000 7f007bfff700 1 -- 172.21.15.153:0/2829432543 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f006c029040 con 0x7f0074016730 2023-10-05T21:15:20.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.318+0000 7f008ddc4680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:20.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.318+0000 7f008ddc4680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:20.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.318+0000 7f008ddc4680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:20.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.318+0000 7f008ddc4680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:20.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.318+0000 7f008ddc4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.318+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f43360 con 0x557a50f0fbb0 2023-10-05T21:15:20.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.318+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.318+0000 7f008ddc4680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.318+0000 7f008ddc4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.318+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f43760 con 0x557a50f0fbb0 2023-10-05T21:15:20.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.318+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.318+0000 7f008ddc4680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:20.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.318+0000 7f008ddc4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.318+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f448a0 con 0x557a50f0fbb0 2023-10-05T21:15:20.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.319+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.319+0000 7f008ddc4680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:20.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.319+0000 7f008ddc4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.319+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f44c50 con 0x557a50f3feb0 2023-10-05T21:15:20.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.319+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f0074014070 con 0x557a50f3feb0 2023-10-05T21:15:20.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.319+0000 7f008ddc4680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.319+0000 7f008ddc4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.319+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f45000 con 0x557a50f0fbb0 2023-10-05T21:15:20.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.319+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.319+0000 7f008ddc4680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.319+0000 7f008ddc4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.319+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f45000 con 0x557a50f0fbb0 2023-10-05T21:15:20.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.319+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.319+0000 7f008ddc4680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:20.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.319+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f45000 con 0x557a50f3feb0 2023-10-05T21:15:20.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.320+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0074014070 con 0x557a50f3feb0 2023-10-05T21:15:20.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.320+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f45000 con 0x7f0074016730 2023-10-05T21:15:20.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.320+0000 7f007bfff700 1 -- 172.21.15.153:0/2829432543 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f006c029040 con 0x7f0074016730 2023-10-05T21:15:20.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.320+0000 7f007bfff700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f45000 con 0x7f006c007030 2023-10-05T21:15:20.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.320+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c00a570 con 0x7f006c007030 2023-10-05T21:15:20.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.320+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f448a0 con 0x557a50f0fbb0 2023-10-05T21:15:20.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.320+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.320+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f448a0 con 0x557a50f0fbb0 2023-10-05T21:15:20.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.320+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.320+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f448a0 con 0x7f006c007030 2023-10-05T21:15:20.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.321+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c00a570 con 0x7f006c007030 2023-10-05T21:15:20.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.321+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f448a0 con 0x7f006c007030 2023-10-05T21:15:20.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.321+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c00a570 con 0x7f006c007030 2023-10-05T21:15:20.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.321+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f448a0 con 0x7f0074016730 2023-10-05T21:15:20.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.321+0000 7f007bfff700 1 -- 172.21.15.153:0/2829432543 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f006c029040 con 0x7f0074016730 2023-10-05T21:15:20.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.321+0000 7f007bfff700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f448a0 con 0x557a50f3feb0 2023-10-05T21:15:20.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.321+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0074014070 con 0x557a50f3feb0 2023-10-05T21:15:20.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.321+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f448a0 con 0x557a50f0fbb0 2023-10-05T21:15:20.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.322+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.322+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f448a0 con 0x7f006c007030 2023-10-05T21:15:20.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.322+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c00a570 con 0x7f006c007030 2023-10-05T21:15:20.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.322+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f448a0 con 0x557a50f0fbb0 2023-10-05T21:15:20.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.322+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.322+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f448a0 con 0x7f0074016730 2023-10-05T21:15:20.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.322+0000 7f007bfff700 1 -- 172.21.15.153:0/2829432543 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f006c029040 con 0x7f0074016730 2023-10-05T21:15:20.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.322+0000 7f007bfff700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f448a0 con 0x557a50f3feb0 2023-10-05T21:15:20.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.322+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0074014070 con 0x557a50f3feb0 2023-10-05T21:15:20.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.322+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f448a0 con 0x557a50f3feb0 2023-10-05T21:15:20.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.323+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0074014070 con 0x557a50f3feb0 2023-10-05T21:15:20.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.323+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f448a0 con 0x7f006c007030 2023-10-05T21:15:20.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.323+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c00a570 con 0x7f006c007030 2023-10-05T21:15:20.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.323+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f448a0 con 0x557a50f3feb0 2023-10-05T21:15:20.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.323+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0074014070 con 0x557a50f3feb0 2023-10-05T21:15:20.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.323+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f448a0 con 0x557a50f3feb0 2023-10-05T21:15:20.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.323+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0074014070 con 0x557a50f3feb0 2023-10-05T21:15:20.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.323+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f448a0 con 0x557a50f0fbb0 2023-10-05T21:15:20.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.324+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.324+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f448a0 con 0x557a50f0fbb0 2023-10-05T21:15:20.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.324+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.324+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f448a0 con 0x7f006c007030 2023-10-05T21:15:20.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.324+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c00a570 con 0x7f006c007030 2023-10-05T21:15:20.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.324+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f448a0 con 0x557a50f3feb0 2023-10-05T21:15:20.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.324+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0074014070 con 0x557a50f3feb0 2023-10-05T21:15:20.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.324+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f448a0 con 0x7f0074016730 2023-10-05T21:15:20.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.324+0000 7f007bfff700 1 -- 172.21.15.153:0/2829432543 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f006c029040 con 0x7f0074016730 2023-10-05T21:15:20.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.324+0000 7f007bfff700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f448a0 con 0x557a50f0fbb0 2023-10-05T21:15:20.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.325+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.325+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f448a0 con 0x7f006c007030 2023-10-05T21:15:20.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.325+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c00a570 con 0x7f006c007030 2023-10-05T21:15:20.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.325+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f448a0 con 0x557a50f3feb0 2023-10-05T21:15:20.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.325+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0074014070 con 0x557a50f3feb0 2023-10-05T21:15:20.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.325+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f448a0 con 0x7f006c007030 2023-10-05T21:15:20.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.325+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c00a570 con 0x7f006c007030 2023-10-05T21:15:20.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.325+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f448a0 con 0x7f0074016730 2023-10-05T21:15:20.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.326+0000 7f007bfff700 1 -- 172.21.15.153:0/2829432543 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f006c029040 con 0x7f0074016730 2023-10-05T21:15:20.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.326+0000 7f007bfff700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f448a0 con 0x557a50f3feb0 2023-10-05T21:15:20.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.326+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0074014070 con 0x557a50f3feb0 2023-10-05T21:15:20.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.326+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f448a0 con 0x7f006c007030 2023-10-05T21:15:20.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.326+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f007c00a570 con 0x7f006c007030 2023-10-05T21:15:20.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.326+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f448a0 con 0x557a50f0fbb0 2023-10-05T21:15:20.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.326+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.326+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f448a0 con 0x7f0074016730 2023-10-05T21:15:20.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.326+0000 7f007bfff700 1 -- 172.21.15.153:0/2829432543 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f006c029040 con 0x7f0074016730 2023-10-05T21:15:20.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.326+0000 7f008ddc4680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:20.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.326+0000 7f008ddc4680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:20.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.326+0000 7f008ddc4680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:20.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.326+0000 7f008ddc4680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:20.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.326+0000 7f008ddc4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.327+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f45000 con 0x557a50f0fbb0 2023-10-05T21:15:20.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.327+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.327+0000 7f008ddc4680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:20.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.327+0000 7f008ddc4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.327+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f45400 con 0x557a50f3feb0 2023-10-05T21:15:20.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.327+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f0074014070 con 0x557a50f3feb0 2023-10-05T21:15:20.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.327+0000 7f008ddc4680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:20.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.327+0000 7f008ddc4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.327+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f45cf0 con 0x557a50f0fbb0 2023-10-05T21:15:20.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.327+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.327+0000 7f008ddc4680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:20.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.327+0000 7f008ddc4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.327+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f45cf0 con 0x557a50f0fbb0 2023-10-05T21:15:20.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.327+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.327+0000 7f008ddc4680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:20.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.327+0000 7f008ddc4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.327+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f45cf0 con 0x7f006c007030 2023-10-05T21:15:20.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.328+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f007c00a570 con 0x7f006c007030 2023-10-05T21:15:20.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.328+0000 7f008ddc4680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.328+0000 7f008ddc4680 20 zone default found 2023-10-05T21:15:20.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.328+0000 7f008ddc4680 4 Realm: () 2023-10-05T21:15:20.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.328+0000 7f008ddc4680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:20.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.328+0000 7f008ddc4680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:20.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.328+0000 7f008ddc4680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:20.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.328+0000 7f008ddc4680 20 zonegroup default 2023-10-05T21:15:20.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.328+0000 7f008ddc4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.328+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f45cf0 con 0x7f006c007030 2023-10-05T21:15:20.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.328+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f007c00a570 con 0x7f006c007030 2023-10-05T21:15:20.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.328+0000 7f008ddc4680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.328+0000 7f008ddc4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.328+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f47670 con 0x557a50f3feb0 2023-10-05T21:15:20.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.328+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0074014070 con 0x557a50f3feb0 2023-10-05T21:15:20.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.328+0000 7f008ddc4680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.328+0000 7f008ddc4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.328+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f47a20 con 0x557a50f3feb0 2023-10-05T21:15:20.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.328+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0074014070 con 0x557a50f3feb0 2023-10-05T21:15:20.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.328+0000 7f008ddc4680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.329+0000 7f008ddc4680 20 started sync module instance, tier type = 2023-10-05T21:15:20.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.329+0000 7f008ddc4680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:20.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.329+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f46d80 con 0x7f0074016730 2023-10-05T21:15:20.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.329+0000 7f007bfff700 1 -- 172.21.15.153:0/2829432543 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f006c029040 con 0x7f0074016730 2023-10-05T21:15:20.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.329+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93983832568192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f483b0 con 0x7f0074016730 2023-10-05T21:15:20.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.329+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f48c50 con 0x557a50f0fbb0 2023-10-05T21:15:20.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.330+0000 7f007bfff700 1 -- 172.21.15.153:0/2829432543 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 93983832568192] v29'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f006c029040 con 0x7f0074016730 2023-10-05T21:15:20.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.330+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.330+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93983832573792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f48000 con 0x557a50f0fbb0 2023-10-05T21:15:20.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.330+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f498c0 con 0x557a50f3feb0 2023-10-05T21:15:20.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.331+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0074014070 con 0x557a50f3feb0 2023-10-05T21:15:20.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.331+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 93983832573792] v29'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.331+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93983832576848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f4a1b0 con 0x557a50f3feb0 2023-10-05T21:15:20.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.331+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f4aa50 con 0x7f0074016730 2023-10-05T21:15:20.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.332+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 93983832576848] v29'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0074014070 con 0x557a50f3feb0 2023-10-05T21:15:20.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.332+0000 7f007bfff700 1 -- 172.21.15.153:0/2829432543 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f006c029040 con 0x7f0074016730 2023-10-05T21:15:20.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.332+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 93983832581472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f4ae00 con 0x7f0074016730 2023-10-05T21:15:20.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.332+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f4b810 con 0x557a50f0fbb0 2023-10-05T21:15:20.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.332+0000 7f007bfff700 1 -- 172.21.15.153:0/2829432543 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 93983832581472] v29'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f006c029040 con 0x7f0074016730 2023-10-05T21:15:20.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.332+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.332+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 93983832584992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f4bc60 con 0x557a50f0fbb0 2023-10-05T21:15:20.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.333+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f4c670 con 0x7f006c007030 2023-10-05T21:15:20.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.333+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 93983832584992] v29'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.333+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f007c00a570 con 0x7f006c007030 2023-10-05T21:15:20.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.333+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 93983832586688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f4c670 con 0x7f006c007030 2023-10-05T21:15:20.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.333+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f4c670 con 0x7f006c007030 2023-10-05T21:15:20.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.334+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 93983832586688] v29'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f007c00a570 con 0x7f006c007030 2023-10-05T21:15:20.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.334+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f007c00a570 con 0x7f006c007030 2023-10-05T21:15:20.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.334+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93983832589232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f4d080 con 0x7f006c007030 2023-10-05T21:15:20.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.334+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f4da90 con 0x7f006c007030 2023-10-05T21:15:20.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.335+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 93983832589232] v29'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f007c00a570 con 0x7f006c007030 2023-10-05T21:15:20.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.335+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f007c00a570 con 0x7f006c007030 2023-10-05T21:15:20.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.335+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93983832591808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f4da90 con 0x7f006c007030 2023-10-05T21:15:20.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.335+0000 7f008ddc4680 20 add_watcher() i=0 2023-10-05T21:15:20.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.335+0000 7f008ddc4680 20 add_watcher() i=1 2023-10-05T21:15:20.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.335+0000 7f008ddc4680 20 add_watcher() i=2 2023-10-05T21:15:20.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.335+0000 7f008ddc4680 20 add_watcher() i=3 2023-10-05T21:15:20.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.335+0000 7f008ddc4680 20 add_watcher() i=4 2023-10-05T21:15:20.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.335+0000 7f008ddc4680 20 add_watcher() i=5 2023-10-05T21:15:20.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.335+0000 7f008ddc4680 20 add_watcher() i=6 2023-10-05T21:15:20.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.335+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 93983832591808] v29'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f007c00a570 con 0x7f006c007030 2023-10-05T21:15:20.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.335+0000 7f008ddc4680 20 add_watcher() i=7 2023-10-05T21:15:20.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.335+0000 7f008ddc4680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:20.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.335+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f50ed0 con 0x557a50f0fbb0 2023-10-05T21:15:20.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.336+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.336+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93983832594288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50f4e390 con 0x557a50f0fbb0 2023-10-05T21:15:20.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.336+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 93983832594288] v29'168 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.336+0000 7f0051fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:20.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.336+0000 7f008ddc4680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:20.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.336+0000 7f008ddc4680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:20.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.337+0000 7f008ddc4680 1 Processor -- start 2023-10-05T21:15:20.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.337+0000 7f008ddc4680 1 -- start start 2023-10-05T21:15:20.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.337+0000 7f008ddc4680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557a50f5ab30 0x557a50f5af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.337+0000 7f008ddc4680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a50f5b550 con 0x557a50f5ab30 2023-10-05T21:15:20.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.337+0000 7f007bfff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557a50f5ab30 0x557a50f5af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.337+0000 7f007bfff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557a50f5ab30 0x557a50f5af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38498/0 (socket says 172.21.15.153:38498) 2023-10-05T21:15:20.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.337+0000 7f007bfff700 1 -- 172.21.15.153:0/1393347601 learned_addr learned my addr 172.21.15.153:0/1393347601 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:20.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.337+0000 7f007bfff700 1 -- 172.21.15.153:0/1393347601 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a50f5ba30 con 0x557a50f5ab30 2023-10-05T21:15:20.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.337+0000 7f007bfff700 1 --2- 172.21.15.153:0/1393347601 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557a50f5ab30 0x557a50f5af40 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x557a50f09f50 tx=0x7f006c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe9dfd5a7290e80 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.338+0000 7f00517e2700 1 -- 172.21.15.153:0/1393347601 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f006c025040 con 0x557a50f5ab30 2023-10-05T21:15:20.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.338+0000 7f00517e2700 1 -- 172.21.15.153:0/1393347601 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c039450 con 0x557a50f5ab30 2023-10-05T21:15:20.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.338+0000 7f00517e2700 1 -- 172.21.15.153:0/1393347601 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f006c039740 con 0x557a50f5ab30 2023-10-05T21:15:20.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.338+0000 7f008ddc4680 1 -- 172.21.15.153:0/1393347601 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557a50f5ab30 msgr2=0x557a50f5af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.338+0000 7f008ddc4680 1 --2- 172.21.15.153:0/1393347601 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557a50f5ab30 0x557a50f5af40 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x557a50f09f50 tx=0x7f006c011000 comp rx=0 tx=0).stop 2023-10-05T21:15:20.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.338+0000 7f008ddc4680 1 -- 172.21.15.153:0/1393347601 shutdown_connections 2023-10-05T21:15:20.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.338+0000 7f008ddc4680 1 --2- 172.21.15.153:0/1393347601 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557a50f5ab30 0x557a50f5af40 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.338+0000 7f008ddc4680 1 -- 172.21.15.153:0/1393347601 >> 172.21.15.153:0/1393347601 conn(0x557a50f56e30 msgr2=0x557a50f54f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:20.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.338+0000 7f008ddc4680 1 -- 172.21.15.153:0/1393347601 shutdown_connections 2023-10-05T21:15:20.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.338+0000 7f008ddc4680 1 -- 172.21.15.153:0/1393347601 wait complete. 2023-10-05T21:15:20.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.339+0000 7f008ddc4680 1 Processor -- start 2023-10-05T21:15:20.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.339+0000 7f008ddc4680 1 -- start start 2023-10-05T21:15:20.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.339+0000 7f008ddc4680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557a50f5ab30 0x557a50f61810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.339+0000 7f008ddc4680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a50f61d50 con 0x557a50f5ab30 2023-10-05T21:15:20.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.339+0000 7f007bfff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557a50f5ab30 0x557a50f61810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.339+0000 7f007bfff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557a50f5ab30 0x557a50f61810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38512/0 (socket says 172.21.15.153:38512) 2023-10-05T21:15:20.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.339+0000 7f007bfff700 1 -- 172.21.15.153:0/965615322 learned_addr learned my addr 172.21.15.153:0/965615322 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:20.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.339+0000 7f007bfff700 1 -- 172.21.15.153:0/965615322 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a50f134e0 con 0x557a50f5ab30 2023-10-05T21:15:20.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.340+0000 7f007bfff700 1 --2- 172.21.15.153:0/965615322 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557a50f5ab30 0x557a50f61810 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x557a50f563a0 tx=0x7f006c039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.340+0000 7effcb7fe700 1 -- 172.21.15.153:0/965615322 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f006c025040 con 0x557a50f5ab30 2023-10-05T21:15:20.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.340+0000 7effcb7fe700 1 -- 172.21.15.153:0/965615322 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c047070 con 0x557a50f5ab30 2023-10-05T21:15:20.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.340+0000 7f008ddc4680 1 -- 172.21.15.153:0/965615322 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557a50f61f50 con 0x557a50f5ab30 2023-10-05T21:15:20.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.340+0000 7effcb7fe700 1 -- 172.21.15.153:0/965615322 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f006c04c5d0 con 0x557a50f5ab30 2023-10-05T21:15:20.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.340+0000 7f008ddc4680 1 -- 172.21.15.153:0/965615322 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557a50f62400 con 0x557a50f5ab30 2023-10-05T21:15:20.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.341+0000 7effcb7fe700 1 -- 172.21.15.153:0/965615322 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f006c049070 con 0x557a50f5ab30 2023-10-05T21:15:20.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.341+0000 7effcb7fe700 1 --2- 172.21.15.153:0/965615322 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7effc0034140 0x7effc00365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.341+0000 7effcb7fe700 1 -- 172.21.15.153:0/965615322 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f006c032030 con 0x557a50f5ab30 2023-10-05T21:15:20.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.341+0000 7f008169d700 1 --2- 172.21.15.153:0/965615322 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7effc0034140 0x7effc00365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.341+0000 7f008ddc4680 5 note: GC not initialized 2023-10-05T21:15:20.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.341+0000 7f008169d700 1 --2- 172.21.15.153:0/965615322 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7effc0034140 0x7effc00365f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x557a50f4dd00 tx=0x7f007c037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.342+0000 7effc8ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:20.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.342+0000 7effbe7fc700 20 reqs_thread_entry: start 2023-10-05T21:15:20.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.342+0000 7f008ddc4680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:20.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.342+0000 7f008ddc4680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:20.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.342+0000 7effbcff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:50 2023 2023-10-05T21:15:20.376 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:20.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.342+0000 7effa3fff700 20 reqs_thread_entry: start 2023-10-05T21:15:20.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.342+0000 7f008ddc4680 20 get_system_obj_state: rctx=0x7ffc0517c938 obj=default.rgw.meta:users.uid:foo state=0x557a50dbc240 s->prefetch_data=0 2023-10-05T21:15:20.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.342+0000 7f008ddc4680 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T21:15:20.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.342+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50fc70d0 con 0x557a50f0fbb0 2023-10-05T21:15:20.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.343+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.343+0000 7f008ddc4680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T21:15:20.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.343+0000 7f008ddc4680 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:20.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.343+0000 7f008ddc4680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:20.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.343+0000 7f008ddc4680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:20.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.343+0000 7f008ddc4680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:20.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.343+0000 7f008ddc4680 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:20.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.343+0000 7f008ddc4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.343+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50fc9650 con 0x557a50f0fbb0 2023-10-05T21:15:20.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.343+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.343+0000 7f008ddc4680 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T21:15:20.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.343+0000 7f008ddc4680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T21:15:20.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.343+0000 7f008ddc4680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:20.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.343+0000 7f008ddc4680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:20.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.343+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:104 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50fc9cd0 con 0x7f0074016730 2023-10-05T21:15:20.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.343+0000 7f007bfff700 1 -- 172.21.15.153:0/2829432543 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(104 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f006c03f020 con 0x7f0074016730 2023-10-05T21:15:20.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.343+0000 7f008ddc4680 20 disabling bucket name=myfoo 2023-10-05T21:15:20.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.343+0000 7f008ddc4680 20 get_system_obj_state: rctx=0x7ffc0517c120 obj=default.rgw.meta:root:myfoo state=0x557a50dbc240 s->prefetch_data=0 2023-10-05T21:15:20.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.343+0000 7f008ddc4680 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-10-05T21:15:20.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.343+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 8.9 8:91b71841:root::myfoo:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50fc7400 con 0x7f0074016730 2023-10-05T21:15:20.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.344+0000 7f007bfff700 1 -- 172.21.15.153:0/2829432543 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(105 myfoo [getxattrs out=75b,stat out=16b] v0'0 uv27 ondisk = 0) v8 ==== 191+0+91 (crc 0 0 0) 0x7f006c03f020 con 0x7f0074016730 2023-10-05T21:15:20.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.344+0000 7f008ddc4680 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x6 2023-10-05T21:15:20.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.344+0000 7f008ddc4680 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:20.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.344+0000 7f008ddc4680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:20.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.344+0000 7f008ddc4680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:20.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.344+0000 7f008ddc4680 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x1, cached=0x6) 2023-10-05T21:15:20.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.344+0000 7f008ddc4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.344+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:106 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50fc7830 con 0x7f0074016730 2023-10-05T21:15:20.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.344+0000 7f007bfff700 1 -- 172.21.15.153:0/2829432543 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(106 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+165 (crc 0 0 0) 0x7f006c03f020 con 0x7f0074016730 2023-10-05T21:15:20.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.344+0000 7f008ddc4680 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T21:15:20.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.344+0000 7f008ddc4680 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2023-10-05T21:15:20.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.344+0000 7f008ddc4680 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:20.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.344+0000 7f008ddc4680 20 get_system_obj_state: rctx=0x7ffc0517c120 obj=default.rgw.meta:root:.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 state=0x557a50dbc500 s->prefetch_data=0 2023-10-05T21:15:20.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.344+0000 7f008ddc4680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 : miss 2023-10-05T21:15:20.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.344+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50fc7cc0 con 0x557a50f3feb0 2023-10-05T21:15:20.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.344+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(107 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f0074014070 con 0x557a50f3feb0 2023-10-05T21:15:20.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.344+0000 7f008ddc4680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 info.flags=0x16 2023-10-05T21:15:20.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.344+0000 7f008ddc4680 10 adding default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 to cache LRU end 2023-10-05T21:15:20.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.344+0000 7f008ddc4680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:20.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.344+0000 7f008ddc4680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:20.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.344+0000 7f008ddc4680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:20.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.344+0000 7f008ddc4680 20 Read xattr: user.rgw.acl 2023-10-05T21:15:20.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.344+0000 7f008ddc4680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:20.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.344+0000 7f008ddc4680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:20.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.344+0000 7f008ddc4680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.344+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:108 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50fc87f0 con 0x557a50f3feb0 2023-10-05T21:15:20.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.345+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(108 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f0074014070 con 0x557a50f3feb0 2023-10-05T21:15:20.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.345+0000 7f008ddc4680 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T21:15:20.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.345+0000 7f008ddc4680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 info.flags=0x13 2023-10-05T21:15:20.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.345+0000 7f008ddc4680 10 moving default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 to cache LRU end 2023-10-05T21:15:20.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.345+0000 7f008ddc4680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:20.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.345+0000 7f008ddc4680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:20.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.345+0000 7f008ddc4680 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 2023-10-05T21:15:20.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.345+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:109 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50fd2dc0 con 0x557a50f3feb0 2023-10-05T21:15:20.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.346+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(109 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v29'6 uv6 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7f0074014070 con 0x557a50f3feb0 2023-10-05T21:15:20.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.346+0000 7f008ddc4680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 info.flags=0x17 2023-10-05T21:15:20.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.346+0000 7f008ddc4680 10 moving default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 to cache LRU end 2023-10-05T21:15:20.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.346+0000 7f008ddc4680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:20.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.346+0000 7f008ddc4680 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1, ofs0, ns] 2023-10-05T21:15:20.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.346+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:110 7.15 7:a93a5511:::notify.2:head [notify cookie 93983833140528 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50fd16c0 con 0x557a50f3feb0 2023-10-05T21:15:20.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.346+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== watch-notify(notify (1) cookie 93983832576848 notify 124554051595 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x557a50f32720 con 0x557a50f3feb0 2023-10-05T21:15:20.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.346+0000 7f007a7fc700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051595 cookie 93983832576848 notifier 4592 bl.length()=725 2023-10-05T21:15:20.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.346+0000 7f007a7fc700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 info.flags=0x17 2023-10-05T21:15:20.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.346+0000 7f007a7fc700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 to cache LRU end 2023-10-05T21:15:20.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.346+0000 7f007a7fc700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:20.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.346+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(110 notify.2 [notify cookie 93983833140528 out=8b] v0'0 uv183 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f0074014070 con 0x557a50f3feb0 2023-10-05T21:15:20.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.346+0000 7f007a7fc700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:111 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f0060003d90 con 0x557a50f3feb0 2023-10-05T21:15:20.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.347+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 31 ==== osd_op_reply(111 notify.2 [notify-ack] v0'0 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0074014070 con 0x557a50f3feb0 2023-10-05T21:15:20.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.347+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 32 ==== watch-notify(notify_complete (2) cookie 93983833140528 notify 124554051595 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557a50f322d0 con 0x557a50f3feb0 2023-10-05T21:15:20.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.347+0000 7f008ddc4680 20 handle_bi_update(): bucket=:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1]): orig_sources= new_sources= 2023-10-05T21:15:20.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.347+0000 7f008ddc4680 20 handle_bi_update(): bucket=:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1]): potential sources added=[] removed=[] 2023-10-05T21:15:20.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.347+0000 7f008ddc4680 20 handle_bi_update(): bucket=:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1]): orig_dests= new_dests= 2023-10-05T21:15:20.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.347+0000 7f008ddc4680 20 handle_bi_update(): bucket=:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1]): potential dests added=[] removed=[] 2023-10-05T21:15:20.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.347+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:112 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50fd2810 con 0x557a50f0fbb0 2023-10-05T21:15:20.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.347+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(112 foo [delete,create,call,writefull 0~357] v29'12 uv12 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.347+0000 7f008ddc4680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T21:15:20.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.347+0000 7f008ddc4680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:20.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.347+0000 7f008ddc4680 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T21:15:20.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.347+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:113 7.d 7:b4812045:::notify.4:head [notify cookie 93983833097440 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50fd2810 con 0x557a50f0fbb0 2023-10-05T21:15:20.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.348+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== watch-notify(notify (1) cookie 93983832584992 notify 124554051603 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x7f007c0291f0 con 0x557a50f0fbb0 2023-10-05T21:15:20.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.348+0000 7f0079ffb700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051603 cookie 93983832584992 notifier 4592 bl.length()=533 2023-10-05T21:15:20.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.348+0000 7f0079ffb700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T21:15:20.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.348+0000 7f0079ffb700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:20.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.348+0000 7f0079ffb700 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:114 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7effd0003440 con 0x557a50f0fbb0 2023-10-05T21:15:20.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.348+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(113 notify.4 [notify cookie 93983833097440 out=8b] v0'0 uv183 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.348+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(114 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.348+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== watch-notify(notify_complete (2) cookie 93983833097440 notify 124554051603 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f007c02d040 con 0x557a50f0fbb0 2023-10-05T21:15:20.385 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:20.385 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "foo", 2023-10-05T21:15:20.385 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Foo", 2023-10-05T21:15:20.385 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "foo@foo.com", 2023-10-05T21:15:20.385 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 1, 2023-10-05T21:15:20.385 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 4, 2023-10-05T21:15:20.386 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [], 2023-10-05T21:15:20.386 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2023-10-05T21:15:20.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:20.386 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:20.386 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:20.386 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T21:15:20.386 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:20.386 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:20.386 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [], 2023-10-05T21:15:20.386 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2023-10-05T21:15:20.386 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2023-10-05T21:15:20.387 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2023-10-05T21:15:20.387 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2023-10-05T21:15:20.387 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2023-10-05T21:15:20.387 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:15:20.387 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:20.387 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:20.387 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:20.387 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:20.387 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:20.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:20.387 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2023-10-05T21:15:20.387 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:20.388 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:20.388 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:20.388 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:20.388 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:20.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:20.388 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2023-10-05T21:15:20.388 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2023-10-05T21:15:20.388 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [] 2023-10-05T21:15:20.388 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:20.388 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:15:20.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.348+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:115 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93983832568192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50fd2810 con 0x7f0074016730 2023-10-05T21:15:20.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.349+0000 7f007bfff700 1 -- 172.21.15.153:0/2829432543 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(115 notify.0 [watch unwatch cookie 93983832568192] v29'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f006c03f020 con 0x7f0074016730 2023-10-05T21:15:20.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.349+0000 7f008ddc4680 20 remove_watcher() i=0 2023-10-05T21:15:20.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.349+0000 7f008ddc4680 2 removed watcher, disabling cache 2023-10-05T21:15:20.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.349+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:116 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93983832573792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50fd2810 con 0x557a50f0fbb0 2023-10-05T21:15:20.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.350+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 42 ==== osd_op_reply(116 notify.1 [watch unwatch cookie 93983832573792] v29'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.350+0000 7f008ddc4680 20 remove_watcher() i=1 2023-10-05T21:15:20.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.350+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:117 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93983832576848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50fd2810 con 0x557a50f3feb0 2023-10-05T21:15:20.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.351+0000 7f0080e9c700 1 -- 172.21.15.153:0/2829432543 <== osd.3 v2:172.21.15.153:6800/140455 33 ==== osd_op_reply(117 notify.2 [watch unwatch cookie 93983832576848] v29'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0074014070 con 0x557a50f3feb0 2023-10-05T21:15:20.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.351+0000 7f008ddc4680 20 remove_watcher() i=2 2023-10-05T21:15:20.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.351+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:118 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93983832581472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50fd2810 con 0x7f0074016730 2023-10-05T21:15:20.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.352+0000 7f007bfff700 1 -- 172.21.15.153:0/2829432543 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== osd_op_reply(118 notify.3 [watch unwatch cookie 93983832581472] v29'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f006c03f020 con 0x7f0074016730 2023-10-05T21:15:20.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.352+0000 7f008ddc4680 20 remove_watcher() i=3 2023-10-05T21:15:20.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.352+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:119 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93983832584992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50fd2810 con 0x557a50f0fbb0 2023-10-05T21:15:20.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.352+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 43 ==== osd_op_reply(119 notify.4 [watch unwatch cookie 93983832584992] v29'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.352+0000 7f008ddc4680 20 remove_watcher() i=4 2023-10-05T21:15:20.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.352+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:120 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93983832586688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50fd2810 con 0x7f006c007030 2023-10-05T21:15:20.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.353+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(120 notify.5 [watch unwatch cookie 93983832586688] v29'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f007c00a570 con 0x7f006c007030 2023-10-05T21:15:20.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.353+0000 7f008ddc4680 20 remove_watcher() i=5 2023-10-05T21:15:20.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.353+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:121 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93983832589232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50fd2810 con 0x7f006c007030 2023-10-05T21:15:20.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.354+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(121 notify.6 [watch unwatch cookie 93983832589232] v29'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f007c00a570 con 0x7f006c007030 2023-10-05T21:15:20.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.354+0000 7f008ddc4680 20 remove_watcher() i=6 2023-10-05T21:15:20.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.354+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:122 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93983832591808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50fd2810 con 0x7f006c007030 2023-10-05T21:15:20.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.355+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(122 notify.7 [watch unwatch cookie 93983832591808] v29'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f007c00a570 con 0x7f006c007030 2023-10-05T21:15:20.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.355+0000 7f008ddc4680 20 remove_watcher() i=7 2023-10-05T21:15:20.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.355+0000 7f0051fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:20.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.355+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:123 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93983832594288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x557a50fd2810 con 0x557a50f0fbb0 2023-10-05T21:15:20.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.356+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 <== osd.1 v2:172.21.15.153:6816/140456 44 ==== osd_op_reply(123 data_loggenerations_metadata [watch unwatch cookie 93983832594288] v29'169 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f007c00a570 con 0x557a50f0fbb0 2023-10-05T21:15:20.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.356+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f006c007030 msgr2=0x7f006c01d430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.356+0000 7f008ddc4680 1 --2- 172.21.15.153:0/2829432543 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f006c007030 0x7f006c01d430 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.356+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x557a50f0fbb0 msgr2=0x557a50f3da90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.356+0000 7f008ddc4680 1 --2- 172.21.15.153:0/2829432543 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x557a50f0fbb0 0x557a50f3da90 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.356+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f0074016730 msgr2=0x7f00740460c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.356+0000 7f008ddc4680 1 --2- 172.21.15.153:0/2829432543 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f0074016730 0x7f00740460c0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.356+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x557a50f3feb0 msgr2=0x557a50f42290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.356+0000 7f008ddc4680 1 --2- 172.21.15.153:0/2829432543 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x557a50f3feb0 0x557a50f42290 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.356+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0064034140 msgr2=0x7f00640365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.356+0000 7f008ddc4680 1 --2- 172.21.15.153:0/2829432543 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0064034140 0x7f00640365f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f006c00afd0 tx=0x7f006c014000 comp rx=0 tx=0).stop 2023-10-05T21:15:20.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.356+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557a50e7d0a0 msgr2=0x557a50f31d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.356+0000 7f008ddc4680 1 --2- 172.21.15.153:0/2829432543 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557a50e7d0a0 0x557a50f31d90 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x557a50f2b660 tx=0x7f0074016000 comp rx=0 tx=0).stop 2023-10-05T21:15:20.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.356+0000 7f008169d700 1 -- 172.21.15.153:0/2829432543 reap_dead start 2023-10-05T21:15:20.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.356+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 shutdown_connections 2023-10-05T21:15:20.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.356+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 >> 172.21.15.153:0/2829432543 conn(0x557a50f03b80 msgr2=0x557a50f24c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:20.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.356+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 shutdown_connections 2023-10-05T21:15:20.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.356+0000 7f008ddc4680 1 -- 172.21.15.153:0/2829432543 wait complete. 2023-10-05T21:15:20.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.357+0000 7f008ddc4680 1 -- 172.21.15.153:0/965615322 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7effc0034140 msgr2=0x7effc00365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.357+0000 7f008ddc4680 1 --2- 172.21.15.153:0/965615322 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7effc0034140 0x7effc00365f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x557a50f4dd00 tx=0x7f007c037450 comp rx=0 tx=0).stop 2023-10-05T21:15:20.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.357+0000 7f008ddc4680 1 -- 172.21.15.153:0/965615322 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557a50f5ab30 msgr2=0x557a50f61810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.357+0000 7f008ddc4680 1 --2- 172.21.15.153:0/965615322 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557a50f5ab30 0x557a50f61810 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x557a50f563a0 tx=0x7f006c039000 comp rx=0 tx=0).stop 2023-10-05T21:15:20.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.357+0000 7f008ddc4680 1 -- 172.21.15.153:0/965615322 shutdown_connections 2023-10-05T21:15:20.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.357+0000 7f008ddc4680 1 --2- 172.21.15.153:0/965615322 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7effc0034140 0x7effc00365f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.357+0000 7f008ddc4680 1 --2- 172.21.15.153:0/965615322 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557a50f5ab30 0x557a50f61810 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.357+0000 7f008ddc4680 1 -- 172.21.15.153:0/965615322 >> 172.21.15.153:0/965615322 conn(0x557a50f56e30 msgr2=0x557a50f54f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:20.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.357+0000 7f008ddc4680 1 -- 172.21.15.153:0/965615322 shutdown_connections 2023-10-05T21:15:20.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.357+0000 7f008ddc4680 1 -- 172.21.15.153:0/965615322 wait complete. 2023-10-05T21:15:20.398 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:15:20.400 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2023-10-05T21:15:20.400 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2023-10-05T21:15:20.400 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2023-10-05T21:15:20.477 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:20.478 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:20.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.475+0000 7f58364e7680 1 Processor -- start 2023-10-05T21:15:20.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.475+0000 7f58364e7680 1 -- start start 2023-10-05T21:15:20.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.476+0000 7f58364e7680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55d5c391f0a0 0x55d5c39b0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.476+0000 7f58364e7680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d5c38f8990 con 0x55d5c39b09d0 2023-10-05T21:15:20.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.476+0000 7f58364e7680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d5c38b8db0 con 0x55d5c391f0a0 2023-10-05T21:15:20.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.476+0000 7f58295bf700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55d5c391f0a0 0x55d5c39b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.476+0000 7f5828dbe700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55d5c39b09d0 0x55d5c39b2db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:55352/0 (socket says 172.21.15.153:55352) 2023-10-05T21:15:20.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.476+0000 7f5828dbe700 1 -- 172.21.15.153:0/3389095192 learned_addr learned my addr 172.21.15.153:0/3389095192 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:20.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.476+0000 7f58295bf700 1 -- 172.21.15.153:0/3389095192 >> v1:172.21.15.111:6789/0 conn(0x55d5c39b09d0 legacy=0x55d5c39b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.476+0000 7f581bfff700 1 -- 172.21.15.153:0/3389095192 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4222909790 0 0) 0x55d5c38f8990 con 0x55d5c39b09d0 2023-10-05T21:15:20.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.476+0000 7f58295bf700 1 -- 172.21.15.153:0/3389095192 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5c39b54e0 con 0x55d5c391f0a0 2023-10-05T21:15:20.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.476+0000 7f58295bf700 1 --2- 172.21.15.153:0/3389095192 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c391f0a0 0x55d5c39b0490 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f582000a5d0 tx=0x7f5820005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca7f32819fb16ca server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.476+0000 7f581bfff700 1 -- 172.21.15.153:0/3389095192 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f58200086a0 con 0x55d5c391f0a0 2023-10-05T21:15:20.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.476+0000 7f581bfff700 1 -- 172.21.15.153:0/3389095192 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5820008800 con 0x55d5c391f0a0 2023-10-05T21:15:20.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.476+0000 7f581bfff700 1 -- 172.21.15.153:0/3389095192 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5820008ad0 con 0x55d5c391f0a0 2023-10-05T21:15:20.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.477+0000 7f58364e7680 1 -- 172.21.15.153:0/3389095192 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c391f0a0 msgr2=0x55d5c39b0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.477+0000 7f58364e7680 1 --2- 172.21.15.153:0/3389095192 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c391f0a0 0x55d5c39b0490 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f582000a5d0 tx=0x7f5820005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:20.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.477+0000 7f58364e7680 1 -- 172.21.15.153:0/3389095192 shutdown_connections 2023-10-05T21:15:20.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.477+0000 7f58364e7680 1 --2- 172.21.15.153:0/3389095192 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c391f0a0 0x55d5c39b0490 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.477+0000 7f58364e7680 1 -- 172.21.15.153:0/3389095192 >> 172.21.15.153:0/3389095192 conn(0x55d5c39a5b80 msgr2=0x55d5c39a7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:20.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.477+0000 7f58364e7680 1 -- 172.21.15.153:0/3389095192 shutdown_connections 2023-10-05T21:15:20.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.477+0000 7f58364e7680 1 -- 172.21.15.153:0/3389095192 wait complete. 2023-10-05T21:15:20.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.478+0000 7f58364e7680 1 Processor -- start 2023-10-05T21:15:20.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.478+0000 7f58364e7680 1 -- start start 2023-10-05T21:15:20.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.478+0000 7f58364e7680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c391f0a0 0x55d5c39cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.478+0000 7f58364e7680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5c3858ea0 con 0x55d5c391f0a0 2023-10-05T21:15:20.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.478+0000 7f58295bf700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c391f0a0 0x55d5c39cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.478+0000 7f58295bf700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c391f0a0 0x55d5c39cc8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38530/0 (socket says 172.21.15.153:38530) 2023-10-05T21:15:20.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.478+0000 7f58295bf700 1 -- 172.21.15.153:0/2649956245 learned_addr learned my addr 172.21.15.153:0/2649956245 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:20.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.478+0000 7f58295bf700 1 -- 172.21.15.153:0/2649956245 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5820005cf0 con 0x55d5c391f0a0 2023-10-05T21:15:20.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.478+0000 7f58295bf700 1 --2- 172.21.15.153:0/2649956245 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c391f0a0 0x55d5c39cc8a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5820005a90 tx=0x7f5820015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=440c94e41bd5024e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.478+0000 7f581affd700 1 -- 172.21.15.153:0/2649956245 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5820008970 con 0x55d5c391f0a0 2023-10-05T21:15:20.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.479+0000 7f581affd700 1 -- 172.21.15.153:0/2649956245 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5820008ad0 con 0x55d5c391f0a0 2023-10-05T21:15:20.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.479+0000 7f581affd700 1 -- 172.21.15.153:0/2649956245 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5820008da0 con 0x55d5c391f0a0 2023-10-05T21:15:20.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.479+0000 7f58364e7680 1 -- 172.21.15.153:0/2649956245 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c391f0a0 msgr2=0x55d5c39cc8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.479+0000 7f58364e7680 1 --2- 172.21.15.153:0/2649956245 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c391f0a0 0x55d5c39cc8a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5820005a90 tx=0x7f5820015000 comp rx=0 tx=0).stop 2023-10-05T21:15:20.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.479+0000 7f58364e7680 1 -- 172.21.15.153:0/2649956245 shutdown_connections 2023-10-05T21:15:20.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.479+0000 7f58364e7680 1 --2- 172.21.15.153:0/2649956245 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c391f0a0 0x55d5c39cc8a0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.479+0000 7f58364e7680 1 -- 172.21.15.153:0/2649956245 >> 172.21.15.153:0/2649956245 conn(0x55d5c39a5b80 msgr2=0x55d5c39c8370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:20.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.479+0000 7f58364e7680 1 -- 172.21.15.153:0/2649956245 shutdown_connections 2023-10-05T21:15:20.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.479+0000 7f58364e7680 1 -- 172.21.15.153:0/2649956245 wait complete. 2023-10-05T21:15:20.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.479+0000 7f58364e7680 1 Processor -- start 2023-10-05T21:15:20.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.479+0000 7f58364e7680 1 -- start start 2023-10-05T21:15:20.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.480+0000 7f58364e7680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c391f0a0 0x55d5c39d3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.480+0000 7f58364e7680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5c384fc80 con 0x55d5c391f0a0 2023-10-05T21:15:20.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.480+0000 7f58295bf700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c391f0a0 0x55d5c39d3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.480+0000 7f58295bf700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c391f0a0 0x55d5c39d3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38538/0 (socket says 172.21.15.153:38538) 2023-10-05T21:15:20.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.480+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 learned_addr learned my addr 172.21.15.153:0/1976258138 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:20.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.480+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5c39b54e0 con 0x55d5c391f0a0 2023-10-05T21:15:20.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.480+0000 7f58295bf700 1 --2- 172.21.15.153:0/1976258138 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c391f0a0 0x55d5c39d3ca0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f5820000c00 tx=0x7f582001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.481+0000 7f58197fa700 1 -- 172.21.15.153:0/1976258138 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f582001d420 con 0x55d5c391f0a0 2023-10-05T21:15:20.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.481+0000 7f58197fa700 1 -- 172.21.15.153:0/1976258138 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582001d5a0 con 0x55d5c391f0a0 2023-10-05T21:15:20.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.481+0000 7f58197fa700 1 -- 172.21.15.153:0/1976258138 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f582001d890 con 0x55d5c391f0a0 2023-10-05T21:15:20.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.481+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d5c39d41e0 con 0x55d5c391f0a0 2023-10-05T21:15:20.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.481+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d5c39d4690 con 0x55d5c391f0a0 2023-10-05T21:15:20.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.481+0000 7f58197fa700 1 -- 172.21.15.153:0/1976258138 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f582001d9f0 con 0x55d5c391f0a0 2023-10-05T21:15:20.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.481+0000 7f58364e7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.482+0000 7f58197fa700 1 --2- 172.21.15.153:0/1976258138 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f580c034140 0x7f580c0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.482+0000 7f58197fa700 1 -- 172.21.15.153:0/1976258138 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f5820049920 con 0x55d5c391f0a0 2023-10-05T21:15:20.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.482+0000 7f5828dbe700 1 --2- 172.21.15.153:0/1976258138 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f580c034140 0x7f580c0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.482+0000 7f58364e7680 1 --2- 172.21.15.153:0/1976258138 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d5c39b09d0 0x55d5c39dfa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.482+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e01c0 con 0x55d5c39b09d0 2023-10-05T21:15:20.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.482+0000 7f5829dc0700 1 --2- 172.21.15.153:0/1976258138 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d5c39b09d0 0x55d5c39dfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.482+0000 7f5828dbe700 1 --2- 172.21.15.153:0/1976258138 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f580c034140 0x7f580c0365f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f581c0011e0 tx=0x7f581c0013a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.482+0000 7f5829dc0700 1 --2- 172.21.15.153:0/1976258138 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d5c39b09d0 0x55d5c39dfa30 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.483+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.483+0000 7f58364e7680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.483+0000 7f58364e7680 20 realm 2023-10-05T21:15:20.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.483+0000 7f58364e7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.483+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39dd070 con 0x55d5c39b09d0 2023-10-05T21:15:20.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.483+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.483+0000 7f58364e7680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.483+0000 7f58364e7680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:20.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.483+0000 7f58364e7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.483+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e0c70 con 0x55d5c39b09d0 2023-10-05T21:15:20.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.483+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.483+0000 7f58364e7680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.483+0000 7f58364e7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.483+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e08c0 con 0x55d5c39b09d0 2023-10-05T21:15:20.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.483+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.483+0000 7f58364e7680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:20.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.483+0000 7f58364e7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.483+0000 7f58364e7680 1 --2- 172.21.15.153:0/1976258138 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d5c39e2030 0x55d5c39e4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.483+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e4950 con 0x55d5c39e2030 2023-10-05T21:15:20.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.484+0000 7f58295bf700 1 --2- 172.21.15.153:0/1976258138 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d5c39e2030 0x55d5c39e4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.484+0000 7f58295bf700 1 --2- 172.21.15.153:0/1976258138 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d5c39e2030 0x55d5c39e4410 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.484+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f5820019040 con 0x55d5c39e2030 2023-10-05T21:15:20.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.484+0000 7f58364e7680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:20.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.484+0000 7f58364e7680 20 searching for the correct realm 2023-10-05T21:15:20.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.484+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x55d5c39e2030 2023-10-05T21:15:20.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.484+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5820019040 con 0x55d5c39e2030 2023-10-05T21:15:20.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.484+0000 7f58295bf700 1 --2- 172.21.15.153:0/1976258138 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f5820007030 0x7f582001c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.484+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x7f5820007030 2023-10-05T21:15:20.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.484+0000 7f5828dbe700 1 --2- 172.21.15.153:0/1976258138 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f5820007030 0x7f582001c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.485+0000 7f5828dbe700 1 --2- 172.21.15.153:0/1976258138 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f5820007030 0x7f582001c6c0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.485+0000 7f5828dbe700 1 -- 172.21.15.153:0/1976258138 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f581c006070 con 0x7f5820007030 2023-10-05T21:15:20.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.485+0000 7f5828dbe700 1 --2- 172.21.15.153:0/1976258138 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f581c00d8e0 0x7f581c00c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.485+0000 7f5828dbe700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x7f581c00d8e0 2023-10-05T21:15:20.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.485+0000 7f5829dc0700 1 --2- 172.21.15.153:0/1976258138 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f581c00d8e0 0x7f581c00c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.486+0000 7f5829dc0700 1 --2- 172.21.15.153:0/1976258138 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f581c00d8e0 0x7f581c00c360 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.486+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f582400a570 con 0x7f581c00d8e0 2023-10-05T21:15:20.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.486+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x55d5c39b09d0 2023-10-05T21:15:20.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.486+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.486+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x55d5c39b09d0 2023-10-05T21:15:20.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.486+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.486+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x7f581c00d8e0 2023-10-05T21:15:20.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.487+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f582400a570 con 0x7f581c00d8e0 2023-10-05T21:15:20.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.487+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x7f581c00d8e0 2023-10-05T21:15:20.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.487+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f582400a570 con 0x7f581c00d8e0 2023-10-05T21:15:20.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.487+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x7f5820007030 2023-10-05T21:15:20.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.487+0000 7f5828dbe700 1 -- 172.21.15.153:0/1976258138 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f581c006070 con 0x7f5820007030 2023-10-05T21:15:20.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.487+0000 7f5828dbe700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x55d5c39e2030 2023-10-05T21:15:20.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.487+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5820019040 con 0x55d5c39e2030 2023-10-05T21:15:20.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.487+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x55d5c39b09d0 2023-10-05T21:15:20.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.487+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.487+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x7f581c00d8e0 2023-10-05T21:15:20.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.488+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f582400a570 con 0x7f581c00d8e0 2023-10-05T21:15:20.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.488+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x55d5c39b09d0 2023-10-05T21:15:20.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.488+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.488+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x7f5820007030 2023-10-05T21:15:20.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.488+0000 7f5828dbe700 1 -- 172.21.15.153:0/1976258138 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f581c006070 con 0x7f5820007030 2023-10-05T21:15:20.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.488+0000 7f5828dbe700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x55d5c39e2030 2023-10-05T21:15:20.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.488+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5820019040 con 0x55d5c39e2030 2023-10-05T21:15:20.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.488+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x55d5c39e2030 2023-10-05T21:15:20.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.488+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5820019040 con 0x55d5c39e2030 2023-10-05T21:15:20.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.489+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x7f581c00d8e0 2023-10-05T21:15:20.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.489+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f582400a570 con 0x7f581c00d8e0 2023-10-05T21:15:20.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.489+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x55d5c39e2030 2023-10-05T21:15:20.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.489+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5820019040 con 0x55d5c39e2030 2023-10-05T21:15:20.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.489+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x55d5c39e2030 2023-10-05T21:15:20.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.489+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5820019040 con 0x55d5c39e2030 2023-10-05T21:15:20.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.489+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x55d5c39b09d0 2023-10-05T21:15:20.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.489+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.489+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x55d5c39b09d0 2023-10-05T21:15:20.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.490+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.490+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x7f581c00d8e0 2023-10-05T21:15:20.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.490+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f582400a570 con 0x7f581c00d8e0 2023-10-05T21:15:20.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.490+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x55d5c39e2030 2023-10-05T21:15:20.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.490+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5820019040 con 0x55d5c39e2030 2023-10-05T21:15:20.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.490+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x7f5820007030 2023-10-05T21:15:20.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.490+0000 7f5828dbe700 1 -- 172.21.15.153:0/1976258138 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f581c006070 con 0x7f5820007030 2023-10-05T21:15:20.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.490+0000 7f5828dbe700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x55d5c39b09d0 2023-10-05T21:15:20.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.491+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.491+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x7f581c00d8e0 2023-10-05T21:15:20.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.491+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f582400a570 con 0x7f581c00d8e0 2023-10-05T21:15:20.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.491+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x55d5c39e2030 2023-10-05T21:15:20.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.491+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5820019040 con 0x55d5c39e2030 2023-10-05T21:15:20.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.491+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x7f581c00d8e0 2023-10-05T21:15:20.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.491+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f582400a570 con 0x7f581c00d8e0 2023-10-05T21:15:20.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.491+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x7f5820007030 2023-10-05T21:15:20.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.492+0000 7f5828dbe700 1 -- 172.21.15.153:0/1976258138 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f581c006070 con 0x7f5820007030 2023-10-05T21:15:20.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.492+0000 7f5828dbe700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x55d5c39e2030 2023-10-05T21:15:20.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.492+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5820019040 con 0x55d5c39e2030 2023-10-05T21:15:20.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.492+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x7f581c00d8e0 2023-10-05T21:15:20.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.492+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f582400a570 con 0x7f581c00d8e0 2023-10-05T21:15:20.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.492+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x55d5c39b09d0 2023-10-05T21:15:20.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.492+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.492+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e62e0 con 0x7f5820007030 2023-10-05T21:15:20.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.492+0000 7f5828dbe700 1 -- 172.21.15.153:0/1976258138 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f581c006070 con 0x7f5820007030 2023-10-05T21:15:20.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.493+0000 7f58364e7680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:20.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.493+0000 7f58364e7680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:20.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.493+0000 7f58364e7680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:20.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.493+0000 7f58364e7680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:20.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.493+0000 7f58364e7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.493+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e5480 con 0x55d5c39b09d0 2023-10-05T21:15:20.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.493+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.493+0000 7f58364e7680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.493+0000 7f58364e7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.493+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e50b0 con 0x55d5c39b09d0 2023-10-05T21:15:20.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.493+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.493+0000 7f58364e7680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:20.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.493+0000 7f58364e7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.493+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6770 con 0x55d5c39b09d0 2023-10-05T21:15:20.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.493+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.493+0000 7f58364e7680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:20.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.493+0000 7f58364e7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.493+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6b20 con 0x55d5c39e2030 2023-10-05T21:15:20.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.493+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f5820019040 con 0x55d5c39e2030 2023-10-05T21:15:20.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.493+0000 7f58364e7680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.494+0000 7f58364e7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.494+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6ed0 con 0x55d5c39b09d0 2023-10-05T21:15:20.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.494+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.494+0000 7f58364e7680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.494+0000 7f58364e7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.494+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6ed0 con 0x55d5c39b09d0 2023-10-05T21:15:20.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.494+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.494+0000 7f58364e7680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:20.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.494+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6ed0 con 0x55d5c39e2030 2023-10-05T21:15:20.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.494+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5820019040 con 0x55d5c39e2030 2023-10-05T21:15:20.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.494+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6ed0 con 0x7f5820007030 2023-10-05T21:15:20.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.494+0000 7f5828dbe700 1 -- 172.21.15.153:0/1976258138 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f581c006070 con 0x7f5820007030 2023-10-05T21:15:20.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.494+0000 7f5828dbe700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6ed0 con 0x7f581c00d8e0 2023-10-05T21:15:20.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.495+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f582400a570 con 0x7f581c00d8e0 2023-10-05T21:15:20.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.495+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6770 con 0x55d5c39b09d0 2023-10-05T21:15:20.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.495+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.495+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6770 con 0x55d5c39b09d0 2023-10-05T21:15:20.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.495+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.495+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6770 con 0x7f581c00d8e0 2023-10-05T21:15:20.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.496+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f582400a570 con 0x7f581c00d8e0 2023-10-05T21:15:20.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.496+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6770 con 0x7f581c00d8e0 2023-10-05T21:15:20.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.496+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f582400a570 con 0x7f581c00d8e0 2023-10-05T21:15:20.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.496+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6770 con 0x7f5820007030 2023-10-05T21:15:20.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.496+0000 7f5828dbe700 1 -- 172.21.15.153:0/1976258138 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f581c006070 con 0x7f5820007030 2023-10-05T21:15:20.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.496+0000 7f5828dbe700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6770 con 0x55d5c39e2030 2023-10-05T21:15:20.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.496+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5820019040 con 0x55d5c39e2030 2023-10-05T21:15:20.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.496+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6770 con 0x55d5c39b09d0 2023-10-05T21:15:20.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.496+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.496+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6770 con 0x7f581c00d8e0 2023-10-05T21:15:20.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.497+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f582400a570 con 0x7f581c00d8e0 2023-10-05T21:15:20.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.497+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6770 con 0x55d5c39b09d0 2023-10-05T21:15:20.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.497+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.497+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6770 con 0x7f5820007030 2023-10-05T21:15:20.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.497+0000 7f5828dbe700 1 -- 172.21.15.153:0/1976258138 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f581c006070 con 0x7f5820007030 2023-10-05T21:15:20.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.497+0000 7f5828dbe700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6770 con 0x55d5c39e2030 2023-10-05T21:15:20.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.497+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5820019040 con 0x55d5c39e2030 2023-10-05T21:15:20.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.497+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6770 con 0x55d5c39e2030 2023-10-05T21:15:20.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.498+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5820019040 con 0x55d5c39e2030 2023-10-05T21:15:20.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.498+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6770 con 0x7f581c00d8e0 2023-10-05T21:15:20.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.498+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f582400a570 con 0x7f581c00d8e0 2023-10-05T21:15:20.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.498+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6770 con 0x55d5c39e2030 2023-10-05T21:15:20.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.498+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5820019040 con 0x55d5c39e2030 2023-10-05T21:15:20.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.498+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6770 con 0x55d5c39e2030 2023-10-05T21:15:20.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.498+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5820019040 con 0x55d5c39e2030 2023-10-05T21:15:20.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.498+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6770 con 0x55d5c39b09d0 2023-10-05T21:15:20.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.498+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.498+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6770 con 0x55d5c39b09d0 2023-10-05T21:15:20.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.499+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.499+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6770 con 0x7f581c00d8e0 2023-10-05T21:15:20.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.499+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f582400a570 con 0x7f581c00d8e0 2023-10-05T21:15:20.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.499+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6770 con 0x55d5c39e2030 2023-10-05T21:15:20.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.499+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5820019040 con 0x55d5c39e2030 2023-10-05T21:15:20.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.499+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6770 con 0x7f5820007030 2023-10-05T21:15:20.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.499+0000 7f5828dbe700 1 -- 172.21.15.153:0/1976258138 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f581c006070 con 0x7f5820007030 2023-10-05T21:15:20.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.499+0000 7f5828dbe700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6770 con 0x55d5c39b09d0 2023-10-05T21:15:20.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.500+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.500+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6770 con 0x7f581c00d8e0 2023-10-05T21:15:20.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.500+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f582400a570 con 0x7f581c00d8e0 2023-10-05T21:15:20.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.500+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6770 con 0x55d5c39e2030 2023-10-05T21:15:20.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.500+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5820019040 con 0x55d5c39e2030 2023-10-05T21:15:20.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.500+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6770 con 0x7f581c00d8e0 2023-10-05T21:15:20.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.500+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f582400a570 con 0x7f581c00d8e0 2023-10-05T21:15:20.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.500+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6770 con 0x7f5820007030 2023-10-05T21:15:20.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.500+0000 7f5828dbe700 1 -- 172.21.15.153:0/1976258138 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f581c006070 con 0x7f5820007030 2023-10-05T21:15:20.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.500+0000 7f5828dbe700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6770 con 0x55d5c39e2030 2023-10-05T21:15:20.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.501+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5820019040 con 0x55d5c39e2030 2023-10-05T21:15:20.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.501+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6770 con 0x7f581c00d8e0 2023-10-05T21:15:20.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.501+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f582400a570 con 0x7f581c00d8e0 2023-10-05T21:15:20.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.501+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6770 con 0x55d5c39b09d0 2023-10-05T21:15:20.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.501+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.501+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6770 con 0x7f5820007030 2023-10-05T21:15:20.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.501+0000 7f5828dbe700 1 -- 172.21.15.153:0/1976258138 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f581c006070 con 0x7f5820007030 2023-10-05T21:15:20.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.501+0000 7f58364e7680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:20.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.501+0000 7f58364e7680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:20.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.501+0000 7f58364e7680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:20.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.501+0000 7f58364e7680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:20.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.501+0000 7f58364e7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.501+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e6ed0 con 0x55d5c39b09d0 2023-10-05T21:15:20.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.502+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.502+0000 7f58364e7680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:20.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.502+0000 7f58364e7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.502+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e7330 con 0x55d5c39e2030 2023-10-05T21:15:20.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.502+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f5820019040 con 0x55d5c39e2030 2023-10-05T21:15:20.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.502+0000 7f58364e7680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:20.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.502+0000 7f58364e7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.502+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e7c20 con 0x55d5c39b09d0 2023-10-05T21:15:20.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.502+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.502+0000 7f58364e7680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:20.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.502+0000 7f58364e7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.502+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e7c20 con 0x55d5c39b09d0 2023-10-05T21:15:20.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.502+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.502+0000 7f58364e7680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:20.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.502+0000 7f58364e7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.502+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e7c20 con 0x7f581c00d8e0 2023-10-05T21:15:20.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.503+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f582400a570 con 0x7f581c00d8e0 2023-10-05T21:15:20.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.503+0000 7f58364e7680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.503+0000 7f58364e7680 20 zone default found 2023-10-05T21:15:20.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.503+0000 7f58364e7680 4 Realm: () 2023-10-05T21:15:20.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.503+0000 7f58364e7680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:20.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.503+0000 7f58364e7680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:20.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.503+0000 7f58364e7680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:20.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.503+0000 7f58364e7680 20 zonegroup default 2023-10-05T21:15:20.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.503+0000 7f58364e7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.503+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e7c20 con 0x7f581c00d8e0 2023-10-05T21:15:20.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.503+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f582400a570 con 0x7f581c00d8e0 2023-10-05T21:15:20.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.503+0000 7f58364e7680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.503+0000 7f58364e7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.503+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e7c20 con 0x55d5c39e2030 2023-10-05T21:15:20.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.503+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5820019040 con 0x55d5c39e2030 2023-10-05T21:15:20.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.503+0000 7f58364e7680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.503+0000 7f58364e7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.503+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e99e0 con 0x55d5c39e2030 2023-10-05T21:15:20.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.503+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5820019040 con 0x55d5c39e2030 2023-10-05T21:15:20.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.503+0000 7f58364e7680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:20.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.503+0000 7f58364e7680 20 started sync module instance, tier type = 2023-10-05T21:15:20.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.503+0000 7f58364e7680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:20.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.503+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39e9590 con 0x7f5820007030 2023-10-05T21:15:20.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.504+0000 7f5828dbe700 1 -- 172.21.15.153:0/1976258138 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f581c006070 con 0x7f5820007030 2023-10-05T21:15:20.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.504+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94376598343840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39ea2d0 con 0x7f5820007030 2023-10-05T21:15:20.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.504+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39eab70 con 0x55d5c39b09d0 2023-10-05T21:15:20.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.505+0000 7f5828dbe700 1 -- 172.21.15.153:0/1976258138 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94376598343840] v29'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f581c006070 con 0x7f5820007030 2023-10-05T21:15:20.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.505+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.505+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94376598349440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39eafc0 con 0x55d5c39b09d0 2023-10-05T21:15:20.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.505+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39eb8a0 con 0x55d5c39e2030 2023-10-05T21:15:20.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.506+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94376598349440] v29'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.506+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5820019040 con 0x55d5c39e2030 2023-10-05T21:15:20.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.506+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94376598350864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39ebca0 con 0x55d5c39e2030 2023-10-05T21:15:20.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.506+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39ec6b0 con 0x7f5820007030 2023-10-05T21:15:20.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.507+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94376598350864] v29'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5820019040 con 0x55d5c39e2030 2023-10-05T21:15:20.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.507+0000 7f5828dbe700 1 -- 172.21.15.153:0/1976258138 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f581c006070 con 0x7f5820007030 2023-10-05T21:15:20.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.507+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94376598356416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39eca60 con 0x7f5820007030 2023-10-05T21:15:20.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.507+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39ed470 con 0x55d5c39b09d0 2023-10-05T21:15:20.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.507+0000 7f5828dbe700 1 -- 172.21.15.153:0/1976258138 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94376598356416] v29'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f581c006070 con 0x7f5820007030 2023-10-05T21:15:20.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.507+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.507+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94376598359936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39ed3d0 con 0x55d5c39b09d0 2023-10-05T21:15:20.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.508+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39ee2b0 con 0x7f581c00d8e0 2023-10-05T21:15:20.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.508+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94376598359936] v29'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.508+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f582400a570 con 0x7f581c00d8e0 2023-10-05T21:15:20.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.508+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94376598362144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39ee270 con 0x7f581c00d8e0 2023-10-05T21:15:20.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.508+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39eed30 con 0x7f581c00d8e0 2023-10-05T21:15:20.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.509+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(96 notify.6 [create] v29'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f582400a570 con 0x7f581c00d8e0 2023-10-05T21:15:20.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.509+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(95 notify.5 [watch watch cookie 94376598362144] v29'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f582400a570 con 0x7f581c00d8e0 2023-10-05T21:15:20.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.509+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94376598366240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39ef220 con 0x7f581c00d8e0 2023-10-05T21:15:20.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.509+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39edc90 con 0x7f581c00d8e0 2023-10-05T21:15:20.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.510+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94376598366240] v29'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f582400a570 con 0x7f581c00d8e0 2023-10-05T21:15:20.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.510+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f582400a570 con 0x7f581c00d8e0 2023-10-05T21:15:20.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.510+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94376598367536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39ef180 con 0x7f581c00d8e0 2023-10-05T21:15:20.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.510+0000 7f58364e7680 20 add_watcher() i=0 2023-10-05T21:15:20.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.510+0000 7f58364e7680 20 add_watcher() i=1 2023-10-05T21:15:20.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.510+0000 7f58364e7680 20 add_watcher() i=2 2023-10-05T21:15:20.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.510+0000 7f58364e7680 20 add_watcher() i=3 2023-10-05T21:15:20.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.510+0000 7f58364e7680 20 add_watcher() i=4 2023-10-05T21:15:20.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.510+0000 7f58364e7680 20 add_watcher() i=5 2023-10-05T21:15:20.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.510+0000 7f58364e7680 20 add_watcher() i=6 2023-10-05T21:15:20.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.511+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94376598367536] v29'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f582400a570 con 0x7f581c00d8e0 2023-10-05T21:15:20.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.511+0000 7f58364e7680 20 add_watcher() i=7 2023-10-05T21:15:20.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.511+0000 7f58364e7680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:20.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.511+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39f2d50 con 0x55d5c39b09d0 2023-10-05T21:15:20.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.511+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.511+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94376598370352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39f0170 con 0x55d5c39b09d0 2023-10-05T21:15:20.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.512+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94376598370352] v29'170 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.512+0000 7f57fa7e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:20.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.512+0000 7f58364e7680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:20.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.512+0000 7f58364e7680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:20.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.512+0000 7f58364e7680 1 Processor -- start 2023-10-05T21:15:20.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.512+0000 7f58364e7680 1 -- start start 2023-10-05T21:15:20.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.512+0000 7f58364e7680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c39fc7d0 0x55d5c39fcbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.512+0000 7f58364e7680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5c39fd1f0 con 0x55d5c39fc7d0 2023-10-05T21:15:20.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.513+0000 7f5828dbe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c39fc7d0 0x55d5c39fcbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.513+0000 7f5828dbe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c39fc7d0 0x55d5c39fcbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38546/0 (socket says 172.21.15.153:38546) 2023-10-05T21:15:20.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.513+0000 7f5828dbe700 1 -- 172.21.15.153:0/1701640047 learned_addr learned my addr 172.21.15.153:0/1701640047 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:20.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.513+0000 7f5828dbe700 1 -- 172.21.15.153:0/1701640047 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5c39fd6d0 con 0x55d5c39fc7d0 2023-10-05T21:15:20.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.513+0000 7f5828dbe700 1 --2- 172.21.15.153:0/1701640047 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c39fc7d0 0x55d5c39fcbe0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f581c000fb0 tx=0x7f581c006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f6a964c7fb9efac server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.513+0000 7f57f9fe3700 1 -- 172.21.15.153:0/1701640047 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f581c023040 con 0x55d5c39fc7d0 2023-10-05T21:15:20.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.513+0000 7f57f9fe3700 1 -- 172.21.15.153:0/1701640047 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581c024040 con 0x55d5c39fc7d0 2023-10-05T21:15:20.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.513+0000 7f57f9fe3700 1 -- 172.21.15.153:0/1701640047 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f581c013040 con 0x55d5c39fc7d0 2023-10-05T21:15:20.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.514+0000 7f58364e7680 1 -- 172.21.15.153:0/1701640047 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c39fc7d0 msgr2=0x55d5c39fcbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.514+0000 7f58364e7680 1 --2- 172.21.15.153:0/1701640047 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c39fc7d0 0x55d5c39fcbe0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f581c000fb0 tx=0x7f581c006000 comp rx=0 tx=0).stop 2023-10-05T21:15:20.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.514+0000 7f58364e7680 1 -- 172.21.15.153:0/1701640047 shutdown_connections 2023-10-05T21:15:20.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.514+0000 7f58364e7680 1 --2- 172.21.15.153:0/1701640047 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c39fc7d0 0x55d5c39fcbe0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.514+0000 7f58364e7680 1 -- 172.21.15.153:0/1701640047 >> 172.21.15.153:0/1701640047 conn(0x55d5c39f8ad0 msgr2=0x55d5c39f6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:20.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.514+0000 7f58364e7680 1 -- 172.21.15.153:0/1701640047 shutdown_connections 2023-10-05T21:15:20.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.514+0000 7f58364e7680 1 -- 172.21.15.153:0/1701640047 wait complete. 2023-10-05T21:15:20.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.514+0000 7f58364e7680 1 Processor -- start 2023-10-05T21:15:20.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.514+0000 7f58364e7680 1 -- start start 2023-10-05T21:15:20.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.515+0000 7f58364e7680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c39fc7d0 0x55d5c3a035a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.515+0000 7f58364e7680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5c3a03ae0 con 0x55d5c39fc7d0 2023-10-05T21:15:20.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.515+0000 7f5828dbe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c39fc7d0 0x55d5c3a035a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.515+0000 7f5828dbe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c39fc7d0 0x55d5c3a035a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:38562/0 (socket says 172.21.15.153:38562) 2023-10-05T21:15:20.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.515+0000 7f5828dbe700 1 -- 172.21.15.153:0/3961182458 learned_addr learned my addr 172.21.15.153:0/3961182458 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:20.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.515+0000 7f5828dbe700 1 -- 172.21.15.153:0/3961182458 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581c00ede0 con 0x55d5c39fc7d0 2023-10-05T21:15:20.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.515+0000 7f5828dbe700 1 --2- 172.21.15.153:0/3961182458 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c39fc7d0 0x55d5c3a035a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f581c000fb0 tx=0x7f581c030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.515+0000 7f576bfff700 1 -- 172.21.15.153:0/3961182458 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f581c023040 con 0x55d5c39fc7d0 2023-10-05T21:15:20.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.515+0000 7f576bfff700 1 -- 172.21.15.153:0/3961182458 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581c03b530 con 0x55d5c39fc7d0 2023-10-05T21:15:20.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.515+0000 7f576bfff700 1 -- 172.21.15.153:0/3961182458 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f581c03b6e0 con 0x55d5c39fc7d0 2023-10-05T21:15:20.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.515+0000 7f58364e7680 1 -- 172.21.15.153:0/3961182458 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d5c3a03ce0 con 0x55d5c39fc7d0 2023-10-05T21:15:20.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.516+0000 7f58364e7680 1 -- 172.21.15.153:0/3961182458 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d5c3a04130 con 0x55d5c39fc7d0 2023-10-05T21:15:20.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.516+0000 7f576bfff700 1 -- 172.21.15.153:0/3961182458 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f581c03b840 con 0x55d5c39fc7d0 2023-10-05T21:15:20.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.516+0000 7f576bfff700 1 --2- 172.21.15.153:0/3961182458 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f57700340f0 0x7f57700365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:20.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.516+0000 7f576bfff700 1 -- 172.21.15.153:0/3961182458 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f581c04eb00 con 0x55d5c39fc7d0 2023-10-05T21:15:20.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.517+0000 7f58364e7680 5 note: GC not initialized 2023-10-05T21:15:20.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.517+0000 7f5829dc0700 1 --2- 172.21.15.153:0/3961182458 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f57700340f0 0x7f57700365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:20.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.517+0000 7f5829dc0700 1 --2- 172.21.15.153:0/3961182458 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f57700340f0 0x7f57700365a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55d5c39ef350 tx=0x7f5824037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:20.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.518+0000 7f57697fa700 20 reqs_thread_entry: start 2023-10-05T21:15:20.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.518+0000 7f5762ffd700 20 reqs_thread_entry: start 2023-10-05T21:15:20.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.518+0000 7f58364e7680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:20.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.518+0000 7f58364e7680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:20.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.518+0000 7f57617fa700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:15:50 2023 2023-10-05T21:15:20.553 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:20.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.518+0000 7f5760ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:20.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.518+0000 7f58364e7680 20 get_system_obj_state: rctx=0x7fff2ca1fc18 obj=default.rgw.meta:users.uid:foo state=0x55d5c385e240 s->prefetch_data=0 2023-10-05T21:15:20.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.518+0000 7f58364e7680 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T21:15:20.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.518+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c3a68e80 con 0x55d5c39b09d0 2023-10-05T21:15:20.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.519+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv12 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.519+0000 7f58364e7680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T21:15:20.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.519+0000 7f58364e7680 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:20.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.519+0000 7f58364e7680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:20.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.519+0000 7f58364e7680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:20.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.519+0000 7f58364e7680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:20.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.519+0000 7f58364e7680 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:20.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.519+0000 7f58364e7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.519+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c3a6b400 con 0x55d5c39b09d0 2023-10-05T21:15:20.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.519+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv12 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.519+0000 7f58364e7680 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T21:15:20.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.519+0000 7f58364e7680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T21:15:20.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.519+0000 7f58364e7680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:20.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.519+0000 7f58364e7680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:20.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.519+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:104 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c3a6ba80 con 0x7f5820007030 2023-10-05T21:15:20.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.519+0000 7f5828dbe700 1 -- 172.21.15.153:0/1976258138 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(104 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f581c006070 con 0x7f5820007030 2023-10-05T21:15:20.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.519+0000 7f58364e7680 20 enabling bucket name=myfoo 2023-10-05T21:15:20.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.519+0000 7f58364e7680 20 get_system_obj_state: rctx=0x7fff2ca1f400 obj=default.rgw.meta:root:myfoo state=0x55d5c385e240 s->prefetch_data=0 2023-10-05T21:15:20.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.519+0000 7f58364e7680 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-10-05T21:15:20.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.519+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 8.9 8:91b71841:root::myfoo:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c3a691b0 con 0x7f5820007030 2023-10-05T21:15:20.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.520+0000 7f5828dbe700 1 -- 172.21.15.153:0/1976258138 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(105 myfoo [getxattrs out=75b,stat out=16b] v0'0 uv27 ondisk = 0) v8 ==== 191+0+91 (crc 0 0 0) 0x7f581c006070 con 0x7f5820007030 2023-10-05T21:15:20.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.520+0000 7f58364e7680 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x6 2023-10-05T21:15:20.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.520+0000 7f58364e7680 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:20.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.520+0000 7f58364e7680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:20.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.520+0000 7f58364e7680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:20.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.520+0000 7f58364e7680 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x1, cached=0x6) 2023-10-05T21:15:20.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.520+0000 7f58364e7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.520+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:106 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c3a691b0 con 0x7f5820007030 2023-10-05T21:15:20.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.520+0000 7f5828dbe700 1 -- 172.21.15.153:0/1976258138 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(106 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+165 (crc 0 0 0) 0x7f581c0530b0 con 0x7f5820007030 2023-10-05T21:15:20.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.520+0000 7f58364e7680 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T21:15:20.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.520+0000 7f58364e7680 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2023-10-05T21:15:20.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.520+0000 7f58364e7680 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:20.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.520+0000 7f58364e7680 20 get_system_obj_state: rctx=0x7fff2ca1f400 obj=default.rgw.meta:root:.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 state=0x55d5c385e500 s->prefetch_data=0 2023-10-05T21:15:20.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.520+0000 7f58364e7680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 : miss 2023-10-05T21:15:20.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.520+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c3a6ce90 con 0x55d5c39e2030 2023-10-05T21:15:20.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.520+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(107 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f5820019040 con 0x55d5c39e2030 2023-10-05T21:15:20.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.520+0000 7f58364e7680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 info.flags=0x16 2023-10-05T21:15:20.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.520+0000 7f58364e7680 10 adding default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 to cache LRU end 2023-10-05T21:15:20.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.520+0000 7f58364e7680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:20.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.520+0000 7f58364e7680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:20.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.520+0000 7f58364e7680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:20.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.520+0000 7f58364e7680 20 Read xattr: user.rgw.acl 2023-10-05T21:15:20.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.520+0000 7f58364e7680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:20.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.520+0000 7f58364e7680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:20.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.520+0000 7f58364e7680 20 rados->read ofs=0 len=0 2023-10-05T21:15:20.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.520+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:108 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c3a6fa80 con 0x55d5c39e2030 2023-10-05T21:15:20.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.521+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(108 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv6 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f5820019040 con 0x55d5c39e2030 2023-10-05T21:15:20.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.521+0000 7f58364e7680 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T21:15:20.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.521+0000 7f58364e7680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 info.flags=0x13 2023-10-05T21:15:20.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.521+0000 7f58364e7680 10 moving default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 to cache LRU end 2023-10-05T21:15:20.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.521+0000 7f58364e7680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:20.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.521+0000 7f58364e7680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:20.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.521+0000 7f58364e7680 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 2023-10-05T21:15:20.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.521+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:109 8.14 8:2ac55809:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c3a74ea0 con 0x55d5c39e2030 2023-10-05T21:15:20.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.522+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(109 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v29'7 uv7 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7f5820019040 con 0x55d5c39e2030 2023-10-05T21:15:20.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.522+0000 7f58364e7680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 info.flags=0x17 2023-10-05T21:15:20.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.522+0000 7f58364e7680 10 moving default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 to cache LRU end 2023-10-05T21:15:20.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.522+0000 7f58364e7680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:20.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.522+0000 7f58364e7680 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1, ofs0, ns] 2023-10-05T21:15:20.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.522+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:110 7.15 7:a93a5511:::notify.2:head [notify cookie 94376598916624 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c3a6d7b0 con 0x55d5c39e2030 2023-10-05T21:15:20.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.522+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== watch-notify(notify (1) cookie 94376598350864 notify 124554051596 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x7f582004d040 con 0x55d5c39e2030 2023-10-05T21:15:20.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.522+0000 7f581affd700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051596 cookie 94376598350864 notifier 4598 bl.length()=725 2023-10-05T21:15:20.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.522+0000 7f581affd700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 info.flags=0x17 2023-10-05T21:15:20.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.522+0000 7f581affd700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1 to cache LRU end 2023-10-05T21:15:20.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.522+0000 7f581affd700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:20.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.522+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(110 notify.2 [notify cookie 94376598916624 out=8b] v0'0 uv186 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f5820019040 con 0x55d5c39e2030 2023-10-05T21:15:20.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.522+0000 7f581affd700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:111 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f5808003d90 con 0x55d5c39e2030 2023-10-05T21:15:20.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.522+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 31 ==== watch-notify(notify_complete (2) cookie 94376598916624 notify 124554051596 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d5c39d4690 con 0x55d5c39e2030 2023-10-05T21:15:20.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.522+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 32 ==== osd_op_reply(111 notify.2 [notify-ack] v0'0 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5820019040 con 0x55d5c39e2030 2023-10-05T21:15:20.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.522+0000 7f58364e7680 20 handle_bi_update(): bucket=:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1]): orig_sources= new_sources= 2023-10-05T21:15:20.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.522+0000 7f58364e7680 20 handle_bi_update(): bucket=:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1]): potential sources added=[] removed=[] 2023-10-05T21:15:20.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.522+0000 7f58364e7680 20 handle_bi_update(): bucket=:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1]): orig_dests= new_dests= 2023-10-05T21:15:20.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.522+0000 7f58364e7680 20 handle_bi_update(): bucket=:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1]): potential dests added=[] removed=[] 2023-10-05T21:15:20.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.522+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:112 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c3a6d770 con 0x55d5c39b09d0 2023-10-05T21:15:20.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.523+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(112 foo [delete,create,call,writefull 0~357] v29'13 uv13 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.523+0000 7f58364e7680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T21:15:20.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.523+0000 7f58364e7680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:20.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.523+0000 7f58364e7680 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T21:15:20.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.523+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:113 7.d 7:b4812045:::notify.4:head [notify cookie 94376598916352 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c3a6d770 con 0x55d5c39b09d0 2023-10-05T21:15:20.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.523+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== watch-notify(notify (1) cookie 94376598359936 notify 124554051604 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x7f58240291f0 con 0x55d5c39b09d0 2023-10-05T21:15:20.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.523+0000 7f581a7fc700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051604 cookie 94376598359936 notifier 4598 bl.length()=533 2023-10-05T21:15:20.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.523+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(113 notify.4 [notify cookie 94376598916352 out=8b] v0'0 uv186 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.523+0000 7f581a7fc700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T21:15:20.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.523+0000 7f581a7fc700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:20.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.523+0000 7f581a7fc700 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:114 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f5778003440 con 0x55d5c39b09d0 2023-10-05T21:15:20.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.524+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(114 notify.4 [notify-ack] v0'0 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.524+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== watch-notify(notify_complete (2) cookie 94376598916352 notify 124554051604 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f582402d040 con 0x55d5c39b09d0 2023-10-05T21:15:20.562 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:20.562 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "foo", 2023-10-05T21:15:20.562 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Foo", 2023-10-05T21:15:20.562 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "foo@foo.com", 2023-10-05T21:15:20.562 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2023-10-05T21:15:20.562 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 4, 2023-10-05T21:15:20.562 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [], 2023-10-05T21:15:20.562 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2023-10-05T21:15:20.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:20.563 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:20.563 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:20.563 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T21:15:20.563 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:20.563 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:20.563 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [], 2023-10-05T21:15:20.563 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2023-10-05T21:15:20.563 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2023-10-05T21:15:20.563 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2023-10-05T21:15:20.563 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2023-10-05T21:15:20.563 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2023-10-05T21:15:20.564 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:15:20.564 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:20.564 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:20.564 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:20.564 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:20.564 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:20.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:20.564 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2023-10-05T21:15:20.564 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:20.564 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:20.564 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:20.564 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:20.565 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:20.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:20.565 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2023-10-05T21:15:20.565 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2023-10-05T21:15:20.565 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [] 2023-10-05T21:15:20.565 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:20.565 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:15:20.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.524+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:115 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94376598343840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c3a6d770 con 0x7f5820007030 2023-10-05T21:15:20.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.525+0000 7f5828dbe700 1 -- 172.21.15.153:0/1976258138 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(115 notify.0 [watch unwatch cookie 94376598343840] v29'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f581c0530b0 con 0x7f5820007030 2023-10-05T21:15:20.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.525+0000 7f58364e7680 20 remove_watcher() i=0 2023-10-05T21:15:20.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.525+0000 7f58364e7680 2 removed watcher, disabling cache 2023-10-05T21:15:20.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.525+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:116 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94376598349440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c3a6d770 con 0x55d5c39b09d0 2023-10-05T21:15:20.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.526+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 42 ==== osd_op_reply(116 notify.1 [watch unwatch cookie 94376598349440] v29'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.526+0000 7f58364e7680 20 remove_watcher() i=1 2023-10-05T21:15:20.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.526+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:117 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94376598350864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c3a6d770 con 0x55d5c39e2030 2023-10-05T21:15:20.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.526+0000 7f58295bf700 1 -- 172.21.15.153:0/1976258138 <== osd.3 v2:172.21.15.153:6800/140455 33 ==== osd_op_reply(117 notify.2 [watch unwatch cookie 94376598350864] v29'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5820019040 con 0x55d5c39e2030 2023-10-05T21:15:20.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.526+0000 7f58364e7680 20 remove_watcher() i=2 2023-10-05T21:15:20.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.526+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:118 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94376598356416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39ea680 con 0x7f5820007030 2023-10-05T21:15:20.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.527+0000 7f5828dbe700 1 -- 172.21.15.153:0/1976258138 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== osd_op_reply(118 notify.3 [watch unwatch cookie 94376598356416] v29'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f581c0530b0 con 0x7f5820007030 2023-10-05T21:15:20.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.527+0000 7f58364e7680 20 remove_watcher() i=3 2023-10-05T21:15:20.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.527+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:119 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94376598359936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39eac10 con 0x55d5c39b09d0 2023-10-05T21:15:20.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.528+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 43 ==== osd_op_reply(119 notify.4 [watch unwatch cookie 94376598359936] v29'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.528+0000 7f58364e7680 20 remove_watcher() i=4 2023-10-05T21:15:20.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.528+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:120 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94376598362144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39ea680 con 0x7f581c00d8e0 2023-10-05T21:15:20.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.529+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(120 notify.5 [watch unwatch cookie 94376598362144] v29'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f582400a570 con 0x7f581c00d8e0 2023-10-05T21:15:20.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.529+0000 7f58364e7680 20 remove_watcher() i=5 2023-10-05T21:15:20.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.529+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:121 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94376598366240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39ecf80 con 0x7f581c00d8e0 2023-10-05T21:15:20.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.529+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(121 notify.6 [watch unwatch cookie 94376598366240] v29'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f582400a570 con 0x7f581c00d8e0 2023-10-05T21:15:20.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.529+0000 7f58364e7680 20 remove_watcher() i=6 2023-10-05T21:15:20.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.529+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:122 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94376598367536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39eac10 con 0x7f581c00d8e0 2023-10-05T21:15:20.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.530+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(122 notify.7 [watch unwatch cookie 94376598367536] v29'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f582400a570 con 0x7f581c00d8e0 2023-10-05T21:15:20.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.530+0000 7f58364e7680 20 remove_watcher() i=7 2023-10-05T21:15:20.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.531+0000 7f57fa7e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:20.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.531+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:123 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94376598370352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d5c39ed820 con 0x55d5c39b09d0 2023-10-05T21:15:20.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.532+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 <== osd.1 v2:172.21.15.153:6816/140456 44 ==== osd_op_reply(123 data_loggenerations_metadata [watch unwatch cookie 94376598370352] v29'171 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f582400a570 con 0x55d5c39b09d0 2023-10-05T21:15:20.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.532+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f581c00d8e0 msgr2=0x7f581c00c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.532+0000 7f58364e7680 1 --2- 172.21.15.153:0/1976258138 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f581c00d8e0 0x7f581c00c360 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.532+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d5c39b09d0 msgr2=0x55d5c39dfa30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.532+0000 7f58364e7680 1 --2- 172.21.15.153:0/1976258138 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d5c39b09d0 0x55d5c39dfa30 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.532+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f5820007030 msgr2=0x7f582001c6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.532+0000 7f58364e7680 1 --2- 172.21.15.153:0/1976258138 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f5820007030 0x7f582001c6c0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.532+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d5c39e2030 msgr2=0x55d5c39e4410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.532+0000 7f58364e7680 1 --2- 172.21.15.153:0/1976258138 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d5c39e2030 0x55d5c39e4410 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.532+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f580c034140 msgr2=0x7f580c0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.532+0000 7f58364e7680 1 --2- 172.21.15.153:0/1976258138 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f580c034140 0x7f580c0365f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f581c0011e0 tx=0x7f581c0013a0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.532+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c391f0a0 msgr2=0x55d5c39d3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.532+0000 7f58364e7680 1 --2- 172.21.15.153:0/1976258138 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c391f0a0 0x55d5c39d3ca0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f5820000c00 tx=0x7f582001d000 comp rx=0 tx=0).stop 2023-10-05T21:15:20.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.532+0000 7f5829dc0700 1 -- 172.21.15.153:0/1976258138 reap_dead start 2023-10-05T21:15:20.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.532+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 shutdown_connections 2023-10-05T21:15:20.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.532+0000 7f58364e7680 1 --2- 172.21.15.153:0/1976258138 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c391f0a0 0x55d5c39d3ca0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.532+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 >> 172.21.15.153:0/1976258138 conn(0x55d5c39a5b80 msgr2=0x55d5c39c6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:20.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.532+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 shutdown_connections 2023-10-05T21:15:20.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.532+0000 7f58364e7680 1 -- 172.21.15.153:0/1976258138 wait complete. 2023-10-05T21:15:20.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.532+0000 7f58364e7680 1 -- 172.21.15.153:0/3961182458 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f57700340f0 msgr2=0x7f57700365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.532+0000 7f58364e7680 1 --2- 172.21.15.153:0/3961182458 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f57700340f0 0x7f57700365a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55d5c39ef350 tx=0x7f5824037450 comp rx=0 tx=0).stop 2023-10-05T21:15:20.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.532+0000 7f58364e7680 1 -- 172.21.15.153:0/3961182458 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c39fc7d0 msgr2=0x55d5c3a035a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:20.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.533+0000 7f58364e7680 1 --2- 172.21.15.153:0/3961182458 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c39fc7d0 0x55d5c3a035a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f581c000fb0 tx=0x7f581c030000 comp rx=0 tx=0).stop 2023-10-05T21:15:20.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.533+0000 7f58364e7680 1 -- 172.21.15.153:0/3961182458 shutdown_connections 2023-10-05T21:15:20.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.533+0000 7f58364e7680 1 --2- 172.21.15.153:0/3961182458 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f57700340f0 0x7f57700365a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.533+0000 7f58364e7680 1 --2- 172.21.15.153:0/3961182458 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d5c39fc7d0 0x55d5c3a035a0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:20.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.533+0000 7f58364e7680 1 -- 172.21.15.153:0/3961182458 >> 172.21.15.153:0/3961182458 conn(0x55d5c39f8ad0 msgr2=0x55d5c39f6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:20.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.533+0000 7f58364e7680 1 -- 172.21.15.153:0/3961182458 shutdown_connections 2023-10-05T21:15:20.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:20.533+0000 7f58364e7680 1 -- 172.21.15.153:0/3961182458 wait complete. 2023-10-05T21:15:20.575 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:15:20.581 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2023-10-05T21:15:20.809 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2023-10-05T21:15:20.814 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T21:15:35.815 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2023-10-05T21:15:35.816 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2023-10-05T21:15:35.816 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2023-10-05T21:15:35.866 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:35.866 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:35.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.866+0000 7f90483af680 1 Processor -- start 2023-10-05T21:15:35.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.866+0000 7f90483af680 1 -- start start 2023-10-05T21:15:35.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.866+0000 7f90483af680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55d215a73a40 0x55d215a73e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:35.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.866+0000 7f90483af680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d2159c0990 con 0x55d215a74390 2023-10-05T21:15:35.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.866+0000 7f90483af680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d215980db0 con 0x55d215a73a40 2023-10-05T21:15:35.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.866+0000 7f903b487700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55d215a73a40 0x55d215a73e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:35.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.866+0000 7f903ac86700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55d215a74390 0x55d215a7ad30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:39218/0 (socket says 172.21.15.153:39218) 2023-10-05T21:15:35.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.866+0000 7f903ac86700 1 -- 172.21.15.153:0/1139870300 learned_addr learned my addr 172.21.15.153:0/1139870300 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:35.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.867+0000 7f903a485700 1 -- 172.21.15.153:0/1139870300 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2903378093 0 0) 0x55d2159c0990 con 0x55d215a74390 2023-10-05T21:15:35.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.867+0000 7f903a485700 1 -- 172.21.15.153:0/1139870300 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9024001e10 con 0x55d215a74390 2023-10-05T21:15:35.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.867+0000 7f903b487700 1 -- 172.21.15.153:0/1139870300 >> v1:172.21.15.111:6789/0 conn(0x55d215a74390 legacy=0x55d215a7ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:35.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.867+0000 7f903b487700 1 -- 172.21.15.153:0/1139870300 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d215a7d460 con 0x55d215a73a40 2023-10-05T21:15:35.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.867+0000 7f903b487700 1 --2- 172.21.15.153:0/1139870300 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215a73a40 0x55d215a73e50 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f902c00a520 tx=0x7f902c005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec71e70fa22d7da6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:35.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.867+0000 7f903a485700 1 -- 172.21.15.153:0/1139870300 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f902c00f590 con 0x55d215a73a40 2023-10-05T21:15:35.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.867+0000 7f903a485700 1 -- 172.21.15.153:0/1139870300 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902c00f6f0 con 0x55d215a73a40 2023-10-05T21:15:35.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.867+0000 7f903a485700 1 -- 172.21.15.153:0/1139870300 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f902c00f880 con 0x55d215a73a40 2023-10-05T21:15:35.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.868+0000 7f90483af680 1 -- 172.21.15.153:0/1139870300 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215a73a40 msgr2=0x55d215a73e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:35.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.868+0000 7f90483af680 1 --2- 172.21.15.153:0/1139870300 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215a73a40 0x55d215a73e50 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f902c00a520 tx=0x7f902c005d40 comp rx=0 tx=0).stop 2023-10-05T21:15:35.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.868+0000 7f90483af680 1 -- 172.21.15.153:0/1139870300 shutdown_connections 2023-10-05T21:15:35.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.868+0000 7f90483af680 1 --2- 172.21.15.153:0/1139870300 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215a73a40 0x55d215a73e50 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:35.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.868+0000 7f90483af680 1 -- 172.21.15.153:0/1139870300 >> 172.21.15.153:0/1139870300 conn(0x55d215a6d300 msgr2=0x55d215a6f710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:35.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.868+0000 7f90483af680 1 -- 172.21.15.153:0/1139870300 shutdown_connections 2023-10-05T21:15:35.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.868+0000 7f90483af680 1 -- 172.21.15.153:0/1139870300 wait complete. 2023-10-05T21:15:35.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.869+0000 7f90483af680 1 Processor -- start 2023-10-05T21:15:35.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.869+0000 7f90483af680 1 -- start start 2023-10-05T21:15:35.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.869+0000 7f90483af680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215a73a40 0x55d215a94820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:35.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.869+0000 7f90483af680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d215920ea0 con 0x55d215a73a40 2023-10-05T21:15:35.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.869+0000 7f903b487700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215a73a40 0x55d215a94820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:35.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.869+0000 7f903b487700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215a73a40 0x55d215a94820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57542/0 (socket says 172.21.15.153:57542) 2023-10-05T21:15:35.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.869+0000 7f903b487700 1 -- 172.21.15.153:0/1676837996 learned_addr learned my addr 172.21.15.153:0/1676837996 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:35.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.869+0000 7f903b487700 1 -- 172.21.15.153:0/1676837996 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f902c00a0e0 con 0x55d215a73a40 2023-10-05T21:15:35.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.869+0000 7f903b487700 1 --2- 172.21.15.153:0/1676837996 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215a73a40 0x55d215a94820 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f902c000f80 tx=0x7f902c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2207fe6e6d827c00 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:35.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.870+0000 7f9039483700 1 -- 172.21.15.153:0/1676837996 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f902c00f860 con 0x55d215a73a40 2023-10-05T21:15:35.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.870+0000 7f9039483700 1 -- 172.21.15.153:0/1676837996 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902c00f9c0 con 0x55d215a73a40 2023-10-05T21:15:35.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.870+0000 7f9039483700 1 -- 172.21.15.153:0/1676837996 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f902c00fb50 con 0x55d215a73a40 2023-10-05T21:15:35.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.870+0000 7f90483af680 1 -- 172.21.15.153:0/1676837996 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215a73a40 msgr2=0x55d215a94820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:35.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.870+0000 7f90483af680 1 --2- 172.21.15.153:0/1676837996 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215a73a40 0x55d215a94820 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f902c000f80 tx=0x7f902c014000 comp rx=0 tx=0).stop 2023-10-05T21:15:35.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.870+0000 7f90483af680 1 -- 172.21.15.153:0/1676837996 shutdown_connections 2023-10-05T21:15:35.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.870+0000 7f90483af680 1 --2- 172.21.15.153:0/1676837996 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215a73a40 0x55d215a94820 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:35.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.870+0000 7f90483af680 1 -- 172.21.15.153:0/1676837996 >> 172.21.15.153:0/1676837996 conn(0x55d215a6d300 msgr2=0x55d215a902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:35.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.870+0000 7f90483af680 1 -- 172.21.15.153:0/1676837996 shutdown_connections 2023-10-05T21:15:35.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.870+0000 7f90483af680 1 -- 172.21.15.153:0/1676837996 wait complete. 2023-10-05T21:15:35.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.870+0000 7f90483af680 1 Processor -- start 2023-10-05T21:15:35.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.871+0000 7f90483af680 1 -- start start 2023-10-05T21:15:35.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.871+0000 7f90483af680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215a73a40 0x55d215a9bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:35.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.871+0000 7f90483af680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d215917c80 con 0x55d215a73a40 2023-10-05T21:15:35.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.871+0000 7f903b487700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215a73a40 0x55d215a9bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:35.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.871+0000 7f903b487700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215a73a40 0x55d215a9bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57544/0 (socket says 172.21.15.153:57544) 2023-10-05T21:15:35.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.871+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 learned_addr learned my addr 172.21.15.153:0/4229765134 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:35.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.871+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d215a7d460 con 0x55d215a73a40 2023-10-05T21:15:35.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.872+0000 7f903b487700 1 --2- 172.21.15.153:0/4229765134 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215a73a40 0x55d215a9bd00 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f902c000f80 tx=0x7f902c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:35.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.872+0000 7f902b7fe700 1 -- 172.21.15.153:0/4229765134 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f902c02f430 con 0x55d215a73a40 2023-10-05T21:15:35.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.872+0000 7f902b7fe700 1 -- 172.21.15.153:0/4229765134 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902c02f590 con 0x55d215a73a40 2023-10-05T21:15:35.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.872+0000 7f902b7fe700 1 -- 172.21.15.153:0/4229765134 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f902c02f740 con 0x55d215a73a40 2023-10-05T21:15:35.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.872+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d215a9c240 con 0x55d215a73a40 2023-10-05T21:15:35.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.872+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d215a9c690 con 0x55d215a73a40 2023-10-05T21:15:35.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.873+0000 7f902b7fe700 1 -- 172.21.15.153:0/4229765134 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f902c010420 con 0x55d215a73a40 2023-10-05T21:15:35.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.873+0000 7f902b7fe700 1 --2- 172.21.15.153:0/4229765134 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9020034140 0x7f90200365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:35.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.873+0000 7f902b7fe700 1 -- 172.21.15.153:0/4229765134 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f902c02b070 con 0x55d215a73a40 2023-10-05T21:15:35.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.873+0000 7f903ac86700 1 --2- 172.21.15.153:0/4229765134 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9020034140 0x7f90200365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:35.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.873+0000 7f90483af680 20 rados->read ofs=0 len=0 2023-10-05T21:15:35.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.873+0000 7f90483af680 1 --2- 172.21.15.153:0/4229765134 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d215a74390 0x55d215aa7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:35.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.873+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aa81c0 con 0x55d215a74390 2023-10-05T21:15:35.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.874+0000 7f903ac86700 1 --2- 172.21.15.153:0/4229765134 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9020034140 0x7f90200365f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9030004170 tx=0x7f9030001360 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:35.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.874+0000 7f903bc88700 1 --2- 172.21.15.153:0/4229765134 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d215a74390 0x55d215aa7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:35.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.874+0000 7f903bc88700 1 --2- 172.21.15.153:0/4229765134 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d215a74390 0x55d215aa7a30 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:35.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.874+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f903400a500 con 0x55d215a74390 2023-10-05T21:15:35.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.874+0000 7f90483af680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:35.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.874+0000 7f90483af680 20 realm 2023-10-05T21:15:35.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.874+0000 7f90483af680 20 rados->read ofs=0 len=0 2023-10-05T21:15:35.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.874+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aa4f50 con 0x55d215a74390 2023-10-05T21:15:35.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.875+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f903400a500 con 0x55d215a74390 2023-10-05T21:15:35.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.875+0000 7f90483af680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:35.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.875+0000 7f90483af680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:35.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.875+0000 7f90483af680 20 rados->read ofs=0 len=0 2023-10-05T21:15:35.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.875+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aa8c70 con 0x55d215a74390 2023-10-05T21:15:35.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.875+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f903400a500 con 0x55d215a74390 2023-10-05T21:15:35.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.875+0000 7f90483af680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:35.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.875+0000 7f90483af680 20 rados->read ofs=0 len=0 2023-10-05T21:15:35.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.875+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aa9590 con 0x55d215a74390 2023-10-05T21:15:35.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.875+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f903400a500 con 0x55d215a74390 2023-10-05T21:15:35.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.875+0000 7f90483af680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:35.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.875+0000 7f90483af680 20 rados->read ofs=0 len=0 2023-10-05T21:15:35.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.875+0000 7f90483af680 1 --2- 172.21.15.153:0/4229765134 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d215aa9e50 0x55d215aac230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:35.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.875+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aac7f0 con 0x55d215aa9e50 2023-10-05T21:15:35.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.875+0000 7f903b487700 1 --2- 172.21.15.153:0/4229765134 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d215aa9e50 0x55d215aac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:35.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.876+0000 7f903b487700 1 --2- 172.21.15.153:0/4229765134 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d215aa9e50 0x55d215aac230 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:35.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.876+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f902c0387b0 con 0x55d215aa9e50 2023-10-05T21:15:35.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.876+0000 7f90483af680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:35.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.876+0000 7f90483af680 20 searching for the correct realm 2023-10-05T21:15:35.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.876+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x55d215aa9e50 2023-10-05T21:15:35.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.876+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f902c0387b0 con 0x55d215aa9e50 2023-10-05T21:15:35.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.876+0000 7f903b487700 1 --2- 172.21.15.153:0/4229765134 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f902c0383b0 0x7f902c038a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:35.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.876+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x7f902c0383b0 2023-10-05T21:15:35.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.876+0000 7f903ac86700 1 --2- 172.21.15.153:0/4229765134 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f902c0383b0 0x7f902c038a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:35.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.877+0000 7f903ac86700 1 --2- 172.21.15.153:0/4229765134 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f902c0383b0 0x7f902c038a70 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:35.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.877+0000 7f903ac86700 1 -- 172.21.15.153:0/4229765134 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9030006070 con 0x7f902c0383b0 2023-10-05T21:15:35.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.877+0000 7f903ac86700 1 --2- 172.21.15.153:0/4229765134 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f903000ebe0 0x7f903000d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:35.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.877+0000 7f903ac86700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x7f903000ebe0 2023-10-05T21:15:35.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.877+0000 7f903bc88700 1 --2- 172.21.15.153:0/4229765134 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f903000ebe0 0x7f903000d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:35.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.878+0000 7f903bc88700 1 --2- 172.21.15.153:0/4229765134 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f903000ebe0 0x7f903000d8e0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:35.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.878+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9034014040 con 0x7f903000ebe0 2023-10-05T21:15:35.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.878+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x55d215a74390 2023-10-05T21:15:35.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.878+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9034014040 con 0x55d215a74390 2023-10-05T21:15:35.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.878+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x55d215a74390 2023-10-05T21:15:35.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.879+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9034014040 con 0x55d215a74390 2023-10-05T21:15:35.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.879+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x7f903000ebe0 2023-10-05T21:15:35.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.879+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9034014040 con 0x7f903000ebe0 2023-10-05T21:15:35.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.879+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x7f903000ebe0 2023-10-05T21:15:35.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.879+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9034014040 con 0x7f903000ebe0 2023-10-05T21:15:35.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.879+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x7f902c0383b0 2023-10-05T21:15:35.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.879+0000 7f903ac86700 1 -- 172.21.15.153:0/4229765134 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9030006070 con 0x7f902c0383b0 2023-10-05T21:15:35.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.879+0000 7f903ac86700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x55d215aa9e50 2023-10-05T21:15:35.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.880+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f902c0387b0 con 0x55d215aa9e50 2023-10-05T21:15:35.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.880+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x55d215a74390 2023-10-05T21:15:35.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.880+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9034014040 con 0x55d215a74390 2023-10-05T21:15:35.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.880+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x7f903000ebe0 2023-10-05T21:15:35.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.880+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9034014040 con 0x7f903000ebe0 2023-10-05T21:15:35.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.880+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x55d215a74390 2023-10-05T21:15:35.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.880+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9034014040 con 0x55d215a74390 2023-10-05T21:15:35.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.881+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x7f902c0383b0 2023-10-05T21:15:35.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.881+0000 7f903ac86700 1 -- 172.21.15.153:0/4229765134 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9030006070 con 0x7f902c0383b0 2023-10-05T21:15:35.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.881+0000 7f903ac86700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x55d215aa9e50 2023-10-05T21:15:35.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.881+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f902c0387b0 con 0x55d215aa9e50 2023-10-05T21:15:35.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.881+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x55d215aa9e50 2023-10-05T21:15:35.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.881+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f902c0387b0 con 0x55d215aa9e50 2023-10-05T21:15:35.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.881+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x7f903000ebe0 2023-10-05T21:15:35.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.882+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9034014040 con 0x7f903000ebe0 2023-10-05T21:15:35.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.882+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x55d215aa9e50 2023-10-05T21:15:35.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.882+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f902c0387b0 con 0x55d215aa9e50 2023-10-05T21:15:35.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.882+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x55d215aa9e50 2023-10-05T21:15:35.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.882+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f902c0387b0 con 0x55d215aa9e50 2023-10-05T21:15:35.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.882+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x55d215a74390 2023-10-05T21:15:35.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.882+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9034014040 con 0x55d215a74390 2023-10-05T21:15:35.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.882+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x55d215a74390 2023-10-05T21:15:35.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.883+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f9034022080 con 0x55d215a74390 2023-10-05T21:15:35.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.883+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x7f903000ebe0 2023-10-05T21:15:35.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.883+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9034022080 con 0x7f903000ebe0 2023-10-05T21:15:35.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.883+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x55d215aa9e50 2023-10-05T21:15:35.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.883+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f902c0387b0 con 0x55d215aa9e50 2023-10-05T21:15:35.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.883+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x7f902c0383b0 2023-10-05T21:15:35.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.884+0000 7f903ac86700 1 -- 172.21.15.153:0/4229765134 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9030006070 con 0x7f902c0383b0 2023-10-05T21:15:35.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.884+0000 7f903ac86700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x55d215a74390 2023-10-05T21:15:35.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.884+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9034022080 con 0x55d215a74390 2023-10-05T21:15:35.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.884+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x7f903000ebe0 2023-10-05T21:15:35.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.884+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9034022080 con 0x7f903000ebe0 2023-10-05T21:15:35.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.884+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x55d215aa9e50 2023-10-05T21:15:35.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.884+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f902c0387b0 con 0x55d215aa9e50 2023-10-05T21:15:35.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.884+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x7f903000ebe0 2023-10-05T21:15:35.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.885+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9034022080 con 0x7f903000ebe0 2023-10-05T21:15:35.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.885+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x7f902c0383b0 2023-10-05T21:15:35.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.885+0000 7f903ac86700 1 -- 172.21.15.153:0/4229765134 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9030006070 con 0x7f902c0383b0 2023-10-05T21:15:35.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.885+0000 7f903ac86700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x55d215aa9e50 2023-10-05T21:15:35.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.885+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f902c0387b0 con 0x55d215aa9e50 2023-10-05T21:15:35.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.885+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x7f903000ebe0 2023-10-05T21:15:35.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.886+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9034022080 con 0x7f903000ebe0 2023-10-05T21:15:35.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.886+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x55d215a74390 2023-10-05T21:15:35.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.886+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f9034022080 con 0x55d215a74390 2023-10-05T21:15:35.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.886+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae110 con 0x7f902c0383b0 2023-10-05T21:15:35.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.886+0000 7f903ac86700 1 -- 172.21.15.153:0/4229765134 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9030006070 con 0x7f902c0383b0 2023-10-05T21:15:35.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.886+0000 7f90483af680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:35.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.886+0000 7f90483af680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:35.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.886+0000 7f90483af680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:35.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.886+0000 7f90483af680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:35.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.886+0000 7f90483af680 20 rados->read ofs=0 len=0 2023-10-05T21:15:35.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.886+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aad330 con 0x55d215a74390 2023-10-05T21:15:35.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.886+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9034022080 con 0x55d215a74390 2023-10-05T21:15:35.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.886+0000 7f90483af680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:35.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.886+0000 7f90483af680 20 rados->read ofs=0 len=0 2023-10-05T21:15:35.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.886+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aad7c0 con 0x55d215a74390 2023-10-05T21:15:35.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.887+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9034022080 con 0x55d215a74390 2023-10-05T21:15:35.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.887+0000 7f90483af680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:35.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.887+0000 7f90483af680 20 rados->read ofs=0 len=0 2023-10-05T21:15:35.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.887+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aadbf0 con 0x55d215a74390 2023-10-05T21:15:35.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.887+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f9034022080 con 0x55d215a74390 2023-10-05T21:15:35.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.887+0000 7f90483af680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:35.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.887+0000 7f90483af680 20 rados->read ofs=0 len=0 2023-10-05T21:15:35.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.887+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aace90 con 0x55d215aa9e50 2023-10-05T21:15:35.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.887+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f902c0387b0 con 0x55d215aa9e50 2023-10-05T21:15:35.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.887+0000 7f90483af680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:35.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.887+0000 7f90483af680 20 rados->read ofs=0 len=0 2023-10-05T21:15:35.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.887+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aae9b0 con 0x55d215a74390 2023-10-05T21:15:35.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.888+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9034022080 con 0x55d215a74390 2023-10-05T21:15:35.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.888+0000 7f90483af680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:35.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.888+0000 7f90483af680 20 rados->read ofs=0 len=0 2023-10-05T21:15:35.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.888+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aaeaa0 con 0x55d215a74390 2023-10-05T21:15:35.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.888+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9034022080 con 0x55d215a74390 2023-10-05T21:15:35.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.888+0000 7f90483af680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:35.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.888+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aaea70 con 0x55d215aa9e50 2023-10-05T21:15:35.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.888+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f902c0387b0 con 0x55d215aa9e50 2023-10-05T21:15:35.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.888+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aaea70 con 0x7f902c0383b0 2023-10-05T21:15:35.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.888+0000 7f903ac86700 1 -- 172.21.15.153:0/4229765134 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9030006070 con 0x7f902c0383b0 2023-10-05T21:15:35.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.888+0000 7f903ac86700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aaea70 con 0x7f903000ebe0 2023-10-05T21:15:35.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.889+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9034022080 con 0x7f903000ebe0 2023-10-05T21:15:35.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.889+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aadbf0 con 0x55d215a74390 2023-10-05T21:15:35.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.889+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9034022080 con 0x55d215a74390 2023-10-05T21:15:35.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.889+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aadbf0 con 0x55d215a74390 2023-10-05T21:15:35.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.889+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9034022080 con 0x55d215a74390 2023-10-05T21:15:35.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.889+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aadbf0 con 0x7f903000ebe0 2023-10-05T21:15:35.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.890+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9034022080 con 0x7f903000ebe0 2023-10-05T21:15:35.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.890+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aadbf0 con 0x7f903000ebe0 2023-10-05T21:15:35.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.890+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9034022080 con 0x7f903000ebe0 2023-10-05T21:15:35.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.890+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aadbf0 con 0x7f902c0383b0 2023-10-05T21:15:35.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.890+0000 7f903ac86700 1 -- 172.21.15.153:0/4229765134 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9030006070 con 0x7f902c0383b0 2023-10-05T21:15:35.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.890+0000 7f903ac86700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aadbf0 con 0x55d215aa9e50 2023-10-05T21:15:35.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.890+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f902c0387b0 con 0x55d215aa9e50 2023-10-05T21:15:35.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.890+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aadbf0 con 0x55d215a74390 2023-10-05T21:15:35.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.891+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9034022080 con 0x55d215a74390 2023-10-05T21:15:35.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.891+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aadbf0 con 0x7f903000ebe0 2023-10-05T21:15:35.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.891+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9034022080 con 0x7f903000ebe0 2023-10-05T21:15:35.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.891+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aadbf0 con 0x55d215a74390 2023-10-05T21:15:35.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.891+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9034022080 con 0x55d215a74390 2023-10-05T21:15:35.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.891+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aadbf0 con 0x7f902c0383b0 2023-10-05T21:15:35.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.891+0000 7f903ac86700 1 -- 172.21.15.153:0/4229765134 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9030006070 con 0x7f902c0383b0 2023-10-05T21:15:35.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.891+0000 7f903ac86700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aadbf0 con 0x55d215aa9e50 2023-10-05T21:15:35.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.892+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f902c0387b0 con 0x55d215aa9e50 2023-10-05T21:15:35.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.892+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aadbf0 con 0x55d215aa9e50 2023-10-05T21:15:35.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.892+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f902c0387b0 con 0x55d215aa9e50 2023-10-05T21:15:35.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.892+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aadbf0 con 0x7f903000ebe0 2023-10-05T21:15:35.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.892+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9034022080 con 0x7f903000ebe0 2023-10-05T21:15:35.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.892+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aadbf0 con 0x55d215aa9e50 2023-10-05T21:15:35.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.892+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f902c0387b0 con 0x55d215aa9e50 2023-10-05T21:15:35.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.892+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aadbf0 con 0x55d215aa9e50 2023-10-05T21:15:35.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.893+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f902c0387b0 con 0x55d215aa9e50 2023-10-05T21:15:35.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.893+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aadbf0 con 0x55d215a74390 2023-10-05T21:15:35.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.893+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9034022080 con 0x55d215a74390 2023-10-05T21:15:35.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.893+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aadbf0 con 0x55d215a74390 2023-10-05T21:15:35.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.893+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f9034022080 con 0x55d215a74390 2023-10-05T21:15:35.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.893+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aadbf0 con 0x7f903000ebe0 2023-10-05T21:15:35.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.894+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9034022080 con 0x7f903000ebe0 2023-10-05T21:15:35.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.894+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aadbf0 con 0x55d215aa9e50 2023-10-05T21:15:35.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.894+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f902c0387b0 con 0x55d215aa9e50 2023-10-05T21:15:35.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.894+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aadbf0 con 0x7f902c0383b0 2023-10-05T21:15:35.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.894+0000 7f903ac86700 1 -- 172.21.15.153:0/4229765134 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9030006070 con 0x7f902c0383b0 2023-10-05T21:15:35.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.894+0000 7f903ac86700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aadbf0 con 0x55d215a74390 2023-10-05T21:15:35.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.894+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9034022080 con 0x55d215a74390 2023-10-05T21:15:35.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.894+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aadbf0 con 0x7f903000ebe0 2023-10-05T21:15:35.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.895+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9034022080 con 0x7f903000ebe0 2023-10-05T21:15:35.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.895+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aadbf0 con 0x55d215aa9e50 2023-10-05T21:15:35.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.895+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f902c0387b0 con 0x55d215aa9e50 2023-10-05T21:15:35.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.895+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aadbf0 con 0x7f903000ebe0 2023-10-05T21:15:35.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.895+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9034022080 con 0x7f903000ebe0 2023-10-05T21:15:35.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.895+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aadbf0 con 0x7f902c0383b0 2023-10-05T21:15:35.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.895+0000 7f903ac86700 1 -- 172.21.15.153:0/4229765134 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9030006070 con 0x7f902c0383b0 2023-10-05T21:15:35.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.895+0000 7f903ac86700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aadbf0 con 0x55d215aa9e50 2023-10-05T21:15:35.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.896+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f902c0387b0 con 0x55d215aa9e50 2023-10-05T21:15:35.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.896+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aadbf0 con 0x7f903000ebe0 2023-10-05T21:15:35.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.896+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9034022080 con 0x7f903000ebe0 2023-10-05T21:15:35.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.896+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aadbf0 con 0x55d215a74390 2023-10-05T21:15:35.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.896+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f9034022080 con 0x55d215a74390 2023-10-05T21:15:35.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.896+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aadbf0 con 0x7f902c0383b0 2023-10-05T21:15:35.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.897+0000 7f903ac86700 1 -- 172.21.15.153:0/4229765134 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9030006070 con 0x7f902c0383b0 2023-10-05T21:15:35.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.897+0000 7f90483af680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:35.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.897+0000 7f90483af680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:35.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.897+0000 7f90483af680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:35.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.897+0000 7f90483af680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:35.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.897+0000 7f90483af680 20 rados->read ofs=0 len=0 2023-10-05T21:15:35.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.897+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aaea70 con 0x55d215a74390 2023-10-05T21:15:35.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.897+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9034022080 con 0x55d215a74390 2023-10-05T21:15:35.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.897+0000 7f90483af680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:35.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.897+0000 7f90483af680 20 rados->read ofs=0 len=0 2023-10-05T21:15:35.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.897+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aaeed0 con 0x55d215aa9e50 2023-10-05T21:15:35.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.897+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f902c05d040 con 0x55d215aa9e50 2023-10-05T21:15:35.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.897+0000 7f90483af680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:35.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.897+0000 7f90483af680 20 rados->read ofs=0 len=0 2023-10-05T21:15:35.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.897+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aaf7c0 con 0x55d215a74390 2023-10-05T21:15:35.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.897+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9034022080 con 0x55d215a74390 2023-10-05T21:15:35.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.897+0000 7f90483af680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:35.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.897+0000 7f90483af680 20 rados->read ofs=0 len=0 2023-10-05T21:15:35.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.897+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aaf7c0 con 0x55d215a74390 2023-10-05T21:15:35.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.898+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f9034022080 con 0x55d215a74390 2023-10-05T21:15:35.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.898+0000 7f90483af680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:35.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.898+0000 7f90483af680 20 rados->read ofs=0 len=0 2023-10-05T21:15:35.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.898+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aaf7c0 con 0x7f903000ebe0 2023-10-05T21:15:35.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.898+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f9034022080 con 0x7f903000ebe0 2023-10-05T21:15:35.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.898+0000 7f90483af680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:35.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.898+0000 7f90483af680 20 zone default found 2023-10-05T21:15:35.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.898+0000 7f90483af680 4 Realm: () 2023-10-05T21:15:35.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.898+0000 7f90483af680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:35.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.898+0000 7f90483af680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:35.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.898+0000 7f90483af680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:35.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.898+0000 7f90483af680 20 zonegroup default 2023-10-05T21:15:35.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.898+0000 7f90483af680 20 rados->read ofs=0 len=0 2023-10-05T21:15:35.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.898+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aaf7c0 con 0x7f903000ebe0 2023-10-05T21:15:35.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.898+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f9034022080 con 0x7f903000ebe0 2023-10-05T21:15:35.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.898+0000 7f90483af680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:35.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.898+0000 7f90483af680 20 rados->read ofs=0 len=0 2023-10-05T21:15:35.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.898+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aaf7c0 con 0x55d215aa9e50 2023-10-05T21:15:35.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.899+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f902c05d040 con 0x55d215aa9e50 2023-10-05T21:15:35.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.899+0000 7f90483af680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:35.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.899+0000 7f90483af680 20 rados->read ofs=0 len=0 2023-10-05T21:15:35.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.899+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ab18b0 con 0x55d215aa9e50 2023-10-05T21:15:35.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.899+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f902c05d040 con 0x55d215aa9e50 2023-10-05T21:15:35.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.899+0000 7f90483af680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:35.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.899+0000 7f90483af680 20 started sync module instance, tier type = 2023-10-05T21:15:35.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.899+0000 7f90483af680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:35.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.899+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ab0f70 con 0x7f902c0383b0 2023-10-05T21:15:35.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.900+0000 7f903ac86700 1 -- 172.21.15.153:0/4229765134 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9030006070 con 0x7f902c0383b0 2023-10-05T21:15:35.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.900+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94360795017936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ab1c60 con 0x7f902c0383b0 2023-10-05T21:15:35.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.900+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ab2620 con 0x55d215a74390 2023-10-05T21:15:35.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.901+0000 7f903ac86700 1 -- 172.21.15.153:0/4229765134 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94360795017936] v29'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9030006070 con 0x7f902c0383b0 2023-10-05T21:15:35.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.901+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9034022080 con 0x55d215a74390 2023-10-05T21:15:35.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.901+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94360795029712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ab2a20 con 0x55d215a74390 2023-10-05T21:15:35.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.901+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ab3430 con 0x55d215aa9e50 2023-10-05T21:15:35.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.902+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94360795029712] v29'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9034022080 con 0x55d215a74390 2023-10-05T21:15:35.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.902+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f902c05d040 con 0x55d215aa9e50 2023-10-05T21:15:35.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.902+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94360795033408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ab3830 con 0x55d215aa9e50 2023-10-05T21:15:35.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.902+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ab4240 con 0x7f902c0383b0 2023-10-05T21:15:35.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.903+0000 7f903ac86700 1 -- 172.21.15.153:0/4229765134 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9030006070 con 0x7f902c0383b0 2023-10-05T21:15:35.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.903+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94360795037008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ab4ae0 con 0x7f902c0383b0 2023-10-05T21:15:35.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.903+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ab54f0 con 0x55d215a74390 2023-10-05T21:15:35.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.903+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94360795033408] v29'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f902c05d040 con 0x55d215aa9e50 2023-10-05T21:15:35.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.904+0000 7f903ac86700 1 -- 172.21.15.153:0/4229765134 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94360795037008] v29'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9030006070 con 0x7f902c0383b0 2023-10-05T21:15:35.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.904+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9034022080 con 0x55d215a74390 2023-10-05T21:15:35.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.904+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94360795026288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ab54f0 con 0x55d215a74390 2023-10-05T21:15:35.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.904+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ab5de0 con 0x7f903000ebe0 2023-10-05T21:15:35.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.905+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94360795026288] v29'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9034022080 con 0x55d215a74390 2023-10-05T21:15:35.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.905+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9034022080 con 0x7f903000ebe0 2023-10-05T21:15:35.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.905+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94360795044640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ab54f0 con 0x7f903000ebe0 2023-10-05T21:15:35.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.905+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ab6840 con 0x7f903000ebe0 2023-10-05T21:15:35.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.905+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(96 notify.6 [create] v29'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9034022080 con 0x7f903000ebe0 2023-10-05T21:15:35.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.905+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(95 notify.5 [watch watch cookie 94360795044640] v29'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9034022080 con 0x7f903000ebe0 2023-10-05T21:15:35.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.905+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94360795046736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ab6cd0 con 0x7f903000ebe0 2023-10-05T21:15:35.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.906+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ab76e0 con 0x7f903000ebe0 2023-10-05T21:15:35.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.906+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94360795046736] v29'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9034022080 con 0x7f903000ebe0 2023-10-05T21:15:35.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.906+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9034022080 con 0x7f903000ebe0 2023-10-05T21:15:35.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.906+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94360795047840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ab6bf0 con 0x7f903000ebe0 2023-10-05T21:15:35.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.906+0000 7f90483af680 20 add_watcher() i=0 2023-10-05T21:15:35.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.906+0000 7f90483af680 20 add_watcher() i=1 2023-10-05T21:15:35.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.906+0000 7f90483af680 20 add_watcher() i=2 2023-10-05T21:15:35.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.906+0000 7f90483af680 20 add_watcher() i=3 2023-10-05T21:15:35.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.906+0000 7f90483af680 20 add_watcher() i=4 2023-10-05T21:15:35.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.906+0000 7f90483af680 20 add_watcher() i=5 2023-10-05T21:15:35.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.906+0000 7f90483af680 20 add_watcher() i=6 2023-10-05T21:15:35.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.907+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94360795047840] v29'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9034022080 con 0x7f903000ebe0 2023-10-05T21:15:35.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.907+0000 7f90483af680 20 add_watcher() i=7 2023-10-05T21:15:35.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.907+0000 7f90483af680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:35.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.907+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aba710 con 0x55d215a74390 2023-10-05T21:15:35.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.907+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f9034022080 con 0x55d215a74390 2023-10-05T21:15:35.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.907+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94360795050480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ab7b70 con 0x55d215a74390 2023-10-05T21:15:35.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.908+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94360795050480] v29'172 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9034022080 con 0x55d215a74390 2023-10-05T21:15:35.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.908+0000 7f8f87fff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:35.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.908+0000 7f90483af680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:35.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.908+0000 7f90483af680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:35.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.909+0000 7f90483af680 1 Processor -- start 2023-10-05T21:15:35.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.909+0000 7f90483af680 1 -- start start 2023-10-05T21:15:35.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.909+0000 7f90483af680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215ac50a0 0x55d215ac54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:35.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.909+0000 7f90483af680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d215ac5a80 con 0x55d215ac50a0 2023-10-05T21:15:35.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.909+0000 7f903ac86700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215ac50a0 0x55d215ac54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:35.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.909+0000 7f903ac86700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215ac50a0 0x55d215ac54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57552/0 (socket says 172.21.15.153:57552) 2023-10-05T21:15:35.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.909+0000 7f903ac86700 1 -- 172.21.15.153:0/1183925049 learned_addr learned my addr 172.21.15.153:0/1183925049 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:35.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.910+0000 7f903ac86700 1 -- 172.21.15.153:0/1183925049 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d215ac5bc0 con 0x55d215ac50a0 2023-10-05T21:15:35.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.910+0000 7f903ac86700 1 --2- 172.21.15.153:0/1183925049 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215ac50a0 0x55d215ac54b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x55d215aa9020 tx=0x7f9030006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7677510d50b727 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:35.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.910+0000 7f8f877fe700 1 -- 172.21.15.153:0/1183925049 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9030023040 con 0x55d215ac50a0 2023-10-05T21:15:35.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.910+0000 7f8f877fe700 1 -- 172.21.15.153:0/1183925049 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9030024040 con 0x55d215ac50a0 2023-10-05T21:15:35.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.910+0000 7f8f877fe700 1 -- 172.21.15.153:0/1183925049 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9030013040 con 0x55d215ac50a0 2023-10-05T21:15:35.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.911+0000 7f90483af680 1 -- 172.21.15.153:0/1183925049 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215ac50a0 msgr2=0x55d215ac54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:35.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.911+0000 7f90483af680 1 --2- 172.21.15.153:0/1183925049 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215ac50a0 0x55d215ac54b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x55d215aa9020 tx=0x7f9030006000 comp rx=0 tx=0).stop 2023-10-05T21:15:35.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.911+0000 7f90483af680 1 -- 172.21.15.153:0/1183925049 shutdown_connections 2023-10-05T21:15:35.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.911+0000 7f90483af680 1 --2- 172.21.15.153:0/1183925049 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215ac50a0 0x55d215ac54b0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:35.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.911+0000 7f90483af680 1 -- 172.21.15.153:0/1183925049 >> 172.21.15.153:0/1183925049 conn(0x55d215ac02a0 msgr2=0x55d215abe400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:35.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.911+0000 7f90483af680 1 -- 172.21.15.153:0/1183925049 shutdown_connections 2023-10-05T21:15:35.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.911+0000 7f90483af680 1 -- 172.21.15.153:0/1183925049 wait complete. 2023-10-05T21:15:35.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.911+0000 7f90483af680 1 Processor -- start 2023-10-05T21:15:35.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.911+0000 7f90483af680 1 -- start start 2023-10-05T21:15:35.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.912+0000 7f90483af680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215ac50a0 0x55d215acac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:35.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.912+0000 7f90483af680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d215acb140 con 0x55d215ac50a0 2023-10-05T21:15:35.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.912+0000 7f903ac86700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215ac50a0 0x55d215acac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:35.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.912+0000 7f903ac86700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215ac50a0 0x55d215acac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57568/0 (socket says 172.21.15.153:57568) 2023-10-05T21:15:35.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.912+0000 7f903ac86700 1 -- 172.21.15.153:0/3898065605 learned_addr learned my addr 172.21.15.153:0/3898065605 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:35.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.912+0000 7f903ac86700 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9024001e10 con 0x55d215ac50a0 2023-10-05T21:15:35.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.912+0000 7f903ac86700 1 --2- 172.21.15.153:0/3898065605 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215ac50a0 0x55d215acac00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f90300017a0 tx=0x7f9030030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:35.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.912+0000 7f8f85ffb700 1 -- 172.21.15.153:0/3898065605 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9030023070 con 0x55d215ac50a0 2023-10-05T21:15:35.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.912+0000 7f8f85ffb700 1 -- 172.21.15.153:0/3898065605 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903001e630 con 0x55d215ac50a0 2023-10-05T21:15:35.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.912+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d215acb340 con 0x55d215ac50a0 2023-10-05T21:15:35.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.912+0000 7f8f85ffb700 1 -- 172.21.15.153:0/3898065605 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f903001e800 con 0x55d215ac50a0 2023-10-05T21:15:35.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.913+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d215acb790 con 0x55d215ac50a0 2023-10-05T21:15:35.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.913+0000 7f8f85ffb700 1 -- 172.21.15.153:0/3898065605 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f903001e960 con 0x55d215ac50a0 2023-10-05T21:15:35.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.913+0000 7f8f85ffb700 1 --2- 172.21.15.153:0/3898065605 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8f780340f0 0x7f8f780365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:35.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.914+0000 7f8f85ffb700 1 -- 172.21.15.153:0/3898065605 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f9030043ac0 con 0x55d215ac50a0 2023-10-05T21:15:35.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.914+0000 7f903bc88700 1 --2- 172.21.15.153:0/3898065605 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8f780340f0 0x7f8f780365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:35.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.914+0000 7f90483af680 1 --2- 172.21.15.153:0/3898065605 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d215ad59c0 0x55d215ad7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:35.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.914+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ad8570 con 0x55d215ad59c0 2023-10-05T21:15:35.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.914+0000 7f903b487700 1 --2- 172.21.15.153:0/3898065605 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d215ad59c0 0x55d215ad7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:35.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.914+0000 7f903bc88700 1 --2- 172.21.15.153:0/3898065605 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8f780340f0 0x7f8f780365a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55d215ab6f40 tx=0x7f9034005500 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:35.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.914+0000 7f903b487700 1 --2- 172.21.15.153:0/3898065605 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d215ad59c0 0x55d215ad7e70 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:35.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.915+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v29'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ad59c0 2023-10-05T21:15:35.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.915+0000 7f90483af680 1 --2- 172.21.15.153:0/3898065605 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55d215ad92f0 0x55d215adb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:35.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.915+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215adbd90 con 0x55d215ad92f0 2023-10-05T21:15:35.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.915+0000 7f903ac86700 1 --2- 172.21.15.153:0/3898065605 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55d215ad92f0 0x55d215adb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:35.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.916+0000 7f903ac86700 1 --2- 172.21.15.153:0/3898065605 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55d215ad92f0 0x55d215adb6d0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:35.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.917+0000 7f903ac86700 1 -- 172.21.15.153:0/3898065605 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v29'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f903003f040 con 0x55d215ad92f0 2023-10-05T21:15:35.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.917+0000 7f90483af680 1 --2- 172.21.15.153:0/3898065605 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d215adcf00 0x55d215adf380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:35.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.917+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215adfad0 con 0x55d215adcf00 2023-10-05T21:15:35.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.917+0000 7f903bc88700 1 --2- 172.21.15.153:0/3898065605 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d215adcf00 0x55d215adf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:35.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.917+0000 7f903bc88700 1 --2- 172.21.15.153:0/3898065605 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d215adcf00 0x55d215adf380 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:35.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.918+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v29'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9034022080 con 0x55d215adcf00 2023-10-05T21:15:35.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.918+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ae0200 con 0x55d215ad59c0 2023-10-05T21:15:35.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.919+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v29'173 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ad59c0 2023-10-05T21:15:35.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.919+0000 7f90483af680 1 --2- 172.21.15.153:0/3898065605 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55d215ae0f80 0x55d215ae3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:35.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.919+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ae3a60 con 0x55d215ae0f80 2023-10-05T21:15:35.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.919+0000 7f903b487700 1 --2- 172.21.15.153:0/3898065605 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55d215ae0f80 0x55d215ae3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:35.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.919+0000 7f903b487700 1 --2- 172.21.15.153:0/3898065605 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55d215ae0f80 0x55d215ae3360 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:35.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.920+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v29'48 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ae0f80 2023-10-05T21:15:35.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.920+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ae4170 con 0x55d215adcf00 2023-10-05T21:15:35.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.920+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v29'29 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9034022080 con 0x55d215adcf00 2023-10-05T21:15:35.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.921+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ae4810 con 0x55d215ad59c0 2023-10-05T21:15:35.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.922+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v29'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ad59c0 2023-10-05T21:15:35.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.922+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ae4810 con 0x55d215ad92f0 2023-10-05T21:15:35.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.922+0000 7f903ac86700 1 -- 172.21.15.153:0/3898065605 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v29'33 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f903003f040 con 0x55d215ad92f0 2023-10-05T21:15:35.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.922+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ae4e70 con 0x55d215ae0f80 2023-10-05T21:15:35.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.923+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v29'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ae0f80 2023-10-05T21:15:35.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.923+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ae4e70 con 0x55d215adcf00 2023-10-05T21:15:35.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.924+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v29'24 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9034022080 con 0x55d215adcf00 2023-10-05T21:15:35.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.924+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ae5490 con 0x55d215ae0f80 2023-10-05T21:15:35.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.925+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v29'49 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ae0f80 2023-10-05T21:15:35.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.925+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ae5490 con 0x55d215ad92f0 2023-10-05T21:15:35.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.926+0000 7f903ac86700 1 -- 172.21.15.153:0/3898065605 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v29'24 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f903003f040 con 0x55d215ad92f0 2023-10-05T21:15:35.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.926+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ae5ab0 con 0x55d215ae0f80 2023-10-05T21:15:35.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.927+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v29'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ae0f80 2023-10-05T21:15:35.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.927+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ae5ab0 con 0x55d215ad92f0 2023-10-05T21:15:35.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.928+0000 7f903ac86700 1 -- 172.21.15.153:0/3898065605 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v29'35 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f903003f040 con 0x55d215ad92f0 2023-10-05T21:15:35.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.928+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ae5c50 con 0x55d215ad59c0 2023-10-05T21:15:35.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.928+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v29'174 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ad59c0 2023-10-05T21:15:35.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.929+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ae5c10 con 0x55d215adcf00 2023-10-05T21:15:35.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.929+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v29'38 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9034022080 con 0x55d215adcf00 2023-10-05T21:15:35.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.929+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ae5c10 con 0x55d215ae0f80 2023-10-05T21:15:35.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.930+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v29'50 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ae0f80 2023-10-05T21:15:35.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.930+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ae5c10 con 0x55d215adcf00 2023-10-05T21:15:35.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.931+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v29'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9034022080 con 0x55d215adcf00 2023-10-05T21:15:35.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.931+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ae5c10 con 0x55d215ad59c0 2023-10-05T21:15:35.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.932+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v29'29 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ad59c0 2023-10-05T21:15:35.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.932+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ae5c10 con 0x55d215ad59c0 2023-10-05T21:15:35.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.932+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v29'175 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ad59c0 2023-10-05T21:15:35.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.932+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ae5c10 con 0x55d215adcf00 2023-10-05T21:15:35.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.933+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v29'39 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9034022080 con 0x55d215adcf00 2023-10-05T21:15:35.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.933+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ae5c10 con 0x55d215ae0f80 2023-10-05T21:15:35.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.934+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v29'34 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ae0f80 2023-10-05T21:15:35.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.934+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ae5c10 con 0x55d215adcf00 2023-10-05T21:15:35.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.935+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v29'23 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9034022080 con 0x55d215adcf00 2023-10-05T21:15:35.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.935+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ae5c10 con 0x55d215adcf00 2023-10-05T21:15:35.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.935+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v29'24 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9034022080 con 0x55d215adcf00 2023-10-05T21:15:35.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.935+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ae5c10 con 0x55d215adcf00 2023-10-05T21:15:35.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.936+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v29'26 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9034022080 con 0x55d215adcf00 2023-10-05T21:15:35.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.936+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ae5c10 con 0x55d215adcf00 2023-10-05T21:15:35.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.937+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v29'30 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9034022080 con 0x55d215adcf00 2023-10-05T21:15:35.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.937+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ae5c10 con 0x55d215ad92f0 2023-10-05T21:15:35.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.938+0000 7f903ac86700 1 -- 172.21.15.153:0/3898065605 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v29'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f903003f040 con 0x55d215ad92f0 2023-10-05T21:15:35.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.938+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ae5c10 con 0x55d215adcf00 2023-10-05T21:15:35.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.938+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v29'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9034022080 con 0x55d215adcf00 2023-10-05T21:15:35.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.938+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ae5c10 con 0x55d215ad92f0 2023-10-05T21:15:35.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.940+0000 7f903ac86700 1 -- 172.21.15.153:0/3898065605 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v29'34 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f903003f040 con 0x55d215ad92f0 2023-10-05T21:15:35.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.940+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ae5c10 con 0x55d215adcf00 2023-10-05T21:15:35.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.941+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v29'40 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9034022080 con 0x55d215adcf00 2023-10-05T21:15:35.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.941+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ae5c10 con 0x55d215ad92f0 2023-10-05T21:15:35.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.942+0000 7f903ac86700 1 -- 172.21.15.153:0/3898065605 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v29'36 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f903003f040 con 0x55d215ad92f0 2023-10-05T21:15:35.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.942+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ae5c10 con 0x55d215ae0f80 2023-10-05T21:15:35.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.943+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v29'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ae0f80 2023-10-05T21:15:35.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.944+0000 7f8f7effd700 20 reqs_thread_entry: start 2023-10-05T21:15:35.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.944+0000 7f8f7cff9700 20 reqs_thread_entry: start 2023-10-05T21:15:35.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.944+0000 7f90483af680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:35.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.944+0000 7f90483af680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:35.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.944+0000 7f8f6affd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:16:06 2023 2023-10-05T21:15:35.991 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:35.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.944+0000 7f8f6a7fc700 20 reqs_thread_entry: start 2023-10-05T21:15:35.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.944+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:33 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ad59c0 2023-10-05T21:15:35.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.944+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(33 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ad59c0 2023-10-05T21:15:35.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.944+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:34 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215ad59c0 2023-10-05T21:15:35.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.945+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(34 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ad59c0 2023-10-05T21:15:35.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.945+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:35 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ad59c0 2023-10-05T21:15:35.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.945+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(35 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ad59c0 2023-10-05T21:15:35.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.945+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:36 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ad92f0 2023-10-05T21:15:35.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.945+0000 7f903ac86700 1 -- 172.21.15.153:0/3898065605 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(36 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f903003f040 con 0x55d215ad92f0 2023-10-05T21:15:35.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.945+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:37 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215ad92f0 2023-10-05T21:15:35.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.945+0000 7f903ac86700 1 -- 172.21.15.153:0/3898065605 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(37 gc.1 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f903003f040 con 0x55d215ad92f0 2023-10-05T21:15:35.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.945+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:38 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ad92f0 2023-10-05T21:15:35.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.946+0000 7f903ac86700 1 -- 172.21.15.153:0/3898065605 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(38 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f903003f040 con 0x55d215ad92f0 2023-10-05T21:15:35.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.946+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:39 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215adcf00 2023-10-05T21:15:35.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.946+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(39 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f9034022080 con 0x55d215adcf00 2023-10-05T21:15:35.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.946+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:40 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215adcf00 2023-10-05T21:15:35.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.947+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(40 gc.2 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f9034022080 con 0x55d215adcf00 2023-10-05T21:15:35.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.947+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215adcf00 2023-10-05T21:15:35.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.947+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(41 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f9034022080 con 0x55d215adcf00 2023-10-05T21:15:35.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.947+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ad59c0 2023-10-05T21:15:35.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.947+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(42 gc.3 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ad59c0 2023-10-05T21:15:35.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.947+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215ad59c0 2023-10-05T21:15:35.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.948+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(43 gc.3 [call out=24b] v0'0 uv11 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ad59c0 2023-10-05T21:15:35.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.948+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:44 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ad59c0 2023-10-05T21:15:35.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.948+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(44 gc.3 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ad59c0 2023-10-05T21:15:35.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.948+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ae0f80 2023-10-05T21:15:35.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.948+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(45 gc.4 [call out=15b] v0'0 uv47 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ae0f80 2023-10-05T21:15:35.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.948+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:46 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215ae0f80 2023-10-05T21:15:35.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.948+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(46 gc.4 [call out=24b] v0'0 uv47 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ae0f80 2023-10-05T21:15:35.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.948+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:47 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ae0f80 2023-10-05T21:15:35.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.949+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(47 gc.4 [call out=1702b] v0'0 uv47 ondisk = 0) v8 ==== 148+0+1702 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ae0f80 2023-10-05T21:15:35.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.949+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:48 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215adcf00 2023-10-05T21:15:35.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.949+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(48 gc.5 [call out=15b] v0'0 uv8 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f9034022080 con 0x55d215adcf00 2023-10-05T21:15:35.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.949+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:49 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215adcf00 2023-10-05T21:15:35.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.949+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(49 gc.5 [call out=24b] v0'0 uv8 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f9034022080 con 0x55d215adcf00 2023-10-05T21:15:35.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.949+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:50 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215adcf00 2023-10-05T21:15:35.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.949+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(50 gc.5 [call out=15b] v0'0 uv8 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f903404f020 con 0x55d215adcf00 2023-10-05T21:15:35.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.949+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:51 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ad59c0 2023-10-05T21:15:35.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.950+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(51 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ad59c0 2023-10-05T21:15:35.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.950+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:52 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215ad59c0 2023-10-05T21:15:35.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.950+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(52 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ad59c0 2023-10-05T21:15:35.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.950+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ad59c0 2023-10-05T21:15:35.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.950+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(53 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ad59c0 2023-10-05T21:15:35.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.950+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ad92f0 2023-10-05T21:15:35.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.951+0000 7f903ac86700 1 -- 172.21.15.153:0/3898065605 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(54 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f903003f040 con 0x55d215ad92f0 2023-10-05T21:15:35.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.951+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:55 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215ad92f0 2023-10-05T21:15:35.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.951+0000 7f903ac86700 1 -- 172.21.15.153:0/3898065605 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(55 gc.7 [call out=24b] v0'0 uv6 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f903003f040 con 0x55d215ad92f0 2023-10-05T21:15:35.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.951+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:56 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ad92f0 2023-10-05T21:15:35.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.951+0000 7f903ac86700 1 -- 172.21.15.153:0/3898065605 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(56 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f903003f040 con 0x55d215ad92f0 2023-10-05T21:15:35.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.951+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:57 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ae0f80 2023-10-05T21:15:35.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.952+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(57 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ae0f80 2023-10-05T21:15:35.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.952+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:58 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215ae0f80 2023-10-05T21:15:35.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.952+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(58 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ae0f80 2023-10-05T21:15:35.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.952+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:59 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ae0f80 2023-10-05T21:15:35.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.952+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(59 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ae0f80 2023-10-05T21:15:35.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.952+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215adcf00 2023-10-05T21:15:35.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.952+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(60 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f903404f020 con 0x55d215adcf00 2023-10-05T21:15:35.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.952+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215adcf00 2023-10-05T21:15:35.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.953+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(61 gc.9 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f903404f020 con 0x55d215adcf00 2023-10-05T21:15:35.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.953+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:62 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215adcf00 2023-10-05T21:15:35.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.953+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(62 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f903404f020 con 0x55d215adcf00 2023-10-05T21:15:35.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.953+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:63 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ae0f80 2023-10-05T21:15:35.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.953+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(63 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ae0f80 2023-10-05T21:15:35.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.953+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:64 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215ae0f80 2023-10-05T21:15:35.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.953+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(64 gc.10 [call out=24b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ae0f80 2023-10-05T21:15:35.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.954+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:65 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ae0f80 2023-10-05T21:15:35.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.954+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(65 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ae0f80 2023-10-05T21:15:35.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.954+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:66 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ad92f0 2023-10-05T21:15:35.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.954+0000 7f903ac86700 1 -- 172.21.15.153:0/3898065605 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(66 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f903003f040 con 0x55d215ad92f0 2023-10-05T21:15:35.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.954+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:67 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215ad92f0 2023-10-05T21:15:35.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.955+0000 7f903ac86700 1 -- 172.21.15.153:0/3898065605 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(67 gc.11 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f903003f040 con 0x55d215ad92f0 2023-10-05T21:15:35.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.955+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ad92f0 2023-10-05T21:15:35.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.955+0000 7f903ac86700 1 -- 172.21.15.153:0/3898065605 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f903003f040 con 0x55d215ad92f0 2023-10-05T21:15:35.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.955+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:69 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ae0f80 2023-10-05T21:15:35.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.955+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(69 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ae0f80 2023-10-05T21:15:35.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.955+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:70 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215ae0f80 2023-10-05T21:15:35.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.955+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(70 gc.12 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ae0f80 2023-10-05T21:15:35.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.955+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ae0f80 2023-10-05T21:15:35.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.956+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(71 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ae0f80 2023-10-05T21:15:35.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.956+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:72 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ad92f0 2023-10-05T21:15:35.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.956+0000 7f903ac86700 1 -- 172.21.15.153:0/3898065605 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(72 gc.13 [call out=15b] v0'0 uv12 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f903003f040 con 0x55d215ad92f0 2023-10-05T21:15:35.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.956+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215ad92f0 2023-10-05T21:15:35.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.956+0000 7f903ac86700 1 -- 172.21.15.153:0/3898065605 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 gc.13 [call out=24b] v0'0 uv12 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f903003f040 con 0x55d215ad92f0 2023-10-05T21:15:35.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.956+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:74 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ad92f0 2023-10-05T21:15:35.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.957+0000 7f903ac86700 1 -- 172.21.15.153:0/3898065605 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(74 gc.13 [call out=15b] v0'0 uv12 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f903003f040 con 0x55d215ad92f0 2023-10-05T21:15:35.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.957+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:75 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ad59c0 2023-10-05T21:15:35.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.957+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(75 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ad59c0 2023-10-05T21:15:35.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.957+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215ad59c0 2023-10-05T21:15:35.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.957+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(76 gc.14 [call out=24b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ad59c0 2023-10-05T21:15:35.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.957+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:77 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ad59c0 2023-10-05T21:15:35.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.957+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(77 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ad59c0 2023-10-05T21:15:35.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.957+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:78 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215adcf00 2023-10-05T21:15:35.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.958+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(78 gc.15 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f903404f020 con 0x55d215adcf00 2023-10-05T21:15:35.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.958+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:79 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215adcf00 2023-10-05T21:15:35.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.958+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(79 gc.15 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f903404f020 con 0x55d215adcf00 2023-10-05T21:15:35.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.958+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:80 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215adcf00 2023-10-05T21:15:35.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.958+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(80 gc.15 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f903404f020 con 0x55d215adcf00 2023-10-05T21:15:35.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.958+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:81 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ae0f80 2023-10-05T21:15:35.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.959+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(81 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ae0f80 2023-10-05T21:15:35.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.959+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:82 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215ae0f80 2023-10-05T21:15:36.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.959+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== osd_op_reply(82 gc.16 [call out=24b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ae0f80 2023-10-05T21:15:36.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.959+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:83 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ae0f80 2023-10-05T21:15:36.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.959+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.2 v2:172.21.15.153:6807/140454 22 ==== osd_op_reply(83 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ae0f80 2023-10-05T21:15:36.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.959+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:84 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215adcf00 2023-10-05T21:15:36.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.959+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(84 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f903404f020 con 0x55d215adcf00 2023-10-05T21:15:36.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.959+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:85 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215adcf00 2023-10-05T21:15:36.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.960+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(85 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f903404f020 con 0x55d215adcf00 2023-10-05T21:15:36.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.960+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:86 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215adcf00 2023-10-05T21:15:36.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.960+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(86 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f903404f020 con 0x55d215adcf00 2023-10-05T21:15:36.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.960+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ad59c0 2023-10-05T21:15:36.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.960+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(87 gc.18 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ad59c0 2023-10-05T21:15:36.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.960+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:88 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215ad59c0 2023-10-05T21:15:36.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.960+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(88 gc.18 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ad59c0 2023-10-05T21:15:36.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.960+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:89 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ad59c0 2023-10-05T21:15:36.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.960+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(89 gc.18 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ad59c0 2023-10-05T21:15:36.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.960+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:90 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ad59c0 2023-10-05T21:15:36.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.961+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(90 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ad59c0 2023-10-05T21:15:36.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.961+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:91 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215ad59c0 2023-10-05T21:15:36.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.961+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(91 gc.19 [call out=24b] v0'0 uv15 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ad59c0 2023-10-05T21:15:36.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.961+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ad59c0 2023-10-05T21:15:36.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.961+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(92 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ad59c0 2023-10-05T21:15:36.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.961+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:93 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215adcf00 2023-10-05T21:15:36.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.961+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(93 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f903404f020 con 0x55d215adcf00 2023-10-05T21:15:36.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.961+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:94 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215adcf00 2023-10-05T21:15:36.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.962+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== osd_op_reply(94 gc.20 [call out=24b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f903404f020 con 0x55d215adcf00 2023-10-05T21:15:36.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.962+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:95 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215adcf00 2023-10-05T21:15:36.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.962+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(95 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f903404f020 con 0x55d215adcf00 2023-10-05T21:15:36.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.962+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:96 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ae0f80 2023-10-05T21:15:36.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.962+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.2 v2:172.21.15.153:6807/140454 23 ==== osd_op_reply(96 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ae0f80 2023-10-05T21:15:36.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.962+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:97 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215ae0f80 2023-10-05T21:15:36.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.962+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.2 v2:172.21.15.153:6807/140454 24 ==== osd_op_reply(97 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ae0f80 2023-10-05T21:15:36.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.962+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:98 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ae0f80 2023-10-05T21:15:36.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.963+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.2 v2:172.21.15.153:6807/140454 25 ==== osd_op_reply(98 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ae0f80 2023-10-05T21:15:36.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.963+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:99 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215adcf00 2023-10-05T21:15:36.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.963+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 31 ==== osd_op_reply(99 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f903404f020 con 0x55d215adcf00 2023-10-05T21:15:36.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.963+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:100 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215adcf00 2023-10-05T21:15:36.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.963+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 32 ==== osd_op_reply(100 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f903404f020 con 0x55d215adcf00 2023-10-05T21:15:36.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.963+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:101 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215adcf00 2023-10-05T21:15:36.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.963+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 33 ==== osd_op_reply(101 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f903404f020 con 0x55d215adcf00 2023-10-05T21:15:36.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.963+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:102 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215adcf00 2023-10-05T21:15:36.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.964+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 34 ==== osd_op_reply(102 gc.23 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f903404f020 con 0x55d215adcf00 2023-10-05T21:15:36.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.964+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:103 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215adcf00 2023-10-05T21:15:36.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.964+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 35 ==== osd_op_reply(103 gc.23 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f903404f020 con 0x55d215adcf00 2023-10-05T21:15:36.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.964+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:104 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215adcf00 2023-10-05T21:15:36.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.964+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 36 ==== osd_op_reply(104 gc.23 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f903404f020 con 0x55d215adcf00 2023-10-05T21:15:36.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.964+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:105 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215adcf00 2023-10-05T21:15:36.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.964+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 37 ==== osd_op_reply(105 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f903404f020 con 0x55d215adcf00 2023-10-05T21:15:36.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.964+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:106 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215adcf00 2023-10-05T21:15:36.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.965+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 38 ==== osd_op_reply(106 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f903404f020 con 0x55d215adcf00 2023-10-05T21:15:36.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.965+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215adcf00 2023-10-05T21:15:36.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.965+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 39 ==== osd_op_reply(107 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f903404f020 con 0x55d215adcf00 2023-10-05T21:15:36.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.965+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:108 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215adcf00 2023-10-05T21:15:36.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.965+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 40 ==== osd_op_reply(108 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f903404f020 con 0x55d215adcf00 2023-10-05T21:15:36.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.965+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:109 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215adcf00 2023-10-05T21:15:36.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.965+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 41 ==== osd_op_reply(109 gc.25 [call out=24b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f903404f020 con 0x55d215adcf00 2023-10-05T21:15:36.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.965+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:110 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215adcf00 2023-10-05T21:15:36.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.966+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 42 ==== osd_op_reply(110 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f903404f020 con 0x55d215adcf00 2023-10-05T21:15:36.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.966+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:111 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ad92f0 2023-10-05T21:15:36.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.966+0000 7f903ac86700 1 -- 172.21.15.153:0/3898065605 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(111 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f903003f040 con 0x55d215ad92f0 2023-10-05T21:15:36.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.966+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215ad92f0 2023-10-05T21:15:36.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.966+0000 7f903ac86700 1 -- 172.21.15.153:0/3898065605 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(112 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f903003f040 con 0x55d215ad92f0 2023-10-05T21:15:36.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.966+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:113 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ad92f0 2023-10-05T21:15:36.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.967+0000 7f903ac86700 1 -- 172.21.15.153:0/3898065605 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(113 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f903003f040 con 0x55d215ad92f0 2023-10-05T21:15:36.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.967+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:114 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215adcf00 2023-10-05T21:15:36.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.967+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 43 ==== osd_op_reply(114 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f903404f020 con 0x55d215adcf00 2023-10-05T21:15:36.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.967+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:115 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215adcf00 2023-10-05T21:15:36.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.967+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 44 ==== osd_op_reply(115 gc.27 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f903404f020 con 0x55d215adcf00 2023-10-05T21:15:36.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.967+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:116 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215adcf00 2023-10-05T21:15:36.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.967+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 45 ==== osd_op_reply(116 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f903404f020 con 0x55d215adcf00 2023-10-05T21:15:36.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.967+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:117 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ad92f0 2023-10-05T21:15:36.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.968+0000 7f903ac86700 1 -- 172.21.15.153:0/3898065605 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(117 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f903003f040 con 0x55d215ad92f0 2023-10-05T21:15:36.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.968+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:118 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215ad92f0 2023-10-05T21:15:36.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.968+0000 7f903ac86700 1 -- 172.21.15.153:0/3898065605 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(118 gc.28 [call out=24b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f903003f040 con 0x55d215ad92f0 2023-10-05T21:15:36.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.968+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:119 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ad92f0 2023-10-05T21:15:36.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.969+0000 7f903ac86700 1 -- 172.21.15.153:0/3898065605 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(119 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f903003f040 con 0x55d215ad92f0 2023-10-05T21:15:36.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.969+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:120 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215adcf00 2023-10-05T21:15:36.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.969+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 46 ==== osd_op_reply(120 gc.29 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f903404f020 con 0x55d215adcf00 2023-10-05T21:15:36.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.969+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:121 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215adcf00 2023-10-05T21:15:36.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.970+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 47 ==== osd_op_reply(121 gc.29 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f903404f020 con 0x55d215adcf00 2023-10-05T21:15:36.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.970+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:122 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215adcf00 2023-10-05T21:15:36.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.970+0000 7f903bc88700 1 -- 172.21.15.153:0/3898065605 <== osd.3 v2:172.21.15.153:6800/140455 48 ==== osd_op_reply(122 gc.29 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f903404f020 con 0x55d215adcf00 2023-10-05T21:15:36.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.970+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:123 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ad92f0 2023-10-05T21:15:36.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.971+0000 7f903ac86700 1 -- 172.21.15.153:0/3898065605 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(123 gc.30 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f903003f040 con 0x55d215ad92f0 2023-10-05T21:15:36.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.971+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:124 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215ad92f0 2023-10-05T21:15:36.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.971+0000 7f903ac86700 1 -- 172.21.15.153:0/3898065605 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(124 gc.30 [call out=24b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f903003f040 con 0x55d215ad92f0 2023-10-05T21:15:36.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.971+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:125 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ad92f0 2023-10-05T21:15:36.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.971+0000 7f903ac86700 1 -- 172.21.15.153:0/3898065605 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(125 gc.30 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f903003f040 con 0x55d215ad92f0 2023-10-05T21:15:36.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.971+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:126 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ae0f80 2023-10-05T21:15:36.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.972+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.2 v2:172.21.15.153:6807/140454 26 ==== osd_op_reply(126 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ae0f80 2023-10-05T21:15:36.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.972+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:127 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b40b80 con 0x55d215ae0f80 2023-10-05T21:15:36.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.972+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.2 v2:172.21.15.153:6807/140454 27 ==== osd_op_reply(127 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ae0f80 2023-10-05T21:15:36.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.972+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:128 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215b41b90 con 0x55d215ae0f80 2023-10-05T21:15:36.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.972+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 <== osd.2 v2:172.21.15.153:6807/140454 28 ==== osd_op_reply(128 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f902c05d040 con 0x55d215ae0f80 2023-10-05T21:15:36.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.972+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94360795017936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aff760 con 0x7f902c0383b0 2023-10-05T21:15:36.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.973+0000 7f903ac86700 1 -- 172.21.15.153:0/4229765134 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(102 notify.0 [watch unwatch cookie 94360795017936] v29'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f903003f040 con 0x7f902c0383b0 2023-10-05T21:15:36.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.973+0000 7f90483af680 20 remove_watcher() i=0 2023-10-05T21:15:36.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.973+0000 7f90483af680 2 removed watcher, disabling cache 2023-10-05T21:15:36.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.973+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94360795029712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aaf2d0 con 0x55d215a74390 2023-10-05T21:15:36.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.974+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(103 notify.1 [watch unwatch cookie 94360795029712] v29'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f903404f020 con 0x55d215a74390 2023-10-05T21:15:36.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.974+0000 7f90483af680 20 remove_watcher() i=1 2023-10-05T21:15:36.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.974+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:104 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94360795033408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aaf2d0 con 0x55d215aa9e50 2023-10-05T21:15:36.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.975+0000 7f903b487700 1 -- 172.21.15.153:0/4229765134 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(104 notify.2 [watch unwatch cookie 94360795033408] v29'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f902c05d040 con 0x55d215aa9e50 2023-10-05T21:15:36.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.975+0000 7f90483af680 20 remove_watcher() i=2 2023-10-05T21:15:36.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.975+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94360795037008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ab2f40 con 0x7f902c0383b0 2023-10-05T21:15:36.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.976+0000 7f903ac86700 1 -- 172.21.15.153:0/4229765134 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(105 notify.3 [watch unwatch cookie 94360795037008] v29'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f903003f040 con 0x7f902c0383b0 2023-10-05T21:15:36.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.976+0000 7f90483af680 20 remove_watcher() i=3 2023-10-05T21:15:36.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.976+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94360795026288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aaf2d0 con 0x55d215a74390 2023-10-05T21:15:36.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.976+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(106 notify.4 [watch unwatch cookie 94360795026288] v29'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f903404f020 con 0x55d215a74390 2023-10-05T21:15:36.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.976+0000 7f90483af680 20 remove_watcher() i=4 2023-10-05T21:15:36.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.976+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:107 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94360795044640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ab3d50 con 0x7f903000ebe0 2023-10-05T21:15:36.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.977+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(107 notify.5 [watch unwatch cookie 94360795044640] v29'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f903404f020 con 0x7f903000ebe0 2023-10-05T21:15:36.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.977+0000 7f90483af680 20 remove_watcher() i=5 2023-10-05T21:15:36.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.977+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94360795046736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ab1370 con 0x7f903000ebe0 2023-10-05T21:15:36.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.978+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(108 notify.6 [watch unwatch cookie 94360795046736] v29'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f903404f020 con 0x7f903000ebe0 2023-10-05T21:15:36.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.978+0000 7f90483af680 20 remove_watcher() i=6 2023-10-05T21:15:36.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.978+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94360795047840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215aaf2d0 con 0x7f903000ebe0 2023-10-05T21:15:36.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.980+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(109 notify.7 [watch unwatch cookie 94360795047840] v29'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f903404f020 con 0x7f903000ebe0 2023-10-05T21:15:36.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.980+0000 7f90483af680 20 remove_watcher() i=7 2023-10-05T21:15:36.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.980+0000 7f8f87fff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:36.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.980+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:110 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94360795050480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55d215ab5b20 con 0x55d215a74390 2023-10-05T21:15:36.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.981+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(110 data_loggenerations_metadata [watch unwatch cookie 94360795050480] v29'176 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f903404f020 con 0x55d215a74390 2023-10-05T21:15:36.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.981+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f903000ebe0 msgr2=0x7f903000d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.981+0000 7f90483af680 1 --2- 172.21.15.153:0/4229765134 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f903000ebe0 0x7f903000d8e0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.981+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d215a74390 msgr2=0x55d215aa7a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.981+0000 7f90483af680 1 --2- 172.21.15.153:0/4229765134 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d215a74390 0x55d215aa7a30 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.981+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f902c0383b0 msgr2=0x7f902c038a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.981+0000 7f90483af680 1 --2- 172.21.15.153:0/4229765134 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f902c0383b0 0x7f902c038a70 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.981+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d215aa9e50 msgr2=0x55d215aac230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.981+0000 7f90483af680 1 --2- 172.21.15.153:0/4229765134 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d215aa9e50 0x55d215aac230 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.981+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9020034140 msgr2=0x7f90200365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.981+0000 7f90483af680 1 --2- 172.21.15.153:0/4229765134 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9020034140 0x7f90200365f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9030004170 tx=0x7f9030001360 comp rx=0 tx=0).stop 2023-10-05T21:15:36.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.981+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215a73a40 msgr2=0x55d215a9bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.981+0000 7f903bc88700 1 -- 172.21.15.153:0/4229765134 reap_dead start 2023-10-05T21:15:36.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.981+0000 7f90483af680 1 --2- 172.21.15.153:0/4229765134 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215a73a40 0x55d215a9bd00 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f902c000f80 tx=0x7f902c01d000 comp rx=0 tx=0).stop 2023-10-05T21:15:36.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.981+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 shutdown_connections 2023-10-05T21:15:36.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.981+0000 7f90483af680 1 --2- 172.21.15.153:0/4229765134 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215a73a40 0x55d215a9bd00 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.981+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 >> 172.21.15.153:0/4229765134 conn(0x55d215a6d300 msgr2=0x55d215a8eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:36.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.981+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 shutdown_connections 2023-10-05T21:15:36.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.981+0000 7f90483af680 1 -- 172.21.15.153:0/4229765134 wait complete. 2023-10-05T21:15:36.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.982+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55d215ad92f0 msgr2=0x55d215adb6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.982+0000 7f90483af680 1 --2- 172.21.15.153:0/3898065605 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55d215ad92f0 0x55d215adb6d0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.982+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d215ad59c0 msgr2=0x55d215ad7e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.982+0000 7f90483af680 1 --2- 172.21.15.153:0/3898065605 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d215ad59c0 0x55d215ad7e70 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.982+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55d215ae0f80 msgr2=0x55d215ae3360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.982+0000 7f90483af680 1 --2- 172.21.15.153:0/3898065605 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55d215ae0f80 0x55d215ae3360 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.982+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d215adcf00 msgr2=0x55d215adf380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.982+0000 7f90483af680 1 --2- 172.21.15.153:0/3898065605 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d215adcf00 0x55d215adf380 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.982+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8f780340f0 msgr2=0x7f8f780365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.982+0000 7f90483af680 1 --2- 172.21.15.153:0/3898065605 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8f780340f0 0x7f8f780365a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55d215ab6f40 tx=0x7f9034005500 comp rx=0 tx=0).stop 2023-10-05T21:15:36.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.982+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215ac50a0 msgr2=0x55d215acac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.982+0000 7f903b487700 1 -- 172.21.15.153:0/3898065605 reap_dead start 2023-10-05T21:15:36.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.982+0000 7f90483af680 1 --2- 172.21.15.153:0/3898065605 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215ac50a0 0x55d215acac00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f90300017a0 tx=0x7f9030030000 comp rx=0 tx=0).stop 2023-10-05T21:15:36.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.982+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 shutdown_connections 2023-10-05T21:15:36.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.982+0000 7f90483af680 1 --2- 172.21.15.153:0/3898065605 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d215ac50a0 0x55d215acac00 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.982+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 >> 172.21.15.153:0/3898065605 conn(0x55d215ac02a0 msgr2=0x55d215abe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:36.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.982+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 shutdown_connections 2023-10-05T21:15:36.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:35.982+0000 7f90483af680 1 -- 172.21.15.153:0/3898065605 wait complete. 2023-10-05T21:15:36.014 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2023-10-05T21:15:36.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:36.014 INFO:teuthology.orchestra.run.smithi153.stdout: "tag": "193cdd3f-16f8-4551-b3a7-d103e6acfa54.4220.17313276171723374549\u0000", 2023-10-05T21:15:36.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:15:35.813824+0000", 2023-10-05T21:15:36.014 INFO:teuthology.orchestra.run.smithi153.stdout: "objs": [ 2023-10-05T21:15:36.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:36.015 INFO:teuthology.orchestra.run.smithi153.stdout: "pool": "default.rgw.buckets.data", 2023-10-05T21:15:36.015 INFO:teuthology.orchestra.run.smithi153.stdout: "oid": "193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_1", 2023-10-05T21:15:36.015 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "", 2023-10-05T21:15:36.015 INFO:teuthology.orchestra.run.smithi153.stdout: "instance": "" 2023-10-05T21:15:36.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:36.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:36.015 INFO:teuthology.orchestra.run.smithi153.stdout: "pool": "default.rgw.buckets.data", 2023-10-05T21:15:36.015 INFO:teuthology.orchestra.run.smithi153.stdout: "oid": "193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_2", 2023-10-05T21:15:36.015 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "", 2023-10-05T21:15:36.015 INFO:teuthology.orchestra.run.smithi153.stdout: "instance": "" 2023-10-05T21:15:36.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:36.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:36.016 INFO:teuthology.orchestra.run.smithi153.stdout: "pool": "default.rgw.buckets.data", 2023-10-05T21:15:36.016 INFO:teuthology.orchestra.run.smithi153.stdout: "oid": "193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_3", 2023-10-05T21:15:36.016 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "", 2023-10-05T21:15:36.016 INFO:teuthology.orchestra.run.smithi153.stdout: "instance": "" 2023-10-05T21:15:36.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:36.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:36.016 INFO:teuthology.orchestra.run.smithi153.stdout: "pool": "default.rgw.buckets.data", 2023-10-05T21:15:36.016 INFO:teuthology.orchestra.run.smithi153.stdout: "oid": "193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_4", 2023-10-05T21:15:36.016 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "", 2023-10-05T21:15:36.016 INFO:teuthology.orchestra.run.smithi153.stdout: "instance": "" 2023-10-05T21:15:36.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:36.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:36.017 INFO:teuthology.orchestra.run.smithi153.stdout: "pool": "default.rgw.buckets.data", 2023-10-05T21:15:36.017 INFO:teuthology.orchestra.run.smithi153.stdout: "oid": "193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_5", 2023-10-05T21:15:36.017 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "", 2023-10-05T21:15:36.017 INFO:teuthology.orchestra.run.smithi153.stdout: "instance": "" 2023-10-05T21:15:36.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:36.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:36.017 INFO:teuthology.orchestra.run.smithi153.stdout: "pool": "default.rgw.buckets.data", 2023-10-05T21:15:36.017 INFO:teuthology.orchestra.run.smithi153.stdout: "oid": "193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_6", 2023-10-05T21:15:36.017 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "", 2023-10-05T21:15:36.017 INFO:teuthology.orchestra.run.smithi153.stdout: "instance": "" 2023-10-05T21:15:36.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:36.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:36.018 INFO:teuthology.orchestra.run.smithi153.stdout: "pool": "default.rgw.buckets.data", 2023-10-05T21:15:36.018 INFO:teuthology.orchestra.run.smithi153.stdout: "oid": "193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_7", 2023-10-05T21:15:36.018 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "", 2023-10-05T21:15:36.018 INFO:teuthology.orchestra.run.smithi153.stdout: "instance": "" 2023-10-05T21:15:36.018 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:36.018 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:15:36.018 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:36.018 INFO:teuthology.orchestra.run.smithi153.stdout:] 2023-10-05T21:15:36.018 DEBUG:tasks.util.rgw: json result: [{'tag': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4220.17313276171723374549\x00', 'time': '2023-10-05T21:15:35.813824+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_7', 'key': '', 'instance': ''}]}] 2023-10-05T21:15:36.019 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2023-10-05T21:15:36.019 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2023-10-05T21:15:36.019 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2023-10-05T21:15:36.062 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:36.062 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:36.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.061+0000 7fa2291f9680 1 Processor -- start 2023-10-05T21:15:36.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.061+0000 7fa2291f9680 1 -- start start 2023-10-05T21:15:36.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.061+0000 7fa2291f9680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x559334cd9790 0x559334cdbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.061+0000 7fa2291f9680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559334c22970 con 0x559334c49080 2023-10-05T21:15:36.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.061+0000 7fa2291f9680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x559334be2db0 con 0x559334cd9790 2023-10-05T21:15:36.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.062+0000 7fa21bad0700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x559334cd9790 0x559334cdbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.062+0000 7fa21c2d1700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x559334c49080 0x559334cd8070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:39224/0 (socket says 172.21.15.153:39224) 2023-10-05T21:15:36.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.062+0000 7fa21c2d1700 1 -- 172.21.15.153:0/4093500364 learned_addr learned my addr 172.21.15.153:0/4093500364 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:36.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.062+0000 7fa21b2cf700 1 -- 172.21.15.153:0/4093500364 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1024190077 0 0) 0x559334c22970 con 0x559334c49080 2023-10-05T21:15:36.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.062+0000 7fa21b2cf700 1 -- 172.21.15.153:0/4093500364 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa204001e10 con 0x559334c49080 2023-10-05T21:15:36.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.062+0000 7fa21bad0700 1 -- 172.21.15.153:0/4093500364 >> v1:172.21.15.111:6789/0 conn(0x559334c49080 legacy=0x559334cd8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.062+0000 7fa21bad0700 1 -- 172.21.15.153:0/4093500364 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559334cdd1c0 con 0x559334cd9790 2023-10-05T21:15:36.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.062+0000 7fa21bad0700 1 --2- 172.21.15.153:0/4093500364 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334cd9790 0x559334cdbb70 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa21000a5d0 tx=0x7fa210005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffc93466e5fdb348 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.062+0000 7fa21b2cf700 1 -- 172.21.15.153:0/4093500364 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa210007610 con 0x559334cd9790 2023-10-05T21:15:36.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.062+0000 7fa21b2cf700 1 -- 172.21.15.153:0/4093500364 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa210007770 con 0x559334cd9790 2023-10-05T21:15:36.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.062+0000 7fa21b2cf700 1 -- 172.21.15.153:0/4093500364 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa210007a40 con 0x559334cd9790 2023-10-05T21:15:36.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.063+0000 7fa2291f9680 1 -- 172.21.15.153:0/4093500364 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334cd9790 msgr2=0x559334cdbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.063+0000 7fa2291f9680 1 --2- 172.21.15.153:0/4093500364 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334cd9790 0x559334cdbb70 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa21000a5d0 tx=0x7fa210005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:36.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.063+0000 7fa2291f9680 1 -- 172.21.15.153:0/4093500364 shutdown_connections 2023-10-05T21:15:36.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.063+0000 7fa2291f9680 1 --2- 172.21.15.153:0/4093500364 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334cd9790 0x559334cdbb70 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.063+0000 7fa2291f9680 1 -- 172.21.15.153:0/4093500364 >> 172.21.15.153:0/4093500364 conn(0x559334ccfb60 msgr2=0x559334cd1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:36.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.063+0000 7fa2291f9680 1 -- 172.21.15.153:0/4093500364 shutdown_connections 2023-10-05T21:15:36.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.063+0000 7fa2291f9680 1 -- 172.21.15.153:0/4093500364 wait complete. 2023-10-05T21:15:36.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.064+0000 7fa2291f9680 1 Processor -- start 2023-10-05T21:15:36.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.064+0000 7fa2291f9680 1 -- start start 2023-10-05T21:15:36.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.064+0000 7fa2291f9680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334c49080 0x559334cf46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.064+0000 7fa2291f9680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x559334b82ea0 con 0x559334c49080 2023-10-05T21:15:36.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.064+0000 7fa21c2d1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334c49080 0x559334cf46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.064+0000 7fa21c2d1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334c49080 0x559334cf46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57580/0 (socket says 172.21.15.153:57580) 2023-10-05T21:15:36.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.064+0000 7fa21c2d1700 1 -- 172.21.15.153:0/2483497292 learned_addr learned my addr 172.21.15.153:0/2483497292 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:36.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.065+0000 7fa21c2d1700 1 -- 172.21.15.153:0/2483497292 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa210005cf0 con 0x559334c49080 2023-10-05T21:15:36.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.065+0000 7fa21c2d1700 1 --2- 172.21.15.153:0/2483497292 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334c49080 0x559334cf46a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa20c001c40 tx=0x7fa20c0017f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=490fae2924a8a464 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.065+0000 7fa21a2cd700 1 -- 172.21.15.153:0/2483497292 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa20c00bbf0 con 0x559334c49080 2023-10-05T21:15:36.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.065+0000 7fa21a2cd700 1 -- 172.21.15.153:0/2483497292 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20c00bd70 con 0x559334c49080 2023-10-05T21:15:36.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.065+0000 7fa21a2cd700 1 -- 172.21.15.153:0/2483497292 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa20c00e5f0 con 0x559334c49080 2023-10-05T21:15:36.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.065+0000 7fa2291f9680 1 -- 172.21.15.153:0/2483497292 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334c49080 msgr2=0x559334cf46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.065+0000 7fa2291f9680 1 --2- 172.21.15.153:0/2483497292 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334c49080 0x559334cf46a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa20c001c40 tx=0x7fa20c0017f0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.065+0000 7fa2291f9680 1 -- 172.21.15.153:0/2483497292 shutdown_connections 2023-10-05T21:15:36.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.065+0000 7fa2291f9680 1 --2- 172.21.15.153:0/2483497292 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334c49080 0x559334cf46a0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.065+0000 7fa2291f9680 1 -- 172.21.15.153:0/2483497292 >> 172.21.15.153:0/2483497292 conn(0x559334ccfb60 msgr2=0x559334cf0170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:36.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.065+0000 7fa2291f9680 1 -- 172.21.15.153:0/2483497292 shutdown_connections 2023-10-05T21:15:36.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.065+0000 7fa2291f9680 1 -- 172.21.15.153:0/2483497292 wait complete. 2023-10-05T21:15:36.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.066+0000 7fa2291f9680 1 Processor -- start 2023-10-05T21:15:36.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.066+0000 7fa2291f9680 1 -- start start 2023-10-05T21:15:36.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.066+0000 7fa2291f9680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334c49080 0x559334cd59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.066+0000 7fa2291f9680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x559334b79c80 con 0x559334c49080 2023-10-05T21:15:36.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.066+0000 7fa21c2d1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334c49080 0x559334cd59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.066+0000 7fa21c2d1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334c49080 0x559334cd59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57590/0 (socket says 172.21.15.153:57590) 2023-10-05T21:15:36.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.066+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 learned_addr learned my addr 172.21.15.153:0/1836458336 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:36.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.066+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa204001e10 con 0x559334c49080 2023-10-05T21:15:36.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.067+0000 7fa21c2d1700 1 --2- 172.21.15.153:0/1836458336 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334c49080 0x559334cd59d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x559334cf5440 tx=0x7fa20c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.067+0000 7fa218aca700 1 -- 172.21.15.153:0/1836458336 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa20c01f070 con 0x559334c49080 2023-10-05T21:15:36.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.067+0000 7fa218aca700 1 -- 172.21.15.153:0/1836458336 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20c018640 con 0x559334c49080 2023-10-05T21:15:36.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.067+0000 7fa218aca700 1 -- 172.21.15.153:0/1836458336 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa20c018930 con 0x559334c49080 2023-10-05T21:15:36.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.067+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559334cd3ff0 con 0x559334c49080 2023-10-05T21:15:36.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.067+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559334cd4440 con 0x559334c49080 2023-10-05T21:15:36.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.068+0000 7fa218aca700 1 -- 172.21.15.153:0/1836458336 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fa20c018a90 con 0x559334c49080 2023-10-05T21:15:36.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.068+0000 7fa2291f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.068+0000 7fa218aca700 1 --2- 172.21.15.153:0/1836458336 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa208034140 0x7fa2080365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.068+0000 7fa218aca700 1 -- 172.21.15.153:0/1836458336 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fa20c048d40 con 0x559334c49080 2023-10-05T21:15:36.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.068+0000 7fa21bad0700 1 --2- 172.21.15.153:0/1836458336 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa208034140 0x7fa2080365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.068+0000 7fa2291f9680 1 --2- 172.21.15.153:0/1836458336 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x559334cd9790 0x559334d09b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.068+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d0a2c0 con 0x559334cd9790 2023-10-05T21:15:36.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.068+0000 7fa21cad2700 1 --2- 172.21.15.153:0/1836458336 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x559334cd9790 0x559334d09b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.068+0000 7fa21bad0700 1 --2- 172.21.15.153:0/1836458336 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa208034140 0x7fa2080365f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa21000afd0 tx=0x7fa210014000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.069+0000 7fa21cad2700 1 --2- 172.21.15.153:0/1836458336 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x559334cd9790 0x559334d09b30 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.069+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.069+0000 7fa2291f9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.069+0000 7fa2291f9680 20 realm 2023-10-05T21:15:36.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.069+0000 7fa2291f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.069+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d07150 con 0x559334cd9790 2023-10-05T21:15:36.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.069+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.069+0000 7fa2291f9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.069+0000 7fa2291f9680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:36.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.069+0000 7fa2291f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.069+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d0adc0 con 0x559334cd9790 2023-10-05T21:15:36.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.069+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.069+0000 7fa2291f9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.069+0000 7fa2291f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.069+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d0b6e0 con 0x559334cd9790 2023-10-05T21:15:36.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.070+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.070+0000 7fa2291f9680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:36.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.070+0000 7fa2291f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.070+0000 7fa2291f9680 1 --2- 172.21.15.153:0/1836458336 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x559334d0bfa0 0x559334d0e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.070+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d0e9d0 con 0x559334d0bfa0 2023-10-05T21:15:36.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.070+0000 7fa21c2d1700 1 --2- 172.21.15.153:0/1836458336 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x559334d0bfa0 0x559334d0e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.070+0000 7fa21c2d1700 1 --2- 172.21.15.153:0/1836458336 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x559334d0bfa0 0x559334d0e380 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.070+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa20c014070 con 0x559334d0bfa0 2023-10-05T21:15:36.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.070+0000 7fa2291f9680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:36.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.070+0000 7fa2291f9680 20 searching for the correct realm 2023-10-05T21:15:36.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.070+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x559334d0bfa0 2023-10-05T21:15:36.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.070+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa20c014070 con 0x559334d0bfa0 2023-10-05T21:15:36.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.070+0000 7fa21c2d1700 1 --2- 172.21.15.153:0/1836458336 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fa20c016730 0x7fa20c00d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.070+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x7fa20c016730 2023-10-05T21:15:36.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.071+0000 7fa21bad0700 1 --2- 172.21.15.153:0/1836458336 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fa20c016730 0x7fa20c00d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.071+0000 7fa21bad0700 1 --2- 172.21.15.153:0/1836458336 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fa20c016730 0x7fa20c00d3d0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.071+0000 7fa21bad0700 1 -- 172.21.15.153:0/1836458336 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2100079b0 con 0x7fa20c016730 2023-10-05T21:15:36.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.071+0000 7fa21bad0700 1 --2- 172.21.15.153:0/1836458336 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fa210007030 0x7fa21001d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.071+0000 7fa21bad0700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x7fa210007030 2023-10-05T21:15:36.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.071+0000 7fa21cad2700 1 --2- 172.21.15.153:0/1836458336 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fa210007030 0x7fa21001d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.072+0000 7fa21cad2700 1 --2- 172.21.15.153:0/1836458336 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fa210007030 0x7fa21001d430 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.072+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa21400a570 con 0x7fa210007030 2023-10-05T21:15:36.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.072+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x559334cd9790 2023-10-05T21:15:36.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.072+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.072+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x559334cd9790 2023-10-05T21:15:36.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.073+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.073+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x7fa210007030 2023-10-05T21:15:36.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.073+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa21400a570 con 0x7fa210007030 2023-10-05T21:15:36.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.073+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x7fa210007030 2023-10-05T21:15:36.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.073+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa21400a570 con 0x7fa210007030 2023-10-05T21:15:36.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.073+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x7fa20c016730 2023-10-05T21:15:36.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.073+0000 7fa21bad0700 1 -- 172.21.15.153:0/1836458336 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa210029040 con 0x7fa20c016730 2023-10-05T21:15:36.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.073+0000 7fa21bad0700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x559334d0bfa0 2023-10-05T21:15:36.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.074+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa20c014070 con 0x559334d0bfa0 2023-10-05T21:15:36.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.074+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x559334cd9790 2023-10-05T21:15:36.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.074+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.074+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x7fa210007030 2023-10-05T21:15:36.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.074+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa21400a570 con 0x7fa210007030 2023-10-05T21:15:36.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.074+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x559334cd9790 2023-10-05T21:15:36.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.074+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.074+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x7fa20c016730 2023-10-05T21:15:36.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.074+0000 7fa21bad0700 1 -- 172.21.15.153:0/1836458336 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa210029040 con 0x7fa20c016730 2023-10-05T21:15:36.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.074+0000 7fa21bad0700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x559334d0bfa0 2023-10-05T21:15:36.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.075+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa20c014070 con 0x559334d0bfa0 2023-10-05T21:15:36.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.075+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x559334d0bfa0 2023-10-05T21:15:36.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.075+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa20c014070 con 0x559334d0bfa0 2023-10-05T21:15:36.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.075+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x7fa210007030 2023-10-05T21:15:36.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.075+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa21400a570 con 0x7fa210007030 2023-10-05T21:15:36.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.075+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x559334d0bfa0 2023-10-05T21:15:36.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.075+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa20c014070 con 0x559334d0bfa0 2023-10-05T21:15:36.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.075+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x559334d0bfa0 2023-10-05T21:15:36.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.075+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa20c014070 con 0x559334d0bfa0 2023-10-05T21:15:36.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.076+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x559334cd9790 2023-10-05T21:15:36.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.076+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.076+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x559334cd9790 2023-10-05T21:15:36.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.076+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.076+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x7fa210007030 2023-10-05T21:15:36.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.076+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa21400a570 con 0x7fa210007030 2023-10-05T21:15:36.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.076+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x559334d0bfa0 2023-10-05T21:15:36.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.076+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa20c014070 con 0x559334d0bfa0 2023-10-05T21:15:36.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.076+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x7fa20c016730 2023-10-05T21:15:36.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.077+0000 7fa21bad0700 1 -- 172.21.15.153:0/1836458336 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa210029040 con 0x7fa20c016730 2023-10-05T21:15:36.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.077+0000 7fa21bad0700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x559334cd9790 2023-10-05T21:15:36.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.077+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.077+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x7fa210007030 2023-10-05T21:15:36.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.077+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa21400a570 con 0x7fa210007030 2023-10-05T21:15:36.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.077+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x559334d0bfa0 2023-10-05T21:15:36.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.077+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa20c014070 con 0x559334d0bfa0 2023-10-05T21:15:36.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.077+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x7fa210007030 2023-10-05T21:15:36.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.078+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa21400a570 con 0x7fa210007030 2023-10-05T21:15:36.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.078+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x7fa20c016730 2023-10-05T21:15:36.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.078+0000 7fa21bad0700 1 -- 172.21.15.153:0/1836458336 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa210029040 con 0x7fa20c016730 2023-10-05T21:15:36.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.078+0000 7fa21bad0700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x559334d0bfa0 2023-10-05T21:15:36.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.078+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa20c014070 con 0x559334d0bfa0 2023-10-05T21:15:36.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.078+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x7fa210007030 2023-10-05T21:15:36.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.078+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa21400a570 con 0x7fa210007030 2023-10-05T21:15:36.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.078+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x559334cd9790 2023-10-05T21:15:36.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.079+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.079+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10540 con 0x7fa20c016730 2023-10-05T21:15:36.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.079+0000 7fa21bad0700 1 -- 172.21.15.153:0/1836458336 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa210029040 con 0x7fa20c016730 2023-10-05T21:15:36.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.079+0000 7fa2291f9680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:36.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.079+0000 7fa2291f9680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:36.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.079+0000 7fa2291f9680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:36.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.079+0000 7fa2291f9680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:36.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.079+0000 7fa2291f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.079+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d0f490 con 0x559334cd9790 2023-10-05T21:15:36.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.079+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.079+0000 7fa2291f9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.079+0000 7fa2291f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.079+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d0f890 con 0x559334cd9790 2023-10-05T21:15:36.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.079+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.079+0000 7fa2291f9680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:36.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.079+0000 7fa2291f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.079+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d109d0 con 0x559334cd9790 2023-10-05T21:15:36.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.080+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.080+0000 7fa2291f9680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:36.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.080+0000 7fa2291f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.080+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d10d80 con 0x559334d0bfa0 2023-10-05T21:15:36.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.080+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fa20c014070 con 0x559334d0bfa0 2023-10-05T21:15:36.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.080+0000 7fa2291f9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.080+0000 7fa2291f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.080+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d11130 con 0x559334cd9790 2023-10-05T21:15:36.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.080+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.080+0000 7fa2291f9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.080+0000 7fa2291f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.080+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d11130 con 0x559334cd9790 2023-10-05T21:15:36.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.080+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.080+0000 7fa2291f9680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:36.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.080+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d12140 con 0x559334d0bfa0 2023-10-05T21:15:36.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.081+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa20c014070 con 0x559334d0bfa0 2023-10-05T21:15:36.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.081+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d12140 con 0x7fa20c016730 2023-10-05T21:15:36.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.081+0000 7fa21bad0700 1 -- 172.21.15.153:0/1836458336 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa210029040 con 0x7fa20c016730 2023-10-05T21:15:36.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.081+0000 7fa21bad0700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d12140 con 0x7fa210007030 2023-10-05T21:15:36.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.081+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa21400a570 con 0x7fa210007030 2023-10-05T21:15:36.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.081+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d109d0 con 0x559334cd9790 2023-10-05T21:15:36.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.081+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.081+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d109d0 con 0x559334cd9790 2023-10-05T21:15:36.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.081+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.082+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d109d0 con 0x7fa210007030 2023-10-05T21:15:36.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.082+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa21400a570 con 0x7fa210007030 2023-10-05T21:15:36.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.082+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d109d0 con 0x7fa210007030 2023-10-05T21:15:36.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.082+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa21400a570 con 0x7fa210007030 2023-10-05T21:15:36.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.082+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d109d0 con 0x7fa20c016730 2023-10-05T21:15:36.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.082+0000 7fa21bad0700 1 -- 172.21.15.153:0/1836458336 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa210029040 con 0x7fa20c016730 2023-10-05T21:15:36.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.082+0000 7fa21bad0700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d109d0 con 0x559334d0bfa0 2023-10-05T21:15:36.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.082+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa20c014070 con 0x559334d0bfa0 2023-10-05T21:15:36.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.082+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d109d0 con 0x559334cd9790 2023-10-05T21:15:36.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.083+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.083+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d109d0 con 0x7fa210007030 2023-10-05T21:15:36.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.083+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa21400a570 con 0x7fa210007030 2023-10-05T21:15:36.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.083+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d109d0 con 0x559334cd9790 2023-10-05T21:15:36.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.083+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.083+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d109d0 con 0x7fa20c016730 2023-10-05T21:15:36.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.083+0000 7fa21bad0700 1 -- 172.21.15.153:0/1836458336 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa210029040 con 0x7fa20c016730 2023-10-05T21:15:36.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.083+0000 7fa21bad0700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d109d0 con 0x559334d0bfa0 2023-10-05T21:15:36.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.084+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa20c014070 con 0x559334d0bfa0 2023-10-05T21:15:36.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.084+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d109d0 con 0x559334d0bfa0 2023-10-05T21:15:36.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.084+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d0bfa0 2023-10-05T21:15:36.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.084+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d109d0 con 0x7fa210007030 2023-10-05T21:15:36.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.084+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa21400a570 con 0x7fa210007030 2023-10-05T21:15:36.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.084+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d109d0 con 0x559334d0bfa0 2023-10-05T21:15:36.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.084+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d0bfa0 2023-10-05T21:15:36.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.084+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d109d0 con 0x559334d0bfa0 2023-10-05T21:15:36.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.085+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d0bfa0 2023-10-05T21:15:36.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.085+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d109d0 con 0x559334cd9790 2023-10-05T21:15:36.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.085+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.085+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d109d0 con 0x559334cd9790 2023-10-05T21:15:36.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.085+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.085+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d109d0 con 0x7fa210007030 2023-10-05T21:15:36.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.085+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa21400a570 con 0x7fa210007030 2023-10-05T21:15:36.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.085+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d109d0 con 0x559334d0bfa0 2023-10-05T21:15:36.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.085+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d0bfa0 2023-10-05T21:15:36.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.085+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d109d0 con 0x7fa20c016730 2023-10-05T21:15:36.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.086+0000 7fa21bad0700 1 -- 172.21.15.153:0/1836458336 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa210029040 con 0x7fa20c016730 2023-10-05T21:15:36.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.086+0000 7fa21bad0700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d109d0 con 0x559334cd9790 2023-10-05T21:15:36.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.086+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.086+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d109d0 con 0x7fa210007030 2023-10-05T21:15:36.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.086+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa21400a570 con 0x7fa210007030 2023-10-05T21:15:36.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.086+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d109d0 con 0x559334d0bfa0 2023-10-05T21:15:36.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.086+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d0bfa0 2023-10-05T21:15:36.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.086+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d109d0 con 0x7fa210007030 2023-10-05T21:15:36.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.087+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa21400a570 con 0x7fa210007030 2023-10-05T21:15:36.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.087+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d109d0 con 0x7fa20c016730 2023-10-05T21:15:36.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.087+0000 7fa21bad0700 1 -- 172.21.15.153:0/1836458336 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa210029040 con 0x7fa20c016730 2023-10-05T21:15:36.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.087+0000 7fa21bad0700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d109d0 con 0x559334d0bfa0 2023-10-05T21:15:36.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.087+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d0bfa0 2023-10-05T21:15:36.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.087+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d109d0 con 0x7fa210007030 2023-10-05T21:15:36.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.087+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa21400a570 con 0x7fa210007030 2023-10-05T21:15:36.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.087+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d109d0 con 0x559334cd9790 2023-10-05T21:15:36.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.088+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.088+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d109d0 con 0x7fa20c016730 2023-10-05T21:15:36.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.088+0000 7fa21bad0700 1 -- 172.21.15.153:0/1836458336 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa210029040 con 0x7fa20c016730 2023-10-05T21:15:36.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.088+0000 7fa2291f9680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:36.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.088+0000 7fa2291f9680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:36.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.088+0000 7fa2291f9680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:36.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.088+0000 7fa2291f9680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:36.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.088+0000 7fa2291f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.088+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d11130 con 0x559334cd9790 2023-10-05T21:15:36.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.088+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.088+0000 7fa2291f9680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:36.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.088+0000 7fa2291f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.088+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d11530 con 0x559334d0bfa0 2023-10-05T21:15:36.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.089+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d0bfa0 2023-10-05T21:15:36.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.089+0000 7fa2291f9680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:36.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.089+0000 7fa2291f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.089+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d11e20 con 0x559334cd9790 2023-10-05T21:15:36.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.089+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.089+0000 7fa2291f9680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:36.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.089+0000 7fa2291f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.089+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d0f0c0 con 0x559334cd9790 2023-10-05T21:15:36.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.089+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.089+0000 7fa2291f9680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:36.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.089+0000 7fa2291f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.089+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d11e20 con 0x7fa210007030 2023-10-05T21:15:36.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.090+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x7fa210007030 2023-10-05T21:15:36.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.090+0000 7fa2291f9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.090+0000 7fa2291f9680 20 zone default found 2023-10-05T21:15:36.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.090+0000 7fa2291f9680 4 Realm: () 2023-10-05T21:15:36.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.090+0000 7fa2291f9680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:36.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.090+0000 7fa2291f9680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:36.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.090+0000 7fa2291f9680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:36.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.090+0000 7fa2291f9680 20 zonegroup default 2023-10-05T21:15:36.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.090+0000 7fa2291f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.090+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d11e20 con 0x7fa210007030 2023-10-05T21:15:36.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.090+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x7fa210007030 2023-10-05T21:15:36.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.090+0000 7fa2291f9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.090+0000 7fa2291f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.090+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d11e20 con 0x559334d0bfa0 2023-10-05T21:15:36.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.090+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d0bfa0 2023-10-05T21:15:36.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.090+0000 7fa2291f9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.090+0000 7fa2291f9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.090+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d13ca0 con 0x559334d0bfa0 2023-10-05T21:15:36.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.091+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d0bfa0 2023-10-05T21:15:36.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.091+0000 7fa2291f9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.091+0000 7fa2291f9680 20 started sync module instance, tier type = 2023-10-05T21:15:36.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.091+0000 7fa2291f9680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:36.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.091+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d13360 con 0x7fa20c016730 2023-10-05T21:15:36.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.091+0000 7fa21bad0700 1 -- 172.21.15.153:0/1836458336 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa210029040 con 0x7fa20c016730 2023-10-05T21:15:36.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.091+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94090734679904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d14540 con 0x7fa20c016730 2023-10-05T21:15:36.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.091+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d14de0 con 0x559334cd9790 2023-10-05T21:15:36.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.092+0000 7fa21bad0700 1 -- 172.21.15.153:0/1836458336 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94090734679904] v29'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa210029040 con 0x7fa20c016730 2023-10-05T21:15:36.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.092+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.092+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94090734682192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d14de0 con 0x559334cd9790 2023-10-05T21:15:36.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.092+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d158d0 con 0x559334d0bfa0 2023-10-05T21:15:36.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.093+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94090734682192] v29'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.093+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d0bfa0 2023-10-05T21:15:36.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.093+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94090734684400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d14d40 con 0x559334d0bfa0 2023-10-05T21:15:36.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.093+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d166b0 con 0x7fa20c016730 2023-10-05T21:15:36.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.094+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94090734684400] v29'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d0bfa0 2023-10-05T21:15:36.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.094+0000 7fa21bad0700 1 -- 172.21.15.153:0/1836458336 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa210029040 con 0x7fa20c016730 2023-10-05T21:15:36.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.094+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94090734689840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d16f50 con 0x7fa20c016730 2023-10-05T21:15:36.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.094+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d177f0 con 0x559334cd9790 2023-10-05T21:15:36.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.095+0000 7fa21bad0700 1 -- 172.21.15.153:0/1836458336 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94090734689840] v29'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa210029040 con 0x7fa20c016730 2023-10-05T21:15:36.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.095+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.095+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94090734695168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d17750 con 0x559334cd9790 2023-10-05T21:15:36.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.095+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d18610 con 0x7fa210007030 2023-10-05T21:15:36.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.096+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94090734695168] v29'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.096+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x7fa210007030 2023-10-05T21:15:36.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.096+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94090734697376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d184e0 con 0x7fa210007030 2023-10-05T21:15:36.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.096+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d19070 con 0x7fa210007030 2023-10-05T21:15:36.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.096+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94090734697376] v29'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x7fa210007030 2023-10-05T21:15:36.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.097+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x7fa210007030 2023-10-05T21:15:36.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.097+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94090734699072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d19070 con 0x7fa210007030 2023-10-05T21:15:36.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.097+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d19ae0 con 0x7fa210007030 2023-10-05T21:15:36.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.097+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(98 notify.7 [create] v29'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x7fa210007030 2023-10-05T21:15:36.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.097+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94090734704016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d19f90 con 0x7fa210007030 2023-10-05T21:15:36.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.097+0000 7fa2291f9680 20 add_watcher() i=0 2023-10-05T21:15:36.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.097+0000 7fa2291f9680 20 add_watcher() i=1 2023-10-05T21:15:36.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.097+0000 7fa2291f9680 20 add_watcher() i=2 2023-10-05T21:15:36.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.097+0000 7fa2291f9680 20 add_watcher() i=3 2023-10-05T21:15:36.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.097+0000 7fa2291f9680 20 add_watcher() i=4 2023-10-05T21:15:36.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.097+0000 7fa2291f9680 20 add_watcher() i=5 2023-10-05T21:15:36.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.097+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(97 notify.6 [watch watch cookie 94090734699072] v29'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x7fa210007030 2023-10-05T21:15:36.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.097+0000 7fa2291f9680 20 add_watcher() i=6 2023-10-05T21:15:36.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.098+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94090734704016] v29'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x7fa210007030 2023-10-05T21:15:36.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.098+0000 7fa2291f9680 20 add_watcher() i=7 2023-10-05T21:15:36.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.098+0000 7fa2291f9680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:36.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.098+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d18b80 con 0x559334cd9790 2023-10-05T21:15:36.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.098+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.098+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94090734705312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d18b80 con 0x559334cd9790 2023-10-05T21:15:36.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.099+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94090734705312] v29'177 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.099+0000 7fa1edfe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:36.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.099+0000 7fa2291f9680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:36.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.099+0000 7fa2291f9680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:36.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.099+0000 7fa2291f9680 1 Processor -- start 2023-10-05T21:15:36.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.100+0000 7fa2291f9680 1 -- start start 2023-10-05T21:15:36.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.100+0000 7fa2291f9680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334d26ae0 0x559334d26ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.100+0000 7fa2291f9680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x559334d27500 con 0x559334d26ae0 2023-10-05T21:15:36.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.100+0000 7fa21bad0700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334d26ae0 0x559334d26ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.100+0000 7fa21bad0700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334d26ae0 0x559334d26ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57598/0 (socket says 172.21.15.153:57598) 2023-10-05T21:15:36.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.100+0000 7fa21bad0700 1 -- 172.21.15.153:0/246920609 learned_addr learned my addr 172.21.15.153:0/246920609 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:36.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.100+0000 7fa21bad0700 1 -- 172.21.15.153:0/246920609 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559334d279e0 con 0x559334d26ae0 2023-10-05T21:15:36.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.101+0000 7fa21bad0700 1 --2- 172.21.15.153:0/246920609 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334d26ae0 0x559334d26ef0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x559334cdd190 tx=0x7fa210011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc620fd72276a938 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.101+0000 7fa1ed7e2700 1 -- 172.21.15.153:0/246920609 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa210025040 con 0x559334d26ae0 2023-10-05T21:15:36.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.101+0000 7fa1ed7e2700 1 -- 172.21.15.153:0/246920609 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa210039450 con 0x559334d26ae0 2023-10-05T21:15:36.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.101+0000 7fa1ed7e2700 1 -- 172.21.15.153:0/246920609 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa21001f480 con 0x559334d26ae0 2023-10-05T21:15:36.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.101+0000 7fa2291f9680 1 -- 172.21.15.153:0/246920609 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334d26ae0 msgr2=0x559334d26ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.101+0000 7fa2291f9680 1 --2- 172.21.15.153:0/246920609 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334d26ae0 0x559334d26ef0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x559334cdd190 tx=0x7fa210011000 comp rx=0 tx=0).stop 2023-10-05T21:15:36.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.101+0000 7fa2291f9680 1 -- 172.21.15.153:0/246920609 shutdown_connections 2023-10-05T21:15:36.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.101+0000 7fa2291f9680 1 --2- 172.21.15.153:0/246920609 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334d26ae0 0x559334d26ef0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.101+0000 7fa2291f9680 1 -- 172.21.15.153:0/246920609 >> 172.21.15.153:0/246920609 conn(0x559334d22de0 msgr2=0x559334d20ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:36.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.101+0000 7fa2291f9680 1 -- 172.21.15.153:0/246920609 shutdown_connections 2023-10-05T21:15:36.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.101+0000 7fa2291f9680 1 -- 172.21.15.153:0/246920609 wait complete. 2023-10-05T21:15:36.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.102+0000 7fa2291f9680 1 Processor -- start 2023-10-05T21:15:36.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.102+0000 7fa2291f9680 1 -- start start 2023-10-05T21:15:36.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.102+0000 7fa2291f9680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334d26ae0 0x559334d2d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.102+0000 7fa2291f9680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x559334d2dd20 con 0x559334d26ae0 2023-10-05T21:15:36.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.102+0000 7fa21bad0700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334d26ae0 0x559334d2d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.102+0000 7fa21bad0700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334d26ae0 0x559334d2d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57606/0 (socket says 172.21.15.153:57606) 2023-10-05T21:15:36.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.102+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 learned_addr learned my addr 172.21.15.153:0/3836279582 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:36.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.102+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559334cdd1c0 con 0x559334d26ae0 2023-10-05T21:15:36.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.103+0000 7fa21bad0700 1 --2- 172.21.15.153:0/3836279582 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334d26ae0 0x559334d2d7e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x559334d22350 tx=0x7fa210039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.103+0000 7fa1677fe700 1 -- 172.21.15.153:0/3836279582 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa210025040 con 0x559334d26ae0 2023-10-05T21:15:36.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.103+0000 7fa1677fe700 1 -- 172.21.15.153:0/3836279582 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa210047070 con 0x559334d26ae0 2023-10-05T21:15:36.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.103+0000 7fa1677fe700 1 -- 172.21.15.153:0/3836279582 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa21004c5d0 con 0x559334d26ae0 2023-10-05T21:15:36.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.103+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559334d2df20 con 0x559334d26ae0 2023-10-05T21:15:36.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.103+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559334d2e3d0 con 0x559334d26ae0 2023-10-05T21:15:36.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.104+0000 7fa1677fe700 1 -- 172.21.15.153:0/3836279582 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fa210049070 con 0x559334d26ae0 2023-10-05T21:15:36.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.104+0000 7fa1677fe700 1 --2- 172.21.15.153:0/3836279582 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa15c034140 0x7fa15c0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.104+0000 7fa1677fe700 1 -- 172.21.15.153:0/3836279582 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fa210032030 con 0x559334d26ae0 2023-10-05T21:15:36.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.104+0000 7fa21cad2700 1 --2- 172.21.15.153:0/3836279582 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa15c034140 0x7fa15c0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.104+0000 7fa2291f9680 1 --2- 172.21.15.153:0/3836279582 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x559334d385e0 0x559334d3aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.104+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d3b140 con 0x559334d385e0 2023-10-05T21:15:36.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.104+0000 7fa21c2d1700 1 --2- 172.21.15.153:0/3836279582 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x559334d385e0 0x559334d3aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.104+0000 7fa21cad2700 1 --2- 172.21.15.153:0/3836279582 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa15c034140 0x7fa15c0365f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x559334d19020 tx=0x7fa214037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.104+0000 7fa21c2d1700 1 --2- 172.21.15.153:0/3836279582 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x559334d385e0 0x559334d3aa90 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.105+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v29'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.105+0000 7fa2291f9680 1 --2- 172.21.15.153:0/3836279582 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x559334d3bec0 0x559334d3e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.105+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d3e9a0 con 0x559334d3bec0 2023-10-05T21:15:36.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.105+0000 7fa21bad0700 1 --2- 172.21.15.153:0/3836279582 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x559334d3bec0 0x559334d3e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.106+0000 7fa21bad0700 1 --2- 172.21.15.153:0/3836279582 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x559334d3bec0 0x559334d3e2a0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.106+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v29'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa21003f020 con 0x559334d3bec0 2023-10-05T21:15:36.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.106+0000 7fa2291f9680 1 --2- 172.21.15.153:0/3836279582 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x559334d3f7d0 0x559334d41c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.106+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d42330 con 0x559334d3f7d0 2023-10-05T21:15:36.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.107+0000 7fa21cad2700 1 --2- 172.21.15.153:0/3836279582 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x559334d3f7d0 0x559334d41c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.107+0000 7fa21cad2700 1 --2- 172.21.15.153:0/3836279582 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x559334d3f7d0 0x559334d41c80 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.107+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v29'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.108+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d42a60 con 0x559334d385e0 2023-10-05T21:15:36.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.108+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v29'178 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.108+0000 7fa2291f9680 1 --2- 172.21.15.153:0/3836279582 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x559334d437c0 0x559334d45bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.108+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d46270 con 0x559334d437c0 2023-10-05T21:15:36.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.108+0000 7fa21c2d1700 1 --2- 172.21.15.153:0/3836279582 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x559334d437c0 0x559334d45bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.109+0000 7fa21c2d1700 1 --2- 172.21.15.153:0/3836279582 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x559334d437c0 0x559334d45bc0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.109+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v29'51 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.109+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d46a30 con 0x559334d3f7d0 2023-10-05T21:15:36.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.110+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v29'31 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.110+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d470d0 con 0x559334d385e0 2023-10-05T21:15:36.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.111+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v29'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.111+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d470d0 con 0x559334d3bec0 2023-10-05T21:15:36.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.112+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v29'35 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.112+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d47790 con 0x559334d437c0 2023-10-05T21:15:36.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.113+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v29'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.113+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d47820 con 0x559334d3f7d0 2023-10-05T21:15:36.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.114+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v29'25 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.114+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d47d10 con 0x559334d437c0 2023-10-05T21:15:36.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.114+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v29'52 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.114+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d47d10 con 0x559334d3bec0 2023-10-05T21:15:36.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.115+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v29'25 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.115+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d483c0 con 0x559334d437c0 2023-10-05T21:15:36.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.116+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v29'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.116+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d48450 con 0x559334d3bec0 2023-10-05T21:15:36.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.117+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v29'37 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.117+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d48940 con 0x559334d385e0 2023-10-05T21:15:36.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.118+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v29'179 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.118+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d48940 con 0x559334d3f7d0 2023-10-05T21:15:36.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.118+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v29'41 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.118+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d48fd0 con 0x559334d437c0 2023-10-05T21:15:36.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.119+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v29'53 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.119+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d48fb0 con 0x559334d3f7d0 2023-10-05T21:15:36.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.120+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v29'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.120+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d48fb0 con 0x559334d385e0 2023-10-05T21:15:36.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.121+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v29'30 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.121+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d48d40 con 0x559334d385e0 2023-10-05T21:15:36.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.121+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v29'180 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.121+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d48d40 con 0x559334d3f7d0 2023-10-05T21:15:36.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.122+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v29'42 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.122+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d48d40 con 0x559334d437c0 2023-10-05T21:15:36.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.123+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v29'35 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.123+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d48d40 con 0x559334d3f7d0 2023-10-05T21:15:36.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.123+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v29'24 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.124+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d48d40 con 0x559334d3f7d0 2023-10-05T21:15:36.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.124+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v29'25 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.124+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d48d40 con 0x559334d3f7d0 2023-10-05T21:15:36.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.125+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v29'27 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.125+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d48d40 con 0x559334d3f7d0 2023-10-05T21:15:36.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.125+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v29'32 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.125+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d48d40 con 0x559334d3bec0 2023-10-05T21:15:36.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.127+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v29'22 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.127+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d48d40 con 0x559334d3f7d0 2023-10-05T21:15:36.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.127+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v29'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.127+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d48d40 con 0x559334d3bec0 2023-10-05T21:15:36.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.128+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v29'36 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.128+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d48d40 con 0x559334d3f7d0 2023-10-05T21:15:36.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.129+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v29'43 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.129+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d48d40 con 0x559334d3bec0 2023-10-05T21:15:36.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.130+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v29'38 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.130+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d48d40 con 0x559334d437c0 2023-10-05T21:15:36.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.131+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v29'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.132+0000 7fa164ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:36.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.132+0000 7fa15a7fc700 20 reqs_thread_entry: start 2023-10-05T21:15:36.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.132+0000 7fa2291f9680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:36.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.133+0000 7fa2291f9680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:36.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.133+0000 7fa158ff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:16:06 2023 2023-10-05T21:15:36.142 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:36.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.133+0000 7fa13ffff700 20 reqs_thread_entry: start 2023-10-05T21:15:36.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.133+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2023-10-05T21:15:36.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.133+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:33 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d385e0 2023-10-05T21:15:36.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.134+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(33 gc.14 [call] v29'181 uv181 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.134+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:34 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d385e0 2023-10-05T21:15:36.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.134+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(34 gc.14 [call out=15b] v0'0 uv181 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.134+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.134+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:35 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da4680 con 0x559334d385e0 2023-10-05T21:15:36.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.134+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(35 gc.14 [call out=24b] v0'0 uv181 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.134+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d385e0 2023-10-05T21:15:36.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.134+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(36 gc.14 [call out=15b] v0'0 uv181 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.134+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.134+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:37 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d385e0 2023-10-05T21:15:36.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.135+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(37 gc.14 [call out=15b] v0'0 uv181 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.135+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.135+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d385e0 2023-10-05T21:15:36.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.135+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(38 gc.14 [call] v29'182 uv182 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.135+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2023-10-05T21:15:36.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.136+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:39 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.136+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(39 gc.15 [call] v29'44 uv44 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.136+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:40 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.137+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(40 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.137+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.137+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da4680 con 0x559334d3f7d0 2023-10-05T21:15:36.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.137+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(41 gc.15 [call out=24b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.137+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:42 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.137+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(42 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.137+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.137+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:43 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.137+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(43 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.137+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.137+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.138+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(44 gc.15 [call] v29'45 uv45 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.138+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2023-10-05T21:15:36.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.138+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d437c0 2023-10-05T21:15:36.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.139+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(45 gc.16 [call] v29'54 uv54 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.139+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:46 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d437c0 2023-10-05T21:15:36.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.139+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(46 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.139+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.139+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:47 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da4680 con 0x559334d437c0 2023-10-05T21:15:36.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.140+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(47 gc.16 [call out=24b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.140+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:48 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d437c0 2023-10-05T21:15:36.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.140+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(48 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.140+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.140+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:49 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d437c0 2023-10-05T21:15:36.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.140+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(49 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.140+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.140+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:50 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d437c0 2023-10-05T21:15:36.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.141+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(50 gc.16 [call] v29'55 uv55 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.141+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2023-10-05T21:15:36.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.141+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:51 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.141+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(51 gc.17 [call] v29'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.141+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.142+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(52 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.142+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.142+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:53 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da4680 con 0x559334d3f7d0 2023-10-05T21:15:36.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.142+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(53 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.142+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:54 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.142+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(54 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.142+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.142+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:55 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.142+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(55 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.142+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.142+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:56 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.143+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(56 gc.17 [call] v29'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.143+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2023-10-05T21:15:36.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.143+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:57 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d385e0 2023-10-05T21:15:36.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.144+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(57 gc.18 [call] v29'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.144+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:58 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d385e0 2023-10-05T21:15:36.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.144+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(58 gc.18 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.144+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.144+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:59 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da4680 con 0x559334d385e0 2023-10-05T21:15:36.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.144+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(59 gc.18 [call out=24b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.144+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:60 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d385e0 2023-10-05T21:15:36.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.144+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(60 gc.18 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.144+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.144+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:61 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d385e0 2023-10-05T21:15:36.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.145+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(61 gc.18 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.145+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.145+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d385e0 2023-10-05T21:15:36.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.145+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(62 gc.18 [call] v29'32 uv32 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.145+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2023-10-05T21:15:36.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.145+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d385e0 2023-10-05T21:15:36.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.146+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(63 gc.19 [call] v29'183 uv183 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.146+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:64 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d385e0 2023-10-05T21:15:36.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.146+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(64 gc.19 [call out=15b] v0'0 uv183 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.146+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.146+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:65 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da4680 con 0x559334d385e0 2023-10-05T21:15:36.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.146+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(65 gc.19 [call out=24b] v0'0 uv183 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.146+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:66 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d385e0 2023-10-05T21:15:36.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.147+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(66 gc.19 [call out=15b] v0'0 uv183 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.147+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.147+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d385e0 2023-10-05T21:15:36.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.147+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(67 gc.19 [call out=15b] v0'0 uv183 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.147+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.147+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:68 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d385e0 2023-10-05T21:15:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.148+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(68 gc.19 [call] v29'184 uv184 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.148+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2023-10-05T21:15:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.148+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.148+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(69 gc.20 [call] v29'46 uv46 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.149+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:70 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.149+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(70 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.149+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.149+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:71 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da4680 con 0x559334d3f7d0 2023-10-05T21:15:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.149+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(71 gc.20 [call out=24b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.149+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.149+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(72 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.149+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.149+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:73 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.149+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== osd_op_reply(73 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.149+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.149+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:74 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.150+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(74 gc.20 [call] v29'47 uv47 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.150+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2023-10-05T21:15:36.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.150+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d437c0 2023-10-05T21:15:36.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.151+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(75 gc.21 [call] v29'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.151+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:76 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d437c0 2023-10-05T21:15:36.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.151+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(76 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.151+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.151+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:77 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da4680 con 0x559334d437c0 2023-10-05T21:15:36.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.151+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(77 gc.21 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.151+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:78 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d437c0 2023-10-05T21:15:36.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.152+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(78 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.152+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.152+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:79 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d437c0 2023-10-05T21:15:36.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.152+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(79 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.152+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.152+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:80 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d437c0 2023-10-05T21:15:36.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.153+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(80 gc.21 [call] v29'37 uv37 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.153+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2023-10-05T21:15:36.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.153+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:81 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.153+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 31 ==== osd_op_reply(81 gc.22 [call] v29'25 uv25 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.153+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.153+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 32 ==== osd_op_reply(82 gc.22 [call out=15b] v0'0 uv25 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.154+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.154+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da4680 con 0x559334d3f7d0 2023-10-05T21:15:36.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.154+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 33 ==== osd_op_reply(83 gc.22 [call out=24b] v0'0 uv25 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.154+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.154+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 34 ==== osd_op_reply(84 gc.22 [call out=15b] v0'0 uv25 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.154+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.154+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:85 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.154+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 35 ==== osd_op_reply(85 gc.22 [call out=15b] v0'0 uv25 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.154+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.154+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:86 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.155+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 36 ==== osd_op_reply(86 gc.22 [call] v29'26 uv26 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.155+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2023-10-05T21:15:36.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.155+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:87 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.156+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 37 ==== osd_op_reply(87 gc.23 [call] v29'26 uv26 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.156+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.156+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 38 ==== osd_op_reply(88 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.156+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.156+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da4680 con 0x559334d3f7d0 2023-10-05T21:15:36.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.156+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 39 ==== osd_op_reply(89 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.156+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:90 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.156+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 40 ==== osd_op_reply(90 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.156+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.156+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:91 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.157+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 41 ==== osd_op_reply(91 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.157+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.157+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:92 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.157+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 42 ==== osd_op_reply(92 gc.23 [call] v29'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.157+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2023-10-05T21:15:36.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.157+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:93 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.158+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 43 ==== osd_op_reply(93 gc.24 [call] v29'28 uv28 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.158+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:94 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.158+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 44 ==== osd_op_reply(94 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.158+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.158+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:95 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da4680 con 0x559334d3f7d0 2023-10-05T21:15:36.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.158+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 45 ==== osd_op_reply(95 gc.24 [call out=24b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.158+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:96 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.159+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 46 ==== osd_op_reply(96 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.159+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.159+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:97 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.159+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 47 ==== osd_op_reply(97 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.159+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.159+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:98 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.160+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 48 ==== osd_op_reply(98 gc.24 [call] v29'29 uv29 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.160+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2023-10-05T21:15:36.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.160+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:99 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.160+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 49 ==== osd_op_reply(99 gc.25 [call] v29'33 uv33 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.160+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:100 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.161+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 50 ==== osd_op_reply(100 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.161+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.161+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:101 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da4680 con 0x559334d3f7d0 2023-10-05T21:15:36.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.161+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 51 ==== osd_op_reply(101 gc.25 [call out=24b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.161+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:102 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.161+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 52 ==== osd_op_reply(102 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.161+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.161+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:103 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.161+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 53 ==== osd_op_reply(103 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.161+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.162+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:104 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.162+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 54 ==== osd_op_reply(104 gc.25 [call] v29'34 uv34 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.162+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2023-10-05T21:15:36.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.162+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:105 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3bec0 2023-10-05T21:15:36.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.163+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(105 gc.26 [call] v29'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.163+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:106 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3bec0 2023-10-05T21:15:36.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.164+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(106 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.164+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.164+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:107 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da4680 con 0x559334d3bec0 2023-10-05T21:15:36.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.164+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(107 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.164+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:108 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3bec0 2023-10-05T21:15:36.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.164+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(108 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.164+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.164+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3bec0 2023-10-05T21:15:36.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.165+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(109 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.165+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.165+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3bec0 2023-10-05T21:15:36.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.165+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(110 gc.26 [call] v29'24 uv24 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.165+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2023-10-05T21:15:36.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.165+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:111 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.166+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 55 ==== osd_op_reply(111 gc.27 [call] v29'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.166+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:112 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.167+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 56 ==== osd_op_reply(112 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.167+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.167+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:113 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da4680 con 0x559334d3f7d0 2023-10-05T21:15:36.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.167+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 57 ==== osd_op_reply(113 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.167+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:114 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.167+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 58 ==== osd_op_reply(114 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.167+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.167+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:115 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.167+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 59 ==== osd_op_reply(115 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.167+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.167+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:116 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.168+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 60 ==== osd_op_reply(116 gc.27 [call] v29'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.168+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2023-10-05T21:15:36.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.168+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:117 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3bec0 2023-10-05T21:15:36.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.169+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(117 gc.28 [call] v29'37 uv37 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.169+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:118 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3bec0 2023-10-05T21:15:36.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.170+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(118 gc.28 [call out=15b] v0'0 uv37 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.170+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.170+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:119 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da4680 con 0x559334d3bec0 2023-10-05T21:15:36.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.170+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(119 gc.28 [call out=24b] v0'0 uv37 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.170+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:120 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3bec0 2023-10-05T21:15:36.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.170+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(120 gc.28 [call out=15b] v0'0 uv37 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.170+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.170+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:121 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3bec0 2023-10-05T21:15:36.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.170+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(121 gc.28 [call out=15b] v0'0 uv37 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.170+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.170+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:122 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3bec0 2023-10-05T21:15:36.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.171+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(122 gc.28 [call] v29'38 uv38 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.171+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2023-10-05T21:15:36.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.171+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:123 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.172+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 61 ==== osd_op_reply(123 gc.29 [call] v29'48 uv48 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.172+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:124 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.172+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 62 ==== osd_op_reply(124 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.172+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.172+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:125 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da4680 con 0x559334d3f7d0 2023-10-05T21:15:36.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.173+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 63 ==== osd_op_reply(125 gc.29 [call out=24b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.173+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:126 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.173+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 64 ==== osd_op_reply(126 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.173+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.173+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:127 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.173+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 65 ==== osd_op_reply(127 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.173+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.173+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:128 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.174+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 66 ==== osd_op_reply(128 gc.29 [call] v29'49 uv49 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.174+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2023-10-05T21:15:36.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.174+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:129 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3bec0 2023-10-05T21:15:36.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.175+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(129 gc.30 [call] v29'39 uv39 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.175+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:130 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3bec0 2023-10-05T21:15:36.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.175+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(130 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.175+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.175+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:131 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da4680 con 0x559334d3bec0 2023-10-05T21:15:36.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.175+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(131 gc.30 [call out=24b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.175+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:132 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3bec0 2023-10-05T21:15:36.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.176+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(132 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.176+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.176+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:133 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3bec0 2023-10-05T21:15:36.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.176+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(133 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.176+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.176+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:134 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3bec0 2023-10-05T21:15:36.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.177+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(134 gc.30 [call] v29'40 uv40 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.177+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2023-10-05T21:15:36.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.177+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:135 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d437c0 2023-10-05T21:15:36.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.177+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(135 gc.31 [call] v29'26 uv26 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.177+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:136 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d437c0 2023-10-05T21:15:36.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.178+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== osd_op_reply(136 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.178+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.178+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:137 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da4680 con 0x559334d437c0 2023-10-05T21:15:36.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.178+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 22 ==== osd_op_reply(137 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.178+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:138 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d437c0 2023-10-05T21:15:36.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.178+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 23 ==== osd_op_reply(138 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.178+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.178+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:139 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d437c0 2023-10-05T21:15:36.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.178+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 24 ==== osd_op_reply(139 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.178+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.178+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:140 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d437c0 2023-10-05T21:15:36.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.179+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 25 ==== osd_op_reply(140 gc.31 [call] v29'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.179+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2023-10-05T21:15:36.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.179+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:141 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d385e0 2023-10-05T21:15:36.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.180+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(141 gc.0 [call] v29'26 uv26 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.180+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:142 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d385e0 2023-10-05T21:15:36.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.180+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(142 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.180+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.180+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:143 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da4680 con 0x559334d385e0 2023-10-05T21:15:36.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.180+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(143 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.180+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:144 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d385e0 2023-10-05T21:15:36.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.180+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(144 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.180+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.180+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:145 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d385e0 2023-10-05T21:15:36.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.181+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(145 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.181+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.181+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:146 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d385e0 2023-10-05T21:15:36.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.181+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(146 gc.0 [call] v29'27 uv27 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.181+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2023-10-05T21:15:36.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.181+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:147 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3bec0 2023-10-05T21:15:36.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.182+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(147 gc.1 [call] v29'20 uv20 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.182+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:148 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3bec0 2023-10-05T21:15:36.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.182+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(148 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.182+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.182+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:149 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da4680 con 0x559334d3bec0 2023-10-05T21:15:36.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.183+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(149 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.183+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:150 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3bec0 2023-10-05T21:15:36.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.183+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(150 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.183+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.183+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:151 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3bec0 2023-10-05T21:15:36.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.183+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(151 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.183+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.183+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:152 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3bec0 2023-10-05T21:15:36.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.184+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 31 ==== osd_op_reply(152 gc.1 [call] v29'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.184+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2023-10-05T21:15:36.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.184+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:153 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.185+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 67 ==== osd_op_reply(153 gc.2 [call] v29'20 uv20 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.185+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:154 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.185+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 68 ==== osd_op_reply(154 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.185+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.185+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:155 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da4680 con 0x559334d3f7d0 2023-10-05T21:15:36.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.185+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 69 ==== osd_op_reply(155 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.185+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:156 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.185+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 70 ==== osd_op_reply(156 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.185+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.185+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:157 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.186+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 71 ==== osd_op_reply(157 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.186+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.186+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:158 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.186+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 72 ==== osd_op_reply(158 gc.2 [call] v29'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.186+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2023-10-05T21:15:36.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.186+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:159 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d385e0 2023-10-05T21:15:36.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.187+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(159 gc.3 [call] v29'185 uv185 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.187+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:160 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d385e0 2023-10-05T21:15:36.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.187+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(160 gc.3 [call out=15b] v0'0 uv185 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.187+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.187+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:161 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da4680 con 0x559334d385e0 2023-10-05T21:15:36.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.188+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(161 gc.3 [call out=24b] v0'0 uv185 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.188+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:162 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d385e0 2023-10-05T21:15:36.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.188+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(162 gc.3 [call out=15b] v0'0 uv185 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.188+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.188+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:163 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d385e0 2023-10-05T21:15:36.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.188+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(163 gc.3 [call out=15b] v0'0 uv185 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.188+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.188+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:164 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d385e0 2023-10-05T21:15:36.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.189+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(164 gc.3 [call] v29'186 uv186 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.189+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2023-10-05T21:15:36.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.189+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:165 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d437c0 2023-10-05T21:15:36.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.190+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 26 ==== osd_op_reply(165 gc.4 [call] v29'56 uv56 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.190+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:166 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d437c0 2023-10-05T21:15:36.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.190+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 27 ==== osd_op_reply(166 gc.4 [call out=15b] v0'0 uv56 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.190+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.190+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:167 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da4680 con 0x559334d437c0 2023-10-05T21:15:36.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.190+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 28 ==== osd_op_reply(167 gc.4 [call out=24b] v0'0 uv56 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.190+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:168 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d437c0 2023-10-05T21:15:36.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.190+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 29 ==== osd_op_reply(168 gc.4 [call out=15b] v0'0 uv56 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.190+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.190+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:169 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d437c0 2023-10-05T21:15:36.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.191+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 30 ==== osd_op_reply(169 gc.4 [call out=1702b] v0'0 uv56 ondisk = 0) v8 ==== 148+0+1702 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.191+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-10-05T21:15:36.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.191+0000 7fa2291f9680 20 garbage collection: RGWGC::process iterating over entry tag='193cdd3f-16f8-4551-b3a7-d103e6acfa54.4220.17313276171723374549', time=2023-10-05T21:15:35.813824+0000, chain.objs.size()=7 2023-10-05T21:15:36.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.191+0000 7fa2291f9680 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_1 2023-10-05T21:15:36.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.191+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:170 3.13 3:c88290cc:::193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3f7d0 2023-10-05T21:15:36.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.191+0000 7fa2291f9680 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_2 2023-10-05T21:15:36.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.191+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:171 3.e 3:700239b1:::193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da7f50 con 0x559334d437c0 2023-10-05T21:15:36.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.191+0000 7fa2291f9680 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_3 2023-10-05T21:15:36.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.191+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:172 3.1 3:816c418d:::193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5690 con 0x559334d3bec0 2023-10-05T21:15:36.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.191+0000 7fa2291f9680 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_4 2023-10-05T21:15:36.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.191+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:173 3.37 3:ecf069b3:::193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da7f50 con 0x559334d385e0 2023-10-05T21:15:36.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.191+0000 7fa2291f9680 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_5 2023-10-05T21:15:36.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.191+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:174 3.20 3:0743845f:::193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334daf230 con 0x559334d437c0 2023-10-05T21:15:36.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.191+0000 7fa2291f9680 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_6 2023-10-05T21:15:36.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.191+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:175 3.32 3:4dbdc7f0:::193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334db1af0 con 0x559334d3f7d0 2023-10-05T21:15:36.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.191+0000 7fa2291f9680 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_7 2023-10-05T21:15:36.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.191+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:176 3.33 3:cdd17340:::193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334db43b0 con 0x559334d3bec0 2023-10-05T21:15:36.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.192+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(173 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_4 [call] v29'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.192+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 32 ==== osd_op_reply(172 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_3 [call] v29'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.192+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 31 ==== osd_op_reply(174 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_5 [call] v29'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.192+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 33 ==== osd_op_reply(176 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_7 [call] v29'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.192+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 73 ==== osd_op_reply(175 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_6 [call] v29'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.192+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 32 ==== osd_op_reply(171 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_2 [call] v29'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.192+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 74 ==== osd_op_reply(170 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.1__shadow_.G6ySAfnaCOI56JZVljt1QzOVwQqUC1F_1 [call] v29'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.192+0000 7fa2291f9680 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T21:15:36.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.192+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:177 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d437c0 2023-10-05T21:15:36.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.193+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 33 ==== osd_op_reply(177 gc.4 [call] v29'57 uv57 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.193+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:178 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d437c0 2023-10-05T21:15:36.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.194+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 34 ==== osd_op_reply(178 gc.4 [call] v29'58 uv58 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.194+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2023-10-05T21:15:36.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.194+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:179 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d3f7d0 2023-10-05T21:15:36.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.195+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 75 ==== osd_op_reply(179 gc.5 [call] v29'35 uv35 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.195+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:180 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d3f7d0 2023-10-05T21:15:36.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.195+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 76 ==== osd_op_reply(180 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.195+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.195+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:181 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da4680 con 0x559334d3f7d0 2023-10-05T21:15:36.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.195+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 77 ==== osd_op_reply(181 gc.5 [call out=24b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.195+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:182 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d3f7d0 2023-10-05T21:15:36.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.195+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 78 ==== osd_op_reply(182 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.195+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.195+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:183 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d3f7d0 2023-10-05T21:15:36.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.196+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 79 ==== osd_op_reply(183 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.196+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.196+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:184 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d3f7d0 2023-10-05T21:15:36.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.196+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 80 ==== osd_op_reply(184 gc.5 [call] v29'36 uv36 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.196+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2023-10-05T21:15:36.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.196+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:185 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d385e0 2023-10-05T21:15:36.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.197+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(185 gc.6 [call] v29'22 uv22 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.197+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:186 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d385e0 2023-10-05T21:15:36.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.197+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(186 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.197+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.197+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:187 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da4680 con 0x559334d385e0 2023-10-05T21:15:36.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.198+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(187 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.198+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:188 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d385e0 2023-10-05T21:15:36.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.198+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== osd_op_reply(188 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.198+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.198+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:189 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da3180 con 0x559334d385e0 2023-10-05T21:15:36.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.198+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 42 ==== osd_op_reply(189 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.198+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.198+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:190 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da3180 con 0x559334d385e0 2023-10-05T21:15:36.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.199+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.1 v2:172.21.15.153:6816/140456 43 ==== osd_op_reply(190 gc.6 [call] v29'23 uv23 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d385e0 2023-10-05T21:15:36.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.199+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2023-10-05T21:15:36.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.199+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:191 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da3180 con 0x559334d3bec0 2023-10-05T21:15:36.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.200+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 34 ==== osd_op_reply(191 gc.7 [call] v29'39 uv39 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.200+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:192 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da3180 con 0x559334d3bec0 2023-10-05T21:15:36.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.200+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 35 ==== osd_op_reply(192 gc.7 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.200+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.200+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:193 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da3180 con 0x559334d3bec0 2023-10-05T21:15:36.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.200+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 36 ==== osd_op_reply(193 gc.7 [call out=24b] v0'0 uv39 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.200+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:194 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da3180 con 0x559334d3bec0 2023-10-05T21:15:36.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.201+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 37 ==== osd_op_reply(194 gc.7 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.201+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.201+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:195 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da3180 con 0x559334d3bec0 2023-10-05T21:15:36.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.201+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 38 ==== osd_op_reply(195 gc.7 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.201+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.201+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:196 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da3180 con 0x559334d3bec0 2023-10-05T21:15:36.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.202+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 39 ==== osd_op_reply(196 gc.7 [call] v29'40 uv40 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.202+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2023-10-05T21:15:36.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.202+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:197 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da3180 con 0x559334d437c0 2023-10-05T21:15:36.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.202+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 35 ==== osd_op_reply(197 gc.8 [call] v29'20 uv20 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.202+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:198 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da3180 con 0x559334d437c0 2023-10-05T21:15:36.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.203+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 36 ==== osd_op_reply(198 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.203+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.203+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:199 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da3180 con 0x559334d437c0 2023-10-05T21:15:36.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.203+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 37 ==== osd_op_reply(199 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.203+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:200 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da3180 con 0x559334d437c0 2023-10-05T21:15:36.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.203+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 38 ==== osd_op_reply(200 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.203+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.203+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:201 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da3180 con 0x559334d437c0 2023-10-05T21:15:36.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.203+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 39 ==== osd_op_reply(201 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.204+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.204+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:202 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da3180 con 0x559334d437c0 2023-10-05T21:15:36.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.204+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 40 ==== osd_op_reply(202 gc.8 [call] v29'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.204+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2023-10-05T21:15:36.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.204+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:203 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da3180 con 0x559334d3f7d0 2023-10-05T21:15:36.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.205+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 81 ==== osd_op_reply(203 gc.9 [call] v29'26 uv26 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.205+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:204 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da3180 con 0x559334d3f7d0 2023-10-05T21:15:36.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.205+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 82 ==== osd_op_reply(204 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.205+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.205+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:205 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da6f40 con 0x559334d3f7d0 2023-10-05T21:15:36.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.205+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 83 ==== osd_op_reply(205 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.205+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:206 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da3180 con 0x559334d3f7d0 2023-10-05T21:15:36.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.206+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 84 ==== osd_op_reply(206 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.206+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.206+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:207 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d3f7d0 2023-10-05T21:15:36.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.206+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 85 ==== osd_op_reply(207 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.206+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.206+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:208 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d3f7d0 2023-10-05T21:15:36.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.206+0000 7fa21cad2700 1 -- 172.21.15.153:0/3836279582 <== osd.3 v2:172.21.15.153:6800/140455 86 ==== osd_op_reply(208 gc.9 [call] v29'27 uv27 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334d3f7d0 2023-10-05T21:15:36.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.206+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2023-10-05T21:15:36.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.206+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:209 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d437c0 2023-10-05T21:15:36.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.207+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 41 ==== osd_op_reply(209 gc.10 [call] v29'59 uv59 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.207+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:210 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d437c0 2023-10-05T21:15:36.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.207+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 42 ==== osd_op_reply(210 gc.10 [call out=15b] v0'0 uv59 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.207+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.207+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:211 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da4680 con 0x559334d437c0 2023-10-05T21:15:36.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.208+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 43 ==== osd_op_reply(211 gc.10 [call out=24b] v0'0 uv59 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.208+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:212 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d437c0 2023-10-05T21:15:36.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.208+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 44 ==== osd_op_reply(212 gc.10 [call out=15b] v0'0 uv59 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.208+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.208+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:213 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d437c0 2023-10-05T21:15:36.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.208+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 45 ==== osd_op_reply(213 gc.10 [call out=15b] v0'0 uv59 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.208+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.208+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:214 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d437c0 2023-10-05T21:15:36.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.209+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 46 ==== osd_op_reply(214 gc.10 [call] v29'60 uv60 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.209+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2023-10-05T21:15:36.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.209+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:215 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d3bec0 2023-10-05T21:15:36.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.209+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 40 ==== osd_op_reply(215 gc.11 [call] v29'26 uv26 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.209+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:216 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d3bec0 2023-10-05T21:15:36.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.210+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 41 ==== osd_op_reply(216 gc.11 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.210+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.210+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:217 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d3bec0 2023-10-05T21:15:36.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.210+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 42 ==== osd_op_reply(217 gc.11 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.210+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:218 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d3bec0 2023-10-05T21:15:36.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.210+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 43 ==== osd_op_reply(218 gc.11 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.210+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.210+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:219 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d3bec0 2023-10-05T21:15:36.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.210+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 44 ==== osd_op_reply(219 gc.11 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.210+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.210+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:220 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d3bec0 2023-10-05T21:15:36.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.211+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 45 ==== osd_op_reply(220 gc.11 [call] v29'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.211+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2023-10-05T21:15:36.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.211+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:221 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d437c0 2023-10-05T21:15:36.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.212+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 47 ==== osd_op_reply(221 gc.12 [call] v29'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.212+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:222 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d437c0 2023-10-05T21:15:36.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.212+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 48 ==== osd_op_reply(222 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.212+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.212+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:223 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da4680 con 0x559334d437c0 2023-10-05T21:15:36.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.212+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 49 ==== osd_op_reply(223 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.212+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:224 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d437c0 2023-10-05T21:15:36.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.213+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 50 ==== osd_op_reply(224 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.213+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.213+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:225 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d437c0 2023-10-05T21:15:36.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.213+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 51 ==== osd_op_reply(225 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.213+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.213+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:226 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d437c0 2023-10-05T21:15:36.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.214+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 <== osd.2 v2:172.21.15.153:6807/140454 52 ==== osd_op_reply(226 gc.12 [call] v29'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d437c0 2023-10-05T21:15:36.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.214+0000 7fa2291f9680 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2023-10-05T21:15:36.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.214+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:227 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d3bec0 2023-10-05T21:15:36.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.215+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 46 ==== osd_op_reply(227 gc.13 [call] v29'41 uv41 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.215+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:228 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d3bec0 2023-10-05T21:15:36.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.215+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 47 ==== osd_op_reply(228 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.215+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.215+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:229 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da4680 con 0x559334d3bec0 2023-10-05T21:15:36.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.215+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 48 ==== osd_op_reply(229 gc.13 [call out=24b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.215+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:230 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d3bec0 2023-10-05T21:15:36.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.215+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 49 ==== osd_op_reply(230 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.215+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T21:15:36.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.215+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:231 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d3bec0 2023-10-05T21:15:36.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.216+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 50 ==== osd_op_reply(231 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.216+0000 7fa2291f9680 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T21:15:36.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.216+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:232 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334da5a40 con 0x559334d3bec0 2023-10-05T21:15:36.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.216+0000 7fa21bad0700 1 -- 172.21.15.153:0/3836279582 <== osd.0 v2:172.21.15.111:6800/111394 51 ==== osd_op_reply(232 gc.13 [call] v29'42 uv42 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa21005b040 con 0x559334d3bec0 2023-10-05T21:15:36.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.217+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94090734679904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d626f0 con 0x7fa20c016730 2023-10-05T21:15:36.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.217+0000 7fa21bad0700 1 -- 172.21.15.153:0/1836458336 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(102 notify.0 [watch unwatch cookie 94090734679904] v29'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa21005b040 con 0x7fa20c016730 2023-10-05T21:15:36.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.217+0000 7fa2291f9680 20 remove_watcher() i=0 2023-10-05T21:15:36.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.217+0000 7fa2291f9680 2 removed watcher, disabling cache 2023-10-05T21:15:36.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.217+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94090734682192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d13760 con 0x559334cd9790 2023-10-05T21:15:36.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.218+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(103 notify.1 [watch unwatch cookie 94090734682192] v29'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.218+0000 7fa2291f9680 20 remove_watcher() i=1 2023-10-05T21:15:36.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.218+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:104 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94090734684400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d13760 con 0x559334d0bfa0 2023-10-05T21:15:36.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.219+0000 7fa21c2d1700 1 -- 172.21.15.153:0/1836458336 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(104 notify.2 [watch unwatch cookie 94090734684400] v29'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa20c04e040 con 0x559334d0bfa0 2023-10-05T21:15:36.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.219+0000 7fa2291f9680 20 remove_watcher() i=2 2023-10-05T21:15:36.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.219+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94090734689840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d13760 con 0x7fa20c016730 2023-10-05T21:15:36.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.220+0000 7fa21bad0700 1 -- 172.21.15.153:0/1836458336 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(105 notify.3 [watch unwatch cookie 94090734689840] v29'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa21005b040 con 0x7fa20c016730 2023-10-05T21:15:36.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.220+0000 7fa2291f9680 20 remove_watcher() i=3 2023-10-05T21:15:36.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.220+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94090734695168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d15e30 con 0x559334cd9790 2023-10-05T21:15:36.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.221+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(106 notify.4 [watch unwatch cookie 94090734695168] v29'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.221+0000 7fa2291f9680 20 remove_watcher() i=4 2023-10-05T21:15:36.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.221+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:107 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94090734697376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d17300 con 0x7fa210007030 2023-10-05T21:15:36.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.221+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(107 notify.5 [watch unwatch cookie 94090734697376] v29'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x7fa210007030 2023-10-05T21:15:36.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.221+0000 7fa2291f9680 20 remove_watcher() i=5 2023-10-05T21:15:36.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.221+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94090734699072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d15e30 con 0x7fa210007030 2023-10-05T21:15:36.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.222+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(108 notify.6 [watch unwatch cookie 94090734699072] v29'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x7fa210007030 2023-10-05T21:15:36.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.222+0000 7fa2291f9680 20 remove_watcher() i=6 2023-10-05T21:15:36.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.222+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94090734704016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d17300 con 0x7fa210007030 2023-10-05T21:15:36.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.223+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(109 notify.7 [watch unwatch cookie 94090734704016] v29'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x7fa210007030 2023-10-05T21:15:36.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.223+0000 7fa2291f9680 20 remove_watcher() i=7 2023-10-05T21:15:36.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.224+0000 7fa1edfe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:36.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.224+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:110 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94090734705312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x559334d19590 con 0x559334cd9790 2023-10-05T21:15:36.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(110 data_loggenerations_metadata [watch unwatch cookie 94090734705312] v29'187 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa21400a570 con 0x559334cd9790 2023-10-05T21:15:36.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fa210007030 msgr2=0x7fa21001d430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 --2- 172.21.15.153:0/1836458336 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fa210007030 0x7fa21001d430 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x559334cd9790 msgr2=0x559334d09b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 --2- 172.21.15.153:0/1836458336 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x559334cd9790 0x559334d09b30 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fa20c016730 msgr2=0x7fa20c00d3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 --2- 172.21.15.153:0/1836458336 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fa20c016730 0x7fa20c00d3d0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x559334d0bfa0 msgr2=0x559334d0e380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 --2- 172.21.15.153:0/1836458336 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x559334d0bfa0 0x559334d0e380 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa208034140 msgr2=0x7fa2080365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 --2- 172.21.15.153:0/1836458336 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa208034140 0x7fa2080365f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa21000afd0 tx=0x7fa210014000 comp rx=0 tx=0).stop 2023-10-05T21:15:36.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334c49080 msgr2=0x559334cd59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa21cad2700 1 -- 172.21.15.153:0/1836458336 reap_dead start 2023-10-05T21:15:36.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 --2- 172.21.15.153:0/1836458336 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334c49080 0x559334cd59d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x559334cf5440 tx=0x7fa20c016000 comp rx=0 tx=0).stop 2023-10-05T21:15:36.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 shutdown_connections 2023-10-05T21:15:36.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 --2- 172.21.15.153:0/1836458336 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334c49080 0x559334cd59d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 >> 172.21.15.153:0/1836458336 conn(0x559334ccfb60 msgr2=0x559334cee9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:36.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 shutdown_connections 2023-10-05T21:15:36.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 -- 172.21.15.153:0/1836458336 wait complete. 2023-10-05T21:15:36.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x559334d3bec0 msgr2=0x559334d3e2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 --2- 172.21.15.153:0/3836279582 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x559334d3bec0 0x559334d3e2a0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x559334d385e0 msgr2=0x559334d3aa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 --2- 172.21.15.153:0/3836279582 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x559334d385e0 0x559334d3aa90 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x559334d437c0 msgr2=0x559334d45bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 --2- 172.21.15.153:0/3836279582 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x559334d437c0 0x559334d45bc0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x559334d3f7d0 msgr2=0x559334d41c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 --2- 172.21.15.153:0/3836279582 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x559334d3f7d0 0x559334d41c80 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa15c034140 msgr2=0x7fa15c0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 --2- 172.21.15.153:0/3836279582 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa15c034140 0x7fa15c0365f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x559334d19020 tx=0x7fa214037450 comp rx=0 tx=0).stop 2023-10-05T21:15:36.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334d26ae0 msgr2=0x559334d2d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 --2- 172.21.15.153:0/3836279582 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334d26ae0 0x559334d2d7e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x559334d22350 tx=0x7fa210039000 comp rx=0 tx=0).stop 2023-10-05T21:15:36.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa21c2d1700 1 -- 172.21.15.153:0/3836279582 reap_dead start 2023-10-05T21:15:36.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 shutdown_connections 2023-10-05T21:15:36.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 --2- 172.21.15.153:0/3836279582 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559334d26ae0 0x559334d2d7e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 >> 172.21.15.153:0/3836279582 conn(0x559334d22de0 msgr2=0x559334d20eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:36.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.225+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 shutdown_connections 2023-10-05T21:15:36.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.226+0000 7fa2291f9680 1 -- 172.21.15.153:0/3836279582 wait complete. 2023-10-05T21:15:36.245 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2023-10-05T21:15:36.245 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2023-10-05T21:15:36.245 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2023-10-05T21:15:36.320 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:36.320 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:36.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.319+0000 7f1b7b2e8680 1 Processor -- start 2023-10-05T21:15:36.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.319+0000 7f1b7b2e8680 1 -- start start 2023-10-05T21:15:36.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.320+0000 7f1b7b2e8680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55b740a4b900 0x55b740a4dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.320+0000 7f1b7b2e8680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b740995990 con 0x55b740a478c0 2023-10-05T21:15:36.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.320+0000 7f1b7b2e8680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b740955db0 con 0x55b740a4b900 2023-10-05T21:15:36.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.320+0000 7f1b6dbbf700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55b740a4b900 0x55b740a4dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.320+0000 7f1b6e3c0700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55b740a478c0 0x55b740a47cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:39240/0 (socket says 172.21.15.153:39240) 2023-10-05T21:15:36.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.320+0000 7f1b6dbbf700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55b740a4b900 0x55b740a4dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57614/0 (socket says 172.21.15.153:57614) 2023-10-05T21:15:36.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.320+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/3085552566 learned_addr learned my addr 172.21.15.153:0/3085552566 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:36.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.320+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/3085552566 >> v1:172.21.15.111:6789/0 conn(0x55b740a478c0 legacy=0x55b740a47cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.320+0000 7f1b6d3be700 1 -- 172.21.15.153:0/3085552566 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2187136169 0 0) 0x55b740995990 con 0x55b740a478c0 2023-10-05T21:15:36.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.320+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/3085552566 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b740a4f230 con 0x55b740a4b900 2023-10-05T21:15:36.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.321+0000 7f1b6dbbf700 1 --2- 172.21.15.153:0/3085552566 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a4b900 0x55b740a4dce0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1b6000a5d0 tx=0x7f1b60005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44b88afc4cb5f99 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.321+0000 7f1b6d3be700 1 -- 172.21.15.153:0/3085552566 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b600086a0 con 0x55b740a4b900 2023-10-05T21:15:36.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.321+0000 7f1b6d3be700 1 -- 172.21.15.153:0/3085552566 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b60008800 con 0x55b740a4b900 2023-10-05T21:15:36.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.321+0000 7f1b6d3be700 1 -- 172.21.15.153:0/3085552566 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b60008ad0 con 0x55b740a4b900 2023-10-05T21:15:36.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.321+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/3085552566 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a4b900 msgr2=0x55b740a4dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.321+0000 7f1b7b2e8680 1 --2- 172.21.15.153:0/3085552566 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a4b900 0x55b740a4dce0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1b6000a5d0 tx=0x7f1b60005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:36.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.321+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/3085552566 shutdown_connections 2023-10-05T21:15:36.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.321+0000 7f1b7b2e8680 1 --2- 172.21.15.153:0/3085552566 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a4b900 0x55b740a4dce0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.321+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/3085552566 >> 172.21.15.153:0/3085552566 conn(0x55b740a42300 msgr2=0x55b740a44710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:36.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.321+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/3085552566 shutdown_connections 2023-10-05T21:15:36.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.321+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/3085552566 wait complete. 2023-10-05T21:15:36.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.322+0000 7f1b7b2e8680 1 Processor -- start 2023-10-05T21:15:36.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.322+0000 7f1b7b2e8680 1 -- start start 2023-10-05T21:15:36.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.322+0000 7f1b7b2e8680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a478c0 0x55b740a66600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.322+0000 7f1b7b2e8680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7408f5ea0 con 0x55b740a478c0 2023-10-05T21:15:36.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.323+0000 7f1b6e3c0700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a478c0 0x55b740a66600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.323+0000 7f1b6e3c0700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a478c0 0x55b740a66600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57630/0 (socket says 172.21.15.153:57630) 2023-10-05T21:15:36.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.323+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/1487038744 learned_addr learned my addr 172.21.15.153:0/1487038744 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:36.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.323+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/1487038744 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b60005cf0 con 0x55b740a478c0 2023-10-05T21:15:36.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.323+0000 7f1b6e3c0700 1 --2- 172.21.15.153:0/1487038744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a478c0 0x55b740a66600 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1b64001dc0 tx=0x7f1b64001790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48c47a7593ae7d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.323+0000 7f1b5ffff700 1 -- 172.21.15.153:0/1487038744 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b6400bce0 con 0x55b740a478c0 2023-10-05T21:15:36.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.323+0000 7f1b5ffff700 1 -- 172.21.15.153:0/1487038744 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6400be40 con 0x55b740a478c0 2023-10-05T21:15:36.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.323+0000 7f1b5ffff700 1 -- 172.21.15.153:0/1487038744 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b6400e5d0 con 0x55b740a478c0 2023-10-05T21:15:36.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.324+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/1487038744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a478c0 msgr2=0x55b740a66600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.324+0000 7f1b7b2e8680 1 --2- 172.21.15.153:0/1487038744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a478c0 0x55b740a66600 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1b64001dc0 tx=0x7f1b64001790 comp rx=0 tx=0).stop 2023-10-05T21:15:36.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.324+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/1487038744 shutdown_connections 2023-10-05T21:15:36.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.324+0000 7f1b7b2e8680 1 --2- 172.21.15.153:0/1487038744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a478c0 0x55b740a66600 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.324+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/1487038744 >> 172.21.15.153:0/1487038744 conn(0x55b740a42300 msgr2=0x55b740a620d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:36.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.324+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/1487038744 shutdown_connections 2023-10-05T21:15:36.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.324+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/1487038744 wait complete. 2023-10-05T21:15:36.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.324+0000 7f1b7b2e8680 1 Processor -- start 2023-10-05T21:15:36.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.324+0000 7f1b7b2e8680 1 -- start start 2023-10-05T21:15:36.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.324+0000 7f1b7b2e8680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a478c0 0x55b740a47160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.324+0000 7f1b7b2e8680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7408ecc80 con 0x55b740a478c0 2023-10-05T21:15:36.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.325+0000 7f1b6e3c0700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a478c0 0x55b740a47160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.325+0000 7f1b6e3c0700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a478c0 0x55b740a47160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57634/0 (socket says 172.21.15.153:57634) 2023-10-05T21:15:36.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.325+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 learned_addr learned my addr 172.21.15.153:0/2658734127 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:36.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.325+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b64001a70 con 0x55b740a478c0 2023-10-05T21:15:36.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.325+0000 7f1b6e3c0700 1 --2- 172.21.15.153:0/2658734127 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a478c0 0x55b740a47160 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1b640017d0 tx=0x7f1b64016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.325+0000 7f1b5e7fc700 1 -- 172.21.15.153:0/2658734127 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b6401f070 con 0x55b740a478c0 2023-10-05T21:15:36.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.325+0000 7f1b5e7fc700 1 -- 172.21.15.153:0/2658734127 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6401a4d0 con 0x55b740a478c0 2023-10-05T21:15:36.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.325+0000 7f1b5e7fc700 1 -- 172.21.15.153:0/2658734127 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b6401a7a0 con 0x55b740a478c0 2023-10-05T21:15:36.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.325+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b740a6f6c0 con 0x55b740a478c0 2023-10-05T21:15:36.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.325+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b740a73f30 con 0x55b740a478c0 2023-10-05T21:15:36.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.326+0000 7f1b5e7fc700 1 -- 172.21.15.153:0/2658734127 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f1b6401a900 con 0x55b740a478c0 2023-10-05T21:15:36.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.326+0000 7f1b5e7fc700 1 --2- 172.21.15.153:0/2658734127 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1b50034140 0x7f1b500365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.326+0000 7f1b5e7fc700 1 -- 172.21.15.153:0/2658734127 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f1b64048f70 con 0x55b740a478c0 2023-10-05T21:15:36.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.326+0000 7f1b6dbbf700 1 --2- 172.21.15.153:0/2658734127 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1b50034140 0x7f1b500365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.327+0000 7f1b7b2e8680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.327+0000 7f1b7b2e8680 1 --2- 172.21.15.153:0/2658734127 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55b740a4b900 0x55b740a7cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.327+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a7d2b0 con 0x55b740a4b900 2023-10-05T21:15:36.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.327+0000 7f1b6ebc1700 1 --2- 172.21.15.153:0/2658734127 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55b740a4b900 0x55b740a7cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.327+0000 7f1b6dbbf700 1 --2- 172.21.15.153:0/2658734127 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1b50034140 0x7f1b500365f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x55b7409bb0b0 tx=0x7f1b60015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.327+0000 7f1b6ebc1700 1 --2- 172.21.15.153:0/2658734127 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55b740a4b900 0x55b740a7cb20 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.327+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.327+0000 7f1b7b2e8680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.327+0000 7f1b7b2e8680 20 realm 2023-10-05T21:15:36.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.327+0000 7f1b7b2e8680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.327+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a7a080 con 0x55b740a4b900 2023-10-05T21:15:36.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.327+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.327+0000 7f1b7b2e8680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.327+0000 7f1b7b2e8680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:36.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.328+0000 7f1b7b2e8680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.328+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a7dd90 con 0x55b740a4b900 2023-10-05T21:15:36.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.328+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.328+0000 7f1b7b2e8680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.328+0000 7f1b7b2e8680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.328+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a7d9b0 con 0x55b740a4b900 2023-10-05T21:15:36.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.328+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.328+0000 7f1b7b2e8680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:36.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.328+0000 7f1b7b2e8680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.328+0000 7f1b7b2e8680 1 --2- 172.21.15.153:0/2658734127 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b740a7f130 0x55b740a81510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.328+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a81a50 con 0x55b740a7f130 2023-10-05T21:15:36.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.328+0000 7f1b6e3c0700 1 --2- 172.21.15.153:0/2658734127 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b740a7f130 0x55b740a81510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.328+0000 7f1b6e3c0700 1 --2- 172.21.15.153:0/2658734127 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b740a7f130 0x55b740a81510 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.329+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f1b64014070 con 0x55b740a7f130 2023-10-05T21:15:36.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.329+0000 7f1b7b2e8680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:36.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.329+0000 7f1b7b2e8680 20 searching for the correct realm 2023-10-05T21:15:36.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.329+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x55b740a7f130 2023-10-05T21:15:36.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.329+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b64014070 con 0x55b740a7f130 2023-10-05T21:15:36.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.329+0000 7f1b6e3c0700 1 --2- 172.21.15.153:0/2658734127 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f1b6402d020 0x7f1b64047850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.329+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x7f1b6402d020 2023-10-05T21:15:36.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.329+0000 7f1b6dbbf700 1 --2- 172.21.15.153:0/2658734127 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f1b6402d020 0x7f1b64047850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.329+0000 7f1b6dbbf700 1 --2- 172.21.15.153:0/2658734127 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f1b6402d020 0x7f1b64047850 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.329+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2658734127 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b60019040 con 0x7f1b6402d020 2023-10-05T21:15:36.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.330+0000 7f1b6dbbf700 1 --2- 172.21.15.153:0/2658734127 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f1b60007030 0x7f1b6001d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.330+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x7f1b60007030 2023-10-05T21:15:36.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.330+0000 7f1b6ebc1700 1 --2- 172.21.15.153:0/2658734127 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f1b60007030 0x7f1b6001d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.330+0000 7f1b6ebc1700 1 --2- 172.21.15.153:0/2658734127 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f1b60007030 0x7f1b6001d420 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.330+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b6800a570 con 0x7f1b60007030 2023-10-05T21:15:36.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.330+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x55b740a4b900 2023-10-05T21:15:36.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.331+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.331+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x55b740a4b900 2023-10-05T21:15:36.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.331+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.331+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x7f1b60007030 2023-10-05T21:15:36.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.331+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b6800a570 con 0x7f1b60007030 2023-10-05T21:15:36.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.331+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x7f1b60007030 2023-10-05T21:15:36.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.331+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b6800a570 con 0x7f1b60007030 2023-10-05T21:15:36.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.331+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x7f1b6402d020 2023-10-05T21:15:36.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.332+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2658734127 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b60019040 con 0x7f1b6402d020 2023-10-05T21:15:36.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.332+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x55b740a7f130 2023-10-05T21:15:36.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.332+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1b64014070 con 0x55b740a7f130 2023-10-05T21:15:36.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.332+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x55b740a4b900 2023-10-05T21:15:36.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.332+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.332+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x7f1b60007030 2023-10-05T21:15:36.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.332+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b6800a570 con 0x7f1b60007030 2023-10-05T21:15:36.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.332+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x55b740a4b900 2023-10-05T21:15:36.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.332+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.332+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x7f1b6402d020 2023-10-05T21:15:36.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.333+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2658734127 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b60019040 con 0x7f1b6402d020 2023-10-05T21:15:36.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.333+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x55b740a7f130 2023-10-05T21:15:36.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.333+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b64014070 con 0x55b740a7f130 2023-10-05T21:15:36.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.333+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x55b740a7f130 2023-10-05T21:15:36.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.333+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b64014070 con 0x55b740a7f130 2023-10-05T21:15:36.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.333+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x7f1b60007030 2023-10-05T21:15:36.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.333+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b6800a570 con 0x7f1b60007030 2023-10-05T21:15:36.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.333+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x55b740a7f130 2023-10-05T21:15:36.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.333+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b64014070 con 0x55b740a7f130 2023-10-05T21:15:36.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.333+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x55b740a7f130 2023-10-05T21:15:36.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.334+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b64014070 con 0x55b740a7f130 2023-10-05T21:15:36.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.334+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x55b740a4b900 2023-10-05T21:15:36.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.334+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.334+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x55b740a4b900 2023-10-05T21:15:36.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.334+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.334+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x7f1b60007030 2023-10-05T21:15:36.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.334+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b6800a570 con 0x7f1b60007030 2023-10-05T21:15:36.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.334+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x55b740a7f130 2023-10-05T21:15:36.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.334+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b64014070 con 0x55b740a7f130 2023-10-05T21:15:36.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.334+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x7f1b6402d020 2023-10-05T21:15:36.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.335+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2658734127 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b60019040 con 0x7f1b6402d020 2023-10-05T21:15:36.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.335+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x55b740a4b900 2023-10-05T21:15:36.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.335+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.335+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x7f1b60007030 2023-10-05T21:15:36.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.335+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b6800a570 con 0x7f1b60007030 2023-10-05T21:15:36.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.335+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x55b740a7f130 2023-10-05T21:15:36.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.335+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b64014070 con 0x55b740a7f130 2023-10-05T21:15:36.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.335+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x7f1b60007030 2023-10-05T21:15:36.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.336+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b6800a570 con 0x7f1b60007030 2023-10-05T21:15:36.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.336+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x7f1b6402d020 2023-10-05T21:15:36.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.336+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2658734127 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b60019040 con 0x7f1b6402d020 2023-10-05T21:15:36.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.336+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x55b740a7f130 2023-10-05T21:15:36.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.336+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b64014070 con 0x55b740a7f130 2023-10-05T21:15:36.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.336+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x7f1b60007030 2023-10-05T21:15:36.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.337+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b6800a570 con 0x7f1b60007030 2023-10-05T21:15:36.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.337+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x55b740a4b900 2023-10-05T21:15:36.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.337+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.337+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83300 con 0x7f1b6402d020 2023-10-05T21:15:36.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.337+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2658734127 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b60019040 con 0x7f1b6402d020 2023-10-05T21:15:36.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.337+0000 7f1b7b2e8680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:36.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.337+0000 7f1b7b2e8680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:36.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.337+0000 7f1b7b2e8680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:36.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.337+0000 7f1b7b2e8680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:36.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.337+0000 7f1b7b2e8680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.337+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a82420 con 0x55b740a4b900 2023-10-05T21:15:36.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.337+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.337+0000 7f1b7b2e8680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.337+0000 7f1b7b2e8680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.337+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a828b0 con 0x55b740a4b900 2023-10-05T21:15:36.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.337+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.337+0000 7f1b7b2e8680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:36.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.337+0000 7f1b7b2e8680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.337+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a82ce0 con 0x55b740a4b900 2023-10-05T21:15:36.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.338+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.338+0000 7f1b7b2e8680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:36.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.338+0000 7f1b7b2e8680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.338+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a836b0 con 0x55b740a7f130 2023-10-05T21:15:36.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.338+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f1b64014070 con 0x55b740a7f130 2023-10-05T21:15:36.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.338+0000 7f1b7b2e8680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.338+0000 7f1b7b2e8680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.338+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83a60 con 0x55b740a4b900 2023-10-05T21:15:36.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.338+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.338+0000 7f1b7b2e8680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.338+0000 7f1b7b2e8680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.338+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83e90 con 0x55b740a4b900 2023-10-05T21:15:36.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.338+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.338+0000 7f1b7b2e8680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:36.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.338+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a84ea0 con 0x55b740a7f130 2023-10-05T21:15:36.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.339+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b64014070 con 0x55b740a7f130 2023-10-05T21:15:36.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.339+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a84ea0 con 0x7f1b6402d020 2023-10-05T21:15:36.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.339+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2658734127 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b60019040 con 0x7f1b6402d020 2023-10-05T21:15:36.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.339+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a84ea0 con 0x7f1b60007030 2023-10-05T21:15:36.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.339+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b6800a570 con 0x7f1b60007030 2023-10-05T21:15:36.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.339+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a82ce0 con 0x55b740a4b900 2023-10-05T21:15:36.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.339+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.339+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a82ce0 con 0x55b740a4b900 2023-10-05T21:15:36.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.340+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.340+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a82ce0 con 0x7f1b60007030 2023-10-05T21:15:36.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.340+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b6800a570 con 0x7f1b60007030 2023-10-05T21:15:36.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.340+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a82ce0 con 0x7f1b60007030 2023-10-05T21:15:36.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.340+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b6800a570 con 0x7f1b60007030 2023-10-05T21:15:36.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.340+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a82ce0 con 0x7f1b6402d020 2023-10-05T21:15:36.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.340+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2658734127 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b60019040 con 0x7f1b6402d020 2023-10-05T21:15:36.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.340+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a82ce0 con 0x55b740a7f130 2023-10-05T21:15:36.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.341+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1b64014070 con 0x55b740a7f130 2023-10-05T21:15:36.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.341+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a82ce0 con 0x55b740a4b900 2023-10-05T21:15:36.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.341+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.341+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a82ce0 con 0x7f1b60007030 2023-10-05T21:15:36.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.341+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b6800a570 con 0x7f1b60007030 2023-10-05T21:15:36.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.341+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a82ce0 con 0x55b740a4b900 2023-10-05T21:15:36.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.341+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.341+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a82ce0 con 0x7f1b6402d020 2023-10-05T21:15:36.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.341+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2658734127 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b60019040 con 0x7f1b6402d020 2023-10-05T21:15:36.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.341+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a82ce0 con 0x55b740a7f130 2023-10-05T21:15:36.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.342+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b64014070 con 0x55b740a7f130 2023-10-05T21:15:36.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.342+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a82ce0 con 0x55b740a7f130 2023-10-05T21:15:36.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.342+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b64014070 con 0x55b740a7f130 2023-10-05T21:15:36.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.342+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a82ce0 con 0x7f1b60007030 2023-10-05T21:15:36.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.342+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b6800a570 con 0x7f1b60007030 2023-10-05T21:15:36.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.342+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a82ce0 con 0x55b740a7f130 2023-10-05T21:15:36.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.342+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b64014070 con 0x55b740a7f130 2023-10-05T21:15:36.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.342+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a82ce0 con 0x55b740a7f130 2023-10-05T21:15:36.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.342+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b64014070 con 0x55b740a7f130 2023-10-05T21:15:36.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.342+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a82ce0 con 0x55b740a4b900 2023-10-05T21:15:36.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.343+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.343+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a82ce0 con 0x55b740a4b900 2023-10-05T21:15:36.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.343+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.343+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a82ce0 con 0x7f1b60007030 2023-10-05T21:15:36.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.343+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b6800a570 con 0x7f1b60007030 2023-10-05T21:15:36.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.343+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a82ce0 con 0x55b740a7f130 2023-10-05T21:15:36.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.343+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b64014070 con 0x55b740a7f130 2023-10-05T21:15:36.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.343+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a82ce0 con 0x7f1b6402d020 2023-10-05T21:15:36.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.343+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2658734127 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b60019040 con 0x7f1b6402d020 2023-10-05T21:15:36.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.343+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a82ce0 con 0x55b740a4b900 2023-10-05T21:15:36.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.344+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.344+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a82ce0 con 0x7f1b60007030 2023-10-05T21:15:36.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.344+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b6800a570 con 0x7f1b60007030 2023-10-05T21:15:36.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.344+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a82ce0 con 0x55b740a7f130 2023-10-05T21:15:36.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.344+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b64014070 con 0x55b740a7f130 2023-10-05T21:15:36.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.344+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a82ce0 con 0x7f1b60007030 2023-10-05T21:15:36.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.345+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b6800a570 con 0x7f1b60007030 2023-10-05T21:15:36.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.345+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a82ce0 con 0x7f1b6402d020 2023-10-05T21:15:36.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.345+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2658734127 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b60019040 con 0x7f1b6402d020 2023-10-05T21:15:36.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.345+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a82ce0 con 0x55b740a7f130 2023-10-05T21:15:36.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.345+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b64014070 con 0x55b740a7f130 2023-10-05T21:15:36.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.345+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a82ce0 con 0x7f1b60007030 2023-10-05T21:15:36.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.345+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b6800a570 con 0x7f1b60007030 2023-10-05T21:15:36.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.345+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a82ce0 con 0x55b740a4b900 2023-10-05T21:15:36.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.346+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.346+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a82ce0 con 0x7f1b6402d020 2023-10-05T21:15:36.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.346+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2658734127 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1b60019040 con 0x7f1b6402d020 2023-10-05T21:15:36.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.346+0000 7f1b7b2e8680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:36.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.346+0000 7f1b7b2e8680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:36.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.346+0000 7f1b7b2e8680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:36.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.346+0000 7f1b7b2e8680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:36.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.346+0000 7f1b7b2e8680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.346+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a83e90 con 0x55b740a4b900 2023-10-05T21:15:36.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.346+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.346+0000 7f1b7b2e8680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:36.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.346+0000 7f1b7b2e8680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.346+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a84240 con 0x55b740a7f130 2023-10-05T21:15:36.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.346+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f1b64014070 con 0x55b740a7f130 2023-10-05T21:15:36.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.346+0000 7f1b7b2e8680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:36.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.346+0000 7f1b7b2e8680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.346+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a81f60 con 0x55b740a4b900 2023-10-05T21:15:36.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.347+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.347+0000 7f1b7b2e8680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:36.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.347+0000 7f1b7b2e8680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.347+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a81f60 con 0x55b740a4b900 2023-10-05T21:15:36.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.347+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.347+0000 7f1b7b2e8680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:36.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.347+0000 7f1b7b2e8680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.347+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a84ae0 con 0x7f1b60007030 2023-10-05T21:15:36.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.347+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x7f1b60007030 2023-10-05T21:15:36.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.347+0000 7f1b7b2e8680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.347+0000 7f1b7b2e8680 20 zone default found 2023-10-05T21:15:36.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.347+0000 7f1b7b2e8680 4 Realm: () 2023-10-05T21:15:36.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.347+0000 7f1b7b2e8680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:36.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.347+0000 7f1b7b2e8680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:36.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.347+0000 7f1b7b2e8680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:36.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.347+0000 7f1b7b2e8680 20 zonegroup default 2023-10-05T21:15:36.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.347+0000 7f1b7b2e8680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.347+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a84ae0 con 0x7f1b60007030 2023-10-05T21:15:36.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.348+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x7f1b60007030 2023-10-05T21:15:36.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.348+0000 7f1b7b2e8680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.348+0000 7f1b7b2e8680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.348+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a86460 con 0x55b740a7f130 2023-10-05T21:15:36.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.348+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1b64014070 con 0x55b740a7f130 2023-10-05T21:15:36.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.348+0000 7f1b7b2e8680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.348+0000 7f1b7b2e8680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.348+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a86810 con 0x55b740a7f130 2023-10-05T21:15:36.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.348+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1b64014070 con 0x55b740a7f130 2023-10-05T21:15:36.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.348+0000 7f1b7b2e8680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.348+0000 7f1b7b2e8680 20 started sync module instance, tier type = 2023-10-05T21:15:36.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.348+0000 7f1b7b2e8680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:36.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.348+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a85b20 con 0x7f1b6402d020 2023-10-05T21:15:36.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.349+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2658734127 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b60019040 con 0x7f1b6402d020 2023-10-05T21:15:36.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.349+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94245552150064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a86c00 con 0x7f1b6402d020 2023-10-05T21:15:36.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.349+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a87650 con 0x55b740a4b900 2023-10-05T21:15:36.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.350+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2658734127 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94245552150064] v29'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b60019040 con 0x7f1b6402d020 2023-10-05T21:15:36.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.350+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.350+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94245552156864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a87a50 con 0x55b740a4b900 2023-10-05T21:15:36.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.350+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a88460 con 0x55b740a7f130 2023-10-05T21:15:36.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.351+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94245552156864] v29'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.351+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b64014070 con 0x55b740a7f130 2023-10-05T21:15:36.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.351+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94245552160624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a88860 con 0x55b740a7f130 2023-10-05T21:15:36.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.351+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a89270 con 0x7f1b6402d020 2023-10-05T21:15:36.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.352+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94245552160624] v29'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b64014070 con 0x55b740a7f130 2023-10-05T21:15:36.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.352+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2658734127 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b60019040 con 0x7f1b6402d020 2023-10-05T21:15:36.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.352+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94245552152352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a89b60 con 0x7f1b6402d020 2023-10-05T21:15:36.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.352+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a8a400 con 0x55b740a4b900 2023-10-05T21:15:36.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.352+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2658734127 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94245552152352] v29'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b60019040 con 0x7f1b6402d020 2023-10-05T21:15:36.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.353+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.353+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94245552168720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a8a360 con 0x55b740a4b900 2023-10-05T21:15:36.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.353+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a8b260 con 0x7f1b60007030 2023-10-05T21:15:36.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.353+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94245552168720] v29'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.353+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x7f1b60007030 2023-10-05T21:15:36.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.353+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94245552170928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a8b220 con 0x7f1b60007030 2023-10-05T21:15:36.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.353+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a8bce0 con 0x7f1b60007030 2023-10-05T21:15:36.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.354+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94245552170928] v29'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x7f1b60007030 2023-10-05T21:15:36.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.354+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x7f1b60007030 2023-10-05T21:15:36.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.354+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94245552175056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a8bce0 con 0x7f1b60007030 2023-10-05T21:15:36.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.354+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a8c730 con 0x7f1b60007030 2023-10-05T21:15:36.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.355+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94245552175056] v29'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x7f1b60007030 2023-10-05T21:15:36.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.355+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x7f1b60007030 2023-10-05T21:15:36.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.355+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94245552172032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a8c6f0 con 0x7f1b60007030 2023-10-05T21:15:36.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.355+0000 7f1b7b2e8680 20 add_watcher() i=0 2023-10-05T21:15:36.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.355+0000 7f1b7b2e8680 20 add_watcher() i=1 2023-10-05T21:15:36.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.355+0000 7f1b7b2e8680 20 add_watcher() i=2 2023-10-05T21:15:36.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.355+0000 7f1b7b2e8680 20 add_watcher() i=3 2023-10-05T21:15:36.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.355+0000 7f1b7b2e8680 20 add_watcher() i=4 2023-10-05T21:15:36.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.355+0000 7f1b7b2e8680 20 add_watcher() i=5 2023-10-05T21:15:36.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.355+0000 7f1b7b2e8680 20 add_watcher() i=6 2023-10-05T21:15:36.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.356+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94245552172032] v29'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x7f1b60007030 2023-10-05T21:15:36.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.356+0000 7f1b7b2e8680 20 add_watcher() i=7 2023-10-05T21:15:36.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.356+0000 7f1b7b2e8680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:36.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.356+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a8fb00 con 0x55b740a4b900 2023-10-05T21:15:36.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.356+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.356+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94245552178128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a8cfc0 con 0x55b740a4b900 2023-10-05T21:15:36.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.357+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94245552178128] v29'188 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.357+0000 7f1b3ffdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:36.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.357+0000 7f1b7b2e8680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:36.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.357+0000 7f1b7b2e8680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:36.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.357+0000 7f1b7b2e8680 1 Processor -- start 2023-10-05T21:15:36.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.357+0000 7f1b7b2e8680 1 -- start start 2023-10-05T21:15:36.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.357+0000 7f1b7b2e8680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a9a460 0x55b740a9a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.357+0000 7f1b7b2e8680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b740a9ae40 con 0x55b740a9a460 2023-10-05T21:15:36.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.357+0000 7f1b6dbbf700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a9a460 0x55b740a9a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.357+0000 7f1b6dbbf700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a9a460 0x55b740a9a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57636/0 (socket says 172.21.15.153:57636) 2023-10-05T21:15:36.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.357+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/3561906689 learned_addr learned my addr 172.21.15.153:0/3561906689 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:36.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.358+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/3561906689 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b740a9af80 con 0x55b740a9a460 2023-10-05T21:15:36.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.358+0000 7f1b6dbbf700 1 --2- 172.21.15.153:0/3561906689 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a9a460 0x55b740a9a870 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1b60002000 tx=0x7f1b60012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12bf7c5b683791b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.358+0000 7f1b3f7de700 1 -- 172.21.15.153:0/3561906689 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b6001de90 con 0x55b740a9a460 2023-10-05T21:15:36.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.358+0000 7f1b3f7de700 1 -- 172.21.15.153:0/3561906689 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6002b440 con 0x55b740a9a460 2023-10-05T21:15:36.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.358+0000 7f1b3f7de700 1 -- 172.21.15.153:0/3561906689 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b6002b5f0 con 0x55b740a9a460 2023-10-05T21:15:36.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.359+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/3561906689 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a9a460 msgr2=0x55b740a9a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.359+0000 7f1b7b2e8680 1 --2- 172.21.15.153:0/3561906689 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a9a460 0x55b740a9a870 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1b60002000 tx=0x7f1b60012000 comp rx=0 tx=0).stop 2023-10-05T21:15:36.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.359+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/3561906689 shutdown_connections 2023-10-05T21:15:36.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.359+0000 7f1b7b2e8680 1 --2- 172.21.15.153:0/3561906689 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a9a460 0x55b740a9a870 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.359+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/3561906689 >> 172.21.15.153:0/3561906689 conn(0x55b740a95660 msgr2=0x55b740a937c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:36.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.359+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/3561906689 shutdown_connections 2023-10-05T21:15:36.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.359+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/3561906689 wait complete. 2023-10-05T21:15:36.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.359+0000 7f1b7b2e8680 1 Processor -- start 2023-10-05T21:15:36.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.359+0000 7f1b7b2e8680 1 -- start start 2023-10-05T21:15:36.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.359+0000 7f1b7b2e8680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a9a460 0x55b740a9ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.359+0000 7f1b7b2e8680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b740aa0480 con 0x55b740a9a460 2023-10-05T21:15:36.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.360+0000 7f1b6dbbf700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a9a460 0x55b740a9ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.360+0000 7f1b6dbbf700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a9a460 0x55b740a9ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57640/0 (socket says 172.21.15.153:57640) 2023-10-05T21:15:36.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.360+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2349735374 learned_addr learned my addr 172.21.15.153:0/2349735374 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:36.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.360+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b740a4f230 con 0x55b740a9a460 2023-10-05T21:15:36.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.360+0000 7f1b6dbbf700 1 --2- 172.21.15.153:0/2349735374 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a9a460 0x55b740a9ff40 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1b60038040 tx=0x7f1b60030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.360+0000 7f1b3dfdb700 1 -- 172.21.15.153:0/2349735374 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b6003f500 con 0x55b740a9a460 2023-10-05T21:15:36.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.360+0000 7f1b3dfdb700 1 -- 172.21.15.153:0/2349735374 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6003f660 con 0x55b740a9a460 2023-10-05T21:15:36.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.360+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b740aa0680 con 0x55b740a9a460 2023-10-05T21:15:36.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.360+0000 7f1b3dfdb700 1 -- 172.21.15.153:0/2349735374 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b6003f7d0 con 0x55b740a9a460 2023-10-05T21:15:36.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.360+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b740aa0ad0 con 0x55b740a9a460 2023-10-05T21:15:36.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.361+0000 7f1b3dfdb700 1 -- 172.21.15.153:0/2349735374 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f1b60047070 con 0x55b740a9a460 2023-10-05T21:15:36.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.361+0000 7f1b3dfdb700 1 --2- 172.21.15.153:0/2349735374 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1ab40340f0 0x7f1ab40365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.361+0000 7f1b3dfdb700 1 -- 172.21.15.153:0/2349735374 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f1b60030070 con 0x55b740a9a460 2023-10-05T21:15:36.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.361+0000 7f1b6ebc1700 1 --2- 172.21.15.153:0/2349735374 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1ab40340f0 0x7f1ab40365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.361+0000 7f1b7b2e8680 1 --2- 172.21.15.153:0/2349735374 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55b740aaad00 0x55b740aad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.361+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740aad8b0 con 0x55b740aaad00 2023-10-05T21:15:36.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.361+0000 7f1b6e3c0700 1 --2- 172.21.15.153:0/2349735374 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55b740aaad00 0x55b740aad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.362+0000 7f1b6ebc1700 1 --2- 172.21.15.153:0/2349735374 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1ab40340f0 0x7f1ab40365a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x55b740a8c890 tx=0x7f1b6800aec0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.362+0000 7f1b6e3c0700 1 --2- 172.21.15.153:0/2349735374 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55b740aaad00 0x55b740aad1b0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.362+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v29'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1b64014070 con 0x55b740aaad00 2023-10-05T21:15:36.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.362+0000 7f1b7b2e8680 1 --2- 172.21.15.153:0/2349735374 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55b740aae630 0x55b740ab0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.362+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740ab10d0 con 0x55b740aae630 2023-10-05T21:15:36.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.363+0000 7f1b6dbbf700 1 --2- 172.21.15.153:0/2349735374 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55b740aae630 0x55b740ab0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.363+0000 7f1b6dbbf700 1 --2- 172.21.15.153:0/2349735374 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55b740aae630 0x55b740ab0a10 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.364+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2349735374 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v29'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1b60033040 con 0x55b740aae630 2023-10-05T21:15:36.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.364+0000 7f1b7b2e8680 1 --2- 172.21.15.153:0/2349735374 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b740ab1e80 0x55b740ab42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.364+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740ab49f0 con 0x55b740ab1e80 2023-10-05T21:15:36.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.364+0000 7f1b6ebc1700 1 --2- 172.21.15.153:0/2349735374 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b740ab1e80 0x55b740ab42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.364+0000 7f1b6ebc1700 1 --2- 172.21.15.153:0/2349735374 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b740ab1e80 0x55b740ab42a0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.365+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v29'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.365+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740ab5120 con 0x55b740aaad00 2023-10-05T21:15:36.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.365+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v29'189 uv186 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1b64014070 con 0x55b740aaad00 2023-10-05T21:15:36.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.365+0000 7f1b7b2e8680 1 --2- 172.21.15.153:0/2349735374 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55b740ab5e80 0x55b740ab8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.365+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740ab8920 con 0x55b740ab5e80 2023-10-05T21:15:36.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.365+0000 7f1b6e3c0700 1 --2- 172.21.15.153:0/2349735374 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55b740ab5e80 0x55b740ab8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.366+0000 7f1b6e3c0700 1 --2- 172.21.15.153:0/2349735374 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55b740ab5e80 0x55b740ab8260 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.366+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v29'61 uv58 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1b64014070 con 0x55b740ab5e80 2023-10-05T21:15:36.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.366+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740ab9050 con 0x55b740ab1e80 2023-10-05T21:15:36.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.367+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v29'37 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.367+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740ab9670 con 0x55b740aaad00 2023-10-05T21:15:36.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.368+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v29'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1b64014070 con 0x55b740aaad00 2023-10-05T21:15:36.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.368+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740ab9670 con 0x55b740aae630 2023-10-05T21:15:36.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.369+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2349735374 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v29'41 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1b60033040 con 0x55b740aae630 2023-10-05T21:15:36.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.369+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740ab9c90 con 0x55b740ab5e80 2023-10-05T21:15:36.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.369+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v29'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1b64014070 con 0x55b740ab5e80 2023-10-05T21:15:36.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.369+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740ab9c90 con 0x55b740ab1e80 2023-10-05T21:15:36.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.370+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v29'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.370+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740ab9c90 con 0x55b740ab5e80 2023-10-05T21:15:36.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.371+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v29'62 uv60 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1b64014070 con 0x55b740ab5e80 2023-10-05T21:15:36.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.371+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740ab9d20 con 0x55b740aae630 2023-10-05T21:15:36.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.372+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2349735374 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v29'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1b60033040 con 0x55b740aae630 2023-10-05T21:15:36.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.372+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740aba340 con 0x55b740ab5e80 2023-10-05T21:15:36.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.372+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v29'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1b64014070 con 0x55b740ab5e80 2023-10-05T21:15:36.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.372+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740aba340 con 0x55b740aae630 2023-10-05T21:15:36.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.373+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2349735374 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v29'43 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1b6005c040 con 0x55b740aae630 2023-10-05T21:15:36.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.373+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740aba830 con 0x55b740aaad00 2023-10-05T21:15:36.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.374+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v29'190 uv182 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1b64014070 con 0x55b740aaad00 2023-10-05T21:15:36.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.374+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740aba830 con 0x55b740ab1e80 2023-10-05T21:15:36.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.375+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v29'50 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.375+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740aba830 con 0x55b740ab5e80 2023-10-05T21:15:36.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.375+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v29'63 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1b64014070 con 0x55b740ab5e80 2023-10-05T21:15:36.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.375+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740aba830 con 0x55b740ab1e80 2023-10-05T21:15:36.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.376+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v29'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.376+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740aba830 con 0x55b740aaad00 2023-10-05T21:15:36.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.377+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v29'33 uv32 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1b64014070 con 0x55b740aaad00 2023-10-05T21:15:36.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.377+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740aba830 con 0x55b740aaad00 2023-10-05T21:15:36.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.378+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v29'191 uv184 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1b64014070 con 0x55b740aaad00 2023-10-05T21:15:36.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.378+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740aba830 con 0x55b740ab1e80 2023-10-05T21:15:36.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.378+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v29'51 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.378+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740aba830 con 0x55b740ab5e80 2023-10-05T21:15:36.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.379+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v29'38 uv37 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1b64014070 con 0x55b740ab5e80 2023-10-05T21:15:36.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.379+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740aba830 con 0x55b740ab1e80 2023-10-05T21:15:36.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.380+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v29'27 uv26 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.380+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740aba8c0 con 0x55b740ab1e80 2023-10-05T21:15:36.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.380+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v29'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.380+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740aba8c0 con 0x55b740ab1e80 2023-10-05T21:15:36.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.381+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v29'30 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.381+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740aba8c0 con 0x55b740ab1e80 2023-10-05T21:15:36.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.382+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v29'38 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.382+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740aba8e0 con 0x55b740aae630 2023-10-05T21:15:36.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.383+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2349735374 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v29'25 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1b6005c040 con 0x55b740aae630 2023-10-05T21:15:36.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.383+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740aba8e0 con 0x55b740ab1e80 2023-10-05T21:15:36.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.383+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v29'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.383+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740aba8e0 con 0x55b740aae630 2023-10-05T21:15:36.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.384+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2349735374 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v29'42 uv38 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1b6005c040 con 0x55b740aae630 2023-10-05T21:15:36.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.384+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740aba8e0 con 0x55b740ab1e80 2023-10-05T21:15:36.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.385+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v29'52 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.385+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740aba8e0 con 0x55b740aae630 2023-10-05T21:15:36.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.385+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2349735374 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v29'44 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1b6005c040 con 0x55b740aae630 2023-10-05T21:15:36.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.385+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740aba8e0 con 0x55b740ab5e80 2023-10-05T21:15:36.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.386+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v29'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1b64014070 con 0x55b740ab5e80 2023-10-05T21:15:36.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.387+0000 7f1aaeffd700 20 reqs_thread_entry: start 2023-10-05T21:15:36.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.387+0000 7f1aacff9700 20 reqs_thread_entry: start 2023-10-05T21:15:36.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.387+0000 7f1b7b2e8680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:36.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.388+0000 7f1b7b2e8680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:36.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.388+0000 7f1a9effd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:16:06 2023 2023-10-05T21:15:36.426 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:36.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.388+0000 7f1a9e7fc700 20 reqs_thread_entry: start 2023-10-05T21:15:36.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.388+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:33 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740aaad00 2023-10-05T21:15:36.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.388+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(33 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1b64014070 con 0x55b740aaad00 2023-10-05T21:15:36.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.388+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:34 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740aaad00 2023-10-05T21:15:36.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.388+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(34 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f1b64014070 con 0x55b740aaad00 2023-10-05T21:15:36.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.388+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:35 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740aaad00 2023-10-05T21:15:36.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.389+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(35 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1b64014070 con 0x55b740aaad00 2023-10-05T21:15:36.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.389+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:36 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740aae630 2023-10-05T21:15:36.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.389+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2349735374 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(36 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1b6005c040 con 0x55b740aae630 2023-10-05T21:15:36.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.389+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:37 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740aae630 2023-10-05T21:15:36.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.389+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2349735374 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(37 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f1b6005c040 con 0x55b740aae630 2023-10-05T21:15:36.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.390+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:38 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740aae630 2023-10-05T21:15:36.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.390+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2349735374 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(38 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1b6005c040 con 0x55b740aae630 2023-10-05T21:15:36.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.390+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:39 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab1e80 2023-10-05T21:15:36.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.390+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(39 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.390+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:40 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740ab1e80 2023-10-05T21:15:36.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.390+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(40 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.390+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab1e80 2023-10-05T21:15:36.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.390+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(41 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.390+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740aaad00 2023-10-05T21:15:36.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.391+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(42 gc.3 [call out=15b] v0'0 uv186 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1b64014070 con 0x55b740aaad00 2023-10-05T21:15:36.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.391+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740aaad00 2023-10-05T21:15:36.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.391+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(43 gc.3 [call out=24b] v0'0 uv186 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f1b64014070 con 0x55b740aaad00 2023-10-05T21:15:36.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.391+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:44 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740aaad00 2023-10-05T21:15:36.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.391+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(44 gc.3 [call out=15b] v0'0 uv186 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1b64014070 con 0x55b740aaad00 2023-10-05T21:15:36.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.391+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab5e80 2023-10-05T21:15:36.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.391+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(45 gc.4 [call out=15b] v0'0 uv58 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1b64014070 con 0x55b740ab5e80 2023-10-05T21:15:36.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.391+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:46 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740ab5e80 2023-10-05T21:15:36.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.392+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(46 gc.4 [call out=24b] v0'0 uv58 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f1b64014070 con 0x55b740ab5e80 2023-10-05T21:15:36.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.392+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:47 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab5e80 2023-10-05T21:15:36.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.392+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(47 gc.4 [call out=15b] v0'0 uv58 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1b64014070 con 0x55b740ab5e80 2023-10-05T21:15:36.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.392+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:48 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab1e80 2023-10-05T21:15:36.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.392+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(48 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.392+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:49 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740ab1e80 2023-10-05T21:15:36.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.392+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(49 gc.5 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.393+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:50 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab1e80 2023-10-05T21:15:36.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.393+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(50 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.393+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:51 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740aaad00 2023-10-05T21:15:36.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.393+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(51 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1b64014070 con 0x55b740aaad00 2023-10-05T21:15:36.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.393+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:52 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740aaad00 2023-10-05T21:15:36.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.393+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(52 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f1b64014070 con 0x55b740aaad00 2023-10-05T21:15:36.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.393+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740aaad00 2023-10-05T21:15:36.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.394+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(53 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1b64014070 con 0x55b740aaad00 2023-10-05T21:15:36.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.394+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740aae630 2023-10-05T21:15:36.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.394+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2349735374 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(54 gc.7 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1b6005c040 con 0x55b740aae630 2023-10-05T21:15:36.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.394+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:55 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740aae630 2023-10-05T21:15:36.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.394+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2349735374 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(55 gc.7 [call out=24b] v0'0 uv40 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f1b6005c040 con 0x55b740aae630 2023-10-05T21:15:36.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.394+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:56 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740aae630 2023-10-05T21:15:36.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.395+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2349735374 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(56 gc.7 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1b6005c040 con 0x55b740aae630 2023-10-05T21:15:36.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.395+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:57 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab5e80 2023-10-05T21:15:36.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.395+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(57 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1b64014070 con 0x55b740ab5e80 2023-10-05T21:15:36.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.395+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:58 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740ab5e80 2023-10-05T21:15:36.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.395+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(58 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f1b64014070 con 0x55b740ab5e80 2023-10-05T21:15:36.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.395+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:59 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab5e80 2023-10-05T21:15:36.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.395+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(59 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1b64014070 con 0x55b740ab5e80 2023-10-05T21:15:36.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.395+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab1e80 2023-10-05T21:15:36.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.396+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(60 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.396+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740ab1e80 2023-10-05T21:15:36.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.396+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(61 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.396+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:62 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab1e80 2023-10-05T21:15:36.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.396+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(62 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.396+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:63 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab5e80 2023-10-05T21:15:36.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.396+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(63 gc.10 [call out=15b] v0'0 uv60 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b64014070 con 0x55b740ab5e80 2023-10-05T21:15:36.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.396+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:64 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740ab5e80 2023-10-05T21:15:36.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.397+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(64 gc.10 [call out=24b] v0'0 uv60 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1b64014070 con 0x55b740ab5e80 2023-10-05T21:15:36.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.397+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:65 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab5e80 2023-10-05T21:15:36.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.397+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(65 gc.10 [call out=15b] v0'0 uv60 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b64014070 con 0x55b740ab5e80 2023-10-05T21:15:36.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.397+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:66 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740aae630 2023-10-05T21:15:36.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.397+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2349735374 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(66 gc.11 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b6005c040 con 0x55b740aae630 2023-10-05T21:15:36.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.397+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:67 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740aae630 2023-10-05T21:15:36.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.398+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2349735374 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(67 gc.11 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1b6005c040 con 0x55b740aae630 2023-10-05T21:15:36.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.398+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740aae630 2023-10-05T21:15:36.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.398+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2349735374 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 gc.11 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b6005c040 con 0x55b740aae630 2023-10-05T21:15:36.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.398+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:69 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab5e80 2023-10-05T21:15:36.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.399+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(69 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b64014070 con 0x55b740ab5e80 2023-10-05T21:15:36.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.399+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:70 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740ab5e80 2023-10-05T21:15:36.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.399+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(70 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1b64014070 con 0x55b740ab5e80 2023-10-05T21:15:36.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.399+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab5e80 2023-10-05T21:15:36.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.399+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(71 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b64014070 con 0x55b740ab5e80 2023-10-05T21:15:36.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.399+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:72 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740aae630 2023-10-05T21:15:36.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.399+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2349735374 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(72 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b6005c040 con 0x55b740aae630 2023-10-05T21:15:36.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.399+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740aae630 2023-10-05T21:15:36.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.400+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2349735374 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 gc.13 [call out=24b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1b6005c040 con 0x55b740aae630 2023-10-05T21:15:36.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.400+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:74 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740aae630 2023-10-05T21:15:36.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.400+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2349735374 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(74 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b6005c040 con 0x55b740aae630 2023-10-05T21:15:36.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.400+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:75 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740aaad00 2023-10-05T21:15:36.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.400+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(75 gc.14 [call out=15b] v0'0 uv182 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b64014070 con 0x55b740aaad00 2023-10-05T21:15:36.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.400+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740aaad00 2023-10-05T21:15:36.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.400+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(76 gc.14 [call out=24b] v0'0 uv182 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1b64014070 con 0x55b740aaad00 2023-10-05T21:15:36.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.400+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:77 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740aaad00 2023-10-05T21:15:36.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.401+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(77 gc.14 [call out=15b] v0'0 uv182 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b64014070 con 0x55b740aaad00 2023-10-05T21:15:36.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.401+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:78 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab1e80 2023-10-05T21:15:36.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.401+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(78 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.401+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:79 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740ab1e80 2023-10-05T21:15:36.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.401+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(79 gc.15 [call out=24b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.401+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:80 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab1e80 2023-10-05T21:15:36.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.401+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(80 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.401+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:81 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab5e80 2023-10-05T21:15:36.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.402+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(81 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b64014070 con 0x55b740ab5e80 2023-10-05T21:15:36.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.402+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:82 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740ab5e80 2023-10-05T21:15:36.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.402+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== osd_op_reply(82 gc.16 [call out=24b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1b64014070 con 0x55b740ab5e80 2023-10-05T21:15:36.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.402+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:83 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab5e80 2023-10-05T21:15:36.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.402+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.2 v2:172.21.15.153:6807/140454 22 ==== osd_op_reply(83 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b64014070 con 0x55b740ab5e80 2023-10-05T21:15:36.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.402+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:84 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab1e80 2023-10-05T21:15:36.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.402+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(84 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.402+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:85 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740ab1e80 2023-10-05T21:15:36.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.403+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(85 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.403+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:86 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab1e80 2023-10-05T21:15:36.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.403+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(86 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.403+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740aaad00 2023-10-05T21:15:36.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.403+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(87 gc.18 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b64014070 con 0x55b740aaad00 2023-10-05T21:15:36.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.403+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:88 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740aaad00 2023-10-05T21:15:36.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.403+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(88 gc.18 [call out=24b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1b64014070 con 0x55b740aaad00 2023-10-05T21:15:36.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.403+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:89 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740aaad00 2023-10-05T21:15:36.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.404+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(89 gc.18 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b64014070 con 0x55b740aaad00 2023-10-05T21:15:36.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.404+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:90 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740aaad00 2023-10-05T21:15:36.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.404+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(90 gc.19 [call out=15b] v0'0 uv184 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b64014070 con 0x55b740aaad00 2023-10-05T21:15:36.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.404+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:91 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740aaad00 2023-10-05T21:15:36.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.404+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(91 gc.19 [call out=24b] v0'0 uv184 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1b64014070 con 0x55b740aaad00 2023-10-05T21:15:36.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.404+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740aaad00 2023-10-05T21:15:36.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.404+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(92 gc.19 [call out=15b] v0'0 uv184 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b64014070 con 0x55b740aaad00 2023-10-05T21:15:36.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.404+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:93 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab1e80 2023-10-05T21:15:36.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.404+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(93 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.404+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:94 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740ab1e80 2023-10-05T21:15:36.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.405+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== osd_op_reply(94 gc.20 [call out=24b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.405+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:95 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab1e80 2023-10-05T21:15:36.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.405+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(95 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.405+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:96 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab5e80 2023-10-05T21:15:36.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.405+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.2 v2:172.21.15.153:6807/140454 23 ==== osd_op_reply(96 gc.21 [call out=15b] v0'0 uv37 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b64014070 con 0x55b740ab5e80 2023-10-05T21:15:36.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.405+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:97 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740ab5e80 2023-10-05T21:15:36.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.405+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.2 v2:172.21.15.153:6807/140454 24 ==== osd_op_reply(97 gc.21 [call out=24b] v0'0 uv37 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1b64014070 con 0x55b740ab5e80 2023-10-05T21:15:36.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.406+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:98 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab5e80 2023-10-05T21:15:36.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.406+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.2 v2:172.21.15.153:6807/140454 25 ==== osd_op_reply(98 gc.21 [call out=15b] v0'0 uv37 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b64014070 con 0x55b740ab5e80 2023-10-05T21:15:36.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.406+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:99 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab1e80 2023-10-05T21:15:36.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.406+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 31 ==== osd_op_reply(99 gc.22 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.406+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:100 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740ab1e80 2023-10-05T21:15:36.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.406+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 32 ==== osd_op_reply(100 gc.22 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.406+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:101 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab1e80 2023-10-05T21:15:36.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.406+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 33 ==== osd_op_reply(101 gc.22 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.406+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:102 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab1e80 2023-10-05T21:15:36.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.407+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 34 ==== osd_op_reply(102 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.407+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:103 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740ab1e80 2023-10-05T21:15:36.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.407+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 35 ==== osd_op_reply(103 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.407+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:104 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab1e80 2023-10-05T21:15:36.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.407+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 36 ==== osd_op_reply(104 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.407+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:105 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab1e80 2023-10-05T21:15:36.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.407+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 37 ==== osd_op_reply(105 gc.24 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.407+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:106 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740ab1e80 2023-10-05T21:15:36.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.407+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 38 ==== osd_op_reply(106 gc.24 [call out=24b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.408+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab1e80 2023-10-05T21:15:36.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.408+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 39 ==== osd_op_reply(107 gc.24 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.408+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:108 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab1e80 2023-10-05T21:15:36.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.408+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 40 ==== osd_op_reply(108 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.408+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:109 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740ab1e80 2023-10-05T21:15:36.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.408+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 41 ==== osd_op_reply(109 gc.25 [call out=24b] v0'0 uv34 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.408+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:110 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab1e80 2023-10-05T21:15:36.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.408+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 42 ==== osd_op_reply(110 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.408+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:111 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740aae630 2023-10-05T21:15:36.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.409+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2349735374 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(111 gc.26 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b6005c040 con 0x55b740aae630 2023-10-05T21:15:36.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.409+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740aae630 2023-10-05T21:15:36.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.409+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2349735374 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(112 gc.26 [call out=24b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1b6005c040 con 0x55b740aae630 2023-10-05T21:15:36.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.409+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:113 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740aae630 2023-10-05T21:15:36.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.409+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2349735374 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(113 gc.26 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b6005c040 con 0x55b740aae630 2023-10-05T21:15:36.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.409+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:114 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab1e80 2023-10-05T21:15:36.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.410+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 43 ==== osd_op_reply(114 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.410+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:115 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740ab1e80 2023-10-05T21:15:36.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.410+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 44 ==== osd_op_reply(115 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.410+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:116 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab1e80 2023-10-05T21:15:36.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.410+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 45 ==== osd_op_reply(116 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.410+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:117 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740aae630 2023-10-05T21:15:36.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.410+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2349735374 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(117 gc.28 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b6005c040 con 0x55b740aae630 2023-10-05T21:15:36.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.410+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:118 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740aae630 2023-10-05T21:15:36.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.411+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2349735374 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(118 gc.28 [call out=24b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1b6005c040 con 0x55b740aae630 2023-10-05T21:15:36.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.411+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:119 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740aae630 2023-10-05T21:15:36.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.411+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2349735374 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(119 gc.28 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b6005c040 con 0x55b740aae630 2023-10-05T21:15:36.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.411+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:120 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab1e80 2023-10-05T21:15:36.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.411+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 46 ==== osd_op_reply(120 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.411+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:121 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740ab1e80 2023-10-05T21:15:36.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.412+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 47 ==== osd_op_reply(121 gc.29 [call out=24b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.412+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:122 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab1e80 2023-10-05T21:15:36.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.412+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2349735374 <== osd.3 v2:172.21.15.153:6800/140455 48 ==== osd_op_reply(122 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740ab1e80 2023-10-05T21:15:36.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.412+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:123 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740aae630 2023-10-05T21:15:36.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.412+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2349735374 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(123 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b6005c040 con 0x55b740aae630 2023-10-05T21:15:36.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.412+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:124 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740aae630 2023-10-05T21:15:36.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.413+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2349735374 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(124 gc.30 [call out=24b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1b6005c040 con 0x55b740aae630 2023-10-05T21:15:36.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.413+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:125 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740aae630 2023-10-05T21:15:36.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.413+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2349735374 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(125 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b6005c040 con 0x55b740aae630 2023-10-05T21:15:36.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.413+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:126 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab5e80 2023-10-05T21:15:36.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.413+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.2 v2:172.21.15.153:6807/140454 26 ==== osd_op_reply(126 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b64014070 con 0x55b740ab5e80 2023-10-05T21:15:36.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.413+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:127 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b157e0 con 0x55b740ab5e80 2023-10-05T21:15:36.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.413+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.2 v2:172.21.15.153:6807/140454 27 ==== osd_op_reply(127 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1b64014070 con 0x55b740ab5e80 2023-10-05T21:15:36.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.413+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:128 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740b167f0 con 0x55b740ab5e80 2023-10-05T21:15:36.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.414+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 <== osd.2 v2:172.21.15.153:6807/140454 28 ==== osd_op_reply(128 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1b64014070 con 0x55b740ab5e80 2023-10-05T21:15:36.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.414+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94245552150064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740ad88e0 con 0x7f1b6402d020 2023-10-05T21:15:36.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.414+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2658734127 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(102 notify.0 [watch unwatch cookie 94245552150064] v29'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b6005c040 con 0x7f1b6402d020 2023-10-05T21:15:36.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.415+0000 7f1b7b2e8680 20 remove_watcher() i=0 2023-10-05T21:15:36.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.415+0000 7f1b7b2e8680 2 removed watcher, disabling cache 2023-10-05T21:15:36.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.415+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94245552156864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a85630 con 0x55b740a4b900 2023-10-05T21:15:36.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.415+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(103 notify.1 [watch unwatch cookie 94245552156864] v29'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.415+0000 7f1b7b2e8680 20 remove_watcher() i=1 2023-10-05T21:15:36.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.415+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:104 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94245552160624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a870c0 con 0x55b740a7f130 2023-10-05T21:15:36.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.416+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2658734127 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(104 notify.2 [watch unwatch cookie 94245552160624] v29'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b64014070 con 0x55b740a7f130 2023-10-05T21:15:36.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.416+0000 7f1b7b2e8680 20 remove_watcher() i=2 2023-10-05T21:15:36.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.416+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94245552152352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a870c0 con 0x7f1b6402d020 2023-10-05T21:15:36.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.417+0000 7f1b6dbbf700 1 -- 172.21.15.153:0/2658734127 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(105 notify.3 [watch unwatch cookie 94245552152352] v29'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b6005c040 con 0x7f1b6402d020 2023-10-05T21:15:36.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.417+0000 7f1b7b2e8680 20 remove_watcher() i=3 2023-10-05T21:15:36.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.417+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94245552168720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a870c0 con 0x55b740a4b900 2023-10-05T21:15:36.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.418+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(106 notify.4 [watch unwatch cookie 94245552168720] v29'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.418+0000 7f1b7b2e8680 20 remove_watcher() i=4 2023-10-05T21:15:36.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.418+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:107 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94245552170928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a870c0 con 0x7f1b60007030 2023-10-05T21:15:36.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.418+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(107 notify.5 [watch unwatch cookie 94245552170928] v29'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x7f1b60007030 2023-10-05T21:15:36.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.418+0000 7f1b7b2e8680 20 remove_watcher() i=5 2023-10-05T21:15:36.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.418+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94245552175056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a8a7b0 con 0x7f1b60007030 2023-10-05T21:15:36.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.420+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(108 notify.6 [watch unwatch cookie 94245552175056] v29'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x7f1b60007030 2023-10-05T21:15:36.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.420+0000 7f1b7b2e8680 20 remove_watcher() i=6 2023-10-05T21:15:36.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.420+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94245552172032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740a870c0 con 0x7f1b60007030 2023-10-05T21:15:36.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.420+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(109 notify.7 [watch unwatch cookie 94245552172032] v29'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x7f1b60007030 2023-10-05T21:15:36.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.420+0000 7f1b7b2e8680 20 remove_watcher() i=7 2023-10-05T21:15:36.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.421+0000 7f1b3ffdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:36.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.421+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:110 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94245552178128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55b740ad5450 con 0x55b740a4b900 2023-10-05T21:15:36.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.422+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(110 data_loggenerations_metadata [watch unwatch cookie 94245552178128] v29'192 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1b6800a570 con 0x55b740a4b900 2023-10-05T21:15:36.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.422+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f1b60007030 msgr2=0x7f1b6001d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.422+0000 7f1b7b2e8680 1 --2- 172.21.15.153:0/2658734127 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f1b60007030 0x7f1b6001d420 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.422+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55b740a4b900 msgr2=0x55b740a7cb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.422+0000 7f1b7b2e8680 1 --2- 172.21.15.153:0/2658734127 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55b740a4b900 0x55b740a7cb20 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.422+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f1b6402d020 msgr2=0x7f1b64047850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.422+0000 7f1b7b2e8680 1 --2- 172.21.15.153:0/2658734127 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f1b6402d020 0x7f1b64047850 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.422+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b740a7f130 msgr2=0x55b740a81510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.422+0000 7f1b7b2e8680 1 --2- 172.21.15.153:0/2658734127 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b740a7f130 0x55b740a81510 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.422+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1b50034140 msgr2=0x7f1b500365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.422+0000 7f1b7b2e8680 1 --2- 172.21.15.153:0/2658734127 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1b50034140 0x7f1b500365f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x55b7409bb0b0 tx=0x7f1b60015000 comp rx=0 tx=0).stop 2023-10-05T21:15:36.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.422+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a478c0 msgr2=0x55b740a47160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.422+0000 7f1b7b2e8680 1 --2- 172.21.15.153:0/2658734127 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a478c0 0x55b740a47160 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1b640017d0 tx=0x7f1b64016000 comp rx=0 tx=0).stop 2023-10-05T21:15:36.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.422+0000 7f1b6ebc1700 1 -- 172.21.15.153:0/2658734127 reap_dead start 2023-10-05T21:15:36.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.422+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 shutdown_connections 2023-10-05T21:15:36.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.422+0000 7f1b7b2e8680 1 --2- 172.21.15.153:0/2658734127 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a478c0 0x55b740a47160 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.422+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 >> 172.21.15.153:0/2658734127 conn(0x55b740a42300 msgr2=0x55b740a60950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:36.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.422+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 shutdown_connections 2023-10-05T21:15:36.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.422+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2658734127 wait complete. 2023-10-05T21:15:36.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.422+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55b740aae630 msgr2=0x55b740ab0a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.422+0000 7f1b7b2e8680 1 --2- 172.21.15.153:0/2349735374 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55b740aae630 0x55b740ab0a10 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.422+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55b740aaad00 msgr2=0x55b740aad1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.422+0000 7f1b7b2e8680 1 --2- 172.21.15.153:0/2349735374 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55b740aaad00 0x55b740aad1b0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.422+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55b740ab5e80 msgr2=0x55b740ab8260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.423+0000 7f1b7b2e8680 1 --2- 172.21.15.153:0/2349735374 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55b740ab5e80 0x55b740ab8260 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.423+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b740ab1e80 msgr2=0x55b740ab42a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.423+0000 7f1b7b2e8680 1 --2- 172.21.15.153:0/2349735374 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55b740ab1e80 0x55b740ab42a0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.423+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1ab40340f0 msgr2=0x7f1ab40365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.423+0000 7f1b7b2e8680 1 --2- 172.21.15.153:0/2349735374 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1ab40340f0 0x7f1ab40365a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x55b740a8c890 tx=0x7f1b6800aec0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.423+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a9a460 msgr2=0x55b740a9ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.423+0000 7f1b6e3c0700 1 -- 172.21.15.153:0/2349735374 reap_dead start 2023-10-05T21:15:36.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.423+0000 7f1b7b2e8680 1 --2- 172.21.15.153:0/2349735374 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a9a460 0x55b740a9ff40 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1b60038040 tx=0x7f1b60030000 comp rx=0 tx=0).stop 2023-10-05T21:15:36.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.423+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 shutdown_connections 2023-10-05T21:15:36.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.423+0000 7f1b7b2e8680 1 --2- 172.21.15.153:0/2349735374 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b740a9a460 0x55b740a9ff40 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.423+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 >> 172.21.15.153:0/2349735374 conn(0x55b740a95660 msgr2=0x55b740a93790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:36.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.423+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 shutdown_connections 2023-10-05T21:15:36.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.423+0000 7f1b7b2e8680 1 -- 172.21.15.153:0/2349735374 wait complete. 2023-10-05T21:15:36.461 INFO:teuthology.orchestra.run.smithi153.stdout:[] 2023-10-05T21:15:36.461 DEBUG:tasks.util.rgw: json result: [] 2023-10-05T21:15:36.461 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2023-10-05T21:15:36.461 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2023-10-05T21:15:36.462 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2023-10-05T21:15:36.546 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:36.547 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:36.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.546+0000 7fd8a3b9c680 1 Processor -- start 2023-10-05T21:15:36.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.546+0000 7fd8a3b9c680 1 -- start start 2023-10-05T21:15:36.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.546+0000 7fd8a3b9c680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x56301564c2b0 0x56301564c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.546+0000 7fd8a3b9c680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56301559a990 con 0x56301564cc00 2023-10-05T21:15:36.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.546+0000 7fd8a3b9c680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x56301555adb0 con 0x56301564c2b0 2023-10-05T21:15:36.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.546+0000 7fd896c74700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x56301564c2b0 0x56301564c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.546+0000 7fd896c74700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x56301564c2b0 0x56301564c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57642/0 (socket says 172.21.15.153:57642) 2023-10-05T21:15:36.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.546+0000 7fd896c74700 1 -- 172.21.15.153:0/3886540979 learned_addr learned my addr 172.21.15.153:0/3886540979 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:36.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.546+0000 7fd896473700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x56301564cc00 0x56301564d5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:39250/0 (socket says 172.21.15.153:39250) 2023-10-05T21:15:36.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.547+0000 7fd896c74700 1 -- 172.21.15.153:0/3886540979 >> v1:172.21.15.111:6789/0 conn(0x56301564cc00 legacy=0x56301564d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.547+0000 7fd895c72700 1 -- 172.21.15.153:0/3886540979 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463996291 0 0) 0x56301559a990 con 0x56301564cc00 2023-10-05T21:15:36.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.547+0000 7fd896c74700 1 -- 172.21.15.153:0/3886540979 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56301564dea0 con 0x56301564c2b0 2023-10-05T21:15:36.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.547+0000 7fd896c74700 1 --2- 172.21.15.153:0/3886540979 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56301564c2b0 0x56301564c6c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd88800a650 tx=0x7fd888005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c00736653303419 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.547+0000 7fd895c72700 1 -- 172.21.15.153:0/3886540979 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd888008760 con 0x56301564c2b0 2023-10-05T21:15:36.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.547+0000 7fd895c72700 1 -- 172.21.15.153:0/3886540979 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8880088c0 con 0x56301564c2b0 2023-10-05T21:15:36.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.547+0000 7fd895c72700 1 -- 172.21.15.153:0/3886540979 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd888008bb0 con 0x56301564c2b0 2023-10-05T21:15:36.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.547+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/3886540979 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56301564c2b0 msgr2=0x56301564c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.547+0000 7fd8a3b9c680 1 --2- 172.21.15.153:0/3886540979 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56301564c2b0 0x56301564c6c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd88800a650 tx=0x7fd888005b10 comp rx=0 tx=0).stop 2023-10-05T21:15:36.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.547+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/3886540979 shutdown_connections 2023-10-05T21:15:36.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.547+0000 7fd8a3b9c680 1 --2- 172.21.15.153:0/3886540979 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56301564c2b0 0x56301564c6c0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.547+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/3886540979 >> 172.21.15.153:0/3886540979 conn(0x563015647b80 msgr2=0x563015649f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:36.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.547+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/3886540979 shutdown_connections 2023-10-05T21:15:36.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.547+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/3886540979 wait complete. 2023-10-05T21:15:36.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.548+0000 7fd8a3b9c680 1 Processor -- start 2023-10-05T21:15:36.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.548+0000 7fd8a3b9c680 1 -- start start 2023-10-05T21:15:36.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.549+0000 7fd8a3b9c680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56301564c2b0 0x5630155c0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.549+0000 7fd8a3b9c680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630154faea0 con 0x56301564c2b0 2023-10-05T21:15:36.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.549+0000 7fd896c74700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56301564c2b0 0x5630155c0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.549+0000 7fd896c74700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56301564c2b0 0x5630155c0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57646/0 (socket says 172.21.15.153:57646) 2023-10-05T21:15:36.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.549+0000 7fd896c74700 1 -- 172.21.15.153:0/3474186877 learned_addr learned my addr 172.21.15.153:0/3474186877 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:36.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.549+0000 7fd896c74700 1 -- 172.21.15.153:0/3474186877 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd888005db0 con 0x56301564c2b0 2023-10-05T21:15:36.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.549+0000 7fd896c74700 1 --2- 172.21.15.153:0/3474186877 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56301564c2b0 0x5630155c0fe0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd888003080 tx=0x7fd888015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79392d254ca301ee server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.550+0000 7fd894c70700 1 -- 172.21.15.153:0/3474186877 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd888008a30 con 0x56301564c2b0 2023-10-05T21:15:36.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.550+0000 7fd894c70700 1 -- 172.21.15.153:0/3474186877 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd888008b90 con 0x56301564c2b0 2023-10-05T21:15:36.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.550+0000 7fd894c70700 1 -- 172.21.15.153:0/3474186877 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd888008d00 con 0x56301564c2b0 2023-10-05T21:15:36.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.550+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/3474186877 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56301564c2b0 msgr2=0x5630155c0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.550+0000 7fd8a3b9c680 1 --2- 172.21.15.153:0/3474186877 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56301564c2b0 0x5630155c0fe0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd888003080 tx=0x7fd888015000 comp rx=0 tx=0).stop 2023-10-05T21:15:36.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.550+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/3474186877 shutdown_connections 2023-10-05T21:15:36.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.550+0000 7fd8a3b9c680 1 --2- 172.21.15.153:0/3474186877 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56301564c2b0 0x5630155c0fe0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.550+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/3474186877 >> 172.21.15.153:0/3474186877 conn(0x563015647b80 msgr2=0x563015667030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:36.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.550+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/3474186877 shutdown_connections 2023-10-05T21:15:36.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.550+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/3474186877 wait complete. 2023-10-05T21:15:36.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.550+0000 7fd8a3b9c680 1 Processor -- start 2023-10-05T21:15:36.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.551+0000 7fd8a3b9c680 1 -- start start 2023-10-05T21:15:36.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.551+0000 7fd8a3b9c680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56301564c2b0 0x5630156739f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.551+0000 7fd8a3b9c680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630154f1c80 con 0x56301564c2b0 2023-10-05T21:15:36.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.551+0000 7fd896c74700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56301564c2b0 0x5630156739f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.551+0000 7fd896c74700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56301564c2b0 0x5630156739f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57654/0 (socket says 172.21.15.153:57654) 2023-10-05T21:15:36.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.551+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 learned_addr learned my addr 172.21.15.153:0/107654713 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:36.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.551+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56301564dea0 con 0x56301564c2b0 2023-10-05T21:15:36.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.551+0000 7fd896c74700 1 --2- 172.21.15.153:0/107654713 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56301564c2b0 0x5630156739f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd888003010 tx=0x7fd88801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.552+0000 7fd886ffd700 1 -- 172.21.15.153:0/107654713 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd888012d10 con 0x56301564c2b0 2023-10-05T21:15:36.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.552+0000 7fd886ffd700 1 -- 172.21.15.153:0/107654713 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd888012e70 con 0x56301564c2b0 2023-10-05T21:15:36.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.552+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563015673f30 con 0x56301564c2b0 2023-10-05T21:15:36.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.552+0000 7fd886ffd700 1 -- 172.21.15.153:0/107654713 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd88802e430 con 0x56301564c2b0 2023-10-05T21:15:36.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.552+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563015674320 con 0x56301564c2b0 2023-10-05T21:15:36.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.552+0000 7fd886ffd700 1 -- 172.21.15.153:0/107654713 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fd888009430 con 0x56301564c2b0 2023-10-05T21:15:36.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.553+0000 7fd8a3b9c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.553+0000 7fd886ffd700 1 --2- 172.21.15.153:0/107654713 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd87c034140 0x7fd87c0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.553+0000 7fd886ffd700 1 -- 172.21.15.153:0/107654713 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fd88804a170 con 0x56301564c2b0 2023-10-05T21:15:36.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.553+0000 7fd896473700 1 --2- 172.21.15.153:0/107654713 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd87c034140 0x7fd87c0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.553+0000 7fd8a3b9c680 1 --2- 172.21.15.153:0/107654713 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x56301567d730 0x56301567fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.553+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563015680320 con 0x56301567d730 2023-10-05T21:15:36.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.553+0000 7fd897475700 1 --2- 172.21.15.153:0/107654713 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x56301567d730 0x56301567fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.553+0000 7fd896473700 1 --2- 172.21.15.153:0/107654713 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd87c034140 0x7fd87c0365f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd88c0011e0 tx=0x7fd88c0013c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.554+0000 7fd897475700 1 --2- 172.21.15.153:0/107654713 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x56301567d730 0x56301567fb90 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.554+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.554+0000 7fd8a3b9c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.554+0000 7fd8a3b9c680 20 realm 2023-10-05T21:15:36.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.554+0000 7fd8a3b9c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.554+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56301567cda0 con 0x56301567d730 2023-10-05T21:15:36.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.554+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.554+0000 7fd8a3b9c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.554+0000 7fd8a3b9c680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:36.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.554+0000 7fd8a3b9c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.554+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563015680e20 con 0x56301567d730 2023-10-05T21:15:36.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.554+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.554+0000 7fd8a3b9c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.554+0000 7fd8a3b9c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.554+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563015680a70 con 0x56301567d730 2023-10-05T21:15:36.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.555+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.555+0000 7fd8a3b9c680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:36.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.555+0000 7fd8a3b9c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.555+0000 7fd8a3b9c680 1 --2- 172.21.15.153:0/107654713 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5630156821e0 0x5630156845c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.555+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563015684b00 con 0x5630156821e0 2023-10-05T21:15:36.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.555+0000 7fd896c74700 1 --2- 172.21.15.153:0/107654713 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5630156821e0 0x5630156845c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.555+0000 7fd896c74700 1 --2- 172.21.15.153:0/107654713 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5630156821e0 0x5630156845c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.555+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fd888019040 con 0x5630156821e0 2023-10-05T21:15:36.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.555+0000 7fd8a3b9c680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:36.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.555+0000 7fd8a3b9c680 20 searching for the correct realm 2023-10-05T21:15:36.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.555+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156863b0 con 0x5630156821e0 2023-10-05T21:15:36.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.555+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd888019040 con 0x5630156821e0 2023-10-05T21:15:36.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.555+0000 7fd896c74700 1 --2- 172.21.15.153:0/107654713 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fd888037020 0x7fd888048a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.555+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156863b0 con 0x7fd888037020 2023-10-05T21:15:36.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.556+0000 7fd896473700 1 --2- 172.21.15.153:0/107654713 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fd888037020 0x7fd888048a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.556+0000 7fd896473700 1 --2- 172.21.15.153:0/107654713 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fd888037020 0x7fd888048a50 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.556+0000 7fd896473700 1 -- 172.21.15.153:0/107654713 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd88c00f620 con 0x7fd888037020 2023-10-05T21:15:36.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.556+0000 7fd896473700 1 --2- 172.21.15.153:0/107654713 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fd88c00e8c0 0x7fd88c00d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.556+0000 7fd896473700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156863b0 con 0x7fd88c00e8c0 2023-10-05T21:15:36.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.556+0000 7fd897475700 1 --2- 172.21.15.153:0/107654713 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fd88c00e8c0 0x7fd88c00d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.557+0000 7fd897475700 1 --2- 172.21.15.153:0/107654713 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fd88c00e8c0 0x7fd88c00d310 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.557+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd89000a570 con 0x7fd88c00e8c0 2023-10-05T21:15:36.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.557+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156863b0 con 0x56301567d730 2023-10-05T21:15:36.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.557+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.557+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156863b0 con 0x56301567d730 2023-10-05T21:15:36.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.557+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.557+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156863b0 con 0x7fd88c00e8c0 2023-10-05T21:15:36.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.557+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd89000a570 con 0x7fd88c00e8c0 2023-10-05T21:15:36.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.557+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156863b0 con 0x7fd88c00e8c0 2023-10-05T21:15:36.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.558+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd89000a570 con 0x7fd88c00e8c0 2023-10-05T21:15:36.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.558+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156863b0 con 0x7fd888037020 2023-10-05T21:15:36.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.558+0000 7fd896473700 1 -- 172.21.15.153:0/107654713 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd88c00f620 con 0x7fd888037020 2023-10-05T21:15:36.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.558+0000 7fd896473700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156863b0 con 0x5630156821e0 2023-10-05T21:15:36.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.558+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fd888019040 con 0x5630156821e0 2023-10-05T21:15:36.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.558+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156863b0 con 0x56301567d730 2023-10-05T21:15:36.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.558+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.558+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156863b0 con 0x7fd88c00e8c0 2023-10-05T21:15:36.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.559+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd89000a570 con 0x7fd88c00e8c0 2023-10-05T21:15:36.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.559+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156863b0 con 0x56301567d730 2023-10-05T21:15:36.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.559+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.559+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156863b0 con 0x7fd888037020 2023-10-05T21:15:36.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.559+0000 7fd896473700 1 -- 172.21.15.153:0/107654713 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd88c00f620 con 0x7fd888037020 2023-10-05T21:15:36.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.559+0000 7fd896473700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd88c01f040 con 0x5630156821e0 2023-10-05T21:15:36.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.559+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd888019040 con 0x5630156821e0 2023-10-05T21:15:36.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.559+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd88c01f040 con 0x5630156821e0 2023-10-05T21:15:36.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.559+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd888019040 con 0x5630156821e0 2023-10-05T21:15:36.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.559+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd88c01f040 con 0x7fd88c00e8c0 2023-10-05T21:15:36.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.560+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd89000a570 con 0x7fd88c00e8c0 2023-10-05T21:15:36.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.560+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd88c01f040 con 0x5630156821e0 2023-10-05T21:15:36.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.560+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd888019040 con 0x5630156821e0 2023-10-05T21:15:36.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.560+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd88c01f040 con 0x5630156821e0 2023-10-05T21:15:36.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.560+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd888019040 con 0x5630156821e0 2023-10-05T21:15:36.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.560+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd88c01f040 con 0x56301567d730 2023-10-05T21:15:36.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.560+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.560+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd88c01f040 con 0x56301567d730 2023-10-05T21:15:36.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.560+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.560+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd88c01f040 con 0x7fd88c00e8c0 2023-10-05T21:15:36.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.561+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd89000a570 con 0x7fd88c00e8c0 2023-10-05T21:15:36.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.561+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd88c01f040 con 0x5630156821e0 2023-10-05T21:15:36.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.561+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd888019040 con 0x5630156821e0 2023-10-05T21:15:36.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.561+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd88c01f040 con 0x7fd888037020 2023-10-05T21:15:36.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.561+0000 7fd896473700 1 -- 172.21.15.153:0/107654713 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd88c00f620 con 0x7fd888037020 2023-10-05T21:15:36.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.561+0000 7fd896473700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd88c01f040 con 0x56301567d730 2023-10-05T21:15:36.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.561+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.561+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd88c01f040 con 0x7fd88c00e8c0 2023-10-05T21:15:36.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.562+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd89000a570 con 0x7fd88c00e8c0 2023-10-05T21:15:36.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.562+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd88c01f040 con 0x5630156821e0 2023-10-05T21:15:36.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.562+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd888019040 con 0x5630156821e0 2023-10-05T21:15:36.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.562+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd88c01f040 con 0x7fd88c00e8c0 2023-10-05T21:15:36.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.562+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd89000a570 con 0x7fd88c00e8c0 2023-10-05T21:15:36.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.562+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd88c01f040 con 0x7fd888037020 2023-10-05T21:15:36.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.562+0000 7fd896473700 1 -- 172.21.15.153:0/107654713 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd88c00f620 con 0x7fd888037020 2023-10-05T21:15:36.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.562+0000 7fd896473700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd88c01f040 con 0x5630156821e0 2023-10-05T21:15:36.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.563+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd888019040 con 0x5630156821e0 2023-10-05T21:15:36.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.563+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd88c01f040 con 0x7fd88c00e8c0 2023-10-05T21:15:36.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.563+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd89000a570 con 0x7fd88c00e8c0 2023-10-05T21:15:36.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.563+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd88c01f040 con 0x56301567d730 2023-10-05T21:15:36.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.563+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.563+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7fd88c01f040 con 0x7fd888037020 2023-10-05T21:15:36.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.563+0000 7fd896473700 1 -- 172.21.15.153:0/107654713 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd88c00f620 con 0x7fd888037020 2023-10-05T21:15:36.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.563+0000 7fd8a3b9c680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:36.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.563+0000 7fd8a3b9c680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:36.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.563+0000 7fd8a3b9c680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:36.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.563+0000 7fd8a3b9c680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:36.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.563+0000 7fd8a3b9c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.563+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563015685450 con 0x56301567d730 2023-10-05T21:15:36.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.564+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.564+0000 7fd8a3b9c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.564+0000 7fd8a3b9c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.564+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563015685080 con 0x56301567d730 2023-10-05T21:15:36.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.564+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.564+0000 7fd8a3b9c680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:36.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.564+0000 7fd8a3b9c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.564+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156858f0 con 0x56301567d730 2023-10-05T21:15:36.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.564+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.564+0000 7fd8a3b9c680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:36.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.564+0000 7fd8a3b9c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.564+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563015685ee0 con 0x5630156821e0 2023-10-05T21:15:36.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.564+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fd888019040 con 0x5630156821e0 2023-10-05T21:15:36.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.564+0000 7fd8a3b9c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.564+0000 7fd8a3b9c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.564+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563015686c50 con 0x56301567d730 2023-10-05T21:15:36.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.564+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.564+0000 7fd8a3b9c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.564+0000 7fd8a3b9c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.564+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563015686d40 con 0x56301567d730 2023-10-05T21:15:36.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.565+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.565+0000 7fd8a3b9c680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:36.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.565+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563015686d10 con 0x5630156821e0 2023-10-05T21:15:36.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.565+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd888019040 con 0x5630156821e0 2023-10-05T21:15:36.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.565+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563015686d10 con 0x7fd888037020 2023-10-05T21:15:36.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.565+0000 7fd896473700 1 -- 172.21.15.153:0/107654713 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd88c00f620 con 0x7fd888037020 2023-10-05T21:15:36.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.565+0000 7fd896473700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x563015686d10 con 0x7fd88c00e8c0 2023-10-05T21:15:36.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.565+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd89000a570 con 0x7fd88c00e8c0 2023-10-05T21:15:36.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.565+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156858f0 con 0x56301567d730 2023-10-05T21:15:36.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.565+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.565+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156858f0 con 0x56301567d730 2023-10-05T21:15:36.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.566+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.566+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156858f0 con 0x7fd88c00e8c0 2023-10-05T21:15:36.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.566+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd89000a570 con 0x7fd88c00e8c0 2023-10-05T21:15:36.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.566+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156858f0 con 0x7fd88c00e8c0 2023-10-05T21:15:36.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.566+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd89000a570 con 0x7fd88c00e8c0 2023-10-05T21:15:36.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.566+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156858f0 con 0x7fd888037020 2023-10-05T21:15:36.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.566+0000 7fd896473700 1 -- 172.21.15.153:0/107654713 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd88c00f620 con 0x7fd888037020 2023-10-05T21:15:36.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.566+0000 7fd896473700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156858f0 con 0x5630156821e0 2023-10-05T21:15:36.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.567+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fd888019040 con 0x5630156821e0 2023-10-05T21:15:36.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.567+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156858f0 con 0x56301567d730 2023-10-05T21:15:36.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.567+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.567+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156858f0 con 0x7fd88c00e8c0 2023-10-05T21:15:36.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.567+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd89000a570 con 0x7fd88c00e8c0 2023-10-05T21:15:36.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.567+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156858f0 con 0x56301567d730 2023-10-05T21:15:36.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.567+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.567+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156858f0 con 0x7fd888037020 2023-10-05T21:15:36.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.567+0000 7fd896473700 1 -- 172.21.15.153:0/107654713 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd88c00f620 con 0x7fd888037020 2023-10-05T21:15:36.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.567+0000 7fd896473700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156858f0 con 0x5630156821e0 2023-10-05T21:15:36.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.568+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd888019040 con 0x5630156821e0 2023-10-05T21:15:36.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.568+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156858f0 con 0x5630156821e0 2023-10-05T21:15:36.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.568+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd888019040 con 0x5630156821e0 2023-10-05T21:15:36.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.568+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156858f0 con 0x7fd88c00e8c0 2023-10-05T21:15:36.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.568+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd89000a570 con 0x7fd88c00e8c0 2023-10-05T21:15:36.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.568+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156858f0 con 0x5630156821e0 2023-10-05T21:15:36.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.568+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd888019040 con 0x5630156821e0 2023-10-05T21:15:36.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.568+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156858f0 con 0x5630156821e0 2023-10-05T21:15:36.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.568+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd888019040 con 0x5630156821e0 2023-10-05T21:15:36.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.568+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156858f0 con 0x56301567d730 2023-10-05T21:15:36.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.569+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.569+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156858f0 con 0x56301567d730 2023-10-05T21:15:36.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.569+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.569+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156858f0 con 0x7fd88c00e8c0 2023-10-05T21:15:36.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.569+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd89000a570 con 0x7fd88c00e8c0 2023-10-05T21:15:36.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.569+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156858f0 con 0x5630156821e0 2023-10-05T21:15:36.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.569+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd888019040 con 0x5630156821e0 2023-10-05T21:15:36.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.569+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156858f0 con 0x7fd888037020 2023-10-05T21:15:36.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.569+0000 7fd896473700 1 -- 172.21.15.153:0/107654713 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd88c00f620 con 0x7fd888037020 2023-10-05T21:15:36.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.569+0000 7fd896473700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156858f0 con 0x56301567d730 2023-10-05T21:15:36.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.570+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.570+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156858f0 con 0x7fd88c00e8c0 2023-10-05T21:15:36.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.570+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd89000a570 con 0x7fd88c00e8c0 2023-10-05T21:15:36.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.570+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156858f0 con 0x5630156821e0 2023-10-05T21:15:36.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.570+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd888019040 con 0x5630156821e0 2023-10-05T21:15:36.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.570+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156858f0 con 0x7fd88c00e8c0 2023-10-05T21:15:36.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.570+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd89000a570 con 0x7fd88c00e8c0 2023-10-05T21:15:36.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.570+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156858f0 con 0x7fd888037020 2023-10-05T21:15:36.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.571+0000 7fd896473700 1 -- 172.21.15.153:0/107654713 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd88c00f620 con 0x7fd888037020 2023-10-05T21:15:36.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.571+0000 7fd896473700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156858f0 con 0x5630156821e0 2023-10-05T21:15:36.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.571+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd888019040 con 0x5630156821e0 2023-10-05T21:15:36.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.571+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156858f0 con 0x7fd88c00e8c0 2023-10-05T21:15:36.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.571+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd89000a570 con 0x7fd88c00e8c0 2023-10-05T21:15:36.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.571+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156858f0 con 0x56301567d730 2023-10-05T21:15:36.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.571+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.571+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156858f0 con 0x7fd888037020 2023-10-05T21:15:36.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.571+0000 7fd896473700 1 -- 172.21.15.153:0/107654713 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd88c00f620 con 0x7fd888037020 2023-10-05T21:15:36.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.571+0000 7fd8a3b9c680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:36.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.571+0000 7fd8a3b9c680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:36.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.571+0000 7fd8a3b9c680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:36.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.571+0000 7fd8a3b9c680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:36.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.571+0000 7fd8a3b9c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.571+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563015686d10 con 0x56301567d730 2023-10-05T21:15:36.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.572+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.572+0000 7fd8a3b9c680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:36.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.572+0000 7fd8a3b9c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.572+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563015687170 con 0x5630156821e0 2023-10-05T21:15:36.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.572+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fd888019040 con 0x5630156821e0 2023-10-05T21:15:36.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.572+0000 7fd8a3b9c680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:36.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.572+0000 7fd8a3b9c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.572+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563015687a60 con 0x56301567d730 2023-10-05T21:15:36.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.572+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.572+0000 7fd8a3b9c680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:36.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.572+0000 7fd8a3b9c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.572+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563015687a60 con 0x56301567d730 2023-10-05T21:15:36.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.572+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.572+0000 7fd8a3b9c680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:36.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.572+0000 7fd8a3b9c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.572+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563015687ea0 con 0x7fd88c00e8c0 2023-10-05T21:15:36.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.573+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x7fd88c00e8c0 2023-10-05T21:15:36.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.573+0000 7fd8a3b9c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.573+0000 7fd8a3b9c680 20 zone default found 2023-10-05T21:15:36.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.573+0000 7fd8a3b9c680 4 Realm: () 2023-10-05T21:15:36.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.573+0000 7fd8a3b9c680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:36.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.573+0000 7fd8a3b9c680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:36.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.573+0000 7fd8a3b9c680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:36.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.573+0000 7fd8a3b9c680 20 zonegroup default 2023-10-05T21:15:36.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.573+0000 7fd8a3b9c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.573+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563015687ea0 con 0x7fd88c00e8c0 2023-10-05T21:15:36.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.573+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x7fd88c00e8c0 2023-10-05T21:15:36.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.573+0000 7fd8a3b9c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.573+0000 7fd8a3b9c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.573+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156894e0 con 0x5630156821e0 2023-10-05T21:15:36.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.573+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd888019040 con 0x5630156821e0 2023-10-05T21:15:36.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.573+0000 7fd8a3b9c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.573+0000 7fd8a3b9c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.573+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563015689890 con 0x5630156821e0 2023-10-05T21:15:36.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.573+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd888019040 con 0x5630156821e0 2023-10-05T21:15:36.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.573+0000 7fd8a3b9c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.573+0000 7fd8a3b9c680 20 started sync module instance, tier type = 2023-10-05T21:15:36.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.573+0000 7fd8a3b9c680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:36.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.573+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563015688bf0 con 0x7fd888037020 2023-10-05T21:15:36.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.574+0000 7fd896473700 1 -- 172.21.15.153:0/107654713 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd88c00f620 con 0x7fd888037020 2023-10-05T21:15:36.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.574+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94764517593072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56301568a130 con 0x7fd888037020 2023-10-05T21:15:36.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.574+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56301568a9d0 con 0x56301567d730 2023-10-05T21:15:36.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.575+0000 7fd896473700 1 -- 172.21.15.153:0/107654713 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94764517593072] v29'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd88c00f620 con 0x7fd888037020 2023-10-05T21:15:36.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.575+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.575+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94764517596224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56301568aa10 con 0x56301567d730 2023-10-05T21:15:36.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.575+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56301568b5d0 con 0x5630156821e0 2023-10-05T21:15:36.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.576+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94764517596224] v29'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.576+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd888019040 con 0x5630156821e0 2023-10-05T21:15:36.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.576+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94764517598432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56301568b9d0 con 0x5630156821e0 2023-10-05T21:15:36.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.576+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56301568c3e0 con 0x7fd888037020 2023-10-05T21:15:36.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.577+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94764517598432] v29'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd888019040 con 0x5630156821e0 2023-10-05T21:15:36.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.577+0000 7fd896473700 1 -- 172.21.15.153:0/107654713 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd88c00f620 con 0x7fd888037020 2023-10-05T21:15:36.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.577+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94764517605104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56301568c7e0 con 0x7fd888037020 2023-10-05T21:15:36.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.577+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56301568d1f0 con 0x56301567d730 2023-10-05T21:15:36.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.578+0000 7fd896473700 1 -- 172.21.15.153:0/107654713 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94764517605104] v29'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd88c00f620 con 0x7fd888037020 2023-10-05T21:15:36.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.578+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.578+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94764517608704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56301568d640 con 0x56301567d730 2023-10-05T21:15:36.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.578+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56301568e050 con 0x7fd88c00e8c0 2023-10-05T21:15:36.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.579+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94764517608704] v29'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.579+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x7fd88c00e8c0 2023-10-05T21:15:36.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.579+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94764517610368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56301568e050 con 0x7fd88c00e8c0 2023-10-05T21:15:36.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.579+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56301568ea60 con 0x7fd88c00e8c0 2023-10-05T21:15:36.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.579+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94764517610368] v29'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x7fd88c00e8c0 2023-10-05T21:15:36.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.580+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x7fd88c00e8c0 2023-10-05T21:15:36.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.580+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94764517612976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56301568ea60 con 0x7fd88c00e8c0 2023-10-05T21:15:36.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.580+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56301568f4b0 con 0x7fd88c00e8c0 2023-10-05T21:15:36.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.580+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94764517612976] v29'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x7fd88c00e8c0 2023-10-05T21:15:36.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.580+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x7fd88c00e8c0 2023-10-05T21:15:36.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.580+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94764517617536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56301568ea60 con 0x7fd88c00e8c0 2023-10-05T21:15:36.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.580+0000 7fd8a3b9c680 20 add_watcher() i=0 2023-10-05T21:15:36.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.580+0000 7fd8a3b9c680 20 add_watcher() i=1 2023-10-05T21:15:36.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.580+0000 7fd8a3b9c680 20 add_watcher() i=2 2023-10-05T21:15:36.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.580+0000 7fd8a3b9c680 20 add_watcher() i=3 2023-10-05T21:15:36.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.580+0000 7fd8a3b9c680 20 add_watcher() i=4 2023-10-05T21:15:36.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.580+0000 7fd8a3b9c680 20 add_watcher() i=5 2023-10-05T21:15:36.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.580+0000 7fd8a3b9c680 20 add_watcher() i=6 2023-10-05T21:15:36.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.581+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94764517617536] v29'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x7fd88c00e8c0 2023-10-05T21:15:36.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.581+0000 7fd8a3b9c680 20 add_watcher() i=7 2023-10-05T21:15:36.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.581+0000 7fd8a3b9c680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:36.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.581+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156928e0 con 0x56301567d730 2023-10-05T21:15:36.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.581+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.581+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94764517615424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56301568fd80 con 0x56301567d730 2023-10-05T21:15:36.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.582+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94764517615424] v29'193 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.582+0000 7fd867fe7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:36.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.582+0000 7fd8a3b9c680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:36.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.582+0000 7fd8a3b9c680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:36.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.582+0000 7fd8a3b9c680 1 Processor -- start 2023-10-05T21:15:36.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.583+0000 7fd8a3b9c680 1 -- start start 2023-10-05T21:15:36.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.583+0000 7fd8a3b9c680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56301569c500 0x56301569c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.583+0000 7fd8a3b9c680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x56301569cf20 con 0x56301569c500 2023-10-05T21:15:36.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.583+0000 7fd896473700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56301569c500 0x56301569c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.583+0000 7fd896473700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56301569c500 0x56301569c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57664/0 (socket says 172.21.15.153:57664) 2023-10-05T21:15:36.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.583+0000 7fd896473700 1 -- 172.21.15.153:0/2795445906 learned_addr learned my addr 172.21.15.153:0/2795445906 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:36.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.583+0000 7fd896473700 1 -- 172.21.15.153:0/2795445906 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56301569d400 con 0x56301569c500 2023-10-05T21:15:36.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.583+0000 7fd896473700 1 --2- 172.21.15.153:0/2795445906 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56301569c500 0x56301569c910 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x5630156811d0 tx=0x7fd88c006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda635739f694361 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.583+0000 7fd8677e6700 1 -- 172.21.15.153:0/2795445906 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd88c00dae0 con 0x56301569c500 2023-10-05T21:15:36.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.583+0000 7fd8677e6700 1 -- 172.21.15.153:0/2795445906 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88c00dc40 con 0x56301569c500 2023-10-05T21:15:36.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.583+0000 7fd8677e6700 1 -- 172.21.15.153:0/2795445906 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd88c00ddf0 con 0x56301569c500 2023-10-05T21:15:36.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.584+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2795445906 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56301569c500 msgr2=0x56301569c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.584+0000 7fd8a3b9c680 1 --2- 172.21.15.153:0/2795445906 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56301569c500 0x56301569c910 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x5630156811d0 tx=0x7fd88c006000 comp rx=0 tx=0).stop 2023-10-05T21:15:36.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.584+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2795445906 shutdown_connections 2023-10-05T21:15:36.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.584+0000 7fd8a3b9c680 1 --2- 172.21.15.153:0/2795445906 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56301569c500 0x56301569c910 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.584+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2795445906 >> 172.21.15.153:0/2795445906 conn(0x563015698800 msgr2=0x563015696900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:36.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.584+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2795445906 shutdown_connections 2023-10-05T21:15:36.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.584+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2795445906 wait complete. 2023-10-05T21:15:36.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.584+0000 7fd8a3b9c680 1 Processor -- start 2023-10-05T21:15:36.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.585+0000 7fd8a3b9c680 1 -- start start 2023-10-05T21:15:36.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.585+0000 7fd8a3b9c680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56301569c500 0x5630156a32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.585+0000 7fd8a3b9c680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630156a3830 con 0x56301569c500 2023-10-05T21:15:36.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.585+0000 7fd896473700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56301569c500 0x5630156a32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.585+0000 7fd896473700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56301569c500 0x5630156a32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57678/0 (socket says 172.21.15.153:57678) 2023-10-05T21:15:36.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.585+0000 7fd896473700 1 -- 172.21.15.153:0/2989794203 learned_addr learned my addr 172.21.15.153:0/2989794203 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:36.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.585+0000 7fd896473700 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd88c006070 con 0x56301569c500 2023-10-05T21:15:36.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.585+0000 7fd896473700 1 --2- 172.21.15.153:0/2989794203 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56301569c500 0x5630156a32f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fd88c000fb0 tx=0x7fd88c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.585+0000 7fd865fe3700 1 -- 172.21.15.153:0/2989794203 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd88c03da90 con 0x56301569c500 2023-10-05T21:15:36.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.585+0000 7fd865fe3700 1 -- 172.21.15.153:0/2989794203 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88c03dbf0 con 0x56301569c500 2023-10-05T21:15:36.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.585+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5630156a3a30 con 0x56301569c500 2023-10-05T21:15:36.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.585+0000 7fd865fe3700 1 -- 172.21.15.153:0/2989794203 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd88c03dd80 con 0x56301569c500 2023-10-05T21:15:36.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.586+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5630156a3e80 con 0x56301569c500 2023-10-05T21:15:36.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.586+0000 7fd865fe3700 1 -- 172.21.15.153:0/2989794203 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fd88c01a040 con 0x56301569c500 2023-10-05T21:15:36.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.586+0000 7fd865fe3700 1 --2- 172.21.15.153:0/2989794203 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd7dc034140 0x7fd7dc0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.586+0000 7fd865fe3700 1 -- 172.21.15.153:0/2989794203 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fd88c048b30 con 0x56301569c500 2023-10-05T21:15:36.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.586+0000 7fd897475700 1 --2- 172.21.15.153:0/2989794203 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd7dc034140 0x7fd7dc0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.587+0000 7fd8a3b9c680 1 --2- 172.21.15.153:0/2989794203 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5630156ae110 0x5630156b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.587+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156b0c70 con 0x5630156ae110 2023-10-05T21:15:36.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.587+0000 7fd896c74700 1 --2- 172.21.15.153:0/2989794203 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5630156ae110 0x5630156b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.587+0000 7fd897475700 1 --2- 172.21.15.153:0/2989794203 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd7dc034140 0x7fd7dc0365f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x56301568ecc0 tx=0x7fd890037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.587+0000 7fd896c74700 1 --2- 172.21.15.153:0/2989794203 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5630156ae110 0x5630156b05c0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.588+0000 7fd896c74700 1 -- 172.21.15.153:0/2989794203 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v29'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd888019040 con 0x5630156ae110 2023-10-05T21:15:36.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.588+0000 7fd8a3b9c680 1 --2- 172.21.15.153:0/2989794203 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x5630156b19f0 0x5630156b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.588+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156b44d0 con 0x5630156b19f0 2023-10-05T21:15:36.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.588+0000 7fd896473700 1 --2- 172.21.15.153:0/2989794203 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x5630156b19f0 0x5630156b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.588+0000 7fd896473700 1 --2- 172.21.15.153:0/2989794203 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x5630156b19f0 0x5630156b3dd0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.589+0000 7fd896473700 1 -- 172.21.15.153:0/2989794203 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v29'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd88c00f620 con 0x5630156b19f0 2023-10-05T21:15:36.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.589+0000 7fd8a3b9c680 1 --2- 172.21.15.153:0/2989794203 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5630156b5280 0x5630156b7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.589+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156b7e40 con 0x5630156b5280 2023-10-05T21:15:36.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.589+0000 7fd897475700 1 --2- 172.21.15.153:0/2989794203 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5630156b5280 0x5630156b7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.589+0000 7fd897475700 1 --2- 172.21.15.153:0/2989794203 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5630156b5280 0x5630156b7730 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.590+0000 7fd897475700 1 -- 172.21.15.153:0/2989794203 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v29'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x5630156b5280 2023-10-05T21:15:36.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.590+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156b85b0 con 0x5630156ae110 2023-10-05T21:15:36.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.591+0000 7fd896c74700 1 -- 172.21.15.153:0/2989794203 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v29'194 uv186 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd888019040 con 0x5630156ae110 2023-10-05T21:15:36.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.591+0000 7fd8a3b9c680 1 --2- 172.21.15.153:0/2989794203 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x5630156b91e0 0x5630156bb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.591+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156bbde0 con 0x5630156b91e0 2023-10-05T21:15:36.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.591+0000 7fd896c74700 1 --2- 172.21.15.153:0/2989794203 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x5630156b91e0 0x5630156bb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.591+0000 7fd896c74700 1 --2- 172.21.15.153:0/2989794203 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x5630156b91e0 0x5630156bb690 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.592+0000 7fd896c74700 1 -- 172.21.15.153:0/2989794203 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v29'64 uv58 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd888019040 con 0x5630156b91e0 2023-10-05T21:15:36.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.592+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156bc510 con 0x5630156b5280 2023-10-05T21:15:36.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.592+0000 7fd897475700 1 -- 172.21.15.153:0/2989794203 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v29'39 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x5630156b5280 2023-10-05T21:15:36.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.592+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156bcc10 con 0x5630156ae110 2023-10-05T21:15:36.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.593+0000 7fd896c74700 1 -- 172.21.15.153:0/2989794203 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v29'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd888019040 con 0x5630156ae110 2023-10-05T21:15:36.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.593+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156bd100 con 0x5630156b19f0 2023-10-05T21:15:36.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.594+0000 7fd896473700 1 -- 172.21.15.153:0/2989794203 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v29'43 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd88c00f620 con 0x5630156b19f0 2023-10-05T21:15:36.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.594+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156ab8a0 con 0x5630156b91e0 2023-10-05T21:15:36.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.595+0000 7fd896c74700 1 -- 172.21.15.153:0/2989794203 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v29'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd888019040 con 0x5630156b91e0 2023-10-05T21:15:36.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.595+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156ab8a0 con 0x5630156b5280 2023-10-05T21:15:36.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.596+0000 7fd897475700 1 -- 172.21.15.153:0/2989794203 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v29'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x5630156b5280 2023-10-05T21:15:36.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.596+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156abb10 con 0x5630156b91e0 2023-10-05T21:15:36.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.596+0000 7fd896c74700 1 -- 172.21.15.153:0/2989794203 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v29'65 uv60 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd888019040 con 0x5630156b91e0 2023-10-05T21:15:36.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.596+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156abb30 con 0x5630156b19f0 2023-10-05T21:15:36.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.597+0000 7fd896473700 1 -- 172.21.15.153:0/2989794203 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v29'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd88c00f620 con 0x5630156b19f0 2023-10-05T21:15:36.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.597+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156bded0 con 0x5630156b91e0 2023-10-05T21:15:36.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.598+0000 7fd896c74700 1 -- 172.21.15.153:0/2989794203 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v29'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd888019040 con 0x5630156b91e0 2023-10-05T21:15:36.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.598+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156bded0 con 0x5630156b19f0 2023-10-05T21:15:36.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.599+0000 7fd896473700 1 -- 172.21.15.153:0/2989794203 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v29'45 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd88c00f620 con 0x5630156b19f0 2023-10-05T21:15:36.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.599+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156bded0 con 0x5630156ae110 2023-10-05T21:15:36.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.600+0000 7fd896c74700 1 -- 172.21.15.153:0/2989794203 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v29'195 uv182 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd888019040 con 0x5630156ae110 2023-10-05T21:15:36.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.600+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156bded0 con 0x5630156b5280 2023-10-05T21:15:36.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.600+0000 7fd897475700 1 -- 172.21.15.153:0/2989794203 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v29'53 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x5630156b5280 2023-10-05T21:15:36.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.600+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156bded0 con 0x5630156b91e0 2023-10-05T21:15:36.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.601+0000 7fd896c74700 1 -- 172.21.15.153:0/2989794203 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v29'66 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd888019040 con 0x5630156b91e0 2023-10-05T21:15:36.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.601+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156bded0 con 0x5630156b5280 2023-10-05T21:15:36.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.602+0000 7fd897475700 1 -- 172.21.15.153:0/2989794203 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v29'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x5630156b5280 2023-10-05T21:15:36.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.602+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156be000 con 0x5630156ae110 2023-10-05T21:15:36.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.602+0000 7fd896c74700 1 -- 172.21.15.153:0/2989794203 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v29'34 uv32 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd888019040 con 0x5630156ae110 2023-10-05T21:15:36.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.602+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156be000 con 0x5630156ae110 2023-10-05T21:15:36.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.603+0000 7fd896c74700 1 -- 172.21.15.153:0/2989794203 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v29'196 uv184 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd888019040 con 0x5630156ae110 2023-10-05T21:15:36.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.603+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156be000 con 0x5630156b5280 2023-10-05T21:15:36.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.604+0000 7fd897475700 1 -- 172.21.15.153:0/2989794203 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v29'54 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x5630156b5280 2023-10-05T21:15:36.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.604+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156be0c0 con 0x5630156b91e0 2023-10-05T21:15:36.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.605+0000 7fd896c74700 1 -- 172.21.15.153:0/2989794203 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v29'39 uv37 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd888019040 con 0x5630156b91e0 2023-10-05T21:15:36.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.605+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156be0c0 con 0x5630156b5280 2023-10-05T21:15:36.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.605+0000 7fd897475700 1 -- 172.21.15.153:0/2989794203 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v29'28 uv26 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x5630156b5280 2023-10-05T21:15:36.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.605+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156be090 con 0x5630156b5280 2023-10-05T21:15:36.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.606+0000 7fd897475700 1 -- 172.21.15.153:0/2989794203 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v29'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x5630156b5280 2023-10-05T21:15:36.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.606+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156be0c0 con 0x5630156b5280 2023-10-05T21:15:36.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.607+0000 7fd897475700 1 -- 172.21.15.153:0/2989794203 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v29'31 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x5630156b5280 2023-10-05T21:15:36.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.607+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156be0c0 con 0x5630156b5280 2023-10-05T21:15:36.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.607+0000 7fd897475700 1 -- 172.21.15.153:0/2989794203 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v29'40 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x5630156b5280 2023-10-05T21:15:36.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.607+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156be0b0 con 0x5630156b19f0 2023-10-05T21:15:36.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.608+0000 7fd896473700 1 -- 172.21.15.153:0/2989794203 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v29'26 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd88c00f620 con 0x5630156b19f0 2023-10-05T21:15:36.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.608+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156be0b0 con 0x5630156b5280 2023-10-05T21:15:36.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.609+0000 7fd897475700 1 -- 172.21.15.153:0/2989794203 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v29'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x5630156b5280 2023-10-05T21:15:36.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.609+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156be0b0 con 0x5630156b19f0 2023-10-05T21:15:36.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.610+0000 7fd896473700 1 -- 172.21.15.153:0/2989794203 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v29'44 uv38 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd88c00f620 con 0x5630156b19f0 2023-10-05T21:15:36.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.610+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156be0b0 con 0x5630156b5280 2023-10-05T21:15:36.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.610+0000 7fd897475700 1 -- 172.21.15.153:0/2989794203 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v29'55 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x5630156b5280 2023-10-05T21:15:36.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.610+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156be0b0 con 0x5630156b19f0 2023-10-05T21:15:36.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.611+0000 7fd896473700 1 -- 172.21.15.153:0/2989794203 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v29'46 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd88c00f620 con 0x5630156b19f0 2023-10-05T21:15:36.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.611+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156be0b0 con 0x5630156b91e0 2023-10-05T21:15:36.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.612+0000 7fd896c74700 1 -- 172.21.15.153:0/2989794203 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v29'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd888019040 con 0x5630156b91e0 2023-10-05T21:15:36.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.613+0000 7fd7d6ffd700 20 reqs_thread_entry: start 2023-10-05T21:15:36.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.613+0000 7fd7d4ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:36.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.613+0000 7fd8a3b9c680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:36.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.613+0000 7fd8a3b9c680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:36.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.613+0000 7fd7c6ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:16:06 2023 2023-10-05T21:15:36.632 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:36.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.613+0000 7fd7c67fc700 20 reqs_thread_entry: start 2023-10-05T21:15:36.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.613+0000 7fd8a3b9c680 20 get_system_obj_state: rctx=0x7ffc07ea6948 obj=default.rgw.meta:users.uid:foo state=0x563015500240 s->prefetch_data=0 2023-10-05T21:15:36.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.613+0000 7fd8a3b9c680 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T21:15:36.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.613+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x563015719560 con 0x56301567d730 2023-10-05T21:15:36.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.614+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv13 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.614+0000 7fd8a3b9c680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T21:15:36.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.614+0000 7fd8a3b9c680 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:36.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.614+0000 7fd8a3b9c680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:36.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.614+0000 7fd8a3b9c680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:36.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.614+0000 7fd8a3b9c680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:36.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.614+0000 7fd8a3b9c680 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:36.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.614+0000 7fd8a3b9c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.614+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56301571b7f0 con 0x56301567d730 2023-10-05T21:15:36.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.614+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv13 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.614+0000 7fd8a3b9c680 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T21:15:36.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.614+0000 7fd8a3b9c680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T21:15:36.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.614+0000 7fd8a3b9c680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:36.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.614+0000 7fd8a3b9c680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:36.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.614+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:104 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x56301571b7f0 con 0x7fd888037020 2023-10-05T21:15:36.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.614+0000 7fd896473700 1 -- 172.21.15.153:0/107654713 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(104 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7fd88c00f620 con 0x7fd888037020 2023-10-05T21:15:36.634 INFO:teuthology.orchestra.run.smithi153.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2023-10-05T21:15:36.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.615+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94764517593072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156d8090 con 0x7fd888037020 2023-10-05T21:15:36.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.615+0000 7fd896473700 1 -- 172.21.15.153:0/107654713 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(105 notify.0 [watch unwatch cookie 94764517593072] v29'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd88c00f620 con 0x7fd888037020 2023-10-05T21:15:36.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.615+0000 7fd8a3b9c680 20 remove_watcher() i=0 2023-10-05T21:15:36.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.615+0000 7fd8a3b9c680 2 removed watcher, disabling cache 2023-10-05T21:15:36.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.615+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94764517596224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563015688ff0 con 0x56301567d730 2023-10-05T21:15:36.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.616+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(106 notify.1 [watch unwatch cookie 94764517596224] v29'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.616+0000 7fd8a3b9c680 20 remove_watcher() i=1 2023-10-05T21:15:36.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.616+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94764517598432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563015688ff0 con 0x5630156821e0 2023-10-05T21:15:36.640 DEBUG:teuthology.orchestra.run:got remote process result: 17 2023-10-05T21:15:36.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.617+0000 7fd896c74700 1 -- 172.21.15.153:0/107654713 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(107 notify.2 [watch unwatch cookie 94764517598432] v29'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd888019040 con 0x5630156821e0 2023-10-05T21:15:36.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.617+0000 7fd8a3b9c680 20 remove_watcher() i=2 2023-10-05T21:15:36.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.617+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94764517605104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56301568a4e0 con 0x7fd888037020 2023-10-05T21:15:36.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.618+0000 7fd896473700 1 -- 172.21.15.153:0/107654713 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(108 notify.3 [watch unwatch cookie 94764517605104] v29'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd88c00f620 con 0x7fd888037020 2023-10-05T21:15:36.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.618+0000 7fd8a3b9c680 20 remove_watcher() i=3 2023-10-05T21:15:36.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.618+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94764517608704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563015688ff0 con 0x56301567d730 2023-10-05T21:15:36.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.619+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(109 notify.4 [watch unwatch cookie 94764517608704] v29'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.619+0000 7fd8a3b9c680 20 remove_watcher() i=4 2023-10-05T21:15:36.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.619+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94764517610368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56301568cd00 con 0x7fd88c00e8c0 2023-10-05T21:15:36.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.620+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(110 notify.5 [watch unwatch cookie 94764517610368] v29'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x7fd88c00e8c0 2023-10-05T21:15:36.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.620+0000 7fd8a3b9c680 20 remove_watcher() i=5 2023-10-05T21:15:36.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.620+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:111 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94764517612976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x563015688ff0 con 0x7fd88c00e8c0 2023-10-05T21:15:36.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.620+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(111 notify.6 [watch unwatch cookie 94764517612976] v29'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x7fd88c00e8c0 2023-10-05T21:15:36.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.620+0000 7fd8a3b9c680 20 remove_watcher() i=6 2023-10-05T21:15:36.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.620+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94764517617536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x56301568d380 con 0x7fd88c00e8c0 2023-10-05T21:15:36.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.621+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(112 notify.7 [watch unwatch cookie 94764517617536] v29'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x7fd88c00e8c0 2023-10-05T21:15:36.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.621+0000 7fd8a3b9c680 20 remove_watcher() i=7 2023-10-05T21:15:36.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.622+0000 7fd867fe7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:36.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.622+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:113 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94764517615424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5630156db860 con 0x56301567d730 2023-10-05T21:15:36.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.622+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(113 data_loggenerations_metadata [watch unwatch cookie 94764517615424] v29'197 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd89000a570 con 0x56301567d730 2023-10-05T21:15:36.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fd88c00e8c0 msgr2=0x7fd88c00d310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 --2- 172.21.15.153:0/107654713 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fd88c00e8c0 0x7fd88c00d310 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x56301567d730 msgr2=0x56301567fb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 --2- 172.21.15.153:0/107654713 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x56301567d730 0x56301567fb90 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fd888037020 msgr2=0x7fd888048a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 --2- 172.21.15.153:0/107654713 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fd888037020 0x7fd888048a50 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5630156821e0 msgr2=0x5630156845c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 --2- 172.21.15.153:0/107654713 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5630156821e0 0x5630156845c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd87c034140 msgr2=0x7fd87c0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 --2- 172.21.15.153:0/107654713 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd87c034140 0x7fd87c0365f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd88c0011e0 tx=0x7fd88c0013c0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56301564c2b0 msgr2=0x5630156739f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 --2- 172.21.15.153:0/107654713 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56301564c2b0 0x5630156739f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd888003010 tx=0x7fd88801d000 comp rx=0 tx=0).stop 2023-10-05T21:15:36.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd897475700 1 -- 172.21.15.153:0/107654713 reap_dead start 2023-10-05T21:15:36.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 shutdown_connections 2023-10-05T21:15:36.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 >> 172.21.15.153:0/107654713 conn(0x563015647b80 msgr2=0x563015665890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:36.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 shutdown_connections 2023-10-05T21:15:36.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/107654713 wait complete. 2023-10-05T21:15:36.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x5630156b19f0 msgr2=0x5630156b3dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 --2- 172.21.15.153:0/2989794203 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x5630156b19f0 0x5630156b3dd0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5630156ae110 msgr2=0x5630156b05c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 --2- 172.21.15.153:0/2989794203 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5630156ae110 0x5630156b05c0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x5630156b91e0 msgr2=0x5630156bb690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 --2- 172.21.15.153:0/2989794203 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x5630156b91e0 0x5630156bb690 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5630156b5280 msgr2=0x5630156b7730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 --2- 172.21.15.153:0/2989794203 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5630156b5280 0x5630156b7730 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd7dc034140 msgr2=0x7fd7dc0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 --2- 172.21.15.153:0/2989794203 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd7dc034140 0x7fd7dc0365f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x56301568ecc0 tx=0x7fd890037450 comp rx=0 tx=0).stop 2023-10-05T21:15:36.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56301569c500 msgr2=0x5630156a32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 --2- 172.21.15.153:0/2989794203 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56301569c500 0x5630156a32f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fd88c000fb0 tx=0x7fd88c032000 comp rx=0 tx=0).stop 2023-10-05T21:15:36.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd896c74700 1 -- 172.21.15.153:0/2989794203 reap_dead start 2023-10-05T21:15:36.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 shutdown_connections 2023-10-05T21:15:36.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 >> 172.21.15.153:0/2989794203 conn(0x563015698800 msgr2=0x5630156968d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:36.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 shutdown_connections 2023-10-05T21:15:36.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.623+0000 7fd8a3b9c680 1 -- 172.21.15.153:0/2989794203 wait complete. 2023-10-05T21:15:36.653 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=217 failed=True 2023-10-05T21:15:36.656 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T21:15:36.683 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T21:15:36.690 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T21:15:36.735 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2023-10-05T21:15:36.739 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T21:15:36.739 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2023-10-05T21:15:36.739 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2023-10-05T21:15:36.739 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2023-10-05T21:15:36.784 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:36.784 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:36.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.783+0000 7f3e336a9680 1 Processor -- start 2023-10-05T21:15:36.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.784+0000 7f3e336a9680 1 -- start start 2023-10-05T21:15:36.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.784+0000 7f3e336a9680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5609e4c0a0b0 0x5609e4c9b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.784+0000 7f3e336a9680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5609e4be3930 con 0x5609e4c9b9e0 2023-10-05T21:15:36.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.784+0000 7f3e336a9680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x5609e4ba3db0 con 0x5609e4c0a0b0 2023-10-05T21:15:36.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.784+0000 7f3e26781700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5609e4c0a0b0 0x5609e4c9b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.784+0000 7f3e25f80700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x5609e4c9b9e0 0x5609e4c9ddc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:39262/0 (socket says 172.21.15.153:39262) 2023-10-05T21:15:36.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.784+0000 7f3e25f80700 1 -- 172.21.15.153:0/3268204917 learned_addr learned my addr 172.21.15.153:0/3268204917 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:36.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.784+0000 7f3e26781700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5609e4c0a0b0 0x5609e4c9b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57684/0 (socket says 172.21.15.153:57684) 2023-10-05T21:15:36.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.784+0000 7f3e26781700 1 -- 172.21.15.153:0/3268204917 >> v1:172.21.15.111:6789/0 conn(0x5609e4c9b9e0 legacy=0x5609e4c9ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.784+0000 7f3e26781700 1 -- 172.21.15.153:0/3268204917 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609e4ca04f0 con 0x5609e4c0a0b0 2023-10-05T21:15:36.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.785+0000 7f3e26781700 1 --2- 172.21.15.153:0/3268204917 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5609e4c0a0b0 0x5609e4c9b4a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800a5d0 tx=0x7f3e18005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ecb9ec9191e6a95 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.785+0000 7f3e2577f700 1 -- 172.21.15.153:0/3268204917 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e180086a0 con 0x5609e4c0a0b0 2023-10-05T21:15:36.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.785+0000 7f3e2577f700 1 -- 172.21.15.153:0/3268204917 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e18008800 con 0x5609e4c0a0b0 2023-10-05T21:15:36.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.785+0000 7f3e2577f700 1 -- 172.21.15.153:0/3268204917 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e18008ad0 con 0x5609e4c0a0b0 2023-10-05T21:15:36.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.785+0000 7f3e336a9680 1 -- 172.21.15.153:0/3268204917 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5609e4c0a0b0 msgr2=0x5609e4c9b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.785+0000 7f3e336a9680 1 --2- 172.21.15.153:0/3268204917 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5609e4c0a0b0 0x5609e4c9b4a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800a5d0 tx=0x7f3e18005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:36.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.785+0000 7f3e336a9680 1 -- 172.21.15.153:0/3268204917 shutdown_connections 2023-10-05T21:15:36.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.785+0000 7f3e336a9680 1 --2- 172.21.15.153:0/3268204917 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5609e4c0a0b0 0x5609e4c9b4a0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.785+0000 7f3e336a9680 1 -- 172.21.15.153:0/3268204917 >> 172.21.15.153:0/3268204917 conn(0x5609e4c90b90 msgr2=0x5609e4c92fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:36.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.785+0000 7f3e336a9680 1 -- 172.21.15.153:0/3268204917 shutdown_connections 2023-10-05T21:15:36.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.785+0000 7f3e336a9680 1 -- 172.21.15.153:0/3268204917 wait complete. 2023-10-05T21:15:36.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.786+0000 7f3e336a9680 1 Processor -- start 2023-10-05T21:15:36.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.786+0000 7f3e336a9680 1 -- start start 2023-10-05T21:15:36.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.786+0000 7f3e336a9680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5609e4c0a0b0 0x5609e4cb7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.786+0000 7f3e336a9680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609e4b43ea0 con 0x5609e4c0a0b0 2023-10-05T21:15:36.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.786+0000 7f3e26781700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5609e4c0a0b0 0x5609e4cb7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.787+0000 7f3e26781700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5609e4c0a0b0 0x5609e4cb7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57696/0 (socket says 172.21.15.153:57696) 2023-10-05T21:15:36.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.787+0000 7f3e26781700 1 -- 172.21.15.153:0/3956487415 learned_addr learned my addr 172.21.15.153:0/3956487415 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:36.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.787+0000 7f3e26781700 1 -- 172.21.15.153:0/3956487415 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e18005cf0 con 0x5609e4c0a0b0 2023-10-05T21:15:36.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.787+0000 7f3e26781700 1 --2- 172.21.15.153:0/3956487415 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5609e4c0a0b0 0x5609e4cb7b30 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3e18005a90 tx=0x7f3e18015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d3f84893542aa1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.787+0000 7f3e1ffff700 1 -- 172.21.15.153:0/3956487415 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e18008970 con 0x5609e4c0a0b0 2023-10-05T21:15:36.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.787+0000 7f3e1ffff700 1 -- 172.21.15.153:0/3956487415 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e18008ad0 con 0x5609e4c0a0b0 2023-10-05T21:15:36.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.787+0000 7f3e1ffff700 1 -- 172.21.15.153:0/3956487415 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e18008dc0 con 0x5609e4c0a0b0 2023-10-05T21:15:36.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.787+0000 7f3e336a9680 1 -- 172.21.15.153:0/3956487415 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5609e4c0a0b0 msgr2=0x5609e4cb7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.787+0000 7f3e336a9680 1 --2- 172.21.15.153:0/3956487415 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5609e4c0a0b0 0x5609e4cb7b30 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3e18005a90 tx=0x7f3e18015000 comp rx=0 tx=0).stop 2023-10-05T21:15:36.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.787+0000 7f3e336a9680 1 -- 172.21.15.153:0/3956487415 shutdown_connections 2023-10-05T21:15:36.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.787+0000 7f3e336a9680 1 --2- 172.21.15.153:0/3956487415 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5609e4c0a0b0 0x5609e4cb7b30 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.788+0000 7f3e336a9680 1 -- 172.21.15.153:0/3956487415 >> 172.21.15.153:0/3956487415 conn(0x5609e4c90b90 msgr2=0x5609e4cb3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:36.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.788+0000 7f3e336a9680 1 -- 172.21.15.153:0/3956487415 shutdown_connections 2023-10-05T21:15:36.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.788+0000 7f3e336a9680 1 -- 172.21.15.153:0/3956487415 wait complete. 2023-10-05T21:15:36.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.788+0000 7f3e336a9680 1 Processor -- start 2023-10-05T21:15:36.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.788+0000 7f3e336a9680 1 -- start start 2023-10-05T21:15:36.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.788+0000 7f3e336a9680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5609e4c0a0b0 0x5609e4cbee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.788+0000 7f3e336a9680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609e4b3ac80 con 0x5609e4c0a0b0 2023-10-05T21:15:36.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.788+0000 7f3e26781700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5609e4c0a0b0 0x5609e4cbee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.788+0000 7f3e26781700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5609e4c0a0b0 0x5609e4cbee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57708/0 (socket says 172.21.15.153:57708) 2023-10-05T21:15:36.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.788+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 learned_addr learned my addr 172.21.15.153:0/1417361961 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:36.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.789+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609e4ca04f0 con 0x5609e4c0a0b0 2023-10-05T21:15:36.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.789+0000 7f3e26781700 1 --2- 172.21.15.153:0/1417361961 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5609e4c0a0b0 0x5609e4cbee60 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3e1801f040 tx=0x7f3e1801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.789+0000 7f3e1e7fc700 1 -- 172.21.15.153:0/1417361961 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e18008970 con 0x5609e4c0a0b0 2023-10-05T21:15:36.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.789+0000 7f3e1e7fc700 1 -- 172.21.15.153:0/1417361961 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1802a070 con 0x5609e4c0a0b0 2023-10-05T21:15:36.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.789+0000 7f3e1e7fc700 1 -- 172.21.15.153:0/1417361961 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e180265c0 con 0x5609e4c0a0b0 2023-10-05T21:15:36.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.789+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5609e4cbf3a0 con 0x5609e4c0a0b0 2023-10-05T21:15:36.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.789+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5609e4cbf7f0 con 0x5609e4c0a0b0 2023-10-05T21:15:36.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.790+0000 7f3e1e7fc700 1 -- 172.21.15.153:0/1417361961 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f3e18026770 con 0x5609e4c0a0b0 2023-10-05T21:15:36.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.790+0000 7f3e336a9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.790+0000 7f3e1e7fc700 1 --2- 172.21.15.153:0/1417361961 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3e08034130 0x7f3e080365e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.790+0000 7f3e1e7fc700 1 -- 172.21.15.153:0/1417361961 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f3e18049c20 con 0x5609e4c0a0b0 2023-10-05T21:15:36.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.790+0000 7f3e25f80700 1 --2- 172.21.15.153:0/1417361961 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3e08034130 0x7f3e080365e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.790+0000 7f3e336a9680 1 --2- 172.21.15.153:0/1417361961 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5609e4c9b9e0 0x5609e4ccac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.790+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4ccb3b0 con 0x5609e4c9b9e0 2023-10-05T21:15:36.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.790+0000 7f3e26f82700 1 --2- 172.21.15.153:0/1417361961 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5609e4c9b9e0 0x5609e4ccac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.791+0000 7f3e25f80700 1 --2- 172.21.15.153:0/1417361961 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3e08034130 0x7f3e080365e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3e10004170 tx=0x7f3e10001380 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.791+0000 7f3e26f82700 1 --2- 172.21.15.153:0/1417361961 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5609e4c9b9e0 0x5609e4ccac20 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.791+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.791+0000 7f3e336a9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.791+0000 7f3e336a9680 20 realm 2023-10-05T21:15:36.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.791+0000 7f3e336a9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.791+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cc8200 con 0x5609e4c9b9e0 2023-10-05T21:15:36.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.791+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.791+0000 7f3e336a9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.791+0000 7f3e336a9680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:36.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.791+0000 7f3e336a9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.791+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4ccbeb0 con 0x5609e4c9b9e0 2023-10-05T21:15:36.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.792+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.792+0000 7f3e336a9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.792+0000 7f3e336a9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.792+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4ccc7d0 con 0x5609e4c9b9e0 2023-10-05T21:15:36.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.792+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.792+0000 7f3e336a9680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:36.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.792+0000 7f3e336a9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.792+0000 7f3e336a9680 1 --2- 172.21.15.153:0/1417361961 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5609e4ccd090 0x5609e4ccf470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.792+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4ccfac0 con 0x5609e4ccd090 2023-10-05T21:15:36.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.792+0000 7f3e26781700 1 --2- 172.21.15.153:0/1417361961 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5609e4ccd090 0x5609e4ccf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.792+0000 7f3e26781700 1 --2- 172.21.15.153:0/1417361961 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5609e4ccd090 0x5609e4ccf470 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.793+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f3e18036070 con 0x5609e4ccd090 2023-10-05T21:15:36.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.793+0000 7f3e336a9680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:36.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.793+0000 7f3e336a9680 20 searching for the correct realm 2023-10-05T21:15:36.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.793+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x5609e4ccd090 2023-10-05T21:15:36.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.793+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e18036070 con 0x5609e4ccd090 2023-10-05T21:15:36.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.793+0000 7f3e26781700 1 --2- 172.21.15.153:0/1417361961 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f3e18007030 0x7f3e180305e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.793+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x7f3e18007030 2023-10-05T21:15:36.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.793+0000 7f3e25f80700 1 --2- 172.21.15.153:0/1417361961 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f3e18007030 0x7f3e180305e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.793+0000 7f3e25f80700 1 --2- 172.21.15.153:0/1417361961 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f3e18007030 0x7f3e180305e0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.793+0000 7f3e25f80700 1 -- 172.21.15.153:0/1417361961 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e10006070 con 0x7f3e18007030 2023-10-05T21:15:36.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.793+0000 7f3e25f80700 1 --2- 172.21.15.153:0/1417361961 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f3e1000d3d0 0x7f3e1000d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.793+0000 7f3e25f80700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x7f3e1000d3d0 2023-10-05T21:15:36.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.794+0000 7f3e26f82700 1 --2- 172.21.15.153:0/1417361961 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f3e1000d3d0 0x7f3e1000d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.794+0000 7f3e26f82700 1 --2- 172.21.15.153:0/1417361961 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f3e1000d3d0 0x7f3e1000d820 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.794+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e2000a570 con 0x7f3e1000d3d0 2023-10-05T21:15:36.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.794+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x5609e4c9b9e0 2023-10-05T21:15:36.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.794+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.795+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x5609e4c9b9e0 2023-10-05T21:15:36.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.795+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.795+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x7f3e1000d3d0 2023-10-05T21:15:36.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.795+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e2000a570 con 0x7f3e1000d3d0 2023-10-05T21:15:36.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.795+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x7f3e1000d3d0 2023-10-05T21:15:36.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.795+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e2000a570 con 0x7f3e1000d3d0 2023-10-05T21:15:36.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.795+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x7f3e18007030 2023-10-05T21:15:36.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.795+0000 7f3e25f80700 1 -- 172.21.15.153:0/1417361961 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e10006070 con 0x7f3e18007030 2023-10-05T21:15:36.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.795+0000 7f3e25f80700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x5609e4ccd090 2023-10-05T21:15:36.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.796+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3e18036070 con 0x5609e4ccd090 2023-10-05T21:15:36.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.796+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x5609e4c9b9e0 2023-10-05T21:15:36.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.796+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.796+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x7f3e1000d3d0 2023-10-05T21:15:36.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.796+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e2000a570 con 0x7f3e1000d3d0 2023-10-05T21:15:36.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.796+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x5609e4c9b9e0 2023-10-05T21:15:36.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.796+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.796+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x7f3e18007030 2023-10-05T21:15:36.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.796+0000 7f3e25f80700 1 -- 172.21.15.153:0/1417361961 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e10006070 con 0x7f3e18007030 2023-10-05T21:15:36.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.796+0000 7f3e25f80700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x5609e4ccd090 2023-10-05T21:15:36.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.797+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e18036070 con 0x5609e4ccd090 2023-10-05T21:15:36.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.797+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x5609e4ccd090 2023-10-05T21:15:36.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.797+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e18036070 con 0x5609e4ccd090 2023-10-05T21:15:36.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.797+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x7f3e1000d3d0 2023-10-05T21:15:36.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.797+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e2000a570 con 0x7f3e1000d3d0 2023-10-05T21:15:36.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.797+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x5609e4ccd090 2023-10-05T21:15:36.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.797+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e18036070 con 0x5609e4ccd090 2023-10-05T21:15:36.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.797+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x5609e4ccd090 2023-10-05T21:15:36.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.798+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e18036070 con 0x5609e4ccd090 2023-10-05T21:15:36.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.798+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x5609e4c9b9e0 2023-10-05T21:15:36.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.798+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.798+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x5609e4c9b9e0 2023-10-05T21:15:36.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.798+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.798+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x7f3e1000d3d0 2023-10-05T21:15:36.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.798+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e2000a570 con 0x7f3e1000d3d0 2023-10-05T21:15:36.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.798+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x5609e4ccd090 2023-10-05T21:15:36.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.798+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e18036070 con 0x5609e4ccd090 2023-10-05T21:15:36.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.798+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x7f3e18007030 2023-10-05T21:15:36.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.799+0000 7f3e25f80700 1 -- 172.21.15.153:0/1417361961 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e10006070 con 0x7f3e18007030 2023-10-05T21:15:36.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.799+0000 7f3e25f80700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x5609e4c9b9e0 2023-10-05T21:15:36.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.799+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.799+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x7f3e1000d3d0 2023-10-05T21:15:36.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.799+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e2000a570 con 0x7f3e1000d3d0 2023-10-05T21:15:36.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.799+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x5609e4ccd090 2023-10-05T21:15:36.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.799+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e18036070 con 0x5609e4ccd090 2023-10-05T21:15:36.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.799+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x7f3e1000d3d0 2023-10-05T21:15:36.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.800+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e2000a570 con 0x7f3e1000d3d0 2023-10-05T21:15:36.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.800+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x7f3e18007030 2023-10-05T21:15:36.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.800+0000 7f3e25f80700 1 -- 172.21.15.153:0/1417361961 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e10006070 con 0x7f3e18007030 2023-10-05T21:15:36.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.800+0000 7f3e25f80700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x5609e4ccd090 2023-10-05T21:15:36.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.800+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e18036070 con 0x5609e4ccd090 2023-10-05T21:15:36.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.800+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x7f3e1000d3d0 2023-10-05T21:15:36.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.800+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e2000a570 con 0x7f3e1000d3d0 2023-10-05T21:15:36.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.800+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x5609e4c9b9e0 2023-10-05T21:15:36.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.800+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.800+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1560 con 0x7f3e18007030 2023-10-05T21:15:36.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.801+0000 7f3e25f80700 1 -- 172.21.15.153:0/1417361961 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e10006070 con 0x7f3e18007030 2023-10-05T21:15:36.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.801+0000 7f3e336a9680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:36.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.801+0000 7f3e336a9680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:36.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.801+0000 7f3e336a9680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:36.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.801+0000 7f3e336a9680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:36.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.801+0000 7f3e336a9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.801+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd04b0 con 0x5609e4c9b9e0 2023-10-05T21:15:36.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.801+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.801+0000 7f3e336a9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.801+0000 7f3e336a9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.801+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd08b0 con 0x5609e4c9b9e0 2023-10-05T21:15:36.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.801+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.801+0000 7f3e336a9680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:36.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.801+0000 7f3e336a9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.801+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd19f0 con 0x5609e4c9b9e0 2023-10-05T21:15:36.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.801+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.801+0000 7f3e336a9680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:36.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.801+0000 7f3e336a9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.801+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd1da0 con 0x5609e4ccd090 2023-10-05T21:15:36.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.802+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f3e18036070 con 0x5609e4ccd090 2023-10-05T21:15:36.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.802+0000 7f3e336a9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.802+0000 7f3e336a9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.802+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd2150 con 0x5609e4c9b9e0 2023-10-05T21:15:36.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.802+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.802+0000 7f3e336a9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.802+0000 7f3e336a9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.802+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd2150 con 0x5609e4c9b9e0 2023-10-05T21:15:36.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.802+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.802+0000 7f3e336a9680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:36.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.802+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd2150 con 0x5609e4ccd090 2023-10-05T21:15:36.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.802+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e18036070 con 0x5609e4ccd090 2023-10-05T21:15:36.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.802+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd2150 con 0x7f3e18007030 2023-10-05T21:15:36.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.803+0000 7f3e25f80700 1 -- 172.21.15.153:0/1417361961 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e10006070 con 0x7f3e18007030 2023-10-05T21:15:36.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.803+0000 7f3e25f80700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd2150 con 0x7f3e1000d3d0 2023-10-05T21:15:36.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.803+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e2000a570 con 0x7f3e1000d3d0 2023-10-05T21:15:36.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.803+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd19f0 con 0x5609e4c9b9e0 2023-10-05T21:15:36.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.803+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.803+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd19f0 con 0x5609e4c9b9e0 2023-10-05T21:15:36.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.803+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.804+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd19f0 con 0x7f3e1000d3d0 2023-10-05T21:15:36.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.804+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e2000a570 con 0x7f3e1000d3d0 2023-10-05T21:15:36.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.804+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd19f0 con 0x7f3e1000d3d0 2023-10-05T21:15:36.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.804+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e2000a570 con 0x7f3e1000d3d0 2023-10-05T21:15:36.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.804+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd19f0 con 0x7f3e18007030 2023-10-05T21:15:36.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.805+0000 7f3e25f80700 1 -- 172.21.15.153:0/1417361961 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e10006070 con 0x7f3e18007030 2023-10-05T21:15:36.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.805+0000 7f3e25f80700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd19f0 con 0x5609e4ccd090 2023-10-05T21:15:36.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.805+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3e18036070 con 0x5609e4ccd090 2023-10-05T21:15:36.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.805+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd19f0 con 0x5609e4c9b9e0 2023-10-05T21:15:36.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.805+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.805+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd19f0 con 0x7f3e1000d3d0 2023-10-05T21:15:36.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.805+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e2000a570 con 0x7f3e1000d3d0 2023-10-05T21:15:36.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.805+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd19f0 con 0x5609e4c9b9e0 2023-10-05T21:15:36.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.805+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.805+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd19f0 con 0x7f3e18007030 2023-10-05T21:15:36.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.806+0000 7f3e25f80700 1 -- 172.21.15.153:0/1417361961 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e10006070 con 0x7f3e18007030 2023-10-05T21:15:36.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.806+0000 7f3e25f80700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd19f0 con 0x5609e4ccd090 2023-10-05T21:15:36.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.806+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e18036070 con 0x5609e4ccd090 2023-10-05T21:15:36.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.806+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd19f0 con 0x5609e4ccd090 2023-10-05T21:15:36.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.806+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e18036070 con 0x5609e4ccd090 2023-10-05T21:15:36.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.806+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd19f0 con 0x7f3e1000d3d0 2023-10-05T21:15:36.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.806+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e2000a570 con 0x7f3e1000d3d0 2023-10-05T21:15:36.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.806+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd19f0 con 0x5609e4ccd090 2023-10-05T21:15:36.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.806+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e18036070 con 0x5609e4ccd090 2023-10-05T21:15:36.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.806+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd19f0 con 0x5609e4ccd090 2023-10-05T21:15:36.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.807+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e18036070 con 0x5609e4ccd090 2023-10-05T21:15:36.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.807+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd19f0 con 0x5609e4c9b9e0 2023-10-05T21:15:36.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.807+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.807+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd19f0 con 0x5609e4c9b9e0 2023-10-05T21:15:36.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.807+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.807+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd19f0 con 0x7f3e1000d3d0 2023-10-05T21:15:36.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.807+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e2000a570 con 0x7f3e1000d3d0 2023-10-05T21:15:36.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.807+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd19f0 con 0x5609e4ccd090 2023-10-05T21:15:36.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.807+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e18036070 con 0x5609e4ccd090 2023-10-05T21:15:36.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.807+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd19f0 con 0x7f3e18007030 2023-10-05T21:15:36.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.808+0000 7f3e25f80700 1 -- 172.21.15.153:0/1417361961 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e10006070 con 0x7f3e18007030 2023-10-05T21:15:36.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.808+0000 7f3e25f80700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd19f0 con 0x5609e4c9b9e0 2023-10-05T21:15:36.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.808+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.808+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd19f0 con 0x7f3e1000d3d0 2023-10-05T21:15:36.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.808+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e2000a570 con 0x7f3e1000d3d0 2023-10-05T21:15:36.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.808+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd19f0 con 0x5609e4ccd090 2023-10-05T21:15:36.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.808+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e18036070 con 0x5609e4ccd090 2023-10-05T21:15:36.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.808+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd19f0 con 0x7f3e1000d3d0 2023-10-05T21:15:36.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.809+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e2000a570 con 0x7f3e1000d3d0 2023-10-05T21:15:36.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.809+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd19f0 con 0x7f3e18007030 2023-10-05T21:15:36.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.809+0000 7f3e25f80700 1 -- 172.21.15.153:0/1417361961 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e10006070 con 0x7f3e18007030 2023-10-05T21:15:36.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.809+0000 7f3e25f80700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd19f0 con 0x5609e4ccd090 2023-10-05T21:15:36.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.809+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e18036070 con 0x5609e4ccd090 2023-10-05T21:15:36.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.809+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd19f0 con 0x7f3e1000d3d0 2023-10-05T21:15:36.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.809+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e2000a570 con 0x7f3e1000d3d0 2023-10-05T21:15:36.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.809+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd19f0 con 0x5609e4c9b9e0 2023-10-05T21:15:36.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.809+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.809+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd19f0 con 0x7f3e18007030 2023-10-05T21:15:36.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.810+0000 7f3e25f80700 1 -- 172.21.15.153:0/1417361961 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e10006070 con 0x7f3e18007030 2023-10-05T21:15:36.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.810+0000 7f3e336a9680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:36.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.810+0000 7f3e336a9680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:36.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.810+0000 7f3e336a9680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:36.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.810+0000 7f3e336a9680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:36.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.810+0000 7f3e336a9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.810+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd2150 con 0x5609e4c9b9e0 2023-10-05T21:15:36.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.810+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.810+0000 7f3e336a9680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:36.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.810+0000 7f3e336a9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.810+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd2550 con 0x5609e4ccd090 2023-10-05T21:15:36.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.810+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f3e18036070 con 0x5609e4ccd090 2023-10-05T21:15:36.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.810+0000 7f3e336a9680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:36.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.810+0000 7f3e336a9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.810+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd2df0 con 0x5609e4c9b9e0 2023-10-05T21:15:36.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.810+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.810+0000 7f3e336a9680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:36.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.810+0000 7f3e336a9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.810+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd2df0 con 0x5609e4c9b9e0 2023-10-05T21:15:36.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.811+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.811+0000 7f3e336a9680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:36.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.811+0000 7f3e336a9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.811+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd2ef0 con 0x7f3e1000d3d0 2023-10-05T21:15:36.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.811+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f3e2000a570 con 0x7f3e1000d3d0 2023-10-05T21:15:36.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.811+0000 7f3e336a9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.811+0000 7f3e336a9680 20 zone default found 2023-10-05T21:15:36.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.811+0000 7f3e336a9680 4 Realm: () 2023-10-05T21:15:36.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.811+0000 7f3e336a9680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:36.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.811+0000 7f3e336a9680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:36.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.811+0000 7f3e336a9680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:36.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.811+0000 7f3e336a9680 20 zonegroup default 2023-10-05T21:15:36.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.811+0000 7f3e336a9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.811+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd2ef0 con 0x7f3e1000d3d0 2023-10-05T21:15:36.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.811+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f3e2000a570 con 0x7f3e1000d3d0 2023-10-05T21:15:36.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.811+0000 7f3e336a9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.811+0000 7f3e336a9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.811+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd4870 con 0x5609e4ccd090 2023-10-05T21:15:36.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.812+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3e18036070 con 0x5609e4ccd090 2023-10-05T21:15:36.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.812+0000 7f3e336a9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.812+0000 7f3e336a9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.812+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd4c20 con 0x5609e4ccd090 2023-10-05T21:15:36.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.812+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3e18036070 con 0x5609e4ccd090 2023-10-05T21:15:36.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.812+0000 7f3e336a9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.812+0000 7f3e336a9680 20 started sync module instance, tier type = 2023-10-05T21:15:36.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.812+0000 7f3e336a9680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:36.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.812+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd3f80 con 0x7f3e18007030 2023-10-05T21:15:36.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.813+0000 7f3e25f80700 1 -- 172.21.15.153:0/1417361961 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e10006070 con 0x7f3e18007030 2023-10-05T21:15:36.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.813+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94600493351808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd54c0 con 0x7f3e18007030 2023-10-05T21:15:36.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.813+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd5d60 con 0x5609e4c9b9e0 2023-10-05T21:15:36.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.813+0000 7f3e25f80700 1 -- 172.21.15.153:0/1417361961 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94600493351808] v29'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e10006070 con 0x7f3e18007030 2023-10-05T21:15:36.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.814+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.814+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94600493357168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd61b0 con 0x5609e4c9b9e0 2023-10-05T21:15:36.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.814+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd6a50 con 0x5609e4ccd090 2023-10-05T21:15:36.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.814+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94600493357168] v29'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.814+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e18036070 con 0x5609e4ccd090 2023-10-05T21:15:36.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.814+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94600493358592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd6e50 con 0x5609e4ccd090 2023-10-05T21:15:36.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.814+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd7860 con 0x7f3e18007030 2023-10-05T21:15:36.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.815+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94600493358592] v29'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e18036070 con 0x5609e4ccd090 2023-10-05T21:15:36.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.815+0000 7f3e25f80700 1 -- 172.21.15.153:0/1417361961 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e10006070 con 0x7f3e18007030 2023-10-05T21:15:36.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.815+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94600493364080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd7c10 con 0x7f3e18007030 2023-10-05T21:15:36.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.815+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd8620 con 0x5609e4c9b9e0 2023-10-05T21:15:36.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.816+0000 7f3e25f80700 1 -- 172.21.15.153:0/1417361961 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94600493364080] v29'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e10006070 con 0x7f3e18007030 2023-10-05T21:15:36.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.816+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.816+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94600493367600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd8a70 con 0x5609e4c9b9e0 2023-10-05T21:15:36.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.816+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd9480 con 0x7f3e1000d3d0 2023-10-05T21:15:36.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.817+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94600493367600] v29'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.817+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e2000a570 con 0x7f3e1000d3d0 2023-10-05T21:15:36.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.817+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94600493369264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd9480 con 0x7f3e1000d3d0 2023-10-05T21:15:36.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.817+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd9e90 con 0x7f3e1000d3d0 2023-10-05T21:15:36.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.818+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(96 notify.6 [create] v29'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e2000a570 con 0x7f3e1000d3d0 2023-10-05T21:15:36.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.818+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94600493373856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cda2e0 con 0x7f3e1000d3d0 2023-10-05T21:15:36.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.818+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(95 notify.5 [watch watch cookie 94600493369264] v29'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e2000a570 con 0x7f3e1000d3d0 2023-10-05T21:15:36.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.818+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd8fd0 con 0x7f3e1000d3d0 2023-10-05T21:15:36.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.818+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94600493373856] v29'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e2000a570 con 0x7f3e1000d3d0 2023-10-05T21:15:36.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.818+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e2000a570 con 0x7f3e1000d3d0 2023-10-05T21:15:36.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.818+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94600493374960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cda240 con 0x7f3e1000d3d0 2023-10-05T21:15:36.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.818+0000 7f3e336a9680 20 add_watcher() i=0 2023-10-05T21:15:36.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.818+0000 7f3e336a9680 20 add_watcher() i=1 2023-10-05T21:15:36.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.818+0000 7f3e336a9680 20 add_watcher() i=2 2023-10-05T21:15:36.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.818+0000 7f3e336a9680 20 add_watcher() i=3 2023-10-05T21:15:36.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.818+0000 7f3e336a9680 20 add_watcher() i=4 2023-10-05T21:15:36.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.818+0000 7f3e336a9680 20 add_watcher() i=5 2023-10-05T21:15:36.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.818+0000 7f3e336a9680 20 add_watcher() i=6 2023-10-05T21:15:36.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.819+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94600493374960] v29'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e2000a570 con 0x7f3e1000d3d0 2023-10-05T21:15:36.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.819+0000 7f3e336a9680 20 add_watcher() i=7 2023-10-05T21:15:36.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.819+0000 7f3e336a9680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:36.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.819+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cdde90 con 0x5609e4c9b9e0 2023-10-05T21:15:36.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.820+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.820+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94600493377904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cdb2b0 con 0x5609e4c9b9e0 2023-10-05T21:15:36.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.820+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94600493377904] v29'199 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.820+0000 7f3df7fdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:36.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.820+0000 7f3e336a9680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:36.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.820+0000 7f3e336a9680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:36.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.821+0000 7f3e336a9680 1 Processor -- start 2023-10-05T21:15:36.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.821+0000 7f3e336a9680 1 -- start start 2023-10-05T21:15:36.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.821+0000 7f3e336a9680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5609e4ce79d0 0x5609e4ce7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.821+0000 7f3e336a9680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609e4ce83f0 con 0x5609e4ce79d0 2023-10-05T21:15:36.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.821+0000 7f3e25f80700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5609e4ce79d0 0x5609e4ce7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.821+0000 7f3e25f80700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5609e4ce79d0 0x5609e4ce7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57720/0 (socket says 172.21.15.153:57720) 2023-10-05T21:15:36.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.821+0000 7f3e25f80700 1 -- 172.21.15.153:0/1497179380 learned_addr learned my addr 172.21.15.153:0/1497179380 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:36.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.821+0000 7f3e25f80700 1 -- 172.21.15.153:0/1497179380 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609e4ce88d0 con 0x5609e4ce79d0 2023-10-05T21:15:36.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.821+0000 7f3e25f80700 1 --2- 172.21.15.153:0/1497179380 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5609e4ce79d0 0x5609e4ce7de0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x5609e4ccff00 tx=0x7f3e10006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7dcfb167a6085ea server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.822+0000 7f3df77de700 1 -- 172.21.15.153:0/1497179380 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e10023040 con 0x5609e4ce79d0 2023-10-05T21:15:36.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.822+0000 7f3df77de700 1 -- 172.21.15.153:0/1497179380 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e10024040 con 0x5609e4ce79d0 2023-10-05T21:15:36.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.822+0000 7f3df77de700 1 -- 172.21.15.153:0/1497179380 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e10013040 con 0x5609e4ce79d0 2023-10-05T21:15:36.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.822+0000 7f3e336a9680 1 -- 172.21.15.153:0/1497179380 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5609e4ce79d0 msgr2=0x5609e4ce7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.822+0000 7f3e336a9680 1 --2- 172.21.15.153:0/1497179380 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5609e4ce79d0 0x5609e4ce7de0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x5609e4ccff00 tx=0x7f3e10006000 comp rx=0 tx=0).stop 2023-10-05T21:15:36.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.822+0000 7f3e336a9680 1 -- 172.21.15.153:0/1497179380 shutdown_connections 2023-10-05T21:15:36.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.822+0000 7f3e336a9680 1 --2- 172.21.15.153:0/1497179380 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5609e4ce79d0 0x5609e4ce7de0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.822+0000 7f3e336a9680 1 -- 172.21.15.153:0/1497179380 >> 172.21.15.153:0/1497179380 conn(0x5609e4ce3cd0 msgr2=0x5609e4ce1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:36.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.822+0000 7f3e336a9680 1 -- 172.21.15.153:0/1497179380 shutdown_connections 2023-10-05T21:15:36.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.822+0000 7f3e336a9680 1 -- 172.21.15.153:0/1497179380 wait complete. 2023-10-05T21:15:36.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.823+0000 7f3e336a9680 1 Processor -- start 2023-10-05T21:15:36.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.823+0000 7f3e336a9680 1 -- start start 2023-10-05T21:15:36.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.823+0000 7f3e336a9680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5609e4ce79d0 0x5609e4cee760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.823+0000 7f3e336a9680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609e4ceeca0 con 0x5609e4ce79d0 2023-10-05T21:15:36.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.823+0000 7f3e25f80700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5609e4ce79d0 0x5609e4cee760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.823+0000 7f3e25f80700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5609e4ce79d0 0x5609e4cee760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57730/0 (socket says 172.21.15.153:57730) 2023-10-05T21:15:36.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.823+0000 7f3e25f80700 1 -- 172.21.15.153:0/2738102111 learned_addr learned my addr 172.21.15.153:0/2738102111 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:36.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.823+0000 7f3e25f80700 1 -- 172.21.15.153:0/2738102111 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609e4be3930 con 0x5609e4ce79d0 2023-10-05T21:15:36.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.823+0000 7f3e25f80700 1 --2- 172.21.15.153:0/2738102111 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5609e4ce79d0 0x5609e4cee760 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000b9a0 tx=0x7f3e10030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.824+0000 7f3df5fdb700 1 -- 172.21.15.153:0/2738102111 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e10023040 con 0x5609e4ce79d0 2023-10-05T21:15:36.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.824+0000 7f3df5fdb700 1 -- 172.21.15.153:0/2738102111 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1003be10 con 0x5609e4ce79d0 2023-10-05T21:15:36.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.824+0000 7f3e336a9680 1 -- 172.21.15.153:0/2738102111 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5609e4ceeea0 con 0x5609e4ce79d0 2023-10-05T21:15:36.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.824+0000 7f3df5fdb700 1 -- 172.21.15.153:0/2738102111 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e1001e420 con 0x5609e4ce79d0 2023-10-05T21:15:36.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.824+0000 7f3e336a9680 1 -- 172.21.15.153:0/2738102111 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5609e4cef2f0 con 0x5609e4ce79d0 2023-10-05T21:15:36.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.824+0000 7f3df5fdb700 1 -- 172.21.15.153:0/2738102111 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f3e1001e580 con 0x5609e4ce79d0 2023-10-05T21:15:36.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.825+0000 7f3df5fdb700 1 --2- 172.21.15.153:0/2738102111 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3d6c034140 0x7f3d6c0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.825+0000 7f3df5fdb700 1 -- 172.21.15.153:0/2738102111 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f3e1004fb00 con 0x5609e4ce79d0 2023-10-05T21:15:36.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.825+0000 7f3e336a9680 5 note: GC not initialized 2023-10-05T21:15:36.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.825+0000 7f3e26f82700 1 --2- 172.21.15.153:0/2738102111 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3d6c034140 0x7f3d6c0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.825+0000 7f3e26f82700 1 --2- 172.21.15.153:0/2738102111 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3d6c034140 0x7f3d6c0365f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x5609e4cda470 tx=0x7f3e20037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.826+0000 7f3d66ffd700 20 reqs_thread_entry: start 2023-10-05T21:15:36.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.826+0000 7f3d64ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:36.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.826+0000 7f3e336a9680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:36.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.826+0000 7f3e336a9680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:36.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.826+0000 7f3d56ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:16:07 2023 2023-10-05T21:15:36.860 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:36.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.826+0000 7f3d567fc700 20 reqs_thread_entry: start 2023-10-05T21:15:36.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.826+0000 7f3e336a9680 20 get_system_obj_state: rctx=0x7ffee7608ef0 obj=default.rgw.meta:root:myfoo state=0x5609e4b49240 s->prefetch_data=0 2023-10-05T21:15:36.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.826+0000 7f3e336a9680 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-10-05T21:15:36.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.826+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:102 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4d54800 con 0x7f3e18007030 2023-10-05T21:15:36.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.827+0000 7f3e25f80700 1 -- 172.21.15.153:0/1417361961 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(102 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv33 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f3e10006070 con 0x7f3e18007030 2023-10-05T21:15:36.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.827+0000 7f3e336a9680 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x16 2023-10-05T21:15:36.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.827+0000 7f3e336a9680 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:36.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.827+0000 7f3e336a9680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:36.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.827+0000 7f3e336a9680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:36.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.827+0000 7f3e336a9680 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x11, cached=0x16) 2023-10-05T21:15:36.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.827+0000 7f3e336a9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.827+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:103 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4d570c0 con 0x7f3e18007030 2023-10-05T21:15:36.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.827+0000 7f3e25f80700 1 -- 172.21.15.153:0/1417361961 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(103 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7f3e10006070 con 0x7f3e18007030 2023-10-05T21:15:36.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.827+0000 7f3e336a9680 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T21:15:36.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.827+0000 7f3e336a9680 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2023-10-05T21:15:36.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.827+0000 7f3e336a9680 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:36.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.827+0000 7f3e336a9680 20 get_system_obj_state: rctx=0x7ffee7608ef0 obj=default.rgw.meta:root:.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 state=0x5609e4b49500 s->prefetch_data=0 2023-10-05T21:15:36.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.827+0000 7f3e336a9680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 : miss 2023-10-05T21:15:36.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.827+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:104 8.e 8:7627b2dd:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4d56960 con 0x7f3e1000d3d0 2023-10-05T21:15:36.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.827+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(104 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f3e2000a570 con 0x7f3e1000d3d0 2023-10-05T21:15:36.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.827+0000 7f3e336a9680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 info.flags=0x16 2023-10-05T21:15:36.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.827+0000 7f3e336a9680 10 adding default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 to cache LRU end 2023-10-05T21:15:36.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.827+0000 7f3e336a9680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:36.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.827+0000 7f3e336a9680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:36.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.827+0000 7f3e336a9680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:36.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.827+0000 7f3e336a9680 20 Read xattr: user.rgw.acl 2023-10-05T21:15:36.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.827+0000 7f3e336a9680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:36.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.827+0000 7f3e336a9680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:36.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.827+0000 7f3e336a9680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.827+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:105 8.e 8:7627b2dd:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4d59780 con 0x7f3e1000d3d0 2023-10-05T21:15:36.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.828+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(105 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f3e2000a570 con 0x7f3e1000d3d0 2023-10-05T21:15:36.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.828+0000 7f3e336a9680 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T21:15:36.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.828+0000 7f3e336a9680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 info.flags=0x13 2023-10-05T21:15:36.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.828+0000 7f3e336a9680 10 moving default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 to cache LRU end 2023-10-05T21:15:36.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.828+0000 7f3e336a9680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:36.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.828+0000 7f3e336a9680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:36.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.828+0000 7f3e336a9680 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 2023-10-05T21:15:36.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.828+0000 7f3e336a9680 20 get_obj_state: rctx=0x7ffee76090f0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5609e4d5a0f8 s->prefetch_data=0 2023-10-05T21:15:36.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.828+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:106 3.2f 3:f67a3996:::193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4d52cb0 con 0x5609e4ccd090 2023-10-05T21:15:36.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.828+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(106 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=849b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 262+0+865 (crc 0 0 0) 0x7f3e18036070 con 0x5609e4ccd090 2023-10-05T21:15:36.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.828+0000 7f3e336a9680 10 manifest: total_size = 5 2023-10-05T21:15:36.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.828+0000 7f3e336a9680 20 get_obj_state: setting s->obj_tag to _mwXdNXGXRiXjgnZ4UdxhYEA5wnneQSu 2023-10-05T21:15:36.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.828+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:107 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94600493351808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4d58810 con 0x7f3e18007030 2023-10-05T21:15:36.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.829+0000 7f3e25f80700 1 -- 172.21.15.153:0/1417361961 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(107 notify.0 [watch unwatch cookie 94600493351808] v29'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e10006070 con 0x7f3e18007030 2023-10-05T21:15:36.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.829+0000 7f3e336a9680 20 remove_watcher() i=0 2023-10-05T21:15:36.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.829+0000 7f3e336a9680 2 removed watcher, disabling cache 2023-10-05T21:15:36.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.829+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:108 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94600493357168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4d58810 con 0x5609e4c9b9e0 2023-10-05T21:15:36.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.830+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(108 notify.1 [watch unwatch cookie 94600493357168] v29'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.830+0000 7f3e336a9680 20 remove_watcher() i=1 2023-10-05T21:15:36.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.830+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:109 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94600493358592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd5870 con 0x5609e4ccd090 2023-10-05T21:15:36.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.831+0000 7f3e26781700 1 -- 172.21.15.153:0/1417361961 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(109 notify.2 [watch unwatch cookie 94600493358592] v29'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e18036070 con 0x5609e4ccd090 2023-10-05T21:15:36.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.831+0000 7f3e336a9680 20 remove_watcher() i=2 2023-10-05T21:15:36.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.831+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:110 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94600493364080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4d58810 con 0x7f3e18007030 2023-10-05T21:15:36.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.831+0000 7f3e25f80700 1 -- 172.21.15.153:0/1417361961 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(110 notify.3 [watch unwatch cookie 94600493364080] v29'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e10054040 con 0x7f3e18007030 2023-10-05T21:15:36.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.831+0000 7f3e336a9680 20 remove_watcher() i=3 2023-10-05T21:15:36.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.831+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:111 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94600493367600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd5870 con 0x5609e4c9b9e0 2023-10-05T21:15:36.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.832+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(111 notify.4 [watch unwatch cookie 94600493367600] v29'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.832+0000 7f3e336a9680 20 remove_watcher() i=4 2023-10-05T21:15:36.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.832+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94600493369264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd7370 con 0x7f3e1000d3d0 2023-10-05T21:15:36.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.833+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(112 notify.5 [watch unwatch cookie 94600493369264] v29'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e2000a570 con 0x7f3e1000d3d0 2023-10-05T21:15:36.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.833+0000 7f3e336a9680 20 remove_watcher() i=5 2023-10-05T21:15:36.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.833+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:113 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94600493373856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4d58810 con 0x7f3e1000d3d0 2023-10-05T21:15:36.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.834+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(113 notify.6 [watch unwatch cookie 94600493373856] v29'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e2000a570 con 0x7f3e1000d3d0 2023-10-05T21:15:36.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.834+0000 7f3e336a9680 20 remove_watcher() i=6 2023-10-05T21:15:36.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.834+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:114 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94600493374960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd8130 con 0x7f3e1000d3d0 2023-10-05T21:15:36.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.834+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.0 v2:172.21.15.111:6800/111394 31 ==== osd_op_reply(114 notify.7 [watch unwatch cookie 94600493374960] v29'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e2000a570 con 0x7f3e1000d3d0 2023-10-05T21:15:36.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.834+0000 7f3e336a9680 20 remove_watcher() i=7 2023-10-05T21:15:36.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.835+0000 7f3df7fdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:36.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.835+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:115 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94600493377904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5609e4cd5870 con 0x5609e4c9b9e0 2023-10-05T21:15:36.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.836+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(115 data_loggenerations_metadata [watch unwatch cookie 94600493377904] v29'200 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3e2000a570 con 0x5609e4c9b9e0 2023-10-05T21:15:36.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.836+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f3e1000d3d0 msgr2=0x7f3e1000d820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.836+0000 7f3e336a9680 1 --2- 172.21.15.153:0/1417361961 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f3e1000d3d0 0x7f3e1000d820 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.836+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5609e4c9b9e0 msgr2=0x5609e4ccac20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.836+0000 7f3e336a9680 1 --2- 172.21.15.153:0/1417361961 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5609e4c9b9e0 0x5609e4ccac20 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.836+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f3e18007030 msgr2=0x7f3e180305e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.836+0000 7f3e336a9680 1 --2- 172.21.15.153:0/1417361961 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f3e18007030 0x7f3e180305e0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.836+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5609e4ccd090 msgr2=0x5609e4ccf470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.836+0000 7f3e336a9680 1 --2- 172.21.15.153:0/1417361961 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5609e4ccd090 0x5609e4ccf470 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.836+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3e08034130 msgr2=0x7f3e080365e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.836+0000 7f3e336a9680 1 --2- 172.21.15.153:0/1417361961 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3e08034130 0x7f3e080365e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3e10004170 tx=0x7f3e10001380 comp rx=0 tx=0).stop 2023-10-05T21:15:36.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.836+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5609e4c0a0b0 msgr2=0x5609e4cbee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.836+0000 7f3e336a9680 1 --2- 172.21.15.153:0/1417361961 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5609e4c0a0b0 0x5609e4cbee60 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3e1801f040 tx=0x7f3e1801d000 comp rx=0 tx=0).stop 2023-10-05T21:15:36.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.836+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 reap_dead start 2023-10-05T21:15:36.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.836+0000 7f3e26f82700 1 -- 172.21.15.153:0/1417361961 reap_dead start 2023-10-05T21:15:36.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.836+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 shutdown_connections 2023-10-05T21:15:36.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.836+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 >> 172.21.15.153:0/1417361961 conn(0x5609e4c90b90 msgr2=0x5609e4cb1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:36.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.836+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 shutdown_connections 2023-10-05T21:15:36.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.836+0000 7f3e336a9680 1 -- 172.21.15.153:0/1417361961 wait complete. 2023-10-05T21:15:36.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.837+0000 7f3e336a9680 1 -- 172.21.15.153:0/2738102111 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3d6c034140 msgr2=0x7f3d6c0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.837+0000 7f3e336a9680 1 --2- 172.21.15.153:0/2738102111 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3d6c034140 0x7f3d6c0365f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x5609e4cda470 tx=0x7f3e20037450 comp rx=0 tx=0).stop 2023-10-05T21:15:36.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.837+0000 7f3e336a9680 1 -- 172.21.15.153:0/2738102111 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5609e4ce79d0 msgr2=0x5609e4cee760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.837+0000 7f3e336a9680 1 --2- 172.21.15.153:0/2738102111 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5609e4ce79d0 0x5609e4cee760 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000b9a0 tx=0x7f3e10030000 comp rx=0 tx=0).stop 2023-10-05T21:15:36.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.837+0000 7f3e336a9680 1 -- 172.21.15.153:0/2738102111 shutdown_connections 2023-10-05T21:15:36.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.837+0000 7f3e336a9680 1 --2- 172.21.15.153:0/2738102111 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3d6c034140 0x7f3d6c0365f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.837+0000 7f3e336a9680 1 --2- 172.21.15.153:0/2738102111 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5609e4ce79d0 0x5609e4cee760 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.837+0000 7f3e336a9680 1 -- 172.21.15.153:0/2738102111 >> 172.21.15.153:0/2738102111 conn(0x5609e4ce3cd0 msgr2=0x5609e4ce1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:36.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.837+0000 7f3e336a9680 1 -- 172.21.15.153:0/2738102111 shutdown_connections 2023-10-05T21:15:36.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.837+0000 7f3e336a9680 1 -- 172.21.15.153:0/2738102111 wait complete. 2023-10-05T21:15:36.870 INFO:teuthology.orchestra.run.smithi153.stdout:fooFoofooFooFULL_CONTROL 2023-10-05T21:15:36.871 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2023-10-05T21:15:36.873 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2023-10-05T21:15:36.877 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T21:15:36.877 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2023-10-05T21:15:36.877 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2023-10-05T21:15:36.877 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2023-10-05T21:15:36.922 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:36.922 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:36.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.921+0000 7f4ae283a680 1 Processor -- start 2023-10-05T21:15:36.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.921+0000 7f4ae283a680 1 -- start start 2023-10-05T21:15:36.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.922+0000 7f4ae283a680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5641e15482c0 0x5641e15486d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.922+0000 7f4ae283a680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5641e1496930 con 0x5641e1548c10 2023-10-05T21:15:36.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.922+0000 7f4ae283a680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x5641e1456db0 con 0x5641e15482c0 2023-10-05T21:15:36.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.922+0000 7f4ad5912700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5641e15482c0 0x5641e15486d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.922+0000 7f4ad5912700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5641e15482c0 0x5641e15486d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57736/0 (socket says 172.21.15.153:57736) 2023-10-05T21:15:36.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.922+0000 7f4ad5111700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x5641e1548c10 0x5641e1549600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:39268/0 (socket says 172.21.15.153:39268) 2023-10-05T21:15:36.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.922+0000 7f4ad5912700 1 -- 172.21.15.153:0/3752580835 learned_addr learned my addr 172.21.15.153:0/3752580835 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:36.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.922+0000 7f4ad5912700 1 -- 172.21.15.153:0/3752580835 >> v1:172.21.15.111:6789/0 conn(0x5641e1548c10 legacy=0x5641e1549600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.922+0000 7f4ad5912700 1 -- 172.21.15.153:0/3752580835 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641e1549eb0 con 0x5641e15482c0 2023-10-05T21:15:36.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.922+0000 7f4ad5912700 1 --2- 172.21.15.153:0/3752580835 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e15482c0 0x5641e15486d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800a650 tx=0x7f4ac8005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f31525ac166c0f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.923+0000 7f4ad4910700 1 -- 172.21.15.153:0/3752580835 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ac8008760 con 0x5641e15482c0 2023-10-05T21:15:36.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.923+0000 7f4ad4910700 1 -- 172.21.15.153:0/3752580835 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac80088c0 con 0x5641e15482c0 2023-10-05T21:15:36.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.923+0000 7f4ad4910700 1 -- 172.21.15.153:0/3752580835 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ac8008bb0 con 0x5641e15482c0 2023-10-05T21:15:36.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.923+0000 7f4ae283a680 1 -- 172.21.15.153:0/3752580835 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e15482c0 msgr2=0x5641e15486d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.923+0000 7f4ae283a680 1 --2- 172.21.15.153:0/3752580835 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e15482c0 0x5641e15486d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800a650 tx=0x7f4ac8005b10 comp rx=0 tx=0).stop 2023-10-05T21:15:36.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.923+0000 7f4ae283a680 1 -- 172.21.15.153:0/3752580835 shutdown_connections 2023-10-05T21:15:36.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.923+0000 7f4ae283a680 1 --2- 172.21.15.153:0/3752580835 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e15482c0 0x5641e15486d0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.923+0000 7f4ae283a680 1 -- 172.21.15.153:0/3752580835 >> 172.21.15.153:0/3752580835 conn(0x5641e1543b90 msgr2=0x5641e1545fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:36.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.923+0000 7f4ae283a680 1 -- 172.21.15.153:0/3752580835 shutdown_connections 2023-10-05T21:15:36.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.923+0000 7f4ae283a680 1 -- 172.21.15.153:0/3752580835 wait complete. 2023-10-05T21:15:36.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.924+0000 7f4ae283a680 1 Processor -- start 2023-10-05T21:15:36.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.924+0000 7f4ae283a680 1 -- start start 2023-10-05T21:15:36.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.924+0000 7f4ae283a680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e15482c0 0x5641e14bcff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.924+0000 7f4ae283a680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641e13f6ea0 con 0x5641e15482c0 2023-10-05T21:15:36.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.924+0000 7f4ad5912700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e15482c0 0x5641e14bcff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.924+0000 7f4ad5912700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e15482c0 0x5641e14bcff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57744/0 (socket says 172.21.15.153:57744) 2023-10-05T21:15:36.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.924+0000 7f4ad5912700 1 -- 172.21.15.153:0/1344895682 learned_addr learned my addr 172.21.15.153:0/1344895682 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:36.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.924+0000 7f4ad5912700 1 -- 172.21.15.153:0/1344895682 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac8005db0 con 0x5641e15482c0 2023-10-05T21:15:36.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.925+0000 7f4ad5912700 1 --2- 172.21.15.153:0/1344895682 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e15482c0 0x5641e14bcff0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8005b50 tx=0x7f4ac8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecdb62443ab6f8bf server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.925+0000 7f4ac77fe700 1 -- 172.21.15.153:0/1344895682 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ac80055f0 con 0x5641e15482c0 2023-10-05T21:15:36.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.925+0000 7f4ac77fe700 1 -- 172.21.15.153:0/1344895682 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac8008a30 con 0x5641e15482c0 2023-10-05T21:15:36.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.925+0000 7f4ac77fe700 1 -- 172.21.15.153:0/1344895682 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ac8008ce0 con 0x5641e15482c0 2023-10-05T21:15:36.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.925+0000 7f4ae283a680 1 -- 172.21.15.153:0/1344895682 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e15482c0 msgr2=0x5641e14bcff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.925+0000 7f4ae283a680 1 --2- 172.21.15.153:0/1344895682 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e15482c0 0x5641e14bcff0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8005b50 tx=0x7f4ac8015000 comp rx=0 tx=0).stop 2023-10-05T21:15:36.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.925+0000 7f4ae283a680 1 -- 172.21.15.153:0/1344895682 shutdown_connections 2023-10-05T21:15:36.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.925+0000 7f4ae283a680 1 --2- 172.21.15.153:0/1344895682 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e15482c0 0x5641e14bcff0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.925+0000 7f4ae283a680 1 -- 172.21.15.153:0/1344895682 >> 172.21.15.153:0/1344895682 conn(0x5641e1543b90 msgr2=0x5641e1563310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:36.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.925+0000 7f4ae283a680 1 -- 172.21.15.153:0/1344895682 shutdown_connections 2023-10-05T21:15:36.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.925+0000 7f4ae283a680 1 -- 172.21.15.153:0/1344895682 wait complete. 2023-10-05T21:15:36.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.925+0000 7f4ae283a680 1 Processor -- start 2023-10-05T21:15:36.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.925+0000 7f4ae283a680 1 -- start start 2023-10-05T21:15:36.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.926+0000 7f4ae283a680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e15482c0 0x5641e156fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.926+0000 7f4ae283a680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641e13edc80 con 0x5641e15482c0 2023-10-05T21:15:36.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.926+0000 7f4ad5912700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e15482c0 0x5641e156fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.926+0000 7f4ad5912700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e15482c0 0x5641e156fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57758/0 (socket says 172.21.15.153:57758) 2023-10-05T21:15:36.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.926+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 learned_addr learned my addr 172.21.15.153:0/1299460200 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:36.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.926+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641e1549eb0 con 0x5641e15482c0 2023-10-05T21:15:36.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.926+0000 7f4ad5912700 1 --2- 172.21.15.153:0/1299460200 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e15482c0 0x5641e156fcd0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8020040 tx=0x7f4ac801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.927+0000 7f4ac5ffb700 1 -- 172.21.15.153:0/1299460200 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ac8026b50 con 0x5641e15482c0 2023-10-05T21:15:36.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.927+0000 7f4ac5ffb700 1 -- 172.21.15.153:0/1299460200 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac8026cb0 con 0x5641e15482c0 2023-10-05T21:15:36.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.927+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5641e1570210 con 0x5641e15482c0 2023-10-05T21:15:36.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.927+0000 7f4ac5ffb700 1 -- 172.21.15.153:0/1299460200 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ac802f480 con 0x5641e15482c0 2023-10-05T21:15:36.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.927+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5641e15706c0 con 0x5641e15482c0 2023-10-05T21:15:36.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.927+0000 7f4ac5ffb700 1 -- 172.21.15.153:0/1299460200 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f4ac802f5e0 con 0x5641e15482c0 2023-10-05T21:15:36.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.928+0000 7f4ae283a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.928+0000 7f4ac5ffb700 1 --2- 172.21.15.153:0/1299460200 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4ab8034130 0x7f4ab80365e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.928+0000 7f4ac5ffb700 1 -- 172.21.15.153:0/1299460200 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f4ac804a4d0 con 0x5641e15482c0 2023-10-05T21:15:36.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.928+0000 7f4ad5111700 1 --2- 172.21.15.153:0/1299460200 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4ab8034130 0x7f4ab80365e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.928+0000 7f4ae283a680 1 --2- 172.21.15.153:0/1299460200 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5641e1579a60 0x5641e157be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.928+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e157c5d0 con 0x5641e1579a60 2023-10-05T21:15:36.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.928+0000 7f4ad6113700 1 --2- 172.21.15.153:0/1299460200 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5641e1579a60 0x5641e157be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.928+0000 7f4ad5111700 1 --2- 172.21.15.153:0/1299460200 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4ab8034130 0x7f4ab80365e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4acc001e70 tx=0x7f4acc001390 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.928+0000 7f4ad6113700 1 --2- 172.21.15.153:0/1299460200 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5641e1579a60 0x5641e157be40 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.929+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.929+0000 7f4ae283a680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.929+0000 7f4ae283a680 20 realm 2023-10-05T21:15:36.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.929+0000 7f4ae283a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.929+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15790d0 con 0x5641e1579a60 2023-10-05T21:15:36.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.929+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.929+0000 7f4ae283a680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.929+0000 7f4ae283a680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:36.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.929+0000 7f4ae283a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.929+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e157d080 con 0x5641e1579a60 2023-10-05T21:15:36.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.929+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.929+0000 7f4ae283a680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.929+0000 7f4ae283a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.929+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e157d9a0 con 0x5641e1579a60 2023-10-05T21:15:36.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.929+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.929+0000 7f4ae283a680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:36.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.929+0000 7f4ae283a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.929+0000 7f4ae283a680 1 --2- 172.21.15.153:0/1299460200 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5641e157e260 0x5641e1580640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.929+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1580c90 con 0x5641e157e260 2023-10-05T21:15:36.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.929+0000 7f4ad5912700 1 --2- 172.21.15.153:0/1299460200 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5641e157e260 0x5641e1580640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.930+0000 7f4ad5912700 1 --2- 172.21.15.153:0/1299460200 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5641e157e260 0x5641e1580640 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.930+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f4ac8019040 con 0x5641e157e260 2023-10-05T21:15:36.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.930+0000 7f4ae283a680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:36.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.930+0000 7f4ae283a680 20 searching for the correct realm 2023-10-05T21:15:36.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.930+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1582540 con 0x5641e157e260 2023-10-05T21:15:36.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.930+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ac8019040 con 0x5641e157e260 2023-10-05T21:15:36.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.930+0000 7f4ad5912700 1 --2- 172.21.15.153:0/1299460200 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4ac8007030 0x7f4ac8048100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.930+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1582540 con 0x7f4ac8007030 2023-10-05T21:15:36.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.930+0000 7f4ad5111700 1 --2- 172.21.15.153:0/1299460200 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4ac8007030 0x7f4ac8048100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.931+0000 7f4ad5111700 1 --2- 172.21.15.153:0/1299460200 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4ac8007030 0x7f4ac8048100 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.931+0000 7f4ad5111700 1 -- 172.21.15.153:0/1299460200 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4acc00f560 con 0x7f4ac8007030 2023-10-05T21:15:36.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.931+0000 7f4ad5111700 1 --2- 172.21.15.153:0/1299460200 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4acc00e8c0 0x7f4acc00d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.931+0000 7f4ad5111700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1582540 con 0x7f4acc00e8c0 2023-10-05T21:15:36.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.931+0000 7f4ad6113700 1 --2- 172.21.15.153:0/1299460200 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4acc00e8c0 0x7f4acc00d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.931+0000 7f4ad6113700 1 --2- 172.21.15.153:0/1299460200 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4acc00e8c0 0x7f4acc00d310 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.932+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ad000a570 con 0x7f4acc00e8c0 2023-10-05T21:15:36.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.932+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1582540 con 0x5641e1579a60 2023-10-05T21:15:36.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.932+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.932+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1582540 con 0x5641e1579a60 2023-10-05T21:15:36.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.932+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.932+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1582540 con 0x7f4acc00e8c0 2023-10-05T21:15:36.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.932+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ad000a570 con 0x7f4acc00e8c0 2023-10-05T21:15:36.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.932+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1582540 con 0x7f4acc00e8c0 2023-10-05T21:15:36.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.932+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ad000a570 con 0x7f4acc00e8c0 2023-10-05T21:15:36.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.932+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1582540 con 0x7f4ac8007030 2023-10-05T21:15:36.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.933+0000 7f4ad5111700 1 -- 172.21.15.153:0/1299460200 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4acc00f560 con 0x7f4ac8007030 2023-10-05T21:15:36.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.933+0000 7f4ad5111700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1582540 con 0x5641e157e260 2023-10-05T21:15:36.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.933+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4ac8019040 con 0x5641e157e260 2023-10-05T21:15:36.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.933+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1582540 con 0x5641e1579a60 2023-10-05T21:15:36.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.933+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.933+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1582540 con 0x7f4acc00e8c0 2023-10-05T21:15:36.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.933+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ad000a570 con 0x7f4acc00e8c0 2023-10-05T21:15:36.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.933+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1582540 con 0x5641e1579a60 2023-10-05T21:15:36.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.934+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.934+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1582540 con 0x7f4ac8007030 2023-10-05T21:15:36.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.934+0000 7f4ad5111700 1 -- 172.21.15.153:0/1299460200 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4acc00f560 con 0x7f4ac8007030 2023-10-05T21:15:36.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.934+0000 7f4ad5111700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f4acc01f040 con 0x5641e157e260 2023-10-05T21:15:36.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.934+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ac8019040 con 0x5641e157e260 2023-10-05T21:15:36.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.934+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f4acc01f040 con 0x5641e157e260 2023-10-05T21:15:36.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.934+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ac8019040 con 0x5641e157e260 2023-10-05T21:15:36.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.934+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f4acc01f040 con 0x7f4acc00e8c0 2023-10-05T21:15:36.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.934+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ad000a570 con 0x7f4acc00e8c0 2023-10-05T21:15:36.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.934+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f4acc01f040 con 0x5641e157e260 2023-10-05T21:15:36.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.935+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ac8019040 con 0x5641e157e260 2023-10-05T21:15:36.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.935+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f4acc01f040 con 0x5641e157e260 2023-10-05T21:15:36.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.935+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ac8019040 con 0x5641e157e260 2023-10-05T21:15:36.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.935+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f4acc01f040 con 0x5641e1579a60 2023-10-05T21:15:36.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.935+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.935+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f4acc01f040 con 0x5641e1579a60 2023-10-05T21:15:36.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.935+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.935+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f4acc01f040 con 0x7f4acc00e8c0 2023-10-05T21:15:36.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.936+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ad000a570 con 0x7f4acc00e8c0 2023-10-05T21:15:36.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.936+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f4acc01f040 con 0x5641e157e260 2023-10-05T21:15:36.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.936+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ac8019040 con 0x5641e157e260 2023-10-05T21:15:36.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.936+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f4acc01f040 con 0x7f4ac8007030 2023-10-05T21:15:36.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.936+0000 7f4ad5111700 1 -- 172.21.15.153:0/1299460200 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4acc00f560 con 0x7f4ac8007030 2023-10-05T21:15:36.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.936+0000 7f4ad5111700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f4acc01f040 con 0x5641e1579a60 2023-10-05T21:15:36.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.936+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.936+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f4acc01f040 con 0x7f4acc00e8c0 2023-10-05T21:15:36.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.937+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ad000a570 con 0x7f4acc00e8c0 2023-10-05T21:15:36.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.937+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f4acc01f040 con 0x5641e157e260 2023-10-05T21:15:36.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.937+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ac8019040 con 0x5641e157e260 2023-10-05T21:15:36.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.937+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f4acc01f040 con 0x7f4acc00e8c0 2023-10-05T21:15:36.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.937+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ad000a570 con 0x7f4acc00e8c0 2023-10-05T21:15:36.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.937+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f4acc01f040 con 0x7f4ac8007030 2023-10-05T21:15:36.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.938+0000 7f4ad5111700 1 -- 172.21.15.153:0/1299460200 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4acc00f560 con 0x7f4ac8007030 2023-10-05T21:15:36.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.938+0000 7f4ad5111700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f4acc01f040 con 0x5641e157e260 2023-10-05T21:15:36.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.938+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ac8019040 con 0x5641e157e260 2023-10-05T21:15:36.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.938+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f4acc01f040 con 0x7f4acc00e8c0 2023-10-05T21:15:36.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.938+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ad000a570 con 0x7f4acc00e8c0 2023-10-05T21:15:36.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.938+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f4acc01f040 con 0x5641e1579a60 2023-10-05T21:15:36.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.938+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.938+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f4acc01f040 con 0x7f4ac8007030 2023-10-05T21:15:36.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.938+0000 7f4ad5111700 1 -- 172.21.15.153:0/1299460200 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4acc00f560 con 0x7f4ac8007030 2023-10-05T21:15:36.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.938+0000 7f4ae283a680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:36.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.938+0000 7f4ae283a680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:36.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.938+0000 7f4ae283a680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:36.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.938+0000 7f4ae283a680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:36.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.939+0000 7f4ae283a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.939+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1581660 con 0x5641e1579a60 2023-10-05T21:15:36.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.939+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.939+0000 7f4ae283a680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.939+0000 7f4ae283a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.939+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1581f50 con 0x5641e1579a60 2023-10-05T21:15:36.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.939+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.939+0000 7f4ae283a680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:36.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.939+0000 7f4ae283a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.939+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15828f0 con 0x5641e1579a60 2023-10-05T21:15:36.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.939+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.939+0000 7f4ae283a680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:36.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.939+0000 7f4ae283a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.939+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1582ca0 con 0x5641e157e260 2023-10-05T21:15:36.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.939+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f4ac8019040 con 0x5641e157e260 2023-10-05T21:15:36.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.939+0000 7f4ae283a680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.940+0000 7f4ae283a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.940+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1583050 con 0x5641e1579a60 2023-10-05T21:15:36.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.940+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.940+0000 7f4ae283a680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.940+0000 7f4ae283a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.940+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1583050 con 0x5641e1579a60 2023-10-05T21:15:36.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.940+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.940+0000 7f4ae283a680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:36.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.940+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1583050 con 0x5641e157e260 2023-10-05T21:15:36.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.940+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ac8019040 con 0x5641e157e260 2023-10-05T21:15:36.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.940+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1583050 con 0x7f4ac8007030 2023-10-05T21:15:36.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.940+0000 7f4ad5111700 1 -- 172.21.15.153:0/1299460200 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4acc00f560 con 0x7f4ac8007030 2023-10-05T21:15:36.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.940+0000 7f4ad5111700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1583050 con 0x7f4acc00e8c0 2023-10-05T21:15:36.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.941+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ad000a570 con 0x7f4acc00e8c0 2023-10-05T21:15:36.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.941+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15828f0 con 0x5641e1579a60 2023-10-05T21:15:36.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.941+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.941+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15828f0 con 0x5641e1579a60 2023-10-05T21:15:36.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.941+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.941+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15828f0 con 0x7f4acc00e8c0 2023-10-05T21:15:36.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.941+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ad000a570 con 0x7f4acc00e8c0 2023-10-05T21:15:36.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.941+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15828f0 con 0x7f4acc00e8c0 2023-10-05T21:15:36.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.942+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ad000a570 con 0x7f4acc00e8c0 2023-10-05T21:15:36.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.942+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15828f0 con 0x7f4ac8007030 2023-10-05T21:15:36.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.942+0000 7f4ad5111700 1 -- 172.21.15.153:0/1299460200 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4acc00f560 con 0x7f4ac8007030 2023-10-05T21:15:36.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.942+0000 7f4ad5111700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15828f0 con 0x5641e157e260 2023-10-05T21:15:36.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.942+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4ac8019040 con 0x5641e157e260 2023-10-05T21:15:36.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.942+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15828f0 con 0x5641e1579a60 2023-10-05T21:15:36.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.942+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.942+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15828f0 con 0x7f4acc00e8c0 2023-10-05T21:15:36.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.942+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ad000a570 con 0x7f4acc00e8c0 2023-10-05T21:15:36.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.942+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15828f0 con 0x5641e1579a60 2023-10-05T21:15:36.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.943+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.943+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15828f0 con 0x7f4ac8007030 2023-10-05T21:15:36.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.943+0000 7f4ad5111700 1 -- 172.21.15.153:0/1299460200 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4acc00f560 con 0x7f4ac8007030 2023-10-05T21:15:36.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.943+0000 7f4ad5111700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15828f0 con 0x5641e157e260 2023-10-05T21:15:36.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.943+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ac8019040 con 0x5641e157e260 2023-10-05T21:15:36.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.943+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15828f0 con 0x5641e157e260 2023-10-05T21:15:36.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.943+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ac8019040 con 0x5641e157e260 2023-10-05T21:15:36.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.943+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15828f0 con 0x7f4acc00e8c0 2023-10-05T21:15:36.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.943+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ad000a570 con 0x7f4acc00e8c0 2023-10-05T21:15:36.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.944+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15828f0 con 0x5641e157e260 2023-10-05T21:15:36.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.944+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ac8019040 con 0x5641e157e260 2023-10-05T21:15:36.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.944+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15828f0 con 0x5641e157e260 2023-10-05T21:15:36.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.944+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ac8019040 con 0x5641e157e260 2023-10-05T21:15:36.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.944+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15828f0 con 0x5641e1579a60 2023-10-05T21:15:36.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.944+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.944+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15828f0 con 0x5641e1579a60 2023-10-05T21:15:36.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.944+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.944+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15828f0 con 0x7f4acc00e8c0 2023-10-05T21:15:36.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.945+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ad000a570 con 0x7f4acc00e8c0 2023-10-05T21:15:36.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.945+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15828f0 con 0x5641e157e260 2023-10-05T21:15:36.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.945+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ac8019040 con 0x5641e157e260 2023-10-05T21:15:36.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.945+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15828f0 con 0x7f4ac8007030 2023-10-05T21:15:36.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.945+0000 7f4ad5111700 1 -- 172.21.15.153:0/1299460200 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4acc00f560 con 0x7f4ac8007030 2023-10-05T21:15:36.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.945+0000 7f4ad5111700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15828f0 con 0x5641e1579a60 2023-10-05T21:15:36.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.945+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.945+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15828f0 con 0x7f4acc00e8c0 2023-10-05T21:15:36.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.946+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ad000a570 con 0x7f4acc00e8c0 2023-10-05T21:15:36.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.946+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15828f0 con 0x5641e157e260 2023-10-05T21:15:36.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.946+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ac8019040 con 0x5641e157e260 2023-10-05T21:15:36.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.946+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15828f0 con 0x7f4acc00e8c0 2023-10-05T21:15:36.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.946+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ad000a570 con 0x7f4acc00e8c0 2023-10-05T21:15:36.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.946+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15828f0 con 0x7f4ac8007030 2023-10-05T21:15:36.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.946+0000 7f4ad5111700 1 -- 172.21.15.153:0/1299460200 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4acc00f560 con 0x7f4ac8007030 2023-10-05T21:15:36.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.946+0000 7f4ad5111700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15828f0 con 0x5641e157e260 2023-10-05T21:15:36.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.947+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ac8019040 con 0x5641e157e260 2023-10-05T21:15:36.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.947+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15828f0 con 0x7f4acc00e8c0 2023-10-05T21:15:36.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.947+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ad000a570 con 0x7f4acc00e8c0 2023-10-05T21:15:36.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.947+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15828f0 con 0x5641e1579a60 2023-10-05T21:15:36.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.947+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.947+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15828f0 con 0x7f4ac8007030 2023-10-05T21:15:36.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.947+0000 7f4ad5111700 1 -- 172.21.15.153:0/1299460200 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4acc00f560 con 0x7f4ac8007030 2023-10-05T21:15:36.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.947+0000 7f4ae283a680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:36.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.947+0000 7f4ae283a680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:36.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.947+0000 7f4ae283a680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:36.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.947+0000 7f4ae283a680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:36.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.947+0000 7f4ae283a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.948+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1583050 con 0x5641e1579a60 2023-10-05T21:15:36.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.948+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.948+0000 7f4ae283a680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:36.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.948+0000 7f4ae283a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.948+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1583450 con 0x5641e157e260 2023-10-05T21:15:36.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.948+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f4ac8019040 con 0x5641e157e260 2023-10-05T21:15:36.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.948+0000 7f4ae283a680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:36.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.948+0000 7f4ae283a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.948+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1583d40 con 0x5641e1579a60 2023-10-05T21:15:36.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.948+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.948+0000 7f4ae283a680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:36.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.948+0000 7f4ae283a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.948+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1583d40 con 0x5641e1579a60 2023-10-05T21:15:36.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.948+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.948+0000 7f4ae283a680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:36.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.949+0000 7f4ae283a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.949+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1583d40 con 0x7f4acc00e8c0 2023-10-05T21:15:36.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.949+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f4ad000a570 con 0x7f4acc00e8c0 2023-10-05T21:15:36.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.949+0000 7f4ae283a680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.949+0000 7f4ae283a680 20 zone default found 2023-10-05T21:15:36.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.949+0000 7f4ae283a680 4 Realm: () 2023-10-05T21:15:36.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.949+0000 7f4ae283a680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:36.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.949+0000 7f4ae283a680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:36.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.949+0000 7f4ae283a680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:36.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.949+0000 7f4ae283a680 20 zonegroup default 2023-10-05T21:15:36.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.949+0000 7f4ae283a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.949+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1583d40 con 0x7f4acc00e8c0 2023-10-05T21:15:36.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.949+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4ad000a570 con 0x7f4acc00e8c0 2023-10-05T21:15:36.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.949+0000 7f4ae283a680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.949+0000 7f4ae283a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.949+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1583850 con 0x5641e157e260 2023-10-05T21:15:36.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.949+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4ac8019040 con 0x5641e157e260 2023-10-05T21:15:36.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.949+0000 7f4ae283a680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.949+0000 7f4ae283a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.949+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1583c70 con 0x5641e157e260 2023-10-05T21:15:36.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.950+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4ac8019040 con 0x5641e157e260 2023-10-05T21:15:36.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.950+0000 7f4ae283a680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:36.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.950+0000 7f4ae283a680 20 started sync module instance, tier type = 2023-10-05T21:15:36.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.950+0000 7f4ae283a680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:36.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.950+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1568990 con 0x7f4ac8007030 2023-10-05T21:15:36.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.950+0000 7f4ad5111700 1 -- 172.21.15.153:0/1299460200 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4acc00f560 con 0x7f4ac8007030 2023-10-05T21:15:36.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.950+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94840953408912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e15691e0 con 0x7f4ac8007030 2023-10-05T21:15:36.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.950+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1588f70 con 0x5641e1579a60 2023-10-05T21:15:36.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.951+0000 7f4ad5111700 1 -- 172.21.15.153:0/1299460200 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94840953408912] v29'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4acc00f560 con 0x7f4ac8007030 2023-10-05T21:15:36.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.951+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.951+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94840953537936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1588f90 con 0x5641e1579a60 2023-10-05T21:15:36.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.951+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1589b70 con 0x5641e157e260 2023-10-05T21:15:36.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.952+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94840953537936] v29'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.952+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ac8019040 con 0x5641e157e260 2023-10-05T21:15:36.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.952+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94840953542176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1589b30 con 0x5641e157e260 2023-10-05T21:15:36.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.952+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e158a5d0 con 0x7f4ac8007030 2023-10-05T21:15:36.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.953+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94840953542176] v29'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ac8019040 con 0x5641e157e260 2023-10-05T21:15:36.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.953+0000 7f4ad5111700 1 -- 172.21.15.153:0/1299460200 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4acc00f560 con 0x7f4ac8007030 2023-10-05T21:15:36.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.953+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94840953544928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e158a980 con 0x7f4ac8007030 2023-10-05T21:15:36.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.953+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e158b390 con 0x5641e1579a60 2023-10-05T21:15:36.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.953+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.954+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94840953549008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e158bb90 con 0x5641e1579a60 2023-10-05T21:15:36.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.954+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e158c770 con 0x7f4acc00e8c0 2023-10-05T21:15:36.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.954+0000 7f4ad5111700 1 -- 172.21.15.153:0/1299460200 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94840953544928] v29'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4acc00f560 con 0x7f4ac8007030 2023-10-05T21:15:36.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.954+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94840953549008] v29'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.954+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ad000a570 con 0x7f4acc00e8c0 2023-10-05T21:15:36.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.954+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94840953553440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e158c730 con 0x7f4acc00e8c0 2023-10-05T21:15:36.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.954+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e158b710 con 0x7f4acc00e8c0 2023-10-05T21:15:36.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.955+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94840953553440] v29'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ad000a570 con 0x7f4acc00e8c0 2023-10-05T21:15:36.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.955+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ad000a570 con 0x7f4acc00e8c0 2023-10-05T21:15:36.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.955+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94840953554736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e158d070 con 0x7f4acc00e8c0 2023-10-05T21:15:36.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.955+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e158da80 con 0x7f4acc00e8c0 2023-10-05T21:15:36.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.956+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94840953554736] v29'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ad000a570 con 0x7f4acc00e8c0 2023-10-05T21:15:36.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.956+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ad000a570 con 0x7f4acc00e8c0 2023-10-05T21:15:36.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.956+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94840953556400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e158da80 con 0x7f4acc00e8c0 2023-10-05T21:15:36.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.956+0000 7f4ae283a680 20 add_watcher() i=0 2023-10-05T21:15:36.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.956+0000 7f4ae283a680 20 add_watcher() i=1 2023-10-05T21:15:36.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.956+0000 7f4ae283a680 20 add_watcher() i=2 2023-10-05T21:15:36.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.956+0000 7f4ae283a680 20 add_watcher() i=3 2023-10-05T21:15:36.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.956+0000 7f4ae283a680 20 add_watcher() i=4 2023-10-05T21:15:36.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.956+0000 7f4ae283a680 20 add_watcher() i=5 2023-10-05T21:15:36.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.956+0000 7f4ae283a680 20 add_watcher() i=6 2023-10-05T21:15:36.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.957+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94840953556400] v29'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ad000a570 con 0x7f4acc00e8c0 2023-10-05T21:15:36.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.957+0000 7f4ae283a680 20 add_watcher() i=7 2023-10-05T21:15:36.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.957+0000 7f4ae283a680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:36.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.957+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1590d10 con 0x5641e1579a60 2023-10-05T21:15:36.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.957+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.957+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94840953558784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e158e040 con 0x5641e1579a60 2023-10-05T21:15:36.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.958+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94840953558784] v29'201 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.958+0000 7f4aa6fe5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:36.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.958+0000 7f4ae283a680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:36.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.958+0000 7f4ae283a680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:36.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.958+0000 7f4ae283a680 1 Processor -- start 2023-10-05T21:15:36.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.958+0000 7f4ae283a680 1 -- start start 2023-10-05T21:15:36.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.958+0000 7f4ae283a680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e159aa30 0x5641e159ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.958+0000 7f4ae283a680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641e159b450 con 0x5641e159aa30 2023-10-05T21:15:36.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.959+0000 7f4ad5111700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e159aa30 0x5641e159ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.959+0000 7f4ad5111700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e159aa30 0x5641e159ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57766/0 (socket says 172.21.15.153:57766) 2023-10-05T21:15:36.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.959+0000 7f4ad5111700 1 -- 172.21.15.153:0/2191776122 learned_addr learned my addr 172.21.15.153:0/2191776122 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:36.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.959+0000 7f4ad5111700 1 -- 172.21.15.153:0/2191776122 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641e159b930 con 0x5641e159aa30 2023-10-05T21:15:36.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.959+0000 7f4ad5111700 1 --2- 172.21.15.153:0/2191776122 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e159aa30 0x5641e159ae40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x5641e157d630 tx=0x7f4acc006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a815078358eeee77 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.959+0000 7f4aa67e4700 1 -- 172.21.15.153:0/2191776122 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4acc00da60 con 0x5641e159aa30 2023-10-05T21:15:36.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.959+0000 7f4aa67e4700 1 -- 172.21.15.153:0/2191776122 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4acc00dbc0 con 0x5641e159aa30 2023-10-05T21:15:36.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.959+0000 7f4aa67e4700 1 -- 172.21.15.153:0/2191776122 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4acc00dd70 con 0x5641e159aa30 2023-10-05T21:15:36.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.960+0000 7f4ae283a680 1 -- 172.21.15.153:0/2191776122 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e159aa30 msgr2=0x5641e159ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:36.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.960+0000 7f4ae283a680 1 --2- 172.21.15.153:0/2191776122 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e159aa30 0x5641e159ae40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x5641e157d630 tx=0x7f4acc006000 comp rx=0 tx=0).stop 2023-10-05T21:15:36.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.960+0000 7f4ae283a680 1 -- 172.21.15.153:0/2191776122 shutdown_connections 2023-10-05T21:15:36.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.960+0000 7f4ae283a680 1 --2- 172.21.15.153:0/2191776122 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e159aa30 0x5641e159ae40 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:36.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.960+0000 7f4ae283a680 1 -- 172.21.15.153:0/2191776122 >> 172.21.15.153:0/2191776122 conn(0x5641e1596d30 msgr2=0x5641e1594e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:36.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.960+0000 7f4ae283a680 1 -- 172.21.15.153:0/2191776122 shutdown_connections 2023-10-05T21:15:36.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.960+0000 7f4ae283a680 1 -- 172.21.15.153:0/2191776122 wait complete. 2023-10-05T21:15:36.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.960+0000 7f4ae283a680 1 Processor -- start 2023-10-05T21:15:36.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.961+0000 7f4ae283a680 1 -- start start 2023-10-05T21:15:36.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.961+0000 7f4ae283a680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e159aa30 0x5641e15a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.961+0000 7f4ae283a680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641e15a1c90 con 0x5641e159aa30 2023-10-05T21:15:36.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.961+0000 7f4ad5111700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e159aa30 0x5641e15a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.961+0000 7f4ad5111700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e159aa30 0x5641e15a1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57770/0 (socket says 172.21.15.153:57770) 2023-10-05T21:15:36.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.961+0000 7f4ad5111700 1 -- 172.21.15.153:0/2611823726 learned_addr learned my addr 172.21.15.153:0/2611823726 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:36.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.961+0000 7f4ad5111700 1 -- 172.21.15.153:0/2611823726 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4acc006070 con 0x5641e159aa30 2023-10-05T21:15:36.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.962+0000 7f4ad5111700 1 --2- 172.21.15.153:0/2611823726 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e159aa30 0x5641e15a1750 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4acc001810 tx=0x7f4acc032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.962+0000 7f4aa4fe1700 1 -- 172.21.15.153:0/2611823726 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4acc03d9f0 con 0x5641e159aa30 2023-10-05T21:15:36.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.962+0000 7f4aa4fe1700 1 -- 172.21.15.153:0/2611823726 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4acc03db70 con 0x5641e159aa30 2023-10-05T21:15:36.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.962+0000 7f4ae283a680 1 -- 172.21.15.153:0/2611823726 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5641e15a1e90 con 0x5641e159aa30 2023-10-05T21:15:36.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.962+0000 7f4aa4fe1700 1 -- 172.21.15.153:0/2611823726 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4acc03dd60 con 0x5641e159aa30 2023-10-05T21:15:36.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.962+0000 7f4ae283a680 1 -- 172.21.15.153:0/2611823726 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5641e15a22e0 con 0x5641e159aa30 2023-10-05T21:15:36.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.962+0000 7f4aa4fe1700 1 -- 172.21.15.153:0/2611823726 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f4acc01a040 con 0x5641e159aa30 2023-10-05T21:15:36.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.963+0000 7f4aa4fe1700 1 --2- 172.21.15.153:0/2611823726 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4a1c034140 0x7f4a1c0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:36.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.963+0000 7f4aa4fe1700 1 -- 172.21.15.153:0/2611823726 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f4acc048b30 con 0x5641e159aa30 2023-10-05T21:15:36.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.963+0000 7f4ad6113700 1 --2- 172.21.15.153:0/2611823726 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4a1c034140 0x7f4a1c0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:36.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.963+0000 7f4ae283a680 5 note: GC not initialized 2023-10-05T21:15:36.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.963+0000 7f4ad6113700 1 --2- 172.21.15.153:0/2611823726 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4a1c034140 0x7f4a1c0365f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x5641e1590d50 tx=0x7f4ad0037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:36.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.964+0000 7f4a15ffb700 20 reqs_thread_entry: start 2023-10-05T21:15:36.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.964+0000 7f4a077fe700 20 reqs_thread_entry: start 2023-10-05T21:15:36.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.964+0000 7f4ae283a680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:36.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.964+0000 7f4ae283a680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:36.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.964+0000 7f4a05ffb700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:16:07 2023 2023-10-05T21:15:36.994 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:36.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.964+0000 7f4a057fa700 20 reqs_thread_entry: start 2023-10-05T21:15:36.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.964+0000 7f4ae283a680 20 get_system_obj_state: rctx=0x7ffde65a1d80 obj=default.rgw.meta:root:myfoo state=0x5641e13fc240 s->prefetch_data=0 2023-10-05T21:15:36.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.964+0000 7f4ae283a680 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-10-05T21:15:36.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.964+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:102 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1607870 con 0x7f4ac8007030 2023-10-05T21:15:36.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.965+0000 7f4ad5111700 1 -- 172.21.15.153:0/1299460200 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(102 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv33 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f4acc00f560 con 0x7f4ac8007030 2023-10-05T21:15:36.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.965+0000 7f4ae283a680 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x16 2023-10-05T21:15:36.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.965+0000 7f4ae283a680 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:36.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.965+0000 7f4ae283a680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:36.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.965+0000 7f4ae283a680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:36.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.965+0000 7f4ae283a680 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x11, cached=0x16) 2023-10-05T21:15:36.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.965+0000 7f4ae283a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.965+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:103 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1609ac0 con 0x7f4ac8007030 2023-10-05T21:15:36.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.965+0000 7f4ad5111700 1 -- 172.21.15.153:0/1299460200 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(103 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7f4acc00f560 con 0x7f4ac8007030 2023-10-05T21:15:36.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.965+0000 7f4ae283a680 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T21:15:36.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.965+0000 7f4ae283a680 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2023-10-05T21:15:36.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.965+0000 7f4ae283a680 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:36.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.965+0000 7f4ae283a680 20 get_system_obj_state: rctx=0x7ffde65a1d80 obj=default.rgw.meta:root:.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 state=0x5641e13fc500 s->prefetch_data=0 2023-10-05T21:15:36.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.965+0000 7f4ae283a680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 : miss 2023-10-05T21:15:36.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.965+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:104 8.e 8:7627b2dd:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e16088d0 con 0x7f4acc00e8c0 2023-10-05T21:15:36.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.966+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(104 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f4ad000a570 con 0x7f4acc00e8c0 2023-10-05T21:15:36.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.966+0000 7f4ae283a680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 info.flags=0x16 2023-10-05T21:15:36.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.966+0000 7f4ae283a680 10 adding default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 to cache LRU end 2023-10-05T21:15:36.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.966+0000 7f4ae283a680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:36.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.966+0000 7f4ae283a680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:36.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.966+0000 7f4ae283a680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:36.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.966+0000 7f4ae283a680 20 Read xattr: user.rgw.acl 2023-10-05T21:15:36.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.966+0000 7f4ae283a680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:36.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.966+0000 7f4ae283a680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:36.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.966+0000 7f4ae283a680 20 rados->read ofs=0 len=0 2023-10-05T21:15:36.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.966+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:105 8.e 8:7627b2dd:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e160c5d0 con 0x7f4acc00e8c0 2023-10-05T21:15:36.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.966+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(105 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f4ad000a570 con 0x7f4acc00e8c0 2023-10-05T21:15:36.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.966+0000 7f4ae283a680 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T21:15:36.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.966+0000 7f4ae283a680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 info.flags=0x13 2023-10-05T21:15:36.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.966+0000 7f4ae283a680 10 moving default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 to cache LRU end 2023-10-05T21:15:36.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.966+0000 7f4ae283a680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:36.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.966+0000 7f4ae283a680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:36.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.966+0000 7f4ae283a680 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 2023-10-05T21:15:36.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.966+0000 7f4ae283a680 20 get_obj_state: rctx=0x7ffde65a1f80 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5641e160cdf8 s->prefetch_data=0 2023-10-05T21:15:36.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.966+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:106 3.2f 3:f67a3996:::193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e160d760 con 0x5641e157e260 2023-10-05T21:15:36.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.967+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(106 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 262+0+927 (crc 0 0 0) 0x7f4ac8019040 con 0x5641e157e260 2023-10-05T21:15:36.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.967+0000 7f4ae283a680 10 manifest: total_size = 5 2023-10-05T21:15:36.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.967+0000 7f4ae283a680 20 get_obj_state: setting s->obj_tag to _MkG5s3WkxgyXJJdQR1IwmgYRyiYpxtc 2023-10-05T21:15:36.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.967+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:107 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94840953408912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f4ac8055000 con 0x7f4ac8007030 2023-10-05T21:15:36.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.967+0000 7f4ad5111700 1 -- 172.21.15.153:0/1299460200 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(107 notify.0 [watch unwatch cookie 94840953408912] v29'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4acc00f560 con 0x7f4ac8007030 2023-10-05T21:15:36.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.968+0000 7f4ae283a680 20 remove_watcher() i=0 2023-10-05T21:15:36.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.968+0000 7f4ae283a680 2 removed watcher, disabling cache 2023-10-05T21:15:36.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.968+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:108 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94840953537936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1568d90 con 0x5641e1579a60 2023-10-05T21:15:36.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.968+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(108 notify.1 [watch unwatch cookie 94840953537936] v29'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.968+0000 7f4ae283a680 20 remove_watcher() i=1 2023-10-05T21:15:36.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.968+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:109 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94840953542176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1588590 con 0x5641e157e260 2023-10-05T21:15:36.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.969+0000 7f4ad5912700 1 -- 172.21.15.153:0/1299460200 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(109 notify.2 [watch unwatch cookie 94840953542176] v29'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ac8019040 con 0x5641e157e260 2023-10-05T21:15:36.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.969+0000 7f4ae283a680 20 remove_watcher() i=2 2023-10-05T21:15:36.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.969+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:110 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94840953544928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1568d90 con 0x7f4ac8007030 2023-10-05T21:15:36.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.970+0000 7f4ad5111700 1 -- 172.21.15.153:0/1299460200 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(110 notify.3 [watch unwatch cookie 94840953544928] v29'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4acc057040 con 0x7f4ac8007030 2023-10-05T21:15:36.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.970+0000 7f4ae283a680 20 remove_watcher() i=3 2023-10-05T21:15:36.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.970+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:111 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94840953549008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1588590 con 0x5641e1579a60 2023-10-05T21:15:36.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.971+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(111 notify.4 [watch unwatch cookie 94840953549008] v29'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:36.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.971+0000 7f4ae283a680 20 remove_watcher() i=4 2023-10-05T21:15:36.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.971+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94840953553440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e158a0e0 con 0x7f4acc00e8c0 2023-10-05T21:15:36.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.972+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(112 notify.5 [watch unwatch cookie 94840953553440] v29'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ad000a570 con 0x7f4acc00e8c0 2023-10-05T21:15:37.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.972+0000 7f4ae283a680 20 remove_watcher() i=5 2023-10-05T21:15:37.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.972+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:113 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94840953554736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1568d90 con 0x7f4acc00e8c0 2023-10-05T21:15:37.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.973+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(113 notify.6 [watch unwatch cookie 94840953554736] v29'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ad000a570 con 0x7f4acc00e8c0 2023-10-05T21:15:37.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.973+0000 7f4ae283a680 20 remove_watcher() i=6 2023-10-05T21:15:37.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.973+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:114 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94840953556400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e1588590 con 0x7f4acc00e8c0 2023-10-05T21:15:37.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.973+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.0 v2:172.21.15.111:6800/111394 31 ==== osd_op_reply(114 notify.7 [watch unwatch cookie 94840953556400] v29'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ad000a570 con 0x7f4acc00e8c0 2023-10-05T21:15:37.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.973+0000 7f4ae283a680 20 remove_watcher() i=7 2023-10-05T21:15:37.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.974+0000 7f4aa6fe5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:37.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.974+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:115 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94840953558784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5641e158c220 con 0x5641e1579a60 2023-10-05T21:15:37.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.975+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(115 data_loggenerations_metadata [watch unwatch cookie 94840953558784] v29'202 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4ad000a570 con 0x5641e1579a60 2023-10-05T21:15:37.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.975+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4acc00e8c0 msgr2=0x7f4acc00d310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.975+0000 7f4ae283a680 1 --2- 172.21.15.153:0/1299460200 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4acc00e8c0 0x7f4acc00d310 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.975+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5641e1579a60 msgr2=0x5641e157be40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.975+0000 7f4ae283a680 1 --2- 172.21.15.153:0/1299460200 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5641e1579a60 0x5641e157be40 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.975+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4ac8007030 msgr2=0x7f4ac8048100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.975+0000 7f4ae283a680 1 --2- 172.21.15.153:0/1299460200 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4ac8007030 0x7f4ac8048100 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.975+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5641e157e260 msgr2=0x5641e1580640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.975+0000 7f4ae283a680 1 --2- 172.21.15.153:0/1299460200 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5641e157e260 0x5641e1580640 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.975+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4ab8034130 msgr2=0x7f4ab80365e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.975+0000 7f4ae283a680 1 --2- 172.21.15.153:0/1299460200 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4ab8034130 0x7f4ab80365e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4acc001e70 tx=0x7f4acc001390 comp rx=0 tx=0).stop 2023-10-05T21:15:37.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.975+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e15482c0 msgr2=0x5641e156fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.975+0000 7f4ad6113700 1 -- 172.21.15.153:0/1299460200 reap_dead start 2023-10-05T21:15:37.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.975+0000 7f4ae283a680 1 --2- 172.21.15.153:0/1299460200 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e15482c0 0x5641e156fcd0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8020040 tx=0x7f4ac801d000 comp rx=0 tx=0).stop 2023-10-05T21:15:37.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.975+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 shutdown_connections 2023-10-05T21:15:37.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.975+0000 7f4ae283a680 1 --2- 172.21.15.153:0/1299460200 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e15482c0 0x5641e156fcd0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.975+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 >> 172.21.15.153:0/1299460200 conn(0x5641e1543b90 msgr2=0x5641e1561b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:37.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.975+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 shutdown_connections 2023-10-05T21:15:37.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.975+0000 7f4ae283a680 1 -- 172.21.15.153:0/1299460200 wait complete. 2023-10-05T21:15:37.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.975+0000 7f4ae283a680 1 -- 172.21.15.153:0/2611823726 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4a1c034140 msgr2=0x7f4a1c0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.975+0000 7f4ae283a680 1 --2- 172.21.15.153:0/2611823726 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4a1c034140 0x7f4a1c0365f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x5641e1590d50 tx=0x7f4ad0037450 comp rx=0 tx=0).stop 2023-10-05T21:15:37.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.975+0000 7f4ae283a680 1 -- 172.21.15.153:0/2611823726 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e159aa30 msgr2=0x5641e15a1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.975+0000 7f4ae283a680 1 --2- 172.21.15.153:0/2611823726 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e159aa30 0x5641e15a1750 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4acc001810 tx=0x7f4acc032000 comp rx=0 tx=0).stop 2023-10-05T21:15:37.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.975+0000 7f4ae283a680 1 -- 172.21.15.153:0/2611823726 shutdown_connections 2023-10-05T21:15:37.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.975+0000 7f4ae283a680 1 --2- 172.21.15.153:0/2611823726 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4a1c034140 0x7f4a1c0365f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.975+0000 7f4ae283a680 1 --2- 172.21.15.153:0/2611823726 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5641e159aa30 0x5641e15a1750 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.975+0000 7f4ae283a680 1 -- 172.21.15.153:0/2611823726 >> 172.21.15.153:0/2611823726 conn(0x5641e1596d30 msgr2=0x5641e1594e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:37.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.976+0000 7f4ae283a680 1 -- 172.21.15.153:0/2611823726 shutdown_connections 2023-10-05T21:15:37.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:36.976+0000 7f4ae283a680 1 -- 172.21.15.153:0/2611823726 wait complete. 2023-10-05T21:15:37.004 INFO:teuthology.orchestra.run.smithi153.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2023-10-05T21:15:37.004 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2023-10-05T21:15:37.006 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2023-10-05T21:15:37.009 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T21:15:37.063 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2023-10-05T21:15:37.063 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2023-10-05T21:15:37.063 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2023-10-05T21:15:37.063 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2023-10-05T21:15:37.064 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2023-10-05T21:15:37.064 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2023-10-05T21:15:37.064 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2023-10-05T21:15:37.109 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:37.109 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:37.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.108+0000 7f4dca18e680 1 Processor -- start 2023-10-05T21:15:37.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.108+0000 7f4dca18e680 1 -- start start 2023-10-05T21:15:37.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.108+0000 7f4dca18e680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55f3ab10cf70 0x55f3ab10f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.108+0000 7f4dca18e680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f3ab057930 con 0x55f3ab108a40 2023-10-05T21:15:37.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.108+0000 7f4dca18e680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f3ab017db0 con 0x55f3ab10cf70 2023-10-05T21:15:37.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.109+0000 7f4dbca65700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55f3ab10cf70 0x55f3ab10f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.109+0000 7f4dbca65700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55f3ab10cf70 0x55f3ab10f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57786/0 (socket says 172.21.15.153:57786) 2023-10-05T21:15:37.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.109+0000 7f4dbca65700 1 -- 172.21.15.153:0/3026482924 learned_addr learned my addr 172.21.15.153:0/3026482924 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:37.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.109+0000 7f4dbd266700 1 --1- 172.21.15.153:0/3026482924 >> v1:172.21.15.111:6789/0 conn(0x55f3ab108a40 0x55f3ab108e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:39274/0 (socket says 172.21.15.153:39274) 2023-10-05T21:15:37.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.109+0000 7f4dbca65700 1 -- 172.21.15.153:0/3026482924 >> v1:172.21.15.111:6789/0 conn(0x55f3ab108a40 legacy=0x55f3ab108e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.109+0000 7f4dbca65700 1 -- 172.21.15.153:0/3026482924 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3ab07cc30 con 0x55f3ab10cf70 2023-10-05T21:15:37.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.109+0000 7f4dbca65700 1 --2- 172.21.15.153:0/3026482924 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f3ab10cf70 0x55f3ab10f350 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4db000a760 tx=0x7f4db0005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43738d49a0b4bf88 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.109+0000 7f4db7fff700 1 -- 172.21.15.153:0/3026482924 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4db000f070 con 0x55f3ab10cf70 2023-10-05T21:15:37.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.109+0000 7f4db7fff700 1 -- 172.21.15.153:0/3026482924 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db000a2e0 con 0x55f3ab10cf70 2023-10-05T21:15:37.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.109+0000 7f4db7fff700 1 -- 172.21.15.153:0/3026482924 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4db00085b0 con 0x55f3ab10cf70 2023-10-05T21:15:37.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.110+0000 7f4dca18e680 1 -- 172.21.15.153:0/3026482924 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f3ab10cf70 msgr2=0x55f3ab10f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.110+0000 7f4dca18e680 1 --2- 172.21.15.153:0/3026482924 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f3ab10cf70 0x55f3ab10f350 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4db000a760 tx=0x7f4db0005b10 comp rx=0 tx=0).stop 2023-10-05T21:15:37.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.110+0000 7f4dca18e680 1 -- 172.21.15.153:0/3026482924 shutdown_connections 2023-10-05T21:15:37.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.110+0000 7f4dca18e680 1 --2- 172.21.15.153:0/3026482924 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f3ab10cf70 0x55f3ab10f350 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.110+0000 7f4dca18e680 1 -- 172.21.15.153:0/3026482924 >> 172.21.15.153:0/3026482924 conn(0x55f3ab104310 msgr2=0x55f3ab106720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:37.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.110+0000 7f4dca18e680 1 -- 172.21.15.153:0/3026482924 shutdown_connections 2023-10-05T21:15:37.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.110+0000 7f4dca18e680 1 -- 172.21.15.153:0/3026482924 wait complete. 2023-10-05T21:15:37.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.110+0000 7f4dca18e680 1 Processor -- start 2023-10-05T21:15:37.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.110+0000 7f4dca18e680 1 -- start start 2023-10-05T21:15:37.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.111+0000 7f4dca18e680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f3ab108a40 0x55f3ab1276c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.111+0000 7f4dca18e680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3aafb7ea0 con 0x55f3ab108a40 2023-10-05T21:15:37.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.111+0000 7f4dbd266700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f3ab108a40 0x55f3ab1276c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.111+0000 7f4dbd266700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f3ab108a40 0x55f3ab1276c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57796/0 (socket says 172.21.15.153:57796) 2023-10-05T21:15:37.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.111+0000 7f4dbd266700 1 -- 172.21.15.153:0/4072235412 learned_addr learned my addr 172.21.15.153:0/4072235412 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:37.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.111+0000 7f4dbd266700 1 -- 172.21.15.153:0/4072235412 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db0005db0 con 0x55f3ab108a40 2023-10-05T21:15:37.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.111+0000 7f4dbd266700 1 --2- 172.21.15.153:0/4072235412 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f3ab108a40 0x55f3ab1276c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4da8001cf0 tx=0x7f4da80018a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae5b731cb2599bc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.111+0000 7f4db6ffd700 1 -- 172.21.15.153:0/4072235412 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4da8014070 con 0x55f3ab108a40 2023-10-05T21:15:37.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.111+0000 7f4db6ffd700 1 -- 172.21.15.153:0/4072235412 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da800be10 con 0x55f3ab108a40 2023-10-05T21:15:37.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.111+0000 7f4db6ffd700 1 -- 172.21.15.153:0/4072235412 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4da800f590 con 0x55f3ab108a40 2023-10-05T21:15:37.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.112+0000 7f4dca18e680 1 -- 172.21.15.153:0/4072235412 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f3ab108a40 msgr2=0x55f3ab1276c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.112+0000 7f4dca18e680 1 --2- 172.21.15.153:0/4072235412 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f3ab108a40 0x55f3ab1276c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4da8001cf0 tx=0x7f4da80018a0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.112+0000 7f4dca18e680 1 -- 172.21.15.153:0/4072235412 shutdown_connections 2023-10-05T21:15:37.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.112+0000 7f4dca18e680 1 --2- 172.21.15.153:0/4072235412 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f3ab108a40 0x55f3ab1276c0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.112+0000 7f4dca18e680 1 -- 172.21.15.153:0/4072235412 >> 172.21.15.153:0/4072235412 conn(0x55f3ab104310 msgr2=0x55f3ab123190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:37.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.112+0000 7f4dca18e680 1 -- 172.21.15.153:0/4072235412 shutdown_connections 2023-10-05T21:15:37.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.112+0000 7f4dca18e680 1 -- 172.21.15.153:0/4072235412 wait complete. 2023-10-05T21:15:37.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.112+0000 7f4dca18e680 1 Processor -- start 2023-10-05T21:15:37.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.112+0000 7f4dca18e680 1 -- start start 2023-10-05T21:15:37.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.112+0000 7f4dca18e680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f3ab108a40 0x55f3ab12ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.112+0000 7f4dca18e680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3aafaec80 con 0x55f3ab108a40 2023-10-05T21:15:37.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.112+0000 7f4dbd266700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f3ab108a40 0x55f3ab12ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.112+0000 7f4dbd266700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f3ab108a40 0x55f3ab12ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57800/0 (socket says 172.21.15.153:57800) 2023-10-05T21:15:37.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.112+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 learned_addr learned my addr 172.21.15.153:0/2730456551 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:37.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.113+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3ab057930 con 0x55f3ab108a40 2023-10-05T21:15:37.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.113+0000 7f4dbd266700 1 --2- 172.21.15.153:0/2730456551 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f3ab108a40 0x55f3ab12ebc0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4da80018e0 tx=0x7f4da8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.113+0000 7f4db57fa700 1 -- 172.21.15.153:0/2730456551 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4da801c740 con 0x55f3ab108a40 2023-10-05T21:15:37.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.113+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f3ab12f100 con 0x55f3ab108a40 2023-10-05T21:15:37.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.113+0000 7f4db57fa700 1 -- 172.21.15.153:0/2730456551 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da801c8c0 con 0x55f3ab108a40 2023-10-05T21:15:37.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.113+0000 7f4db57fa700 1 -- 172.21.15.153:0/2730456551 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4da801cbb0 con 0x55f3ab108a40 2023-10-05T21:15:37.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.113+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f3ab12f550 con 0x55f3ab108a40 2023-10-05T21:15:37.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.114+0000 7f4db57fa700 1 -- 172.21.15.153:0/2730456551 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f4da8023020 con 0x55f3ab108a40 2023-10-05T21:15:37.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.114+0000 7f4dca18e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.114+0000 7f4db57fa700 1 --2- 172.21.15.153:0/2730456551 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4da00340f0 0x7f4da00365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.114+0000 7f4db57fa700 1 -- 172.21.15.153:0/2730456551 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f4da8008030 con 0x55f3ab108a40 2023-10-05T21:15:37.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.114+0000 7f4dbca65700 1 --2- 172.21.15.153:0/2730456551 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4da00340f0 0x7f4da00365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.114+0000 7f4dca18e680 1 --2- 172.21.15.153:0/2730456551 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55f3ab10cf70 0x55f3ab13a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.114+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab13b0e0 con 0x55f3ab10cf70 2023-10-05T21:15:37.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.114+0000 7f4dbda67700 1 --2- 172.21.15.153:0/2730456551 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55f3ab10cf70 0x55f3ab13a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.114+0000 7f4dbca65700 1 --2- 172.21.15.153:0/2730456551 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4da00340f0 0x7f4da00365a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4db0005b50 tx=0x7f4db0018000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.115+0000 7f4dbda67700 1 --2- 172.21.15.153:0/2730456551 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55f3ab10cf70 0x55f3ab13a950 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.115+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.115+0000 7f4dca18e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.115+0000 7f4dca18e680 20 realm 2023-10-05T21:15:37.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.115+0000 7f4dca18e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.115+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab137f30 con 0x55f3ab10cf70 2023-10-05T21:15:37.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.115+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.115+0000 7f4dca18e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.115+0000 7f4dca18e680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:37.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.115+0000 7f4dca18e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.115+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab13bbe0 con 0x55f3ab10cf70 2023-10-05T21:15:37.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.115+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.115+0000 7f4dca18e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.115+0000 7f4dca18e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.115+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab13c500 con 0x55f3ab10cf70 2023-10-05T21:15:37.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.116+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.116+0000 7f4dca18e680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:37.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.116+0000 7f4dca18e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.116+0000 7f4dca18e680 1 --2- 172.21.15.153:0/2730456551 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55f3ab13cdc0 0x55f3ab13f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.116+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab13f7f0 con 0x55f3ab13cdc0 2023-10-05T21:15:37.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.116+0000 7f4dbd266700 1 --2- 172.21.15.153:0/2730456551 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55f3ab13cdc0 0x55f3ab13f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.116+0000 7f4dbd266700 1 --2- 172.21.15.153:0/2730456551 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55f3ab13cdc0 0x55f3ab13f1a0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.116+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f4da8016070 con 0x55f3ab13cdc0 2023-10-05T21:15:37.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.116+0000 7f4dca18e680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:37.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.116+0000 7f4dca18e680 20 searching for the correct realm 2023-10-05T21:15:37.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.116+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x55f3ab13cdc0 2023-10-05T21:15:37.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.117+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4da8016070 con 0x55f3ab13cdc0 2023-10-05T21:15:37.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.117+0000 7f4dbd266700 1 --2- 172.21.15.153:0/2730456551 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4da801a070 0x7f4da8030790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.117+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x7f4da801a070 2023-10-05T21:15:37.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.117+0000 7f4dbca65700 1 --2- 172.21.15.153:0/2730456551 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4da801a070 0x7f4da8030790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.117+0000 7f4dbca65700 1 --2- 172.21.15.153:0/2730456551 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4da801a070 0x7f4da8030790 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.117+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db0009600 con 0x7f4da801a070 2023-10-05T21:15:37.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.117+0000 7f4dbca65700 1 --2- 172.21.15.153:0/2730456551 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4db0013ab0 0x7f4db001d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.117+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x7f4db0013ab0 2023-10-05T21:15:37.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.118+0000 7f4dbda67700 1 --2- 172.21.15.153:0/2730456551 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4db0013ab0 0x7f4db001d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.118+0000 7f4dbda67700 1 --2- 172.21.15.153:0/2730456551 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4db0013ab0 0x7f4db001d410 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.118+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.118+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x55f3ab10cf70 2023-10-05T21:15:37.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.118+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.118+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x55f3ab10cf70 2023-10-05T21:15:37.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.119+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.119+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x7f4db0013ab0 2023-10-05T21:15:37.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.119+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.119+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x7f4db0013ab0 2023-10-05T21:15:37.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.119+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.119+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x7f4da801a070 2023-10-05T21:15:37.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.119+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db0009600 con 0x7f4da801a070 2023-10-05T21:15:37.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.119+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x55f3ab13cdc0 2023-10-05T21:15:37.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.120+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4da8016070 con 0x55f3ab13cdc0 2023-10-05T21:15:37.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.120+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x55f3ab10cf70 2023-10-05T21:15:37.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.120+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.120+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x7f4db0013ab0 2023-10-05T21:15:37.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.120+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.120+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x55f3ab10cf70 2023-10-05T21:15:37.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.120+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.120+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x7f4da801a070 2023-10-05T21:15:37.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.120+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db0009600 con 0x7f4da801a070 2023-10-05T21:15:37.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.120+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x55f3ab13cdc0 2023-10-05T21:15:37.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.121+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4da8016070 con 0x55f3ab13cdc0 2023-10-05T21:15:37.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.121+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x55f3ab13cdc0 2023-10-05T21:15:37.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.121+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4da8016070 con 0x55f3ab13cdc0 2023-10-05T21:15:37.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.121+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x7f4db0013ab0 2023-10-05T21:15:37.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.121+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.121+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x55f3ab13cdc0 2023-10-05T21:15:37.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.121+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4da8016070 con 0x55f3ab13cdc0 2023-10-05T21:15:37.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.121+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x55f3ab13cdc0 2023-10-05T21:15:37.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.121+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4da8016070 con 0x55f3ab13cdc0 2023-10-05T21:15:37.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.121+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x55f3ab10cf70 2023-10-05T21:15:37.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.122+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.122+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x55f3ab10cf70 2023-10-05T21:15:37.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.122+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.122+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x7f4db0013ab0 2023-10-05T21:15:37.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.122+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.122+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x55f3ab13cdc0 2023-10-05T21:15:37.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.122+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4da8016070 con 0x55f3ab13cdc0 2023-10-05T21:15:37.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.122+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x7f4da801a070 2023-10-05T21:15:37.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.122+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db0009600 con 0x7f4da801a070 2023-10-05T21:15:37.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.122+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x55f3ab10cf70 2023-10-05T21:15:37.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.123+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.123+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x7f4db0013ab0 2023-10-05T21:15:37.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.123+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.123+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x55f3ab13cdc0 2023-10-05T21:15:37.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.123+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4da8016070 con 0x55f3ab13cdc0 2023-10-05T21:15:37.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.123+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x7f4db0013ab0 2023-10-05T21:15:37.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.123+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.123+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x7f4da801a070 2023-10-05T21:15:37.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.124+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db0009600 con 0x7f4da801a070 2023-10-05T21:15:37.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.124+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x55f3ab13cdc0 2023-10-05T21:15:37.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.124+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4da8016070 con 0x55f3ab13cdc0 2023-10-05T21:15:37.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.124+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x7f4db0013ab0 2023-10-05T21:15:37.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.124+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.124+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x55f3ab10cf70 2023-10-05T21:15:37.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.124+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.124+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141360 con 0x7f4da801a070 2023-10-05T21:15:37.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.125+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db0009600 con 0x7f4da801a070 2023-10-05T21:15:37.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.125+0000 7f4dca18e680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:37.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.125+0000 7f4dca18e680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:37.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.125+0000 7f4dca18e680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:37.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.125+0000 7f4dca18e680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:37.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.125+0000 7f4dca18e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.125+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1402b0 con 0x55f3ab10cf70 2023-10-05T21:15:37.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.125+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.125+0000 7f4dca18e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.125+0000 7f4dca18e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.125+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1406b0 con 0x55f3ab10cf70 2023-10-05T21:15:37.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.125+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.125+0000 7f4dca18e680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:37.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.125+0000 7f4dca18e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.125+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1417f0 con 0x55f3ab10cf70 2023-10-05T21:15:37.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.125+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.125+0000 7f4dca18e680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:37.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.125+0000 7f4dca18e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.125+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141ba0 con 0x55f3ab13cdc0 2023-10-05T21:15:37.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.125+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.125+0000 7f4dca18e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.125+0000 7f4dca18e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.125+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141f50 con 0x55f3ab10cf70 2023-10-05T21:15:37.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.126+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.126+0000 7f4dca18e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.126+0000 7f4dca18e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.126+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141f50 con 0x55f3ab10cf70 2023-10-05T21:15:37.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.126+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.126+0000 7f4dca18e680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:37.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.126+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab142f60 con 0x55f3ab13cdc0 2023-10-05T21:15:37.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.126+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.126+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab142f60 con 0x7f4da801a070 2023-10-05T21:15:37.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.126+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db0009600 con 0x7f4da801a070 2023-10-05T21:15:37.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.126+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab142f60 con 0x7f4db0013ab0 2023-10-05T21:15:37.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.127+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.127+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1417f0 con 0x55f3ab10cf70 2023-10-05T21:15:37.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.127+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.127+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1417f0 con 0x55f3ab10cf70 2023-10-05T21:15:37.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.127+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.127+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1417f0 con 0x7f4db0013ab0 2023-10-05T21:15:37.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.127+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.127+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1417f0 con 0x7f4db0013ab0 2023-10-05T21:15:37.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.127+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.127+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1417f0 con 0x7f4da801a070 2023-10-05T21:15:37.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.128+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db0009600 con 0x7f4da801a070 2023-10-05T21:15:37.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.128+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1417f0 con 0x55f3ab13cdc0 2023-10-05T21:15:37.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.128+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.128+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1417f0 con 0x55f3ab10cf70 2023-10-05T21:15:37.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.128+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.128+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1417f0 con 0x7f4db0013ab0 2023-10-05T21:15:37.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.128+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.128+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1417f0 con 0x55f3ab10cf70 2023-10-05T21:15:37.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.128+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.128+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1417f0 con 0x7f4da801a070 2023-10-05T21:15:37.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.129+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db0009600 con 0x7f4da801a070 2023-10-05T21:15:37.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.129+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1417f0 con 0x55f3ab13cdc0 2023-10-05T21:15:37.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.129+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.129+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1417f0 con 0x55f3ab13cdc0 2023-10-05T21:15:37.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.129+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.129+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1417f0 con 0x7f4db0013ab0 2023-10-05T21:15:37.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.129+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.129+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1417f0 con 0x55f3ab13cdc0 2023-10-05T21:15:37.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.130+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.130+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1417f0 con 0x55f3ab13cdc0 2023-10-05T21:15:37.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.130+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.130+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1417f0 con 0x55f3ab10cf70 2023-10-05T21:15:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.130+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.130+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1417f0 con 0x55f3ab10cf70 2023-10-05T21:15:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.130+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.130+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1417f0 con 0x7f4db0013ab0 2023-10-05T21:15:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.131+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.131+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1417f0 con 0x55f3ab13cdc0 2023-10-05T21:15:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.131+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.131+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1417f0 con 0x7f4da801a070 2023-10-05T21:15:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.131+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db0009600 con 0x7f4da801a070 2023-10-05T21:15:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.131+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1417f0 con 0x55f3ab10cf70 2023-10-05T21:15:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.131+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.131+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1417f0 con 0x7f4db0013ab0 2023-10-05T21:15:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.132+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.132+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1417f0 con 0x55f3ab13cdc0 2023-10-05T21:15:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.132+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.132+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1417f0 con 0x7f4db0013ab0 2023-10-05T21:15:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.132+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.132+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1417f0 con 0x7f4da801a070 2023-10-05T21:15:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.132+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db0009600 con 0x7f4da801a070 2023-10-05T21:15:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.132+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1417f0 con 0x55f3ab13cdc0 2023-10-05T21:15:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.133+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.133+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1417f0 con 0x7f4db0013ab0 2023-10-05T21:15:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.133+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.133+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1417f0 con 0x55f3ab10cf70 2023-10-05T21:15:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.133+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.133+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1417f0 con 0x7f4da801a070 2023-10-05T21:15:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.133+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4db0009600 con 0x7f4da801a070 2023-10-05T21:15:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.133+0000 7f4dca18e680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.133+0000 7f4dca18e680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.133+0000 7f4dca18e680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:37.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.133+0000 7f4dca18e680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:37.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.133+0000 7f4dca18e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.133+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab141f50 con 0x55f3ab10cf70 2023-10-05T21:15:37.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.134+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.134+0000 7f4dca18e680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:37.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.134+0000 7f4dca18e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.134+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab142300 con 0x55f3ab13cdc0 2023-10-05T21:15:37.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.134+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.134+0000 7f4dca18e680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:37.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.134+0000 7f4dca18e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.134+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab142ba0 con 0x55f3ab10cf70 2023-10-05T21:15:37.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.134+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.134+0000 7f4dca18e680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:37.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.134+0000 7f4dca18e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.134+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab142ba0 con 0x55f3ab10cf70 2023-10-05T21:15:37.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.134+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.134+0000 7f4dca18e680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:37.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.134+0000 7f4dca18e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.134+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab142ba0 con 0x7f4db0013ab0 2023-10-05T21:15:37.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.135+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.135+0000 7f4dca18e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.135+0000 7f4dca18e680 20 zone default found 2023-10-05T21:15:37.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.135+0000 7f4dca18e680 4 Realm: () 2023-10-05T21:15:37.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.135+0000 7f4dca18e680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:37.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.135+0000 7f4dca18e680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:37.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.135+0000 7f4dca18e680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:37.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.135+0000 7f4dca18e680 20 zonegroup default 2023-10-05T21:15:37.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.135+0000 7f4dca18e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.135+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab142ba0 con 0x7f4db0013ab0 2023-10-05T21:15:37.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.135+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.135+0000 7f4dca18e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.135+0000 7f4dca18e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.135+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab144520 con 0x55f3ab13cdc0 2023-10-05T21:15:37.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.135+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.135+0000 7f4dca18e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.135+0000 7f4dca18e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.135+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1448d0 con 0x55f3ab13cdc0 2023-10-05T21:15:37.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.135+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.135+0000 7f4dca18e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.135+0000 7f4dca18e680 20 started sync module instance, tier type = 2023-10-05T21:15:37.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.135+0000 7f4dca18e680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:37.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.135+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab143c30 con 0x7f4da801a070 2023-10-05T21:15:37.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.136+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db0009600 con 0x7f4da801a070 2023-10-05T21:15:37.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.136+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94505035644976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab145170 con 0x7f4da801a070 2023-10-05T21:15:37.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.136+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab145a10 con 0x55f3ab10cf70 2023-10-05T21:15:37.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.137+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94505035644976] v29'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db0009600 con 0x7f4da801a070 2023-10-05T21:15:37.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.137+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.137+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94505035650336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab145e60 con 0x55f3ab10cf70 2023-10-05T21:15:37.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.137+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab146700 con 0x55f3ab13cdc0 2023-10-05T21:15:37.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.138+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94505035650336] v29'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.138+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.138+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94505035651728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab146b00 con 0x55f3ab13cdc0 2023-10-05T21:15:37.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.138+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab147510 con 0x7f4da801a070 2023-10-05T21:15:37.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.139+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94505035651728] v29'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.139+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db0009600 con 0x7f4da801a070 2023-10-05T21:15:37.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.139+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94505035652832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab147db0 con 0x7f4da801a070 2023-10-05T21:15:37.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.139+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab148650 con 0x55f3ab10cf70 2023-10-05T21:15:37.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.140+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94505035652832] v29'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db0009600 con 0x7f4da801a070 2023-10-05T21:15:37.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.140+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.140+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94505035661664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab148aa0 con 0x55f3ab10cf70 2023-10-05T21:15:37.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.140+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1494b0 con 0x7f4db0013ab0 2023-10-05T21:15:37.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.140+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94505035661664] v29'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.141+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.141+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94505035663328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1494b0 con 0x7f4db0013ab0 2023-10-05T21:15:37.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.141+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab149f20 con 0x7f4db0013ab0 2023-10-05T21:15:37.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.141+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(96 notify.6 [create] v29'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.141+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(95 notify.5 [watch watch cookie 94505035663328] v29'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.141+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94505035667920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab14a3d0 con 0x7f4db0013ab0 2023-10-05T21:15:37.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.141+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab148fc0 con 0x7f4db0013ab0 2023-10-05T21:15:37.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.142+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94505035667920] v29'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.142+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.142+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94505035669216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab14a330 con 0x7f4db0013ab0 2023-10-05T21:15:37.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.142+0000 7f4dca18e680 20 add_watcher() i=0 2023-10-05T21:15:37.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.142+0000 7f4dca18e680 20 add_watcher() i=1 2023-10-05T21:15:37.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.142+0000 7f4dca18e680 20 add_watcher() i=2 2023-10-05T21:15:37.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.142+0000 7f4dca18e680 20 add_watcher() i=3 2023-10-05T21:15:37.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.142+0000 7f4dca18e680 20 add_watcher() i=4 2023-10-05T21:15:37.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.142+0000 7f4dca18e680 20 add_watcher() i=5 2023-10-05T21:15:37.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.142+0000 7f4dca18e680 20 add_watcher() i=6 2023-10-05T21:15:37.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.143+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94505035669216] v29'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.143+0000 7f4dca18e680 20 add_watcher() i=7 2023-10-05T21:15:37.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.143+0000 7f4dca18e680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:37.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.143+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab14df80 con 0x55f3ab10cf70 2023-10-05T21:15:37.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.143+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.143+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94505035672160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab14b3a0 con 0x55f3ab10cf70 2023-10-05T21:15:37.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.144+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94505035672160] v29'203 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.144+0000 7f4d8e7e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:37.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.144+0000 7f4dca18e680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:37.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.144+0000 7f4dca18e680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:37.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.144+0000 7f4dca18e680 1 Processor -- start 2023-10-05T21:15:37.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.144+0000 7f4dca18e680 1 -- start start 2023-10-05T21:15:37.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.145+0000 7f4dca18e680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f3ab1579d0 0x55f3ab157de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.145+0000 7f4dca18e680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3ab1583f0 con 0x55f3ab1579d0 2023-10-05T21:15:37.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.145+0000 7f4dbca65700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f3ab1579d0 0x55f3ab157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.145+0000 7f4dbca65700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f3ab1579d0 0x55f3ab157de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57812/0 (socket says 172.21.15.153:57812) 2023-10-05T21:15:37.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.145+0000 7f4dbca65700 1 -- 172.21.15.153:0/1484079152 learned_addr learned my addr 172.21.15.153:0/1484079152 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:37.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.145+0000 7f4dbca65700 1 -- 172.21.15.153:0/1484079152 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3ab1588d0 con 0x55f3ab1579d0 2023-10-05T21:15:37.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.145+0000 7f4dbca65700 1 --2- 172.21.15.153:0/1484079152 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f3ab1579d0 0x55f3ab157de0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4db0002000 tx=0x7f4db0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79229195b47f9bdc server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.146+0000 7f4d8dfe3700 1 -- 172.21.15.153:0/1484079152 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4db0009a90 con 0x55f3ab1579d0 2023-10-05T21:15:37.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.146+0000 7f4d8dfe3700 1 -- 172.21.15.153:0/1484079152 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db002b450 con 0x55f3ab1579d0 2023-10-05T21:15:37.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.146+0000 7f4d8dfe3700 1 -- 172.21.15.153:0/1484079152 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4db002b600 con 0x55f3ab1579d0 2023-10-05T21:15:37.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.146+0000 7f4dca18e680 1 -- 172.21.15.153:0/1484079152 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f3ab1579d0 msgr2=0x55f3ab157de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.146+0000 7f4dca18e680 1 --2- 172.21.15.153:0/1484079152 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f3ab1579d0 0x55f3ab157de0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4db0002000 tx=0x7f4db0016000 comp rx=0 tx=0).stop 2023-10-05T21:15:37.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.146+0000 7f4dca18e680 1 -- 172.21.15.153:0/1484079152 shutdown_connections 2023-10-05T21:15:37.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.146+0000 7f4dca18e680 1 --2- 172.21.15.153:0/1484079152 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f3ab1579d0 0x55f3ab157de0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.146+0000 7f4dca18e680 1 -- 172.21.15.153:0/1484079152 >> 172.21.15.153:0/1484079152 conn(0x55f3ab153cd0 msgr2=0x55f3ab151dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:37.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.146+0000 7f4dca18e680 1 -- 172.21.15.153:0/1484079152 shutdown_connections 2023-10-05T21:15:37.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.146+0000 7f4dca18e680 1 -- 172.21.15.153:0/1484079152 wait complete. 2023-10-05T21:15:37.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.147+0000 7f4dca18e680 1 Processor -- start 2023-10-05T21:15:37.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.147+0000 7f4dca18e680 1 -- start start 2023-10-05T21:15:37.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.147+0000 7f4dca18e680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f3ab1579d0 0x55f3ab15e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.147+0000 7f4dca18e680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3ab15ebf0 con 0x55f3ab1579d0 2023-10-05T21:15:37.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.147+0000 7f4dbca65700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f3ab1579d0 0x55f3ab15e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.147+0000 7f4dbca65700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f3ab1579d0 0x55f3ab15e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:57826/0 (socket says 172.21.15.153:57826) 2023-10-05T21:15:37.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.147+0000 7f4dbca65700 1 -- 172.21.15.153:0/116579101 learned_addr learned my addr 172.21.15.153:0/116579101 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:37.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.147+0000 7f4dbca65700 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3ab07cc30 con 0x55f3ab1579d0 2023-10-05T21:15:37.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.148+0000 7f4dbca65700 1 --2- 172.21.15.153:0/116579101 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f3ab1579d0 0x55f3ab15e6b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4db0003080 tx=0x7f4db0031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.148+0000 7f4cfffff700 1 -- 172.21.15.153:0/116579101 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4db003f640 con 0x55f3ab1579d0 2023-10-05T21:15:37.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.148+0000 7f4cfffff700 1 -- 172.21.15.153:0/116579101 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db0045030 con 0x55f3ab1579d0 2023-10-05T21:15:37.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.148+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f3ab15edf0 con 0x55f3ab1579d0 2023-10-05T21:15:37.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.148+0000 7f4cfffff700 1 -- 172.21.15.153:0/116579101 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4db003f940 con 0x55f3ab1579d0 2023-10-05T21:15:37.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.148+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f3ab15f240 con 0x55f3ab1579d0 2023-10-05T21:15:37.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.148+0000 7f4cfffff700 1 -- 172.21.15.153:0/116579101 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f4db0026040 con 0x55f3ab1579d0 2023-10-05T21:15:37.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.149+0000 7f4cfffff700 1 --2- 172.21.15.153:0/116579101 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4d04034140 0x7f4d040365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.149+0000 7f4cfffff700 1 -- 172.21.15.153:0/116579101 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f4db0031070 con 0x55f3ab1579d0 2023-10-05T21:15:37.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.149+0000 7f4dbda67700 1 --2- 172.21.15.153:0/116579101 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4d04034140 0x7f4d040365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.149+0000 7f4dca18e680 1 --2- 172.21.15.153:0/116579101 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55f3ab1694e0 0x55f3ab16b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.149+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab16c090 con 0x55f3ab1694e0 2023-10-05T21:15:37.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.149+0000 7f4dbd266700 1 --2- 172.21.15.153:0/116579101 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55f3ab1694e0 0x55f3ab16b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.149+0000 7f4dbda67700 1 --2- 172.21.15.153:0/116579101 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4d04034140 0x7f4d040365f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55f3ab14a440 tx=0x7f4db8037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.149+0000 7f4dbd266700 1 --2- 172.21.15.153:0/116579101 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55f3ab1694e0 0x55f3ab16b990 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.150+0000 7f4dbd266700 1 -- 172.21.15.153:0/116579101 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v29'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab1694e0 2023-10-05T21:15:37.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.150+0000 7f4dca18e680 1 --2- 172.21.15.153:0/116579101 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55f3ab16cdd0 0x55f3ab16f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.150+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab16f880 con 0x55f3ab16cdd0 2023-10-05T21:15:37.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.150+0000 7f4dbca65700 1 --2- 172.21.15.153:0/116579101 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55f3ab16cdd0 0x55f3ab16f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.150+0000 7f4dbca65700 1 --2- 172.21.15.153:0/116579101 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55f3ab16cdd0 0x55f3ab16f1b0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.152+0000 7f4dbca65700 1 -- 172.21.15.153:0/116579101 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v29'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4db0034040 con 0x55f3ab16cdd0 2023-10-05T21:15:37.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.152+0000 7f4dca18e680 1 --2- 172.21.15.153:0/116579101 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55f3ab170630 0x55f3ab172ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.152+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab173210 con 0x55f3ab170630 2023-10-05T21:15:37.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.152+0000 7f4dbda67700 1 --2- 172.21.15.153:0/116579101 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55f3ab170630 0x55f3ab172ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.152+0000 7f4dbda67700 1 --2- 172.21.15.153:0/116579101 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55f3ab170630 0x55f3ab172ac0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.153+0000 7f4dbda67700 1 -- 172.21.15.153:0/116579101 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v29'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab170630 2023-10-05T21:15:37.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.153+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab173940 con 0x55f3ab1694e0 2023-10-05T21:15:37.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.154+0000 7f4dbd266700 1 -- 172.21.15.153:0/116579101 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v29'204 uv186 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab1694e0 2023-10-05T21:15:37.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.154+0000 7f4dca18e680 1 --2- 172.21.15.153:0/116579101 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55f3ab1746c0 0x55f3ab176aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.154+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab177130 con 0x55f3ab1746c0 2023-10-05T21:15:37.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.154+0000 7f4dbd266700 1 --2- 172.21.15.153:0/116579101 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55f3ab1746c0 0x55f3ab176aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.154+0000 7f4dbd266700 1 --2- 172.21.15.153:0/116579101 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55f3ab1746c0 0x55f3ab176aa0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.155+0000 7f4dbd266700 1 -- 172.21.15.153:0/116579101 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v29'67 uv58 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab1746c0 2023-10-05T21:15:37.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.155+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab177860 con 0x55f3ab170630 2023-10-05T21:15:37.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.155+0000 7f4dbda67700 1 -- 172.21.15.153:0/116579101 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v29'41 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab170630 2023-10-05T21:15:37.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.155+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab177ee0 con 0x55f3ab1694e0 2023-10-05T21:15:37.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.157+0000 7f4dbd266700 1 -- 172.21.15.153:0/116579101 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v29'26 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab1694e0 2023-10-05T21:15:37.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.157+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab177ee0 con 0x55f3ab16cdd0 2023-10-05T21:15:37.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.157+0000 7f4dbca65700 1 -- 172.21.15.153:0/116579101 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v29'45 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4db0034040 con 0x55f3ab16cdd0 2023-10-05T21:15:37.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.157+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab178580 con 0x55f3ab1746c0 2023-10-05T21:15:37.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.158+0000 7f4dbd266700 1 -- 172.21.15.153:0/116579101 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v29'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab1746c0 2023-10-05T21:15:37.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.158+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab178580 con 0x55f3ab170630 2023-10-05T21:15:37.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.159+0000 7f4dbda67700 1 -- 172.21.15.153:0/116579101 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v29'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab170630 2023-10-05T21:15:37.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.159+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab178c00 con 0x55f3ab1746c0 2023-10-05T21:15:37.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.159+0000 7f4dbd266700 1 -- 172.21.15.153:0/116579101 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v29'68 uv60 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab1746c0 2023-10-05T21:15:37.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.159+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab178b60 con 0x55f3ab16cdd0 2023-10-05T21:15:37.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.160+0000 7f4dbca65700 1 -- 172.21.15.153:0/116579101 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v29'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db0034040 con 0x55f3ab16cdd0 2023-10-05T21:15:37.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.160+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab179180 con 0x55f3ab1746c0 2023-10-05T21:15:37.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.161+0000 7f4dbd266700 1 -- 172.21.15.153:0/116579101 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v29'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab1746c0 2023-10-05T21:15:37.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.161+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab179180 con 0x55f3ab16cdd0 2023-10-05T21:15:37.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.162+0000 7f4dbca65700 1 -- 172.21.15.153:0/116579101 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v29'47 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db0034040 con 0x55f3ab16cdd0 2023-10-05T21:15:37.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.162+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1793d0 con 0x55f3ab1694e0 2023-10-05T21:15:37.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.163+0000 7f4dbd266700 1 -- 172.21.15.153:0/116579101 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v29'205 uv182 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab1694e0 2023-10-05T21:15:37.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.163+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1793d0 con 0x55f3ab170630 2023-10-05T21:15:37.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.164+0000 7f4dbda67700 1 -- 172.21.15.153:0/116579101 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v29'56 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab170630 2023-10-05T21:15:37.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.164+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1793d0 con 0x55f3ab1746c0 2023-10-05T21:15:37.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.165+0000 7f4dbd266700 1 -- 172.21.15.153:0/116579101 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v29'69 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab1746c0 2023-10-05T21:15:37.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.165+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1793d0 con 0x55f3ab170630 2023-10-05T21:15:37.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.165+0000 7f4dbda67700 1 -- 172.21.15.153:0/116579101 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v29'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab170630 2023-10-05T21:15:37.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.165+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1793d0 con 0x55f3ab1694e0 2023-10-05T21:15:37.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.166+0000 7f4dbd266700 1 -- 172.21.15.153:0/116579101 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v29'35 uv32 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab1694e0 2023-10-05T21:15:37.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.166+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1793d0 con 0x55f3ab1694e0 2023-10-05T21:15:37.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.167+0000 7f4dbd266700 1 -- 172.21.15.153:0/116579101 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v29'206 uv184 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab1694e0 2023-10-05T21:15:37.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.167+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1793d0 con 0x55f3ab170630 2023-10-05T21:15:37.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.168+0000 7f4dbda67700 1 -- 172.21.15.153:0/116579101 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v29'57 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab170630 2023-10-05T21:15:37.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.168+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1793d0 con 0x55f3ab1746c0 2023-10-05T21:15:37.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.168+0000 7f4dbd266700 1 -- 172.21.15.153:0/116579101 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v29'51 uv37 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab1746c0 2023-10-05T21:15:37.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.168+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1793d0 con 0x55f3ab170630 2023-10-05T21:15:37.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.169+0000 7f4dbda67700 1 -- 172.21.15.153:0/116579101 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v29'29 uv26 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab170630 2023-10-05T21:15:37.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.169+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1793d0 con 0x55f3ab170630 2023-10-05T21:15:37.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.170+0000 7f4dbda67700 1 -- 172.21.15.153:0/116579101 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v29'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab170630 2023-10-05T21:15:37.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.170+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1793d0 con 0x55f3ab170630 2023-10-05T21:15:37.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.170+0000 7f4dbda67700 1 -- 172.21.15.153:0/116579101 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v29'35 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab170630 2023-10-05T21:15:37.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.170+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1793d0 con 0x55f3ab170630 2023-10-05T21:15:37.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.171+0000 7f4dbda67700 1 -- 172.21.15.153:0/116579101 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v29'42 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab170630 2023-10-05T21:15:37.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.171+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1793d0 con 0x55f3ab16cdd0 2023-10-05T21:15:37.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.172+0000 7f4dbca65700 1 -- 172.21.15.153:0/116579101 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v29'27 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db0034040 con 0x55f3ab16cdd0 2023-10-05T21:15:37.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.172+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1793d0 con 0x55f3ab170630 2023-10-05T21:15:37.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.173+0000 7f4dbda67700 1 -- 172.21.15.153:0/116579101 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v29'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab170630 2023-10-05T21:15:37.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.173+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1793d0 con 0x55f3ab16cdd0 2023-10-05T21:15:37.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.174+0000 7f4dbca65700 1 -- 172.21.15.153:0/116579101 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v29'46 uv38 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db0034040 con 0x55f3ab16cdd0 2023-10-05T21:15:37.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.174+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1793d0 con 0x55f3ab170630 2023-10-05T21:15:37.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.174+0000 7f4dbda67700 1 -- 172.21.15.153:0/116579101 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v29'58 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab170630 2023-10-05T21:15:37.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.175+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1793d0 con 0x55f3ab16cdd0 2023-10-05T21:15:37.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.175+0000 7f4dbca65700 1 -- 172.21.15.153:0/116579101 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v29'48 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4db0034040 con 0x55f3ab16cdd0 2023-10-05T21:15:37.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.175+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1793d0 con 0x55f3ab1746c0 2023-10-05T21:15:37.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.176+0000 7f4dbd266700 1 -- 172.21.15.153:0/116579101 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v29'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab1746c0 2023-10-05T21:15:37.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.177+0000 7f4cfd7fa700 20 reqs_thread_entry: start 2023-10-05T21:15:37.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.177+0000 7f4cf6ffd700 20 reqs_thread_entry: start 2023-10-05T21:15:37.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.177+0000 7f4dca18e680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:37.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.177+0000 7f4dca18e680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:37.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.178+0000 7f4cf57fa700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:16:07 2023 2023-10-05T21:15:37.224 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:37.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.178+0000 7f4cf4ff9700 20 reqs_thread_entry: start 2023-10-05T21:15:37.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.178+0000 7f4dca18e680 20 get_system_obj_state: rctx=0x7ffcb3ae2550 obj=default.rgw.meta:root:myfoo state=0x55f3aafbd240 s->prefetch_data=0 2023-10-05T21:15:37.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.178+0000 7f4dca18e680 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-10-05T21:15:37.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.178+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:102 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d4fc0 con 0x7f4da801a070 2023-10-05T21:15:37.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.178+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(102 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv33 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f4db0034040 con 0x7f4da801a070 2023-10-05T21:15:37.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.178+0000 7f4dca18e680 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x16 2023-10-05T21:15:37.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.178+0000 7f4dca18e680 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:37.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.178+0000 7f4dca18e680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:37.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.178+0000 7f4dca18e680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:37.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.178+0000 7f4dca18e680 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x11, cached=0x16) 2023-10-05T21:15:37.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.178+0000 7f4dca18e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.178+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:103 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d6fe0 con 0x7f4da801a070 2023-10-05T21:15:37.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.178+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(103 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7f4db0034040 con 0x7f4da801a070 2023-10-05T21:15:37.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.178+0000 7f4dca18e680 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T21:15:37.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.178+0000 7f4dca18e680 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2023-10-05T21:15:37.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.178+0000 7f4dca18e680 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:37.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.178+0000 7f4dca18e680 20 get_system_obj_state: rctx=0x7ffcb3ae2550 obj=default.rgw.meta:root:.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 state=0x55f3aafbd500 s->prefetch_data=0 2023-10-05T21:15:37.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.178+0000 7f4dca18e680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 : miss 2023-10-05T21:15:37.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.178+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:104 8.e 8:7627b2dd:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d6510 con 0x7f4db0013ab0 2023-10-05T21:15:37.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.179+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(104 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.179+0000 7f4dca18e680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 info.flags=0x16 2023-10-05T21:15:37.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.179+0000 7f4dca18e680 10 adding default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 to cache LRU end 2023-10-05T21:15:37.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.179+0000 7f4dca18e680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:37.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.179+0000 7f4dca18e680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:37.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.179+0000 7f4dca18e680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:37.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.179+0000 7f4dca18e680 20 Read xattr: user.rgw.acl 2023-10-05T21:15:37.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.179+0000 7f4dca18e680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:37.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.179+0000 7f4dca18e680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:37.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.179+0000 7f4dca18e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.179+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:105 8.e 8:7627b2dd:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d9140 con 0x7f4db0013ab0 2023-10-05T21:15:37.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.179+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(105 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.179+0000 7f4dca18e680 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T21:15:37.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.179+0000 7f4dca18e680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 info.flags=0x13 2023-10-05T21:15:37.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.179+0000 7f4dca18e680 10 moving default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 to cache LRU end 2023-10-05T21:15:37.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.179+0000 7f4dca18e680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:37.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.179+0000 7f4dca18e680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:37.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.179+0000 7f4dca18e680 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 2023-10-05T21:15:37.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.179+0000 7f4dca18e680 10 int RGWRados::cls_bucket_list_unordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, uint32_t, bool, std::vector&, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter) :myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5]) start_after="", prefix="", shard_id=-1", num_entries=1100, list_versions=1, force_check_filter is unset 2023-10-05T21:15:37.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.179+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:106 4.1a 4:596c9839:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d8db0 con 0x7f4da801a070 2023-10-05T21:15:37.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.180+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(106 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.0 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4db0034040 con 0x7f4da801a070 2023-10-05T21:15:37.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.180+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:107 4.20 4:069b8eff:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d8db0 con 0x55f3ab10cf70 2023-10-05T21:15:37.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.180+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(107 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.1 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.180+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:108 4.33 4:ce55c588:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d8db0 con 0x7f4db0013ab0 2023-10-05T21:15:37.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.180+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(108 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.2 [call out=426b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+426 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.180+0000 7f4dca18e680 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2023-10-05T21:15:37.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.180+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 4.1e 4:7b036860:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d8db0 con 0x7f4db0013ab0 2023-10-05T21:15:37.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.181+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(109 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.181+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:110 4.18 4:19ab03a2:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d8d70 con 0x7f4da801a070 2023-10-05T21:15:37.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.181+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(110 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.4 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4db0034040 con 0x7f4da801a070 2023-10-05T21:15:37.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.181+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:111 4.7 4:e373c33d:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d8d70 con 0x7f4db0013ab0 2023-10-05T21:15:37.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.182+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 31 ==== osd_op_reply(111 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.5 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.182+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:112 4.0 4:00da624b:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d8d70 con 0x55f3ab13cdc0 2023-10-05T21:15:37.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.182+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(112 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.6 [call out=425b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+425 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.182+0000 7f4dca18e680 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2023-10-05T21:15:37.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.182+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:113 4.39 4:9c926e0a:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d8d70 con 0x55f3ab13cdc0 2023-10-05T21:15:37.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.182+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(113 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.182+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:114 4.37 4:eef18f7c:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d8d70 con 0x7f4db0013ab0 2023-10-05T21:15:37.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.183+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 32 ==== osd_op_reply(114 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.8 [call out=425b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+425 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.183+0000 7f4dca18e680 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2023-10-05T21:15:37.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.183+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:115 4.32 4:4d6624ea:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d8d70 con 0x55f3ab10cf70 2023-10-05T21:15:37.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.183+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(115 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.183+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:116 4.a 4:51e16db2:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d8d70 con 0x7f4da801a070 2023-10-05T21:15:37.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.184+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== osd_op_reply(116 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.10 [call out=698b] v0'0 uv15 ondisk = 0) v8 ==== 195+0+698 (crc 0 0 0) 0x7f4db0034040 con 0x7f4da801a070 2023-10-05T21:15:37.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.184+0000 7f4dca18e680 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2023-10-05T21:15:37.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.184+0000 7f4dca18e680 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2023-10-05T21:15:37.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.184+0000 7f4dca18e680 20 get_obj_state: rctx=0x7ffcb3ae2180 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55f3ab1d9a58 s->prefetch_data=0 2023-10-05T21:15:37.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.184+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:117 3.2f 3:f6b34931:::193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d8d70 con 0x55f3ab13cdc0 2023-10-05T21:15:37.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.184+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(117 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=879b,stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 262+0+895 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.184+0000 7f4dca18e680 10 manifest: total_size = 6 2023-10-05T21:15:37.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.184+0000 7f4dca18e680 20 get_obj_state: setting s->obj_tag to 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4220.12626231160472352348 2023-10-05T21:15:37.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.184+0000 7f4dca18e680 20 get_obj_state: rctx=0x7ffcb3ae2180 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55f3ab1d9a58 s->prefetch_data=0 2023-10-05T21:15:37.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.184+0000 7f4dca18e680 20 prepare_atomic_modification: state is not atomic. state=0x55f3ab1d9a58 2023-10-05T21:15:37.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.184+0000 7f4dca18e680 20 bucket index object: default.rgw.buckets.index:.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.2 2023-10-05T21:15:37.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.184+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:118 4.33 4:ce55c588:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1de970 con 0x7f4db0013ab0 2023-10-05T21:15:37.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.185+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 33 ==== osd_op_reply(118 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.2 [stat,call,call] v29'4 uv4 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.185+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:119 3.2f 3:f6b34931:::193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1dc3e0 con 0x55f3ab13cdc0 2023-10-05T21:15:37.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.186+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== osd_op_reply(119 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5_9c8454ddf7aa50116496bac348d7550d [call] v29'5 uv5 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.186+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:120 4.33 4:ce55c588:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1defb0 con 0x7f4db0013ab0 2023-10-05T21:15:37.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.186+0000 7f4dca18e680 10 cache get: name=default.rgw.log++bucket.sync-source-hints.myfoo : miss 2023-10-05T21:15:37.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.186+0000 7f4dca18e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.186+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:121 6.18 6:1df25bda:::bucket.sync-source-hints.myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1defb0 con 0x7f4db0013ab0 2023-10-05T21:15:37.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.186+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 34 ==== osd_op_reply(121 bucket.sync-source-hints.myfoo [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 216+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.186+0000 7f4dca18e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.186+0000 7f4dca18e680 10 cache put: name=default.rgw.log++bucket.sync-source-hints.myfoo info.flags=0x0 2023-10-05T21:15:37.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.186+0000 7f4dca18e680 10 adding default.rgw.log++bucket.sync-source-hints.myfoo to cache LRU end 2023-10-05T21:15:37.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.186+0000 7f4dca18e680 10 cache get: name=default.rgw.log++bucket.sync-target-hints.myfoo : miss 2023-10-05T21:15:37.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.186+0000 7f4dca18e680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.186+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:122 6.4 6:26e4c4bc:::bucket.sync-target-hints.myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1defb0 con 0x55f3ab10cf70 2023-10-05T21:15:37.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.187+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(122 bucket.sync-target-hints.myfoo [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 216+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.187+0000 7f4dca18e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.187+0000 7f4dca18e680 10 cache put: name=default.rgw.log++bucket.sync-target-hints.myfoo info.flags=0x0 2023-10-05T21:15:37.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.187+0000 7f4dca18e680 10 adding default.rgw.log++bucket.sync-target-hints.myfoo to cache LRU end 2023-10-05T21:15:37.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.187+0000 7f4dca18e680 10 chain_cache_entry: cache_locator= 2023-10-05T21:15:37.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.187+0000 7f4dca18e680 20 chain_cache_entry: couldn't find cache locator 2023-10-05T21:15:37.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.187+0000 7f4dca18e680 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2023-10-05T21:15:37.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.187+0000 7f4dca18e680 20 get_obj_state: rctx=0x7ffcb3ae2180 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55f3ab1d9a58 s->prefetch_data=0 2023-10-05T21:15:37.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.187+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:123 3.26 3:65f0d7a2:::193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1dfe50 con 0x7f4da801a070 2023-10-05T21:15:37.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.187+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 22 ==== osd_op_reply(123 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x7f4db0034040 con 0x7f4da801a070 2023-10-05T21:15:37.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.187+0000 7f4dca18e680 10 manifest: total_size = 3 2023-10-05T21:15:37.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.187+0000 7f4dca18e680 20 get_obj_state: setting s->obj_tag to 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4220.2163813837243724872 2023-10-05T21:15:37.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.187+0000 7f4dca18e680 20 get_obj_state: rctx=0x7ffcb3ae2180 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55f3ab1d9a58 s->prefetch_data=0 2023-10-05T21:15:37.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.187+0000 7f4dca18e680 20 prepare_atomic_modification: state is not atomic. state=0x55f3ab1d9a58 2023-10-05T21:15:37.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.187+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 35 ==== osd_op_reply(120 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.2 [stat,call,call] v29'5 uv5 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.187+0000 7f4dca18e680 20 bucket index object: default.rgw.buckets.index:.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.6 2023-10-05T21:15:37.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.187+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:124 4.0 4:00da624b:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1de970 con 0x55f3ab13cdc0 2023-10-05T21:15:37.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.187+0000 7f4db6ffd700 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2023-10-05T21:15:37.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.188+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(124 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.6 [stat,call,call] v29'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.188+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:125 3.26 3:65f0d7a2:::193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1de970 con 0x7f4da801a070 2023-10-05T21:15:37.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.189+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 23 ==== osd_op_reply(125 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5_b1b9a972ccd8c962a473909b97007eb4 [call] v29'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f4db0034040 con 0x7f4da801a070 2023-10-05T21:15:37.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.189+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:126 4.0 4:00da624b:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1dd3f0 con 0x55f3ab13cdc0 2023-10-05T21:15:37.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.189+0000 7f4dca18e680 10 cache get: name=default.rgw.log++bucket.sync-source-hints.myfoo : hit (negative entry) 2023-10-05T21:15:37.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.189+0000 7f4dca18e680 10 cache get: name=default.rgw.log++bucket.sync-target-hints.myfoo : hit (negative entry) 2023-10-05T21:15:37.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.189+0000 7f4dca18e680 10 chain_cache_entry: cache_locator= 2023-10-05T21:15:37.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.189+0000 7f4dca18e680 20 chain_cache_entry: couldn't find cache locator 2023-10-05T21:15:37.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.189+0000 7f4dca18e680 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2023-10-05T21:15:37.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.189+0000 7f4dca18e680 20 get_obj_state: rctx=0x7ffcb3ae2180 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55f3ab1d9a58 s->prefetch_data=0 2023-10-05T21:15:37.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.189+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:127 3.2c 3:362754ea:::193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1dd3f0 con 0x55f3ab13cdc0 2023-10-05T21:15:37.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.189+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 31 ==== osd_op_reply(127 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=877b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.189+0000 7f4dca18e680 10 manifest: total_size = 4 2023-10-05T21:15:37.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.189+0000 7f4dca18e680 20 get_obj_state: setting s->obj_tag to 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4220.3212206805811506745 2023-10-05T21:15:37.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.189+0000 7f4dca18e680 20 get_obj_state: rctx=0x7ffcb3ae2180 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55f3ab1d9a58 s->prefetch_data=0 2023-10-05T21:15:37.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.189+0000 7f4dca18e680 20 prepare_atomic_modification: state is not atomic. state=0x55f3ab1d9a58 2023-10-05T21:15:37.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.189+0000 7f4dca18e680 20 bucket index object: default.rgw.buckets.index:.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.8 2023-10-05T21:15:37.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.189+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:128 4.37 4:eef18f7c:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1dd3f0 con 0x7f4db0013ab0 2023-10-05T21:15:37.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.190+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 32 ==== osd_op_reply(126 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.6 [stat,call,call] v29'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.190+0000 7f4db67fc700 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2023-10-05T21:15:37.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.190+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 36 ==== osd_op_reply(128 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.8 [stat,call,call] v29'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.190+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:129 3.2c 3:362754ea:::193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1ddd80 con 0x55f3ab13cdc0 2023-10-05T21:15:37.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.191+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 33 ==== osd_op_reply(129 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v29'4 uv4 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.191+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:130 4.37 4:eef18f7c:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1ddd80 con 0x7f4db0013ab0 2023-10-05T21:15:37.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.191+0000 7f4dca18e680 10 cache get: name=default.rgw.log++bucket.sync-source-hints.myfoo : hit (negative entry) 2023-10-05T21:15:37.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.191+0000 7f4dca18e680 10 cache get: name=default.rgw.log++bucket.sync-target-hints.myfoo : hit (negative entry) 2023-10-05T21:15:37.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.191+0000 7f4dca18e680 10 chain_cache_entry: cache_locator= 2023-10-05T21:15:37.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.191+0000 7f4dca18e680 20 chain_cache_entry: couldn't find cache locator 2023-10-05T21:15:37.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.191+0000 7f4dca18e680 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2023-10-05T21:15:37.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.191+0000 7f4dca18e680 20 get_obj_state: rctx=0x7ffcb3ae2180 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55f3ab1d9a58 s->prefetch_data=0 2023-10-05T21:15:37.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.191+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:131 3.21 3:865e187d:::193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1e1780 con 0x7f4db0013ab0 2023-10-05T21:15:37.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.192+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 37 ==== osd_op_reply(131 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=879b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 262+0+895 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.192+0000 7f4dca18e680 10 manifest: total_size = 5 2023-10-05T21:15:37.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.192+0000 7f4dca18e680 20 get_obj_state: setting s->obj_tag to 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4220.11453952485679179291 2023-10-05T21:15:37.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.192+0000 7f4dca18e680 20 get_obj_state: rctx=0x7ffcb3ae2180 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55f3ab1d9a58 s->prefetch_data=0 2023-10-05T21:15:37.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.192+0000 7f4dca18e680 20 prepare_atomic_modification: state is not atomic. state=0x55f3ab1d9a58 2023-10-05T21:15:37.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.192+0000 7f4dca18e680 20 bucket index object: default.rgw.buckets.index:.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.10 2023-10-05T21:15:37.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.192+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:132 4.a 4:51e16db2:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1e57c0 con 0x7f4da801a070 2023-10-05T21:15:37.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.192+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 38 ==== osd_op_reply(130 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.8 [stat,call,call] v29'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.192+0000 7f4db6ffd700 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2023-10-05T21:15:37.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.193+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 24 ==== osd_op_reply(132 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.10 [stat,call,call] v29'16 uv16 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f4db0034040 con 0x7f4da801a070 2023-10-05T21:15:37.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.193+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:133 3.21 3:865e187d:::193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1de970 con 0x7f4db0013ab0 2023-10-05T21:15:37.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.194+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 39 ==== osd_op_reply(133 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5_24d27c169c2c881eb09a065116f2aa5c [call] v29'4 uv4 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.194+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:134 4.a 4:51e16db2:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1e1780 con 0x7f4da801a070 2023-10-05T21:15:37.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.194+0000 7f4dca18e680 10 cache get: name=default.rgw.log++bucket.sync-source-hints.myfoo : hit (negative entry) 2023-10-05T21:15:37.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.194+0000 7f4dca18e680 10 cache get: name=default.rgw.log++bucket.sync-target-hints.myfoo : hit (negative entry) 2023-10-05T21:15:37.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.194+0000 7f4dca18e680 10 chain_cache_entry: cache_locator= 2023-10-05T21:15:37.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.194+0000 7f4dca18e680 20 chain_cache_entry: couldn't find cache locator 2023-10-05T21:15:37.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.194+0000 7f4dca18e680 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2023-10-05T21:15:37.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.194+0000 7f4dca18e680 20 get_obj_state: rctx=0x7ffcb3ae2180 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55f3ab1d9a58 s->prefetch_data=0 2023-10-05T21:15:37.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.194+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:135 3.2f 3:f67a3996:::193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1e25d0 con 0x55f3ab13cdc0 2023-10-05T21:15:37.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.194+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 34 ==== osd_op_reply(135 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 262+0+927 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.194+0000 7f4dca18e680 10 manifest: total_size = 5 2023-10-05T21:15:37.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.194+0000 7f4dca18e680 20 get_obj_state: setting s->obj_tag to _MkG5s3WkxgyXJJdQR1IwmgYRyiYpxtc 2023-10-05T21:15:37.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.194+0000 7f4dca18e680 20 get_obj_state: rctx=0x7ffcb3ae2180 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55f3ab1d9a58 s->prefetch_data=0 2023-10-05T21:15:37.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.194+0000 7f4dca18e680 20 prepare_atomic_modification: state is not atomic. state=0x55f3ab1d9a58 2023-10-05T21:15:37.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.194+0000 7f4dca18e680 20 bucket index object: default.rgw.buckets.index:.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.10 2023-10-05T21:15:37.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.194+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:136 4.a 4:51e16db2:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1e5600 con 0x7f4da801a070 2023-10-05T21:15:37.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.194+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 25 ==== osd_op_reply(134 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.10 [stat,call,call] v29'17 uv17 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f4db0034040 con 0x7f4da801a070 2023-10-05T21:15:37.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.194+0000 7f4db67fc700 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2023-10-05T21:15:37.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.195+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 26 ==== osd_op_reply(136 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.10 [stat,call,call] v29'18 uv18 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f4db0034040 con 0x7f4da801a070 2023-10-05T21:15:37.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.195+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:137 3.2f 3:f67a3996:::193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1da3c0 con 0x55f3ab13cdc0 2023-10-05T21:15:37.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.196+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 35 ==== osd_op_reply(137 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5_bb3aec0fdcdbc2974890f805c585d432 [call] v29'6 uv6 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.196+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:138 4.a 4:51e16db2:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1dc8d0 con 0x7f4da801a070 2023-10-05T21:15:37.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.196+0000 7f4dca18e680 10 cache get: name=default.rgw.log++bucket.sync-source-hints.myfoo : hit (negative entry) 2023-10-05T21:15:37.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.196+0000 7f4dca18e680 10 cache get: name=default.rgw.log++bucket.sync-target-hints.myfoo : hit (negative entry) 2023-10-05T21:15:37.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.196+0000 7f4dca18e680 10 chain_cache_entry: cache_locator= 2023-10-05T21:15:37.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.196+0000 7f4dca18e680 20 chain_cache_entry: couldn't find cache locator 2023-10-05T21:15:37.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.196+0000 7f4dca18e680 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2023-10-05T21:15:37.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.196+0000 7f4dca18e680 20 int RGWRados::Bucket::List::list_objects_ordered(const DoutPrefixProvider*, int64_t, std::vector*, std::map, bool>*, bool*, optional_yield): starting attempt 1 2023-10-05T21:15:37.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.196+0000 7f4dca18e680 10 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): :myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5]) start_after="_multipart_", prefix="_multipart_, delimiter="", shard_id=-1", num_entries=1001, list_versions=0, expansion_factor=1, force_check_filter is unset 2023-10-05T21:15:37.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.196+0000 7f4dca18e680 10 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-10-05T21:15:37.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.196+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:139 4.1a 4:596c9839:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f4da806f000 con 0x7f4da801a070 2023-10-05T21:15:37.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.196+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:140 4.20 4:069b8eff:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d9d60 con 0x55f3ab10cf70 2023-10-05T21:15:37.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.196+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:141 4.33 4:ce55c588:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1e54d0 con 0x7f4db0013ab0 2023-10-05T21:15:37.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.196+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:142 4.1e 4:7b036860:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d9d60 con 0x7f4db0013ab0 2023-10-05T21:15:37.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.196+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:143 4.18 4:19ab03a2:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1e54d0 con 0x7f4da801a070 2023-10-05T21:15:37.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.196+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:144 4.7 4:e373c33d:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1f1000 con 0x7f4db0013ab0 2023-10-05T21:15:37.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.196+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:145 4.0 4:00da624b:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1f3d80 con 0x55f3ab13cdc0 2023-10-05T21:15:37.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.196+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:146 4.39 4:9c926e0a:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1f6c50 con 0x55f3ab13cdc0 2023-10-05T21:15:37.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.196+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:147 4.37 4:eef18f7c:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1f9b20 con 0x7f4db0013ab0 2023-10-05T21:15:37.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.196+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:148 4.32 4:4d6624ea:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1fc550 con 0x55f3ab10cf70 2023-10-05T21:15:37.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.196+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:149 4.a 4:51e16db2:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1fefb0 con 0x7f4da801a070 2023-10-05T21:15:37.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.196+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(140 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.1 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.197+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 36 ==== osd_op_reply(145 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.6 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.197+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 27 ==== osd_op_reply(139 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.0 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4db0034040 con 0x7f4da801a070 2023-10-05T21:15:37.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.197+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 40 ==== osd_op_reply(147 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.8 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.197+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 41 ==== osd_op_reply(142 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.197+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 42 ==== osd_op_reply(144 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.5 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.197+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 43 ==== osd_op_reply(141 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.2 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.197+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 37 ==== osd_op_reply(146 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.197+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(148 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.197+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 28 ==== osd_op_reply(143 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.4 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4db0034040 con 0x7f4da801a070 2023-10-05T21:15:37.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.197+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 29 ==== osd_op_reply(138 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.10 [stat,call,call] v29'19 uv19 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f4db0034040 con 0x7f4da801a070 2023-10-05T21:15:37.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.197+0000 7f4db67fc700 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2023-10-05T21:15:37.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.197+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 30 ==== osd_op_reply(149 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.10 [call out=124b] v0'0 uv19 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7f4db0034040 con 0x7f4da801a070 2023-10-05T21:15:37.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.197+0000 7f4dca18e680 20 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): returning, count=0, is_truncated=0 2023-10-05T21:15:37.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.197+0000 7f4dca18e680 20 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): returning, last_entry NOT SET 2023-10-05T21:15:37.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.197+0000 7f4dca18e680 10 int RGWRados::Bucket::List::list_objects_ordered(const DoutPrefixProvider*, int64_t, std::vector*, std::map, bool>*, bool*, optional_yield): end of outer loop, truncated=0, count=0, attempt=1 2023-10-05T21:15:37.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.197+0000 7f4dca18e680 10 int RGWRados::Bucket::List::list_objects_ordered(const DoutPrefixProvider*, int64_t, std::vector*, std::map, bool>*, bool*, optional_yield): exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-10-05T21:15:37.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.197+0000 7f4dca18e680 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5])"; uploads.size()=0; is_truncated=0 2023-10-05T21:15:37.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.197+0000 7f4dca18e680 10 lifecycle: RGWRados::convert_old_bucket_info(): bucket=:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5]) 2023-10-05T21:15:37.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.197+0000 7f4dca18e680 20 lifecycle: get_system_obj_state: rctx=0x7ffcb3ae1c48 obj=default.rgw.meta:root:myfoo state=0x55f3aafbd500 s->prefetch_data=0 2023-10-05T21:15:37.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.197+0000 7f4dca18e680 10 lifecycle: cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x16, cached=0x13) 2023-10-05T21:15:37.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.197+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1fefb0 con 0x7f4da801a070 2023-10-05T21:15:37.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.198+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 31 ==== osd_op_reply(150 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv33 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f4db0034040 con 0x7f4da801a070 2023-10-05T21:15:37.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.198+0000 7f4dca18e680 10 lifecycle: cache put: name=default.rgw.meta+root+myfoo info.flags=0x16 2023-10-05T21:15:37.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.198+0000 7f4dca18e680 10 lifecycle: moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:15:37.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.198+0000 7f4dca18e680 10 lifecycle: updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:37.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.198+0000 7f4dca18e680 20 lifecycle: get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:37.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.198+0000 7f4dca18e680 20 lifecycle: Read xattr: user.rgw.idtag 2023-10-05T21:15:37.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.198+0000 7f4dca18e680 10 lifecycle: cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x13, cached=0x17) 2023-10-05T21:15:37.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.198+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:151 8.e 8:7627b2dd:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1fefb0 con 0x7f4db0013ab0 2023-10-05T21:15:37.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.199+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 44 ==== osd_op_reply(151 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 [delete,create,call,call,writefull 0~352,setxattr (123)] v29'4 uv4 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.199+0000 7f4dca18e680 10 lifecycle: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 info.flags=0x17 2023-10-05T21:15:37.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.199+0000 7f4dca18e680 10 lifecycle: moving default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 to cache LRU end 2023-10-05T21:15:37.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.199+0000 7f4dca18e680 10 lifecycle: updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:37.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.199+0000 7f4dca18e680 10 lifecycle: distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5, ofs0, ns] 2023-10-05T21:15:37.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.199+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:152 7.15 7:a93a5511:::notify.2:head [notify cookie 94505036410800 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d6be0 con 0x55f3ab13cdc0 2023-10-05T21:15:37.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.199+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 38 ==== watch-notify(notify (1) cookie 94505035651728 notify 124554051600 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x55f3ab12f550 con 0x55f3ab13cdc0 2023-10-05T21:15:37.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.199+0000 7f4db67fc700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051600 cookie 94505035651728 notifier 4640 bl.length()=725 2023-10-05T21:15:37.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.199+0000 7f4db67fc700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 info.flags=0x17 2023-10-05T21:15:37.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.199+0000 7f4db67fc700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 to cache LRU end 2023-10-05T21:15:37.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.199+0000 7f4db67fc700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:15:37.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.199+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 39 ==== osd_op_reply(152 notify.2 [notify cookie 94505036410800 out=8b] v0'0 uv207 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.199+0000 7f4db67fc700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:153 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f4d0c0034e0 con 0x55f3ab13cdc0 2023-10-05T21:15:37.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.199+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 40 ==== osd_op_reply(153 notify.2 [notify-ack] v0'0 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.200+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 41 ==== watch-notify(notify_complete (2) cookie 94505036410800 notify 124554051600 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55f3ab12f100 con 0x55f3ab13cdc0 2023-10-05T21:15:37.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.200+0000 7f4dca18e680 20 lifecycle: handle_bi_update(): bucket=:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5]): orig_sources= new_sources= 2023-10-05T21:15:37.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.200+0000 7f4dca18e680 20 lifecycle: handle_bi_update(): bucket=:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5]): potential sources added=[] removed=[] 2023-10-05T21:15:37.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.200+0000 7f4dca18e680 20 lifecycle: handle_bi_update(): bucket=:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5]): orig_dests= new_dests= 2023-10-05T21:15:37.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.200+0000 7f4dca18e680 20 lifecycle: handle_bi_update(): bucket=:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5]): potential dests added=[] removed=[] 2023-10-05T21:15:37.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.200+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:33 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=65b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1fefb0 con 0x55f3ab170630 2023-10-05T21:15:37.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.200+0000 7f4dbda67700 1 -- 172.21.15.153:0/116579101 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(33 lc.18 [call] v29'28 uv28 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab170630 2023-10-05T21:15:37.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.200+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 6.1a 6:5f2e3d26:lc::lc.18:head [call rgw.lc_rm_entry in=92b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1fefb0 con 0x55f3ab170630 2023-10-05T21:15:37.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.201+0000 7f4dbda67700 1 -- 172.21.15.153:0/116579101 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(34 lc.18 [call] v29'29 uv29 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab170630 2023-10-05T21:15:37.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.201+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:35 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.unlock in=49b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1fefb0 con 0x55f3ab170630 2023-10-05T21:15:37.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.202+0000 7f4dbda67700 1 -- 172.21.15.153:0/116579101 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(35 lc.18 [call] v29'30 uv30 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab170630 2023-10-05T21:15:37.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.202+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:154 4.1a 4:596c9839:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1fefb0 con 0x7f4da801a070 2023-10-05T21:15:37.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.202+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:155 4.20 4:069b8eff:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1f65c0 con 0x55f3ab10cf70 2023-10-05T21:15:37.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.202+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:156 4.33 4:ce55c588:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1f48b0 con 0x7f4db0013ab0 2023-10-05T21:15:37.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.202+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:157 4.1e 4:7b036860:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1fefb0 con 0x7f4db0013ab0 2023-10-05T21:15:37.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.202+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:158 4.18 4:19ab03a2:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1f65c0 con 0x7f4da801a070 2023-10-05T21:15:37.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.202+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:159 4.7 4:e373c33d:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1f48b0 con 0x7f4db0013ab0 2023-10-05T21:15:37.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.202+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:160 4.0 4:00da624b:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1fefb0 con 0x55f3ab13cdc0 2023-10-05T21:15:37.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.202+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:161 4.39 4:9c926e0a:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1e53d0 con 0x55f3ab13cdc0 2023-10-05T21:15:37.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.202+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:162 4.37 4:eef18f7c:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1f48b0 con 0x7f4db0013ab0 2023-10-05T21:15:37.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.202+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:163 4.32 4:4d6624ea:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1fbe90 con 0x55f3ab10cf70 2023-10-05T21:15:37.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.202+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:164 4.a 4:51e16db2:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1f48b0 con 0x7f4da801a070 2023-10-05T21:15:37.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.202+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(155 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.1 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.202+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 32 ==== osd_op_reply(154 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.0 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4db0034040 con 0x7f4da801a070 2023-10-05T21:15:37.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.202+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== osd_op_reply(163 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.202+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 45 ==== osd_op_reply(156 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.2 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.202+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 46 ==== osd_op_reply(162 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.8 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.202+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 47 ==== osd_op_reply(159 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.5 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.202+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 48 ==== osd_op_reply(157 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.202+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 33 ==== osd_op_reply(158 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.4 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4db0034040 con 0x7f4da801a070 2023-10-05T21:15:37.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.202+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 42 ==== osd_op_reply(160 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.6 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.202+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 43 ==== osd_op_reply(161 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.202+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 34 ==== osd_op_reply(164 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.10 [call out=124b] v0'0 uv19 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7f4db0034040 con 0x7f4da801a070 2023-10-05T21:15:37.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.202+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:165 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1fefb0 con 0x7f4da801a070 2023-10-05T21:15:37.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.203+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 35 ==== osd_op_reply(165 foo.buckets [call] v29'36 uv36 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f4db0034040 con 0x7f4da801a070 2023-10-05T21:15:37.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.203+0000 7f4dca18e680 20 get_system_obj_state: rctx=0x7ffcb3ae16a8 obj=default.rgw.meta:root:myfoo state=0x55f3aafbd500 s->prefetch_data=0 2023-10-05T21:15:37.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.203+0000 7f4dca18e680 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x16, cached=0x17) 2023-10-05T21:15:37.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.203+0000 7f4dca18e680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:37.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.203+0000 7f4dca18e680 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x17) 2023-10-05T21:15:37.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.203+0000 7f4dca18e680 10 removing default.rgw.meta+root+myfoo from cache 2023-10-05T21:15:37.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.203+0000 7f4dca18e680 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2023-10-05T21:15:37.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.203+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:166 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94505036410800 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d6be0 con 0x7f4db0013ab0 2023-10-05T21:15:37.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.204+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 49 ==== watch-notify(notify (1) cookie 94505035667920 notify 124554051605 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x7f4db8029040 con 0x7f4db0013ab0 2023-10-05T21:15:37.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.204+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 50 ==== osd_op_reply(166 notify.6 [notify cookie 94505036410800 out=8b] v0'0 uv207 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.204+0000 7f4db6ffd700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051605 cookie 94505035667920 notifier 4640 bl.length()=149 2023-10-05T21:15:37.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.204+0000 7f4db6ffd700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:167 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f4d9c003c50 con 0x7f4db0013ab0 2023-10-05T21:15:37.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.204+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 51 ==== watch-notify(notify_complete (2) cookie 94505036410800 notify 124554051605 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f4db8066060 con 0x7f4db0013ab0 2023-10-05T21:15:37.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.204+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 52 ==== osd_op_reply(167 notify.6 [notify-ack] v0'0 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.204+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:168 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d6be0 con 0x7f4da801a070 2023-10-05T21:15:37.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.205+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 36 ==== osd_op_reply(168 myfoo [call,call,delete] v29'37 uv37 ondisk = 0) v8 ==== 233+0+0 (crc 0 0 0) 0x7f4db0034040 con 0x7f4da801a070 2023-10-05T21:15:37.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.205+0000 7f4dca18e680 10 removing default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 from cache 2023-10-05T21:15:37.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.205+0000 7f4dca18e680 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5, ofs0, ns] 2023-10-05T21:15:37.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.205+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:169 7.15 7:a93a5511:::notify.2:head [notify cookie 94505036410800 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d6be0 con 0x55f3ab13cdc0 2023-10-05T21:15:37.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.205+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 44 ==== watch-notify(notify (1) cookie 94505035651728 notify 124554051601 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x55f3ab12f100 con 0x55f3ab13cdc0 2023-10-05T21:15:37.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.205+0000 7f4db67fc700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051601 cookie 94505035651728 notifier 4640 bl.length()=206 2023-10-05T21:15:37.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.205+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 45 ==== osd_op_reply(169 notify.2 [notify cookie 94505036410800 out=8b] v0'0 uv207 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.205+0000 7f4db67fc700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:170 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f4d0c0034c0 con 0x55f3ab13cdc0 2023-10-05T21:15:37.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.206+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 46 ==== watch-notify(notify_complete (2) cookie 94505036410800 notify 124554051601 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55f3ab057930 con 0x55f3ab13cdc0 2023-10-05T21:15:37.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.206+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 47 ==== osd_op_reply(170 notify.2 [notify-ack] v0'0 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.206+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:171 8.e 8:7627b2dd:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d6be0 con 0x7f4db0013ab0 2023-10-05T21:15:37.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.207+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 53 ==== osd_op_reply(171 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 [call,call,delete] v29'5 uv5 ondisk = 0) v8 ==== 290+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.207+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:172 4.1a 4:596c9839:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d6be0 con 0x7f4da801a070 2023-10-05T21:15:37.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.207+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:173 4.20 4:069b8eff:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1fefb0 con 0x55f3ab10cf70 2023-10-05T21:15:37.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.207+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:174 4.33 4:ce55c588:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1e0860 con 0x7f4db0013ab0 2023-10-05T21:15:37.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.207+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:175 4.1e 4:7b036860:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d3ac0 con 0x7f4db0013ab0 2023-10-05T21:15:37.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.207+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:176 4.18 4:19ab03a2:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1fefb0 con 0x7f4da801a070 2023-10-05T21:15:37.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.207+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:177 4.7 4:e373c33d:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d6be0 con 0x7f4db0013ab0 2023-10-05T21:15:37.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.207+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:178 4.0 4:00da624b:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1e0860 con 0x55f3ab13cdc0 2023-10-05T21:15:37.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.207+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:179 4.39 4:9c926e0a:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d3ac0 con 0x55f3ab13cdc0 2023-10-05T21:15:37.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.207+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:180 4.37 4:eef18f7c:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d6be0 con 0x7f4db0013ab0 2023-10-05T21:15:37.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.207+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:181 4.32 4:4d6624ea:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1fefb0 con 0x55f3ab10cf70 2023-10-05T21:15:37.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.207+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:182 4.a 4:51e16db2:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1f4c60 con 0x7f4da801a070 2023-10-05T21:15:37.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.208+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 37 ==== osd_op_reply(176 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.4 [delete] v29'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f4db0034040 con 0x7f4da801a070 2023-10-05T21:15:37.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.208+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 38 ==== osd_op_reply(172 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.0 [delete] v29'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f4db0034040 con 0x7f4da801a070 2023-10-05T21:15:37.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.208+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 54 ==== osd_op_reply(174 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.2 [delete] v29'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.208+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 39 ==== osd_op_reply(182 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.10 [delete] v29'20 uv20 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f4db0034040 con 0x7f4da801a070 2023-10-05T21:15:37.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.209+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 48 ==== osd_op_reply(179 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.7 [delete] v29'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.209+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 42 ==== osd_op_reply(181 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.9 [delete] v29'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.209+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 43 ==== osd_op_reply(173 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.1 [delete] v29'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.209+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 55 ==== osd_op_reply(180 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.8 [delete] v29'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.209+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 56 ==== osd_op_reply(175 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.3 [delete] v29'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.209+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 57 ==== osd_op_reply(177 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.5 [delete] v29'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.209+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 49 ==== osd_op_reply(178 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5.6 [delete] v29'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.209+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:183 6.d 6:b0fde540:::pubsub..bucket.myfoo%2f193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d6be0 con 0x55f3ab10cf70 2023-10-05T21:15:37.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.209+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 44 ==== osd_op_reply(183 pubsub..bucket.myfoo/193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 [getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 250+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.209+0000 7f4dca18e680 10 removing default.rgw.log++pubsub..bucket.myfoo/193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 from cache 2023-10-05T21:15:37.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.209+0000 7f4dca18e680 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo/193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5, ofs0, ns] 2023-10-05T21:15:37.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.209+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:184 7.0 7:05bf5b68:::notify.1:head [notify cookie 94505036410624 in=215b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d6be0 con 0x55f3ab10cf70 2023-10-05T21:15:37.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.209+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 45 ==== watch-notify(notify (1) cookie 94505035650336 notify 124554051606 ret 0) v3 ==== 245+0+0 (crc 0 0 0) 0x7f4db8066060 con 0x55f3ab10cf70 2023-10-05T21:15:37.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.209+0000 7f4db6ffd700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051606 cookie 94505035650336 notifier 4640 bl.length()=203 2023-10-05T21:15:37.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.209+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 46 ==== osd_op_reply(184 notify.1 [notify cookie 94505036410624 out=8b] v0'0 uv207 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.209+0000 7f4db6ffd700 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:185 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f4d9c003c50 con 0x55f3ab10cf70 2023-10-05T21:15:37.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.210+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 47 ==== watch-notify(notify_complete (2) cookie 94505036410624 notify 124554051606 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f4db802d040 con 0x55f3ab10cf70 2023-10-05T21:15:37.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.210+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 48 ==== osd_op_reply(185 notify.1 [notify-ack] v0'0 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.210+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:186 6.d 6:b0fde540:::pubsub..bucket.myfoo%2f193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d6be0 con 0x55f3ab10cf70 2023-10-05T21:15:37.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.211+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 49 ==== osd_op_reply(186 pubsub..bucket.myfoo/193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.5 [delete] v29'36 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.211+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:187 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d6be0 con 0x7f4da801a070 2023-10-05T21:15:37.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.211+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 40 ==== osd_op_reply(187 foo.buckets [call] v29'38 uv38 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f4db0034040 con 0x7f4da801a070 2023-10-05T21:15:37.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.212+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:188 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94505035644976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d6be0 con 0x7f4da801a070 2023-10-05T21:15:37.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.212+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 41 ==== osd_op_reply(188 notify.0 [watch unwatch cookie 94505035644976] v29'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db0034040 con 0x7f4da801a070 2023-10-05T21:15:37.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.212+0000 7f4dca18e680 20 remove_watcher() i=0 2023-10-05T21:15:37.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.212+0000 7f4dca18e680 2 removed watcher, disabling cache 2023-10-05T21:15:37.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.212+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:189 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94505035650336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d6be0 con 0x55f3ab10cf70 2023-10-05T21:15:37.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.213+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 50 ==== osd_op_reply(189 notify.1 [watch unwatch cookie 94505035650336] v29'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.213+0000 7f4dca18e680 20 remove_watcher() i=1 2023-10-05T21:15:37.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.213+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:190 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94505035651728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d6be0 con 0x55f3ab13cdc0 2023-10-05T21:15:37.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.214+0000 7f4dbd266700 1 -- 172.21.15.153:0/2730456551 <== osd.3 v2:172.21.15.153:6800/140455 50 ==== osd_op_reply(190 notify.2 [watch unwatch cookie 94505035651728] v29'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4da804a040 con 0x55f3ab13cdc0 2023-10-05T21:15:37.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.214+0000 7f4dca18e680 20 remove_watcher() i=2 2023-10-05T21:15:37.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.214+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:191 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94505035652832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d6be0 con 0x7f4da801a070 2023-10-05T21:15:37.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.215+0000 7f4dbca65700 1 -- 172.21.15.153:0/2730456551 <== osd.2 v2:172.21.15.153:6807/140454 42 ==== osd_op_reply(191 notify.3 [watch unwatch cookie 94505035652832] v29'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db0034040 con 0x7f4da801a070 2023-10-05T21:15:37.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.215+0000 7f4dca18e680 20 remove_watcher() i=3 2023-10-05T21:15:37.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.215+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:192 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94505035661664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d6be0 con 0x55f3ab10cf70 2023-10-05T21:15:37.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.215+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 51 ==== osd_op_reply(192 notify.4 [watch unwatch cookie 94505035661664] v29'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.215+0000 7f4dca18e680 20 remove_watcher() i=4 2023-10-05T21:15:37.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.215+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:193 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94505035663328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d6be0 con 0x7f4db0013ab0 2023-10-05T21:15:37.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.216+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 58 ==== osd_op_reply(193 notify.5 [watch unwatch cookie 94505035663328] v29'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.216+0000 7f4dca18e680 20 remove_watcher() i=5 2023-10-05T21:15:37.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.216+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:194 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94505035667920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d6be0 con 0x7f4db0013ab0 2023-10-05T21:15:37.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.217+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 59 ==== osd_op_reply(194 notify.6 [watch unwatch cookie 94505035667920] v29'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.217+0000 7f4dca18e680 20 remove_watcher() i=6 2023-10-05T21:15:37.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.217+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:195 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94505035669216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d6be0 con 0x7f4db0013ab0 2023-10-05T21:15:37.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.218+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.0 v2:172.21.15.111:6800/111394 60 ==== osd_op_reply(195 notify.7 [watch unwatch cookie 94505035669216] v29'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x7f4db0013ab0 2023-10-05T21:15:37.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.218+0000 7f4dca18e680 20 remove_watcher() i=7 2023-10-05T21:15:37.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.219+0000 7f4d8e7e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:37.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.219+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:196 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94505035672160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55f3ab1d6be0 con 0x55f3ab10cf70 2023-10-05T21:15:37.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.219+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 <== osd.1 v2:172.21.15.153:6816/140456 52 ==== osd_op_reply(196 data_loggenerations_metadata [watch unwatch cookie 94505035672160] v29'207 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4db800a570 con 0x55f3ab10cf70 2023-10-05T21:15:37.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.219+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4db0013ab0 msgr2=0x7f4db001d410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.219+0000 7f4dca18e680 1 --2- 172.21.15.153:0/2730456551 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4db0013ab0 0x7f4db001d410 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.219+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55f3ab10cf70 msgr2=0x55f3ab13a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.219+0000 7f4dca18e680 1 --2- 172.21.15.153:0/2730456551 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55f3ab10cf70 0x55f3ab13a950 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.219+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4da801a070 msgr2=0x7f4da8030790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.219+0000 7f4dca18e680 1 --2- 172.21.15.153:0/2730456551 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4da801a070 0x7f4da8030790 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.219+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55f3ab13cdc0 msgr2=0x55f3ab13f1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.219+0000 7f4dca18e680 1 --2- 172.21.15.153:0/2730456551 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55f3ab13cdc0 0x55f3ab13f1a0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.219+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4da00340f0 msgr2=0x7f4da00365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.219+0000 7f4dca18e680 1 --2- 172.21.15.153:0/2730456551 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4da00340f0 0x7f4da00365a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4db0005b50 tx=0x7f4db0018000 comp rx=0 tx=0).stop 2023-10-05T21:15:37.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.219+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f3ab108a40 msgr2=0x55f3ab12ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.219+0000 7f4dca18e680 1 --2- 172.21.15.153:0/2730456551 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f3ab108a40 0x55f3ab12ebc0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4da80018e0 tx=0x7f4da8016000 comp rx=0 tx=0).stop 2023-10-05T21:15:37.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.220+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 reap_dead start 2023-10-05T21:15:37.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.220+0000 7f4dbda67700 1 -- 172.21.15.153:0/2730456551 reap_dead start 2023-10-05T21:15:37.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.220+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 shutdown_connections 2023-10-05T21:15:37.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.220+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 >> 172.21.15.153:0/2730456551 conn(0x55f3ab104310 msgr2=0x55f3ab121a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:37.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.220+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 shutdown_connections 2023-10-05T21:15:37.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.220+0000 7f4dca18e680 1 -- 172.21.15.153:0/2730456551 wait complete. 2023-10-05T21:15:37.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.220+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55f3ab16cdd0 msgr2=0x55f3ab16f1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.220+0000 7f4dca18e680 1 --2- 172.21.15.153:0/116579101 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55f3ab16cdd0 0x55f3ab16f1b0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.220+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55f3ab1694e0 msgr2=0x55f3ab16b990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.220+0000 7f4dca18e680 1 --2- 172.21.15.153:0/116579101 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55f3ab1694e0 0x55f3ab16b990 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.220+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55f3ab1746c0 msgr2=0x55f3ab176aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.220+0000 7f4dca18e680 1 --2- 172.21.15.153:0/116579101 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55f3ab1746c0 0x55f3ab176aa0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.220+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55f3ab170630 msgr2=0x55f3ab172ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.220+0000 7f4dca18e680 1 --2- 172.21.15.153:0/116579101 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55f3ab170630 0x55f3ab172ac0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.220+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4d04034140 msgr2=0x7f4d040365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.220+0000 7f4dca18e680 1 --2- 172.21.15.153:0/116579101 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4d04034140 0x7f4d040365f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55f3ab14a440 tx=0x7f4db8037450 comp rx=0 tx=0).stop 2023-10-05T21:15:37.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.220+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f3ab1579d0 msgr2=0x55f3ab15e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.220+0000 7f4dca18e680 1 --2- 172.21.15.153:0/116579101 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f3ab1579d0 0x55f3ab15e6b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4db0003080 tx=0x7f4db0031000 comp rx=0 tx=0).stop 2023-10-05T21:15:37.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.220+0000 7f4dbd266700 1 -- 172.21.15.153:0/116579101 reap_dead start 2023-10-05T21:15:37.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.220+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 shutdown_connections 2023-10-05T21:15:37.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.220+0000 7f4dca18e680 1 --2- 172.21.15.153:0/116579101 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f3ab1579d0 0x55f3ab15e6b0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.220+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 >> 172.21.15.153:0/116579101 conn(0x55f3ab153cd0 msgr2=0x55f3ab151da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:37.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.220+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 shutdown_connections 2023-10-05T21:15:37.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.220+0000 7f4dca18e680 1 -- 172.21.15.153:0/116579101 wait complete. 2023-10-05T21:15:37.271 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2023-10-05T21:15:37.271 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2023-10-05T21:15:37.272 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2023-10-05T21:15:37.318 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:37.318 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:37.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.317+0000 7f12b1d50680 1 Processor -- start 2023-10-05T21:15:37.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.317+0000 7f12b1d50680 1 -- start start 2023-10-05T21:15:37.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.317+0000 7f12b1d50680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55e697510bf0 0x55e697512fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.317+0000 7f12b1d50680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e697459930 con 0x55e69750a7c0 2023-10-05T21:15:37.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.317+0000 7f12b1d50680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e697419db0 con 0x55e697510bf0 2023-10-05T21:15:37.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.318+0000 7f129ffff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55e697510bf0 0x55e697512fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.318+0000 7f12a4e28700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55e69750a7c0 0x55e69750abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:54120/0 (socket says 172.21.15.153:54120) 2023-10-05T21:15:37.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.318+0000 7f12a4e28700 1 -- 172.21.15.153:0/2827428048 learned_addr learned my addr 172.21.15.153:0/2827428048 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:15:37.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.318+0000 7f129f7fe700 1 -- 172.21.15.153:0/2827428048 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2953740489 0 0) 0x55e697459930 con 0x55e69750a7c0 2023-10-05T21:15:37.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.318+0000 7f129f7fe700 1 -- 172.21.15.153:0/2827428048 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1294001e10 con 0x55e69750a7c0 2023-10-05T21:15:37.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.318+0000 7f129ffff700 1 -- 172.21.15.153:0/2827428048 >> v1:172.21.15.111:6789/0 conn(0x55e69750a7c0 legacy=0x55e69750abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.318+0000 7f129ffff700 1 -- 172.21.15.153:0/2827428048 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e697514520 con 0x55e697510bf0 2023-10-05T21:15:37.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.318+0000 7f129ffff700 1 --2- 172.21.15.153:0/2827428048 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e697510bf0 0x55e697512fd0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f129800a5d0 tx=0x7f1298005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f1a88a431b03a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.318+0000 7f129f7fe700 1 -- 172.21.15.153:0/2827428048 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1298007610 con 0x55e697510bf0 2023-10-05T21:15:37.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.318+0000 7f129f7fe700 1 -- 172.21.15.153:0/2827428048 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1298007770 con 0x55e697510bf0 2023-10-05T21:15:37.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.318+0000 7f129f7fe700 1 -- 172.21.15.153:0/2827428048 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1298007a40 con 0x55e697510bf0 2023-10-05T21:15:37.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.319+0000 7f12b1d50680 1 -- 172.21.15.153:0/2827428048 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e697510bf0 msgr2=0x55e697512fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.319+0000 7f12b1d50680 1 --2- 172.21.15.153:0/2827428048 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e697510bf0 0x55e697512fd0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f129800a5d0 tx=0x7f1298005a50 comp rx=0 tx=0).stop 2023-10-05T21:15:37.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.319+0000 7f12b1d50680 1 -- 172.21.15.153:0/2827428048 shutdown_connections 2023-10-05T21:15:37.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.319+0000 7f12b1d50680 1 --2- 172.21.15.153:0/2827428048 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e697510bf0 0x55e697512fd0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.319+0000 7f12b1d50680 1 -- 172.21.15.153:0/2827428048 >> 172.21.15.153:0/2827428048 conn(0x55e697506310 msgr2=0x55e697508720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:37.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.319+0000 7f12b1d50680 1 -- 172.21.15.153:0/2827428048 shutdown_connections 2023-10-05T21:15:37.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.319+0000 7f12b1d50680 1 -- 172.21.15.153:0/2827428048 wait complete. 2023-10-05T21:15:37.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.320+0000 7f12b1d50680 1 Processor -- start 2023-10-05T21:15:37.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.320+0000 7f12b1d50680 1 -- start start 2023-10-05T21:15:37.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.320+0000 7f12b1d50680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e69750a7c0 0x55e69752b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.320+0000 7f12b1d50680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6973b9ea0 con 0x55e69750a7c0 2023-10-05T21:15:37.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.320+0000 7f12a4e28700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e69750a7c0 0x55e69752b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.320+0000 7f12a4e28700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e69750a7c0 0x55e69752b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:56568/0 (socket says 172.21.15.153:56568) 2023-10-05T21:15:37.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.320+0000 7f12a4e28700 1 -- 172.21.15.153:0/3990527217 learned_addr learned my addr 172.21.15.153:0/3990527217 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:37.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.320+0000 7f12a4e28700 1 -- 172.21.15.153:0/3990527217 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1298005cf0 con 0x55e69750a7c0 2023-10-05T21:15:37.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.320+0000 7f12a4e28700 1 --2- 172.21.15.153:0/3990527217 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e69750a7c0 0x55e69752b8f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1290001c70 tx=0x7f1290001820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1beccd823f9d8d85 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.320+0000 7f129e7fc700 1 -- 172.21.15.153:0/3990527217 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f129000bbf0 con 0x55e69750a7c0 2023-10-05T21:15:37.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.320+0000 7f129e7fc700 1 -- 172.21.15.153:0/3990527217 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129000bd70 con 0x55e69750a7c0 2023-10-05T21:15:37.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.321+0000 7f129e7fc700 1 -- 172.21.15.153:0/3990527217 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f129000e5f0 con 0x55e69750a7c0 2023-10-05T21:15:37.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.321+0000 7f12b1d50680 1 -- 172.21.15.153:0/3990527217 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e69750a7c0 msgr2=0x55e69752b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.321+0000 7f12b1d50680 1 --2- 172.21.15.153:0/3990527217 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e69750a7c0 0x55e69752b8f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1290001c70 tx=0x7f1290001820 comp rx=0 tx=0).stop 2023-10-05T21:15:37.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.321+0000 7f12b1d50680 1 -- 172.21.15.153:0/3990527217 shutdown_connections 2023-10-05T21:15:37.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.321+0000 7f12b1d50680 1 --2- 172.21.15.153:0/3990527217 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e69750a7c0 0x55e69752b8f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.321+0000 7f12b1d50680 1 -- 172.21.15.153:0/3990527217 >> 172.21.15.153:0/3990527217 conn(0x55e697506310 msgr2=0x55e6975273c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:37.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.321+0000 7f12b1d50680 1 -- 172.21.15.153:0/3990527217 shutdown_connections 2023-10-05T21:15:37.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.321+0000 7f12b1d50680 1 -- 172.21.15.153:0/3990527217 wait complete. 2023-10-05T21:15:37.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.321+0000 7f12b1d50680 1 Processor -- start 2023-10-05T21:15:37.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.321+0000 7f12b1d50680 1 -- start start 2023-10-05T21:15:37.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.321+0000 7f12b1d50680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e69750a7c0 0x55e697532e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.321+0000 7f12b1d50680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6973b0c80 con 0x55e69750a7c0 2023-10-05T21:15:37.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.322+0000 7f12a4e28700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e69750a7c0 0x55e697532e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.322+0000 7f12a4e28700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e69750a7c0 0x55e697532e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:56582/0 (socket says 172.21.15.153:56582) 2023-10-05T21:15:37.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.322+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 learned_addr learned my addr 172.21.15.153:0/1088587351 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:37.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.322+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1294001e10 con 0x55e69750a7c0 2023-10-05T21:15:37.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.322+0000 7f12a4e28700 1 --2- 172.21.15.153:0/1088587351 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e69750a7c0 0x55e697532e20 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1290010000 tx=0x7f1290016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.322+0000 7f129cff9700 1 -- 172.21.15.153:0/1088587351 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f129001f070 con 0x55e69750a7c0 2023-10-05T21:15:37.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.322+0000 7f129cff9700 1 -- 172.21.15.153:0/1088587351 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1290018710 con 0x55e69750a7c0 2023-10-05T21:15:37.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.322+0000 7f129cff9700 1 -- 172.21.15.153:0/1088587351 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12900189c0 con 0x55e69750a7c0 2023-10-05T21:15:37.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.322+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e697533360 con 0x55e69750a7c0 2023-10-05T21:15:37.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.322+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e6975337b0 con 0x55e69750a7c0 2023-10-05T21:15:37.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.323+0000 7f12b1d50680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.323+0000 7f129cff9700 1 -- 172.21.15.153:0/1088587351 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f1290018b70 con 0x55e69750a7c0 2023-10-05T21:15:37.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.323+0000 7f129cff9700 1 --2- 172.21.15.153:0/1088587351 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f12880340f0 0x7f12880365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.324+0000 7f129cff9700 1 -- 172.21.15.153:0/1088587351 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f1290048e10 con 0x55e69750a7c0 2023-10-05T21:15:37.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.324+0000 7f129ffff700 1 --2- 172.21.15.153:0/1088587351 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f12880340f0 0x7f12880365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.324+0000 7f12b1d50680 1 --2- 172.21.15.153:0/1088587351 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55e697510bf0 0x55e69753ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.324+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e69753f340 con 0x55e697510bf0 2023-10-05T21:15:37.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.324+0000 7f12a5629700 1 --2- 172.21.15.153:0/1088587351 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55e697510bf0 0x55e69753ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.324+0000 7f129ffff700 1 --2- 172.21.15.153:0/1088587351 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f12880340f0 0x7f12880365a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f129800afd0 tx=0x7f1298014000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.324+0000 7f12a5629700 1 --2- 172.21.15.153:0/1088587351 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55e697510bf0 0x55e69753ebb0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.324+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.324+0000 7f12b1d50680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.324+0000 7f12b1d50680 20 realm 2023-10-05T21:15:37.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.324+0000 7f12b1d50680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.324+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e69753c190 con 0x55e697510bf0 2023-10-05T21:15:37.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.325+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.325+0000 7f12b1d50680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.325+0000 7f12b1d50680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:37.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.325+0000 7f12b1d50680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.325+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e69753fe40 con 0x55e697510bf0 2023-10-05T21:15:37.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.325+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.325+0000 7f12b1d50680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.325+0000 7f12b1d50680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.325+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697540760 con 0x55e697510bf0 2023-10-05T21:15:37.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.325+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.325+0000 7f12b1d50680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:37.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.325+0000 7f12b1d50680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.325+0000 7f12b1d50680 1 --2- 172.21.15.153:0/1088587351 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55e697541020 0x55e697543400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.325+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697543a50 con 0x55e697541020 2023-10-05T21:15:37.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.325+0000 7f12a4e28700 1 --2- 172.21.15.153:0/1088587351 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55e697541020 0x55e697543400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.326+0000 7f12a4e28700 1 --2- 172.21.15.153:0/1088587351 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55e697541020 0x55e697543400 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.326+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f1290014070 con 0x55e697541020 2023-10-05T21:15:37.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.326+0000 7f12b1d50680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:37.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.326+0000 7f12b1d50680 20 searching for the correct realm 2023-10-05T21:15:37.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.326+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x55e697541020 2023-10-05T21:15:37.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.326+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1290014070 con 0x55e697541020 2023-10-05T21:15:37.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.326+0000 7f12a4e28700 1 --2- 172.21.15.153:0/1088587351 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f129002d020 0x7f129000d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.326+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x7f129002d020 2023-10-05T21:15:37.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.326+0000 7f129ffff700 1 --2- 172.21.15.153:0/1088587351 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f129002d020 0x7f129000d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.326+0000 7f129ffff700 1 --2- 172.21.15.153:0/1088587351 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f129002d020 0x7f129000d3d0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.327+0000 7f129ffff700 1 -- 172.21.15.153:0/1088587351 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1298007ce0 con 0x7f129002d020 2023-10-05T21:15:37.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.327+0000 7f129ffff700 1 --2- 172.21.15.153:0/1088587351 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f1298007030 0x7f129801d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.327+0000 7f129ffff700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x7f1298007030 2023-10-05T21:15:37.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.327+0000 7f12a5629700 1 --2- 172.21.15.153:0/1088587351 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f1298007030 0x7f129801d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.327+0000 7f12a5629700 1 --2- 172.21.15.153:0/1088587351 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f1298007030 0x7f129801d430 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.327+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a000a570 con 0x7f1298007030 2023-10-05T21:15:37.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.327+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x55e697510bf0 2023-10-05T21:15:37.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.328+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.328+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x55e697510bf0 2023-10-05T21:15:37.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.328+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.328+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x7f1298007030 2023-10-05T21:15:37.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.328+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a000a570 con 0x7f1298007030 2023-10-05T21:15:37.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.328+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x7f1298007030 2023-10-05T21:15:37.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.328+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a000a570 con 0x7f1298007030 2023-10-05T21:15:37.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.328+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x7f129002d020 2023-10-05T21:15:37.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.328+0000 7f129ffff700 1 -- 172.21.15.153:0/1088587351 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1298029040 con 0x7f129002d020 2023-10-05T21:15:37.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.328+0000 7f129ffff700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x55e697541020 2023-10-05T21:15:37.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.329+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1290014070 con 0x55e697541020 2023-10-05T21:15:37.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.329+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x55e697510bf0 2023-10-05T21:15:37.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.329+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.329+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x7f1298007030 2023-10-05T21:15:37.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.329+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a000a570 con 0x7f1298007030 2023-10-05T21:15:37.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.329+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x55e697510bf0 2023-10-05T21:15:37.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.329+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.329+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x7f129002d020 2023-10-05T21:15:37.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.330+0000 7f129ffff700 1 -- 172.21.15.153:0/1088587351 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1298029040 con 0x7f129002d020 2023-10-05T21:15:37.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.330+0000 7f129ffff700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x55e697541020 2023-10-05T21:15:37.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.330+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1290014070 con 0x55e697541020 2023-10-05T21:15:37.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.330+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x55e697541020 2023-10-05T21:15:37.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.330+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1290014070 con 0x55e697541020 2023-10-05T21:15:37.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.330+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x7f1298007030 2023-10-05T21:15:37.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.330+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a000a570 con 0x7f1298007030 2023-10-05T21:15:37.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.330+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x55e697541020 2023-10-05T21:15:37.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.331+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1290014070 con 0x55e697541020 2023-10-05T21:15:37.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.331+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x55e697541020 2023-10-05T21:15:37.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.331+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1290014070 con 0x55e697541020 2023-10-05T21:15:37.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.331+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x55e697510bf0 2023-10-05T21:15:37.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.331+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.331+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x55e697510bf0 2023-10-05T21:15:37.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.331+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.331+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x7f1298007030 2023-10-05T21:15:37.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.332+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a000a570 con 0x7f1298007030 2023-10-05T21:15:37.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.332+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x55e697541020 2023-10-05T21:15:37.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.332+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1290014070 con 0x55e697541020 2023-10-05T21:15:37.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.332+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x7f129002d020 2023-10-05T21:15:37.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.332+0000 7f129ffff700 1 -- 172.21.15.153:0/1088587351 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1298029040 con 0x7f129002d020 2023-10-05T21:15:37.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.332+0000 7f129ffff700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x55e697510bf0 2023-10-05T21:15:37.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.332+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.332+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x7f1298007030 2023-10-05T21:15:37.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.333+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a000a570 con 0x7f1298007030 2023-10-05T21:15:37.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.333+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x55e697541020 2023-10-05T21:15:37.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.333+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1290014070 con 0x55e697541020 2023-10-05T21:15:37.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.333+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x7f1298007030 2023-10-05T21:15:37.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.333+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a000a570 con 0x7f1298007030 2023-10-05T21:15:37.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.333+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x7f129002d020 2023-10-05T21:15:37.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.333+0000 7f129ffff700 1 -- 172.21.15.153:0/1088587351 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1298029040 con 0x7f129002d020 2023-10-05T21:15:37.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.333+0000 7f129ffff700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x55e697541020 2023-10-05T21:15:37.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.333+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1290014070 con 0x55e697541020 2023-10-05T21:15:37.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.333+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x7f1298007030 2023-10-05T21:15:37.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.334+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a000a570 con 0x7f1298007030 2023-10-05T21:15:37.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.334+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x55e697510bf0 2023-10-05T21:15:37.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.334+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.334+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975455c0 con 0x7f129002d020 2023-10-05T21:15:37.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.334+0000 7f129ffff700 1 -- 172.21.15.153:0/1088587351 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1298029040 con 0x7f129002d020 2023-10-05T21:15:37.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.334+0000 7f12b1d50680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:37.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.334+0000 7f12b1d50680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:37.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.334+0000 7f12b1d50680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:37.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.334+0000 7f12b1d50680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:37.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.334+0000 7f12b1d50680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.334+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697544510 con 0x55e697510bf0 2023-10-05T21:15:37.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.334+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.335+0000 7f12b1d50680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.335+0000 7f12b1d50680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.335+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697544910 con 0x55e697510bf0 2023-10-05T21:15:37.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.335+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.335+0000 7f12b1d50680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:37.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.335+0000 7f12b1d50680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.335+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697545a50 con 0x55e697510bf0 2023-10-05T21:15:37.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.335+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.335+0000 7f12b1d50680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:37.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.335+0000 7f12b1d50680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.335+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697545e00 con 0x55e697541020 2023-10-05T21:15:37.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.335+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f1290014070 con 0x55e697541020 2023-10-05T21:15:37.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.335+0000 7f12b1d50680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.335+0000 7f12b1d50680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.335+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975461b0 con 0x55e697510bf0 2023-10-05T21:15:37.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.335+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.335+0000 7f12b1d50680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.335+0000 7f12b1d50680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.335+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975461b0 con 0x55e697510bf0 2023-10-05T21:15:37.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.336+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.336+0000 7f12b1d50680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:37.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.336+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975471c0 con 0x55e697541020 2023-10-05T21:15:37.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.336+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1290014070 con 0x55e697541020 2023-10-05T21:15:37.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.336+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975471c0 con 0x7f129002d020 2023-10-05T21:15:37.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.336+0000 7f129ffff700 1 -- 172.21.15.153:0/1088587351 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1298029040 con 0x7f129002d020 2023-10-05T21:15:37.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.336+0000 7f129ffff700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975471c0 con 0x7f1298007030 2023-10-05T21:15:37.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.336+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a000a570 con 0x7f1298007030 2023-10-05T21:15:37.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.336+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697545a50 con 0x55e697510bf0 2023-10-05T21:15:37.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.337+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.337+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697545a50 con 0x55e697510bf0 2023-10-05T21:15:37.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.337+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.337+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697545a50 con 0x7f1298007030 2023-10-05T21:15:37.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.337+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a000a570 con 0x7f1298007030 2023-10-05T21:15:37.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.337+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697545a50 con 0x7f1298007030 2023-10-05T21:15:37.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.337+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a000a570 con 0x7f1298007030 2023-10-05T21:15:37.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.337+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697545a50 con 0x7f129002d020 2023-10-05T21:15:37.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.338+0000 7f129ffff700 1 -- 172.21.15.153:0/1088587351 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1298029040 con 0x7f129002d020 2023-10-05T21:15:37.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.338+0000 7f129ffff700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697545a50 con 0x55e697541020 2023-10-05T21:15:37.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.338+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1290014070 con 0x55e697541020 2023-10-05T21:15:37.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.338+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697545a50 con 0x55e697510bf0 2023-10-05T21:15:37.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.338+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.338+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697545a50 con 0x7f1298007030 2023-10-05T21:15:37.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.338+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a000a570 con 0x7f1298007030 2023-10-05T21:15:37.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.338+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697545a50 con 0x55e697510bf0 2023-10-05T21:15:37.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.338+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.338+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697545a50 con 0x7f129002d020 2023-10-05T21:15:37.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.339+0000 7f129ffff700 1 -- 172.21.15.153:0/1088587351 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1298029040 con 0x7f129002d020 2023-10-05T21:15:37.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.339+0000 7f129ffff700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697545a50 con 0x55e697541020 2023-10-05T21:15:37.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.339+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f129004b040 con 0x55e697541020 2023-10-05T21:15:37.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.339+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697545a50 con 0x55e697541020 2023-10-05T21:15:37.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.339+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f129004b040 con 0x55e697541020 2023-10-05T21:15:37.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.339+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697545a50 con 0x7f1298007030 2023-10-05T21:15:37.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.339+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a000a570 con 0x7f1298007030 2023-10-05T21:15:37.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.339+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697545a50 con 0x55e697541020 2023-10-05T21:15:37.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.339+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f129004b040 con 0x55e697541020 2023-10-05T21:15:37.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.340+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697545a50 con 0x55e697541020 2023-10-05T21:15:37.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.340+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f129004b040 con 0x55e697541020 2023-10-05T21:15:37.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.340+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697545a50 con 0x55e697510bf0 2023-10-05T21:15:37.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.340+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.340+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697545a50 con 0x55e697510bf0 2023-10-05T21:15:37.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.340+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.340+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697545a50 con 0x7f1298007030 2023-10-05T21:15:37.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.340+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a000a570 con 0x7f1298007030 2023-10-05T21:15:37.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.340+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697545a50 con 0x55e697541020 2023-10-05T21:15:37.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.341+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f129004b040 con 0x55e697541020 2023-10-05T21:15:37.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.341+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697545a50 con 0x7f129002d020 2023-10-05T21:15:37.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.341+0000 7f129ffff700 1 -- 172.21.15.153:0/1088587351 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1298029040 con 0x7f129002d020 2023-10-05T21:15:37.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.341+0000 7f129ffff700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697545a50 con 0x55e697510bf0 2023-10-05T21:15:37.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.341+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.341+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697545a50 con 0x7f1298007030 2023-10-05T21:15:37.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.341+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a000a570 con 0x7f1298007030 2023-10-05T21:15:37.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.341+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697545a50 con 0x55e697541020 2023-10-05T21:15:37.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.342+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f129004b040 con 0x55e697541020 2023-10-05T21:15:37.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.342+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697545a50 con 0x7f1298007030 2023-10-05T21:15:37.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.342+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a000a570 con 0x7f1298007030 2023-10-05T21:15:37.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.342+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697545a50 con 0x7f129002d020 2023-10-05T21:15:37.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.342+0000 7f129ffff700 1 -- 172.21.15.153:0/1088587351 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1298029040 con 0x7f129002d020 2023-10-05T21:15:37.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.342+0000 7f129ffff700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697545a50 con 0x55e697541020 2023-10-05T21:15:37.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.342+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f129004b040 con 0x55e697541020 2023-10-05T21:15:37.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.342+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697545a50 con 0x7f1298007030 2023-10-05T21:15:37.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.342+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f12a000a570 con 0x7f1298007030 2023-10-05T21:15:37.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.342+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697545a50 con 0x55e697510bf0 2023-10-05T21:15:37.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.343+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.343+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697545a50 con 0x7f129002d020 2023-10-05T21:15:37.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.343+0000 7f129ffff700 1 -- 172.21.15.153:0/1088587351 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1298029040 con 0x7f129002d020 2023-10-05T21:15:37.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.343+0000 7f12b1d50680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:37.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.343+0000 7f12b1d50680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:37.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.343+0000 7f12b1d50680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:37.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.343+0000 7f12b1d50680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:37.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.343+0000 7f12b1d50680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.343+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975461b0 con 0x55e697510bf0 2023-10-05T21:15:37.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.343+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.343+0000 7f12b1d50680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:37.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.343+0000 7f12b1d50680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.343+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697546560 con 0x55e697541020 2023-10-05T21:15:37.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.343+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f129004b040 con 0x55e697541020 2023-10-05T21:15:37.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.343+0000 7f12b1d50680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:37.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.343+0000 7f12b1d50680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.343+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697546e00 con 0x55e697510bf0 2023-10-05T21:15:37.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.344+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.344+0000 7f12b1d50680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:37.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.344+0000 7f12b1d50680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.344+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697546e00 con 0x55e697510bf0 2023-10-05T21:15:37.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.344+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.344+0000 7f12b1d50680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:37.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.344+0000 7f12b1d50680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.344+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697546e00 con 0x7f1298007030 2023-10-05T21:15:37.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.344+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f12a000a570 con 0x7f1298007030 2023-10-05T21:15:37.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.344+0000 7f12b1d50680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.344+0000 7f12b1d50680 20 zone default found 2023-10-05T21:15:37.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.344+0000 7f12b1d50680 4 Realm: () 2023-10-05T21:15:37.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.344+0000 7f12b1d50680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:37.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.344+0000 7f12b1d50680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:37.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.344+0000 7f12b1d50680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:37.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.344+0000 7f12b1d50680 20 zonegroup default 2023-10-05T21:15:37.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.344+0000 7f12b1d50680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.344+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697546e00 con 0x7f1298007030 2023-10-05T21:15:37.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.344+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f12a000a570 con 0x7f1298007030 2023-10-05T21:15:37.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.344+0000 7f12b1d50680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.344+0000 7f12b1d50680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.344+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697548780 con 0x55e697541020 2023-10-05T21:15:37.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.345+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f129004b040 con 0x55e697541020 2023-10-05T21:15:37.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.345+0000 7f12b1d50680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.345+0000 7f12b1d50680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.345+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697548b30 con 0x55e697541020 2023-10-05T21:15:37.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.345+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f129004b040 con 0x55e697541020 2023-10-05T21:15:37.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.345+0000 7f12b1d50680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.345+0000 7f12b1d50680 20 started sync module instance, tier type = 2023-10-05T21:15:37.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.345+0000 7f12b1d50680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:37.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.345+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697547e90 con 0x7f129002d020 2023-10-05T21:15:37.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.346+0000 7f129ffff700 1 -- 172.21.15.153:0/1088587351 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1298029040 con 0x7f129002d020 2023-10-05T21:15:37.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.346+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94448869737104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697549420 con 0x7f129002d020 2023-10-05T21:15:37.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.346+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697549cc0 con 0x55e697510bf0 2023-10-05T21:15:37.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.346+0000 7f129ffff700 1 -- 172.21.15.153:0/1088587351 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94448869737104] v29'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1298029040 con 0x7f129002d020 2023-10-05T21:15:37.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.347+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.347+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94448869742544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e69754a110 con 0x55e697510bf0 2023-10-05T21:15:37.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.347+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e69754a9b0 con 0x55e697541020 2023-10-05T21:15:37.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.347+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94448869742544] v29'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.348+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f129004b040 con 0x55e697541020 2023-10-05T21:15:37.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.348+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94448869743968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e69754ad60 con 0x55e697541020 2023-10-05T21:15:37.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.348+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e69754b770 con 0x7f129002d020 2023-10-05T21:15:37.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.348+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94448869743968] v29'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f129004b040 con 0x55e697541020 2023-10-05T21:15:37.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.348+0000 7f129ffff700 1 -- 172.21.15.153:0/1088587351 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1298029040 con 0x7f129002d020 2023-10-05T21:15:37.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.348+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94448869745072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e69754c010 con 0x7f129002d020 2023-10-05T21:15:37.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.348+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e69754c8b0 con 0x55e697510bf0 2023-10-05T21:15:37.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.349+0000 7f129ffff700 1 -- 172.21.15.153:0/1088587351 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94448869745072] v29'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1298029040 con 0x7f129002d020 2023-10-05T21:15:37.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.349+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.349+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94448869753792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e69754cd00 con 0x55e697510bf0 2023-10-05T21:15:37.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.349+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e69754d5e0 con 0x7f1298007030 2023-10-05T21:15:37.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.350+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94448869753792] v29'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.350+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a000a570 con 0x7f1298007030 2023-10-05T21:15:37.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.350+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94448869754896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e69754d150 con 0x7f1298007030 2023-10-05T21:15:37.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.350+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e69754e0a0 con 0x7f1298007030 2023-10-05T21:15:37.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.351+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(96 notify.6 [create] v29'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a000a570 con 0x7f1298007030 2023-10-05T21:15:37.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.351+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(95 notify.5 [watch watch cookie 94448869754896] v29'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a000a570 con 0x7f1298007030 2023-10-05T21:15:37.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.351+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94448869759824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e69754e060 con 0x7f1298007030 2023-10-05T21:15:37.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.351+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e69754ebf0 con 0x7f1298007030 2023-10-05T21:15:37.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.351+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94448869759824] v29'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a000a570 con 0x7f1298007030 2023-10-05T21:15:37.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.351+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a000a570 con 0x7f1298007030 2023-10-05T21:15:37.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.352+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94448869756000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e69754ebf0 con 0x7f1298007030 2023-10-05T21:15:37.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.352+0000 7f12b1d50680 20 add_watcher() i=0 2023-10-05T21:15:37.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.352+0000 7f12b1d50680 20 add_watcher() i=1 2023-10-05T21:15:37.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.352+0000 7f12b1d50680 20 add_watcher() i=2 2023-10-05T21:15:37.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.352+0000 7f12b1d50680 20 add_watcher() i=3 2023-10-05T21:15:37.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.352+0000 7f12b1d50680 20 add_watcher() i=4 2023-10-05T21:15:37.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.352+0000 7f12b1d50680 20 add_watcher() i=5 2023-10-05T21:15:37.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.352+0000 7f12b1d50680 20 add_watcher() i=6 2023-10-05T21:15:37.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.352+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94448869756000] v29'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a000a570 con 0x7f1298007030 2023-10-05T21:15:37.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.352+0000 7f12b1d50680 20 add_watcher() i=7 2023-10-05T21:15:37.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.352+0000 7f12b1d50680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:37.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.352+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e697552110 con 0x55e697510bf0 2023-10-05T21:15:37.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.353+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.353+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94448869764080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e69754f530 con 0x55e697510bf0 2023-10-05T21:15:37.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.353+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94448869764080] v29'208 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.353+0000 7f1275fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:37.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.354+0000 7f12b1d50680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:37.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.354+0000 7f12b1d50680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:37.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.354+0000 7f12b1d50680 1 Processor -- start 2023-10-05T21:15:37.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.354+0000 7f12b1d50680 1 -- start start 2023-10-05T21:15:37.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.354+0000 7f12b1d50680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e69750cef0 0x55e69750d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.354+0000 7f12b1d50680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69750b6d0 con 0x55e69750cef0 2023-10-05T21:15:37.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.354+0000 7f129ffff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e69750cef0 0x55e69750d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.354+0000 7f129ffff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e69750cef0 0x55e69750d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:56586/0 (socket says 172.21.15.153:56586) 2023-10-05T21:15:37.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.354+0000 7f129ffff700 1 -- 172.21.15.153:0/3389979209 learned_addr learned my addr 172.21.15.153:0/3389979209 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:37.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.354+0000 7f129ffff700 1 -- 172.21.15.153:0/3389979209 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e69750b810 con 0x55e69750cef0 2023-10-05T21:15:37.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.355+0000 7f129ffff700 1 --2- 172.21.15.153:0/3389979209 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e69750cef0 0x55e69750d300 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x55e69750b490 tx=0x7f1298011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d487c134e729a4c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.355+0000 7f12757e2700 1 -- 172.21.15.153:0/3389979209 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1298025040 con 0x55e69750cef0 2023-10-05T21:15:37.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.355+0000 7f12757e2700 1 -- 172.21.15.153:0/3389979209 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1298039450 con 0x55e69750cef0 2023-10-05T21:15:37.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.355+0000 7f12757e2700 1 -- 172.21.15.153:0/3389979209 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1298039740 con 0x55e69750cef0 2023-10-05T21:15:37.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.355+0000 7f12b1d50680 1 -- 172.21.15.153:0/3389979209 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e69750cef0 msgr2=0x55e69750d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.355+0000 7f12b1d50680 1 --2- 172.21.15.153:0/3389979209 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e69750cef0 0x55e69750d300 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x55e69750b490 tx=0x7f1298011000 comp rx=0 tx=0).stop 2023-10-05T21:15:37.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.356+0000 7f12b1d50680 1 -- 172.21.15.153:0/3389979209 shutdown_connections 2023-10-05T21:15:37.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.356+0000 7f12b1d50680 1 --2- 172.21.15.153:0/3389979209 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e69750cef0 0x55e69750d300 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.356+0000 7f12b1d50680 1 -- 172.21.15.153:0/3389979209 >> 172.21.15.153:0/3389979209 conn(0x55e697557ef0 msgr2=0x55e697555ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:37.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.356+0000 7f12b1d50680 1 -- 172.21.15.153:0/3389979209 shutdown_connections 2023-10-05T21:15:37.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.356+0000 7f12b1d50680 1 -- 172.21.15.153:0/3389979209 wait complete. 2023-10-05T21:15:37.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.356+0000 7f12b1d50680 1 Processor -- start 2023-10-05T21:15:37.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.356+0000 7f12b1d50680 1 -- start start 2023-10-05T21:15:37.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.356+0000 7f12b1d50680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e69750cef0 0x55e697564a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.356+0000 7f12b1d50680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e697564fc0 con 0x55e69750cef0 2023-10-05T21:15:37.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.356+0000 7f129ffff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e69750cef0 0x55e697564a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.356+0000 7f129ffff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e69750cef0 0x55e697564a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:56590/0 (socket says 172.21.15.153:56590) 2023-10-05T21:15:37.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.356+0000 7f129ffff700 1 -- 172.21.15.153:0/2542820186 learned_addr learned my addr 172.21.15.153:0/2542820186 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:37.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.357+0000 7f129ffff700 1 -- 172.21.15.153:0/2542820186 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e697514520 con 0x55e69750cef0 2023-10-05T21:15:37.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.357+0000 7f129ffff700 1 --2- 172.21.15.153:0/2542820186 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e69750cef0 0x55e697564a80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x55e697556d50 tx=0x7f1298039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.357+0000 7f11ef7fe700 1 -- 172.21.15.153:0/2542820186 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1298025070 con 0x55e69750cef0 2023-10-05T21:15:37.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.357+0000 7f11ef7fe700 1 -- 172.21.15.153:0/2542820186 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129802d660 con 0x55e69750cef0 2023-10-05T21:15:37.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.357+0000 7f11ef7fe700 1 -- 172.21.15.153:0/2542820186 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f129802d910 con 0x55e69750cef0 2023-10-05T21:15:37.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.357+0000 7f12b1d50680 1 -- 172.21.15.153:0/2542820186 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e6975651c0 con 0x55e69750cef0 2023-10-05T21:15:37.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.357+0000 7f12b1d50680 1 -- 172.21.15.153:0/2542820186 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e697565670 con 0x55e69750cef0 2023-10-05T21:15:37.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.358+0000 7f11ef7fe700 1 -- 172.21.15.153:0/2542820186 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f129802db80 con 0x55e69750cef0 2023-10-05T21:15:37.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.358+0000 7f11ef7fe700 1 --2- 172.21.15.153:0/2542820186 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f11e40340f0 0x7f11e40365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.358+0000 7f11ef7fe700 1 -- 172.21.15.153:0/2542820186 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f1298032030 con 0x55e69750cef0 2023-10-05T21:15:37.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.358+0000 7f12b1d50680 5 note: GC not initialized 2023-10-05T21:15:37.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.358+0000 7f12a5629700 1 --2- 172.21.15.153:0/2542820186 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f11e40340f0 0x7f11e40365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.358+0000 7f12a5629700 1 --2- 172.21.15.153:0/2542820186 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f11e40340f0 0x7f11e40365a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x55e69754e7c0 tx=0x7f12a0037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.359+0000 7f11ecff9700 20 reqs_thread_entry: start 2023-10-05T21:15:37.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.359+0000 7f11e27fc700 20 reqs_thread_entry: start 2023-10-05T21:15:37.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.359+0000 7f12b1d50680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:37.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.359+0000 7f12b1d50680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:37.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.359+0000 7f11e0ff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:16:07 2023 2023-10-05T21:15:37.391 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:37.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.359+0000 7f11c7fff700 20 reqs_thread_entry: start 2023-10-05T21:15:37.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.359+0000 7f12b1d50680 20 get_system_obj_state: rctx=0x7ffd51ea9898 obj=default.rgw.meta:users.uid:foo state=0x55e69747f340 s->prefetch_data=0 2023-10-05T21:15:37.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.359+0000 7f12b1d50680 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T21:15:37.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.360+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975ca450 con 0x55e697510bf0 2023-10-05T21:15:37.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.360+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv13 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.360+0000 7f12b1d50680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T21:15:37.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.360+0000 7f12b1d50680 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:37.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.360+0000 7f12b1d50680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:37.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.360+0000 7f12b1d50680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:37.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.360+0000 7f12b1d50680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:37.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.360+0000 7f12b1d50680 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:37.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.360+0000 7f12b1d50680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.360+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975cc6e0 con 0x55e697510bf0 2023-10-05T21:15:37.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.360+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv13 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.360+0000 7f12b1d50680 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T21:15:37.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.360+0000 7f12b1d50680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T21:15:37.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.360+0000 7f12b1d50680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:37.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.360+0000 7f12b1d50680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:37.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.360+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:104 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~369 in=369b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975ce220 con 0x55e697510bf0 2023-10-05T21:15:37.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.361+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(104 foo [delete,create,call,writefull 0~369] v29'14 uv14 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.361+0000 7f12b1d50680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T21:15:37.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.361+0000 7f12b1d50680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:37.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.361+0000 7f12b1d50680 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T21:15:37.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.361+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [notify cookie 94448870264656 in=557b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975c93a0 con 0x55e697510bf0 2023-10-05T21:15:37.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.362+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== watch-notify(notify (1) cookie 94448869753792 notify 124554051607 ret 0) v3 ==== 587+0+0 (crc 0 0 0) 0x7f12a00291f0 con 0x55e697510bf0 2023-10-05T21:15:37.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.362+0000 7f129e7fc700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051607 cookie 94448869753792 notifier 4646 bl.length()=545 2023-10-05T21:15:37.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.362+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(105 notify.4 [notify cookie 94448870264656 out=8b] v0'0 uv210 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.362+0000 7f129e7fc700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T21:15:37.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.362+0000 7f129e7fc700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:37.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.362+0000 7f129e7fc700 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f1284003d90 con 0x55e697510bf0 2023-10-05T21:15:37.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.362+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(106 notify.4 [notify-ack] v0'0 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.362+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== watch-notify(notify_complete (2) cookie 94448870264656 notify 124554051607 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f12a002d040 con 0x55e697510bf0 2023-10-05T21:15:37.394 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:37.394 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "foo", 2023-10-05T21:15:37.394 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Foo", 2023-10-05T21:15:37.394 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "foo@foo.com", 2023-10-05T21:15:37.394 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2023-10-05T21:15:37.394 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 4, 2023-10-05T21:15:37.394 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [], 2023-10-05T21:15:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2023-10-05T21:15:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T21:15:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [], 2023-10-05T21:15:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [ 2023-10-05T21:15:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "user", 2023-10-05T21:15:37.395 INFO:teuthology.orchestra.run.smithi153.stdout: "perm": "read" 2023-10-05T21:15:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2023-10-05T21:15:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2023-10-05T21:15:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2023-10-05T21:15:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2023-10-05T21:15:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:15:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:37.396 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2023-10-05T21:15:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2023-10-05T21:15:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2023-10-05T21:15:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [] 2023-10-05T21:15:37.397 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:37.397 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:15:37.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.362+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:107 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94448869737104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975ce220 con 0x7f129002d020 2023-10-05T21:15:37.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.363+0000 7f129ffff700 1 -- 172.21.15.153:0/1088587351 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(107 notify.0 [watch unwatch cookie 94448869737104] v29'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1298048070 con 0x7f129002d020 2023-10-05T21:15:37.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.363+0000 7f12b1d50680 20 remove_watcher() i=0 2023-10-05T21:15:37.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.363+0000 7f12b1d50680 2 removed watcher, disabling cache 2023-10-05T21:15:37.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.363+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:108 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94448869742544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975ce220 con 0x55e697510bf0 2023-10-05T21:15:37.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.364+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 42 ==== osd_op_reply(108 notify.1 [watch unwatch cookie 94448869742544] v29'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.364+0000 7f12b1d50680 20 remove_watcher() i=1 2023-10-05T21:15:37.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.364+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:109 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94448869743968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975ce220 con 0x55e697541020 2023-10-05T21:15:37.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.365+0000 7f12a4e28700 1 -- 172.21.15.153:0/1088587351 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(109 notify.2 [watch unwatch cookie 94448869743968] v29'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f129004b040 con 0x55e697541020 2023-10-05T21:15:37.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.365+0000 7f12b1d50680 20 remove_watcher() i=2 2023-10-05T21:15:37.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.365+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:110 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94448869745072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975ce220 con 0x7f129002d020 2023-10-05T21:15:37.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.366+0000 7f129ffff700 1 -- 172.21.15.153:0/1088587351 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(110 notify.3 [watch unwatch cookie 94448869745072] v29'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1298048070 con 0x7f129002d020 2023-10-05T21:15:37.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.366+0000 7f12b1d50680 20 remove_watcher() i=3 2023-10-05T21:15:37.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.366+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:111 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94448869753792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975ce220 con 0x55e697510bf0 2023-10-05T21:15:37.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.366+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 43 ==== osd_op_reply(111 notify.4 [watch unwatch cookie 94448869753792] v29'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.367+0000 7f12b1d50680 20 remove_watcher() i=4 2023-10-05T21:15:37.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.367+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94448869754896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975ce220 con 0x7f1298007030 2023-10-05T21:15:37.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.367+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(112 notify.5 [watch unwatch cookie 94448869754896] v29'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a000a570 con 0x7f1298007030 2023-10-05T21:15:37.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.367+0000 7f12b1d50680 20 remove_watcher() i=5 2023-10-05T21:15:37.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.367+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:113 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94448869759824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975ce220 con 0x7f1298007030 2023-10-05T21:15:37.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.368+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(113 notify.6 [watch unwatch cookie 94448869759824] v29'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a000a570 con 0x7f1298007030 2023-10-05T21:15:37.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.368+0000 7f12b1d50680 20 remove_watcher() i=6 2023-10-05T21:15:37.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.368+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:114 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94448869756000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975ce220 con 0x7f1298007030 2023-10-05T21:15:37.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.369+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(114 notify.7 [watch unwatch cookie 94448869756000] v29'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f12a000a570 con 0x7f1298007030 2023-10-05T21:15:37.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.369+0000 7f12b1d50680 20 remove_watcher() i=7 2023-10-05T21:15:37.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.370+0000 7f1275fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:37.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.370+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:115 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94448869764080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55e6975ce220 con 0x55e697510bf0 2023-10-05T21:15:37.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.370+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 <== osd.1 v2:172.21.15.153:6816/140456 44 ==== osd_op_reply(115 data_loggenerations_metadata [watch unwatch cookie 94448869764080] v29'209 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f12a000a570 con 0x55e697510bf0 2023-10-05T21:15:37.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.370+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f1298007030 msgr2=0x7f129801d430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.370+0000 7f12b1d50680 1 --2- 172.21.15.153:0/1088587351 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f1298007030 0x7f129801d430 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.370+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55e697510bf0 msgr2=0x55e69753ebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.370+0000 7f12b1d50680 1 --2- 172.21.15.153:0/1088587351 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55e697510bf0 0x55e69753ebb0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.370+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f129002d020 msgr2=0x7f129000d3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.370+0000 7f12b1d50680 1 --2- 172.21.15.153:0/1088587351 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f129002d020 0x7f129000d3d0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.370+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55e697541020 msgr2=0x55e697543400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.370+0000 7f12b1d50680 1 --2- 172.21.15.153:0/1088587351 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55e697541020 0x55e697543400 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.371+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f12880340f0 msgr2=0x7f12880365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.371+0000 7f12b1d50680 1 --2- 172.21.15.153:0/1088587351 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f12880340f0 0x7f12880365a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f129800afd0 tx=0x7f1298014000 comp rx=0 tx=0).stop 2023-10-05T21:15:37.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.371+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e69750a7c0 msgr2=0x55e697532e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.371+0000 7f12b1d50680 1 --2- 172.21.15.153:0/1088587351 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e69750a7c0 0x55e697532e20 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1290010000 tx=0x7f1290016000 comp rx=0 tx=0).stop 2023-10-05T21:15:37.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.371+0000 7f12a5629700 1 -- 172.21.15.153:0/1088587351 reap_dead start 2023-10-05T21:15:37.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.371+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 shutdown_connections 2023-10-05T21:15:37.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.371+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 >> 172.21.15.153:0/1088587351 conn(0x55e697506310 msgr2=0x55e697525c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:37.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.371+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 shutdown_connections 2023-10-05T21:15:37.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.371+0000 7f12b1d50680 1 -- 172.21.15.153:0/1088587351 wait complete. 2023-10-05T21:15:37.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.371+0000 7f12b1d50680 1 -- 172.21.15.153:0/2542820186 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f11e40340f0 msgr2=0x7f11e40365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.371+0000 7f12b1d50680 1 --2- 172.21.15.153:0/2542820186 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f11e40340f0 0x7f11e40365a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x55e69754e7c0 tx=0x7f12a0037450 comp rx=0 tx=0).stop 2023-10-05T21:15:37.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.371+0000 7f12b1d50680 1 -- 172.21.15.153:0/2542820186 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e69750cef0 msgr2=0x55e697564a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.371+0000 7f12b1d50680 1 --2- 172.21.15.153:0/2542820186 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e69750cef0 0x55e697564a80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x55e697556d50 tx=0x7f1298039000 comp rx=0 tx=0).stop 2023-10-05T21:15:37.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.371+0000 7f12b1d50680 1 -- 172.21.15.153:0/2542820186 shutdown_connections 2023-10-05T21:15:37.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.371+0000 7f12b1d50680 1 --2- 172.21.15.153:0/2542820186 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f11e40340f0 0x7f11e40365a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.371+0000 7f12b1d50680 1 --2- 172.21.15.153:0/2542820186 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e69750cef0 0x55e697564a80 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.371+0000 7f12b1d50680 1 -- 172.21.15.153:0/2542820186 >> 172.21.15.153:0/2542820186 conn(0x55e697557ef0 msgr2=0x55e697555fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:37.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.371+0000 7f12b1d50680 1 -- 172.21.15.153:0/2542820186 shutdown_connections 2023-10-05T21:15:37.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.371+0000 7f12b1d50680 1 -- 172.21.15.153:0/2542820186 wait complete. 2023-10-05T21:15:37.408 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:15:37.408 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2023-10-05T21:15:37.408 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2023-10-05T21:15:37.408 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2023-10-05T21:15:37.454 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:37.454 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:37.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.453+0000 7f2ee28ea680 1 Processor -- start 2023-10-05T21:15:37.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.453+0000 7f2ee28ea680 1 -- start start 2023-10-05T21:15:37.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.454+0000 7f2ee28ea680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5582d78adbc0 0x5582d78affa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.454+0000 7f2ee28ea680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5582d77f4930 con 0x5582d781b0b0 2023-10-05T21:15:37.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.454+0000 7f2ee28ea680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x5582d77b4db0 con 0x5582d78adbc0 2023-10-05T21:15:37.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.454+0000 7f2ed51c1700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5582d78adbc0 0x5582d78affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.454+0000 7f2ed51c1700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5582d78adbc0 0x5582d78affa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:56602/0 (socket says 172.21.15.153:56602) 2023-10-05T21:15:37.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.454+0000 7f2ed51c1700 1 -- 172.21.15.153:0/3231941599 learned_addr learned my addr 172.21.15.153:0/3231941599 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:37.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.454+0000 7f2ed59c2700 1 --1- 172.21.15.153:0/3231941599 >> v1:172.21.15.111:6789/0 conn(0x5582d781b0b0 0x5582d78ac4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:54132/0 (socket says 172.21.15.153:54132) 2023-10-05T21:15:37.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.454+0000 7f2ed51c1700 1 -- 172.21.15.153:0/3231941599 >> v1:172.21.15.111:6789/0 conn(0x5582d781b0b0 legacy=0x5582d78ac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.454+0000 7f2ed51c1700 1 -- 172.21.15.153:0/3231941599 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582d78b14f0 con 0x5582d78adbc0 2023-10-05T21:15:37.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.454+0000 7f2ed51c1700 1 --2- 172.21.15.153:0/3231941599 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d78adbc0 0x5582d78affa0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f2ec800a650 tx=0x7f2ec8005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb9f51f6e30277c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.454+0000 7f2ed49c0700 1 -- 172.21.15.153:0/3231941599 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ec8008760 con 0x5582d78adbc0 2023-10-05T21:15:37.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.455+0000 7f2ed49c0700 1 -- 172.21.15.153:0/3231941599 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec80088c0 con 0x5582d78adbc0 2023-10-05T21:15:37.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.455+0000 7f2ed49c0700 1 -- 172.21.15.153:0/3231941599 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ec8008bb0 con 0x5582d78adbc0 2023-10-05T21:15:37.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.455+0000 7f2ee28ea680 1 -- 172.21.15.153:0/3231941599 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d78adbc0 msgr2=0x5582d78affa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.455+0000 7f2ee28ea680 1 --2- 172.21.15.153:0/3231941599 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d78adbc0 0x5582d78affa0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f2ec800a650 tx=0x7f2ec8005b10 comp rx=0 tx=0).stop 2023-10-05T21:15:37.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.455+0000 7f2ee28ea680 1 -- 172.21.15.153:0/3231941599 shutdown_connections 2023-10-05T21:15:37.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.455+0000 7f2ee28ea680 1 --2- 172.21.15.153:0/3231941599 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d78adbc0 0x5582d78affa0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.455+0000 7f2ee28ea680 1 -- 172.21.15.153:0/3231941599 >> 172.21.15.153:0/3231941599 conn(0x5582d78a1b90 msgr2=0x5582d78a3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:37.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.455+0000 7f2ee28ea680 1 -- 172.21.15.153:0/3231941599 shutdown_connections 2023-10-05T21:15:37.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.455+0000 7f2ee28ea680 1 -- 172.21.15.153:0/3231941599 wait complete. 2023-10-05T21:15:37.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.456+0000 7f2ee28ea680 1 Processor -- start 2023-10-05T21:15:37.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.456+0000 7f2ee28ea680 1 -- start start 2023-10-05T21:15:37.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.456+0000 7f2ee28ea680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d781b0b0 0x5582d78c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.456+0000 7f2ee28ea680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582d7754ea0 con 0x5582d781b0b0 2023-10-05T21:15:37.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.456+0000 7f2ed59c2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d781b0b0 0x5582d78c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.456+0000 7f2ed59c2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d781b0b0 0x5582d78c8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:56604/0 (socket says 172.21.15.153:56604) 2023-10-05T21:15:37.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.456+0000 7f2ed59c2700 1 -- 172.21.15.153:0/393168408 learned_addr learned my addr 172.21.15.153:0/393168408 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:37.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.456+0000 7f2ed59c2700 1 -- 172.21.15.153:0/393168408 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec8005db0 con 0x5582d781b0b0 2023-10-05T21:15:37.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.457+0000 7f2ed59c2700 1 --2- 172.21.15.153:0/393168408 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d781b0b0 0x5582d78c8ae0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc001cc0 tx=0x7f2ecc001870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d954e761c4f577bf server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.457+0000 7f2ec77fe700 1 -- 172.21.15.153:0/393168408 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ecc014070 con 0x5582d781b0b0 2023-10-05T21:15:37.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.457+0000 7f2ec77fe700 1 -- 172.21.15.153:0/393168408 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ecc00be10 con 0x5582d781b0b0 2023-10-05T21:15:37.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.457+0000 7f2ec77fe700 1 -- 172.21.15.153:0/393168408 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ecc00f590 con 0x5582d781b0b0 2023-10-05T21:15:37.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.457+0000 7f2ee28ea680 1 -- 172.21.15.153:0/393168408 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d781b0b0 msgr2=0x5582d78c8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.457+0000 7f2ee28ea680 1 --2- 172.21.15.153:0/393168408 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d781b0b0 0x5582d78c8ae0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc001cc0 tx=0x7f2ecc001870 comp rx=0 tx=0).stop 2023-10-05T21:15:37.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.457+0000 7f2ee28ea680 1 -- 172.21.15.153:0/393168408 shutdown_connections 2023-10-05T21:15:37.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.457+0000 7f2ee28ea680 1 --2- 172.21.15.153:0/393168408 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d781b0b0 0x5582d78c8ae0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.457+0000 7f2ee28ea680 1 -- 172.21.15.153:0/393168408 >> 172.21.15.153:0/393168408 conn(0x5582d78a1b90 msgr2=0x5582d78c45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:37.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.457+0000 7f2ee28ea680 1 -- 172.21.15.153:0/393168408 shutdown_connections 2023-10-05T21:15:37.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.457+0000 7f2ee28ea680 1 -- 172.21.15.153:0/393168408 wait complete. 2023-10-05T21:15:37.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.458+0000 7f2ee28ea680 1 Processor -- start 2023-10-05T21:15:37.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.458+0000 7f2ee28ea680 1 -- start start 2023-10-05T21:15:37.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.458+0000 7f2ee28ea680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d781b0b0 0x5582d78cffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.458+0000 7f2ee28ea680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582d774bc80 con 0x5582d781b0b0 2023-10-05T21:15:37.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.458+0000 7f2ed59c2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d781b0b0 0x5582d78cffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.458+0000 7f2ed59c2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d781b0b0 0x5582d78cffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:56606/0 (socket says 172.21.15.153:56606) 2023-10-05T21:15:37.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.458+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 learned_addr learned my addr 172.21.15.153:0/2201758663 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:37.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.458+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582d77f4930 con 0x5582d781b0b0 2023-10-05T21:15:37.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.458+0000 7f2ed59c2700 1 --2- 172.21.15.153:0/2201758663 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d781b0b0 0x5582d78cffc0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc000c00 tx=0x7f2ecc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.459+0000 7f2ec5ffb700 1 -- 172.21.15.153:0/2201758663 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ecc01a690 con 0x5582d781b0b0 2023-10-05T21:15:37.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.459+0000 7f2ec5ffb700 1 -- 172.21.15.153:0/2201758663 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ecc021070 con 0x5582d781b0b0 2023-10-05T21:15:37.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.459+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5582d78d0500 con 0x5582d781b0b0 2023-10-05T21:15:37.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.459+0000 7f2ec5ffb700 1 -- 172.21.15.153:0/2201758663 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ecc01a930 con 0x5582d781b0b0 2023-10-05T21:15:37.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.459+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5582d78d0950 con 0x5582d781b0b0 2023-10-05T21:15:37.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.459+0000 7f2ec5ffb700 1 -- 172.21.15.153:0/2201758663 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f2ecc01ab60 con 0x5582d781b0b0 2023-10-05T21:15:37.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.459+0000 7f2ec5ffb700 1 --2- 172.21.15.153:0/2201758663 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2eb8034140 0x7f2eb80365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.460+0000 7f2ec5ffb700 1 -- 172.21.15.153:0/2201758663 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f2ecc008030 con 0x5582d781b0b0 2023-10-05T21:15:37.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.460+0000 7f2ed51c1700 1 --2- 172.21.15.153:0/2201758663 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2eb8034140 0x7f2eb80365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.460+0000 7f2ee28ea680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.460+0000 7f2ee28ea680 1 --2- 172.21.15.153:0/2201758663 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5582d78adbc0 0x5582d78dbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.460+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78dc520 con 0x5582d78adbc0 2023-10-05T21:15:37.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.460+0000 7f2ed61c3700 1 --2- 172.21.15.153:0/2201758663 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5582d78adbc0 0x5582d78dbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.460+0000 7f2ed51c1700 1 --2- 172.21.15.153:0/2201758663 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2eb8034140 0x7f2eb80365f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8005b50 tx=0x7f2ec8015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.460+0000 7f2ed61c3700 1 --2- 172.21.15.153:0/2201758663 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5582d78adbc0 0x5582d78dbd90 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.460+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.460+0000 7f2ee28ea680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.460+0000 7f2ee28ea680 20 realm 2023-10-05T21:15:37.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.460+0000 7f2ee28ea680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.461+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78d9290 con 0x5582d78adbc0 2023-10-05T21:15:37.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.461+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.461+0000 7f2ee28ea680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.461+0000 7f2ee28ea680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:37.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.461+0000 7f2ee28ea680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.461+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78dcfd0 con 0x5582d78adbc0 2023-10-05T21:15:37.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.461+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.461+0000 7f2ee28ea680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.461+0000 7f2ee28ea680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.461+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78dd8f0 con 0x5582d78adbc0 2023-10-05T21:15:37.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.461+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.461+0000 7f2ee28ea680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:37.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.461+0000 7f2ee28ea680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.461+0000 7f2ee28ea680 1 --2- 172.21.15.153:0/2201758663 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5582d78de1b0 0x5582d78e0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.461+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e0ba0 con 0x5582d78de1b0 2023-10-05T21:15:37.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.461+0000 7f2ed59c2700 1 --2- 172.21.15.153:0/2201758663 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5582d78de1b0 0x5582d78e0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.462+0000 7f2ed59c2700 1 --2- 172.21.15.153:0/2201758663 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5582d78de1b0 0x5582d78e0590 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.462+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f2ecc016070 con 0x5582d78de1b0 2023-10-05T21:15:37.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.462+0000 7f2ee28ea680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:37.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.462+0000 7f2ee28ea680 20 searching for the correct realm 2023-10-05T21:15:37.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.462+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x5582d78de1b0 2023-10-05T21:15:37.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.462+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ecc016070 con 0x5582d78de1b0 2023-10-05T21:15:37.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.462+0000 7f2ed59c2700 1 --2- 172.21.15.153:0/2201758663 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f2ecc019760 0x7f2ecc00e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.462+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x7f2ecc019760 2023-10-05T21:15:37.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.462+0000 7f2ed51c1700 1 --2- 172.21.15.153:0/2201758663 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f2ecc019760 0x7f2ecc00e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.463+0000 7f2ed51c1700 1 --2- 172.21.15.153:0/2201758663 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f2ecc019760 0x7f2ecc00e3b0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.463+0000 7f2ed51c1700 1 -- 172.21.15.153:0/2201758663 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ec8019040 con 0x7f2ecc019760 2023-10-05T21:15:37.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.463+0000 7f2ed51c1700 1 --2- 172.21.15.153:0/2201758663 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f2ec8007030 0x7f2ec801d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.463+0000 7f2ed51c1700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x7f2ec8007030 2023-10-05T21:15:37.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.463+0000 7f2ed61c3700 1 --2- 172.21.15.153:0/2201758663 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f2ec8007030 0x7f2ec801d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.463+0000 7f2ed61c3700 1 --2- 172.21.15.153:0/2201758663 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f2ec8007030 0x7f2ec801d420 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.464+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ed000a570 con 0x7f2ec8007030 2023-10-05T21:15:37.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.464+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x5582d78adbc0 2023-10-05T21:15:37.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.464+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.464+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x5582d78adbc0 2023-10-05T21:15:37.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.464+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.464+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x7f2ec8007030 2023-10-05T21:15:37.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.464+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ed000a570 con 0x7f2ec8007030 2023-10-05T21:15:37.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.464+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x7f2ec8007030 2023-10-05T21:15:37.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.464+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ed000a570 con 0x7f2ec8007030 2023-10-05T21:15:37.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.464+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x7f2ecc019760 2023-10-05T21:15:37.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.465+0000 7f2ed51c1700 1 -- 172.21.15.153:0/2201758663 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ec8019040 con 0x7f2ecc019760 2023-10-05T21:15:37.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.465+0000 7f2ed51c1700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x5582d78de1b0 2023-10-05T21:15:37.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.465+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2ecc016070 con 0x5582d78de1b0 2023-10-05T21:15:37.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.465+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x5582d78adbc0 2023-10-05T21:15:37.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.465+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.465+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x7f2ec8007030 2023-10-05T21:15:37.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.465+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ed000a570 con 0x7f2ec8007030 2023-10-05T21:15:37.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.465+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x5582d78adbc0 2023-10-05T21:15:37.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.465+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.465+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x7f2ecc019760 2023-10-05T21:15:37.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.466+0000 7f2ed51c1700 1 -- 172.21.15.153:0/2201758663 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ec8019040 con 0x7f2ecc019760 2023-10-05T21:15:37.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.466+0000 7f2ed51c1700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x5582d78de1b0 2023-10-05T21:15:37.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.466+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ecc016070 con 0x5582d78de1b0 2023-10-05T21:15:37.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.466+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x5582d78de1b0 2023-10-05T21:15:37.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.466+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ecc016070 con 0x5582d78de1b0 2023-10-05T21:15:37.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.466+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x7f2ec8007030 2023-10-05T21:15:37.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.466+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ed000a570 con 0x7f2ec8007030 2023-10-05T21:15:37.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.466+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x5582d78de1b0 2023-10-05T21:15:37.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.467+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ecc016070 con 0x5582d78de1b0 2023-10-05T21:15:37.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.467+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x5582d78de1b0 2023-10-05T21:15:37.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.467+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ecc016070 con 0x5582d78de1b0 2023-10-05T21:15:37.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.467+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x5582d78adbc0 2023-10-05T21:15:37.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.467+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.467+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x5582d78adbc0 2023-10-05T21:15:37.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.467+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.467+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x7f2ec8007030 2023-10-05T21:15:37.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.468+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ed000a570 con 0x7f2ec8007030 2023-10-05T21:15:37.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.468+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x5582d78de1b0 2023-10-05T21:15:37.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.468+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ecc016070 con 0x5582d78de1b0 2023-10-05T21:15:37.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.468+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x7f2ecc019760 2023-10-05T21:15:37.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.468+0000 7f2ed51c1700 1 -- 172.21.15.153:0/2201758663 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ec8019040 con 0x7f2ecc019760 2023-10-05T21:15:37.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.468+0000 7f2ed51c1700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x5582d78adbc0 2023-10-05T21:15:37.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.468+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.468+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x7f2ec8007030 2023-10-05T21:15:37.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.469+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ed000a570 con 0x7f2ec8007030 2023-10-05T21:15:37.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.469+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x5582d78de1b0 2023-10-05T21:15:37.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.469+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ecc016070 con 0x5582d78de1b0 2023-10-05T21:15:37.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.469+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x7f2ec8007030 2023-10-05T21:15:37.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.469+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ed000a570 con 0x7f2ec8007030 2023-10-05T21:15:37.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.469+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x7f2ecc019760 2023-10-05T21:15:37.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.469+0000 7f2ed51c1700 1 -- 172.21.15.153:0/2201758663 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ec8019040 con 0x7f2ecc019760 2023-10-05T21:15:37.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.469+0000 7f2ed51c1700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x5582d78de1b0 2023-10-05T21:15:37.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.470+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ecc016070 con 0x5582d78de1b0 2023-10-05T21:15:37.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.470+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x7f2ec8007030 2023-10-05T21:15:37.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.470+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ed000a570 con 0x7f2ec8007030 2023-10-05T21:15:37.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.470+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x5582d78adbc0 2023-10-05T21:15:37.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.470+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.470+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2710 con 0x7f2ecc019760 2023-10-05T21:15:37.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.470+0000 7f2ed51c1700 1 -- 172.21.15.153:0/2201758663 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ec8019040 con 0x7f2ecc019760 2023-10-05T21:15:37.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.470+0000 7f2ee28ea680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:37.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.470+0000 7f2ee28ea680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:37.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.470+0000 7f2ee28ea680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:37.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.470+0000 7f2ee28ea680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:37.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.470+0000 7f2ee28ea680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.470+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e1660 con 0x5582d78adbc0 2023-10-05T21:15:37.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.471+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.471+0000 7f2ee28ea680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.471+0000 7f2ee28ea680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.471+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e1a60 con 0x5582d78adbc0 2023-10-05T21:15:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.471+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.471+0000 7f2ee28ea680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.471+0000 7f2ee28ea680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.471+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2ba0 con 0x5582d78adbc0 2023-10-05T21:15:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.471+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.471+0000 7f2ee28ea680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.471+0000 7f2ee28ea680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.471+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2f50 con 0x5582d78de1b0 2023-10-05T21:15:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.472+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f2ecc016070 con 0x5582d78de1b0 2023-10-05T21:15:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.472+0000 7f2ee28ea680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.472+0000 7f2ee28ea680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.472+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e3300 con 0x5582d78adbc0 2023-10-05T21:15:37.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.472+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.472+0000 7f2ee28ea680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.472+0000 7f2ee28ea680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.472+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e3300 con 0x5582d78adbc0 2023-10-05T21:15:37.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.472+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.472+0000 7f2ee28ea680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:37.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.472+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e4310 con 0x5582d78de1b0 2023-10-05T21:15:37.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.472+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ecc016070 con 0x5582d78de1b0 2023-10-05T21:15:37.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.472+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e4310 con 0x7f2ecc019760 2023-10-05T21:15:37.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.472+0000 7f2ed51c1700 1 -- 172.21.15.153:0/2201758663 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ec8019040 con 0x7f2ecc019760 2023-10-05T21:15:37.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.472+0000 7f2ed51c1700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e4310 con 0x7f2ec8007030 2023-10-05T21:15:37.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.473+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ed000a570 con 0x7f2ec8007030 2023-10-05T21:15:37.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.473+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2ba0 con 0x5582d78adbc0 2023-10-05T21:15:37.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.473+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.473+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2ba0 con 0x5582d78adbc0 2023-10-05T21:15:37.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.473+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.473+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2ba0 con 0x7f2ec8007030 2023-10-05T21:15:37.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.473+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ed000a570 con 0x7f2ec8007030 2023-10-05T21:15:37.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.473+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2ba0 con 0x7f2ec8007030 2023-10-05T21:15:37.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.474+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ed000a570 con 0x7f2ec8007030 2023-10-05T21:15:37.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.474+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2ba0 con 0x7f2ecc019760 2023-10-05T21:15:37.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.474+0000 7f2ed51c1700 1 -- 172.21.15.153:0/2201758663 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ec8019040 con 0x7f2ecc019760 2023-10-05T21:15:37.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.474+0000 7f2ed51c1700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2ba0 con 0x5582d78de1b0 2023-10-05T21:15:37.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.474+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2ecc016070 con 0x5582d78de1b0 2023-10-05T21:15:37.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.474+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2ba0 con 0x5582d78adbc0 2023-10-05T21:15:37.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.474+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.474+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2ba0 con 0x7f2ec8007030 2023-10-05T21:15:37.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.475+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ed000a570 con 0x7f2ec8007030 2023-10-05T21:15:37.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.475+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2ba0 con 0x5582d78adbc0 2023-10-05T21:15:37.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.475+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.475+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2ba0 con 0x7f2ecc019760 2023-10-05T21:15:37.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.475+0000 7f2ed51c1700 1 -- 172.21.15.153:0/2201758663 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ec8019040 con 0x7f2ecc019760 2023-10-05T21:15:37.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.475+0000 7f2ed51c1700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2ba0 con 0x5582d78de1b0 2023-10-05T21:15:37.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.475+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ecc016070 con 0x5582d78de1b0 2023-10-05T21:15:37.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.475+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2ba0 con 0x5582d78de1b0 2023-10-05T21:15:37.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.475+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ecc016070 con 0x5582d78de1b0 2023-10-05T21:15:37.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.475+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2ba0 con 0x7f2ec8007030 2023-10-05T21:15:37.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.476+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ed000a570 con 0x7f2ec8007030 2023-10-05T21:15:37.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.476+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2ba0 con 0x5582d78de1b0 2023-10-05T21:15:37.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.476+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ecc016070 con 0x5582d78de1b0 2023-10-05T21:15:37.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.476+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2ba0 con 0x5582d78de1b0 2023-10-05T21:15:37.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.476+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ecc016070 con 0x5582d78de1b0 2023-10-05T21:15:37.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.476+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2ba0 con 0x5582d78adbc0 2023-10-05T21:15:37.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.476+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.476+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2ba0 con 0x5582d78adbc0 2023-10-05T21:15:37.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.477+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.477+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2ba0 con 0x7f2ec8007030 2023-10-05T21:15:37.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.477+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ed000a570 con 0x7f2ec8007030 2023-10-05T21:15:37.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.477+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2ba0 con 0x5582d78de1b0 2023-10-05T21:15:37.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.477+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ecc016070 con 0x5582d78de1b0 2023-10-05T21:15:37.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.477+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2ba0 con 0x7f2ecc019760 2023-10-05T21:15:37.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.477+0000 7f2ed51c1700 1 -- 172.21.15.153:0/2201758663 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ec8019040 con 0x7f2ecc019760 2023-10-05T21:15:37.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.477+0000 7f2ed51c1700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2ba0 con 0x5582d78adbc0 2023-10-05T21:15:37.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.478+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.478+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2ba0 con 0x7f2ec8007030 2023-10-05T21:15:37.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.478+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ed000a570 con 0x7f2ec8007030 2023-10-05T21:15:37.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.478+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2ba0 con 0x5582d78de1b0 2023-10-05T21:15:37.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.478+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ecc016070 con 0x5582d78de1b0 2023-10-05T21:15:37.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.478+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2ba0 con 0x7f2ec8007030 2023-10-05T21:15:37.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.478+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ed000a570 con 0x7f2ec8007030 2023-10-05T21:15:37.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.479+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2ba0 con 0x7f2ecc019760 2023-10-05T21:15:37.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.479+0000 7f2ed51c1700 1 -- 172.21.15.153:0/2201758663 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ec8019040 con 0x7f2ecc019760 2023-10-05T21:15:37.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.479+0000 7f2ed51c1700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2ba0 con 0x5582d78de1b0 2023-10-05T21:15:37.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.479+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ecc016070 con 0x5582d78de1b0 2023-10-05T21:15:37.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.479+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2ba0 con 0x7f2ec8007030 2023-10-05T21:15:37.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.479+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ed000a570 con 0x7f2ec8007030 2023-10-05T21:15:37.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.479+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2ba0 con 0x5582d78adbc0 2023-10-05T21:15:37.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.479+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.479+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e2ba0 con 0x7f2ecc019760 2023-10-05T21:15:37.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.480+0000 7f2ed51c1700 1 -- 172.21.15.153:0/2201758663 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ec8019040 con 0x7f2ecc019760 2023-10-05T21:15:37.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.480+0000 7f2ee28ea680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:37.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.480+0000 7f2ee28ea680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:37.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.480+0000 7f2ee28ea680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:37.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.480+0000 7f2ee28ea680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:37.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.480+0000 7f2ee28ea680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.480+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e3300 con 0x5582d78adbc0 2023-10-05T21:15:37.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.480+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.480+0000 7f2ee28ea680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:37.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.480+0000 7f2ee28ea680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.480+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e3700 con 0x5582d78de1b0 2023-10-05T21:15:37.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.480+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f2ecc016070 con 0x5582d78de1b0 2023-10-05T21:15:37.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.480+0000 7f2ee28ea680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:37.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.480+0000 7f2ee28ea680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.480+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e3ff0 con 0x5582d78adbc0 2023-10-05T21:15:37.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.480+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.480+0000 7f2ee28ea680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:37.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.480+0000 7f2ee28ea680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.480+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e3ff0 con 0x5582d78adbc0 2023-10-05T21:15:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.481+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.481+0000 7f2ee28ea680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.481+0000 7f2ee28ea680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.481+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e3ff0 con 0x7f2ec8007030 2023-10-05T21:15:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.481+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f2ed000a570 con 0x7f2ec8007030 2023-10-05T21:15:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.481+0000 7f2ee28ea680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.481+0000 7f2ee28ea680 20 zone default found 2023-10-05T21:15:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.481+0000 7f2ee28ea680 4 Realm: () 2023-10-05T21:15:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.481+0000 7f2ee28ea680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.481+0000 7f2ee28ea680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.481+0000 7f2ee28ea680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.481+0000 7f2ee28ea680 20 zonegroup default 2023-10-05T21:15:37.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.481+0000 7f2ee28ea680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.481+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e3ff0 con 0x7f2ec8007030 2023-10-05T21:15:37.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.481+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f2ed000a570 con 0x7f2ec8007030 2023-10-05T21:15:37.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.481+0000 7f2ee28ea680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.481+0000 7f2ee28ea680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.481+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e3ff0 con 0x5582d78de1b0 2023-10-05T21:15:37.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.481+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2ecc016070 con 0x5582d78de1b0 2023-10-05T21:15:37.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.481+0000 7f2ee28ea680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.481+0000 7f2ee28ea680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.482+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e5eb0 con 0x5582d78de1b0 2023-10-05T21:15:37.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.482+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2ecc016070 con 0x5582d78de1b0 2023-10-05T21:15:37.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.482+0000 7f2ee28ea680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.482+0000 7f2ee28ea680 20 started sync module instance, tier type = 2023-10-05T21:15:37.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.482+0000 7f2ee28ea680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:37.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.482+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e5570 con 0x7f2ecc019760 2023-10-05T21:15:37.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.483+0000 7f2ed51c1700 1 -- 172.21.15.153:0/2201758663 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ec8019040 con 0x7f2ecc019760 2023-10-05T21:15:37.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.483+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94020450539888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e6750 con 0x7f2ecc019760 2023-10-05T21:15:37.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.483+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e6ff0 con 0x5582d78adbc0 2023-10-05T21:15:37.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.483+0000 7f2ed51c1700 1 -- 172.21.15.153:0/2201758663 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94020450539888] v29'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ec8019040 con 0x7f2ecc019760 2023-10-05T21:15:37.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.483+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.483+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94020450542176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e6ff0 con 0x5582d78adbc0 2023-10-05T21:15:37.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.483+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e7b40 con 0x5582d78de1b0 2023-10-05T21:15:37.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.484+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94020450542176] v29'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.484+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ecc016070 con 0x5582d78de1b0 2023-10-05T21:15:37.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.484+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94020450544384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e6f50 con 0x5582d78de1b0 2023-10-05T21:15:37.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.484+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e8910 con 0x7f2ecc019760 2023-10-05T21:15:37.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.485+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94020450544384] v29'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ecc016070 con 0x5582d78de1b0 2023-10-05T21:15:37.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.485+0000 7f2ed51c1700 1 -- 172.21.15.153:0/2201758663 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ec8019040 con 0x7f2ecc019760 2023-10-05T21:15:37.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.485+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94020450549488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e8d10 con 0x7f2ecc019760 2023-10-05T21:15:37.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.485+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e9720 con 0x5582d78adbc0 2023-10-05T21:15:37.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.486+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.486+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94020450554976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e9f50 con 0x5582d78adbc0 2023-10-05T21:15:37.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.486+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78eab50 con 0x7f2ec8007030 2023-10-05T21:15:37.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.486+0000 7f2ed51c1700 1 -- 172.21.15.153:0/2201758663 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94020450549488] v29'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ec8019040 con 0x7f2ecc019760 2023-10-05T21:15:37.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.487+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94020450554976] v29'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.487+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ed000a570 con 0x7f2ec8007030 2023-10-05T21:15:37.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.487+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94020450559456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78eab10 con 0x7f2ec8007030 2023-10-05T21:15:37.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.487+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e9ad0 con 0x7f2ec8007030 2023-10-05T21:15:37.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.487+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94020450559456] v29'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ed000a570 con 0x7f2ec8007030 2023-10-05T21:15:37.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.487+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v29'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ed000a570 con 0x7f2ec8007030 2023-10-05T21:15:37.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.488+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94020450550592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78eb3f0 con 0x7f2ec8007030 2023-10-05T21:15:37.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.488+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78ebe00 con 0x7f2ec8007030 2023-10-05T21:15:37.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.488+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94020450550592] v29'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ed000a570 con 0x7f2ec8007030 2023-10-05T21:15:37.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.488+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ed000a570 con 0x7f2ec8007030 2023-10-05T21:15:37.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.488+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94020450562416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78ebe00 con 0x7f2ec8007030 2023-10-05T21:15:37.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.488+0000 7f2ee28ea680 20 add_watcher() i=0 2023-10-05T21:15:37.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.488+0000 7f2ee28ea680 20 add_watcher() i=1 2023-10-05T21:15:37.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.488+0000 7f2ee28ea680 20 add_watcher() i=2 2023-10-05T21:15:37.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.488+0000 7f2ee28ea680 20 add_watcher() i=3 2023-10-05T21:15:37.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.488+0000 7f2ee28ea680 20 add_watcher() i=4 2023-10-05T21:15:37.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.488+0000 7f2ee28ea680 20 add_watcher() i=5 2023-10-05T21:15:37.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.488+0000 7f2ee28ea680 20 add_watcher() i=6 2023-10-05T21:15:37.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.489+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94020450562416] v29'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ed000a570 con 0x7f2ec8007030 2023-10-05T21:15:37.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.489+0000 7f2ee28ea680 20 add_watcher() i=7 2023-10-05T21:15:37.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.489+0000 7f2ee28ea680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:37.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.489+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78ef050 con 0x5582d78adbc0 2023-10-05T21:15:37.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.489+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.489+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94020450564736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78ec3c0 con 0x5582d78adbc0 2023-10-05T21:15:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.490+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94020450564736] v29'210 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.490+0000 7f2ea6fe5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.490+0000 7f2ee28ea680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.490+0000 7f2ee28ea680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.490+0000 7f2ee28ea680 1 Processor -- start 2023-10-05T21:15:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.490+0000 7f2ee28ea680 1 -- start start 2023-10-05T21:15:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.491+0000 7f2ee28ea680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d78f8e00 0x5582d78f9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.491+0000 7f2ee28ea680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582d78f9820 con 0x5582d78f8e00 2023-10-05T21:15:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.491+0000 7f2ed51c1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d78f8e00 0x5582d78f9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.491+0000 7f2ed51c1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d78f8e00 0x5582d78f9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:56614/0 (socket says 172.21.15.153:56614) 2023-10-05T21:15:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.491+0000 7f2ed51c1700 1 -- 172.21.15.153:0/3522221161 learned_addr learned my addr 172.21.15.153:0/3522221161 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:37.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.491+0000 7f2ed51c1700 1 -- 172.21.15.153:0/3522221161 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582d78f9d00 con 0x5582d78f8e00 2023-10-05T21:15:37.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.491+0000 7f2ed51c1700 1 --2- 172.21.15.153:0/3522221161 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d78f8e00 0x5582d78f9210 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x5582d78a7f60 tx=0x7f2ec8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c6664dcfb4ee9e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.491+0000 7f2ea67e4700 1 -- 172.21.15.153:0/3522221161 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ec801de90 con 0x5582d78f8e00 2023-10-05T21:15:37.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.491+0000 7f2ea67e4700 1 -- 172.21.15.153:0/3522221161 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec802b440 con 0x5582d78f8e00 2023-10-05T21:15:37.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.491+0000 7f2ea67e4700 1 -- 172.21.15.153:0/3522221161 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ec802b5d0 con 0x5582d78f8e00 2023-10-05T21:15:37.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.492+0000 7f2ee28ea680 1 -- 172.21.15.153:0/3522221161 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d78f8e00 msgr2=0x5582d78f9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.492+0000 7f2ee28ea680 1 --2- 172.21.15.153:0/3522221161 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d78f8e00 0x5582d78f9210 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x5582d78a7f60 tx=0x7f2ec8012000 comp rx=0 tx=0).stop 2023-10-05T21:15:37.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.492+0000 7f2ee28ea680 1 -- 172.21.15.153:0/3522221161 shutdown_connections 2023-10-05T21:15:37.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.492+0000 7f2ee28ea680 1 --2- 172.21.15.153:0/3522221161 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d78f8e00 0x5582d78f9210 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.492+0000 7f2ee28ea680 1 -- 172.21.15.153:0/3522221161 >> 172.21.15.153:0/3522221161 conn(0x5582d78f5100 msgr2=0x5582d78f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:37.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.492+0000 7f2ee28ea680 1 -- 172.21.15.153:0/3522221161 shutdown_connections 2023-10-05T21:15:37.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.492+0000 7f2ee28ea680 1 -- 172.21.15.153:0/3522221161 wait complete. 2023-10-05T21:15:37.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.492+0000 7f2ee28ea680 1 Processor -- start 2023-10-05T21:15:37.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.492+0000 7f2ee28ea680 1 -- start start 2023-10-05T21:15:37.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.493+0000 7f2ee28ea680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d78f8e00 0x5582d78ffb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.493+0000 7f2ee28ea680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582d7900080 con 0x5582d78f8e00 2023-10-05T21:15:37.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.493+0000 7f2ed51c1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d78f8e00 0x5582d78ffb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.493+0000 7f2ed51c1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d78f8e00 0x5582d78ffb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:56628/0 (socket says 172.21.15.153:56628) 2023-10-05T21:15:37.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.493+0000 7f2ed51c1700 1 -- 172.21.15.153:0/4150555548 learned_addr learned my addr 172.21.15.153:0/4150555548 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:37.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.493+0000 7f2ed51c1700 1 -- 172.21.15.153:0/4150555548 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582d78b14f0 con 0x5582d78f8e00 2023-10-05T21:15:37.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.493+0000 7f2ed51c1700 1 --2- 172.21.15.153:0/4150555548 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d78f8e00 0x5582d78ffb40 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x5582d78f4670 tx=0x7f2ec8030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.493+0000 7f2ea4fe1700 1 -- 172.21.15.153:0/4150555548 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ec8036610 con 0x5582d78f8e00 2023-10-05T21:15:37.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.493+0000 7f2ea4fe1700 1 -- 172.21.15.153:0/4150555548 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec80367b0 con 0x5582d78f8e00 2023-10-05T21:15:37.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.493+0000 7f2ea4fe1700 1 -- 172.21.15.153:0/4150555548 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ec8036960 con 0x5582d78f8e00 2023-10-05T21:15:37.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.493+0000 7f2ee28ea680 1 -- 172.21.15.153:0/4150555548 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5582d7900280 con 0x5582d78f8e00 2023-10-05T21:15:37.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.493+0000 7f2ee28ea680 1 -- 172.21.15.153:0/4150555548 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5582d79006d0 con 0x5582d78f8e00 2023-10-05T21:15:37.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.494+0000 7f2ea4fe1700 1 -- 172.21.15.153:0/4150555548 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f2ec8036ac0 con 0x5582d78f8e00 2023-10-05T21:15:37.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.494+0000 7f2ea4fe1700 1 --2- 172.21.15.153:0/4150555548 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2e1c034140 0x7f2e1c0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.494+0000 7f2ea4fe1700 1 -- 172.21.15.153:0/4150555548 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f2ec8030070 con 0x5582d78f8e00 2023-10-05T21:15:37.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.494+0000 7f2ed61c3700 1 --2- 172.21.15.153:0/4150555548 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2e1c034140 0x7f2e1c0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.494+0000 7f2ee28ea680 5 note: GC not initialized 2023-10-05T21:15:37.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.495+0000 7f2ed61c3700 1 --2- 172.21.15.153:0/4150555548 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2e1c034140 0x7f2e1c0365f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x5582d78ef0d0 tx=0x7f2ed0037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.495+0000 7f2e15ffb700 20 reqs_thread_entry: start 2023-10-05T21:15:37.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.496+0000 7f2e077fe700 20 reqs_thread_entry: start 2023-10-05T21:15:37.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.496+0000 7f2ee28ea680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:37.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.496+0000 7f2ee28ea680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:37.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.496+0000 7f2e05ffb700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:16:07 2023 2023-10-05T21:15:37.524 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:37.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.496+0000 7f2e057fa700 20 reqs_thread_entry: start 2023-10-05T21:15:37.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.496+0000 7f2ee28ea680 20 get_system_obj_state: rctx=0x7ffc9aa6db28 obj=default.rgw.meta:users.uid:foo state=0x5582d775a240 s->prefetch_data=0 2023-10-05T21:15:37.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.496+0000 7f2ee28ea680 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T21:15:37.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.496+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d79654f0 con 0x5582d78adbc0 2023-10-05T21:15:37.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.496+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv14 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.496+0000 7f2ee28ea680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T21:15:37.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.496+0000 7f2ee28ea680 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:37.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.496+0000 7f2ee28ea680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:37.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.496+0000 7f2ee28ea680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:37.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.496+0000 7f2ee28ea680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:37.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.496+0000 7f2ee28ea680 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:37.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.496+0000 7f2ee28ea680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.496+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d79677c0 con 0x5582d78adbc0 2023-10-05T21:15:37.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.497+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~369 out=369b,getxattrs out=75b] v0'0 uv14 ondisk = 0) v8 ==== 273+0+492 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.497+0000 7f2ee28ea680 20 rados_obj.operate() r=0 bl.length=369 2023-10-05T21:15:37.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.497+0000 7f2ee28ea680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T21:15:37.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.497+0000 7f2ee28ea680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:37.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.497+0000 7f2ee28ea680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:37.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.497+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:104 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d7969320 con 0x5582d78adbc0 2023-10-05T21:15:37.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.498+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(104 foo [delete,create,call,writefull 0~357] v29'15 uv15 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.498+0000 7f2ee28ea680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T21:15:37.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.498+0000 7f2ee28ea680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:37.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.498+0000 7f2ee28ea680 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T21:15:37.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.498+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [notify cookie 94020451057648 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d7964440 con 0x5582d78adbc0 2023-10-05T21:15:37.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.498+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== watch-notify(notify (1) cookie 94020450554976 notify 124554051608 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x7f2ed0029200 con 0x5582d78adbc0 2023-10-05T21:15:37.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.498+0000 7f2ec77fe700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051608 cookie 94020450554976 notifier 4652 bl.length()=533 2023-10-05T21:15:37.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.498+0000 7f2ec77fe700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T21:15:37.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.498+0000 7f2ec77fe700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:37.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.498+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(105 notify.4 [notify cookie 94020451057648 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.498+0000 7f2ec77fe700 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f2eb4003d90 con 0x5582d78adbc0 2023-10-05T21:15:37.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.498+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(106 notify.4 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.498+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== watch-notify(notify_complete (2) cookie 94020451057648 notify 124554051608 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f2ed002d040 con 0x5582d78adbc0 2023-10-05T21:15:37.527 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:15:37.527 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "foo", 2023-10-05T21:15:37.527 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Foo", 2023-10-05T21:15:37.527 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "foo@foo.com", 2023-10-05T21:15:37.527 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2023-10-05T21:15:37.527 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 4, 2023-10-05T21:15:37.528 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [], 2023-10-05T21:15:37.528 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2023-10-05T21:15:37.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:15:37.528 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:15:37.528 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T21:15:37.528 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T21:15:37.528 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:15:37.528 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:15:37.528 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [], 2023-10-05T21:15:37.528 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2023-10-05T21:15:37.528 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2023-10-05T21:15:37.528 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2023-10-05T21:15:37.529 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2023-10-05T21:15:37.529 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2023-10-05T21:15:37.529 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:15:37.529 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:37.529 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:37.529 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:37.529 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:37.529 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:37.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:37.529 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2023-10-05T21:15:37.529 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:15:37.529 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:15:37.530 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:15:37.530 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:15:37.530 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:15:37.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:15:37.530 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2023-10-05T21:15:37.530 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2023-10-05T21:15:37.530 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [] 2023-10-05T21:15:37.530 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:15:37.530 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:15:37.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.499+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:107 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94020450539888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d7963ff0 con 0x7f2ecc019760 2023-10-05T21:15:37.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.499+0000 7f2ed51c1700 1 -- 172.21.15.153:0/2201758663 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(107 notify.0 [watch unwatch cookie 94020450539888] v29'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ec8033040 con 0x7f2ecc019760 2023-10-05T21:15:37.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.499+0000 7f2ee28ea680 20 remove_watcher() i=0 2023-10-05T21:15:37.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.499+0000 7f2ee28ea680 2 removed watcher, disabling cache 2023-10-05T21:15:37.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.499+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:108 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94020450542176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e5970 con 0x5582d78adbc0 2023-10-05T21:15:37.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.500+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 42 ==== osd_op_reply(108 notify.1 [watch unwatch cookie 94020450542176] v29'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.500+0000 7f2ee28ea680 20 remove_watcher() i=1 2023-10-05T21:15:37.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.500+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:109 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94020450544384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e5970 con 0x5582d78de1b0 2023-10-05T21:15:37.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.501+0000 7f2ed59c2700 1 -- 172.21.15.153:0/2201758663 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(109 notify.2 [watch unwatch cookie 94020450544384] v29'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ecc016070 con 0x5582d78de1b0 2023-10-05T21:15:37.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.501+0000 7f2ee28ea680 20 remove_watcher() i=2 2023-10-05T21:15:37.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.501+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:110 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94020450549488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e6b00 con 0x7f2ecc019760 2023-10-05T21:15:37.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.502+0000 7f2ed51c1700 1 -- 172.21.15.153:0/2201758663 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(110 notify.3 [watch unwatch cookie 94020450549488] v29'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ec8033040 con 0x7f2ecc019760 2023-10-05T21:15:37.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.502+0000 7f2ee28ea680 20 remove_watcher() i=3 2023-10-05T21:15:37.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.502+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:111 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94020450554976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e5970 con 0x5582d78adbc0 2023-10-05T21:15:37.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.502+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 43 ==== osd_op_reply(111 notify.4 [watch unwatch cookie 94020450554976] v29'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.502+0000 7f2ee28ea680 20 remove_watcher() i=4 2023-10-05T21:15:37.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.502+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94020450559456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e7ef0 con 0x7f2ec8007030 2023-10-05T21:15:37.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.503+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(112 notify.5 [watch unwatch cookie 94020450559456] v29'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ed000a570 con 0x7f2ec8007030 2023-10-05T21:15:37.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.503+0000 7f2ee28ea680 20 remove_watcher() i=5 2023-10-05T21:15:37.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.503+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:113 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94020450550592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e6b00 con 0x7f2ec8007030 2023-10-05T21:15:37.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.504+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(113 notify.6 [watch unwatch cookie 94020450550592] v29'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ed000a570 con 0x7f2ec8007030 2023-10-05T21:15:37.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.504+0000 7f2ee28ea680 20 remove_watcher() i=6 2023-10-05T21:15:37.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.504+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:114 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94020450562416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e9460 con 0x7f2ec8007030 2023-10-05T21:15:37.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.505+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(114 notify.7 [watch unwatch cookie 94020450562416] v29'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ed000a570 con 0x7f2ec8007030 2023-10-05T21:15:37.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.505+0000 7f2ee28ea680 20 remove_watcher() i=7 2023-10-05T21:15:37.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.506+0000 7f2ea6fe5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:37.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.506+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:115 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94020450564736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x5582d78e5970 con 0x5582d78adbc0 2023-10-05T21:15:37.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.506+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 <== osd.1 v2:172.21.15.153:6816/140456 44 ==== osd_op_reply(115 data_loggenerations_metadata [watch unwatch cookie 94020450564736] v29'211 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2ed000a570 con 0x5582d78adbc0 2023-10-05T21:15:37.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.506+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f2ec8007030 msgr2=0x7f2ec801d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.506+0000 7f2ee28ea680 1 --2- 172.21.15.153:0/2201758663 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f2ec8007030 0x7f2ec801d420 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.506+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5582d78adbc0 msgr2=0x5582d78dbd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.506+0000 7f2ee28ea680 1 --2- 172.21.15.153:0/2201758663 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5582d78adbc0 0x5582d78dbd90 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.506+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f2ecc019760 msgr2=0x7f2ecc00e3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.506+0000 7f2ee28ea680 1 --2- 172.21.15.153:0/2201758663 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f2ecc019760 0x7f2ecc00e3b0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.506+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5582d78de1b0 msgr2=0x5582d78e0590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.506+0000 7f2ee28ea680 1 --2- 172.21.15.153:0/2201758663 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5582d78de1b0 0x5582d78e0590 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.507+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2eb8034140 msgr2=0x7f2eb80365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.507+0000 7f2ee28ea680 1 --2- 172.21.15.153:0/2201758663 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2eb8034140 0x7f2eb80365f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8005b50 tx=0x7f2ec8015000 comp rx=0 tx=0).stop 2023-10-05T21:15:37.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.507+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d781b0b0 msgr2=0x5582d78cffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.507+0000 7f2ed61c3700 1 -- 172.21.15.153:0/2201758663 reap_dead start 2023-10-05T21:15:37.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.507+0000 7f2ee28ea680 1 --2- 172.21.15.153:0/2201758663 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d781b0b0 0x5582d78cffc0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc000c00 tx=0x7f2ecc016000 comp rx=0 tx=0).stop 2023-10-05T21:15:37.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.507+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 shutdown_connections 2023-10-05T21:15:37.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.507+0000 7f2ee28ea680 1 --2- 172.21.15.153:0/2201758663 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d781b0b0 0x5582d78cffc0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.507+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 >> 172.21.15.153:0/2201758663 conn(0x5582d78a1b90 msgr2=0x5582d78c2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:37.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.507+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 shutdown_connections 2023-10-05T21:15:37.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.507+0000 7f2ee28ea680 1 -- 172.21.15.153:0/2201758663 wait complete. 2023-10-05T21:15:37.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.507+0000 7f2ee28ea680 1 -- 172.21.15.153:0/4150555548 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2e1c034140 msgr2=0x7f2e1c0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.507+0000 7f2ee28ea680 1 --2- 172.21.15.153:0/4150555548 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2e1c034140 0x7f2e1c0365f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x5582d78ef0d0 tx=0x7f2ed0037450 comp rx=0 tx=0).stop 2023-10-05T21:15:37.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.507+0000 7f2ee28ea680 1 -- 172.21.15.153:0/4150555548 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d78f8e00 msgr2=0x5582d78ffb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.507+0000 7f2ee28ea680 1 --2- 172.21.15.153:0/4150555548 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d78f8e00 0x5582d78ffb40 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x5582d78f4670 tx=0x7f2ec8030000 comp rx=0 tx=0).stop 2023-10-05T21:15:37.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.507+0000 7f2ee28ea680 1 -- 172.21.15.153:0/4150555548 shutdown_connections 2023-10-05T21:15:37.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.507+0000 7f2ee28ea680 1 --2- 172.21.15.153:0/4150555548 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f2e1c034140 0x7f2e1c0365f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.507+0000 7f2ee28ea680 1 --2- 172.21.15.153:0/4150555548 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5582d78f8e00 0x5582d78ffb40 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.507+0000 7f2ee28ea680 1 -- 172.21.15.153:0/4150555548 >> 172.21.15.153:0/4150555548 conn(0x5582d78f5100 msgr2=0x5582d78f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:37.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.507+0000 7f2ee28ea680 1 -- 172.21.15.153:0/4150555548 shutdown_connections 2023-10-05T21:15:37.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.507+0000 7f2ee28ea680 1 -- 172.21.15.153:0/4150555548 wait complete. 2023-10-05T21:15:37.540 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:15:37.548 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T21:15:37.548 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2023-10-05T21:15:37.548 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2023-10-05T21:15:37.548 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2023-10-05T21:15:37.592 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:15:37.592 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:15:37.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.592+0000 7f598273c680 1 Processor -- start 2023-10-05T21:15:37.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.592+0000 7f598273c680 1 -- start start 2023-10-05T21:15:37.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.592+0000 7f598273c680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55eeb05e70a0 0x55eeb0678490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.592+0000 7f598273c680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55eeb05c0990 con 0x55eeb06789d0 2023-10-05T21:15:37.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.592+0000 7f598273c680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55eeb0580db0 con 0x55eeb05e70a0 2023-10-05T21:15:37.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.592+0000 7f5975814700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55eeb05e70a0 0x55eeb0678490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.592+0000 7f5975814700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55eeb05e70a0 0x55eeb0678490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:56642/0 (socket says 172.21.15.153:56642) 2023-10-05T21:15:37.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.592+0000 7f5975013700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55eeb06789d0 0x55eeb067adb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:54136/0 (socket says 172.21.15.153:54136) 2023-10-05T21:15:37.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.592+0000 7f5975814700 1 -- 172.21.15.153:0/3878945896 learned_addr learned my addr 172.21.15.153:0/3878945896 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:37.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.592+0000 7f5975814700 1 -- 172.21.15.153:0/3878945896 >> v1:172.21.15.111:6789/0 conn(0x55eeb06789d0 legacy=0x55eeb067adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.592+0000 7f5975814700 1 -- 172.21.15.153:0/3878945896 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eeb067d4e0 con 0x55eeb05e70a0 2023-10-05T21:15:37.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.593+0000 7f5975814700 1 --2- 172.21.15.153:0/3878945896 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb05e70a0 0x55eeb0678490 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f596c00a650 tx=0x7f596c005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d90d3f6485482fae server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.593+0000 7f5974812700 1 -- 172.21.15.153:0/3878945896 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f596c008760 con 0x55eeb05e70a0 2023-10-05T21:15:37.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.593+0000 7f5974812700 1 -- 172.21.15.153:0/3878945896 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596c0088c0 con 0x55eeb05e70a0 2023-10-05T21:15:37.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.593+0000 7f5974812700 1 -- 172.21.15.153:0/3878945896 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f596c008bb0 con 0x55eeb05e70a0 2023-10-05T21:15:37.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.593+0000 7f598273c680 1 -- 172.21.15.153:0/3878945896 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb05e70a0 msgr2=0x55eeb0678490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.593+0000 7f598273c680 1 --2- 172.21.15.153:0/3878945896 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb05e70a0 0x55eeb0678490 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f596c00a650 tx=0x7f596c005b10 comp rx=0 tx=0).stop 2023-10-05T21:15:37.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.593+0000 7f598273c680 1 -- 172.21.15.153:0/3878945896 shutdown_connections 2023-10-05T21:15:37.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.593+0000 7f598273c680 1 --2- 172.21.15.153:0/3878945896 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb05e70a0 0x55eeb0678490 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.593+0000 7f598273c680 1 -- 172.21.15.153:0/3878945896 >> 172.21.15.153:0/3878945896 conn(0x55eeb066db80 msgr2=0x55eeb066ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:37.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.593+0000 7f598273c680 1 -- 172.21.15.153:0/3878945896 shutdown_connections 2023-10-05T21:15:37.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.593+0000 7f598273c680 1 -- 172.21.15.153:0/3878945896 wait complete. 2023-10-05T21:15:37.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.594+0000 7f598273c680 1 Processor -- start 2023-10-05T21:15:37.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.594+0000 7f598273c680 1 -- start start 2023-10-05T21:15:37.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.594+0000 7f598273c680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb05e70a0 0x55eeb0694b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.594+0000 7f598273c680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eeb0520ea0 con 0x55eeb05e70a0 2023-10-05T21:15:37.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.594+0000 7f5975814700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb05e70a0 0x55eeb0694b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.594+0000 7f5975814700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb05e70a0 0x55eeb0694b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:56648/0 (socket says 172.21.15.153:56648) 2023-10-05T21:15:37.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.594+0000 7f5975814700 1 -- 172.21.15.153:0/3188776451 learned_addr learned my addr 172.21.15.153:0/3188776451 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:37.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.594+0000 7f5975814700 1 -- 172.21.15.153:0/3188776451 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596c005db0 con 0x55eeb05e70a0 2023-10-05T21:15:37.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.595+0000 7f5975814700 1 --2- 172.21.15.153:0/3188776451 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb05e70a0 0x55eeb0694b20 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f596c005b50 tx=0x7f596c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5058e6e5b7db87da server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.595+0000 7f59677fe700 1 -- 172.21.15.153:0/3188776451 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f596c008760 con 0x55eeb05e70a0 2023-10-05T21:15:37.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.595+0000 7f59677fe700 1 -- 172.21.15.153:0/3188776451 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596c008a30 con 0x55eeb05e70a0 2023-10-05T21:15:37.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.595+0000 7f59677fe700 1 -- 172.21.15.153:0/3188776451 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f596c0055f0 con 0x55eeb05e70a0 2023-10-05T21:15:37.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.595+0000 7f598273c680 1 -- 172.21.15.153:0/3188776451 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb05e70a0 msgr2=0x55eeb0694b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.595+0000 7f598273c680 1 --2- 172.21.15.153:0/3188776451 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb05e70a0 0x55eeb0694b20 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f596c005b50 tx=0x7f596c015000 comp rx=0 tx=0).stop 2023-10-05T21:15:37.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.595+0000 7f598273c680 1 -- 172.21.15.153:0/3188776451 shutdown_connections 2023-10-05T21:15:37.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.595+0000 7f598273c680 1 --2- 172.21.15.153:0/3188776451 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb05e70a0 0x55eeb0694b20 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.595+0000 7f598273c680 1 -- 172.21.15.153:0/3188776451 >> 172.21.15.153:0/3188776451 conn(0x55eeb066db80 msgr2=0x55eeb06905f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:37.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.595+0000 7f598273c680 1 -- 172.21.15.153:0/3188776451 shutdown_connections 2023-10-05T21:15:37.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.595+0000 7f598273c680 1 -- 172.21.15.153:0/3188776451 wait complete. 2023-10-05T21:15:37.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.596+0000 7f598273c680 1 Processor -- start 2023-10-05T21:15:37.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.596+0000 7f598273c680 1 -- start start 2023-10-05T21:15:37.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.596+0000 7f598273c680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb05e70a0 0x55eeb069be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.596+0000 7f598273c680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eeb0517c80 con 0x55eeb05e70a0 2023-10-05T21:15:37.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.596+0000 7f5975814700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb05e70a0 0x55eeb069be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.596+0000 7f5975814700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb05e70a0 0x55eeb069be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:56650/0 (socket says 172.21.15.153:56650) 2023-10-05T21:15:37.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.596+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 learned_addr learned my addr 172.21.15.153:0/4135945452 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:37.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.596+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eeb067d4e0 con 0x55eeb05e70a0 2023-10-05T21:15:37.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.596+0000 7f5975814700 1 --2- 172.21.15.153:0/4135945452 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb05e70a0 0x55eeb069be50 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f596c020040 tx=0x7f596c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.597+0000 7f5965ffb700 1 -- 172.21.15.153:0/4135945452 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f596c0269b0 con 0x55eeb05e70a0 2023-10-05T21:15:37.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.597+0000 7f5965ffb700 1 -- 172.21.15.153:0/4135945452 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596c026b30 con 0x55eeb05e70a0 2023-10-05T21:15:37.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.597+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55eeb069c390 con 0x55eeb05e70a0 2023-10-05T21:15:37.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.597+0000 7f5965ffb700 1 -- 172.21.15.153:0/4135945452 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f596c026e20 con 0x55eeb05e70a0 2023-10-05T21:15:37.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.597+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eeb069c7e0 con 0x55eeb05e70a0 2023-10-05T21:15:37.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.597+0000 7f598273c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.598+0000 7f5965ffb700 1 -- 172.21.15.153:0/4135945452 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f596c037450 con 0x55eeb05e70a0 2023-10-05T21:15:37.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.598+0000 7f5965ffb700 1 --2- 172.21.15.153:0/4135945452 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5958034190 0x7f5958036640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.598+0000 7f5965ffb700 1 -- 172.21.15.153:0/4135945452 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f596c04a030 con 0x55eeb05e70a0 2023-10-05T21:15:37.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.598+0000 7f5975013700 1 --2- 172.21.15.153:0/4135945452 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5958034190 0x7f5958036640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.598+0000 7f598273c680 1 --2- 172.21.15.153:0/4135945452 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55eeb06789d0 0x55eeb06a7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.598+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06a8370 con 0x55eeb06789d0 2023-10-05T21:15:37.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.598+0000 7f5976015700 1 --2- 172.21.15.153:0/4135945452 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55eeb06789d0 0x55eeb06a7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.598+0000 7f5975013700 1 --2- 172.21.15.153:0/4135945452 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5958034190 0x7f5958036640 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f596800b300 tx=0x7f5968001430 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.598+0000 7f5976015700 1 --2- 172.21.15.153:0/4135945452 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55eeb06789d0 0x55eeb06a7be0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.599+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.599+0000 7f598273c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.599+0000 7f598273c680 20 realm 2023-10-05T21:15:37.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.599+0000 7f598273c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.599+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06a51d0 con 0x55eeb06789d0 2023-10-05T21:15:37.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.599+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.599+0000 7f598273c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.599+0000 7f598273c680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:15:37.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.599+0000 7f598273c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.599+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06a8e70 con 0x55eeb06789d0 2023-10-05T21:15:37.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.599+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.599+0000 7f598273c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.599+0000 7f598273c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.599+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06a9790 con 0x55eeb06789d0 2023-10-05T21:15:37.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.599+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.599+0000 7f598273c680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:37.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.600+0000 7f598273c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.600+0000 7f598273c680 1 --2- 172.21.15.153:0/4135945452 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55eeb06aa050 0x55eeb06ac430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.600+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aca90 con 0x55eeb06aa050 2023-10-05T21:15:37.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.600+0000 7f5975814700 1 --2- 172.21.15.153:0/4135945452 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55eeb06aa050 0x55eeb06ac430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.600+0000 7f5975814700 1 --2- 172.21.15.153:0/4135945452 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55eeb06aa050 0x55eeb06ac430 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.600+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06aa050 2023-10-05T21:15:37.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.600+0000 7f598273c680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:37.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.600+0000 7f598273c680 20 searching for the correct realm 2023-10-05T21:15:37.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.600+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06ae600 con 0x55eeb06aa050 2023-10-05T21:15:37.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.600+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06aa050 2023-10-05T21:15:37.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.600+0000 7f5975814700 1 --2- 172.21.15.153:0/4135945452 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f596c007030 0x7f596c048700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.601+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06ae600 con 0x7f596c007030 2023-10-05T21:15:37.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.601+0000 7f5975013700 1 --2- 172.21.15.153:0/4135945452 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f596c007030 0x7f596c048700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.601+0000 7f5975013700 1 --2- 172.21.15.153:0/4135945452 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f596c007030 0x7f596c048700 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.601+0000 7f5975013700 1 -- 172.21.15.153:0/4135945452 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f596800f560 con 0x7f596c007030 2023-10-05T21:15:37.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.601+0000 7f5975013700 1 --2- 172.21.15.153:0/4135945452 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f596800e8c0 0x7f596800d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.601+0000 7f5975013700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06ae600 con 0x7f596800e8c0 2023-10-05T21:15:37.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.601+0000 7f5976015700 1 --2- 172.21.15.153:0/4135945452 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f596800e8c0 0x7f596800d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.602+0000 7f5976015700 1 --2- 172.21.15.153:0/4135945452 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f596800e8c0 0x7f596800d310 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.602+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f597000a570 con 0x7f596800e8c0 2023-10-05T21:15:37.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.602+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06ae600 con 0x55eeb06789d0 2023-10-05T21:15:37.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.602+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.602+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06ae600 con 0x55eeb06789d0 2023-10-05T21:15:37.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.602+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.602+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06ae600 con 0x7f596800e8c0 2023-10-05T21:15:37.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.603+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f597000a570 con 0x7f596800e8c0 2023-10-05T21:15:37.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.603+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06ae600 con 0x7f596800e8c0 2023-10-05T21:15:37.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.603+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f597000a570 con 0x7f596800e8c0 2023-10-05T21:15:37.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.603+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06ae600 con 0x7f596c007030 2023-10-05T21:15:37.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.603+0000 7f5975013700 1 -- 172.21.15.153:0/4135945452 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f596800f560 con 0x7f596c007030 2023-10-05T21:15:37.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.603+0000 7f5975013700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06ae600 con 0x55eeb06aa050 2023-10-05T21:15:37.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.603+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06aa050 2023-10-05T21:15:37.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.603+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06ae600 con 0x55eeb06789d0 2023-10-05T21:15:37.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.603+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.603+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06ae600 con 0x7f596800e8c0 2023-10-05T21:15:37.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.604+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f597000a570 con 0x7f596800e8c0 2023-10-05T21:15:37.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.604+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06ae600 con 0x55eeb06789d0 2023-10-05T21:15:37.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.604+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.604+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06ae600 con 0x7f596c007030 2023-10-05T21:15:37.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.604+0000 7f5975013700 1 -- 172.21.15.153:0/4135945452 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f596800f560 con 0x7f596c007030 2023-10-05T21:15:37.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.604+0000 7f5975013700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f596801f040 con 0x55eeb06aa050 2023-10-05T21:15:37.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.604+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06aa050 2023-10-05T21:15:37.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.604+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f596801f040 con 0x55eeb06aa050 2023-10-05T21:15:37.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.605+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06aa050 2023-10-05T21:15:37.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.605+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f596801f040 con 0x7f596800e8c0 2023-10-05T21:15:37.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.605+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f597000a570 con 0x7f596800e8c0 2023-10-05T21:15:37.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.605+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f596801f040 con 0x55eeb06aa050 2023-10-05T21:15:37.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.605+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06aa050 2023-10-05T21:15:37.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.605+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f596801f040 con 0x55eeb06aa050 2023-10-05T21:15:37.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.605+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06aa050 2023-10-05T21:15:37.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.605+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f596801f040 con 0x55eeb06789d0 2023-10-05T21:15:37.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.605+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.605+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f596801f040 con 0x55eeb06789d0 2023-10-05T21:15:37.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.606+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.606+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f596801f040 con 0x7f596800e8c0 2023-10-05T21:15:37.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.606+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f597000a570 con 0x7f596800e8c0 2023-10-05T21:15:37.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.606+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f596801f040 con 0x55eeb06aa050 2023-10-05T21:15:37.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.606+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06aa050 2023-10-05T21:15:37.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.606+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f596801f040 con 0x7f596c007030 2023-10-05T21:15:37.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.607+0000 7f5975013700 1 -- 172.21.15.153:0/4135945452 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f596800f560 con 0x7f596c007030 2023-10-05T21:15:37.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.607+0000 7f5975013700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f596801f040 con 0x55eeb06789d0 2023-10-05T21:15:37.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.607+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.607+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f596801f040 con 0x7f596800e8c0 2023-10-05T21:15:37.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.607+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f597000a570 con 0x7f596800e8c0 2023-10-05T21:15:37.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.607+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f596801f040 con 0x55eeb06aa050 2023-10-05T21:15:37.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.607+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06aa050 2023-10-05T21:15:37.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.607+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f596801f040 con 0x7f596800e8c0 2023-10-05T21:15:37.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.608+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f597000a570 con 0x7f596800e8c0 2023-10-05T21:15:37.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.608+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f596801f040 con 0x7f596c007030 2023-10-05T21:15:37.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.608+0000 7f5975013700 1 -- 172.21.15.153:0/4135945452 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f596800f560 con 0x7f596c007030 2023-10-05T21:15:37.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.608+0000 7f5975013700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f596801f040 con 0x55eeb06aa050 2023-10-05T21:15:37.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.608+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06aa050 2023-10-05T21:15:37.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.608+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f596801f040 con 0x7f596800e8c0 2023-10-05T21:15:37.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.608+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f597000a570 con 0x7f596800e8c0 2023-10-05T21:15:37.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.608+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f596801f040 con 0x55eeb06789d0 2023-10-05T21:15:37.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.608+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.608+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x7f596801f040 con 0x7f596c007030 2023-10-05T21:15:37.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.609+0000 7f5975013700 1 -- 172.21.15.153:0/4135945452 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f596800f560 con 0x7f596c007030 2023-10-05T21:15:37.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.609+0000 7f598273c680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:37.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.609+0000 7f598273c680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:37.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.609+0000 7f598273c680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:37.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.609+0000 7f598273c680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:37.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.609+0000 7f598273c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.609+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06ad550 con 0x55eeb06789d0 2023-10-05T21:15:37.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.609+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.609+0000 7f598273c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.609+0000 7f598273c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.609+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06ad950 con 0x55eeb06789d0 2023-10-05T21:15:37.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.609+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.609+0000 7f598273c680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:37.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.609+0000 7f598273c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.609+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aea90 con 0x55eeb06789d0 2023-10-05T21:15:37.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.609+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.609+0000 7f598273c680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:37.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.609+0000 7f598273c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.609+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aee40 con 0x55eeb06aa050 2023-10-05T21:15:37.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.610+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06aa050 2023-10-05T21:15:37.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.610+0000 7f598273c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.610+0000 7f598273c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.610+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06af1f0 con 0x55eeb06789d0 2023-10-05T21:15:37.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.610+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.610+0000 7f598273c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.610+0000 7f598273c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.610+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06af1f0 con 0x55eeb06789d0 2023-10-05T21:15:37.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.610+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.610+0000 7f598273c680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:37.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.610+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06af1f0 con 0x55eeb06aa050 2023-10-05T21:15:37.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.610+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06aa050 2023-10-05T21:15:37.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.610+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06af1f0 con 0x7f596c007030 2023-10-05T21:15:37.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.610+0000 7f5975013700 1 -- 172.21.15.153:0/4135945452 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f596800f560 con 0x7f596c007030 2023-10-05T21:15:37.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.610+0000 7f5975013700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06af1f0 con 0x7f596800e8c0 2023-10-05T21:15:37.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.611+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f597000a570 con 0x7f596800e8c0 2023-10-05T21:15:37.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.611+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aea90 con 0x55eeb06789d0 2023-10-05T21:15:37.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.611+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.611+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aea90 con 0x55eeb06789d0 2023-10-05T21:15:37.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.611+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.611+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aea90 con 0x7f596800e8c0 2023-10-05T21:15:37.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.611+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f597000a570 con 0x7f596800e8c0 2023-10-05T21:15:37.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.611+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aea90 con 0x7f596800e8c0 2023-10-05T21:15:37.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.612+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f597000a570 con 0x7f596800e8c0 2023-10-05T21:15:37.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.612+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aea90 con 0x7f596c007030 2023-10-05T21:15:37.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.612+0000 7f5975013700 1 -- 172.21.15.153:0/4135945452 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f596800f560 con 0x7f596c007030 2023-10-05T21:15:37.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.612+0000 7f5975013700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aea90 con 0x55eeb06aa050 2023-10-05T21:15:37.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.612+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06aa050 2023-10-05T21:15:37.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.612+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aea90 con 0x55eeb06789d0 2023-10-05T21:15:37.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.612+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.612+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aea90 con 0x7f596800e8c0 2023-10-05T21:15:37.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.612+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f597000a570 con 0x7f596800e8c0 2023-10-05T21:15:37.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.612+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aea90 con 0x55eeb06789d0 2023-10-05T21:15:37.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.613+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.613+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aea90 con 0x7f596c007030 2023-10-05T21:15:37.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.613+0000 7f5975013700 1 -- 172.21.15.153:0/4135945452 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f596800f560 con 0x7f596c007030 2023-10-05T21:15:37.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.613+0000 7f5975013700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aea90 con 0x55eeb06aa050 2023-10-05T21:15:37.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.613+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06aa050 2023-10-05T21:15:37.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.613+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aea90 con 0x55eeb06aa050 2023-10-05T21:15:37.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.613+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06aa050 2023-10-05T21:15:37.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.613+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aea90 con 0x7f596800e8c0 2023-10-05T21:15:37.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.614+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f597000a570 con 0x7f596800e8c0 2023-10-05T21:15:37.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.614+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aea90 con 0x55eeb06aa050 2023-10-05T21:15:37.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.614+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06aa050 2023-10-05T21:15:37.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.614+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aea90 con 0x55eeb06aa050 2023-10-05T21:15:37.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.614+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06aa050 2023-10-05T21:15:37.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.614+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aea90 con 0x55eeb06789d0 2023-10-05T21:15:37.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.614+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.614+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aea90 con 0x55eeb06789d0 2023-10-05T21:15:37.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.614+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.614+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aea90 con 0x7f596800e8c0 2023-10-05T21:15:37.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.615+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f597000a570 con 0x7f596800e8c0 2023-10-05T21:15:37.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.615+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aea90 con 0x55eeb06aa050 2023-10-05T21:15:37.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.615+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06aa050 2023-10-05T21:15:37.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.615+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aea90 con 0x7f596c007030 2023-10-05T21:15:37.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.615+0000 7f5975013700 1 -- 172.21.15.153:0/4135945452 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f596800f560 con 0x7f596c007030 2023-10-05T21:15:37.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.615+0000 7f5975013700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aea90 con 0x55eeb06789d0 2023-10-05T21:15:37.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.615+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.615+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aea90 con 0x7f596800e8c0 2023-10-05T21:15:37.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.616+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f597000a570 con 0x7f596800e8c0 2023-10-05T21:15:37.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.616+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aea90 con 0x55eeb06aa050 2023-10-05T21:15:37.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.616+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06aa050 2023-10-05T21:15:37.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.616+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aea90 con 0x7f596800e8c0 2023-10-05T21:15:37.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.616+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f597000a570 con 0x7f596800e8c0 2023-10-05T21:15:37.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.616+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aea90 con 0x7f596c007030 2023-10-05T21:15:37.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.616+0000 7f5975013700 1 -- 172.21.15.153:0/4135945452 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f596800f560 con 0x7f596c007030 2023-10-05T21:15:37.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.616+0000 7f5975013700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aea90 con 0x55eeb06aa050 2023-10-05T21:15:37.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.617+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06aa050 2023-10-05T21:15:37.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.617+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aea90 con 0x7f596800e8c0 2023-10-05T21:15:37.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.617+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f597000a570 con 0x7f596800e8c0 2023-10-05T21:15:37.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.617+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aea90 con 0x55eeb06789d0 2023-10-05T21:15:37.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.617+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.617+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aea90 con 0x7f596c007030 2023-10-05T21:15:37.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.617+0000 7f5975013700 1 -- 172.21.15.153:0/4135945452 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f596800f560 con 0x7f596c007030 2023-10-05T21:15:37.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.617+0000 7f598273c680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:15:37.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.617+0000 7f598273c680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:15:37.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.617+0000 7f598273c680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:15:37.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.617+0000 7f598273c680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:15:37.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.617+0000 7f598273c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.617+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06af1f0 con 0x55eeb06789d0 2023-10-05T21:15:37.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.618+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.618+0000 7f598273c680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:37.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.618+0000 7f598273c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.618+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06af5f0 con 0x55eeb06aa050 2023-10-05T21:15:37.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.618+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06aa050 2023-10-05T21:15:37.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.618+0000 7f598273c680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:15:37.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.618+0000 7f598273c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.618+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06afe90 con 0x55eeb06789d0 2023-10-05T21:15:37.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.618+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.618+0000 7f598273c680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:15:37.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.618+0000 7f598273c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.618+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06afe90 con 0x55eeb06789d0 2023-10-05T21:15:37.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.618+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.618+0000 7f598273c680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:15:37.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.618+0000 7f598273c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.618+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aff90 con 0x7f596800e8c0 2023-10-05T21:15:37.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.619+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f597000a570 con 0x7f596800e8c0 2023-10-05T21:15:37.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.619+0000 7f598273c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.619+0000 7f598273c680 20 zone default found 2023-10-05T21:15:37.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.619+0000 7f598273c680 4 Realm: () 2023-10-05T21:15:37.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.619+0000 7f598273c680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:15:37.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.619+0000 7f598273c680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:15:37.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.619+0000 7f598273c680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:15:37.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.619+0000 7f598273c680 20 zonegroup default 2023-10-05T21:15:37.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.619+0000 7f598273c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.619+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06aff90 con 0x7f596800e8c0 2023-10-05T21:15:37.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.619+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f597000a570 con 0x7f596800e8c0 2023-10-05T21:15:37.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.619+0000 7f598273c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.619+0000 7f598273c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.619+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06b1910 con 0x55eeb06aa050 2023-10-05T21:15:37.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.619+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06aa050 2023-10-05T21:15:37.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.619+0000 7f598273c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.619+0000 7f598273c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.619+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06b1cc0 con 0x55eeb06aa050 2023-10-05T21:15:37.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.620+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06aa050 2023-10-05T21:15:37.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.620+0000 7f598273c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:15:37.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.620+0000 7f598273c680 20 started sync module instance, tier type = 2023-10-05T21:15:37.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.620+0000 7f598273c680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:15:37.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.620+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06b1020 con 0x7f596c007030 2023-10-05T21:15:37.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.620+0000 7f5975013700 1 -- 172.21.15.153:0/4135945452 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v29'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f596800f560 con 0x7f596c007030 2023-10-05T21:15:37.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.620+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94483650384928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06b2560 con 0x7f596c007030 2023-10-05T21:15:37.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.620+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06b2e00 con 0x55eeb06789d0 2023-10-05T21:15:37.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.621+0000 7f5975013700 1 -- 172.21.15.153:0/4135945452 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94483650384928] v29'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f596800f560 con 0x7f596c007030 2023-10-05T21:15:37.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.621+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v29'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.621+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94483650390288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06b21b0 con 0x55eeb06789d0 2023-10-05T21:15:37.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.621+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06b3a50 con 0x55eeb06aa050 2023-10-05T21:15:37.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.622+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94483650390288] v29'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.622+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v29'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06aa050 2023-10-05T21:15:37.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.622+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94483650393344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06b3e50 con 0x55eeb06aa050 2023-10-05T21:15:37.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.622+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06b4860 con 0x7f596c007030 2023-10-05T21:15:37.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.623+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94483650393344] v29'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06aa050 2023-10-05T21:15:37.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.623+0000 7f5975013700 1 -- 172.21.15.153:0/4135945452 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v29'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f596800f560 con 0x7f596c007030 2023-10-05T21:15:37.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.623+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94483650397040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06b4c60 con 0x7f596c007030 2023-10-05T21:15:37.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.623+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06b5670 con 0x55eeb06789d0 2023-10-05T21:15:37.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.624+0000 7f5975013700 1 -- 172.21.15.153:0/4135945452 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94483650397040] v29'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f596800f560 con 0x7f596c007030 2023-10-05T21:15:37.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.624+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v29'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.624+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94483650400640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06b55d0 con 0x55eeb06789d0 2023-10-05T21:15:37.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.624+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06b6490 con 0x7f596800e8c0 2023-10-05T21:15:37.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.624+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94483650400640] v29'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.625+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v29'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f597000a570 con 0x7f596800e8c0 2023-10-05T21:15:37.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.625+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94483650402848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06b55d0 con 0x7f596800e8c0 2023-10-05T21:15:37.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.625+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06b6ef0 con 0x7f596800e8c0 2023-10-05T21:15:37.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.625+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(96 notify.6 [create] v29'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f597000a570 con 0x7f596800e8c0 2023-10-05T21:15:37.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.625+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(95 notify.5 [watch watch cookie 94483650402848] v29'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f597000a570 con 0x7f596800e8c0 2023-10-05T21:15:37.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.625+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94483650406912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06b7380 con 0x7f596800e8c0 2023-10-05T21:15:37.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.625+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06b7d60 con 0x7f596800e8c0 2023-10-05T21:15:37.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.626+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94483650406912] v29'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f597000a570 con 0x7f596800e8c0 2023-10-05T21:15:37.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.626+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v29'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f597000a570 con 0x7f596800e8c0 2023-10-05T21:15:37.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.626+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94483650408016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06b72a0 con 0x7f596800e8c0 2023-10-05T21:15:37.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.626+0000 7f598273c680 20 add_watcher() i=0 2023-10-05T21:15:37.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.626+0000 7f598273c680 20 add_watcher() i=1 2023-10-05T21:15:37.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.626+0000 7f598273c680 20 add_watcher() i=2 2023-10-05T21:15:37.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.626+0000 7f598273c680 20 add_watcher() i=3 2023-10-05T21:15:37.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.626+0000 7f598273c680 20 add_watcher() i=4 2023-10-05T21:15:37.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.626+0000 7f598273c680 20 add_watcher() i=5 2023-10-05T21:15:37.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.626+0000 7f598273c680 20 add_watcher() i=6 2023-10-05T21:15:37.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.627+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94483650408016] v29'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f597000a570 con 0x7f596800e8c0 2023-10-05T21:15:37.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.627+0000 7f598273c680 20 add_watcher() i=7 2023-10-05T21:15:37.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.627+0000 7f598273c680 2 all 8 watchers are set, enabling cache 2023-10-05T21:15:37.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.627+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06bad90 con 0x55eeb06789d0 2023-10-05T21:15:37.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.627+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.627+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94483650410608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06b8220 con 0x55eeb06789d0 2023-10-05T21:15:37.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.628+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94483650410608] v29'212 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.628+0000 7f5946fe5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:37.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.628+0000 7f598273c680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:15:37.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.628+0000 7f598273c680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:15:37.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.628+0000 7f598273c680 1 Processor -- start 2023-10-05T21:15:37.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.628+0000 7f598273c680 1 -- start start 2023-10-05T21:15:37.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.628+0000 7f598273c680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb06c49e0 0x55eeb06c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.628+0000 7f598273c680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eeb06c5400 con 0x55eeb06c49e0 2023-10-05T21:15:37.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.629+0000 7f5975013700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb06c49e0 0x55eeb06c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.629+0000 7f5975013700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb06c49e0 0x55eeb06c4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:56660/0 (socket says 172.21.15.153:56660) 2023-10-05T21:15:37.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.629+0000 7f5975013700 1 -- 172.21.15.153:0/1133621806 learned_addr learned my addr 172.21.15.153:0/1133621806 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:37.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.629+0000 7f5975013700 1 -- 172.21.15.153:0/1133621806 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eeb06c58e0 con 0x55eeb06c49e0 2023-10-05T21:15:37.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.629+0000 7f5975013700 1 --2- 172.21.15.153:0/1133621806 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb06c49e0 0x55eeb06c4df0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f5968000fb0 tx=0x7f5968006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e3c407352843e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.629+0000 7f59467e4700 1 -- 172.21.15.153:0/1133621806 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f596800da60 con 0x55eeb06c49e0 2023-10-05T21:15:37.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.629+0000 7f59467e4700 1 -- 172.21.15.153:0/1133621806 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596800dbc0 con 0x55eeb06c49e0 2023-10-05T21:15:37.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.629+0000 7f59467e4700 1 -- 172.21.15.153:0/1133621806 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f596800dd70 con 0x55eeb06c49e0 2023-10-05T21:15:37.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.630+0000 7f598273c680 1 -- 172.21.15.153:0/1133621806 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb06c49e0 msgr2=0x55eeb06c4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.630+0000 7f598273c680 1 --2- 172.21.15.153:0/1133621806 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb06c49e0 0x55eeb06c4df0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f5968000fb0 tx=0x7f5968006000 comp rx=0 tx=0).stop 2023-10-05T21:15:37.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.630+0000 7f598273c680 1 -- 172.21.15.153:0/1133621806 shutdown_connections 2023-10-05T21:15:37.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.630+0000 7f598273c680 1 --2- 172.21.15.153:0/1133621806 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb06c49e0 0x55eeb06c4df0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.630+0000 7f598273c680 1 -- 172.21.15.153:0/1133621806 >> 172.21.15.153:0/1133621806 conn(0x55eeb06c0ce0 msgr2=0x55eeb06bede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:37.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.630+0000 7f598273c680 1 -- 172.21.15.153:0/1133621806 shutdown_connections 2023-10-05T21:15:37.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.630+0000 7f598273c680 1 -- 172.21.15.153:0/1133621806 wait complete. 2023-10-05T21:15:37.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.630+0000 7f598273c680 1 Processor -- start 2023-10-05T21:15:37.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.630+0000 7f598273c680 1 -- start start 2023-10-05T21:15:37.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.630+0000 7f598273c680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb06c49e0 0x55eeb06cb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.630+0000 7f598273c680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eeb06cbcb0 con 0x55eeb06c49e0 2023-10-05T21:15:37.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.631+0000 7f5975013700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb06c49e0 0x55eeb06cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.631+0000 7f5975013700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb06c49e0 0x55eeb06cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:56670/0 (socket says 172.21.15.153:56670) 2023-10-05T21:15:37.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.631+0000 7f5975013700 1 -- 172.21.15.153:0/3132609154 learned_addr learned my addr 172.21.15.153:0/3132609154 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:15:37.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.631+0000 7f5975013700 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5968006070 con 0x55eeb06c49e0 2023-10-05T21:15:37.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.631+0000 7f5975013700 1 --2- 172.21.15.153:0/3132609154 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb06c49e0 0x55eeb06cb770 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f596800efd0 tx=0x7f5968032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.631+0000 7f5944fe1700 1 -- 172.21.15.153:0/3132609154 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f596803da30 con 0x55eeb06c49e0 2023-10-05T21:15:37.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.631+0000 7f5944fe1700 1 -- 172.21.15.153:0/3132609154 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596803db90 con 0x55eeb06c49e0 2023-10-05T21:15:37.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.631+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55eeb06cbeb0 con 0x55eeb06c49e0 2023-10-05T21:15:37.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.631+0000 7f5944fe1700 1 -- 172.21.15.153:0/3132609154 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f596803dd20 con 0x55eeb06c49e0 2023-10-05T21:15:37.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.631+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eeb06cc300 con 0x55eeb06c49e0 2023-10-05T21:15:37.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.632+0000 7f5944fe1700 1 -- 172.21.15.153:0/3132609154 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f596801a040 con 0x55eeb06c49e0 2023-10-05T21:15:37.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.632+0000 7f5944fe1700 1 --2- 172.21.15.153:0/3132609154 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f58bc0340f0 0x7f58bc0365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.632+0000 7f5944fe1700 1 -- 172.21.15.153:0/3132609154 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f5968048b30 con 0x55eeb06c49e0 2023-10-05T21:15:37.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.632+0000 7f5976015700 1 --2- 172.21.15.153:0/3132609154 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f58bc0340f0 0x7f58bc0365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.632+0000 7f598273c680 1 --2- 172.21.15.153:0/3132609154 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55eeb06d6560 0x55eeb06d8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.632+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06d90c0 con 0x55eeb06d6560 2023-10-05T21:15:37.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.632+0000 7f5975814700 1 --2- 172.21.15.153:0/3132609154 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55eeb06d6560 0x55eeb06d8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.633+0000 7f5976015700 1 --2- 172.21.15.153:0/3132609154 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f58bc0340f0 0x7f58bc0365a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55eeb06b7600 tx=0x7f5970037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.633+0000 7f5975814700 1 --2- 172.21.15.153:0/3132609154 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55eeb06d6560 0x55eeb06d8a10 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.634+0000 7f5975814700 1 -- 172.21.15.153:0/3132609154 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v29'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06d6560 2023-10-05T21:15:37.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.634+0000 7f598273c680 1 --2- 172.21.15.153:0/3132609154 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55eeb06d9e40 0x55eeb06dc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.634+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06dc920 con 0x55eeb06d9e40 2023-10-05T21:15:37.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.634+0000 7f5975013700 1 --2- 172.21.15.153:0/3132609154 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55eeb06d9e40 0x55eeb06dc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.674 DEBUG:teuthology.orchestra.run:got remote process result: 17 2023-10-05T21:15:37.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.634+0000 7f5975013700 1 --2- 172.21.15.153:0/3132609154 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55eeb06d9e40 0x55eeb06dc220 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.635+0000 7f5975013700 1 -- 172.21.15.153:0/3132609154 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v29'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f596800f560 con 0x55eeb06d9e40 2023-10-05T21:15:37.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.635+0000 7f598273c680 1 --2- 172.21.15.153:0/3132609154 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55eeb06dd6b0 0x55eeb06dfb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.635+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06e02b0 con 0x55eeb06dd6b0 2023-10-05T21:15:37.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.635+0000 7f5976015700 1 --2- 172.21.15.153:0/3132609154 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55eeb06dd6b0 0x55eeb06dfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.635+0000 7f5976015700 1 --2- 172.21.15.153:0/3132609154 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55eeb06dd6b0 0x55eeb06dfb60 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.636+0000 7f5976015700 1 -- 172.21.15.153:0/3132609154 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v29'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06dd6b0 2023-10-05T21:15:37.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.636+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06e0a50 con 0x55eeb06d6560 2023-10-05T21:15:37.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.637+0000 7f5975814700 1 -- 172.21.15.153:0/3132609154 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v29'213 uv186 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06d6560 2023-10-05T21:15:37.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.637+0000 7f598273c680 1 --2- 172.21.15.153:0/3132609154 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55eeb06e17d0 0x55eeb06e3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:15:37.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.637+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06e41c0 con 0x55eeb06e17d0 2023-10-05T21:15:37.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.637+0000 7f5975814700 1 --2- 172.21.15.153:0/3132609154 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55eeb06e17d0 0x55eeb06e3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:15:37.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.637+0000 7f5975814700 1 --2- 172.21.15.153:0/3132609154 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55eeb06e17d0 0x55eeb06e3bb0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:15:37.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.638+0000 7f5975814700 1 -- 172.21.15.153:0/3132609154 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v29'70 uv58 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06e17d0 2023-10-05T21:15:37.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.638+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06e48d0 con 0x55eeb06dd6b0 2023-10-05T21:15:37.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.639+0000 7f5976015700 1 -- 172.21.15.153:0/3132609154 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v29'43 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06dd6b0 2023-10-05T21:15:37.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.639+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06e4f70 con 0x55eeb06d6560 2023-10-05T21:15:37.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.639+0000 7f5975814700 1 -- 172.21.15.153:0/3132609154 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v29'27 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06d6560 2023-10-05T21:15:37.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.639+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06e5000 con 0x55eeb06d9e40 2023-10-05T21:15:37.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.640+0000 7f5975013700 1 -- 172.21.15.153:0/3132609154 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v29'47 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f596800f560 con 0x55eeb06d9e40 2023-10-05T21:15:37.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.640+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06e5640 con 0x55eeb06e17d0 2023-10-05T21:15:37.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.641+0000 7f5975814700 1 -- 172.21.15.153:0/3132609154 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v29'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06e17d0 2023-10-05T21:15:37.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.641+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06e5640 con 0x55eeb06dd6b0 2023-10-05T21:15:37.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.642+0000 7f5976015700 1 -- 172.21.15.153:0/3132609154 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v29'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06dd6b0 2023-10-05T21:15:37.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.642+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06e5c80 con 0x55eeb06e17d0 2023-10-05T21:15:37.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.642+0000 7f5975814700 1 -- 172.21.15.153:0/3132609154 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v29'71 uv60 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06e17d0 2023-10-05T21:15:37.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.642+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06e5be0 con 0x55eeb06d9e40 2023-10-05T21:15:37.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.643+0000 7f5975013700 1 -- 172.21.15.153:0/3132609154 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v29'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f596800f560 con 0x55eeb06d9e40 2023-10-05T21:15:37.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.643+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06e60d0 con 0x55eeb06e17d0 2023-10-05T21:15:37.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.644+0000 7f5975814700 1 -- 172.21.15.153:0/3132609154 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v29'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06e17d0 2023-10-05T21:15:37.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.644+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06e60b0 con 0x55eeb06d9e40 2023-10-05T21:15:37.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.645+0000 7f5975013700 1 -- 172.21.15.153:0/3132609154 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v29'49 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f596800f560 con 0x55eeb06d9e40 2023-10-05T21:15:37.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.645+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06d3d20 con 0x55eeb06d6560 2023-10-05T21:15:37.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.645+0000 7f5975814700 1 -- 172.21.15.153:0/3132609154 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v29'214 uv182 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06d6560 2023-10-05T21:15:37.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.645+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06d3d20 con 0x55eeb06dd6b0 2023-10-05T21:15:37.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.646+0000 7f5976015700 1 -- 172.21.15.153:0/3132609154 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v29'59 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06dd6b0 2023-10-05T21:15:37.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.646+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06d3d20 con 0x55eeb06e17d0 2023-10-05T21:15:37.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.647+0000 7f5975814700 1 -- 172.21.15.153:0/3132609154 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v29'72 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06e17d0 2023-10-05T21:15:37.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.647+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06d3d20 con 0x55eeb06dd6b0 2023-10-05T21:15:37.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.648+0000 7f5976015700 1 -- 172.21.15.153:0/3132609154 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v29'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06dd6b0 2023-10-05T21:15:37.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.648+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06d3d20 con 0x55eeb06d6560 2023-10-05T21:15:37.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.648+0000 7f5975814700 1 -- 172.21.15.153:0/3132609154 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v29'37 uv32 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06d6560 2023-10-05T21:15:37.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.648+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06d3d20 con 0x55eeb06d6560 2023-10-05T21:15:37.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.649+0000 7f5975814700 1 -- 172.21.15.153:0/3132609154 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v29'215 uv184 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06d6560 2023-10-05T21:15:37.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.649+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06d3d20 con 0x55eeb06dd6b0 2023-10-05T21:15:37.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.650+0000 7f5976015700 1 -- 172.21.15.153:0/3132609154 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v29'60 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06dd6b0 2023-10-05T21:15:37.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.650+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06d3b40 con 0x55eeb06e17d0 2023-10-05T21:15:37.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.651+0000 7f5975814700 1 -- 172.21.15.153:0/3132609154 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v29'52 uv37 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06e17d0 2023-10-05T21:15:37.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.651+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06d3b40 con 0x55eeb06dd6b0 2023-10-05T21:15:37.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.651+0000 7f5976015700 1 -- 172.21.15.153:0/3132609154 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v29'30 uv26 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06dd6b0 2023-10-05T21:15:37.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.651+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06d3b40 con 0x55eeb06dd6b0 2023-10-05T21:15:37.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.652+0000 7f5976015700 1 -- 172.21.15.153:0/3132609154 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v29'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06dd6b0 2023-10-05T21:15:37.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.652+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06d3ab0 con 0x55eeb06dd6b0 2023-10-05T21:15:37.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.653+0000 7f5976015700 1 -- 172.21.15.153:0/3132609154 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v29'36 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06dd6b0 2023-10-05T21:15:37.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.653+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06d3ab0 con 0x55eeb06dd6b0 2023-10-05T21:15:37.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.653+0000 7f5976015700 1 -- 172.21.15.153:0/3132609154 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v29'44 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06dd6b0 2023-10-05T21:15:37.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.653+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06d3ab0 con 0x55eeb06d9e40 2023-10-05T21:15:37.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.654+0000 7f5975013700 1 -- 172.21.15.153:0/3132609154 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v29'28 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f596800f560 con 0x55eeb06d9e40 2023-10-05T21:15:37.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.654+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06d3ab0 con 0x55eeb06dd6b0 2023-10-05T21:15:37.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.655+0000 7f5976015700 1 -- 172.21.15.153:0/3132609154 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v29'31 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06dd6b0 2023-10-05T21:15:37.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.655+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06d3ab0 con 0x55eeb06d9e40 2023-10-05T21:15:37.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.656+0000 7f5975013700 1 -- 172.21.15.153:0/3132609154 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v29'48 uv38 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f596800f560 con 0x55eeb06d9e40 2023-10-05T21:15:37.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.656+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06d3ab0 con 0x55eeb06dd6b0 2023-10-05T21:15:37.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.656+0000 7f5976015700 1 -- 172.21.15.153:0/3132609154 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v29'61 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06dd6b0 2023-10-05T21:15:37.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.656+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06d3ab0 con 0x55eeb06d9e40 2023-10-05T21:15:37.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.657+0000 7f5975013700 1 -- 172.21.15.153:0/3132609154 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v29'50 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f596800f560 con 0x55eeb06d9e40 2023-10-05T21:15:37.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.657+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06d3af0 con 0x55eeb06e17d0 2023-10-05T21:15:37.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.658+0000 7f5975814700 1 -- 172.21.15.153:0/3132609154 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v29'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06e17d0 2023-10-05T21:15:37.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.659+0000 7f58b5ffb700 20 reqs_thread_entry: start 2023-10-05T21:15:37.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.659+0000 7f58a77fe700 20 reqs_thread_entry: start 2023-10-05T21:15:37.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.659+0000 7f598273c680 20 init_complete bucket index max shards: 11 2023-10-05T21:15:37.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.659+0000 7f598273c680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:15:37.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.659+0000 7f58a5ffb700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:16:07 2023 2023-10-05T21:15:37.681 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:15:37.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.659+0000 7f58a57fa700 20 reqs_thread_entry: start 2023-10-05T21:15:37.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.659+0000 7f598273c680 20 get_system_obj_state: rctx=0x7ffeb2fd9c68 obj=default.rgw.meta:users.uid:foo state=0x55eeb0526240 s->prefetch_data=0 2023-10-05T21:15:37.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.659+0000 7f598273c680 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T21:15:37.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.659+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb0741750 con 0x55eeb06789d0 2023-10-05T21:15:37.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.659+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.659+0000 7f598273c680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T21:15:37.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.659+0000 7f598273c680 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:37.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.659+0000 7f598273c680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:37.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.660+0000 7f598273c680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:15:37.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.660+0000 7f598273c680 20 Read xattr: user.rgw.idtag 2023-10-05T21:15:37.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.660+0000 7f598273c680 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T21:15:37.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.660+0000 7f598273c680 20 rados->read ofs=0 len=0 2023-10-05T21:15:37.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.660+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb07439e0 con 0x55eeb06789d0 2023-10-05T21:15:37.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.660+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.660+0000 7f598273c680 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T21:15:37.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.660+0000 7f598273c680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T21:15:37.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.660+0000 7f598273c680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:15:37.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.660+0000 7f598273c680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:15:37.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.660+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:104 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb07439e0 con 0x7f596c007030 2023-10-05T21:15:37.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.660+0000 7f5975013700 1 -- 172.21.15.153:0/4135945452 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(104 foo.buckets [call out=183b] v0'0 uv40 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f596800f560 con 0x7f596c007030 2023-10-05T21:15:37.683 INFO:teuthology.orchestra.run.smithi153.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2023-10-05T21:15:37.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.661+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94483650384928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb0700280 con 0x7f596c007030 2023-10-05T21:15:37.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.661+0000 7f5975013700 1 -- 172.21.15.153:0/4135945452 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(105 notify.0 [watch unwatch cookie 94483650384928] v29'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f596800f560 con 0x7f596c007030 2023-10-05T21:15:37.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.661+0000 7f598273c680 20 remove_watcher() i=0 2023-10-05T21:15:37.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.661+0000 7f598273c680 2 removed watcher, disabling cache 2023-10-05T21:15:37.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.661+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94483650390288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06b1420 con 0x55eeb06789d0 2023-10-05T21:15:37.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.662+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(106 notify.1 [watch unwatch cookie 94483650390288] v29'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.662+0000 7f598273c680 20 remove_watcher() i=1 2023-10-05T21:15:37.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.662+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94483650393344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06b2910 con 0x55eeb06aa050 2023-10-05T21:15:37.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.663+0000 7f5975814700 1 -- 172.21.15.153:0/4135945452 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(107 notify.2 [watch unwatch cookie 94483650393344] v29'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f596c034070 con 0x55eeb06aa050 2023-10-05T21:15:37.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.663+0000 7f598273c680 20 remove_watcher() i=2 2023-10-05T21:15:37.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.663+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94483650397040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06b2910 con 0x7f596c007030 2023-10-05T21:15:37.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.664+0000 7f5975013700 1 -- 172.21.15.153:0/4135945452 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(108 notify.3 [watch unwatch cookie 94483650397040] v29'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f596800f560 con 0x7f596c007030 2023-10-05T21:15:37.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.664+0000 7f598273c680 20 remove_watcher() i=3 2023-10-05T21:15:37.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.664+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94483650400640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06b2910 con 0x55eeb06789d0 2023-10-05T21:15:37.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.665+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(109 notify.4 [watch unwatch cookie 94483650400640] v29'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.665+0000 7f598273c680 20 remove_watcher() i=4 2023-10-05T21:15:37.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.665+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94483650402848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06b2910 con 0x7f596800e8c0 2023-10-05T21:15:37.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.665+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(110 notify.5 [watch unwatch cookie 94483650402848] v29'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f597000a570 con 0x7f596800e8c0 2023-10-05T21:15:37.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.666+0000 7f598273c680 20 remove_watcher() i=5 2023-10-05T21:15:37.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.666+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:111 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94483650406912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06b5a20 con 0x7f596800e8c0 2023-10-05T21:15:37.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.666+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(111 notify.6 [watch unwatch cookie 94483650406912] v29'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f597000a570 con 0x7f596800e8c0 2023-10-05T21:15:37.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.666+0000 7f598273c680 20 remove_watcher() i=6 2023-10-05T21:15:37.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.666+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94483650408016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb06b6a00 con 0x7f596800e8c0 2023-10-05T21:15:37.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.667+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(112 notify.7 [watch unwatch cookie 94483650408016] v29'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f597000a570 con 0x7f596800e8c0 2023-10-05T21:15:37.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.667+0000 7f598273c680 20 remove_watcher() i=7 2023-10-05T21:15:37.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.668+0000 7f5946fe5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:15:37.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.668+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:113 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94483650410608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) v8 -- 0x55eeb0703a50 con 0x55eeb06789d0 2023-10-05T21:15:37.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.668+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(113 data_loggenerations_metadata [watch unwatch cookie 94483650410608] v29'216 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f597000a570 con 0x55eeb06789d0 2023-10-05T21:15:37.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.668+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f596800e8c0 msgr2=0x7f596800d310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.668+0000 7f598273c680 1 --2- 172.21.15.153:0/4135945452 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f596800e8c0 0x7f596800d310 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.668+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55eeb06789d0 msgr2=0x55eeb06a7be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.668+0000 7f598273c680 1 --2- 172.21.15.153:0/4135945452 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55eeb06789d0 0x55eeb06a7be0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.668+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f596c007030 msgr2=0x7f596c048700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.668+0000 7f598273c680 1 --2- 172.21.15.153:0/4135945452 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f596c007030 0x7f596c048700 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.668+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55eeb06aa050 msgr2=0x55eeb06ac430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.668+0000 7f598273c680 1 --2- 172.21.15.153:0/4135945452 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55eeb06aa050 0x55eeb06ac430 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.669+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5958034190 msgr2=0x7f5958036640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.669+0000 7f598273c680 1 --2- 172.21.15.153:0/4135945452 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5958034190 0x7f5958036640 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f596800b300 tx=0x7f5968001430 comp rx=0 tx=0).stop 2023-10-05T21:15:37.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.669+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb05e70a0 msgr2=0x55eeb069be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.669+0000 7f5976015700 1 -- 172.21.15.153:0/4135945452 reap_dead start 2023-10-05T21:15:37.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.669+0000 7f598273c680 1 --2- 172.21.15.153:0/4135945452 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb05e70a0 0x55eeb069be50 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f596c020040 tx=0x7f596c01d000 comp rx=0 tx=0).stop 2023-10-05T21:15:37.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.669+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 shutdown_connections 2023-10-05T21:15:37.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.669+0000 7f598273c680 1 --2- 172.21.15.153:0/4135945452 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb05e70a0 0x55eeb069be50 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.669+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 >> 172.21.15.153:0/4135945452 conn(0x55eeb066db80 msgr2=0x55eeb068ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:37.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.669+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 shutdown_connections 2023-10-05T21:15:37.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.669+0000 7f598273c680 1 -- 172.21.15.153:0/4135945452 wait complete. 2023-10-05T21:15:37.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.669+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55eeb06d9e40 msgr2=0x55eeb06dc220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.669+0000 7f598273c680 1 --2- 172.21.15.153:0/3132609154 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55eeb06d9e40 0x55eeb06dc220 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.669+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55eeb06d6560 msgr2=0x55eeb06d8a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.669+0000 7f598273c680 1 --2- 172.21.15.153:0/3132609154 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55eeb06d6560 0x55eeb06d8a10 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.669+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55eeb06e17d0 msgr2=0x55eeb06e3bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.669+0000 7f598273c680 1 --2- 172.21.15.153:0/3132609154 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55eeb06e17d0 0x55eeb06e3bb0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.669+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55eeb06dd6b0 msgr2=0x55eeb06dfb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.669+0000 7f598273c680 1 --2- 172.21.15.153:0/3132609154 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55eeb06dd6b0 0x55eeb06dfb60 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.669+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f58bc0340f0 msgr2=0x7f58bc0365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.669+0000 7f598273c680 1 --2- 172.21.15.153:0/3132609154 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f58bc0340f0 0x7f58bc0365a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55eeb06b7600 tx=0x7f5970037450 comp rx=0 tx=0).stop 2023-10-05T21:15:37.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.669+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb06c49e0 msgr2=0x55eeb06cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:15:37.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.669+0000 7f598273c680 1 --2- 172.21.15.153:0/3132609154 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb06c49e0 0x55eeb06cb770 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f596800efd0 tx=0x7f5968032000 comp rx=0 tx=0).stop 2023-10-05T21:15:37.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.669+0000 7f5975814700 1 -- 172.21.15.153:0/3132609154 reap_dead start 2023-10-05T21:15:37.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.669+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 shutdown_connections 2023-10-05T21:15:37.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.669+0000 7f598273c680 1 --2- 172.21.15.153:0/3132609154 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eeb06c49e0 0x55eeb06cb770 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:15:37.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.669+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 >> 172.21.15.153:0/3132609154 conn(0x55eeb06c0ce0 msgr2=0x55eeb06bedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:15:37.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.669+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 shutdown_connections 2023-10-05T21:15:37.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:15:37.669+0000 7f598273c680 1 -- 172.21.15.153:0/3132609154 wait complete. 2023-10-05T21:15:37.692 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T21:15:37.695 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2023-10-05T21:16:12.696 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2023-10-05T21:16:12.696 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2023-10-05T21:16:12.697 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2023-10-05T21:16:12.752 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:16:12.752 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:16:12.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.751+0000 7ffa4ca5d680 1 Processor -- start 2023-10-05T21:16:12.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.751+0000 7ffa4ca5d680 1 -- start start 2023-10-05T21:16:12.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.752+0000 7ffa4ca5d680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5616570f5930 0x561657186490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:12.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.752+0000 7ffa4ca5d680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5616570ce990 con 0x5616571869d0 2023-10-05T21:16:12.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.752+0000 7ffa4ca5d680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x56165708edb0 con 0x5616570f5930 2023-10-05T21:16:12.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.752+0000 7ffa3fb35700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5616570f5930 0x561657186490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:12.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.752+0000 7ffa3fb35700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5616570f5930 0x561657186490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54668/0 (socket says 172.21.15.153:54668) 2023-10-05T21:16:12.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.752+0000 7ffa3f334700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x5616571869d0 0x561657188db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:57768/0 (socket says 172.21.15.153:57768) 2023-10-05T21:16:12.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.752+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1094713987 learned_addr learned my addr 172.21.15.153:0/1094713987 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:12.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.752+0000 7ffa3eb33700 1 -- 172.21.15.153:0/1094713987 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 21977567 0 0) 0x5616570ce990 con 0x5616571869d0 2023-10-05T21:16:12.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.752+0000 7ffa3eb33700 1 -- 172.21.15.153:0/1094713987 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa28001e10 con 0x5616571869d0 2023-10-05T21:16:12.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.753+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1094713987 >> v1:172.21.15.111:6789/0 conn(0x5616571869d0 legacy=0x561657188db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:12.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.753+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1094713987 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56165718b4e0 con 0x5616570f5930 2023-10-05T21:16:12.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.753+0000 7ffa3fb35700 1 --2- 172.21.15.153:0/1094713987 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616570f5930 0x561657186490 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ffa3400a650 tx=0x7ffa34005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267ef18296484202 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:12.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.753+0000 7ffa3eb33700 1 -- 172.21.15.153:0/1094713987 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffa340086a0 con 0x5616570f5930 2023-10-05T21:16:12.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.753+0000 7ffa3eb33700 1 -- 172.21.15.153:0/1094713987 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa34008800 con 0x5616570f5930 2023-10-05T21:16:12.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.753+0000 7ffa3eb33700 1 -- 172.21.15.153:0/1094713987 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffa34008ab0 con 0x5616570f5930 2023-10-05T21:16:12.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.754+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1094713987 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616570f5930 msgr2=0x561657186490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:12.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.754+0000 7ffa4ca5d680 1 --2- 172.21.15.153:0/1094713987 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616570f5930 0x561657186490 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ffa3400a650 tx=0x7ffa34005b10 comp rx=0 tx=0).stop 2023-10-05T21:16:12.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.754+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1094713987 shutdown_connections 2023-10-05T21:16:12.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.754+0000 7ffa4ca5d680 1 --2- 172.21.15.153:0/1094713987 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616570f5930 0x561657186490 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:12.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.754+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1094713987 >> 172.21.15.153:0/1094713987 conn(0x56165717bb80 msgr2=0x56165717df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:12.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.754+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1094713987 shutdown_connections 2023-10-05T21:16:12.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.754+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1094713987 wait complete. 2023-10-05T21:16:12.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.754+0000 7ffa4ca5d680 1 Processor -- start 2023-10-05T21:16:12.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.754+0000 7ffa4ca5d680 1 -- start start 2023-10-05T21:16:12.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.755+0000 7ffa4ca5d680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616570f5930 0x5616571a2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:12.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.755+0000 7ffa4ca5d680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x56165702eea0 con 0x5616570f5930 2023-10-05T21:16:12.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.755+0000 7ffa3fb35700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616570f5930 0x5616571a2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:12.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.755+0000 7ffa3fb35700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616570f5930 0x5616571a2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54684/0 (socket says 172.21.15.153:54684) 2023-10-05T21:16:12.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.755+0000 7ffa3fb35700 1 -- 172.21.15.153:0/221060026 learned_addr learned my addr 172.21.15.153:0/221060026 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:12.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.755+0000 7ffa3fb35700 1 -- 172.21.15.153:0/221060026 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa34005db0 con 0x5616570f5930 2023-10-05T21:16:12.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.755+0000 7ffa3fb35700 1 --2- 172.21.15.153:0/221060026 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616570f5930 0x5616571a2900 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ffa34005810 tx=0x7ffa34015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597e506581b522 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:12.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.755+0000 7ffa3db31700 1 -- 172.21.15.153:0/221060026 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffa340054b0 con 0x5616570f5930 2023-10-05T21:16:12.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.756+0000 7ffa3db31700 1 -- 172.21.15.153:0/221060026 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa34008970 con 0x5616570f5930 2023-10-05T21:16:12.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.756+0000 7ffa3db31700 1 -- 172.21.15.153:0/221060026 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffa34008ae0 con 0x5616570f5930 2023-10-05T21:16:12.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.756+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/221060026 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616570f5930 msgr2=0x5616571a2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:12.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.756+0000 7ffa4ca5d680 1 --2- 172.21.15.153:0/221060026 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616570f5930 0x5616571a2900 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ffa34005810 tx=0x7ffa34015000 comp rx=0 tx=0).stop 2023-10-05T21:16:12.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.756+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/221060026 shutdown_connections 2023-10-05T21:16:12.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.756+0000 7ffa4ca5d680 1 --2- 172.21.15.153:0/221060026 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616570f5930 0x5616571a2900 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:12.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.756+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/221060026 >> 172.21.15.153:0/221060026 conn(0x56165717bb80 msgr2=0x56165719e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:12.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.756+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/221060026 shutdown_connections 2023-10-05T21:16:12.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.756+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/221060026 wait complete. 2023-10-05T21:16:12.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.756+0000 7ffa4ca5d680 1 Processor -- start 2023-10-05T21:16:12.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.756+0000 7ffa4ca5d680 1 -- start start 2023-10-05T21:16:12.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.757+0000 7ffa4ca5d680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616570f5930 0x5616571a9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:12.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.757+0000 7ffa4ca5d680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x561657025c80 con 0x5616570f5930 2023-10-05T21:16:12.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.757+0000 7ffa3fb35700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616570f5930 0x5616571a9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:12.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.757+0000 7ffa3fb35700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616570f5930 0x5616571a9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54694/0 (socket says 172.21.15.153:54694) 2023-10-05T21:16:12.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.757+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 learned_addr learned my addr 172.21.15.153:0/1366960300 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:12.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.757+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56165718b4e0 con 0x5616570f5930 2023-10-05T21:16:12.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.757+0000 7ffa3fb35700 1 --2- 172.21.15.153:0/1366960300 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616570f5930 0x5616571a9c00 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ffa3400a650 tx=0x7ffa3401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:12.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.757+0000 7ffa27fff700 1 -- 172.21.15.153:0/1366960300 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffa34012b00 con 0x5616570f5930 2023-10-05T21:16:12.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.758+0000 7ffa27fff700 1 -- 172.21.15.153:0/1366960300 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa34012c60 con 0x5616570f5930 2023-10-05T21:16:12.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.758+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5616571aa140 con 0x5616570f5930 2023-10-05T21:16:12.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.758+0000 7ffa27fff700 1 -- 172.21.15.153:0/1366960300 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffa3402d440 con 0x5616570f5930 2023-10-05T21:16:12.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.758+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5616571aa590 con 0x5616570f5930 2023-10-05T21:16:12.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.758+0000 7ffa27fff700 1 -- 172.21.15.153:0/1366960300 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7ffa34009430 con 0x5616570f5930 2023-10-05T21:16:12.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.759+0000 7ffa4ca5d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.759+0000 7ffa27fff700 1 --2- 172.21.15.153:0/1366960300 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ffa2c034140 0x7ffa2c0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:12.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.759+0000 7ffa27fff700 1 -- 172.21.15.153:0/1366960300 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7ffa3404a1e0 con 0x5616570f5930 2023-10-05T21:16:12.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.759+0000 7ffa3f334700 1 --2- 172.21.15.153:0/1366960300 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ffa2c034140 0x7ffa2c0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:12.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.759+0000 7ffa4ca5d680 1 --2- 172.21.15.153:0/1366960300 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5616571869d0 0x5616571b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:12.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.759+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571b6150 con 0x5616571869d0 2023-10-05T21:16:12.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.759+0000 7ffa40336700 1 --2- 172.21.15.153:0/1366960300 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5616571869d0 0x5616571b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:12.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.759+0000 7ffa3f334700 1 --2- 172.21.15.153:0/1366960300 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ffa2c034140 0x7ffa2c0365f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ffa3000b300 tx=0x7ffa300014b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:12.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.760+0000 7ffa40336700 1 --2- 172.21.15.153:0/1366960300 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5616571869d0 0x5616571b59c0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:12.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.760+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.760+0000 7ffa4ca5d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:12.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.760+0000 7ffa4ca5d680 20 realm 2023-10-05T21:16:12.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.760+0000 7ffa4ca5d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.760+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571b2f80 con 0x5616571869d0 2023-10-05T21:16:12.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.760+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.760+0000 7ffa4ca5d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:12.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.760+0000 7ffa4ca5d680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:16:12.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.760+0000 7ffa4ca5d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.760+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571b6c50 con 0x5616571869d0 2023-10-05T21:16:12.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.760+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.760+0000 7ffa4ca5d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:12.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.760+0000 7ffa4ca5d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.760+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571b7570 con 0x5616571869d0 2023-10-05T21:16:12.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.761+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.761+0000 7ffa4ca5d680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:12.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.761+0000 7ffa4ca5d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.761+0000 7ffa4ca5d680 1 --2- 172.21.15.153:0/1366960300 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5616571b7e30 0x5616571ba210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:12.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.761+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571ba7e0 con 0x5616571b7e30 2023-10-05T21:16:12.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.761+0000 7ffa3fb35700 1 --2- 172.21.15.153:0/1366960300 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5616571b7e30 0x5616571ba210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:12.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.761+0000 7ffa3fb35700 1 --2- 172.21.15.153:0/1366960300 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5616571b7e30 0x5616571ba210 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:12.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.761+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.761+0000 7ffa4ca5d680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:16:12.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.761+0000 7ffa4ca5d680 20 searching for the correct realm 2023-10-05T21:16:12.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.761+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bc100 con 0x5616571b7e30 2023-10-05T21:16:12.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.762+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.762+0000 7ffa3fb35700 1 --2- 172.21.15.153:0/1366960300 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ffa3402d070 0x7ffa340365d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:12.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.762+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bc100 con 0x7ffa3402d070 2023-10-05T21:16:12.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.762+0000 7ffa3f334700 1 --2- 172.21.15.153:0/1366960300 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ffa3402d070 0x7ffa340365d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:12.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.762+0000 7ffa3f334700 1 --2- 172.21.15.153:0/1366960300 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ffa3402d070 0x7ffa340365d0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:12.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.762+0000 7ffa3f334700 1 -- 172.21.15.153:0/1366960300 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3000f560 con 0x7ffa3402d070 2023-10-05T21:16:12.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.763+0000 7ffa3f334700 1 --2- 172.21.15.153:0/1366960300 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ffa3000e8c0 0x7ffa3000d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:12.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.763+0000 7ffa3f334700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bc100 con 0x7ffa3000e8c0 2023-10-05T21:16:12.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.763+0000 7ffa40336700 1 --2- 172.21.15.153:0/1366960300 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ffa3000e8c0 0x7ffa3000d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:12.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.763+0000 7ffa40336700 1 --2- 172.21.15.153:0/1366960300 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ffa3000e8c0 0x7ffa3000d310 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:12.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.764+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.764+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bc100 con 0x5616571869d0 2023-10-05T21:16:12.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.764+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.764+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bc100 con 0x5616571869d0 2023-10-05T21:16:12.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.764+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.764+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bc100 con 0x7ffa3000e8c0 2023-10-05T21:16:12.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.764+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.764+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bc100 con 0x7ffa3000e8c0 2023-10-05T21:16:12.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.765+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.765+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bc100 con 0x7ffa3402d070 2023-10-05T21:16:12.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.765+0000 7ffa3f334700 1 -- 172.21.15.153:0/1366960300 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3000f560 con 0x7ffa3402d070 2023-10-05T21:16:12.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.765+0000 7ffa3f334700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bc100 con 0x5616571b7e30 2023-10-05T21:16:12.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.765+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.765+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bc100 con 0x5616571869d0 2023-10-05T21:16:12.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.765+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.765+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bc100 con 0x7ffa3000e8c0 2023-10-05T21:16:12.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.766+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.766+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bc100 con 0x5616571869d0 2023-10-05T21:16:12.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.766+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.766+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bc100 con 0x7ffa3402d070 2023-10-05T21:16:12.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.766+0000 7ffa3f334700 1 -- 172.21.15.153:0/1366960300 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3000f560 con 0x7ffa3402d070 2023-10-05T21:16:12.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.766+0000 7ffa3f334700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffa3001f040 con 0x5616571b7e30 2023-10-05T21:16:12.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.767+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.767+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffa3001f040 con 0x5616571b7e30 2023-10-05T21:16:12.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.767+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.767+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffa3001f040 con 0x7ffa3000e8c0 2023-10-05T21:16:12.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.767+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.767+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffa3001f040 con 0x5616571b7e30 2023-10-05T21:16:12.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.767+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.767+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffa3001f040 con 0x5616571b7e30 2023-10-05T21:16:12.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.768+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.768+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffa3001f040 con 0x5616571869d0 2023-10-05T21:16:12.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.768+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.768+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffa3001f040 con 0x5616571869d0 2023-10-05T21:16:12.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.768+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.768+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffa3001f040 con 0x7ffa3000e8c0 2023-10-05T21:16:12.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.769+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.769+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffa3001f040 con 0x5616571b7e30 2023-10-05T21:16:12.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.769+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.769+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffa3001f040 con 0x7ffa3402d070 2023-10-05T21:16:12.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.769+0000 7ffa3f334700 1 -- 172.21.15.153:0/1366960300 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3000f560 con 0x7ffa3402d070 2023-10-05T21:16:12.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.769+0000 7ffa3f334700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffa3001f040 con 0x5616571869d0 2023-10-05T21:16:12.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.769+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.769+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffa3001f040 con 0x7ffa3000e8c0 2023-10-05T21:16:12.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.770+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.770+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffa3001f040 con 0x5616571b7e30 2023-10-05T21:16:12.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.770+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.770+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffa3001f040 con 0x7ffa3000e8c0 2023-10-05T21:16:12.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.770+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.770+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffa3001f040 con 0x7ffa3402d070 2023-10-05T21:16:12.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.771+0000 7ffa3f334700 1 -- 172.21.15.153:0/1366960300 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3000f560 con 0x7ffa3402d070 2023-10-05T21:16:12.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.771+0000 7ffa3f334700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffa3001f040 con 0x5616571b7e30 2023-10-05T21:16:12.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.771+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.771+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffa3001f040 con 0x7ffa3000e8c0 2023-10-05T21:16:12.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.771+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.771+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffa3001f040 con 0x5616571869d0 2023-10-05T21:16:12.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.772+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.772+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffa3001f040 con 0x7ffa3402d070 2023-10-05T21:16:12.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.772+0000 7ffa3f334700 1 -- 172.21.15.153:0/1366960300 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3000f560 con 0x7ffa3402d070 2023-10-05T21:16:12.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.772+0000 7ffa4ca5d680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:16:12.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.772+0000 7ffa4ca5d680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:16:12.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.772+0000 7ffa4ca5d680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:16:12.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.772+0000 7ffa4ca5d680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:16:12.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.772+0000 7ffa4ca5d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.772+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bb320 con 0x5616571869d0 2023-10-05T21:16:12.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.772+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.772+0000 7ffa4ca5d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:12.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.772+0000 7ffa4ca5d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.772+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bb7b0 con 0x5616571869d0 2023-10-05T21:16:12.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.772+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.772+0000 7ffa4ca5d680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:12.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.772+0000 7ffa4ca5d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.772+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bbbe0 con 0x5616571869d0 2023-10-05T21:16:12.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.773+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.773+0000 7ffa4ca5d680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:16:12.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.773+0000 7ffa4ca5d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.773+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bc9a0 con 0x5616571b7e30 2023-10-05T21:16:12.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.773+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.773+0000 7ffa4ca5d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:12.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.773+0000 7ffa4ca5d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.773+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bcd50 con 0x5616571869d0 2023-10-05T21:16:12.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.773+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.773+0000 7ffa4ca5d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:12.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.773+0000 7ffa4ca5d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.773+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bcd50 con 0x5616571869d0 2023-10-05T21:16:12.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.773+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.773+0000 7ffa4ca5d680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:12.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.774+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bdd60 con 0x5616571b7e30 2023-10-05T21:16:12.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.774+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.774+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bdd60 con 0x7ffa3402d070 2023-10-05T21:16:12.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.774+0000 7ffa3f334700 1 -- 172.21.15.153:0/1366960300 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3000f560 con 0x7ffa3402d070 2023-10-05T21:16:12.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.774+0000 7ffa3f334700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bdd60 con 0x7ffa3000e8c0 2023-10-05T21:16:12.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.774+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.774+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bbbe0 con 0x5616571869d0 2023-10-05T21:16:12.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.775+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.775+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bbbe0 con 0x5616571869d0 2023-10-05T21:16:12.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.775+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.775+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bbbe0 con 0x7ffa3000e8c0 2023-10-05T21:16:12.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.775+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.775+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bbbe0 con 0x7ffa3000e8c0 2023-10-05T21:16:12.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.775+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.775+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bbbe0 con 0x7ffa3402d070 2023-10-05T21:16:12.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.776+0000 7ffa3f334700 1 -- 172.21.15.153:0/1366960300 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3000f560 con 0x7ffa3402d070 2023-10-05T21:16:12.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.776+0000 7ffa3f334700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bbbe0 con 0x5616571b7e30 2023-10-05T21:16:12.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.776+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.776+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bbbe0 con 0x5616571869d0 2023-10-05T21:16:12.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.776+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.776+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bbbe0 con 0x7ffa3000e8c0 2023-10-05T21:16:12.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.776+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.776+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bbbe0 con 0x5616571869d0 2023-10-05T21:16:12.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.777+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.777+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bbbe0 con 0x7ffa3402d070 2023-10-05T21:16:12.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.777+0000 7ffa3f334700 1 -- 172.21.15.153:0/1366960300 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3000f560 con 0x7ffa3402d070 2023-10-05T21:16:12.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.777+0000 7ffa3f334700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bbbe0 con 0x5616571b7e30 2023-10-05T21:16:12.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.777+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.777+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bbbe0 con 0x5616571b7e30 2023-10-05T21:16:12.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.777+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.777+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bbbe0 con 0x7ffa3000e8c0 2023-10-05T21:16:12.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.778+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.778+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bbbe0 con 0x5616571b7e30 2023-10-05T21:16:12.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.778+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.778+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bbbe0 con 0x5616571b7e30 2023-10-05T21:16:12.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.778+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.778+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bbbe0 con 0x5616571869d0 2023-10-05T21:16:12.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.778+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.778+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bbbe0 con 0x5616571869d0 2023-10-05T21:16:12.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.779+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.779+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bbbe0 con 0x7ffa3000e8c0 2023-10-05T21:16:12.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.779+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.779+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bbbe0 con 0x5616571b7e30 2023-10-05T21:16:12.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.779+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.779+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bbbe0 con 0x7ffa3402d070 2023-10-05T21:16:12.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.779+0000 7ffa3f334700 1 -- 172.21.15.153:0/1366960300 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3000f560 con 0x7ffa3402d070 2023-10-05T21:16:12.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.780+0000 7ffa3f334700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bbbe0 con 0x5616571869d0 2023-10-05T21:16:12.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.780+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.780+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bbbe0 con 0x7ffa3000e8c0 2023-10-05T21:16:12.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.780+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.780+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bbbe0 con 0x5616571b7e30 2023-10-05T21:16:12.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.780+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.780+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bbbe0 con 0x7ffa3000e8c0 2023-10-05T21:16:12.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.781+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.781+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bbbe0 con 0x7ffa3402d070 2023-10-05T21:16:12.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.781+0000 7ffa3f334700 1 -- 172.21.15.153:0/1366960300 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3000f560 con 0x7ffa3402d070 2023-10-05T21:16:12.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.781+0000 7ffa3f334700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bbbe0 con 0x5616571b7e30 2023-10-05T21:16:12.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.781+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.781+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bbbe0 con 0x7ffa3000e8c0 2023-10-05T21:16:12.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.781+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.781+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bbbe0 con 0x5616571869d0 2023-10-05T21:16:12.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.782+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.782+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bbbe0 con 0x7ffa3402d070 2023-10-05T21:16:12.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.782+0000 7ffa3f334700 1 -- 172.21.15.153:0/1366960300 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa3000f560 con 0x7ffa3402d070 2023-10-05T21:16:12.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.782+0000 7ffa4ca5d680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:16:12.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.782+0000 7ffa4ca5d680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:16:12.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.782+0000 7ffa4ca5d680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:16:12.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.782+0000 7ffa4ca5d680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:16:12.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.782+0000 7ffa4ca5d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.782+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bcd50 con 0x5616571869d0 2023-10-05T21:16:12.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.782+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.782+0000 7ffa4ca5d680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:12.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.782+0000 7ffa4ca5d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.782+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bd100 con 0x5616571b7e30 2023-10-05T21:16:12.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.782+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.783+0000 7ffa4ca5d680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:16:12.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.783+0000 7ffa4ca5d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.783+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bd9a0 con 0x5616571869d0 2023-10-05T21:16:12.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.783+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.783+0000 7ffa4ca5d680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:12.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.783+0000 7ffa4ca5d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.783+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bd9a0 con 0x5616571869d0 2023-10-05T21:16:12.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.783+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.783+0000 7ffa4ca5d680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:16:12.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.783+0000 7ffa4ca5d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.783+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bd9a0 con 0x7ffa3000e8c0 2023-10-05T21:16:12.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.784+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.784+0000 7ffa4ca5d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:12.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.784+0000 7ffa4ca5d680 20 zone default found 2023-10-05T21:16:12.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.784+0000 7ffa4ca5d680 4 Realm: () 2023-10-05T21:16:12.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.784+0000 7ffa4ca5d680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:16:12.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.784+0000 7ffa4ca5d680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:16:12.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.784+0000 7ffa4ca5d680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:16:12.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.784+0000 7ffa4ca5d680 20 zonegroup default 2023-10-05T21:16:12.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.784+0000 7ffa4ca5d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.784+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bd9a0 con 0x7ffa3000e8c0 2023-10-05T21:16:12.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.784+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.784+0000 7ffa4ca5d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:12.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.784+0000 7ffa4ca5d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.784+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bf320 con 0x5616571b7e30 2023-10-05T21:16:12.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.784+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.784+0000 7ffa4ca5d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:12.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.784+0000 7ffa4ca5d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.784+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bf6d0 con 0x5616571b7e30 2023-10-05T21:16:12.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.784+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.784+0000 7ffa4ca5d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:12.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.784+0000 7ffa4ca5d680 20 started sync module instance, tier type = 2023-10-05T21:16:12.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.784+0000 7ffa4ca5d680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:16:12.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.784+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571be9e0 con 0x7ffa3402d070 2023-10-05T21:16:12.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.785+0000 7ffa3f334700 1 -- 172.21.15.153:0/1366960300 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v31'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3000f560 con 0x7ffa3402d070 2023-10-05T21:16:12.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.785+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94653950717328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bff70 con 0x7ffa3402d070 2023-10-05T21:16:12.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.785+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571c0810 con 0x5616571869d0 2023-10-05T21:16:12.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.786+0000 7ffa3f334700 1 -- 172.21.15.153:0/1366960300 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94653950717328] v31'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3000f560 con 0x7ffa3402d070 2023-10-05T21:16:12.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.786+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v31'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.787+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94653950720640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571c0850 con 0x5616571869d0 2023-10-05T21:16:12.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.787+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571c1430 con 0x5616571b7e30 2023-10-05T21:16:12.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.787+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94653950720640] v31'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.787+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v31'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.787+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94653950725856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571c17e0 con 0x5616571b7e30 2023-10-05T21:16:12.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.788+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571c21f0 con 0x7ffa3402d070 2023-10-05T21:16:12.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.788+0000 7ffa3f334700 1 -- 172.21.15.153:0/1366960300 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v31'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3000f560 con 0x7ffa3402d070 2023-10-05T21:16:12.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.788+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94653950729472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571c2a90 con 0x7ffa3402d070 2023-10-05T21:16:12.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.788+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94653950725856] v31'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.788+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571c34a0 con 0x5616571869d0 2023-10-05T21:16:12.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.789+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v31'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.789+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94653950734256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571c38f0 con 0x5616571869d0 2023-10-05T21:16:12.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.789+0000 7ffa3f334700 1 -- 172.21.15.153:0/1366960300 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94653950729472] v31'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3000f560 con 0x7ffa3402d070 2023-10-05T21:16:12.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.789+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571c25a0 con 0x7ffa3000e8c0 2023-10-05T21:16:12.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.790+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94653950734256] v31'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.790+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v31'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.790+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94653950735360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571c3850 con 0x7ffa3000e8c0 2023-10-05T21:16:12.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.790+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571c47f0 con 0x7ffa3000e8c0 2023-10-05T21:16:12.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.791+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94653950735360] v31'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.791+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v31'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.791+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94653950737936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571c4750 con 0x7ffa3000e8c0 2023-10-05T21:16:12.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.791+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571c5210 con 0x7ffa3000e8c0 2023-10-05T21:16:12.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.792+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94653950737936] v31'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.792+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v31'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.792+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94653950741664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571c4750 con 0x7ffa3000e8c0 2023-10-05T21:16:12.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.792+0000 7ffa4ca5d680 20 add_watcher() i=0 2023-10-05T21:16:12.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.792+0000 7ffa4ca5d680 20 add_watcher() i=1 2023-10-05T21:16:12.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.792+0000 7ffa4ca5d680 20 add_watcher() i=2 2023-10-05T21:16:12.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.792+0000 7ffa4ca5d680 20 add_watcher() i=3 2023-10-05T21:16:12.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.792+0000 7ffa4ca5d680 20 add_watcher() i=4 2023-10-05T21:16:12.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.792+0000 7ffa4ca5d680 20 add_watcher() i=5 2023-10-05T21:16:12.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.792+0000 7ffa4ca5d680 20 add_watcher() i=6 2023-10-05T21:16:12.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.793+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94653950741664] v31'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.793+0000 7ffa4ca5d680 20 add_watcher() i=7 2023-10-05T21:16:12.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.793+0000 7ffa4ca5d680 2 all 8 watchers are set, enabling cache 2023-10-05T21:16:12.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.793+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571c8640 con 0x5616571869d0 2023-10-05T21:16:12.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.793+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.793+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94653950739456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571c5ab0 con 0x5616571869d0 2023-10-05T21:16:12.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.794+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94653950739456] v31'217 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.794+0000 7ffa117e2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:16:12.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.794+0000 7ffa4ca5d680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:16:12.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.794+0000 7ffa4ca5d680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:16:12.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.794+0000 7ffa4ca5d680 1 Processor -- start 2023-10-05T21:16:12.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.795+0000 7ffa4ca5d680 1 -- start start 2023-10-05T21:16:12.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.795+0000 7ffa4ca5d680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616571d2fc0 0x5616571d33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:12.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.795+0000 7ffa4ca5d680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616571d39a0 con 0x5616571d2fc0 2023-10-05T21:16:12.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.795+0000 7ffa3f334700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616571d2fc0 0x5616571d33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:12.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.795+0000 7ffa3f334700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616571d2fc0 0x5616571d33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54706/0 (socket says 172.21.15.153:54706) 2023-10-05T21:16:12.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.795+0000 7ffa3f334700 1 -- 172.21.15.153:0/4054889213 learned_addr learned my addr 172.21.15.153:0/4054889213 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:12.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.795+0000 7ffa3f334700 1 -- 172.21.15.153:0/4054889213 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616571d3ae0 con 0x5616571d2fc0 2023-10-05T21:16:12.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.795+0000 7ffa3f334700 1 --2- 172.21.15.153:0/4054889213 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616571d2fc0 0x5616571d33d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x5616571b2f10 tx=0x7ffa30006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fbf0e72f1a175a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:12.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.796+0000 7ffa10fe1700 1 -- 172.21.15.153:0/4054889213 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffa3000db40 con 0x5616571d2fc0 2023-10-05T21:16:12.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.796+0000 7ffa10fe1700 1 -- 172.21.15.153:0/4054889213 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3000dca0 con 0x5616571d2fc0 2023-10-05T21:16:12.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.796+0000 7ffa10fe1700 1 -- 172.21.15.153:0/4054889213 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffa3000de30 con 0x5616571d2fc0 2023-10-05T21:16:12.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.796+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/4054889213 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616571d2fc0 msgr2=0x5616571d33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:12.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.796+0000 7ffa4ca5d680 1 --2- 172.21.15.153:0/4054889213 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616571d2fc0 0x5616571d33d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x5616571b2f10 tx=0x7ffa30006000 comp rx=0 tx=0).stop 2023-10-05T21:16:12.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.796+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/4054889213 shutdown_connections 2023-10-05T21:16:12.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.796+0000 7ffa4ca5d680 1 --2- 172.21.15.153:0/4054889213 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616571d2fc0 0x5616571d33d0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:12.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.796+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/4054889213 >> 172.21.15.153:0/4054889213 conn(0x5616571ce1c0 msgr2=0x5616571cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:12.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.797+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/4054889213 shutdown_connections 2023-10-05T21:16:12.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.797+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/4054889213 wait complete. 2023-10-05T21:16:12.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.797+0000 7ffa4ca5d680 1 Processor -- start 2023-10-05T21:16:12.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.797+0000 7ffa4ca5d680 1 -- start start 2023-10-05T21:16:12.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.797+0000 7ffa4ca5d680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616571d2fc0 0x5616571d8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:12.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.797+0000 7ffa4ca5d680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616571d9020 con 0x5616571d2fc0 2023-10-05T21:16:12.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.797+0000 7ffa3f334700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616571d2fc0 0x5616571d8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:12.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.797+0000 7ffa3f334700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616571d2fc0 0x5616571d8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54720/0 (socket says 172.21.15.153:54720) 2023-10-05T21:16:12.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.797+0000 7ffa3f334700 1 -- 172.21.15.153:0/66371102 learned_addr learned my addr 172.21.15.153:0/66371102 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:12.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.798+0000 7ffa3f334700 1 -- 172.21.15.153:0/66371102 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa30006070 con 0x5616571d2fc0 2023-10-05T21:16:12.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.798+0000 7ffa3f334700 1 --2- 172.21.15.153:0/66371102 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616571d2fc0 0x5616571d8ae0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ffa3000efd0 tx=0x7ffa30031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:12.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.798+0000 7ff98affd700 1 -- 172.21.15.153:0/66371102 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffa3000de10 con 0x5616571d2fc0 2023-10-05T21:16:12.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.798+0000 7ff98affd700 1 -- 172.21.15.153:0/66371102 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3003dd00 con 0x5616571d2fc0 2023-10-05T21:16:12.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.798+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/66371102 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5616571d9220 con 0x5616571d2fc0 2023-10-05T21:16:12.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.798+0000 7ff98affd700 1 -- 172.21.15.153:0/66371102 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffa3003deb0 con 0x5616571d2fc0 2023-10-05T21:16:12.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.798+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/66371102 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5616571d9670 con 0x5616571d2fc0 2023-10-05T21:16:12.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.799+0000 7ff98affd700 1 -- 172.21.15.153:0/66371102 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7ffa3001a040 con 0x5616571d2fc0 2023-10-05T21:16:12.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.799+0000 7ff98affd700 1 --2- 172.21.15.153:0/66371102 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff9800340f0 0x7ff9800365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:12.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.799+0000 7ff98affd700 1 -- 172.21.15.153:0/66371102 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7ffa30048c30 con 0x5616571d2fc0 2023-10-05T21:16:12.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.799+0000 7ffa4ca5d680 5 note: GC not initialized 2023-10-05T21:16:12.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.799+0000 7ffa40336700 1 --2- 172.21.15.153:0/66371102 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff9800340f0 0x7ff9800365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:12.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.800+0000 7ffa40336700 1 --2- 172.21.15.153:0/66371102 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff9800340f0 0x7ff9800365a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x5616571c4970 tx=0x7ffa38036760 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:12.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.800+0000 7ff97ffff700 20 reqs_thread_entry: start 2023-10-05T21:16:12.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.800+0000 7ff97dffb700 20 reqs_thread_entry: start 2023-10-05T21:16:12.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.800+0000 7ffa4ca5d680 20 init_complete bucket index max shards: 11 2023-10-05T21:16:12.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.801+0000 7ffa4ca5d680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:16:12.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.801+0000 7ff96bfff700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:16:43 2023 2023-10-05T21:16:12.830 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:16:12.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.801+0000 7ff96b7fe700 20 reqs_thread_entry: start 2023-10-05T21:16:12.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.801+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723ede0 con 0x5616571869d0 2023-10-05T21:16:12.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.801+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.801+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:103 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723ede0 con 0x7ffa3402d070 2023-10-05T21:16:12.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.801+0000 7ffa3f334700 1 -- 172.21.15.153:0/1366960300 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(103 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7ffa3000f560 con 0x7ffa3402d070 2023-10-05T21:16:12.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.801+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:104 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723ede0 con 0x5616571869d0 2023-10-05T21:16:12.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.802+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(104 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.802+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:105 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723ede0 con 0x5616571b7e30 2023-10-05T21:16:12.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.802+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(105 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.802+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:106 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723ede0 con 0x5616571b7e30 2023-10-05T21:16:12.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.802+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(106 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.802+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723ede0 con 0x5616571b7e30 2023-10-05T21:16:12.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.802+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(107 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.802+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:108 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723ede0 con 0x5616571869d0 2023-10-05T21:16:12.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.803+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(108 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.803+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:109 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723ede0 con 0x5616571869d0 2023-10-05T21:16:12.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.803+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(109 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.803+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:110 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723ede0 con 0x5616571b7e30 2023-10-05T21:16:12.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.803+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== osd_op_reply(110 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.803+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:111 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723ede0 con 0x5616571b7e30 2023-10-05T21:16:12.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.803+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(111 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.803+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723ede0 con 0x7ffa3000e8c0 2023-10-05T21:16:12.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.804+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(112 usage.10 [call out=1268b] v0'0 uv32 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.804+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:113 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723ce30 con 0x5616571869d0 2023-10-05T21:16:12.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.804+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(113 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.804+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:114 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723c940 con 0x7ffa3402d070 2023-10-05T21:16:12.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.804+0000 7ffa3f334700 1 -- 172.21.15.153:0/1366960300 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(114 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3000f560 con 0x7ffa3402d070 2023-10-05T21:16:12.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.805+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:115 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723c940 con 0x5616571b7e30 2023-10-05T21:16:12.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.805+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 31 ==== osd_op_reply(115 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.805+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:116 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723c940 con 0x7ffa3000e8c0 2023-10-05T21:16:12.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.805+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(116 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.805+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:117 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723c940 con 0x7ffa3000e8c0 2023-10-05T21:16:12.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.805+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(117 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.805+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:118 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723c940 con 0x5616571b7e30 2023-10-05T21:16:12.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.806+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 32 ==== osd_op_reply(118 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.806+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:119 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723c940 con 0x7ffa3000e8c0 2023-10-05T21:16:12.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.806+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(119 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) v8 ==== 152+0+163 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.806+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:120 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723c940 con 0x5616571869d0 2023-10-05T21:16:12.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.806+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(120 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.806+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:121 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723c940 con 0x5616571b7e30 2023-10-05T21:16:12.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.807+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 33 ==== osd_op_reply(121 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.807+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:122 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723c940 con 0x7ffa3000e8c0 2023-10-05T21:16:12.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.807+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 31 ==== osd_op_reply(122 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.807+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:123 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723c940 con 0x7ffa3402d070 2023-10-05T21:16:12.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.807+0000 7ffa3f334700 1 -- 172.21.15.153:0/1366960300 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(123 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3000f560 con 0x7ffa3402d070 2023-10-05T21:16:12.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.807+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:124 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723c940 con 0x7ffa3000e8c0 2023-10-05T21:16:12.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.808+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 32 ==== osd_op_reply(124 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.808+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:125 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723c940 con 0x5616571869d0 2023-10-05T21:16:12.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.808+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== osd_op_reply(125 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.808+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:126 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723c940 con 0x5616571869d0 2023-10-05T21:16:12.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.808+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 42 ==== osd_op_reply(126 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.808+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:127 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723c940 con 0x5616571b7e30 2023-10-05T21:16:12.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.808+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 34 ==== osd_op_reply(127 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.808+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:128 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723c940 con 0x5616571869d0 2023-10-05T21:16:12.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.809+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 43 ==== osd_op_reply(128 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.809+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:129 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723c940 con 0x5616571869d0 2023-10-05T21:16:12.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.809+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 44 ==== osd_op_reply(129 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.809+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:130 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723c940 con 0x5616571b7e30 2023-10-05T21:16:12.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.809+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 35 ==== osd_op_reply(130 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.809+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:131 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723c940 con 0x5616571b7e30 2023-10-05T21:16:12.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.809+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 36 ==== osd_op_reply(131 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.809+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:132 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723c940 con 0x5616571b7e30 2023-10-05T21:16:12.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.809+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 37 ==== osd_op_reply(132 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.809+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:133 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723c940 con 0x7ffa3000e8c0 2023-10-05T21:16:12.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.810+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 33 ==== osd_op_reply(133 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.810+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:134 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94653950717328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56165723cd10 con 0x7ffa3402d070 2023-10-05T21:16:12.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.811+0000 7ffa3f334700 1 -- 172.21.15.153:0/1366960300 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(134 notify.0 [watch unwatch cookie 94653950717328] v31'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3000f560 con 0x7ffa3402d070 2023-10-05T21:16:12.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.811+0000 7ffa4ca5d680 20 remove_watcher() i=0 2023-10-05T21:16:12.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.811+0000 7ffa4ca5d680 2 removed watcher, disabling cache 2023-10-05T21:16:12.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.811+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:135 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94653950720640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bed90 con 0x5616571869d0 2023-10-05T21:16:12.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.812+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 45 ==== osd_op_reply(135 notify.1 [watch unwatch cookie 94653950720640] v31'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.812+0000 7ffa4ca5d680 20 remove_watcher() i=1 2023-10-05T21:16:12.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.812+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:136 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94653950725856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bed90 con 0x5616571b7e30 2023-10-05T21:16:12.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.813+0000 7ffa3fb35700 1 -- 172.21.15.153:0/1366960300 <== osd.3 v2:172.21.15.153:6800/140455 38 ==== osd_op_reply(136 notify.2 [watch unwatch cookie 94653950725856] v31'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa34019040 con 0x5616571b7e30 2023-10-05T21:16:12.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.813+0000 7ffa4ca5d680 20 remove_watcher() i=2 2023-10-05T21:16:12.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.813+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94653950729472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bed90 con 0x7ffa3402d070 2023-10-05T21:16:12.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.813+0000 7ffa3f334700 1 -- 172.21.15.153:0/1366960300 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== osd_op_reply(137 notify.3 [watch unwatch cookie 94653950729472] v31'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3000f560 con 0x7ffa3402d070 2023-10-05T21:16:12.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.813+0000 7ffa4ca5d680 20 remove_watcher() i=3 2023-10-05T21:16:12.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.813+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:138 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94653950734256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bed90 con 0x5616571869d0 2023-10-05T21:16:12.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.814+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 46 ==== osd_op_reply(138 notify.4 [watch unwatch cookie 94653950734256] v31'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.814+0000 7ffa4ca5d680 20 remove_watcher() i=4 2023-10-05T21:16:12.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.814+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:139 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94653950735360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571c2fb0 con 0x7ffa3000e8c0 2023-10-05T21:16:12.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.815+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 34 ==== osd_op_reply(139 notify.5 [watch unwatch cookie 94653950735360] v31'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.815+0000 7ffa4ca5d680 20 remove_watcher() i=5 2023-10-05T21:16:12.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.815+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:140 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94653950737936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571bed90 con 0x7ffa3000e8c0 2023-10-05T21:16:12.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.816+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 35 ==== osd_op_reply(140 notify.6 [watch unwatch cookie 94653950737936] v31'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.816+0000 7ffa4ca5d680 20 remove_watcher() i=6 2023-10-05T21:16:12.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.816+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:141 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94653950741664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571c3e10 con 0x7ffa3000e8c0 2023-10-05T21:16:12.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.817+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.0 v2:172.21.15.111:6800/111394 36 ==== osd_op_reply(141 notify.7 [watch unwatch cookie 94653950741664] v31'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x7ffa3000e8c0 2023-10-05T21:16:12.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.817+0000 7ffa4ca5d680 20 remove_watcher() i=7 2023-10-05T21:16:12.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.818+0000 7ffa117e2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:16:12.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.818+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:142 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94653950739456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5616571c4ca0 con 0x5616571869d0 2023-10-05T21:16:12.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.818+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 <== osd.1 v2:172.21.15.153:6816/140456 47 ==== osd_op_reply(142 data_loggenerations_metadata [watch unwatch cookie 94653950739456] v31'218 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ffa3800a570 con 0x5616571869d0 2023-10-05T21:16:12.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.818+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ffa3000e8c0 msgr2=0x7ffa3000d310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:12.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.818+0000 7ffa4ca5d680 1 --2- 172.21.15.153:0/1366960300 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ffa3000e8c0 0x7ffa3000d310 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:12.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.818+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5616571869d0 msgr2=0x5616571b59c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:12.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.818+0000 7ffa4ca5d680 1 --2- 172.21.15.153:0/1366960300 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5616571869d0 0x5616571b59c0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:12.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.818+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ffa3402d070 msgr2=0x7ffa340365d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:12.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.818+0000 7ffa4ca5d680 1 --2- 172.21.15.153:0/1366960300 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ffa3402d070 0x7ffa340365d0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:12.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.818+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5616571b7e30 msgr2=0x5616571ba210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:12.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.818+0000 7ffa4ca5d680 1 --2- 172.21.15.153:0/1366960300 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5616571b7e30 0x5616571ba210 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:12.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.819+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ffa2c034140 msgr2=0x7ffa2c0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:12.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.819+0000 7ffa4ca5d680 1 --2- 172.21.15.153:0/1366960300 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ffa2c034140 0x7ffa2c0365f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ffa3000b300 tx=0x7ffa300014b0 comp rx=0 tx=0).stop 2023-10-05T21:16:12.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.819+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616570f5930 msgr2=0x5616571a9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:12.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.819+0000 7ffa4ca5d680 1 --2- 172.21.15.153:0/1366960300 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616570f5930 0x5616571a9c00 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ffa3400a650 tx=0x7ffa3401d000 comp rx=0 tx=0).stop 2023-10-05T21:16:12.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.819+0000 7ffa40336700 1 -- 172.21.15.153:0/1366960300 reap_dead start 2023-10-05T21:16:12.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.819+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 shutdown_connections 2023-10-05T21:16:12.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.819+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 >> 172.21.15.153:0/1366960300 conn(0x56165717bb80 msgr2=0x56165719cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:12.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.819+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 shutdown_connections 2023-10-05T21:16:12.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.819+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/1366960300 wait complete. 2023-10-05T21:16:12.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.819+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/66371102 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff9800340f0 msgr2=0x7ff9800365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:12.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.819+0000 7ffa4ca5d680 1 --2- 172.21.15.153:0/66371102 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff9800340f0 0x7ff9800365a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x5616571c4970 tx=0x7ffa38036760 comp rx=0 tx=0).stop 2023-10-05T21:16:12.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.819+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/66371102 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616571d2fc0 msgr2=0x5616571d8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:12.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.819+0000 7ffa4ca5d680 1 --2- 172.21.15.153:0/66371102 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616571d2fc0 0x5616571d8ae0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ffa3000efd0 tx=0x7ffa30031000 comp rx=0 tx=0).stop 2023-10-05T21:16:12.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.819+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/66371102 shutdown_connections 2023-10-05T21:16:12.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.819+0000 7ffa4ca5d680 1 --2- 172.21.15.153:0/66371102 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff9800340f0 0x7ff9800365a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:12.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.819+0000 7ffa4ca5d680 1 --2- 172.21.15.153:0/66371102 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616571d2fc0 0x5616571d8ae0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:12.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.819+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/66371102 >> 172.21.15.153:0/66371102 conn(0x5616571ce1c0 msgr2=0x5616571cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:12.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.819+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/66371102 shutdown_connections 2023-10-05T21:16:12.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.819+0000 7ffa4ca5d680 1 -- 172.21.15.153:0/66371102 wait complete. 2023-10-05T21:16:12.842 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:16:12.842 INFO:teuthology.orchestra.run.smithi153.stdout: "entries": [ 2023-10-05T21:16:12.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.842 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "anonymous", 2023-10-05T21:16:12.842 INFO:teuthology.orchestra.run.smithi153.stdout: "buckets": [ 2023-10-05T21:16:12.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.842 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "", 2023-10-05T21:16:12.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:12.842 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:12.842 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "anonymous", 2023-10-05T21:16:12.843 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [] 2023-10-05T21:16:12.843 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:12.843 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:12.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:12.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.843 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:16:12.843 INFO:teuthology.orchestra.run.smithi153.stdout: "buckets": [ 2023-10-05T21:16:12.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.843 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "", 2023-10-05T21:16:12.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:12.843 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:12.843 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:12.844 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [] 2023-10-05T21:16:12.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:12.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.844 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo", 2023-10-05T21:16:12.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:12.844 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:12.844 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:12.844 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [ 2023-10-05T21:16:12.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.844 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "delete_obj", 2023-10-05T21:16:12.844 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:12.845 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:12.845 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 4, 2023-10-05T21:16:12.845 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 4 2023-10-05T21:16:12.845 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:12.845 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:12.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:12.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.845 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo2", 2023-10-05T21:16:12.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:12.845 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:12.845 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:12.845 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [] 2023-10-05T21:16:12.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:12.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.846 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo3", 2023-10-05T21:16:12.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:12.846 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:12.846 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:12.846 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [] 2023-10-05T21:16:12.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:12.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.846 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo4", 2023-10-05T21:16:12.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:12.846 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:12.847 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:12.847 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [] 2023-10-05T21:16:12.847 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:12.847 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:12.847 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:12.847 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:16:12.847 INFO:teuthology.orchestra.run.smithi153.stdout: "summary": [ 2023-10-05T21:16:12.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.847 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "anonymous", 2023-10-05T21:16:12.847 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [], 2023-10-05T21:16:12.847 INFO:teuthology.orchestra.run.smithi153.stdout: "total": { 2023-10-05T21:16:12.847 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:12.848 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:12.848 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 0, 2023-10-05T21:16:12.848 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 0 2023-10-05T21:16:12.848 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:12.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:12.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.848 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:16:12.848 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [ 2023-10-05T21:16:12.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.848 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "delete_obj", 2023-10-05T21:16:12.848 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:12.848 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:12.849 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 4, 2023-10-05T21:16:12.849 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 4 2023-10-05T21:16:12.849 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:12.849 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:16:12.849 INFO:teuthology.orchestra.run.smithi153.stdout: "total": { 2023-10-05T21:16:12.849 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:12.849 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:12.849 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 4, 2023-10-05T21:16:12.849 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 4 2023-10-05T21:16:12.849 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:12.849 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:12.850 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:12.850 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:16:12.850 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2023-10-05T21:16:12.850 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2023-10-05T21:16:12.850 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2023-10-05T21:16:12.850 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2023-10-05T21:16:12.893 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:16:12.893 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:16:12.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.892+0000 7fc4cee90680 1 Processor -- start 2023-10-05T21:16:12.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.893+0000 7fc4cee90680 1 -- start start 2023-10-05T21:16:12.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.893+0000 7fc4cee90680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55a326af2790 0x55a326af4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:12.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.893+0000 7fc4cee90680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a326a3b970 con 0x55a326a62910 2023-10-05T21:16:12.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.893+0000 7fc4cee90680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a3269fbdb0 con 0x55a326af2790 2023-10-05T21:16:12.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.893+0000 7fc4c1767700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55a326af2790 0x55a326af4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:12.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.893+0000 7fc4c1f68700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55a326a62910 0x55a326af1070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:57782/0 (socket says 172.21.15.153:57782) 2023-10-05T21:16:12.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.893+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2931266048 learned_addr learned my addr 172.21.15.153:0/2931266048 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:16:12.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.893+0000 7fc4c1767700 1 -- 172.21.15.153:0/2931266048 >> v1:172.21.15.111:6789/0 conn(0x55a326a62910 legacy=0x55a326af1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:12.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.893+0000 7fc4c1767700 1 -- 172.21.15.153:0/2931266048 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a326af61c0 con 0x55a326af2790 2023-10-05T21:16:12.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.894+0000 7fc4c1767700 1 --2- 172.21.15.153:0/2931266048 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326af2790 0x55a326af4b70 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400a5d0 tx=0x7fc4b4005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=752b2cdd767210f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:12.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.894+0000 7fc4c0f66700 1 -- 172.21.15.153:0/2931266048 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc4b40086a0 con 0x55a326af2790 2023-10-05T21:16:12.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.894+0000 7fc4c0f66700 1 -- 172.21.15.153:0/2931266048 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b4008800 con 0x55a326af2790 2023-10-05T21:16:12.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.894+0000 7fc4c0f66700 1 -- 172.21.15.153:0/2931266048 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc4b4008ad0 con 0x55a326af2790 2023-10-05T21:16:12.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.894+0000 7fc4cee90680 1 -- 172.21.15.153:0/2931266048 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326af2790 msgr2=0x55a326af4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:12.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.894+0000 7fc4cee90680 1 --2- 172.21.15.153:0/2931266048 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326af2790 0x55a326af4b70 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400a5d0 tx=0x7fc4b4005a50 comp rx=0 tx=0).stop 2023-10-05T21:16:12.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.894+0000 7fc4cee90680 1 -- 172.21.15.153:0/2931266048 shutdown_connections 2023-10-05T21:16:12.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.894+0000 7fc4cee90680 1 --2- 172.21.15.153:0/2931266048 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326af2790 0x55a326af4b70 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:12.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.894+0000 7fc4cee90680 1 -- 172.21.15.153:0/2931266048 >> 172.21.15.153:0/2931266048 conn(0x55a326ae8b60 msgr2=0x55a326aeaf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:12.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.894+0000 7fc4cee90680 1 -- 172.21.15.153:0/2931266048 shutdown_connections 2023-10-05T21:16:12.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.894+0000 7fc4cee90680 1 -- 172.21.15.153:0/2931266048 wait complete. 2023-10-05T21:16:12.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.895+0000 7fc4cee90680 1 Processor -- start 2023-10-05T21:16:12.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.895+0000 7fc4cee90680 1 -- start start 2023-10-05T21:16:12.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.895+0000 7fc4cee90680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326a62910 0x55a326b0d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:12.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.895+0000 7fc4cee90680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a32699bea0 con 0x55a326a62910 2023-10-05T21:16:12.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.895+0000 7fc4c1f68700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326a62910 0x55a326b0d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:12.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.895+0000 7fc4c1f68700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326a62910 0x55a326b0d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54736/0 (socket says 172.21.15.153:54736) 2023-10-05T21:16:12.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.895+0000 7fc4c1f68700 1 -- 172.21.15.153:0/1178359887 learned_addr learned my addr 172.21.15.153:0/1178359887 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:12.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.896+0000 7fc4c1f68700 1 -- 172.21.15.153:0/1178359887 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b4005cf0 con 0x55a326a62910 2023-10-05T21:16:12.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.896+0000 7fc4c1f68700 1 --2- 172.21.15.153:0/1178359887 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326a62910 0x55a326b0d870 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8001c00 tx=0x7fc4b80017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42fb24bf6067a783 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:12.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.896+0000 7fc4b37fe700 1 -- 172.21.15.153:0/1178359887 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc4b800bbf0 con 0x55a326a62910 2023-10-05T21:16:12.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.896+0000 7fc4b37fe700 1 -- 172.21.15.153:0/1178359887 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b800bd50 con 0x55a326a62910 2023-10-05T21:16:12.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.896+0000 7fc4b37fe700 1 -- 172.21.15.153:0/1178359887 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc4b800e470 con 0x55a326a62910 2023-10-05T21:16:12.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.896+0000 7fc4cee90680 1 -- 172.21.15.153:0/1178359887 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326a62910 msgr2=0x55a326b0d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:12.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.896+0000 7fc4cee90680 1 --2- 172.21.15.153:0/1178359887 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326a62910 0x55a326b0d870 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8001c00 tx=0x7fc4b80017b0 comp rx=0 tx=0).stop 2023-10-05T21:16:12.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.896+0000 7fc4cee90680 1 -- 172.21.15.153:0/1178359887 shutdown_connections 2023-10-05T21:16:12.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.896+0000 7fc4cee90680 1 --2- 172.21.15.153:0/1178359887 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326a62910 0x55a326b0d870 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:12.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.896+0000 7fc4cee90680 1 -- 172.21.15.153:0/1178359887 >> 172.21.15.153:0/1178359887 conn(0x55a326ae8b60 msgr2=0x55a326b09340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:12.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.897+0000 7fc4cee90680 1 -- 172.21.15.153:0/1178359887 shutdown_connections 2023-10-05T21:16:12.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.897+0000 7fc4cee90680 1 -- 172.21.15.153:0/1178359887 wait complete. 2023-10-05T21:16:12.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.897+0000 7fc4cee90680 1 Processor -- start 2023-10-05T21:16:12.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.897+0000 7fc4cee90680 1 -- start start 2023-10-05T21:16:12.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.897+0000 7fc4cee90680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326a62910 0x55a326b14cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:12.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.897+0000 7fc4cee90680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a326992c80 con 0x55a326a62910 2023-10-05T21:16:12.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.897+0000 7fc4c1f68700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326a62910 0x55a326b14cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:12.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.897+0000 7fc4c1f68700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326a62910 0x55a326b14cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54738/0 (socket says 172.21.15.153:54738) 2023-10-05T21:16:12.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.897+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 learned_addr learned my addr 172.21.15.153:0/2744247978 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:12.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.898+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a326a3b970 con 0x55a326a62910 2023-10-05T21:16:12.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.898+0000 7fc4c1f68700 1 --2- 172.21.15.153:0/2744247978 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326a62910 0x55a326b14cc0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8004150 tx=0x7fc4b8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:12.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.898+0000 7fc4b1ffb700 1 -- 172.21.15.153:0/2744247978 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc4b801f070 con 0x55a326a62910 2023-10-05T21:16:12.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.898+0000 7fc4b1ffb700 1 -- 172.21.15.153:0/2744247978 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b8024410 con 0x55a326a62910 2023-10-05T21:16:12.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.898+0000 7fc4b1ffb700 1 -- 172.21.15.153:0/2744247978 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc4b80245a0 con 0x55a326a62910 2023-10-05T21:16:12.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.898+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a326b15200 con 0x55a326a62910 2023-10-05T21:16:12.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.898+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a326b15650 con 0x55a326a62910 2023-10-05T21:16:12.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.899+0000 7fc4cee90680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.899+0000 7fc4b1ffb700 1 -- 172.21.15.153:0/2744247978 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fc4b8024790 con 0x55a326a62910 2023-10-05T21:16:12.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.899+0000 7fc4b1ffb700 1 --2- 172.21.15.153:0/2744247978 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc4a4034140 0x7fc4a40365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:12.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.899+0000 7fc4b1ffb700 1 -- 172.21.15.153:0/2744247978 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fc4b8048cd0 con 0x55a326a62910 2023-10-05T21:16:12.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.899+0000 7fc4c1767700 1 --2- 172.21.15.153:0/2744247978 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc4a4034140 0x7fc4a40365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:12.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.899+0000 7fc4cee90680 1 --2- 172.21.15.153:0/2744247978 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55a326af2790 0x55a326b20a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:12.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.899+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b21220 con 0x55a326af2790 2023-10-05T21:16:12.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.899+0000 7fc4c2769700 1 --2- 172.21.15.153:0/2744247978 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55a326af2790 0x55a326b20a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:12.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.900+0000 7fc4c1767700 1 --2- 172.21.15.153:0/2744247978 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc4a4034140 0x7fc4a40365f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4003080 tx=0x7fc4b4015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:12.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.900+0000 7fc4c2769700 1 --2- 172.21.15.153:0/2744247978 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55a326af2790 0x55a326b20a90 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:12.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.900+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.900+0000 7fc4cee90680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:12.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.900+0000 7fc4cee90680 20 realm 2023-10-05T21:16:12.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.900+0000 7fc4cee90680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.900+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b1e040 con 0x55a326af2790 2023-10-05T21:16:12.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.900+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.900+0000 7fc4cee90680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:12.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.900+0000 7fc4cee90680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:16:12.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.900+0000 7fc4cee90680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.900+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b21cd0 con 0x55a326af2790 2023-10-05T21:16:12.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.900+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.900+0000 7fc4cee90680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:12.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.900+0000 7fc4cee90680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.900+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b225f0 con 0x55a326af2790 2023-10-05T21:16:12.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.901+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.901+0000 7fc4cee90680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:12.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.901+0000 7fc4cee90680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.901+0000 7fc4cee90680 1 --2- 172.21.15.153:0/2744247978 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55a326b22eb0 0x55a326b25290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:12.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.901+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b25860 con 0x55a326b22eb0 2023-10-05T21:16:12.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.901+0000 7fc4c1f68700 1 --2- 172.21.15.153:0/2744247978 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55a326b22eb0 0x55a326b25290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:12.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.901+0000 7fc4c1f68700 1 --2- 172.21.15.153:0/2744247978 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55a326b22eb0 0x55a326b25290 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:12.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.901+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.901+0000 7fc4cee90680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:16:12.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.901+0000 7fc4cee90680 20 searching for the correct realm 2023-10-05T21:16:12.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.901+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x55a326b22eb0 2023-10-05T21:16:12.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.902+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.902+0000 7fc4c1f68700 1 --2- 172.21.15.153:0/2744247978 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc4b8018b30 0x7fc4b80169a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:12.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.902+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x7fc4b8018b30 2023-10-05T21:16:12.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.902+0000 7fc4c1767700 1 --2- 172.21.15.153:0/2744247978 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc4b8018b30 0x7fc4b80169a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:12.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.902+0000 7fc4c1767700 1 --2- 172.21.15.153:0/2744247978 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc4b8018b30 0x7fc4b80169a0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:12.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.902+0000 7fc4c1767700 1 -- 172.21.15.153:0/2744247978 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4b4019040 con 0x7fc4b8018b30 2023-10-05T21:16:12.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.902+0000 7fc4c1767700 1 --2- 172.21.15.153:0/2744247978 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc4b4007030 0x7fc4b401d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:12.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.902+0000 7fc4c1767700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x7fc4b4007030 2023-10-05T21:16:12.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.903+0000 7fc4c2769700 1 --2- 172.21.15.153:0/2744247978 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc4b4007030 0x7fc4b401d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:12.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.903+0000 7fc4c2769700 1 --2- 172.21.15.153:0/2744247978 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc4b4007030 0x7fc4b401d420 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:12.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.903+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.903+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x55a326af2790 2023-10-05T21:16:12.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.903+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.903+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x55a326af2790 2023-10-05T21:16:12.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.904+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.904+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x7fc4b4007030 2023-10-05T21:16:12.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.904+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.904+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x7fc4b4007030 2023-10-05T21:16:12.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.904+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.904+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x7fc4b8018b30 2023-10-05T21:16:12.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.904+0000 7fc4c1767700 1 -- 172.21.15.153:0/2744247978 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4b4019040 con 0x7fc4b8018b30 2023-10-05T21:16:12.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.904+0000 7fc4c1767700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x55a326b22eb0 2023-10-05T21:16:12.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.905+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.905+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x55a326af2790 2023-10-05T21:16:12.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.905+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.905+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x7fc4b4007030 2023-10-05T21:16:12.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.905+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.905+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x55a326af2790 2023-10-05T21:16:12.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.905+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.905+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x7fc4b8018b30 2023-10-05T21:16:12.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.906+0000 7fc4c1767700 1 -- 172.21.15.153:0/2744247978 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4b4019040 con 0x7fc4b8018b30 2023-10-05T21:16:12.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.906+0000 7fc4c1767700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x55a326b22eb0 2023-10-05T21:16:12.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.906+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.906+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x55a326b22eb0 2023-10-05T21:16:12.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.906+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.906+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x7fc4b4007030 2023-10-05T21:16:12.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.906+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.906+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x55a326b22eb0 2023-10-05T21:16:12.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.906+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.906+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x55a326b22eb0 2023-10-05T21:16:12.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.907+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.907+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x55a326af2790 2023-10-05T21:16:12.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.907+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.907+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x55a326af2790 2023-10-05T21:16:12.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.907+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.907+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x7fc4b4007030 2023-10-05T21:16:12.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.907+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.907+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x55a326b22eb0 2023-10-05T21:16:12.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.908+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.908+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x7fc4b8018b30 2023-10-05T21:16:12.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.908+0000 7fc4c1767700 1 -- 172.21.15.153:0/2744247978 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4b4019040 con 0x7fc4b8018b30 2023-10-05T21:16:12.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.908+0000 7fc4c1767700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x55a326af2790 2023-10-05T21:16:12.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.908+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.908+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x7fc4b4007030 2023-10-05T21:16:12.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.908+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.908+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x55a326b22eb0 2023-10-05T21:16:12.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.908+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.908+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x7fc4b4007030 2023-10-05T21:16:12.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.909+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.909+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x7fc4b8018b30 2023-10-05T21:16:12.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.909+0000 7fc4c1767700 1 -- 172.21.15.153:0/2744247978 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4b4019040 con 0x7fc4b8018b30 2023-10-05T21:16:12.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.909+0000 7fc4c1767700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x55a326b22eb0 2023-10-05T21:16:12.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.909+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.909+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x7fc4b4007030 2023-10-05T21:16:12.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.910+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.910+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x55a326af2790 2023-10-05T21:16:12.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.910+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.910+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27180 con 0x7fc4b8018b30 2023-10-05T21:16:12.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.910+0000 7fc4c1767700 1 -- 172.21.15.153:0/2744247978 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4b4019040 con 0x7fc4b8018b30 2023-10-05T21:16:12.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.910+0000 7fc4cee90680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:16:12.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.910+0000 7fc4cee90680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:16:12.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.910+0000 7fc4cee90680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:16:12.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.910+0000 7fc4cee90680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:16:12.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.910+0000 7fc4cee90680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.910+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b263a0 con 0x55a326af2790 2023-10-05T21:16:12.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.910+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.910+0000 7fc4cee90680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:12.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.910+0000 7fc4cee90680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.910+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b267d0 con 0x55a326af2790 2023-10-05T21:16:12.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.910+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.910+0000 7fc4cee90680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:12.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.910+0000 7fc4cee90680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.911+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b26c00 con 0x55a326af2790 2023-10-05T21:16:12.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.911+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.911+0000 7fc4cee90680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:16:12.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.911+0000 7fc4cee90680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.911+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27530 con 0x55a326b22eb0 2023-10-05T21:16:12.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.911+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.911+0000 7fc4cee90680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:12.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.911+0000 7fc4cee90680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.911+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27930 con 0x55a326af2790 2023-10-05T21:16:12.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.911+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.911+0000 7fc4cee90680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:12.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.911+0000 7fc4cee90680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.911+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27d30 con 0x55a326af2790 2023-10-05T21:16:12.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.911+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.911+0000 7fc4cee90680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:12.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.911+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b28d40 con 0x55a326b22eb0 2023-10-05T21:16:12.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.912+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.912+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b28d40 con 0x7fc4b8018b30 2023-10-05T21:16:12.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.912+0000 7fc4c1767700 1 -- 172.21.15.153:0/2744247978 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4b4019040 con 0x7fc4b8018b30 2023-10-05T21:16:12.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.912+0000 7fc4c1767700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b28d40 con 0x7fc4b4007030 2023-10-05T21:16:12.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.912+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.912+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b26c00 con 0x55a326af2790 2023-10-05T21:16:12.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.912+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.912+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b26c00 con 0x55a326af2790 2023-10-05T21:16:12.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.913+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.913+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b26c00 con 0x7fc4b4007030 2023-10-05T21:16:12.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.913+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.913+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b26c00 con 0x7fc4b4007030 2023-10-05T21:16:12.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.913+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.913+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b26c00 con 0x7fc4b8018b30 2023-10-05T21:16:12.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.913+0000 7fc4c1767700 1 -- 172.21.15.153:0/2744247978 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4b4019040 con 0x7fc4b8018b30 2023-10-05T21:16:12.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.913+0000 7fc4c1767700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b26c00 con 0x55a326b22eb0 2023-10-05T21:16:12.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.914+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.914+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b26c00 con 0x55a326af2790 2023-10-05T21:16:12.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.914+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.914+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b26c00 con 0x7fc4b4007030 2023-10-05T21:16:12.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.914+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.914+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b26c00 con 0x55a326af2790 2023-10-05T21:16:12.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.914+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.914+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b26c00 con 0x7fc4b8018b30 2023-10-05T21:16:12.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.915+0000 7fc4c1767700 1 -- 172.21.15.153:0/2744247978 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4b4019040 con 0x7fc4b8018b30 2023-10-05T21:16:12.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.915+0000 7fc4c1767700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b26c00 con 0x55a326b22eb0 2023-10-05T21:16:12.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.915+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.915+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b26c00 con 0x55a326b22eb0 2023-10-05T21:16:12.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.915+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.915+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b26c00 con 0x7fc4b4007030 2023-10-05T21:16:12.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.915+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.915+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b26c00 con 0x55a326b22eb0 2023-10-05T21:16:12.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.916+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.916+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b26c00 con 0x55a326b22eb0 2023-10-05T21:16:12.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.916+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.916+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b26c00 con 0x55a326af2790 2023-10-05T21:16:12.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.916+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.916+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b26c00 con 0x55a326af2790 2023-10-05T21:16:12.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.916+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.916+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b26c00 con 0x7fc4b4007030 2023-10-05T21:16:12.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.917+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.917+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b26c00 con 0x55a326b22eb0 2023-10-05T21:16:12.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.917+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.917+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b26c00 con 0x7fc4b8018b30 2023-10-05T21:16:12.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.917+0000 7fc4c1767700 1 -- 172.21.15.153:0/2744247978 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4b4019040 con 0x7fc4b8018b30 2023-10-05T21:16:12.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.917+0000 7fc4c1767700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b26c00 con 0x55a326af2790 2023-10-05T21:16:12.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.917+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.917+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b26c00 con 0x7fc4b4007030 2023-10-05T21:16:12.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.918+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.918+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b26c00 con 0x55a326b22eb0 2023-10-05T21:16:12.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.918+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.918+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b26c00 con 0x7fc4b4007030 2023-10-05T21:16:12.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.918+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.918+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b26c00 con 0x7fc4b8018b30 2023-10-05T21:16:12.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.918+0000 7fc4c1767700 1 -- 172.21.15.153:0/2744247978 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4b4019040 con 0x7fc4b8018b30 2023-10-05T21:16:12.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.918+0000 7fc4c1767700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b26c00 con 0x55a326b22eb0 2023-10-05T21:16:12.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.919+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.919+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b26c00 con 0x7fc4b4007030 2023-10-05T21:16:12.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.919+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.919+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b26c00 con 0x55a326af2790 2023-10-05T21:16:12.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.919+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.919+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b26c00 con 0x7fc4b8018b30 2023-10-05T21:16:12.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.919+0000 7fc4c1767700 1 -- 172.21.15.153:0/2744247978 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4b4019040 con 0x7fc4b8018b30 2023-10-05T21:16:12.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.919+0000 7fc4cee90680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:16:12.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.919+0000 7fc4cee90680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:16:12.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.919+0000 7fc4cee90680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:16:12.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.919+0000 7fc4cee90680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:16:12.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.919+0000 7fc4cee90680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.919+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b27d30 con 0x55a326af2790 2023-10-05T21:16:12.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.920+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.920+0000 7fc4cee90680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:12.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.920+0000 7fc4cee90680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.920+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b280e0 con 0x55a326b22eb0 2023-10-05T21:16:12.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.920+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.920+0000 7fc4cee90680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:16:12.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.920+0000 7fc4cee90680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.920+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b25f10 con 0x55a326af2790 2023-10-05T21:16:12.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.920+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.920+0000 7fc4cee90680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:12.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.920+0000 7fc4cee90680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.920+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b25f10 con 0x55a326af2790 2023-10-05T21:16:12.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.920+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.920+0000 7fc4cee90680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:16:12.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.920+0000 7fc4cee90680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.920+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b28980 con 0x7fc4b4007030 2023-10-05T21:16:12.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.921+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.921+0000 7fc4cee90680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:12.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.921+0000 7fc4cee90680 20 zone default found 2023-10-05T21:16:12.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.921+0000 7fc4cee90680 4 Realm: () 2023-10-05T21:16:12.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.921+0000 7fc4cee90680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:16:12.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.921+0000 7fc4cee90680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:16:12.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.921+0000 7fc4cee90680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:16:12.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.921+0000 7fc4cee90680 20 zonegroup default 2023-10-05T21:16:12.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.921+0000 7fc4cee90680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.921+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b28980 con 0x7fc4b4007030 2023-10-05T21:16:12.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.921+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.921+0000 7fc4cee90680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:12.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.921+0000 7fc4cee90680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.921+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b2a300 con 0x55a326b22eb0 2023-10-05T21:16:12.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.921+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.921+0000 7fc4cee90680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:12.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.921+0000 7fc4cee90680 20 rados->read ofs=0 len=0 2023-10-05T21:16:12.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.921+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b2a6b0 con 0x55a326b22eb0 2023-10-05T21:16:12.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.922+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.922+0000 7fc4cee90680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:12.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.922+0000 7fc4cee90680 20 started sync module instance, tier type = 2023-10-05T21:16:12.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.922+0000 7fc4cee90680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:16:12.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.922+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b299c0 con 0x7fc4b8018b30 2023-10-05T21:16:12.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.922+0000 7fc4c1767700 1 -- 172.21.15.153:0/2744247978 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v31'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4b4019040 con 0x7fc4b8018b30 2023-10-05T21:16:12.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.922+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94159217270208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b2af50 con 0x7fc4b8018b30 2023-10-05T21:16:12.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.922+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b2b7f0 con 0x55a326af2790 2023-10-05T21:16:12.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.923+0000 7fc4c1767700 1 -- 172.21.15.153:0/2744247978 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94159217270208] v31'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4b4019040 con 0x7fc4b8018b30 2023-10-05T21:16:12.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.923+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v31'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.923+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94159217273440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b2b7f0 con 0x55a326af2790 2023-10-05T21:16:12.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.923+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b2c370 con 0x55a326b22eb0 2023-10-05T21:16:12.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.925+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v31'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.925+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94159217278496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b2cc60 con 0x55a326b22eb0 2023-10-05T21:16:12.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.925+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94159217273440] v31'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.925+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b2d500 con 0x7fc4b8018b30 2023-10-05T21:16:12.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.925+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94159217278496] v31'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.925+0000 7fc4c1767700 1 -- 172.21.15.153:0/2744247978 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v31'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4b4019040 con 0x7fc4b8018b30 2023-10-05T21:16:12.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.925+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94159217283088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b2d8b0 con 0x7fc4b8018b30 2023-10-05T21:16:12.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.925+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b2e2c0 con 0x55a326af2790 2023-10-05T21:16:12.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.926+0000 7fc4c1767700 1 -- 172.21.15.153:0/2744247978 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94159217283088] v31'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4b4019040 con 0x7fc4b8018b30 2023-10-05T21:16:12.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.926+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v31'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.926+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94159217286608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b2e710 con 0x55a326af2790 2023-10-05T21:16:12.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.926+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b2f120 con 0x7fc4b4007030 2023-10-05T21:16:12.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.927+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v31'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.927+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94159217290288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b2f080 con 0x7fc4b4007030 2023-10-05T21:16:12.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.927+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94159217286608] v31'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.927+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b2ff30 con 0x7fc4b4007030 2023-10-05T21:16:12.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.928+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(96 notify.6 [create] v31'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.928+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(95 notify.5 [watch watch cookie 94159217290288] v31'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.928+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94159217293840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b2f080 con 0x7fc4b4007030 2023-10-05T21:16:12.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.928+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b305d0 con 0x7fc4b4007030 2023-10-05T21:16:12.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.929+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94159217293840] v31'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.929+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v31'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.929+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94159217295456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b30590 con 0x7fc4b4007030 2023-10-05T21:16:12.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.929+0000 7fc4cee90680 20 add_watcher() i=0 2023-10-05T21:16:12.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.929+0000 7fc4cee90680 20 add_watcher() i=1 2023-10-05T21:16:12.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.929+0000 7fc4cee90680 20 add_watcher() i=2 2023-10-05T21:16:12.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.929+0000 7fc4cee90680 20 add_watcher() i=3 2023-10-05T21:16:12.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.929+0000 7fc4cee90680 20 add_watcher() i=4 2023-10-05T21:16:12.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.929+0000 7fc4cee90680 20 add_watcher() i=5 2023-10-05T21:16:12.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.929+0000 7fc4cee90680 20 add_watcher() i=6 2023-10-05T21:16:12.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.930+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94159217295456] v31'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.930+0000 7fc4cee90680 20 add_watcher() i=7 2023-10-05T21:16:12.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.930+0000 7fc4cee90680 2 all 8 watchers are set, enabling cache 2023-10-05T21:16:12.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.930+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b339d0 con 0x55a326af2790 2023-10-05T21:16:12.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.930+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.930+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94159217292496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326b30ec0 con 0x55a326af2790 2023-10-05T21:16:12.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.931+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94159217292496] v31'219 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.931+0000 7fc4937de700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:16:12.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.931+0000 7fc4cee90680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:16:12.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.931+0000 7fc4cee90680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:16:12.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.931+0000 7fc4cee90680 1 Processor -- start 2023-10-05T21:16:12.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.931+0000 7fc4cee90680 1 -- start start 2023-10-05T21:16:12.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.931+0000 7fc4cee90680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326b3e3c0 0x55a326b3e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:12.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.931+0000 7fc4cee90680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a326b3eda0 con 0x55a326b3e3c0 2023-10-05T21:16:12.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.931+0000 7fc4c1767700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326b3e3c0 0x55a326b3e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:12.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.932+0000 7fc4c1767700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326b3e3c0 0x55a326b3e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54746/0 (socket says 172.21.15.153:54746) 2023-10-05T21:16:12.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.932+0000 7fc4c1767700 1 -- 172.21.15.153:0/2337638634 learned_addr learned my addr 172.21.15.153:0/2337638634 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:12.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.932+0000 7fc4c1767700 1 -- 172.21.15.153:0/2337638634 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a326b3eee0 con 0x55a326b3e3c0 2023-10-05T21:16:12.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.932+0000 7fc4c1767700 1 --2- 172.21.15.153:0/2337638634 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326b3e3c0 0x55a326b3e7d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x55a326af6190 tx=0x7fc4b4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d98714970456b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:12.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.932+0000 7fc492fdd700 1 -- 172.21.15.153:0/2337638634 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc4b401ddc0 con 0x55a326b3e3c0 2023-10-05T21:16:12.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.932+0000 7fc492fdd700 1 -- 172.21.15.153:0/2337638634 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b402b450 con 0x55a326b3e3c0 2023-10-05T21:16:12.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.932+0000 7fc492fdd700 1 -- 172.21.15.153:0/2337638634 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc4b402b600 con 0x55a326b3e3c0 2023-10-05T21:16:12.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.933+0000 7fc4cee90680 1 -- 172.21.15.153:0/2337638634 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326b3e3c0 msgr2=0x55a326b3e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:12.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.933+0000 7fc4cee90680 1 --2- 172.21.15.153:0/2337638634 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326b3e3c0 0x55a326b3e7d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x55a326af6190 tx=0x7fc4b4012000 comp rx=0 tx=0).stop 2023-10-05T21:16:12.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.933+0000 7fc4cee90680 1 -- 172.21.15.153:0/2337638634 shutdown_connections 2023-10-05T21:16:12.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.933+0000 7fc4cee90680 1 --2- 172.21.15.153:0/2337638634 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326b3e3c0 0x55a326b3e7d0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:12.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.933+0000 7fc4cee90680 1 -- 172.21.15.153:0/2337638634 >> 172.21.15.153:0/2337638634 conn(0x55a326b395c0 msgr2=0x55a326b37720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:12.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.933+0000 7fc4cee90680 1 -- 172.21.15.153:0/2337638634 shutdown_connections 2023-10-05T21:16:12.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.933+0000 7fc4cee90680 1 -- 172.21.15.153:0/2337638634 wait complete. 2023-10-05T21:16:12.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.933+0000 7fc4cee90680 1 Processor -- start 2023-10-05T21:16:12.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.933+0000 7fc4cee90680 1 -- start start 2023-10-05T21:16:12.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.933+0000 7fc4cee90680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326b3e3c0 0x55a326aee9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:12.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.933+0000 7fc4cee90680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a326aed010 con 0x55a326b3e3c0 2023-10-05T21:16:12.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.934+0000 7fc4c1767700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326b3e3c0 0x55a326aee9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:12.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.934+0000 7fc4c1767700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326b3e3c0 0x55a326aee9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54752/0 (socket says 172.21.15.153:54752) 2023-10-05T21:16:12.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.934+0000 7fc4c1767700 1 -- 172.21.15.153:0/1948774438 learned_addr learned my addr 172.21.15.153:0/1948774438 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:12.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.934+0000 7fc4c1767700 1 -- 172.21.15.153:0/1948774438 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a326af61c0 con 0x55a326b3e3c0 2023-10-05T21:16:12.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.934+0000 7fc4c1767700 1 --2- 172.21.15.153:0/1948774438 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326b3e3c0 0x55a326aee9f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4039040 tx=0x7fc4b4031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:12.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.934+0000 7fc4917da700 1 -- 172.21.15.153:0/1948774438 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc4b40377e0 con 0x55a326b3e3c0 2023-10-05T21:16:12.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.934+0000 7fc4917da700 1 -- 172.21.15.153:0/1948774438 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b4037960 con 0x55a326b3e3c0 2023-10-05T21:16:12.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.934+0000 7fc4917da700 1 -- 172.21.15.153:0/1948774438 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc4b4037c50 con 0x55a326b3e3c0 2023-10-05T21:16:12.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.934+0000 7fc4cee90680 1 -- 172.21.15.153:0/1948774438 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a326aed210 con 0x55a326b3e3c0 2023-10-05T21:16:12.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.934+0000 7fc4cee90680 1 -- 172.21.15.153:0/1948774438 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a326aed660 con 0x55a326b3e3c0 2023-10-05T21:16:12.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.935+0000 7fc4917da700 1 -- 172.21.15.153:0/1948774438 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fc4b4026040 con 0x55a326b3e3c0 2023-10-05T21:16:12.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.935+0000 7fc4917da700 1 --2- 172.21.15.153:0/1948774438 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc4080340f0 0x7fc4080365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:12.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.935+0000 7fc4917da700 1 -- 172.21.15.153:0/1948774438 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fc4b4031070 con 0x55a326b3e3c0 2023-10-05T21:16:12.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.935+0000 7fc4c2769700 1 --2- 172.21.15.153:0/1948774438 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc4080340f0 0x7fc4080365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:12.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.935+0000 7fc4cee90680 5 note: GC not initialized 2023-10-05T21:16:12.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.936+0000 7fc4c2769700 1 --2- 172.21.15.153:0/1948774438 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc4080340f0 0x7fc4080365a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x55a326b30860 tx=0x7fc4bc00af30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:12.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.936+0000 7fc4027fc700 20 reqs_thread_entry: start 2023-10-05T21:16:12.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.936+0000 7fc3f3fff700 20 reqs_thread_entry: start 2023-10-05T21:16:12.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.937+0000 7fc4cee90680 20 init_complete bucket index max shards: 11 2023-10-05T21:16:12.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.937+0000 7fc4cee90680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:16:12.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.937+0000 7fc3f27fc700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:16:43 2023 2023-10-05T21:16:12.961 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:16:12.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.937+0000 7fc3f1ffb700 20 reqs_thread_entry: start 2023-10-05T21:16:12.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.937+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bac5e0 con 0x55a326af2790 2023-10-05T21:16:12.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.937+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.937+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:103 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bac5e0 con 0x7fc4b8018b30 2023-10-05T21:16:12.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.937+0000 7fc4c1767700 1 -- 172.21.15.153:0/2744247978 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(103 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fc4b4034040 con 0x7fc4b8018b30 2023-10-05T21:16:12.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.937+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:104 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bac5e0 con 0x55a326af2790 2023-10-05T21:16:12.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.938+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(104 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.938+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:105 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bac5e0 con 0x55a326b22eb0 2023-10-05T21:16:12.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.938+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(105 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.938+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:106 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bac5e0 con 0x55a326b22eb0 2023-10-05T21:16:12.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.938+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(106 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.938+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bac5e0 con 0x55a326b22eb0 2023-10-05T21:16:12.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.938+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(107 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.938+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:108 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bac5e0 con 0x55a326af2790 2023-10-05T21:16:12.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.939+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(108 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.939+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:109 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bac5e0 con 0x55a326af2790 2023-10-05T21:16:12.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.939+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(109 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.939+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:110 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bac5e0 con 0x55a326b22eb0 2023-10-05T21:16:12.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.939+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== osd_op_reply(110 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.939+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:111 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bac5e0 con 0x55a326b22eb0 2023-10-05T21:16:12.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.939+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(111 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.939+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bac5e0 con 0x7fc4b4007030 2023-10-05T21:16:12.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.940+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(112 usage.10 [call out=1268b] v0'0 uv32 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.940+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:113 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bad5c0 con 0x55a326af2790 2023-10-05T21:16:12.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.940+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(113 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.940+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:114 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bad5c0 con 0x7fc4b8018b30 2023-10-05T21:16:12.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.941+0000 7fc4c1767700 1 -- 172.21.15.153:0/2744247978 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(114 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4b4034040 con 0x7fc4b8018b30 2023-10-05T21:16:12.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.941+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:115 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bad5c0 con 0x55a326b22eb0 2023-10-05T21:16:12.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.941+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 31 ==== osd_op_reply(115 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.941+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:116 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bad5c0 con 0x7fc4b4007030 2023-10-05T21:16:12.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.941+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(116 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.941+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:117 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bad5c0 con 0x7fc4b4007030 2023-10-05T21:16:12.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.941+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(117 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.941+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:118 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bad5c0 con 0x55a326b22eb0 2023-10-05T21:16:12.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.942+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 32 ==== osd_op_reply(118 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.942+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:119 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bad5c0 con 0x7fc4b4007030 2023-10-05T21:16:12.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.942+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(119 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) v8 ==== 152+0+163 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.942+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:120 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bad5c0 con 0x55a326af2790 2023-10-05T21:16:12.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.942+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(120 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.942+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:121 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bad5c0 con 0x55a326b22eb0 2023-10-05T21:16:12.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.943+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 33 ==== osd_op_reply(121 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.943+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:122 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bad5c0 con 0x7fc4b4007030 2023-10-05T21:16:12.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.943+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 31 ==== osd_op_reply(122 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.943+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:123 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bad5c0 con 0x7fc4b8018b30 2023-10-05T21:16:12.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.943+0000 7fc4c1767700 1 -- 172.21.15.153:0/2744247978 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(123 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4b4034040 con 0x7fc4b8018b30 2023-10-05T21:16:12.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.943+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:124 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bad5c0 con 0x7fc4b4007030 2023-10-05T21:16:12.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.943+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 32 ==== osd_op_reply(124 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.943+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:125 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bad5c0 con 0x55a326af2790 2023-10-05T21:16:12.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.944+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== osd_op_reply(125 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.944+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:126 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bad5c0 con 0x55a326af2790 2023-10-05T21:16:12.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.944+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 42 ==== osd_op_reply(126 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.944+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:127 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bad5c0 con 0x55a326b22eb0 2023-10-05T21:16:12.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.944+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 34 ==== osd_op_reply(127 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.944+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:128 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bad5c0 con 0x55a326af2790 2023-10-05T21:16:12.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.944+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 43 ==== osd_op_reply(128 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.944+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:129 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bad5c0 con 0x55a326af2790 2023-10-05T21:16:12.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.945+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 44 ==== osd_op_reply(129 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.945+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:130 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bad5c0 con 0x55a326b22eb0 2023-10-05T21:16:12.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.945+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 35 ==== osd_op_reply(130 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.945+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:131 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bad5c0 con 0x55a326b22eb0 2023-10-05T21:16:12.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.945+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 36 ==== osd_op_reply(131 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.945+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:132 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bad5c0 con 0x55a326b22eb0 2023-10-05T21:16:12.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.945+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 37 ==== osd_op_reply(132 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.945+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:133 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bad5c0 con 0x7fc4b4007030 2023-10-05T21:16:12.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.945+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 33 ==== osd_op_reply(133 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.972 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:16:12.972 INFO:teuthology.orchestra.run.smithi153.stdout: "entries": [ 2023-10-05T21:16:12.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.972 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "anonymous", 2023-10-05T21:16:12.972 INFO:teuthology.orchestra.run.smithi153.stdout: "buckets": [ 2023-10-05T21:16:12.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.973 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "", 2023-10-05T21:16:12.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:12.973 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:12.973 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "anonymous", 2023-10-05T21:16:12.973 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [ 2023-10-05T21:16:12.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.973 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "list_buckets", 2023-10-05T21:16:12.973 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 231, 2023-10-05T21:16:12.973 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:12.973 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:12.973 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:12.974 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:12.974 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:12.974 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:12.974 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:12.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:12.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.974 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:16:12.974 INFO:teuthology.orchestra.run.smithi153.stdout: "buckets": [ 2023-10-05T21:16:12.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.974 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "", 2023-10-05T21:16:12.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:12.975 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:12.975 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:12.975 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [ 2023-10-05T21:16:12.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.975 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "list_buckets", 2023-10-05T21:16:12.975 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 322, 2023-10-05T21:16:12.975 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:12.975 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:12.975 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:12.975 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:12.975 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:12.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:12.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.976 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo", 2023-10-05T21:16:12.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:12.976 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:12.976 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:12.976 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [ 2023-10-05T21:16:12.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.976 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "create_bucket", 2023-10-05T21:16:12.976 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:12.976 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:12.976 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 5, 2023-10-05T21:16:12.976 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 5 2023-10-05T21:16:12.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:12.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.977 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "delete_bucket", 2023-10-05T21:16:12.977 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 217, 2023-10-05T21:16:12.977 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:12.977 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 2, 2023-10-05T21:16:12.977 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:12.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:12.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.977 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "delete_obj", 2023-10-05T21:16:12.977 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:12.977 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:12.977 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 4, 2023-10-05T21:16:12.978 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 4 2023-10-05T21:16:12.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:12.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.978 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "get_acls", 2023-10-05T21:16:12.978 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 1026, 2023-10-05T21:16:12.978 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:12.978 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 2, 2023-10-05T21:16:12.978 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 2 2023-10-05T21:16:12.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:12.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.978 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "get_obj", 2023-10-05T21:16:12.979 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 4, 2023-10-05T21:16:12.979 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:12.979 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:12.979 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:12.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:12.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.979 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "list_bucket", 2023-10-05T21:16:12.979 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 515, 2023-10-05T21:16:12.979 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:12.979 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:12.979 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:12.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:12.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.980 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "put_acls", 2023-10-05T21:16:12.980 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:12.980 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:12.980 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 2, 2023-10-05T21:16:12.980 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 2 2023-10-05T21:16:12.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:12.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.980 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "put_obj", 2023-10-05T21:16:12.980 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:12.980 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 30000042, 2023-10-05T21:16:12.980 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 11, 2023-10-05T21:16:12.981 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 11 2023-10-05T21:16:12.981 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:12.981 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:12.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:12.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.981 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo2", 2023-10-05T21:16:12.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:12.981 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:12.981 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:12.981 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [ 2023-10-05T21:16:12.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.981 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "create_bucket", 2023-10-05T21:16:12.982 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:12.982 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:12.982 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:12.982 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:12.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:12.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.982 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "delete_bucket", 2023-10-05T21:16:12.982 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:12.982 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:12.982 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:12.982 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:12.982 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:12.983 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:12.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:12.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.983 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo3", 2023-10-05T21:16:12.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:12.983 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:12.983 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:12.983 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [ 2023-10-05T21:16:12.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.983 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "create_bucket", 2023-10-05T21:16:12.983 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:12.983 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:12.984 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:12.984 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:12.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:12.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.984 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "delete_bucket", 2023-10-05T21:16:12.984 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:12.984 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:12.984 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:12.984 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:12.984 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:12.984 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:12.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:12.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.985 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo4", 2023-10-05T21:16:12.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:12.985 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:12.985 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:12.985 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [ 2023-10-05T21:16:12.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.985 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "create_bucket", 2023-10-05T21:16:12.985 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:12.985 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:12.985 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:12.985 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:12.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:12.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.986 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "delete_bucket", 2023-10-05T21:16:12.986 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:12.986 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:12.986 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:12.986 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:12.986 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:12.986 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:12.986 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:12.986 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:12.986 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:12.987 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:16:12.987 INFO:teuthology.orchestra.run.smithi153.stdout: "summary": [ 2023-10-05T21:16:12.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.987 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "anonymous", 2023-10-05T21:16:12.987 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [ 2023-10-05T21:16:12.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.987 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "list_buckets", 2023-10-05T21:16:12.987 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 231, 2023-10-05T21:16:12.987 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:12.987 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:12.987 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:12.987 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:12.988 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:16:12.988 INFO:teuthology.orchestra.run.smithi153.stdout: "total": { 2023-10-05T21:16:12.988 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 231, 2023-10-05T21:16:12.988 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:12.988 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:12.988 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:12.988 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:12.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:12.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.988 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:16:12.988 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [ 2023-10-05T21:16:12.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.988 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "create_bucket", 2023-10-05T21:16:12.989 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:12.989 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:12.989 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 8, 2023-10-05T21:16:12.989 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 8 2023-10-05T21:16:12.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:12.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.989 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "delete_bucket", 2023-10-05T21:16:12.989 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 217, 2023-10-05T21:16:12.989 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:12.989 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 5, 2023-10-05T21:16:12.989 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 4 2023-10-05T21:16:12.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:12.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.990 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "delete_obj", 2023-10-05T21:16:12.990 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:12.990 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:12.990 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 4, 2023-10-05T21:16:12.990 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 4 2023-10-05T21:16:12.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:12.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.990 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "get_acls", 2023-10-05T21:16:12.990 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 1026, 2023-10-05T21:16:12.990 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:12.990 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 2, 2023-10-05T21:16:12.991 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 2 2023-10-05T21:16:12.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:12.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:12.991 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "get_obj", 2023-10-05T21:16:12.991 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 4, 2023-10-05T21:16:12.991 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:12.991 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:12.991 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:12.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:12.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.946+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:134 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94159217270208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bac500 con 0x7fc4b8018b30 2023-10-05T21:16:12.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.947+0000 7fc4c1767700 1 -- 172.21.15.153:0/2744247978 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(134 notify.0 [watch unwatch cookie 94159217270208] v31'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4b4034040 con 0x7fc4b8018b30 2023-10-05T21:16:12.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.947+0000 7fc4cee90680 20 remove_watcher() i=0 2023-10-05T21:16:12.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.947+0000 7fc4cee90680 2 removed watcher, disabling cache 2023-10-05T21:16:12.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.947+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:135 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94159217273440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bac500 con 0x55a326af2790 2023-10-05T21:16:12.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.948+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 45 ==== osd_op_reply(135 notify.1 [watch unwatch cookie 94159217273440] v31'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.948+0000 7fc4cee90680 20 remove_watcher() i=1 2023-10-05T21:16:12.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.948+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:136 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94159217278496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bac500 con 0x55a326b22eb0 2023-10-05T21:16:12.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.948+0000 7fc4c1f68700 1 -- 172.21.15.153:0/2744247978 <== osd.3 v2:172.21.15.153:6800/140455 38 ==== osd_op_reply(136 notify.2 [watch unwatch cookie 94159217278496] v31'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4b8023580 con 0x55a326b22eb0 2023-10-05T21:16:12.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.948+0000 7fc4cee90680 20 remove_watcher() i=2 2023-10-05T21:16:12.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.949+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94159217283088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bac500 con 0x7fc4b8018b30 2023-10-05T21:16:12.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.949+0000 7fc4c1767700 1 -- 172.21.15.153:0/2744247978 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== osd_op_reply(137 notify.3 [watch unwatch cookie 94159217283088] v31'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4b4034040 con 0x7fc4b8018b30 2023-10-05T21:16:12.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.949+0000 7fc4cee90680 20 remove_watcher() i=3 2023-10-05T21:16:12.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.949+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:138 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94159217286608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bac500 con 0x55a326af2790 2023-10-05T21:16:12.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.950+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 46 ==== osd_op_reply(138 notify.4 [watch unwatch cookie 94159217286608] v31'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.950+0000 7fc4cee90680 20 remove_watcher() i=4 2023-10-05T21:16:12.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.950+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:139 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94159217290288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bac500 con 0x7fc4b4007030 2023-10-05T21:16:12.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.951+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 34 ==== osd_op_reply(139 notify.5 [watch unwatch cookie 94159217290288] v31'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.951+0000 7fc4cee90680 20 remove_watcher() i=5 2023-10-05T21:16:12.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.951+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:140 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94159217293840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bac500 con 0x7fc4b4007030 2023-10-05T21:16:12.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.952+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 35 ==== osd_op_reply(140 notify.6 [watch unwatch cookie 94159217293840] v31'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.952+0000 7fc4cee90680 20 remove_watcher() i=6 2023-10-05T21:16:12.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.952+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:141 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94159217295456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bac500 con 0x7fc4b4007030 2023-10-05T21:16:12.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.953+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.0 v2:172.21.15.111:6800/111394 36 ==== osd_op_reply(141 notify.7 [watch unwatch cookie 94159217295456] v31'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x7fc4b4007030 2023-10-05T21:16:12.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.953+0000 7fc4cee90680 20 remove_watcher() i=7 2023-10-05T21:16:12.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.953+0000 7fc4937de700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:16:12.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.953+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:142 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94159217292496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a326bac500 con 0x55a326af2790 2023-10-05T21:16:12.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.954+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 <== osd.1 v2:172.21.15.153:6816/140456 47 ==== osd_op_reply(142 data_loggenerations_metadata [watch unwatch cookie 94159217292496] v31'220 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc4bc00a570 con 0x55a326af2790 2023-10-05T21:16:12.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.954+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc4b4007030 msgr2=0x7fc4b401d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:12.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.954+0000 7fc4cee90680 1 --2- 172.21.15.153:0/2744247978 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fc4b4007030 0x7fc4b401d420 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:12.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.954+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55a326af2790 msgr2=0x55a326b20a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:12.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.954+0000 7fc4cee90680 1 --2- 172.21.15.153:0/2744247978 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55a326af2790 0x55a326b20a90 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:12.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.954+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc4b8018b30 msgr2=0x7fc4b80169a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:12.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.954+0000 7fc4cee90680 1 --2- 172.21.15.153:0/2744247978 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fc4b8018b30 0x7fc4b80169a0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:12.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.954+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55a326b22eb0 msgr2=0x55a326b25290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:12.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.954+0000 7fc4cee90680 1 --2- 172.21.15.153:0/2744247978 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55a326b22eb0 0x55a326b25290 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:12.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.954+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc4a4034140 msgr2=0x7fc4a40365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:12.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.954+0000 7fc4cee90680 1 --2- 172.21.15.153:0/2744247978 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc4a4034140 0x7fc4a40365f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4003080 tx=0x7fc4b4015000 comp rx=0 tx=0).stop 2023-10-05T21:16:12.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.954+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326a62910 msgr2=0x55a326b14cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:12.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.954+0000 7fc4c2769700 1 -- 172.21.15.153:0/2744247978 reap_dead start 2023-10-05T21:16:12.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.954+0000 7fc4cee90680 1 --2- 172.21.15.153:0/2744247978 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326a62910 0x55a326b14cc0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8004150 tx=0x7fc4b8016000 comp rx=0 tx=0).stop 2023-10-05T21:16:12.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.954+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 shutdown_connections 2023-10-05T21:16:12.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.954+0000 7fc4cee90680 1 --2- 172.21.15.153:0/2744247978 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326a62910 0x55a326b14cc0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:12.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.954+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 >> 172.21.15.153:0/2744247978 conn(0x55a326ae8b60 msgr2=0x55a326b07ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:12.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.955+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 shutdown_connections 2023-10-05T21:16:13.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.955+0000 7fc4cee90680 1 -- 172.21.15.153:0/2744247978 wait complete. 2023-10-05T21:16:13.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.955+0000 7fc4cee90680 1 -- 172.21.15.153:0/1948774438 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc4080340f0 msgr2=0x7fc4080365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.955+0000 7fc4cee90680 1 --2- 172.21.15.153:0/1948774438 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc4080340f0 0x7fc4080365a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x55a326b30860 tx=0x7fc4bc00af30 comp rx=0 tx=0).stop 2023-10-05T21:16:13.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.955+0000 7fc4cee90680 1 -- 172.21.15.153:0/1948774438 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326b3e3c0 msgr2=0x55a326aee9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.955+0000 7fc4cee90680 1 --2- 172.21.15.153:0/1948774438 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326b3e3c0 0x55a326aee9f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4039040 tx=0x7fc4b4031000 comp rx=0 tx=0).stop 2023-10-05T21:16:13.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.955+0000 7fc4cee90680 1 -- 172.21.15.153:0/1948774438 shutdown_connections 2023-10-05T21:16:13.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.955+0000 7fc4cee90680 1 --2- 172.21.15.153:0/1948774438 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fc4080340f0 0x7fc4080365a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.955+0000 7fc4cee90680 1 --2- 172.21.15.153:0/1948774438 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a326b3e3c0 0x55a326aee9f0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.955+0000 7fc4cee90680 1 -- 172.21.15.153:0/1948774438 >> 172.21.15.153:0/1948774438 conn(0x55a326b395c0 msgr2=0x55a326b376f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.955+0000 7fc4cee90680 1 -- 172.21.15.153:0/1948774438 shutdown_connections 2023-10-05T21:16:13.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:12.955+0000 7fc4cee90680 1 -- 172.21.15.153:0/1948774438 wait complete. 2023-10-05T21:16:13.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.001 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "list_bucket", 2023-10-05T21:16:13.001 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 515, 2023-10-05T21:16:13.001 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.002 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:13.002 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:13.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.002 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "list_buckets", 2023-10-05T21:16:13.002 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 322, 2023-10-05T21:16:13.002 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.002 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:13.002 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:13.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.002 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "put_acls", 2023-10-05T21:16:13.003 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:13.003 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.003 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 2, 2023-10-05T21:16:13.003 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 2 2023-10-05T21:16:13.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.003 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "put_obj", 2023-10-05T21:16:13.003 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:13.003 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 30000042, 2023-10-05T21:16:13.003 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 11, 2023-10-05T21:16:13.003 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 11 2023-10-05T21:16:13.003 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.004 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:16:13.004 INFO:teuthology.orchestra.run.smithi153.stdout: "total": { 2023-10-05T21:16:13.004 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 2084, 2023-10-05T21:16:13.004 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 30000042, 2023-10-05T21:16:13.004 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 35, 2023-10-05T21:16:13.004 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 34 2023-10-05T21:16:13.004 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.004 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.004 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:13.004 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:16:13.005 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 231, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 217, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 231, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 231, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 217, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2084, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2023-10-05T21:16:13.005 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2023-10-05T21:16:13.005 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2023-10-05T21:16:13.005 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2023-10-05T21:16:13.087 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:16:13.087 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:16:13.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.086+0000 7f9a1a905680 1 Processor -- start 2023-10-05T21:16:13.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.086+0000 7f9a1a905680 1 -- start start 2023-10-05T21:16:13.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.086+0000 7f9a1a905680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5561be3827b0 0x5561be384b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.086+0000 7f9a1a905680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5561be2cb990 con 0x5561be2f20a0 2023-10-05T21:16:13.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.086+0000 7f9a1a905680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x5561be28bdb0 con 0x5561be3827b0 2023-10-05T21:16:13.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.086+0000 7f9a0d9dd700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x5561be2f20a0 0x5561be381090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:57784/0 (socket says 172.21.15.153:57784) 2023-10-05T21:16:13.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.086+0000 7f9a0d1dc700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5561be3827b0 0x5561be384b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.086+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/1389703303 learned_addr learned my addr 172.21.15.153:0/1389703303 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:16:13.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.087+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/1389703303 >> v1:172.21.15.111:6789/0 conn(0x5561be2f20a0 legacy=0x5561be381090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.087+0000 7f9a0c9db700 1 -- 172.21.15.153:0/1389703303 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1842670310 0 0) 0x5561be2cb990 con 0x5561be2f20a0 2023-10-05T21:16:13.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.087+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/1389703303 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561be3861e0 con 0x5561be3827b0 2023-10-05T21:16:13.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.087+0000 7f9a0d1dc700 1 --2- 172.21.15.153:0/1389703303 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5561be3827b0 0x5561be384b90 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400a5d0 tx=0x7f9a04005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9dc23a20009104 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.087+0000 7f9a0c9db700 1 -- 172.21.15.153:0/1389703303 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a040086a0 con 0x5561be3827b0 2023-10-05T21:16:13.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.087+0000 7f9a0c9db700 1 -- 172.21.15.153:0/1389703303 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a04008800 con 0x5561be3827b0 2023-10-05T21:16:13.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.087+0000 7f9a0c9db700 1 -- 172.21.15.153:0/1389703303 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a04008ad0 con 0x5561be3827b0 2023-10-05T21:16:13.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.088+0000 7f9a1a905680 1 -- 172.21.15.153:0/1389703303 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5561be3827b0 msgr2=0x5561be384b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.088+0000 7f9a1a905680 1 --2- 172.21.15.153:0/1389703303 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5561be3827b0 0x5561be384b90 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400a5d0 tx=0x7f9a04005a50 comp rx=0 tx=0).stop 2023-10-05T21:16:13.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.088+0000 7f9a1a905680 1 -- 172.21.15.153:0/1389703303 shutdown_connections 2023-10-05T21:16:13.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.088+0000 7f9a1a905680 1 --2- 172.21.15.153:0/1389703303 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5561be3827b0 0x5561be384b90 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.088+0000 7f9a1a905680 1 -- 172.21.15.153:0/1389703303 >> 172.21.15.153:0/1389703303 conn(0x5561be378b80 msgr2=0x5561be37af90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.088+0000 7f9a1a905680 1 -- 172.21.15.153:0/1389703303 shutdown_connections 2023-10-05T21:16:13.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.088+0000 7f9a1a905680 1 -- 172.21.15.153:0/1389703303 wait complete. 2023-10-05T21:16:13.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.088+0000 7f9a1a905680 1 Processor -- start 2023-10-05T21:16:13.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.088+0000 7f9a1a905680 1 -- start start 2023-10-05T21:16:13.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.089+0000 7f9a1a905680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5561be2f20a0 0x5561be39d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.089+0000 7f9a1a905680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561be22bea0 con 0x5561be2f20a0 2023-10-05T21:16:13.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.089+0000 7f9a0d9dd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5561be2f20a0 0x5561be39d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.089+0000 7f9a0d9dd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5561be2f20a0 0x5561be39d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54772/0 (socket says 172.21.15.153:54772) 2023-10-05T21:16:13.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.089+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/3141261056 learned_addr learned my addr 172.21.15.153:0/3141261056 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:13.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.089+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/3141261056 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a04005cf0 con 0x5561be2f20a0 2023-10-05T21:16:13.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.089+0000 7f9a0d9dd700 1 --2- 172.21.15.153:0/3141261056 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5561be2f20a0 0x5561be39d710 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9a00001d70 tx=0x7f9a00001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ebeef7c97c09f83 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.089+0000 7f99ff7fe700 1 -- 172.21.15.153:0/3141261056 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a0000bcc0 con 0x5561be2f20a0 2023-10-05T21:16:13.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.089+0000 7f99ff7fe700 1 -- 172.21.15.153:0/3141261056 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0000be20 con 0x5561be2f20a0 2023-10-05T21:16:13.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.089+0000 7f99ff7fe700 1 -- 172.21.15.153:0/3141261056 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a0000e5f0 con 0x5561be2f20a0 2023-10-05T21:16:13.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.090+0000 7f9a1a905680 1 -- 172.21.15.153:0/3141261056 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5561be2f20a0 msgr2=0x5561be39d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.090+0000 7f9a1a905680 1 --2- 172.21.15.153:0/3141261056 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5561be2f20a0 0x5561be39d710 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9a00001d70 tx=0x7f9a00001770 comp rx=0 tx=0).stop 2023-10-05T21:16:13.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.090+0000 7f9a1a905680 1 -- 172.21.15.153:0/3141261056 shutdown_connections 2023-10-05T21:16:13.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.090+0000 7f9a1a905680 1 --2- 172.21.15.153:0/3141261056 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5561be2f20a0 0x5561be39d710 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.090+0000 7f9a1a905680 1 -- 172.21.15.153:0/3141261056 >> 172.21.15.153:0/3141261056 conn(0x5561be378b80 msgr2=0x5561be3991e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.090+0000 7f9a1a905680 1 -- 172.21.15.153:0/3141261056 shutdown_connections 2023-10-05T21:16:13.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.090+0000 7f9a1a905680 1 -- 172.21.15.153:0/3141261056 wait complete. 2023-10-05T21:16:13.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.090+0000 7f9a1a905680 1 Processor -- start 2023-10-05T21:16:13.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.090+0000 7f9a1a905680 1 -- start start 2023-10-05T21:16:13.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.090+0000 7f9a1a905680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5561be2f20a0 0x5561be37e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.090+0000 7f9a1a905680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561be222c80 con 0x5561be2f20a0 2023-10-05T21:16:13.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.091+0000 7f9a0d9dd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5561be2f20a0 0x5561be37e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.091+0000 7f9a0d9dd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5561be2f20a0 0x5561be37e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54776/0 (socket says 172.21.15.153:54776) 2023-10-05T21:16:13.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.091+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 learned_addr learned my addr 172.21.15.153:0/2733204964 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:13.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.091+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a00001a50 con 0x5561be2f20a0 2023-10-05T21:16:13.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.091+0000 7f9a0d9dd700 1 --2- 172.21.15.153:0/2733204964 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5561be2f20a0 0x5561be37e9f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f9a0000c010 tx=0x7f9a00016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.091+0000 7f99fdffb700 1 -- 172.21.15.153:0/2733204964 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a0001f070 con 0x5561be2f20a0 2023-10-05T21:16:13.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.091+0000 7f99fdffb700 1 -- 172.21.15.153:0/2733204964 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0001a550 con 0x5561be2f20a0 2023-10-05T21:16:13.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.091+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5561be37d010 con 0x5561be2f20a0 2023-10-05T21:16:13.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.091+0000 7f99fdffb700 1 -- 172.21.15.153:0/2733204964 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a0001a840 con 0x5561be2f20a0 2023-10-05T21:16:13.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.091+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5561be37d400 con 0x5561be2f20a0 2023-10-05T21:16:13.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.092+0000 7f9a1a905680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.092+0000 7f99fdffb700 1 -- 172.21.15.153:0/2733204964 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f9a0001a9a0 con 0x5561be2f20a0 2023-10-05T21:16:13.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.092+0000 7f99fdffb700 1 --2- 172.21.15.153:0/2733204964 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f99f00340f0 0x7f99f00365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.093+0000 7f99fdffb700 1 -- 172.21.15.153:0/2733204964 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f9a00048c70 con 0x5561be2f20a0 2023-10-05T21:16:13.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.093+0000 7f9a0d1dc700 1 --2- 172.21.15.153:0/2733204964 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f99f00340f0 0x7f99f00365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.093+0000 7f9a1a905680 1 --2- 172.21.15.153:0/2733204964 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5561be3827b0 0x5561be3b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.093+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b3300 con 0x5561be3827b0 2023-10-05T21:16:13.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.093+0000 7f9a0e1de700 1 --2- 172.21.15.153:0/2733204964 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5561be3827b0 0x5561be3b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.093+0000 7f9a0d1dc700 1 --2- 172.21.15.153:0/2733204964 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f99f00340f0 0x7f99f00365a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9a04003080 tx=0x7f9a04015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.093+0000 7f9a0e1de700 1 --2- 172.21.15.153:0/2733204964 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5561be3827b0 0x5561be3b2b70 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.093+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.093+0000 7f9a1a905680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.093+0000 7f9a1a905680 20 realm 2023-10-05T21:16:13.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.093+0000 7f9a1a905680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.093+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b0100 con 0x5561be3827b0 2023-10-05T21:16:13.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.094+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.094+0000 7f9a1a905680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.094+0000 7f9a1a905680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:16:13.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.094+0000 7f9a1a905680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.094+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b3db0 con 0x5561be3827b0 2023-10-05T21:16:13.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.094+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.094+0000 7f9a1a905680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.094+0000 7f9a1a905680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.094+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b46d0 con 0x5561be3827b0 2023-10-05T21:16:13.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.094+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.094+0000 7f9a1a905680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:13.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.094+0000 7f9a1a905680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.094+0000 7f9a1a905680 1 --2- 172.21.15.153:0/2733204964 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5561be3b4f90 0x5561be3b7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.094+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b7940 con 0x5561be3b4f90 2023-10-05T21:16:13.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.094+0000 7f9a0d9dd700 1 --2- 172.21.15.153:0/2733204964 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5561be3b4f90 0x5561be3b7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.094+0000 7f9a0d9dd700 1 --2- 172.21.15.153:0/2733204964 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5561be3b4f90 0x5561be3b7370 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.095+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f9a00014070 con 0x5561be3b4f90 2023-10-05T21:16:13.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.095+0000 7f9a1a905680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:16:13.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.095+0000 7f9a1a905680 20 searching for the correct realm 2023-10-05T21:16:13.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.095+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x5561be3b4f90 2023-10-05T21:16:13.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.095+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a00014070 con 0x5561be3b4f90 2023-10-05T21:16:13.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.095+0000 7f9a0d9dd700 1 --2- 172.21.15.153:0/2733204964 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f9a0000d750 0x7f9a00048380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.095+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x7f9a0000d750 2023-10-05T21:16:13.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.095+0000 7f9a0d1dc700 1 --2- 172.21.15.153:0/2733204964 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f9a0000d750 0x7f9a00048380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.095+0000 7f9a0d1dc700 1 --2- 172.21.15.153:0/2733204964 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f9a0000d750 0x7f9a00048380 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.096+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/2733204964 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a04019040 con 0x7f9a0000d750 2023-10-05T21:16:13.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.096+0000 7f9a0d1dc700 1 --2- 172.21.15.153:0/2733204964 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f9a04007030 0x7f9a0401d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.096+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x7f9a04007030 2023-10-05T21:16:13.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.096+0000 7f9a0e1de700 1 --2- 172.21.15.153:0/2733204964 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f9a04007030 0x7f9a0401d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.096+0000 7f9a0e1de700 1 --2- 172.21.15.153:0/2733204964 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f9a04007030 0x7f9a0401d420 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.096+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0800a570 con 0x7f9a04007030 2023-10-05T21:16:13.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.096+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x5561be3827b0 2023-10-05T21:16:13.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.097+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.097+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x5561be3827b0 2023-10-05T21:16:13.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.097+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.097+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x7f9a04007030 2023-10-05T21:16:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.097+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0800a570 con 0x7f9a04007030 2023-10-05T21:16:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.097+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x7f9a04007030 2023-10-05T21:16:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.097+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0800a570 con 0x7f9a04007030 2023-10-05T21:16:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.097+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x7f9a0000d750 2023-10-05T21:16:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.098+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/2733204964 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a04019040 con 0x7f9a0000d750 2023-10-05T21:16:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.098+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x5561be3b4f90 2023-10-05T21:16:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.098+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9a00014070 con 0x5561be3b4f90 2023-10-05T21:16:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.098+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x5561be3827b0 2023-10-05T21:16:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.098+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.098+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x7f9a04007030 2023-10-05T21:16:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.098+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0800a570 con 0x7f9a04007030 2023-10-05T21:16:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.098+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x5561be3827b0 2023-10-05T21:16:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.098+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.098+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x7f9a0000d750 2023-10-05T21:16:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.099+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/2733204964 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a04019040 con 0x7f9a0000d750 2023-10-05T21:16:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.099+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x5561be3b4f90 2023-10-05T21:16:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.099+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a00014070 con 0x5561be3b4f90 2023-10-05T21:16:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.099+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x5561be3b4f90 2023-10-05T21:16:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.099+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a00014070 con 0x5561be3b4f90 2023-10-05T21:16:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.099+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x7f9a04007030 2023-10-05T21:16:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.099+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0800a570 con 0x7f9a04007030 2023-10-05T21:16:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.099+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x5561be3b4f90 2023-10-05T21:16:13.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.100+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a00014070 con 0x5561be3b4f90 2023-10-05T21:16:13.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.100+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x5561be3b4f90 2023-10-05T21:16:13.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.100+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a00014070 con 0x5561be3b4f90 2023-10-05T21:16:13.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.100+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x5561be3827b0 2023-10-05T21:16:13.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.100+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.100+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x5561be3827b0 2023-10-05T21:16:13.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.100+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.100+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x7f9a04007030 2023-10-05T21:16:13.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.101+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0800a570 con 0x7f9a04007030 2023-10-05T21:16:13.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.101+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x5561be3b4f90 2023-10-05T21:16:13.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.101+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a00014070 con 0x5561be3b4f90 2023-10-05T21:16:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.101+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x7f9a0000d750 2023-10-05T21:16:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.101+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/2733204964 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a04019040 con 0x7f9a0000d750 2023-10-05T21:16:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.101+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x5561be3827b0 2023-10-05T21:16:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.101+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.101+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x7f9a04007030 2023-10-05T21:16:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.102+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0800a570 con 0x7f9a04007030 2023-10-05T21:16:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.102+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x5561be3b4f90 2023-10-05T21:16:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.102+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a00014070 con 0x5561be3b4f90 2023-10-05T21:16:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.102+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x7f9a04007030 2023-10-05T21:16:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.102+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0800a570 con 0x7f9a04007030 2023-10-05T21:16:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.102+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x7f9a0000d750 2023-10-05T21:16:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.102+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/2733204964 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a04019040 con 0x7f9a0000d750 2023-10-05T21:16:13.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.102+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x5561be3b4f90 2023-10-05T21:16:13.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.103+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a00014070 con 0x5561be3b4f90 2023-10-05T21:16:13.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.103+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x7f9a04007030 2023-10-05T21:16:13.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.103+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0800a570 con 0x7f9a04007030 2023-10-05T21:16:13.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.103+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x5561be3827b0 2023-10-05T21:16:13.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.103+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.103+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9260 con 0x7f9a0000d750 2023-10-05T21:16:13.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.103+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/2733204964 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a04019040 con 0x7f9a0000d750 2023-10-05T21:16:13.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.103+0000 7f9a1a905680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:16:13.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.103+0000 7f9a1a905680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:16:13.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.103+0000 7f9a1a905680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:16:13.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.103+0000 7f9a1a905680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:16:13.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.103+0000 7f9a1a905680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.103+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b8480 con 0x5561be3827b0 2023-10-05T21:16:13.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.104+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.104+0000 7f9a1a905680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.104+0000 7f9a1a905680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.104+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b88b0 con 0x5561be3827b0 2023-10-05T21:16:13.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.104+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.104+0000 7f9a1a905680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:13.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.104+0000 7f9a1a905680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.104+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b8ce0 con 0x5561be3827b0 2023-10-05T21:16:13.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.104+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.104+0000 7f9a1a905680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:16:13.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.104+0000 7f9a1a905680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.104+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b7fe0 con 0x5561be3b4f90 2023-10-05T21:16:13.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.104+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f9a00014070 con 0x5561be3b4f90 2023-10-05T21:16:13.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.104+0000 7f9a1a905680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.104+0000 7f9a1a905680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.104+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9b00 con 0x5561be3827b0 2023-10-05T21:16:13.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.105+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.105+0000 7f9a1a905680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.105+0000 7f9a1a905680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.105+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9bf0 con 0x5561be3827b0 2023-10-05T21:16:13.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.105+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.105+0000 7f9a1a905680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:13.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.105+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9bc0 con 0x5561be3b4f90 2023-10-05T21:16:13.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.105+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a00014070 con 0x5561be3b4f90 2023-10-05T21:16:13.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.105+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9bc0 con 0x7f9a0000d750 2023-10-05T21:16:13.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.105+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/2733204964 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a04019040 con 0x7f9a0000d750 2023-10-05T21:16:13.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.105+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9bc0 con 0x7f9a04007030 2023-10-05T21:16:13.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.106+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0800a570 con 0x7f9a04007030 2023-10-05T21:16:13.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.106+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b8ce0 con 0x5561be3827b0 2023-10-05T21:16:13.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.106+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.106+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b8ce0 con 0x5561be3827b0 2023-10-05T21:16:13.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.106+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.106+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b8ce0 con 0x7f9a04007030 2023-10-05T21:16:13.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.106+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0800a570 con 0x7f9a04007030 2023-10-05T21:16:13.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.106+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b8ce0 con 0x7f9a04007030 2023-10-05T21:16:13.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.107+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0800a570 con 0x7f9a04007030 2023-10-05T21:16:13.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.107+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b8ce0 con 0x7f9a0000d750 2023-10-05T21:16:13.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.107+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/2733204964 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a04019040 con 0x7f9a0000d750 2023-10-05T21:16:13.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.107+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b8ce0 con 0x5561be3b4f90 2023-10-05T21:16:13.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.107+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9a00014070 con 0x5561be3b4f90 2023-10-05T21:16:13.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.107+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b8ce0 con 0x5561be3827b0 2023-10-05T21:16:13.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.107+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.107+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b8ce0 con 0x7f9a04007030 2023-10-05T21:16:13.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.107+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0800a570 con 0x7f9a04007030 2023-10-05T21:16:13.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.107+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b8ce0 con 0x5561be3827b0 2023-10-05T21:16:13.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.108+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.108+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b8ce0 con 0x7f9a0000d750 2023-10-05T21:16:13.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.108+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/2733204964 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a04019040 con 0x7f9a0000d750 2023-10-05T21:16:13.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.108+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b8ce0 con 0x5561be3b4f90 2023-10-05T21:16:13.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.108+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a00014070 con 0x5561be3b4f90 2023-10-05T21:16:13.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.108+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b8ce0 con 0x5561be3b4f90 2023-10-05T21:16:13.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.108+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a00014070 con 0x5561be3b4f90 2023-10-05T21:16:13.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.108+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b8ce0 con 0x7f9a04007030 2023-10-05T21:16:13.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.109+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0800a570 con 0x7f9a04007030 2023-10-05T21:16:13.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.109+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b8ce0 con 0x5561be3b4f90 2023-10-05T21:16:13.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.109+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a00014070 con 0x5561be3b4f90 2023-10-05T21:16:13.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.109+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b8ce0 con 0x5561be3b4f90 2023-10-05T21:16:13.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.109+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a00014070 con 0x5561be3b4f90 2023-10-05T21:16:13.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.109+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b8ce0 con 0x5561be3827b0 2023-10-05T21:16:13.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.109+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.109+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b8ce0 con 0x5561be3827b0 2023-10-05T21:16:13.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.109+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.109+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b8ce0 con 0x7f9a04007030 2023-10-05T21:16:13.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.110+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0800a570 con 0x7f9a04007030 2023-10-05T21:16:13.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.110+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b8ce0 con 0x5561be3b4f90 2023-10-05T21:16:13.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.110+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a00014070 con 0x5561be3b4f90 2023-10-05T21:16:13.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.110+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b8ce0 con 0x7f9a0000d750 2023-10-05T21:16:13.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.110+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/2733204964 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a04019040 con 0x7f9a0000d750 2023-10-05T21:16:13.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.110+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b8ce0 con 0x5561be3827b0 2023-10-05T21:16:13.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.110+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.110+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b8ce0 con 0x7f9a04007030 2023-10-05T21:16:13.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.111+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0800a570 con 0x7f9a04007030 2023-10-05T21:16:13.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.111+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b8ce0 con 0x5561be3b4f90 2023-10-05T21:16:13.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.111+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a00014070 con 0x5561be3b4f90 2023-10-05T21:16:13.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.111+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b8ce0 con 0x7f9a04007030 2023-10-05T21:16:13.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.111+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0800a570 con 0x7f9a04007030 2023-10-05T21:16:13.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.111+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b8ce0 con 0x7f9a0000d750 2023-10-05T21:16:13.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.112+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/2733204964 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a04019040 con 0x7f9a0000d750 2023-10-05T21:16:13.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.112+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b8ce0 con 0x5561be3b4f90 2023-10-05T21:16:13.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.112+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a00014070 con 0x5561be3b4f90 2023-10-05T21:16:13.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.112+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b8ce0 con 0x7f9a04007030 2023-10-05T21:16:13.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.112+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0800a570 con 0x7f9a04007030 2023-10-05T21:16:13.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.112+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b8ce0 con 0x5561be3827b0 2023-10-05T21:16:13.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.112+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.112+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b8ce0 con 0x7f9a0000d750 2023-10-05T21:16:13.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.113+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/2733204964 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a04019040 con 0x7f9a0000d750 2023-10-05T21:16:13.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.113+0000 7f9a1a905680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:16:13.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.113+0000 7f9a1a905680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:16:13.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.113+0000 7f9a1a905680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:16:13.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.113+0000 7f9a1a905680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:16:13.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.113+0000 7f9a1a905680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.113+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3b9bc0 con 0x5561be3827b0 2023-10-05T21:16:13.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.113+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.113+0000 7f9a1a905680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:13.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.113+0000 7f9a1a905680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.113+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3ba020 con 0x5561be3b4f90 2023-10-05T21:16:13.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.113+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f9a00014070 con 0x5561be3b4f90 2023-10-05T21:16:13.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.113+0000 7f9a1a905680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:16:13.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.113+0000 7f9a1a905680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.113+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3ba910 con 0x5561be3827b0 2023-10-05T21:16:13.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.113+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.113+0000 7f9a1a905680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:13.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.113+0000 7f9a1a905680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.113+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3ba910 con 0x5561be3827b0 2023-10-05T21:16:13.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.114+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.114+0000 7f9a1a905680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:16:13.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.114+0000 7f9a1a905680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.114+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3ba910 con 0x7f9a04007030 2023-10-05T21:16:13.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.114+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f9a0800a570 con 0x7f9a04007030 2023-10-05T21:16:13.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.114+0000 7f9a1a905680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.114+0000 7f9a1a905680 20 zone default found 2023-10-05T21:16:13.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.114+0000 7f9a1a905680 4 Realm: () 2023-10-05T21:16:13.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.114+0000 7f9a1a905680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:16:13.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.114+0000 7f9a1a905680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:16:13.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.114+0000 7f9a1a905680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:16:13.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.114+0000 7f9a1a905680 20 zonegroup default 2023-10-05T21:16:13.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.114+0000 7f9a1a905680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.114+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3ba910 con 0x7f9a04007030 2023-10-05T21:16:13.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.114+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f9a0800a570 con 0x7f9a04007030 2023-10-05T21:16:13.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.114+0000 7f9a1a905680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.114+0000 7f9a1a905680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.114+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3bc580 con 0x5561be3b4f90 2023-10-05T21:16:13.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.115+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9a00014070 con 0x5561be3b4f90 2023-10-05T21:16:13.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.115+0000 7f9a1a905680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.115+0000 7f9a1a905680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.115+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3bc930 con 0x5561be3b4f90 2023-10-05T21:16:13.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.115+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9a00014070 con 0x5561be3b4f90 2023-10-05T21:16:13.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.115+0000 7f9a1a905680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.115+0000 7f9a1a905680 20 started sync module instance, tier type = 2023-10-05T21:16:13.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.115+0000 7f9a1a905680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:16:13.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.115+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3bbc40 con 0x7f9a0000d750 2023-10-05T21:16:13.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.116+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/2733204964 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v31'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a04019040 con 0x7f9a0000d750 2023-10-05T21:16:13.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.116+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93878291773264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3bcce0 con 0x7f9a0000d750 2023-10-05T21:16:13.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.116+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3bd620 con 0x5561be3827b0 2023-10-05T21:16:13.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.117+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/2733204964 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 93878291773264] v31'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a04019040 con 0x7f9a0000d750 2023-10-05T21:16:13.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.117+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v31'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.117+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93878291779728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3bda20 con 0x5561be3827b0 2023-10-05T21:16:13.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.117+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3be430 con 0x5561be3b4f90 2023-10-05T21:16:13.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.118+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v31'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a00014070 con 0x5561be3b4f90 2023-10-05T21:16:13.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.118+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93878291783488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3bed20 con 0x5561be3b4f90 2023-10-05T21:16:13.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.118+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 93878291779728] v31'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.118+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3bc060 con 0x7f9a0000d750 2023-10-05T21:16:13.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.119+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/2733204964 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v31'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a04019040 con 0x7f9a0000d750 2023-10-05T21:16:13.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.119+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 93878291783488] v31'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a00014070 con 0x5561be3b4f90 2023-10-05T21:16:13.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.119+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 93878291788352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3bfcd0 con 0x7f9a0000d750 2023-10-05T21:16:13.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.119+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3c0360 con 0x5561be3827b0 2023-10-05T21:16:13.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.119+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/2733204964 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 93878291788352] v31'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a04019040 con 0x7f9a0000d750 2023-10-05T21:16:13.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.119+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v31'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.119+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 93878291785776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3c0760 con 0x5561be3827b0 2023-10-05T21:16:13.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.119+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3c1170 con 0x7f9a04007030 2023-10-05T21:16:13.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.120+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 93878291785776] v31'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.120+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v31'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a0800a570 con 0x7f9a04007030 2023-10-05T21:16:13.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.120+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 93878291789600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3c1170 con 0x7f9a04007030 2023-10-05T21:16:13.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.120+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3c1bd0 con 0x7f9a04007030 2023-10-05T21:16:13.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.121+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(96 notify.6 [create] v31'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a0800a570 con 0x7f9a04007030 2023-10-05T21:16:13.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.121+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(95 notify.5 [watch watch cookie 93878291789600] v31'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a0800a570 con 0x7f9a04007030 2023-10-05T21:16:13.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.121+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93878291797728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3c1b30 con 0x7f9a04007030 2023-10-05T21:16:13.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.121+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3c1b30 con 0x7f9a04007030 2023-10-05T21:16:13.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.122+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 93878291797728] v31'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a0800a570 con 0x7f9a04007030 2023-10-05T21:16:13.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.122+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v31'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a0800a570 con 0x7f9a04007030 2023-10-05T21:16:13.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.122+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93878291795072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3c2600 con 0x7f9a04007030 2023-10-05T21:16:13.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.122+0000 7f9a1a905680 20 add_watcher() i=0 2023-10-05T21:16:13.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.122+0000 7f9a1a905680 20 add_watcher() i=1 2023-10-05T21:16:13.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.122+0000 7f9a1a905680 20 add_watcher() i=2 2023-10-05T21:16:13.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.122+0000 7f9a1a905680 20 add_watcher() i=3 2023-10-05T21:16:13.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.122+0000 7f9a1a905680 20 add_watcher() i=4 2023-10-05T21:16:13.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.122+0000 7f9a1a905680 20 add_watcher() i=5 2023-10-05T21:16:13.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.122+0000 7f9a1a905680 20 add_watcher() i=6 2023-10-05T21:16:13.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.123+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 93878291795072] v31'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a0800a570 con 0x7f9a04007030 2023-10-05T21:16:13.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.123+0000 7f9a1a905680 20 add_watcher() i=7 2023-10-05T21:16:13.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.123+0000 7f9a1a905680 2 all 8 watchers are set, enabling cache 2023-10-05T21:16:13.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.123+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3c5a10 con 0x5561be3827b0 2023-10-05T21:16:13.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.123+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.123+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93878291800800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3c2ed0 con 0x5561be3827b0 2023-10-05T21:16:13.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.124+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 93878291800800] v31'221 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.124+0000 7f99defe5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:16:13.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.124+0000 7f9a1a905680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:16:13.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.124+0000 7f9a1a905680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:16:13.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.124+0000 7f9a1a905680 1 Processor -- start 2023-10-05T21:16:13.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.124+0000 7f9a1a905680 1 -- start start 2023-10-05T21:16:13.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.124+0000 7f9a1a905680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5561be3d03e0 0x5561be3d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.124+0000 7f9a1a905680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561be3d0dc0 con 0x5561be3d03e0 2023-10-05T21:16:13.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.125+0000 7f9a0d1dc700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5561be3d03e0 0x5561be3d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.125+0000 7f9a0d1dc700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5561be3d03e0 0x5561be3d07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54792/0 (socket says 172.21.15.153:54792) 2023-10-05T21:16:13.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.125+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/2392735657 learned_addr learned my addr 172.21.15.153:0/2392735657 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:13.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.125+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/2392735657 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561be3d0f00 con 0x5561be3d03e0 2023-10-05T21:16:13.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.125+0000 7f9a0d1dc700 1 --2- 172.21.15.153:0/2392735657 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5561be3d03e0 0x5561be3d07f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x5561be3861b0 tx=0x7f9a04012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede84d5624bd2307 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.125+0000 7f99de7e4700 1 -- 172.21.15.153:0/2392735657 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a0401dd40 con 0x5561be3d03e0 2023-10-05T21:16:13.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.125+0000 7f99de7e4700 1 -- 172.21.15.153:0/2392735657 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0402b450 con 0x5561be3d03e0 2023-10-05T21:16:13.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.125+0000 7f99de7e4700 1 -- 172.21.15.153:0/2392735657 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a0402b600 con 0x5561be3d03e0 2023-10-05T21:16:13.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.126+0000 7f9a1a905680 1 -- 172.21.15.153:0/2392735657 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5561be3d03e0 msgr2=0x5561be3d07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.126+0000 7f9a1a905680 1 --2- 172.21.15.153:0/2392735657 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5561be3d03e0 0x5561be3d07f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x5561be3861b0 tx=0x7f9a04012000 comp rx=0 tx=0).stop 2023-10-05T21:16:13.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.126+0000 7f9a1a905680 1 -- 172.21.15.153:0/2392735657 shutdown_connections 2023-10-05T21:16:13.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.126+0000 7f9a1a905680 1 --2- 172.21.15.153:0/2392735657 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5561be3d03e0 0x5561be3d07f0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.126+0000 7f9a1a905680 1 -- 172.21.15.153:0/2392735657 >> 172.21.15.153:0/2392735657 conn(0x5561be3cb5e0 msgr2=0x5561be3c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.126+0000 7f9a1a905680 1 -- 172.21.15.153:0/2392735657 shutdown_connections 2023-10-05T21:16:13.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.126+0000 7f9a1a905680 1 -- 172.21.15.153:0/2392735657 wait complete. 2023-10-05T21:16:13.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.126+0000 7f9a1a905680 1 Processor -- start 2023-10-05T21:16:13.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.126+0000 7f9a1a905680 1 -- start start 2023-10-05T21:16:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.126+0000 7f9a1a905680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5561be3d03e0 0x5561be3d5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.126+0000 7f9a1a905680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561be3d64d0 con 0x5561be3d03e0 2023-10-05T21:16:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.127+0000 7f9a0d1dc700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5561be3d03e0 0x5561be3d5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.127+0000 7f9a0d1dc700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5561be3d03e0 0x5561be3d5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54802/0 (socket says 172.21.15.153:54802) 2023-10-05T21:16:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.127+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/3964197140 learned_addr learned my addr 172.21.15.153:0/3964197140 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.127+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/3964197140 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561be3861e0 con 0x5561be3d03e0 2023-10-05T21:16:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.127+0000 7f9a0d1dc700 1 --2- 172.21.15.153:0/3964197140 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5561be3d03e0 0x5561be3d5f90 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x5561be3cab50 tx=0x7f9a04031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.127+0000 7f99dcfe1700 1 -- 172.21.15.153:0/3964197140 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a04040650 con 0x5561be3d03e0 2023-10-05T21:16:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.127+0000 7f99dcfe1700 1 -- 172.21.15.153:0/3964197140 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a040407b0 con 0x5561be3d03e0 2023-10-05T21:16:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.127+0000 7f9a1a905680 1 -- 172.21.15.153:0/3964197140 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5561be3d66d0 con 0x5561be3d03e0 2023-10-05T21:16:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.127+0000 7f99dcfe1700 1 -- 172.21.15.153:0/3964197140 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a040409a0 con 0x5561be3d03e0 2023-10-05T21:16:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.127+0000 7f9a1a905680 1 -- 172.21.15.153:0/3964197140 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5561be3d6b20 con 0x5561be3d03e0 2023-10-05T21:16:13.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.128+0000 7f99dcfe1700 1 -- 172.21.15.153:0/3964197140 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f9a04026040 con 0x5561be3d03e0 2023-10-05T21:16:13.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.128+0000 7f99dcfe1700 1 --2- 172.21.15.153:0/3964197140 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9954034140 0x7f99540365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.128+0000 7f99dcfe1700 1 -- 172.21.15.153:0/3964197140 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f9a04031070 con 0x5561be3d03e0 2023-10-05T21:16:13.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.128+0000 7f9a0e1de700 1 --2- 172.21.15.153:0/3964197140 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9954034140 0x7f99540365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.128+0000 7f9a1a905680 5 note: GC not initialized 2023-10-05T21:16:13.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.129+0000 7f9a0e1de700 1 --2- 172.21.15.153:0/3964197140 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9954034140 0x7f99540365f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x5561be3c2760 tx=0x7f9a0800aee0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.129+0000 7f994dffb700 20 reqs_thread_entry: start 2023-10-05T21:16:13.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.130+0000 7f993f7fe700 20 reqs_thread_entry: start 2023-10-05T21:16:13.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.130+0000 7f9a1a905680 20 init_complete bucket index max shards: 11 2023-10-05T21:16:13.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.130+0000 7f9a1a905680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:16:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.130+0000 7f993dffb700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:16:43 2023 2023-10-05T21:16:13.157 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:16:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.130+0000 7f993d7fa700 20 reqs_thread_entry: start 2023-10-05T21:16:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.130+0000 7f9a1a905680 20 get_system_obj_state: rctx=0x7ffe240f85d8 obj=default.rgw.meta:users.uid:foo state=0x5561be231240 s->prefetch_data=0 2023-10-05T21:16:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.130+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be43b980 con 0x5561be3827b0 2023-10-05T21:16:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.130+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f9a0800a570 con 0x5561be3827b0 2023-10-05T21:16:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.130+0000 7f9a1a905680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:16:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.130+0000 7f9a1a905680 20 Read xattr: user.rgw.idtag 2023-10-05T21:16:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.130+0000 7f9a1a905680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.130+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be43dc10 con 0x5561be3827b0 2023-10-05T21:16:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.131+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f9a0804c040 con 0x5561be3827b0 2023-10-05T21:16:13.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.131+0000 7f9a1a905680 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T21:16:13.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.131+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:104 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be43dc10 con 0x7f9a04007030 2023-10-05T21:16:13.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.132+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(104 usage.10 [call out=1268b] v0'0 uv32 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f9a0804c040 con 0x7f9a04007030 2023-10-05T21:16:13.158 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:16:13.158 INFO:teuthology.orchestra.run.smithi153.stdout: "entries": [ 2023-10-05T21:16:13.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.158 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:16:13.158 INFO:teuthology.orchestra.run.smithi153.stdout: "buckets": [ 2023-10-05T21:16:13.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.159 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "", 2023-10-05T21:16:13.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:13.159 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:13.159 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:13.159 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [ 2023-10-05T21:16:13.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.159 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "list_buckets", 2023-10-05T21:16:13.159 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 322, 2023-10-05T21:16:13.159 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.159 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:13.159 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:13.159 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.160 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:13.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.160 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo", 2023-10-05T21:16:13.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:13.160 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:13.160 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:13.160 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [ 2023-10-05T21:16:13.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.160 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "create_bucket", 2023-10-05T21:16:13.160 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:13.160 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.161 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 5, 2023-10-05T21:16:13.161 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 5 2023-10-05T21:16:13.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.161 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "delete_bucket", 2023-10-05T21:16:13.161 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 217, 2023-10-05T21:16:13.161 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.161 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 2, 2023-10-05T21:16:13.161 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:13.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.162 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "delete_obj", 2023-10-05T21:16:13.162 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:13.162 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.162 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 4, 2023-10-05T21:16:13.162 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 4 2023-10-05T21:16:13.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.162 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "get_acls", 2023-10-05T21:16:13.162 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 1026, 2023-10-05T21:16:13.162 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.162 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 2, 2023-10-05T21:16:13.162 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 2 2023-10-05T21:16:13.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.163 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "get_obj", 2023-10-05T21:16:13.163 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 4, 2023-10-05T21:16:13.163 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.163 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:13.163 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:13.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.163 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "list_bucket", 2023-10-05T21:16:13.163 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 515, 2023-10-05T21:16:13.163 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.164 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:13.164 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:13.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.164 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "put_acls", 2023-10-05T21:16:13.164 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:13.164 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.164 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 2, 2023-10-05T21:16:13.164 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 2 2023-10-05T21:16:13.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.164 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "put_obj", 2023-10-05T21:16:13.165 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:13.165 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 30000042, 2023-10-05T21:16:13.165 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 11, 2023-10-05T21:16:13.165 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 11 2023-10-05T21:16:13.165 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.165 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:13.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.165 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo2", 2023-10-05T21:16:13.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:13.165 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:13.165 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:13.166 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [ 2023-10-05T21:16:13.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.166 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "create_bucket", 2023-10-05T21:16:13.166 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:13.166 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.166 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:13.166 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:13.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.166 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "delete_bucket", 2023-10-05T21:16:13.166 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:13.167 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.167 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:13.167 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:13.167 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.167 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:13.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.132+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93878291773264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3fa500 con 0x7f9a0000d750 2023-10-05T21:16:13.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.133+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/2733204964 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(105 notify.0 [watch unwatch cookie 93878291773264] v31'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a04034040 con 0x7f9a0000d750 2023-10-05T21:16:13.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.133+0000 7f9a1a905680 20 remove_watcher() i=0 2023-10-05T21:16:13.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.133+0000 7f9a1a905680 2 removed watcher, disabling cache 2023-10-05T21:16:13.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.133+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93878291779728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3bb750 con 0x5561be3827b0 2023-10-05T21:16:13.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.134+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(106 notify.1 [watch unwatch cookie 93878291779728] v31'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a0804c040 con 0x5561be3827b0 2023-10-05T21:16:13.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.134+0000 7f9a1a905680 20 remove_watcher() i=1 2023-10-05T21:16:13.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.134+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93878291783488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3bb750 con 0x5561be3b4f90 2023-10-05T21:16:13.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.135+0000 7f9a0d9dd700 1 -- 172.21.15.153:0/2733204964 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(107 notify.2 [watch unwatch cookie 93878291783488] v31'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a00014070 con 0x5561be3b4f90 2023-10-05T21:16:13.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.135+0000 7f9a1a905680 20 remove_watcher() i=2 2023-10-05T21:16:13.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.135+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93878291788352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3bdf40 con 0x7f9a0000d750 2023-10-05T21:16:13.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.135+0000 7f9a0d1dc700 1 -- 172.21.15.153:0/2733204964 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(108 notify.3 [watch unwatch cookie 93878291788352] v31'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a04034040 con 0x7f9a0000d750 2023-10-05T21:16:13.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.135+0000 7f9a1a905680 20 remove_watcher() i=3 2023-10-05T21:16:13.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.135+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93878291785776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3bf240 con 0x5561be3827b0 2023-10-05T21:16:13.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.136+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(109 notify.4 [watch unwatch cookie 93878291785776] v31'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a0804c040 con 0x5561be3827b0 2023-10-05T21:16:13.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.136+0000 7f9a1a905680 20 remove_watcher() i=4 2023-10-05T21:16:13.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.136+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93878291789600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3bdf40 con 0x7f9a04007030 2023-10-05T21:16:13.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.137+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(110 notify.5 [watch unwatch cookie 93878291789600] v31'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a0804c040 con 0x7f9a04007030 2023-10-05T21:16:13.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.137+0000 7f9a1a905680 20 remove_watcher() i=5 2023-10-05T21:16:13.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.137+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:111 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93878291797728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3be830 con 0x7f9a04007030 2023-10-05T21:16:13.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.138+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(111 notify.6 [watch unwatch cookie 93878291797728] v31'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a0804c040 con 0x7f9a04007030 2023-10-05T21:16:13.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.138+0000 7f9a1a905680 20 remove_watcher() i=6 2023-10-05T21:16:13.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.138+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93878291795072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3bf240 con 0x7f9a04007030 2023-10-05T21:16:13.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.139+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(112 notify.7 [watch unwatch cookie 93878291795072] v31'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a0804c040 con 0x7f9a04007030 2023-10-05T21:16:13.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.139+0000 7f9a1a905680 20 remove_watcher() i=7 2023-10-05T21:16:13.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.140+0000 7f99defe5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:16:13.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.140+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:113 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93878291800800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561be3bdf40 con 0x5561be3827b0 2023-10-05T21:16:13.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.141+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(113 data_loggenerations_metadata [watch unwatch cookie 93878291800800] v31'222 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9a0804c040 con 0x5561be3827b0 2023-10-05T21:16:13.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.141+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f9a04007030 msgr2=0x7f9a0401d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.141+0000 7f9a1a905680 1 --2- 172.21.15.153:0/2733204964 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f9a04007030 0x7f9a0401d420 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.141+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5561be3827b0 msgr2=0x5561be3b2b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.141+0000 7f9a1a905680 1 --2- 172.21.15.153:0/2733204964 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5561be3827b0 0x5561be3b2b70 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.141+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f9a0000d750 msgr2=0x7f9a00048380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.141+0000 7f9a1a905680 1 --2- 172.21.15.153:0/2733204964 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f9a0000d750 0x7f9a00048380 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.141+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5561be3b4f90 msgr2=0x5561be3b7370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.141+0000 7f9a1a905680 1 --2- 172.21.15.153:0/2733204964 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5561be3b4f90 0x5561be3b7370 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.141+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f99f00340f0 msgr2=0x7f99f00365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.141+0000 7f9a1a905680 1 --2- 172.21.15.153:0/2733204964 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f99f00340f0 0x7f99f00365a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9a04003080 tx=0x7f9a04015000 comp rx=0 tx=0).stop 2023-10-05T21:16:13.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.141+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5561be2f20a0 msgr2=0x5561be37e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.141+0000 7f9a1a905680 1 --2- 172.21.15.153:0/2733204964 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5561be2f20a0 0x5561be37e9f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f9a0000c010 tx=0x7f9a00016000 comp rx=0 tx=0).stop 2023-10-05T21:16:13.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.141+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 reap_dead start 2023-10-05T21:16:13.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.141+0000 7f9a0e1de700 1 -- 172.21.15.153:0/2733204964 reap_dead start 2023-10-05T21:16:13.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.141+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 shutdown_connections 2023-10-05T21:16:13.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.141+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 >> 172.21.15.153:0/2733204964 conn(0x5561be378b80 msgr2=0x5561be397a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.141+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 shutdown_connections 2023-10-05T21:16:13.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.141+0000 7f9a1a905680 1 -- 172.21.15.153:0/2733204964 wait complete. 2023-10-05T21:16:13.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.141+0000 7f9a1a905680 1 -- 172.21.15.153:0/3964197140 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9954034140 msgr2=0x7f99540365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.141+0000 7f9a1a905680 1 --2- 172.21.15.153:0/3964197140 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9954034140 0x7f99540365f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x5561be3c2760 tx=0x7f9a0800aee0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.141+0000 7f9a1a905680 1 -- 172.21.15.153:0/3964197140 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5561be3d03e0 msgr2=0x5561be3d5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.141+0000 7f9a1a905680 1 --2- 172.21.15.153:0/3964197140 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5561be3d03e0 0x5561be3d5f90 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x5561be3cab50 tx=0x7f9a04031000 comp rx=0 tx=0).stop 2023-10-05T21:16:13.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.141+0000 7f9a1a905680 1 -- 172.21.15.153:0/3964197140 shutdown_connections 2023-10-05T21:16:13.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.141+0000 7f9a1a905680 1 --2- 172.21.15.153:0/3964197140 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f9954034140 0x7f99540365f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.141+0000 7f9a1a905680 1 --2- 172.21.15.153:0/3964197140 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5561be3d03e0 0x5561be3d5f90 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.141+0000 7f9a1a905680 1 -- 172.21.15.153:0/3964197140 >> 172.21.15.153:0/3964197140 conn(0x5561be3cb5e0 msgr2=0x5561be3c9710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.141+0000 7f9a1a905680 1 -- 172.21.15.153:0/3964197140 shutdown_connections 2023-10-05T21:16:13.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.141+0000 7f9a1a905680 1 -- 172.21.15.153:0/3964197140 wait complete. 2023-10-05T21:16:13.177 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo3", 2023-10-05T21:16:13.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:13.177 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:13.177 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:13.177 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [ 2023-10-05T21:16:13.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.177 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "create_bucket", 2023-10-05T21:16:13.178 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:13.178 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.178 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:13.178 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:13.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.178 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "delete_bucket", 2023-10-05T21:16:13.178 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:13.178 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.178 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:13.178 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:13.179 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.179 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:13.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.179 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo4", 2023-10-05T21:16:13.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:13.179 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:13.179 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:13.179 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [ 2023-10-05T21:16:13.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.179 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "create_bucket", 2023-10-05T21:16:13.179 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:13.180 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.180 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:13.180 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:13.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.180 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "delete_bucket", 2023-10-05T21:16:13.180 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:13.180 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.180 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:13.180 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:13.180 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.180 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:13.180 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.181 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:13.181 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.181 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:16:13.181 INFO:teuthology.orchestra.run.smithi153.stdout: "summary": [ 2023-10-05T21:16:13.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.181 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:16:13.181 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [ 2023-10-05T21:16:13.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.181 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "create_bucket", 2023-10-05T21:16:13.181 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:13.181 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.181 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 8, 2023-10-05T21:16:13.182 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 8 2023-10-05T21:16:13.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.182 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "delete_bucket", 2023-10-05T21:16:13.182 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 217, 2023-10-05T21:16:13.182 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.182 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 5, 2023-10-05T21:16:13.182 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 4 2023-10-05T21:16:13.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.182 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "delete_obj", 2023-10-05T21:16:13.182 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:13.183 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.183 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 4, 2023-10-05T21:16:13.183 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 4 2023-10-05T21:16:13.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.183 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "get_acls", 2023-10-05T21:16:13.183 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 1026, 2023-10-05T21:16:13.183 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.183 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 2, 2023-10-05T21:16:13.183 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 2 2023-10-05T21:16:13.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.184 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "get_obj", 2023-10-05T21:16:13.184 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 4, 2023-10-05T21:16:13.184 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.184 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:13.184 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:13.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.184 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "list_bucket", 2023-10-05T21:16:13.184 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 515, 2023-10-05T21:16:13.184 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.184 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:13.184 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:13.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.185 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "list_buckets", 2023-10-05T21:16:13.185 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 322, 2023-10-05T21:16:13.185 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.185 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:13.185 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:13.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.185 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "put_acls", 2023-10-05T21:16:13.185 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:13.186 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.186 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 2, 2023-10-05T21:16:13.186 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 2 2023-10-05T21:16:13.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.186 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "put_obj", 2023-10-05T21:16:13.186 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:13.186 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 30000042, 2023-10-05T21:16:13.186 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 11, 2023-10-05T21:16:13.186 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 11 2023-10-05T21:16:13.186 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.186 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:16:13.187 INFO:teuthology.orchestra.run.smithi153.stdout: "total": { 2023-10-05T21:16:13.187 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 2084, 2023-10-05T21:16:13.187 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 30000042, 2023-10-05T21:16:13.187 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 35, 2023-10-05T21:16:13.187 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 34 2023-10-05T21:16:13.187 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.187 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.187 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:13.187 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:16:13.187 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 217, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 217, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2084, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2023-10-05T21:16:13.188 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2023-10-05T21:16:13.188 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2023-10-05T21:16:13.188 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2023-10-05T21:16:13.234 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:16:13.234 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:16:13.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.233+0000 7fbbb3fc3680 1 Processor -- start 2023-10-05T21:16:13.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.233+0000 7fbbb3fc3680 1 -- start start 2023-10-05T21:16:13.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.233+0000 7fbbb3fc3680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5637b75e1bc0 0x5637b75e3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.234+0000 7fbbb3fc3680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5637b7528930 con 0x5637b754f0b0 2023-10-05T21:16:13.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.234+0000 7fbbb3fc3680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x5637b74e8db0 con 0x5637b75e1bc0 2023-10-05T21:16:13.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.234+0000 7fbba689a700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5637b75e1bc0 0x5637b75e3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.234+0000 7fbba709b700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x5637b754f0b0 0x5637b75e04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:57790/0 (socket says 172.21.15.153:57790) 2023-10-05T21:16:13.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.234+0000 7fbba709b700 1 -- 172.21.15.153:0/873939524 learned_addr learned my addr 172.21.15.153:0/873939524 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:16:13.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.234+0000 7fbba6099700 1 -- 172.21.15.153:0/873939524 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 417592510 0 0) 0x5637b7528930 con 0x5637b754f0b0 2023-10-05T21:16:13.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.234+0000 7fbba6099700 1 -- 172.21.15.153:0/873939524 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb90001e10 con 0x5637b754f0b0 2023-10-05T21:16:13.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.234+0000 7fbba689a700 1 -- 172.21.15.153:0/873939524 >> v1:172.21.15.111:6789/0 conn(0x5637b754f0b0 legacy=0x5637b75e04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.234+0000 7fbba689a700 1 -- 172.21.15.153:0/873939524 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637b75e54f0 con 0x5637b75e1bc0 2023-10-05T21:16:13.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.234+0000 7fbba689a700 1 --2- 172.21.15.153:0/873939524 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b75e1bc0 0x5637b75e3fa0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800a5d0 tx=0x7fbb98005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85730bacf23d3b70 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.234+0000 7fbba6099700 1 -- 172.21.15.153:0/873939524 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb98007610 con 0x5637b75e1bc0 2023-10-05T21:16:13.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.234+0000 7fbba6099700 1 -- 172.21.15.153:0/873939524 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb98007770 con 0x5637b75e1bc0 2023-10-05T21:16:13.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.234+0000 7fbba6099700 1 -- 172.21.15.153:0/873939524 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb98007a40 con 0x5637b75e1bc0 2023-10-05T21:16:13.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.235+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/873939524 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b75e1bc0 msgr2=0x5637b75e3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.235+0000 7fbbb3fc3680 1 --2- 172.21.15.153:0/873939524 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b75e1bc0 0x5637b75e3fa0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800a5d0 tx=0x7fbb98005a50 comp rx=0 tx=0).stop 2023-10-05T21:16:13.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.235+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/873939524 shutdown_connections 2023-10-05T21:16:13.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.235+0000 7fbbb3fc3680 1 --2- 172.21.15.153:0/873939524 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b75e1bc0 0x5637b75e3fa0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.235+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/873939524 >> 172.21.15.153:0/873939524 conn(0x5637b75d5b90 msgr2=0x5637b75d7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.235+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/873939524 shutdown_connections 2023-10-05T21:16:13.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.235+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/873939524 wait complete. 2023-10-05T21:16:13.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.236+0000 7fbbb3fc3680 1 Processor -- start 2023-10-05T21:16:13.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.236+0000 7fbbb3fc3680 1 -- start start 2023-10-05T21:16:13.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.236+0000 7fbbb3fc3680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b754f0b0 0x5637b75fc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.236+0000 7fbbb3fc3680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637b7488ea0 con 0x5637b754f0b0 2023-10-05T21:16:13.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.236+0000 7fbba709b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b754f0b0 0x5637b75fc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.236+0000 7fbba709b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b754f0b0 0x5637b75fc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54818/0 (socket says 172.21.15.153:54818) 2023-10-05T21:16:13.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.236+0000 7fbba709b700 1 -- 172.21.15.153:0/3888118101 learned_addr learned my addr 172.21.15.153:0/3888118101 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:13.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.237+0000 7fbba709b700 1 -- 172.21.15.153:0/3888118101 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb98005cf0 con 0x5637b754f0b0 2023-10-05T21:16:13.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.237+0000 7fbba709b700 1 --2- 172.21.15.153:0/3888118101 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b754f0b0 0x5637b75fc8f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c001c40 tx=0x7fbb9c0017f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1fb9cd8f401c99b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.237+0000 7fbba5097700 1 -- 172.21.15.153:0/3888118101 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb9c00bbf0 con 0x5637b754f0b0 2023-10-05T21:16:13.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.237+0000 7fbba5097700 1 -- 172.21.15.153:0/3888118101 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9c00bd70 con 0x5637b754f0b0 2023-10-05T21:16:13.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.237+0000 7fbba5097700 1 -- 172.21.15.153:0/3888118101 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb9c00e5f0 con 0x5637b754f0b0 2023-10-05T21:16:13.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.237+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/3888118101 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b754f0b0 msgr2=0x5637b75fc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.237+0000 7fbbb3fc3680 1 --2- 172.21.15.153:0/3888118101 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b754f0b0 0x5637b75fc8f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c001c40 tx=0x7fbb9c0017f0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.237+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/3888118101 shutdown_connections 2023-10-05T21:16:13.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.237+0000 7fbbb3fc3680 1 --2- 172.21.15.153:0/3888118101 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b754f0b0 0x5637b75fc8f0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.237+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/3888118101 >> 172.21.15.153:0/3888118101 conn(0x5637b75d5b90 msgr2=0x5637b75f83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.237+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/3888118101 shutdown_connections 2023-10-05T21:16:13.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.237+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/3888118101 wait complete. 2023-10-05T21:16:13.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.238+0000 7fbbb3fc3680 1 Processor -- start 2023-10-05T21:16:13.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.238+0000 7fbbb3fc3680 1 -- start start 2023-10-05T21:16:13.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.238+0000 7fbbb3fc3680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b754f0b0 0x5637b7603db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.238+0000 7fbbb3fc3680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637b747fc80 con 0x5637b754f0b0 2023-10-05T21:16:13.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.238+0000 7fbba709b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b754f0b0 0x5637b7603db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.238+0000 7fbba709b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b754f0b0 0x5637b7603db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54828/0 (socket says 172.21.15.153:54828) 2023-10-05T21:16:13.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.238+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 learned_addr learned my addr 172.21.15.153:0/881565624 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:13.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.239+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb90001e10 con 0x5637b754f0b0 2023-10-05T21:16:13.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.239+0000 7fbba709b700 1 --2- 172.21.15.153:0/881565624 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b754f0b0 0x5637b7603db0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x5637b75fd690 tx=0x7fbb9c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.239+0000 7fbb977fe700 1 -- 172.21.15.153:0/881565624 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb9c01f070 con 0x5637b754f0b0 2023-10-05T21:16:13.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.239+0000 7fbb977fe700 1 -- 172.21.15.153:0/881565624 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9c018640 con 0x5637b754f0b0 2023-10-05T21:16:13.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.239+0000 7fbb977fe700 1 -- 172.21.15.153:0/881565624 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb9c018910 con 0x5637b754f0b0 2023-10-05T21:16:13.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.239+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5637b76042f0 con 0x5637b754f0b0 2023-10-05T21:16:13.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.239+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5637b7604740 con 0x5637b754f0b0 2023-10-05T21:16:13.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.240+0000 7fbb977fe700 1 -- 172.21.15.153:0/881565624 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fbb9c018a70 con 0x5637b754f0b0 2023-10-05T21:16:13.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.240+0000 7fbbb3fc3680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.240+0000 7fbb977fe700 1 --2- 172.21.15.153:0/881565624 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbb8c034140 0x7fbb8c0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.240+0000 7fbb977fe700 1 -- 172.21.15.153:0/881565624 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fbb9c048ec0 con 0x5637b754f0b0 2023-10-05T21:16:13.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.240+0000 7fbba689a700 1 --2- 172.21.15.153:0/881565624 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbb8c034140 0x7fbb8c0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.240+0000 7fbbb3fc3680 1 --2- 172.21.15.153:0/881565624 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5637b75e1bc0 0x5637b760fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.240+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7610260 con 0x5637b75e1bc0 2023-10-05T21:16:13.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.240+0000 7fbba789c700 1 --2- 172.21.15.153:0/881565624 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5637b75e1bc0 0x5637b760fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.241+0000 7fbba689a700 1 --2- 172.21.15.153:0/881565624 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbb8c034140 0x7fbb8c0365f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800afd0 tx=0x7fbb98014000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.241+0000 7fbba789c700 1 --2- 172.21.15.153:0/881565624 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5637b75e1bc0 0x5637b760fad0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.241+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.241+0000 7fbbb3fc3680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.241+0000 7fbbb3fc3680 20 realm 2023-10-05T21:16:13.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.241+0000 7fbbb3fc3680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.241+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b760d0f0 con 0x5637b75e1bc0 2023-10-05T21:16:13.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.241+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.241+0000 7fbbb3fc3680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.241+0000 7fbbb3fc3680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:16:13.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.241+0000 7fbbb3fc3680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.241+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7610d60 con 0x5637b75e1bc0 2023-10-05T21:16:13.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.241+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.241+0000 7fbbb3fc3680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.241+0000 7fbbb3fc3680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.241+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7611680 con 0x5637b75e1bc0 2023-10-05T21:16:13.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.242+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.242+0000 7fbbb3fc3680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:13.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.242+0000 7fbbb3fc3680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.242+0000 7fbbb3fc3680 1 --2- 172.21.15.153:0/881565624 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5637b7611f40 0x5637b7614320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.242+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b76148f0 con 0x5637b7611f40 2023-10-05T21:16:13.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.242+0000 7fbba709b700 1 --2- 172.21.15.153:0/881565624 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5637b7611f40 0x5637b7614320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.242+0000 7fbba709b700 1 --2- 172.21.15.153:0/881565624 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5637b7611f40 0x5637b7614320 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.242+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fbb9c014070 con 0x5637b7611f40 2023-10-05T21:16:13.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.242+0000 7fbbb3fc3680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:16:13.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.242+0000 7fbbb3fc3680 20 searching for the correct realm 2023-10-05T21:16:13.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.242+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x5637b7611f40 2023-10-05T21:16:13.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.242+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb9c014070 con 0x5637b7611f40 2023-10-05T21:16:13.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.242+0000 7fbba709b700 1 --2- 172.21.15.153:0/881565624 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fbb9c0163b0 0x7fbb9c022560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.242+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x7fbb9c0163b0 2023-10-05T21:16:13.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.243+0000 7fbba689a700 1 --2- 172.21.15.153:0/881565624 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fbb9c0163b0 0x7fbb9c022560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.243+0000 7fbba689a700 1 --2- 172.21.15.153:0/881565624 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fbb9c0163b0 0x7fbb9c022560 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.243+0000 7fbba689a700 1 -- 172.21.15.153:0/881565624 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb980079b0 con 0x7fbb9c0163b0 2023-10-05T21:16:13.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.243+0000 7fbba689a700 1 --2- 172.21.15.153:0/881565624 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fbb98007030 0x7fbb9801d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.243+0000 7fbba689a700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x7fbb98007030 2023-10-05T21:16:13.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.243+0000 7fbba789c700 1 --2- 172.21.15.153:0/881565624 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fbb98007030 0x7fbb9801d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.244+0000 7fbba789c700 1 --2- 172.21.15.153:0/881565624 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fbb98007030 0x7fbb9801d430 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.244+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbba000a570 con 0x7fbb98007030 2023-10-05T21:16:13.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.244+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x5637b75e1bc0 2023-10-05T21:16:13.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.244+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.244+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x5637b75e1bc0 2023-10-05T21:16:13.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.244+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.244+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x7fbb98007030 2023-10-05T21:16:13.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.245+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbba000a570 con 0x7fbb98007030 2023-10-05T21:16:13.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.245+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x7fbb98007030 2023-10-05T21:16:13.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.245+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbba000a570 con 0x7fbb98007030 2023-10-05T21:16:13.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.245+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x7fbb9c0163b0 2023-10-05T21:16:13.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.245+0000 7fbba689a700 1 -- 172.21.15.153:0/881565624 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb98029040 con 0x7fbb9c0163b0 2023-10-05T21:16:13.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.245+0000 7fbba689a700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x5637b7611f40 2023-10-05T21:16:13.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.245+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fbb9c014070 con 0x5637b7611f40 2023-10-05T21:16:13.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.245+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x5637b75e1bc0 2023-10-05T21:16:13.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.246+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.246+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x7fbb98007030 2023-10-05T21:16:13.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.246+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbba000a570 con 0x7fbb98007030 2023-10-05T21:16:13.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.246+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x5637b75e1bc0 2023-10-05T21:16:13.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.246+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.246+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x7fbb9c0163b0 2023-10-05T21:16:13.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.246+0000 7fbba689a700 1 -- 172.21.15.153:0/881565624 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb98029040 con 0x7fbb9c0163b0 2023-10-05T21:16:13.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.246+0000 7fbba689a700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x5637b7611f40 2023-10-05T21:16:13.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.247+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb9c014070 con 0x5637b7611f40 2023-10-05T21:16:13.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.247+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x5637b7611f40 2023-10-05T21:16:13.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.247+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb9c014070 con 0x5637b7611f40 2023-10-05T21:16:13.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.247+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x7fbb98007030 2023-10-05T21:16:13.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.247+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbba000a570 con 0x7fbb98007030 2023-10-05T21:16:13.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.247+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x5637b7611f40 2023-10-05T21:16:13.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.247+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb9c014070 con 0x5637b7611f40 2023-10-05T21:16:13.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.247+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x5637b7611f40 2023-10-05T21:16:13.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.248+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb9c014070 con 0x5637b7611f40 2023-10-05T21:16:13.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.248+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x5637b75e1bc0 2023-10-05T21:16:13.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.248+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.248+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x5637b75e1bc0 2023-10-05T21:16:13.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.248+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.248+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x7fbb98007030 2023-10-05T21:16:13.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.248+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbba000a570 con 0x7fbb98007030 2023-10-05T21:16:13.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.248+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x5637b7611f40 2023-10-05T21:16:13.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.248+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb9c014070 con 0x5637b7611f40 2023-10-05T21:16:13.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.248+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x7fbb9c0163b0 2023-10-05T21:16:13.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.249+0000 7fbba689a700 1 -- 172.21.15.153:0/881565624 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb98029040 con 0x7fbb9c0163b0 2023-10-05T21:16:13.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.249+0000 7fbba689a700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x5637b75e1bc0 2023-10-05T21:16:13.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.249+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.249+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x7fbb98007030 2023-10-05T21:16:13.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.249+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbba000a570 con 0x7fbb98007030 2023-10-05T21:16:13.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.249+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x5637b7611f40 2023-10-05T21:16:13.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.249+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb9c014070 con 0x5637b7611f40 2023-10-05T21:16:13.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.249+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x7fbb98007030 2023-10-05T21:16:13.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.250+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbba000a570 con 0x7fbb98007030 2023-10-05T21:16:13.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.250+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x7fbb9c0163b0 2023-10-05T21:16:13.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.250+0000 7fbba689a700 1 -- 172.21.15.153:0/881565624 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb98029040 con 0x7fbb9c0163b0 2023-10-05T21:16:13.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.250+0000 7fbba689a700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x5637b7611f40 2023-10-05T21:16:13.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.250+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb9c014070 con 0x5637b7611f40 2023-10-05T21:16:13.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.250+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x7fbb98007030 2023-10-05T21:16:13.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.250+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbba000a570 con 0x7fbb98007030 2023-10-05T21:16:13.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.250+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x5637b75e1bc0 2023-10-05T21:16:13.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.251+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.251+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616210 con 0x7fbb9c0163b0 2023-10-05T21:16:13.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.251+0000 7fbba689a700 1 -- 172.21.15.153:0/881565624 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb98029040 con 0x7fbb9c0163b0 2023-10-05T21:16:13.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.251+0000 7fbbb3fc3680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:16:13.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.251+0000 7fbbb3fc3680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:16:13.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.251+0000 7fbbb3fc3680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:16:13.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.251+0000 7fbbb3fc3680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:16:13.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.251+0000 7fbbb3fc3680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.251+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7615430 con 0x5637b75e1bc0 2023-10-05T21:16:13.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.251+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.251+0000 7fbbb3fc3680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.251+0000 7fbbb3fc3680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.251+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b76158c0 con 0x5637b75e1bc0 2023-10-05T21:16:13.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.251+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.251+0000 7fbbb3fc3680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:13.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.251+0000 7fbbb3fc3680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.251+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7615cf0 con 0x5637b75e1bc0 2023-10-05T21:16:13.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.252+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.252+0000 7fbbb3fc3680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:16:13.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.252+0000 7fbbb3fc3680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.252+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616ab0 con 0x5637b7611f40 2023-10-05T21:16:13.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.252+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fbb9c014070 con 0x5637b7611f40 2023-10-05T21:16:13.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.252+0000 7fbbb3fc3680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.252+0000 7fbbb3fc3680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.252+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616e60 con 0x5637b75e1bc0 2023-10-05T21:16:13.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.252+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.252+0000 7fbbb3fc3680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.252+0000 7fbbb3fc3680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.252+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616e60 con 0x5637b75e1bc0 2023-10-05T21:16:13.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.252+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.252+0000 7fbbb3fc3680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:13.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.252+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7617e70 con 0x5637b7611f40 2023-10-05T21:16:13.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.252+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb9c014070 con 0x5637b7611f40 2023-10-05T21:16:13.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.252+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7617e70 con 0x7fbb9c0163b0 2023-10-05T21:16:13.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.253+0000 7fbba689a700 1 -- 172.21.15.153:0/881565624 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb98029040 con 0x7fbb9c0163b0 2023-10-05T21:16:13.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.253+0000 7fbba689a700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7617e70 con 0x7fbb98007030 2023-10-05T21:16:13.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.253+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbba000a570 con 0x7fbb98007030 2023-10-05T21:16:13.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.253+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7615cf0 con 0x5637b75e1bc0 2023-10-05T21:16:13.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.254+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.254+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7615cf0 con 0x5637b75e1bc0 2023-10-05T21:16:13.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.254+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.254+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7615cf0 con 0x7fbb98007030 2023-10-05T21:16:13.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.254+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbba000a570 con 0x7fbb98007030 2023-10-05T21:16:13.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.254+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7615cf0 con 0x7fbb98007030 2023-10-05T21:16:13.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.254+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbba000a570 con 0x7fbb98007030 2023-10-05T21:16:13.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.254+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7615cf0 con 0x7fbb9c0163b0 2023-10-05T21:16:13.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.255+0000 7fbba689a700 1 -- 172.21.15.153:0/881565624 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb98029040 con 0x7fbb9c0163b0 2023-10-05T21:16:13.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.255+0000 7fbba689a700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7615cf0 con 0x5637b7611f40 2023-10-05T21:16:13.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.255+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fbb9c014070 con 0x5637b7611f40 2023-10-05T21:16:13.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.255+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7615cf0 con 0x5637b75e1bc0 2023-10-05T21:16:13.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.255+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.255+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7615cf0 con 0x7fbb98007030 2023-10-05T21:16:13.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.255+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbba000a570 con 0x7fbb98007030 2023-10-05T21:16:13.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.255+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7615cf0 con 0x5637b75e1bc0 2023-10-05T21:16:13.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.255+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.255+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7615cf0 con 0x7fbb9c0163b0 2023-10-05T21:16:13.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.256+0000 7fbba689a700 1 -- 172.21.15.153:0/881565624 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb98029040 con 0x7fbb9c0163b0 2023-10-05T21:16:13.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.256+0000 7fbba689a700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7615cf0 con 0x5637b7611f40 2023-10-05T21:16:13.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.256+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb9c014070 con 0x5637b7611f40 2023-10-05T21:16:13.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.256+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7615cf0 con 0x5637b7611f40 2023-10-05T21:16:13.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.256+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb9c014070 con 0x5637b7611f40 2023-10-05T21:16:13.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.256+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7615cf0 con 0x7fbb98007030 2023-10-05T21:16:13.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.256+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbba000a570 con 0x7fbb98007030 2023-10-05T21:16:13.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.257+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7615cf0 con 0x5637b7611f40 2023-10-05T21:16:13.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.257+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb9c014070 con 0x5637b7611f40 2023-10-05T21:16:13.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.257+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7615cf0 con 0x5637b7611f40 2023-10-05T21:16:13.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.257+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb9c014070 con 0x5637b7611f40 2023-10-05T21:16:13.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.257+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7615cf0 con 0x5637b75e1bc0 2023-10-05T21:16:13.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.257+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.257+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7615cf0 con 0x5637b75e1bc0 2023-10-05T21:16:13.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.257+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.257+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7615cf0 con 0x7fbb98007030 2023-10-05T21:16:13.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.258+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbba000a570 con 0x7fbb98007030 2023-10-05T21:16:13.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.258+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7615cf0 con 0x5637b7611f40 2023-10-05T21:16:13.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.258+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb9c014070 con 0x5637b7611f40 2023-10-05T21:16:13.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.258+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7615cf0 con 0x7fbb9c0163b0 2023-10-05T21:16:13.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.258+0000 7fbba689a700 1 -- 172.21.15.153:0/881565624 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb98029040 con 0x7fbb9c0163b0 2023-10-05T21:16:13.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.258+0000 7fbba689a700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7615cf0 con 0x5637b75e1bc0 2023-10-05T21:16:13.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.258+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.258+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7615cf0 con 0x7fbb98007030 2023-10-05T21:16:13.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.259+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbba000a570 con 0x7fbb98007030 2023-10-05T21:16:13.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.259+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7615cf0 con 0x5637b7611f40 2023-10-05T21:16:13.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.259+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb9c014070 con 0x5637b7611f40 2023-10-05T21:16:13.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.259+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7615cf0 con 0x7fbb98007030 2023-10-05T21:16:13.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.259+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbba000a570 con 0x7fbb98007030 2023-10-05T21:16:13.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.259+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7615cf0 con 0x7fbb9c0163b0 2023-10-05T21:16:13.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.259+0000 7fbba689a700 1 -- 172.21.15.153:0/881565624 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb98029040 con 0x7fbb9c0163b0 2023-10-05T21:16:13.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.259+0000 7fbba689a700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7615cf0 con 0x5637b7611f40 2023-10-05T21:16:13.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.260+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb9c014070 con 0x5637b7611f40 2023-10-05T21:16:13.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.260+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7615cf0 con 0x7fbb98007030 2023-10-05T21:16:13.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.260+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbba000a570 con 0x7fbb98007030 2023-10-05T21:16:13.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.260+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7615cf0 con 0x5637b75e1bc0 2023-10-05T21:16:13.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.260+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.260+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7615cf0 con 0x7fbb9c0163b0 2023-10-05T21:16:13.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.260+0000 7fbba689a700 1 -- 172.21.15.153:0/881565624 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb98029040 con 0x7fbb9c0163b0 2023-10-05T21:16:13.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.260+0000 7fbbb3fc3680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:16:13.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.260+0000 7fbbb3fc3680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:16:13.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.260+0000 7fbbb3fc3680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:16:13.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.260+0000 7fbbb3fc3680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:16:13.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.260+0000 7fbbb3fc3680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.260+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616e60 con 0x5637b75e1bc0 2023-10-05T21:16:13.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.261+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.261+0000 7fbbb3fc3680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:13.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.261+0000 7fbbb3fc3680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.261+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7617210 con 0x5637b7611f40 2023-10-05T21:16:13.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.261+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fbb9c014070 con 0x5637b7611f40 2023-10-05T21:16:13.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.261+0000 7fbbb3fc3680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:16:13.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.261+0000 7fbbb3fc3680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.261+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616650 con 0x5637b75e1bc0 2023-10-05T21:16:13.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.261+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.261+0000 7fbbb3fc3680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:13.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.261+0000 7fbbb3fc3680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.261+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7616620 con 0x5637b75e1bc0 2023-10-05T21:16:13.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.261+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.261+0000 7fbbb3fc3680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:16:13.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.261+0000 7fbbb3fc3680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.261+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7617ab0 con 0x7fbb98007030 2023-10-05T21:16:13.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.262+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fbba000a570 con 0x7fbb98007030 2023-10-05T21:16:13.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.262+0000 7fbbb3fc3680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.262+0000 7fbbb3fc3680 20 zone default found 2023-10-05T21:16:13.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.262+0000 7fbbb3fc3680 4 Realm: () 2023-10-05T21:16:13.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.262+0000 7fbbb3fc3680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:16:13.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.262+0000 7fbbb3fc3680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:16:13.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.262+0000 7fbbb3fc3680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:16:13.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.262+0000 7fbbb3fc3680 20 zonegroup default 2023-10-05T21:16:13.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.262+0000 7fbbb3fc3680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.262+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7617ab0 con 0x7fbb98007030 2023-10-05T21:16:13.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.262+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fbba000a570 con 0x7fbb98007030 2023-10-05T21:16:13.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.262+0000 7fbbb3fc3680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.262+0000 7fbbb3fc3680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.262+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7619430 con 0x5637b7611f40 2023-10-05T21:16:13.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.262+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbb9c014070 con 0x5637b7611f40 2023-10-05T21:16:13.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.262+0000 7fbbb3fc3680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.262+0000 7fbbb3fc3680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.262+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b76197e0 con 0x5637b7611f40 2023-10-05T21:16:13.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.262+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbb9c014070 con 0x5637b7611f40 2023-10-05T21:16:13.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.263+0000 7fbbb3fc3680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.263+0000 7fbbb3fc3680 20 started sync module instance, tier type = 2023-10-05T21:16:13.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.263+0000 7fbbb3fc3680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:16:13.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.263+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7618af0 con 0x7fbb9c0163b0 2023-10-05T21:16:13.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.263+0000 7fbba689a700 1 -- 172.21.15.153:0/881565624 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v31'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb98029040 con 0x7fbb9c0163b0 2023-10-05T21:16:13.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.263+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94797299811840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7618ff0 con 0x7fbb9c0163b0 2023-10-05T21:16:13.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.264+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b761a710 con 0x5637b75e1bc0 2023-10-05T21:16:13.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.264+0000 7fbba689a700 1 -- 172.21.15.153:0/881565624 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94797299811840] v31'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb98029040 con 0x7fbb9c0163b0 2023-10-05T21:16:13.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.264+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v31'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.264+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94797299818944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b761ab10 con 0x5637b75e1bc0 2023-10-05T21:16:13.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.264+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b761b520 con 0x5637b7611f40 2023-10-05T21:16:13.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.265+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94797299818944] v31'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.265+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v31'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb9c014070 con 0x5637b7611f40 2023-10-05T21:16:13.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.265+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94797299822640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b761b8d0 con 0x5637b7611f40 2023-10-05T21:16:13.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.265+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b761c2e0 con 0x7fbb9c0163b0 2023-10-05T21:16:13.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.266+0000 7fbba689a700 1 -- 172.21.15.153:0/881565624 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v31'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb98029040 con 0x7fbb9c0163b0 2023-10-05T21:16:13.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.266+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94797299828368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b761cfd0 con 0x7fbb9c0163b0 2023-10-05T21:16:13.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.266+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b761d9e0 con 0x5637b75e1bc0 2023-10-05T21:16:13.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.266+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94797299822640] v31'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb9c014070 con 0x5637b7611f40 2023-10-05T21:16:13.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.267+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v31'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.267+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94797299832048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b761de30 con 0x5637b75e1bc0 2023-10-05T21:16:13.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.267+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b761e840 con 0x7fbb98007030 2023-10-05T21:16:13.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.267+0000 7fbba689a700 1 -- 172.21.15.153:0/881565624 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94797299828368] v31'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb98029040 con 0x7fbb9c0163b0 2023-10-05T21:16:13.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.268+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94797299832048] v31'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.268+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v31'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbba000a570 con 0x7fbb98007030 2023-10-05T21:16:13.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.268+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94797299833152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b761dd90 con 0x7fbb98007030 2023-10-05T21:16:13.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.268+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b761ed30 con 0x7fbb98007030 2023-10-05T21:16:13.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.268+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94797299833152] v31'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbba000a570 con 0x7fbb98007030 2023-10-05T21:16:13.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.268+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v31'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbba000a570 con 0x7fbb98007030 2023-10-05T21:16:13.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.268+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94797299835728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b761ec90 con 0x7fbb98007030 2023-10-05T21:16:13.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.269+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b761f6e0 con 0x7fbb98007030 2023-10-05T21:16:13.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.269+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94797299835728] v31'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbba000a570 con 0x7fbb98007030 2023-10-05T21:16:13.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.269+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v31'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbba000a570 con 0x7fbb98007030 2023-10-05T21:16:13.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.269+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94797299839408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b761ec90 con 0x7fbb98007030 2023-10-05T21:16:13.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.269+0000 7fbbb3fc3680 20 add_watcher() i=0 2023-10-05T21:16:13.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.269+0000 7fbbb3fc3680 20 add_watcher() i=1 2023-10-05T21:16:13.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.269+0000 7fbbb3fc3680 20 add_watcher() i=2 2023-10-05T21:16:13.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.269+0000 7fbbb3fc3680 20 add_watcher() i=3 2023-10-05T21:16:13.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.269+0000 7fbbb3fc3680 20 add_watcher() i=4 2023-10-05T21:16:13.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.269+0000 7fbbb3fc3680 20 add_watcher() i=5 2023-10-05T21:16:13.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.269+0000 7fbbb3fc3680 20 add_watcher() i=6 2023-10-05T21:16:13.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.270+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94797299839408] v31'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbba000a570 con 0x7fbb98007030 2023-10-05T21:16:13.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.270+0000 7fbbb3fc3680 20 add_watcher() i=7 2023-10-05T21:16:13.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.270+0000 7fbbb3fc3680 2 all 8 watchers are set, enabling cache 2023-10-05T21:16:13.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.270+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7622ab0 con 0x5637b75e1bc0 2023-10-05T21:16:13.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.270+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.270+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94797299837296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b761ff70 con 0x5637b75e1bc0 2023-10-05T21:16:13.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.271+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94797299837296] v31'223 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.271+0000 7fbaf3fff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:16:13.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.271+0000 7fbbb3fc3680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:16:13.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.271+0000 7fbbb3fc3680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:16:13.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.271+0000 7fbbb3fc3680 1 Processor -- start 2023-10-05T21:16:13.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.271+0000 7fbbb3fc3680 1 -- start start 2023-10-05T21:16:13.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.272+0000 7fbbb3fc3680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b762d4b0 0x5637b762d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.272+0000 7fbbb3fc3680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637b762de90 con 0x5637b762d4b0 2023-10-05T21:16:13.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.272+0000 7fbba689a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b762d4b0 0x5637b762d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.272+0000 7fbba689a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b762d4b0 0x5637b762d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54830/0 (socket says 172.21.15.153:54830) 2023-10-05T21:16:13.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.272+0000 7fbba689a700 1 -- 172.21.15.153:0/1294890121 learned_addr learned my addr 172.21.15.153:0/1294890121 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:13.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.272+0000 7fbba689a700 1 -- 172.21.15.153:0/1294890121 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637b762dfd0 con 0x5637b762d4b0 2023-10-05T21:16:13.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.272+0000 7fbba689a700 1 --2- 172.21.15.153:0/1294890121 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b762d4b0 0x5637b762d8c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x5637b75dbf60 tx=0x7fbb98011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb30bee86dcbec17 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.272+0000 7fbaf37fe700 1 -- 172.21.15.153:0/1294890121 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb98025040 con 0x5637b762d4b0 2023-10-05T21:16:13.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.272+0000 7fbaf37fe700 1 -- 172.21.15.153:0/1294890121 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb98039450 con 0x5637b762d4b0 2023-10-05T21:16:13.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.272+0000 7fbaf37fe700 1 -- 172.21.15.153:0/1294890121 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb9801f480 con 0x5637b762d4b0 2023-10-05T21:16:13.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.273+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/1294890121 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b762d4b0 msgr2=0x5637b762d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.273+0000 7fbbb3fc3680 1 --2- 172.21.15.153:0/1294890121 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b762d4b0 0x5637b762d8c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x5637b75dbf60 tx=0x7fbb98011000 comp rx=0 tx=0).stop 2023-10-05T21:16:13.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.273+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/1294890121 shutdown_connections 2023-10-05T21:16:13.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.273+0000 7fbbb3fc3680 1 --2- 172.21.15.153:0/1294890121 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b762d4b0 0x5637b762d8c0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.273+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/1294890121 >> 172.21.15.153:0/1294890121 conn(0x5637b76286b0 msgr2=0x5637b7626810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.273+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/1294890121 shutdown_connections 2023-10-05T21:16:13.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.273+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/1294890121 wait complete. 2023-10-05T21:16:13.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.274+0000 7fbbb3fc3680 1 Processor -- start 2023-10-05T21:16:13.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.274+0000 7fbbb3fc3680 1 -- start start 2023-10-05T21:16:13.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.274+0000 7fbbb3fc3680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b762d4b0 0x5637b7632fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.274+0000 7fbbb3fc3680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637b7633500 con 0x5637b762d4b0 2023-10-05T21:16:13.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.274+0000 7fbba689a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b762d4b0 0x5637b7632fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.274+0000 7fbba689a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b762d4b0 0x5637b7632fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54838/0 (socket says 172.21.15.153:54838) 2023-10-05T21:16:13.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.274+0000 7fbba689a700 1 -- 172.21.15.153:0/3236034632 learned_addr learned my addr 172.21.15.153:0/3236034632 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:13.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.274+0000 7fbba689a700 1 -- 172.21.15.153:0/3236034632 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637b75e54f0 con 0x5637b762d4b0 2023-10-05T21:16:13.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.274+0000 7fbba689a700 1 --2- 172.21.15.153:0/3236034632 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b762d4b0 0x5637b7632fc0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x5637b7627c20 tx=0x7fbb98039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.275+0000 7fbaf1ffb700 1 -- 172.21.15.153:0/3236034632 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb98025040 con 0x5637b762d4b0 2023-10-05T21:16:13.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.275+0000 7fbaf1ffb700 1 -- 172.21.15.153:0/3236034632 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb98047070 con 0x5637b762d4b0 2023-10-05T21:16:13.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.275+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/3236034632 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5637b7633700 con 0x5637b762d4b0 2023-10-05T21:16:13.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.275+0000 7fbaf1ffb700 1 -- 172.21.15.153:0/3236034632 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb9804c610 con 0x5637b762d4b0 2023-10-05T21:16:13.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.275+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/3236034632 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5637b7633bb0 con 0x5637b762d4b0 2023-10-05T21:16:13.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.275+0000 7fbaf1ffb700 1 -- 172.21.15.153:0/3236034632 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fbb98049070 con 0x5637b762d4b0 2023-10-05T21:16:13.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.276+0000 7fbaf1ffb700 1 --2- 172.21.15.153:0/3236034632 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbae4034140 0x7fbae40365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.276+0000 7fbaf1ffb700 1 -- 172.21.15.153:0/3236034632 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fbb98032030 con 0x5637b762d4b0 2023-10-05T21:16:13.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.276+0000 7fbbb3fc3680 5 note: GC not initialized 2023-10-05T21:16:13.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.276+0000 7fbba789c700 1 --2- 172.21.15.153:0/3236034632 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbae4034140 0x7fbae40365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.276+0000 7fbba789c700 1 --2- 172.21.15.153:0/3236034632 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbae4034140 0x7fbae40365f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x5637b761ef10 tx=0x7fbba0036440 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.277+0000 7fbaeaffd700 20 reqs_thread_entry: start 2023-10-05T21:16:13.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.277+0000 7fbae8ff9700 20 reqs_thread_entry: start 2023-10-05T21:16:13.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.277+0000 7fbbb3fc3680 20 init_complete bucket index max shards: 11 2023-10-05T21:16:13.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.277+0000 7fbbb3fc3680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:16:13.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.277+0000 7fbad6ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:16:43 2023 2023-10-05T21:16:13.303 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:16:13.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.277+0000 7fbad67fc700 20 reqs_thread_entry: start 2023-10-05T21:16:13.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.277+0000 7fbbb3fc3680 20 get_system_obj_state: rctx=0x7ffc3d1130a8 obj=default.rgw.meta:users.uid:foo state=0x5637b748e240 s->prefetch_data=0 2023-10-05T21:16:13.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.277+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b7698880 con 0x5637b75e1bc0 2023-10-05T21:16:13.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.277+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.277+0000 7fbbb3fc3680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:16:13.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.277+0000 7fbbb3fc3680 20 Read xattr: user.rgw.idtag 2023-10-05T21:16:13.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.278+0000 7fbbb3fc3680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.278+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b769ab10 con 0x5637b75e1bc0 2023-10-05T21:16:13.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.278+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.278+0000 7fbbb3fc3680 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T21:16:13.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.278+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:104 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b769ab10 con 0x7fbb98007030 2023-10-05T21:16:13.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.278+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(104 usage.10 [call out=1268b] v0'0 uv32 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7fbba000a570 con 0x7fbb98007030 2023-10-05T21:16:13.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.279+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94797299811840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b769a620 con 0x7fbb9c0163b0 2023-10-05T21:16:13.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.279+0000 7fbba689a700 1 -- 172.21.15.153:0/881565624 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(105 notify.0 [watch unwatch cookie 94797299811840] v31'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb9803f020 con 0x7fbb9c0163b0 2023-10-05T21:16:13.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.279+0000 7fbbb3fc3680 20 remove_watcher() i=0 2023-10-05T21:16:13.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.279+0000 7fbbb3fc3680 2 removed watcher, disabling cache 2023-10-05T21:16:13.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.279+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94797299818944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b769a620 con 0x5637b75e1bc0 2023-10-05T21:16:13.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.280+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(106 notify.1 [watch unwatch cookie 94797299818944] v31'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.280+0000 7fbbb3fc3680 20 remove_watcher() i=1 2023-10-05T21:16:13.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.280+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94797299822640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b769a620 con 0x5637b7611f40 2023-10-05T21:16:13.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.281+0000 7fbba709b700 1 -- 172.21.15.153:0/881565624 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(107 notify.2 [watch unwatch cookie 94797299822640] v31'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb9c014070 con 0x5637b7611f40 2023-10-05T21:16:13.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.281+0000 7fbbb3fc3680 20 remove_watcher() i=2 2023-10-05T21:16:13.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.281+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94797299828368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b769a620 con 0x7fbb9c0163b0 2023-10-05T21:16:13.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.282+0000 7fbba689a700 1 -- 172.21.15.153:0/881565624 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(108 notify.3 [watch unwatch cookie 94797299828368] v31'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb9803f020 con 0x7fbb9c0163b0 2023-10-05T21:16:13.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.282+0000 7fbbb3fc3680 20 remove_watcher() i=3 2023-10-05T21:16:13.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.282+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94797299832048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b769a620 con 0x5637b75e1bc0 2023-10-05T21:16:13.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.283+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(109 notify.4 [watch unwatch cookie 94797299832048] v31'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.283+0000 7fbbb3fc3680 20 remove_watcher() i=4 2023-10-05T21:16:13.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.283+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94797299833152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b769a620 con 0x7fbb98007030 2023-10-05T21:16:13.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.283+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(110 notify.5 [watch unwatch cookie 94797299833152] v31'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbba000a570 con 0x7fbb98007030 2023-10-05T21:16:13.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.283+0000 7fbbb3fc3680 20 remove_watcher() i=5 2023-10-05T21:16:13.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.283+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:111 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94797299835728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b769a620 con 0x7fbb98007030 2023-10-05T21:16:13.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.284+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(111 notify.6 [watch unwatch cookie 94797299835728] v31'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbba000a570 con 0x7fbb98007030 2023-10-05T21:16:13.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.284+0000 7fbbb3fc3680 20 remove_watcher() i=6 2023-10-05T21:16:13.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.284+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94797299839408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b761d9e0 con 0x7fbb98007030 2023-10-05T21:16:13.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.285+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(112 notify.7 [watch unwatch cookie 94797299839408] v31'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbba000a570 con 0x7fbb98007030 2023-10-05T21:16:13.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.285+0000 7fbbb3fc3680 20 remove_watcher() i=7 2023-10-05T21:16:13.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.286+0000 7fbaf3fff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:16:13.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.286+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:113 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94797299837296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637b769a620 con 0x5637b75e1bc0 2023-10-05T21:16:13.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.286+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(113 data_loggenerations_metadata [watch unwatch cookie 94797299837296] v31'224 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbba000a570 con 0x5637b75e1bc0 2023-10-05T21:16:13.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.286+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fbb98007030 msgr2=0x7fbb9801d430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.286+0000 7fbbb3fc3680 1 --2- 172.21.15.153:0/881565624 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fbb98007030 0x7fbb9801d430 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.287+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5637b75e1bc0 msgr2=0x5637b760fad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.287+0000 7fbbb3fc3680 1 --2- 172.21.15.153:0/881565624 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5637b75e1bc0 0x5637b760fad0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.287+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fbb9c0163b0 msgr2=0x7fbb9c022560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.287+0000 7fbbb3fc3680 1 --2- 172.21.15.153:0/881565624 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fbb9c0163b0 0x7fbb9c022560 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.287+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5637b7611f40 msgr2=0x5637b7614320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.287+0000 7fbbb3fc3680 1 --2- 172.21.15.153:0/881565624 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5637b7611f40 0x5637b7614320 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.287+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbb8c034140 msgr2=0x7fbb8c0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.287+0000 7fbbb3fc3680 1 --2- 172.21.15.153:0/881565624 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbb8c034140 0x7fbb8c0365f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800afd0 tx=0x7fbb98014000 comp rx=0 tx=0).stop 2023-10-05T21:16:13.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.287+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b754f0b0 msgr2=0x5637b7603db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.287+0000 7fbba789c700 1 -- 172.21.15.153:0/881565624 reap_dead start 2023-10-05T21:16:13.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.287+0000 7fbbb3fc3680 1 --2- 172.21.15.153:0/881565624 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b754f0b0 0x5637b7603db0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x5637b75fd690 tx=0x7fbb9c016000 comp rx=0 tx=0).stop 2023-10-05T21:16:13.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.287+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 shutdown_connections 2023-10-05T21:16:13.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.287+0000 7fbbb3fc3680 1 --2- 172.21.15.153:0/881565624 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b754f0b0 0x5637b7603db0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.287+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 >> 172.21.15.153:0/881565624 conn(0x5637b75d5b90 msgr2=0x5637b75f6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.287+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 shutdown_connections 2023-10-05T21:16:13.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.287+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/881565624 wait complete. 2023-10-05T21:16:13.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.287+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/3236034632 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbae4034140 msgr2=0x7fbae40365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.287+0000 7fbbb3fc3680 1 --2- 172.21.15.153:0/3236034632 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbae4034140 0x7fbae40365f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x5637b761ef10 tx=0x7fbba0036440 comp rx=0 tx=0).stop 2023-10-05T21:16:13.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.287+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/3236034632 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b762d4b0 msgr2=0x5637b7632fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.287+0000 7fbbb3fc3680 1 --2- 172.21.15.153:0/3236034632 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b762d4b0 0x5637b7632fc0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x5637b7627c20 tx=0x7fbb98039000 comp rx=0 tx=0).stop 2023-10-05T21:16:13.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.287+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/3236034632 shutdown_connections 2023-10-05T21:16:13.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.287+0000 7fbbb3fc3680 1 --2- 172.21.15.153:0/3236034632 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fbae4034140 0x7fbae40365f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.287+0000 7fbbb3fc3680 1 --2- 172.21.15.153:0/3236034632 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5637b762d4b0 0x5637b7632fc0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.287+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/3236034632 >> 172.21.15.153:0/3236034632 conn(0x5637b76286b0 msgr2=0x5637b76267e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.287+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/3236034632 shutdown_connections 2023-10-05T21:16:13.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.287+0000 7fbbb3fc3680 1 -- 172.21.15.153:0/3236034632 wait complete. 2023-10-05T21:16:13.315 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:16:13.315 INFO:teuthology.orchestra.run.smithi153.stdout: "entries": [ 2023-10-05T21:16:13.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.315 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:16:13.315 INFO:teuthology.orchestra.run.smithi153.stdout: "buckets": [ 2023-10-05T21:16:13.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.316 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "", 2023-10-05T21:16:13.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:13.316 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:13.316 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:13.316 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [] 2023-10-05T21:16:13.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.316 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo", 2023-10-05T21:16:13.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:13.316 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:13.316 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:13.316 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [ 2023-10-05T21:16:13.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.317 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "create_bucket", 2023-10-05T21:16:13.317 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:13.317 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.317 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 5, 2023-10-05T21:16:13.317 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 5 2023-10-05T21:16:13.317 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.317 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:13.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.317 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo2", 2023-10-05T21:16:13.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:13.318 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:13.318 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:13.318 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [ 2023-10-05T21:16:13.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.318 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "create_bucket", 2023-10-05T21:16:13.318 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:13.318 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.318 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:13.318 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:13.318 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.318 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:13.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.319 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo3", 2023-10-05T21:16:13.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:13.319 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:13.319 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:13.319 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [ 2023-10-05T21:16:13.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.319 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "create_bucket", 2023-10-05T21:16:13.319 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:13.319 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.319 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:13.320 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:13.320 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.320 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:13.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.320 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo4", 2023-10-05T21:16:13.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:13.320 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:13.320 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:13.320 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [ 2023-10-05T21:16:13.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.320 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "create_bucket", 2023-10-05T21:16:13.321 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:13.321 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.321 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:13.321 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:13.321 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.321 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:13.321 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.321 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:13.321 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.321 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:16:13.321 INFO:teuthology.orchestra.run.smithi153.stdout: "summary": [ 2023-10-05T21:16:13.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.322 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:16:13.322 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [ 2023-10-05T21:16:13.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.322 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "create_bucket", 2023-10-05T21:16:13.322 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:13.322 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.322 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 8, 2023-10-05T21:16:13.322 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 8 2023-10-05T21:16:13.322 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.322 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:16:13.322 INFO:teuthology.orchestra.run.smithi153.stdout: "total": { 2023-10-05T21:16:13.322 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:13.323 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.323 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 8, 2023-10-05T21:16:13.323 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 8 2023-10-05T21:16:13.323 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.323 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.323 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:13.323 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:16:13.323 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2023-10-05T21:16:13.323 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2023-10-05T21:16:13.324 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2023-10-05T21:16:13.324 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2023-10-05T21:16:13.370 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:16:13.370 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:16:13.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.369+0000 7eff8127d680 1 Processor -- start 2023-10-05T21:16:13.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.369+0000 7eff8127d680 1 -- start start 2023-10-05T21:16:13.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.370+0000 7eff8127d680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5587e801a7c0 0x5587e801abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.370+0000 7eff8127d680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5587e7f69930 con 0x5587e801b110 2023-10-05T21:16:13.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.370+0000 7eff8127d680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x5587e7f29db0 con 0x5587e801a7c0 2023-10-05T21:16:13.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.370+0000 7eff74355700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5587e801a7c0 0x5587e801abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.370+0000 7eff74355700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5587e801a7c0 0x5587e801abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54850/0 (socket says 172.21.15.153:54850) 2023-10-05T21:16:13.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.370+0000 7eff74355700 1 -- 172.21.15.153:0/784475334 learned_addr learned my addr 172.21.15.153:0/784475334 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:13.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.370+0000 7eff73b54700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x5587e801b110 0x5587e801d9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:57806/0 (socket says 172.21.15.153:57806) 2023-10-05T21:16:13.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.370+0000 7eff74355700 1 -- 172.21.15.153:0/784475334 >> v1:172.21.15.111:6789/0 conn(0x5587e801b110 legacy=0x5587e801d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.370+0000 7eff73353700 1 -- 172.21.15.153:0/784475334 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885759743 0 0) 0x5587e7f69930 con 0x5587e801b110 2023-10-05T21:16:13.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.370+0000 7eff74355700 1 -- 172.21.15.153:0/784475334 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587e801e1c0 con 0x5587e801a7c0 2023-10-05T21:16:13.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.371+0000 7eff74355700 1 --2- 172.21.15.153:0/784475334 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5587e801a7c0 0x5587e801abd0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00a650 tx=0x7eff5c005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59d2b74ccaeead6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.371+0000 7eff73353700 1 -- 172.21.15.153:0/784475334 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff5c008760 con 0x5587e801a7c0 2023-10-05T21:16:13.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.371+0000 7eff73353700 1 -- 172.21.15.153:0/784475334 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c0088c0 con 0x5587e801a7c0 2023-10-05T21:16:13.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.371+0000 7eff73353700 1 -- 172.21.15.153:0/784475334 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff5c008bb0 con 0x5587e801a7c0 2023-10-05T21:16:13.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.371+0000 7eff8127d680 1 -- 172.21.15.153:0/784475334 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5587e801a7c0 msgr2=0x5587e801abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.371+0000 7eff8127d680 1 --2- 172.21.15.153:0/784475334 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5587e801a7c0 0x5587e801abd0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00a650 tx=0x7eff5c005b10 comp rx=0 tx=0).stop 2023-10-05T21:16:13.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.371+0000 7eff8127d680 1 -- 172.21.15.153:0/784475334 shutdown_connections 2023-10-05T21:16:13.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.371+0000 7eff8127d680 1 --2- 172.21.15.153:0/784475334 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5587e801a7c0 0x5587e801abd0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.371+0000 7eff8127d680 1 -- 172.21.15.153:0/784475334 >> 172.21.15.153:0/784475334 conn(0x5587e8016310 msgr2=0x5587e8018720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.371+0000 7eff8127d680 1 -- 172.21.15.153:0/784475334 shutdown_connections 2023-10-05T21:16:13.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.371+0000 7eff8127d680 1 -- 172.21.15.153:0/784475334 wait complete. 2023-10-05T21:16:13.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.372+0000 7eff8127d680 1 Processor -- start 2023-10-05T21:16:13.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.372+0000 7eff8127d680 1 -- start start 2023-10-05T21:16:13.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.372+0000 7eff8127d680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5587e801a7c0 0x5587e803b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.372+0000 7eff8127d680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587e7ec9ea0 con 0x5587e801a7c0 2023-10-05T21:16:13.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.372+0000 7eff74355700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5587e801a7c0 0x5587e803b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.372+0000 7eff74355700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5587e801a7c0 0x5587e803b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54852/0 (socket says 172.21.15.153:54852) 2023-10-05T21:16:13.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.372+0000 7eff74355700 1 -- 172.21.15.153:0/3652179074 learned_addr learned my addr 172.21.15.153:0/3652179074 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:13.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.373+0000 7eff74355700 1 -- 172.21.15.153:0/3652179074 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5c005db0 con 0x5587e801a7c0 2023-10-05T21:16:13.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.373+0000 7eff74355700 1 --2- 172.21.15.153:0/3652179074 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5587e801a7c0 0x5587e803b980 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00a5a0 tx=0x7eff5c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f288a132094026 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.373+0000 7eff72351700 1 -- 172.21.15.153:0/3652179074 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff5c0055f0 con 0x5587e801a7c0 2023-10-05T21:16:13.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.373+0000 7eff72351700 1 -- 172.21.15.153:0/3652179074 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c008a30 con 0x5587e801a7c0 2023-10-05T21:16:13.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.373+0000 7eff72351700 1 -- 172.21.15.153:0/3652179074 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff5c008d00 con 0x5587e801a7c0 2023-10-05T21:16:13.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.373+0000 7eff8127d680 1 -- 172.21.15.153:0/3652179074 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5587e801a7c0 msgr2=0x5587e803b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.373+0000 7eff8127d680 1 --2- 172.21.15.153:0/3652179074 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5587e801a7c0 0x5587e803b980 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00a5a0 tx=0x7eff5c015000 comp rx=0 tx=0).stop 2023-10-05T21:16:13.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.373+0000 7eff8127d680 1 -- 172.21.15.153:0/3652179074 shutdown_connections 2023-10-05T21:16:13.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.373+0000 7eff8127d680 1 --2- 172.21.15.153:0/3652179074 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5587e801a7c0 0x5587e803b980 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.373+0000 7eff8127d680 1 -- 172.21.15.153:0/3652179074 >> 172.21.15.153:0/3652179074 conn(0x5587e8016310 msgr2=0x5587e8037450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.374+0000 7eff8127d680 1 -- 172.21.15.153:0/3652179074 shutdown_connections 2023-10-05T21:16:13.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.374+0000 7eff8127d680 1 -- 172.21.15.153:0/3652179074 wait complete. 2023-10-05T21:16:13.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.374+0000 7eff8127d680 1 Processor -- start 2023-10-05T21:16:13.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.374+0000 7eff8127d680 1 -- start start 2023-10-05T21:16:13.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.374+0000 7eff8127d680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5587e801a7c0 0x5587e8042d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.374+0000 7eff8127d680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587e7ec0c80 con 0x5587e801a7c0 2023-10-05T21:16:13.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.374+0000 7eff74355700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5587e801a7c0 0x5587e8042d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.374+0000 7eff74355700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5587e801a7c0 0x5587e8042d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54854/0 (socket says 172.21.15.153:54854) 2023-10-05T21:16:13.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.374+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 learned_addr learned my addr 172.21.15.153:0/1839242947 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:13.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.374+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587e801e1c0 con 0x5587e801a7c0 2023-10-05T21:16:13.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.375+0000 7eff74355700 1 --2- 172.21.15.153:0/1839242947 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5587e801a7c0 0x5587e8042d00 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00a650 tx=0x7eff5c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.375+0000 7eff70b4e700 1 -- 172.21.15.153:0/1839242947 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff5c026a90 con 0x5587e801a7c0 2023-10-05T21:16:13.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.375+0000 7eff70b4e700 1 -- 172.21.15.153:0/1839242947 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c026bf0 con 0x5587e801a7c0 2023-10-05T21:16:13.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.375+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5587e8043240 con 0x5587e801a7c0 2023-10-05T21:16:13.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.375+0000 7eff70b4e700 1 -- 172.21.15.153:0/1839242947 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff5c012450 con 0x5587e801a7c0 2023-10-05T21:16:13.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.375+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5587e80436f0 con 0x5587e801a7c0 2023-10-05T21:16:13.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.376+0000 7eff70b4e700 1 -- 172.21.15.153:0/1839242947 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7eff5c0125b0 con 0x5587e801a7c0 2023-10-05T21:16:13.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.376+0000 7eff8127d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.376+0000 7eff70b4e700 1 --2- 172.21.15.153:0/1839242947 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7eff54034140 0x7eff540365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.376+0000 7eff70b4e700 1 -- 172.21.15.153:0/1839242947 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7eff5c04a3f0 con 0x5587e801a7c0 2023-10-05T21:16:13.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.376+0000 7eff73b54700 1 --2- 172.21.15.153:0/1839242947 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7eff54034140 0x7eff540365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.376+0000 7eff8127d680 1 --2- 172.21.15.153:0/1839242947 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5587e801b110 0x5587e804ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.376+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e804f1b0 con 0x5587e801b110 2023-10-05T21:16:13.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.376+0000 7eff74b56700 1 --2- 172.21.15.153:0/1839242947 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5587e801b110 0x5587e804ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.377+0000 7eff73b54700 1 --2- 172.21.15.153:0/1839242947 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7eff54034140 0x7eff540365f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7eff640011e0 tx=0x7eff640013c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.377+0000 7eff74b56700 1 --2- 172.21.15.153:0/1839242947 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5587e801b110 0x5587e804ea40 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.377+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.377+0000 7eff8127d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.377+0000 7eff8127d680 20 realm 2023-10-05T21:16:13.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.377+0000 7eff8127d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.377+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e804c0a0 con 0x5587e801b110 2023-10-05T21:16:13.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.377+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.377+0000 7eff8127d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.377+0000 7eff8127d680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:16:13.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.377+0000 7eff8127d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.377+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e804fc60 con 0x5587e801b110 2023-10-05T21:16:13.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.377+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.378+0000 7eff8127d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.378+0000 7eff8127d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.378+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e804f860 con 0x5587e801b110 2023-10-05T21:16:13.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.378+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.378+0000 7eff8127d680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:13.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.378+0000 7eff8127d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.378+0000 7eff8127d680 1 --2- 172.21.15.153:0/1839242947 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5587e8050fd0 0x5587e80533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.378+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e80538f0 con 0x5587e8050fd0 2023-10-05T21:16:13.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.378+0000 7eff74355700 1 --2- 172.21.15.153:0/1839242947 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5587e8050fd0 0x5587e80533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.378+0000 7eff74355700 1 --2- 172.21.15.153:0/1839242947 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5587e8050fd0 0x5587e80533b0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.378+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7eff5c019040 con 0x5587e8050fd0 2023-10-05T21:16:13.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.378+0000 7eff8127d680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:16:13.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.378+0000 7eff8127d680 20 searching for the correct realm 2023-10-05T21:16:13.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.378+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e80551a0 con 0x5587e8050fd0 2023-10-05T21:16:13.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.379+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff5c019040 con 0x5587e8050fd0 2023-10-05T21:16:13.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.379+0000 7eff74355700 1 --2- 172.21.15.153:0/1839242947 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7eff5c007030 0x7eff5c0375d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.379+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e80551a0 con 0x7eff5c007030 2023-10-05T21:16:13.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.379+0000 7eff73b54700 1 --2- 172.21.15.153:0/1839242947 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7eff5c007030 0x7eff5c0375d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.379+0000 7eff73b54700 1 --2- 172.21.15.153:0/1839242947 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7eff5c007030 0x7eff5c0375d0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.379+0000 7eff73b54700 1 -- 172.21.15.153:0/1839242947 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6400f620 con 0x7eff5c007030 2023-10-05T21:16:13.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.379+0000 7eff73b54700 1 --2- 172.21.15.153:0/1839242947 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7eff6400e8c0 0x7eff6400d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.379+0000 7eff73b54700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e80551a0 con 0x7eff6400e8c0 2023-10-05T21:16:13.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.380+0000 7eff74b56700 1 --2- 172.21.15.153:0/1839242947 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7eff6400e8c0 0x7eff6400d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.380+0000 7eff74b56700 1 --2- 172.21.15.153:0/1839242947 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7eff6400e8c0 0x7eff6400d310 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.380+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6c00a570 con 0x7eff6400e8c0 2023-10-05T21:16:13.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.380+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e80551a0 con 0x5587e801b110 2023-10-05T21:16:13.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.380+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.380+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e80551a0 con 0x5587e801b110 2023-10-05T21:16:13.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.381+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.381+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e80551a0 con 0x7eff6400e8c0 2023-10-05T21:16:13.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.381+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6c00a570 con 0x7eff6400e8c0 2023-10-05T21:16:13.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.381+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e80551a0 con 0x7eff6400e8c0 2023-10-05T21:16:13.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.381+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6c00a570 con 0x7eff6400e8c0 2023-10-05T21:16:13.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.381+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e80551a0 con 0x7eff5c007030 2023-10-05T21:16:13.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.381+0000 7eff73b54700 1 -- 172.21.15.153:0/1839242947 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6400f620 con 0x7eff5c007030 2023-10-05T21:16:13.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.381+0000 7eff73b54700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e80551a0 con 0x5587e8050fd0 2023-10-05T21:16:13.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.382+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7eff5c019040 con 0x5587e8050fd0 2023-10-05T21:16:13.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.382+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e80551a0 con 0x5587e801b110 2023-10-05T21:16:13.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.382+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.382+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e80551a0 con 0x7eff6400e8c0 2023-10-05T21:16:13.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.382+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6c00a570 con 0x7eff6400e8c0 2023-10-05T21:16:13.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.382+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e80551a0 con 0x5587e801b110 2023-10-05T21:16:13.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.382+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.382+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e80551a0 con 0x7eff5c007030 2023-10-05T21:16:13.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.382+0000 7eff73b54700 1 -- 172.21.15.153:0/1839242947 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6400f620 con 0x7eff5c007030 2023-10-05T21:16:13.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.382+0000 7eff73b54700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7eff6401f040 con 0x5587e8050fd0 2023-10-05T21:16:13.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.383+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff5c019040 con 0x5587e8050fd0 2023-10-05T21:16:13.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.383+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7eff6401f040 con 0x5587e8050fd0 2023-10-05T21:16:13.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.383+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff5c019040 con 0x5587e8050fd0 2023-10-05T21:16:13.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.383+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7eff6401f040 con 0x7eff6400e8c0 2023-10-05T21:16:13.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.383+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6c00a570 con 0x7eff6400e8c0 2023-10-05T21:16:13.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.383+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7eff6401f040 con 0x5587e8050fd0 2023-10-05T21:16:13.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.383+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff5c019040 con 0x5587e8050fd0 2023-10-05T21:16:13.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.383+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7eff6401f040 con 0x5587e8050fd0 2023-10-05T21:16:13.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.384+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff5c019040 con 0x5587e8050fd0 2023-10-05T21:16:13.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.384+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7eff6401f040 con 0x5587e801b110 2023-10-05T21:16:13.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.384+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.384+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7eff6401f040 con 0x5587e801b110 2023-10-05T21:16:13.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.384+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.384+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7eff6401f040 con 0x7eff6400e8c0 2023-10-05T21:16:13.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.384+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6c00a570 con 0x7eff6400e8c0 2023-10-05T21:16:13.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.384+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7eff6401f040 con 0x5587e8050fd0 2023-10-05T21:16:13.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.384+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff5c019040 con 0x5587e8050fd0 2023-10-05T21:16:13.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.384+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7eff6401f040 con 0x7eff5c007030 2023-10-05T21:16:13.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.385+0000 7eff73b54700 1 -- 172.21.15.153:0/1839242947 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6400f620 con 0x7eff5c007030 2023-10-05T21:16:13.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.385+0000 7eff73b54700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7eff6401f040 con 0x5587e801b110 2023-10-05T21:16:13.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.385+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.385+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7eff6401f040 con 0x7eff6400e8c0 2023-10-05T21:16:13.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.385+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6c00a570 con 0x7eff6400e8c0 2023-10-05T21:16:13.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.385+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7eff6401f040 con 0x5587e8050fd0 2023-10-05T21:16:13.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.385+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff5c019040 con 0x5587e8050fd0 2023-10-05T21:16:13.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.385+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7eff6401f040 con 0x7eff6400e8c0 2023-10-05T21:16:13.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.386+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6c00a570 con 0x7eff6400e8c0 2023-10-05T21:16:13.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.386+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7eff6401f040 con 0x7eff5c007030 2023-10-05T21:16:13.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.386+0000 7eff73b54700 1 -- 172.21.15.153:0/1839242947 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6400f620 con 0x7eff5c007030 2023-10-05T21:16:13.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.386+0000 7eff73b54700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7eff6401f040 con 0x5587e8050fd0 2023-10-05T21:16:13.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.386+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff5c019040 con 0x5587e8050fd0 2023-10-05T21:16:13.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.386+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7eff6401f040 con 0x7eff6400e8c0 2023-10-05T21:16:13.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.386+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6c00a570 con 0x7eff6400e8c0 2023-10-05T21:16:13.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.386+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7eff6401f040 con 0x5587e801b110 2023-10-05T21:16:13.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.386+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.386+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7eff6401f040 con 0x7eff5c007030 2023-10-05T21:16:13.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.387+0000 7eff73b54700 1 -- 172.21.15.153:0/1839242947 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6400f620 con 0x7eff5c007030 2023-10-05T21:16:13.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.387+0000 7eff8127d680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:16:13.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.387+0000 7eff8127d680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:16:13.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.387+0000 7eff8127d680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:16:13.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.387+0000 7eff8127d680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:16:13.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.387+0000 7eff8127d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.387+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e80542c0 con 0x5587e801b110 2023-10-05T21:16:13.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.387+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.387+0000 7eff8127d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.387+0000 7eff8127d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.387+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8054750 con 0x5587e801b110 2023-10-05T21:16:13.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.387+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.387+0000 7eff8127d680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:13.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.387+0000 7eff8127d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.387+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8054b80 con 0x5587e801b110 2023-10-05T21:16:13.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.387+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.387+0000 7eff8127d680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:16:13.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.387+0000 7eff8127d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.387+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8055550 con 0x5587e8050fd0 2023-10-05T21:16:13.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.388+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7eff5c019040 con 0x5587e8050fd0 2023-10-05T21:16:13.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.388+0000 7eff8127d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.388+0000 7eff8127d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.388+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8055900 con 0x5587e801b110 2023-10-05T21:16:13.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.388+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.388+0000 7eff8127d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.388+0000 7eff8127d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.388+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8055d30 con 0x5587e801b110 2023-10-05T21:16:13.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.388+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.388+0000 7eff8127d680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:13.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.388+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8056d40 con 0x5587e8050fd0 2023-10-05T21:16:13.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.388+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff5c019040 con 0x5587e8050fd0 2023-10-05T21:16:13.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.388+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8056d40 con 0x7eff5c007030 2023-10-05T21:16:13.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.388+0000 7eff73b54700 1 -- 172.21.15.153:0/1839242947 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6400f620 con 0x7eff5c007030 2023-10-05T21:16:13.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.389+0000 7eff73b54700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8056d40 con 0x7eff6400e8c0 2023-10-05T21:16:13.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.389+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6c00a570 con 0x7eff6400e8c0 2023-10-05T21:16:13.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.389+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8054b80 con 0x5587e801b110 2023-10-05T21:16:13.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.389+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.389+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8054b80 con 0x5587e801b110 2023-10-05T21:16:13.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.389+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.389+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8054b80 con 0x7eff6400e8c0 2023-10-05T21:16:13.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.390+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6c00a570 con 0x7eff6400e8c0 2023-10-05T21:16:13.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.390+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8054b80 con 0x7eff6400e8c0 2023-10-05T21:16:13.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.390+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6c00a570 con 0x7eff6400e8c0 2023-10-05T21:16:13.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.390+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8054b80 con 0x7eff5c007030 2023-10-05T21:16:13.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.390+0000 7eff73b54700 1 -- 172.21.15.153:0/1839242947 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6400f620 con 0x7eff5c007030 2023-10-05T21:16:13.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.390+0000 7eff73b54700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8054b80 con 0x5587e8050fd0 2023-10-05T21:16:13.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.390+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7eff5c019040 con 0x5587e8050fd0 2023-10-05T21:16:13.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.390+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8054b80 con 0x5587e801b110 2023-10-05T21:16:13.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.390+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.390+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8054b80 con 0x7eff6400e8c0 2023-10-05T21:16:13.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.391+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6c00a570 con 0x7eff6400e8c0 2023-10-05T21:16:13.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.391+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8054b80 con 0x5587e801b110 2023-10-05T21:16:13.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.391+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.391+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8054b80 con 0x7eff5c007030 2023-10-05T21:16:13.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.391+0000 7eff73b54700 1 -- 172.21.15.153:0/1839242947 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6400f620 con 0x7eff5c007030 2023-10-05T21:16:13.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.391+0000 7eff73b54700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8054b80 con 0x5587e8050fd0 2023-10-05T21:16:13.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.392+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff5c019040 con 0x5587e8050fd0 2023-10-05T21:16:13.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.392+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8054b80 con 0x5587e8050fd0 2023-10-05T21:16:13.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.392+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff5c019040 con 0x5587e8050fd0 2023-10-05T21:16:13.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.392+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8054b80 con 0x7eff6400e8c0 2023-10-05T21:16:13.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.392+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6c00a570 con 0x7eff6400e8c0 2023-10-05T21:16:13.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.392+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8054b80 con 0x5587e8050fd0 2023-10-05T21:16:13.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.392+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff5c019040 con 0x5587e8050fd0 2023-10-05T21:16:13.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.392+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8054b80 con 0x5587e8050fd0 2023-10-05T21:16:13.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.393+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff5c019040 con 0x5587e8050fd0 2023-10-05T21:16:13.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.393+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8054b80 con 0x5587e801b110 2023-10-05T21:16:13.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.393+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.393+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8054b80 con 0x5587e801b110 2023-10-05T21:16:13.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.393+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.393+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8054b80 con 0x7eff6400e8c0 2023-10-05T21:16:13.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.393+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6c00a570 con 0x7eff6400e8c0 2023-10-05T21:16:13.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.393+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8054b80 con 0x5587e8050fd0 2023-10-05T21:16:13.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.393+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff5c019040 con 0x5587e8050fd0 2023-10-05T21:16:13.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.393+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8054b80 con 0x7eff5c007030 2023-10-05T21:16:13.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.394+0000 7eff73b54700 1 -- 172.21.15.153:0/1839242947 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6400f620 con 0x7eff5c007030 2023-10-05T21:16:13.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.394+0000 7eff73b54700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8054b80 con 0x5587e801b110 2023-10-05T21:16:13.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.394+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.394+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8054b80 con 0x7eff6400e8c0 2023-10-05T21:16:13.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.394+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6c00a570 con 0x7eff6400e8c0 2023-10-05T21:16:13.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.394+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8054b80 con 0x5587e8050fd0 2023-10-05T21:16:13.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.394+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff5c019040 con 0x5587e8050fd0 2023-10-05T21:16:13.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.394+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8054b80 con 0x7eff6400e8c0 2023-10-05T21:16:13.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.395+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6c00a570 con 0x7eff6400e8c0 2023-10-05T21:16:13.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.395+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8054b80 con 0x7eff5c007030 2023-10-05T21:16:13.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.395+0000 7eff73b54700 1 -- 172.21.15.153:0/1839242947 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6400f620 con 0x7eff5c007030 2023-10-05T21:16:13.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.395+0000 7eff73b54700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8054b80 con 0x5587e8050fd0 2023-10-05T21:16:13.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.395+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff5c019040 con 0x5587e8050fd0 2023-10-05T21:16:13.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.395+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8054b80 con 0x7eff6400e8c0 2023-10-05T21:16:13.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.395+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6c00a570 con 0x7eff6400e8c0 2023-10-05T21:16:13.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.395+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8054b80 con 0x5587e801b110 2023-10-05T21:16:13.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.395+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.395+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8054b80 con 0x7eff5c007030 2023-10-05T21:16:13.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.396+0000 7eff73b54700 1 -- 172.21.15.153:0/1839242947 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7eff6400f620 con 0x7eff5c007030 2023-10-05T21:16:13.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.396+0000 7eff8127d680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:16:13.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.396+0000 7eff8127d680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:16:13.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.396+0000 7eff8127d680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:16:13.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.396+0000 7eff8127d680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:16:13.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.396+0000 7eff8127d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.396+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8055d30 con 0x5587e801b110 2023-10-05T21:16:13.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.396+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.396+0000 7eff8127d680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:13.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.396+0000 7eff8127d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.396+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e80560e0 con 0x5587e8050fd0 2023-10-05T21:16:13.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.396+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7eff5c019040 con 0x5587e8050fd0 2023-10-05T21:16:13.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.396+0000 7eff8127d680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:16:13.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.396+0000 7eff8127d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.396+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8053ef0 con 0x5587e801b110 2023-10-05T21:16:13.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.396+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.396+0000 7eff8127d680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:13.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.396+0000 7eff8127d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.396+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8053ec0 con 0x5587e801b110 2023-10-05T21:16:13.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.397+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.397+0000 7eff8127d680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:16:13.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.397+0000 7eff8127d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.397+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8056a00 con 0x7eff6400e8c0 2023-10-05T21:16:13.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.397+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7eff6c00a570 con 0x7eff6400e8c0 2023-10-05T21:16:13.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.397+0000 7eff8127d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.397+0000 7eff8127d680 20 zone default found 2023-10-05T21:16:13.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.397+0000 7eff8127d680 4 Realm: () 2023-10-05T21:16:13.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.397+0000 7eff8127d680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:16:13.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.397+0000 7eff8127d680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:16:13.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.397+0000 7eff8127d680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:16:13.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.397+0000 7eff8127d680 20 zonegroup default 2023-10-05T21:16:13.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.397+0000 7eff8127d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.397+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8056980 con 0x7eff6400e8c0 2023-10-05T21:16:13.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.397+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7eff6c00a570 con 0x7eff6400e8c0 2023-10-05T21:16:13.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.397+0000 7eff8127d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.397+0000 7eff8127d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.397+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8058300 con 0x5587e8050fd0 2023-10-05T21:16:13.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.398+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7eff5c019040 con 0x5587e8050fd0 2023-10-05T21:16:13.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.398+0000 7eff8127d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.398+0000 7eff8127d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.398+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e80586b0 con 0x5587e8050fd0 2023-10-05T21:16:13.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.398+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7eff5c019040 con 0x5587e8050fd0 2023-10-05T21:16:13.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.398+0000 7eff8127d680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.398+0000 7eff8127d680 20 started sync module instance, tier type = 2023-10-05T21:16:13.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.398+0000 7eff8127d680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:16:13.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.398+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e80579c0 con 0x7eff5c007030 2023-10-05T21:16:13.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.399+0000 7eff73b54700 1 -- 172.21.15.153:0/1839242947 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v31'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff6400f620 con 0x7eff5c007030 2023-10-05T21:16:13.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.399+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94042201619904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8058f50 con 0x7eff5c007030 2023-10-05T21:16:13.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.399+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e80597f0 con 0x5587e801b110 2023-10-05T21:16:13.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.400+0000 7eff73b54700 1 -- 172.21.15.153:0/1839242947 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94042201619904] v31'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff6400f620 con 0x7eff5c007030 2023-10-05T21:16:13.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.400+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v31'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.400+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94042201623136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8059870 con 0x5587e801b110 2023-10-05T21:16:13.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.400+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e805a410 con 0x5587e8050fd0 2023-10-05T21:16:13.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.400+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v31'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff5c019040 con 0x5587e8050fd0 2023-10-05T21:16:13.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.400+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94042201623136] v31'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.400+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94042201628320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e805ad00 con 0x5587e8050fd0 2023-10-05T21:16:13.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.400+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e805b220 con 0x7eff5c007030 2023-10-05T21:16:13.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.401+0000 7eff73b54700 1 -- 172.21.15.153:0/1839242947 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v31'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff6400f620 con 0x7eff5c007030 2023-10-05T21:16:13.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.401+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94042201628320] v31'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff5c019040 con 0x5587e8050fd0 2023-10-05T21:16:13.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.401+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94042201630736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e805ac60 con 0x7eff5c007030 2023-10-05T21:16:13.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.401+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e805bfb0 con 0x5587e801b110 2023-10-05T21:16:13.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.402+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v31'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.402+0000 7eff73b54700 1 -- 172.21.15.153:0/1839242947 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94042201630736] v31'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff6400f620 con 0x7eff5c007030 2023-10-05T21:16:13.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.402+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94042201634816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e805c180 con 0x5587e801b110 2023-10-05T21:16:13.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.402+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e805cd50 con 0x7eff6400e8c0 2023-10-05T21:16:13.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.403+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94042201634816] v31'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.403+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v31'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff6c00a570 con 0x7eff6400e8c0 2023-10-05T21:16:13.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.403+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94042201638880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e805cd10 con 0x7eff6400e8c0 2023-10-05T21:16:13.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.403+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e805d7b0 con 0x7eff6400e8c0 2023-10-05T21:16:13.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.404+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(96 notify.6 [create] v31'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff6c00a570 con 0x7eff6400e8c0 2023-10-05T21:16:13.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.404+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(95 notify.5 [watch watch cookie 94042201638880] v31'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff6c00a570 con 0x7eff6400e8c0 2023-10-05T21:16:13.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.404+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94042201641664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e805d710 con 0x7eff6400e8c0 2023-10-05T21:16:13.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.404+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e805e2d0 con 0x7eff6400e8c0 2023-10-05T21:16:13.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.404+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94042201641664] v31'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff6c00a570 con 0x7eff6400e8c0 2023-10-05T21:16:13.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.404+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v31'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff6c00a570 con 0x7eff6400e8c0 2023-10-05T21:16:13.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.404+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94042201635920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e805e2d0 con 0x7eff6400e8c0 2023-10-05T21:16:13.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.404+0000 7eff8127d680 20 add_watcher() i=0 2023-10-05T21:16:13.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.404+0000 7eff8127d680 20 add_watcher() i=1 2023-10-05T21:16:13.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.404+0000 7eff8127d680 20 add_watcher() i=2 2023-10-05T21:16:13.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.404+0000 7eff8127d680 20 add_watcher() i=3 2023-10-05T21:16:13.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.404+0000 7eff8127d680 20 add_watcher() i=4 2023-10-05T21:16:13.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.404+0000 7eff8127d680 20 add_watcher() i=5 2023-10-05T21:16:13.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.404+0000 7eff8127d680 20 add_watcher() i=6 2023-10-05T21:16:13.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.405+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94042201635920] v31'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff6c00a570 con 0x7eff6400e8c0 2023-10-05T21:16:13.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.405+0000 7eff8127d680 20 add_watcher() i=7 2023-10-05T21:16:13.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.405+0000 7eff8127d680 2 all 8 watchers are set, enabling cache 2023-10-05T21:16:13.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.405+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e80617f0 con 0x5587e801b110 2023-10-05T21:16:13.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.406+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.406+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94042201645776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e805ec10 con 0x5587e801b110 2023-10-05T21:16:13.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.406+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94042201645776] v31'225 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.406+0000 7eff45fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:16:13.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.406+0000 7eff8127d680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:16:13.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.406+0000 7eff8127d680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:16:13.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.407+0000 7eff8127d680 1 Processor -- start 2023-10-05T21:16:13.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.407+0000 7eff8127d680 1 -- start start 2023-10-05T21:16:13.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.407+0000 7eff8127d680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5587e801ce50 0x5587e801d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.407+0000 7eff8127d680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587e801d7a0 con 0x5587e801ce50 2023-10-05T21:16:13.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.407+0000 7eff73b54700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5587e801ce50 0x5587e801d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.407+0000 7eff73b54700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5587e801ce50 0x5587e801d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54868/0 (socket says 172.21.15.153:54868) 2023-10-05T21:16:13.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.407+0000 7eff73b54700 1 -- 172.21.15.153:0/1589155589 learned_addr learned my addr 172.21.15.153:0/1589155589 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:13.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.407+0000 7eff73b54700 1 -- 172.21.15.153:0/1589155589 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587e801b6d0 con 0x5587e801ce50 2023-10-05T21:16:13.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.407+0000 7eff73b54700 1 --2- 172.21.15.153:0/1589155589 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5587e801ce50 0x5587e801d260 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x5587e8050010 tx=0x7eff64006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a555fc12cc2c44 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.408+0000 7eff457e2700 1 -- 172.21.15.153:0/1589155589 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff6400dae0 con 0x5587e801ce50 2023-10-05T21:16:13.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.408+0000 7eff457e2700 1 -- 172.21.15.153:0/1589155589 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6400dc40 con 0x5587e801ce50 2023-10-05T21:16:13.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.408+0000 7eff457e2700 1 -- 172.21.15.153:0/1589155589 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff6400ddd0 con 0x5587e801ce50 2023-10-05T21:16:13.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.408+0000 7eff8127d680 1 -- 172.21.15.153:0/1589155589 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5587e801ce50 msgr2=0x5587e801d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.408+0000 7eff8127d680 1 --2- 172.21.15.153:0/1589155589 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5587e801ce50 0x5587e801d260 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x5587e8050010 tx=0x7eff64006000 comp rx=0 tx=0).stop 2023-10-05T21:16:13.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.408+0000 7eff8127d680 1 -- 172.21.15.153:0/1589155589 shutdown_connections 2023-10-05T21:16:13.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.408+0000 7eff8127d680 1 --2- 172.21.15.153:0/1589155589 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5587e801ce50 0x5587e801d260 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.408+0000 7eff8127d680 1 -- 172.21.15.153:0/1589155589 >> 172.21.15.153:0/1589155589 conn(0x5587e80671f0 msgr2=0x5587e8065350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.408+0000 7eff8127d680 1 -- 172.21.15.153:0/1589155589 shutdown_connections 2023-10-05T21:16:13.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.408+0000 7eff8127d680 1 -- 172.21.15.153:0/1589155589 wait complete. 2023-10-05T21:16:13.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.409+0000 7eff8127d680 1 Processor -- start 2023-10-05T21:16:13.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.409+0000 7eff8127d680 1 -- start start 2023-10-05T21:16:13.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.409+0000 7eff8127d680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5587e801ce50 0x5587e8073d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.409+0000 7eff8127d680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587e8074290 con 0x5587e801ce50 2023-10-05T21:16:13.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.409+0000 7eff73b54700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5587e801ce50 0x5587e8073d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.409+0000 7eff73b54700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5587e801ce50 0x5587e8073d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54884/0 (socket says 172.21.15.153:54884) 2023-10-05T21:16:13.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.409+0000 7eff73b54700 1 -- 172.21.15.153:0/619183057 learned_addr learned my addr 172.21.15.153:0/619183057 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:13.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.409+0000 7eff73b54700 1 -- 172.21.15.153:0/619183057 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff64006070 con 0x5587e801ce50 2023-10-05T21:16:13.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.410+0000 7eff73b54700 1 --2- 172.21.15.153:0/619183057 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5587e801ce50 0x5587e8073d50 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7eff6400bfe0 tx=0x7eff64032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.410+0000 7efebf7fe700 1 -- 172.21.15.153:0/619183057 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff6400de30 con 0x5587e801ce50 2023-10-05T21:16:13.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.410+0000 7efebf7fe700 1 -- 172.21.15.153:0/619183057 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6403dcc0 con 0x5587e801ce50 2023-10-05T21:16:13.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.410+0000 7efebf7fe700 1 -- 172.21.15.153:0/619183057 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff6403de30 con 0x5587e801ce50 2023-10-05T21:16:13.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.410+0000 7eff8127d680 1 -- 172.21.15.153:0/619183057 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5587e8074490 con 0x5587e801ce50 2023-10-05T21:16:13.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.410+0000 7eff8127d680 1 -- 172.21.15.153:0/619183057 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5587e80748e0 con 0x5587e801ce50 2023-10-05T21:16:13.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.410+0000 7efebf7fe700 1 -- 172.21.15.153:0/619183057 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7eff6401a040 con 0x5587e801ce50 2023-10-05T21:16:13.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.411+0000 7efebf7fe700 1 --2- 172.21.15.153:0/619183057 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7efeb4034140 0x7efeb40365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.411+0000 7efebf7fe700 1 -- 172.21.15.153:0/619183057 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7eff64048c30 con 0x5587e801ce50 2023-10-05T21:16:13.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.411+0000 7eff74b56700 1 --2- 172.21.15.153:0/619183057 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7efeb4034140 0x7efeb40365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.411+0000 7eff8127d680 5 note: GC not initialized 2023-10-05T21:16:13.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.411+0000 7eff74b56700 1 --2- 172.21.15.153:0/619183057 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7efeb4034140 0x7efeb40365f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x5587e805df00 tx=0x7eff6c00af40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.412+0000 7efebcff9700 20 reqs_thread_entry: start 2023-10-05T21:16:13.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.412+0000 7efeb27fc700 20 reqs_thread_entry: start 2023-10-05T21:16:13.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.412+0000 7eff8127d680 20 init_complete bucket index max shards: 11 2023-10-05T21:16:13.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.412+0000 7eff8127d680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:16:13.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.412+0000 7efeb0ff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:16:43 2023 2023-10-05T21:16:13.446 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:16:13.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.412+0000 7efe97fff700 20 reqs_thread_entry: start 2023-10-05T21:16:13.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.412+0000 7eff8127d680 20 get_system_obj_state: rctx=0x7ffc6ec1e0c8 obj=default.rgw.meta:users.uid:foo state=0x5587e7f8f340 s->prefetch_data=0 2023-10-05T21:16:13.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.412+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e80d9710 con 0x5587e801b110 2023-10-05T21:16:13.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.413+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.413+0000 7eff8127d680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:16:13.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.413+0000 7eff8127d680 20 Read xattr: user.rgw.idtag 2023-10-05T21:16:13.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.413+0000 7eff8127d680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.413+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e80db9a0 con 0x5587e801b110 2023-10-05T21:16:13.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.413+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.413+0000 7eff8127d680 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T21:16:13.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.413+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:104 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e80db9a0 con 0x7eff6400e8c0 2023-10-05T21:16:13.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.414+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(104 usage.10 [call out=1268b] v0'0 uv32 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7eff6c00a570 con 0x7eff6400e8c0 2023-10-05T21:16:13.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.414+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94042201619904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8098290 con 0x7eff5c007030 2023-10-05T21:16:13.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.415+0000 7eff73b54700 1 -- 172.21.15.153:0/1839242947 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(105 notify.0 [watch unwatch cookie 94042201619904] v31'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff6400f620 con 0x7eff5c007030 2023-10-05T21:16:13.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.415+0000 7eff8127d680 20 remove_watcher() i=0 2023-10-05T21:16:13.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.415+0000 7eff8127d680 2 removed watcher, disabling cache 2023-10-05T21:16:13.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.415+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94042201623136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8057dc0 con 0x5587e801b110 2023-10-05T21:16:13.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.416+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(106 notify.1 [watch unwatch cookie 94042201623136] v31'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.416+0000 7eff8127d680 20 remove_watcher() i=1 2023-10-05T21:16:13.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.416+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94042201628320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8058a60 con 0x5587e8050fd0 2023-10-05T21:16:13.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.417+0000 7eff74355700 1 -- 172.21.15.153:0/1839242947 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(107 notify.2 [watch unwatch cookie 94042201628320] v31'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff5c019040 con 0x5587e8050fd0 2023-10-05T21:16:13.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.417+0000 7eff8127d680 20 remove_watcher() i=2 2023-10-05T21:16:13.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.417+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94042201630736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8058a60 con 0x7eff5c007030 2023-10-05T21:16:13.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.417+0000 7eff73b54700 1 -- 172.21.15.153:0/1839242947 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(108 notify.3 [watch unwatch cookie 94042201630736] v31'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff6400f620 con 0x7eff5c007030 2023-10-05T21:16:13.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.417+0000 7eff8127d680 20 remove_watcher() i=3 2023-10-05T21:16:13.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.417+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94042201634816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8058a60 con 0x5587e801b110 2023-10-05T21:16:13.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.418+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(109 notify.4 [watch unwatch cookie 94042201634816] v31'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.418+0000 7eff8127d680 20 remove_watcher() i=4 2023-10-05T21:16:13.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.418+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94042201638880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e805b800 con 0x7eff6400e8c0 2023-10-05T21:16:13.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.419+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(110 notify.5 [watch unwatch cookie 94042201638880] v31'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff6c00a570 con 0x7eff6400e8c0 2023-10-05T21:16:13.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.419+0000 7eff8127d680 20 remove_watcher() i=5 2023-10-05T21:16:13.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.419+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:111 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94042201641664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8058a60 con 0x7eff6400e8c0 2023-10-05T21:16:13.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.420+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(111 notify.6 [watch unwatch cookie 94042201641664] v31'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff6c00a570 con 0x7eff6400e8c0 2023-10-05T21:16:13.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.420+0000 7eff8127d680 20 remove_watcher() i=6 2023-10-05T21:16:13.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.420+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94042201635920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8058a60 con 0x7eff6400e8c0 2023-10-05T21:16:13.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.420+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(112 notify.7 [watch unwatch cookie 94042201635920] v31'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7eff6c00a570 con 0x7eff6400e8c0 2023-10-05T21:16:13.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.421+0000 7eff8127d680 20 remove_watcher() i=7 2023-10-05T21:16:13.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.421+0000 7eff45fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:16:13.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.421+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:113 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94042201645776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5587e8058a60 con 0x5587e801b110 2023-10-05T21:16:13.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.422+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(113 data_loggenerations_metadata [watch unwatch cookie 94042201645776] v31'226 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7eff6c00a570 con 0x5587e801b110 2023-10-05T21:16:13.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.422+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7eff6400e8c0 msgr2=0x7eff6400d310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.422+0000 7eff8127d680 1 --2- 172.21.15.153:0/1839242947 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7eff6400e8c0 0x7eff6400d310 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.422+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5587e801b110 msgr2=0x5587e804ea40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.422+0000 7eff8127d680 1 --2- 172.21.15.153:0/1839242947 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5587e801b110 0x5587e804ea40 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.422+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7eff5c007030 msgr2=0x7eff5c0375d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.422+0000 7eff8127d680 1 --2- 172.21.15.153:0/1839242947 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7eff5c007030 0x7eff5c0375d0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.422+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5587e8050fd0 msgr2=0x5587e80533b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.422+0000 7eff8127d680 1 --2- 172.21.15.153:0/1839242947 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5587e8050fd0 0x5587e80533b0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.422+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7eff54034140 msgr2=0x7eff540365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.422+0000 7eff8127d680 1 --2- 172.21.15.153:0/1839242947 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7eff54034140 0x7eff540365f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7eff640011e0 tx=0x7eff640013c0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.422+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5587e801a7c0 msgr2=0x5587e8042d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.422+0000 7eff8127d680 1 --2- 172.21.15.153:0/1839242947 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5587e801a7c0 0x5587e8042d00 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00a650 tx=0x7eff5c01d000 comp rx=0 tx=0).stop 2023-10-05T21:16:13.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.422+0000 7eff74b56700 1 -- 172.21.15.153:0/1839242947 reap_dead start 2023-10-05T21:16:13.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.422+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 shutdown_connections 2023-10-05T21:16:13.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.422+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 >> 172.21.15.153:0/1839242947 conn(0x5587e8016310 msgr2=0x5587e8035cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.422+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 shutdown_connections 2023-10-05T21:16:13.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.422+0000 7eff8127d680 1 -- 172.21.15.153:0/1839242947 wait complete. 2023-10-05T21:16:13.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.423+0000 7eff8127d680 1 -- 172.21.15.153:0/619183057 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7efeb4034140 msgr2=0x7efeb40365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.423+0000 7eff8127d680 1 --2- 172.21.15.153:0/619183057 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7efeb4034140 0x7efeb40365f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x5587e805df00 tx=0x7eff6c00af40 comp rx=0 tx=0).stop 2023-10-05T21:16:13.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.423+0000 7eff8127d680 1 -- 172.21.15.153:0/619183057 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5587e801ce50 msgr2=0x5587e8073d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.423+0000 7eff8127d680 1 --2- 172.21.15.153:0/619183057 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5587e801ce50 0x5587e8073d50 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7eff6400bfe0 tx=0x7eff64032000 comp rx=0 tx=0).stop 2023-10-05T21:16:13.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.423+0000 7eff8127d680 1 -- 172.21.15.153:0/619183057 shutdown_connections 2023-10-05T21:16:13.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.423+0000 7eff8127d680 1 --2- 172.21.15.153:0/619183057 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7efeb4034140 0x7efeb40365f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.423+0000 7eff8127d680 1 --2- 172.21.15.153:0/619183057 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5587e801ce50 0x5587e8073d50 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.423+0000 7eff8127d680 1 -- 172.21.15.153:0/619183057 >> 172.21.15.153:0/619183057 conn(0x5587e80671f0 msgr2=0x5587e8065320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.423+0000 7eff8127d680 1 -- 172.21.15.153:0/619183057 shutdown_connections 2023-10-05T21:16:13.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.423+0000 7eff8127d680 1 -- 172.21.15.153:0/619183057 wait complete. 2023-10-05T21:16:13.453 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:16:13.453 INFO:teuthology.orchestra.run.smithi153.stdout: "entries": [ 2023-10-05T21:16:13.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.453 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:16:13.453 INFO:teuthology.orchestra.run.smithi153.stdout: "buckets": [ 2023-10-05T21:16:13.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.453 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "", 2023-10-05T21:16:13.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:13.453 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:13.454 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:13.454 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [] 2023-10-05T21:16:13.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.454 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo", 2023-10-05T21:16:13.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:13.454 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:13.454 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:13.454 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [ 2023-10-05T21:16:13.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.454 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "put_obj", 2023-10-05T21:16:13.455 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:13.455 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 30000042, 2023-10-05T21:16:13.455 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 11, 2023-10-05T21:16:13.455 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 11 2023-10-05T21:16:13.455 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.455 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:13.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.455 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo2", 2023-10-05T21:16:13.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:13.455 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:13.455 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:13.456 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [] 2023-10-05T21:16:13.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.456 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo3", 2023-10-05T21:16:13.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:13.456 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:13.456 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:13.456 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [] 2023-10-05T21:16:13.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.456 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo4", 2023-10-05T21:16:13.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:13.457 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:13.457 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:13.457 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [] 2023-10-05T21:16:13.457 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.457 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:13.457 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.457 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:16:13.457 INFO:teuthology.orchestra.run.smithi153.stdout: "summary": [ 2023-10-05T21:16:13.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.457 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:16:13.457 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [ 2023-10-05T21:16:13.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.458 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "put_obj", 2023-10-05T21:16:13.458 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:13.458 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 30000042, 2023-10-05T21:16:13.458 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 11, 2023-10-05T21:16:13.458 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 11 2023-10-05T21:16:13.458 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.458 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:16:13.458 INFO:teuthology.orchestra.run.smithi153.stdout: "total": { 2023-10-05T21:16:13.458 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:13.458 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 30000042, 2023-10-05T21:16:13.458 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 11, 2023-10-05T21:16:13.459 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 11 2023-10-05T21:16:13.459 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.459 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.459 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:13.459 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:16:13.459 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2023-10-05T21:16:13.459 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2023-10-05T21:16:13.459 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2023-10-05T21:16:13.460 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2023-10-05T21:16:13.506 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:16:13.506 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:16:13.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.505+0000 7ff47b64c680 1 Processor -- start 2023-10-05T21:16:13.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.505+0000 7ff47b64c680 1 -- start start 2023-10-05T21:16:13.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.505+0000 7ff47b64c680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55ed90565bc0 0x55ed90567fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.505+0000 7ff47b64c680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ed904ac930 con 0x55ed904d30b0 2023-10-05T21:16:13.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.505+0000 7ff47b64c680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ed9046cdb0 con 0x55ed90565bc0 2023-10-05T21:16:13.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.505+0000 7ff46df23700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55ed90565bc0 0x55ed90567fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.505+0000 7ff46e724700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55ed904d30b0 0x55ed905644a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:57820/0 (socket says 172.21.15.153:57820) 2023-10-05T21:16:13.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.505+0000 7ff46e724700 1 -- 172.21.15.153:0/2867428899 learned_addr learned my addr 172.21.15.153:0/2867428899 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:16:13.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.506+0000 7ff46d722700 1 -- 172.21.15.153:0/2867428899 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3563251776 0 0) 0x55ed904ac930 con 0x55ed904d30b0 2023-10-05T21:16:13.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.506+0000 7ff46d722700 1 -- 172.21.15.153:0/2867428899 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff458001e10 con 0x55ed904d30b0 2023-10-05T21:16:13.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.506+0000 7ff46df23700 1 -- 172.21.15.153:0/2867428899 >> v1:172.21.15.111:6789/0 conn(0x55ed904d30b0 legacy=0x55ed905644a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.506+0000 7ff46df23700 1 -- 172.21.15.153:0/2867428899 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed905694f0 con 0x55ed90565bc0 2023-10-05T21:16:13.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.506+0000 7ff46df23700 1 --2- 172.21.15.153:0/2867428899 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90565bc0 0x55ed90567fa0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff46400a5d0 tx=0x7ff464005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492bafcc8197c844 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.506+0000 7ff46d722700 1 -- 172.21.15.153:0/2867428899 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff464007610 con 0x55ed90565bc0 2023-10-05T21:16:13.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.506+0000 7ff46d722700 1 -- 172.21.15.153:0/2867428899 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff464007770 con 0x55ed90565bc0 2023-10-05T21:16:13.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.506+0000 7ff46d722700 1 -- 172.21.15.153:0/2867428899 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff464007a40 con 0x55ed90565bc0 2023-10-05T21:16:13.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.506+0000 7ff47b64c680 1 -- 172.21.15.153:0/2867428899 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90565bc0 msgr2=0x55ed90567fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.506+0000 7ff47b64c680 1 --2- 172.21.15.153:0/2867428899 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90565bc0 0x55ed90567fa0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff46400a5d0 tx=0x7ff464005a50 comp rx=0 tx=0).stop 2023-10-05T21:16:13.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.507+0000 7ff47b64c680 1 -- 172.21.15.153:0/2867428899 shutdown_connections 2023-10-05T21:16:13.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.507+0000 7ff47b64c680 1 --2- 172.21.15.153:0/2867428899 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed90565bc0 0x55ed90567fa0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.507+0000 7ff47b64c680 1 -- 172.21.15.153:0/2867428899 >> 172.21.15.153:0/2867428899 conn(0x55ed90559b90 msgr2=0x55ed9055bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.507+0000 7ff47b64c680 1 -- 172.21.15.153:0/2867428899 shutdown_connections 2023-10-05T21:16:13.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.507+0000 7ff47b64c680 1 -- 172.21.15.153:0/2867428899 wait complete. 2023-10-05T21:16:13.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.507+0000 7ff47b64c680 1 Processor -- start 2023-10-05T21:16:13.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.507+0000 7ff47b64c680 1 -- start start 2023-10-05T21:16:13.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.508+0000 7ff47b64c680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed904d30b0 0x55ed905808f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.508+0000 7ff47b64c680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed9040cea0 con 0x55ed904d30b0 2023-10-05T21:16:13.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.508+0000 7ff46e724700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed904d30b0 0x55ed905808f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.508+0000 7ff46e724700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed904d30b0 0x55ed905808f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54896/0 (socket says 172.21.15.153:54896) 2023-10-05T21:16:13.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.508+0000 7ff46e724700 1 -- 172.21.15.153:0/1216790999 learned_addr learned my addr 172.21.15.153:0/1216790999 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:13.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.508+0000 7ff46e724700 1 -- 172.21.15.153:0/1216790999 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff464005cf0 con 0x55ed904d30b0 2023-10-05T21:16:13.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.508+0000 7ff46e724700 1 --2- 172.21.15.153:0/1216790999 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed904d30b0 0x55ed905808f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff460001c40 tx=0x7ff4600017f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=416a6e365f2ac74e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.508+0000 7ff45ffff700 1 -- 172.21.15.153:0/1216790999 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff46000bbf0 con 0x55ed904d30b0 2023-10-05T21:16:13.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.508+0000 7ff45ffff700 1 -- 172.21.15.153:0/1216790999 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46000bd70 con 0x55ed904d30b0 2023-10-05T21:16:13.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.508+0000 7ff45ffff700 1 -- 172.21.15.153:0/1216790999 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff46000e5f0 con 0x55ed904d30b0 2023-10-05T21:16:13.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.509+0000 7ff47b64c680 1 -- 172.21.15.153:0/1216790999 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed904d30b0 msgr2=0x55ed905808f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.509+0000 7ff47b64c680 1 --2- 172.21.15.153:0/1216790999 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed904d30b0 0x55ed905808f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff460001c40 tx=0x7ff4600017f0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.509+0000 7ff47b64c680 1 -- 172.21.15.153:0/1216790999 shutdown_connections 2023-10-05T21:16:13.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.509+0000 7ff47b64c680 1 --2- 172.21.15.153:0/1216790999 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed904d30b0 0x55ed905808f0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.509+0000 7ff47b64c680 1 -- 172.21.15.153:0/1216790999 >> 172.21.15.153:0/1216790999 conn(0x55ed90559b90 msgr2=0x55ed9057c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.509+0000 7ff47b64c680 1 -- 172.21.15.153:0/1216790999 shutdown_connections 2023-10-05T21:16:13.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.509+0000 7ff47b64c680 1 -- 172.21.15.153:0/1216790999 wait complete. 2023-10-05T21:16:13.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.509+0000 7ff47b64c680 1 Processor -- start 2023-10-05T21:16:13.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.509+0000 7ff47b64c680 1 -- start start 2023-10-05T21:16:13.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.509+0000 7ff47b64c680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed904d30b0 0x55ed90587db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.509+0000 7ff47b64c680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed90403c80 con 0x55ed904d30b0 2023-10-05T21:16:13.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.510+0000 7ff46e724700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed904d30b0 0x55ed90587db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.510+0000 7ff46e724700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed904d30b0 0x55ed90587db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54910/0 (socket says 172.21.15.153:54910) 2023-10-05T21:16:13.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.510+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 learned_addr learned my addr 172.21.15.153:0/3406944666 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:13.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.510+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff458001e10 con 0x55ed904d30b0 2023-10-05T21:16:13.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.510+0000 7ff46e724700 1 --2- 172.21.15.153:0/3406944666 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed904d30b0 0x55ed90587db0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x55ed90581690 tx=0x7ff460016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.510+0000 7ff45e7fc700 1 -- 172.21.15.153:0/3406944666 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff46001f070 con 0x55ed904d30b0 2023-10-05T21:16:13.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.510+0000 7ff45e7fc700 1 -- 172.21.15.153:0/3406944666 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff460018640 con 0x55ed904d30b0 2023-10-05T21:16:13.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.510+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ed905882f0 con 0x55ed904d30b0 2023-10-05T21:16:13.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.510+0000 7ff45e7fc700 1 -- 172.21.15.153:0/3406944666 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff460018910 con 0x55ed904d30b0 2023-10-05T21:16:13.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.510+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ed90588740 con 0x55ed904d30b0 2023-10-05T21:16:13.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.511+0000 7ff45e7fc700 1 -- 172.21.15.153:0/3406944666 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7ff460018a70 con 0x55ed904d30b0 2023-10-05T21:16:13.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.511+0000 7ff45e7fc700 1 --2- 172.21.15.153:0/3406944666 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff450034140 0x7ff4500365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.511+0000 7ff47b64c680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.511+0000 7ff45e7fc700 1 -- 172.21.15.153:0/3406944666 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7ff460048e00 con 0x55ed904d30b0 2023-10-05T21:16:13.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.511+0000 7ff46df23700 1 --2- 172.21.15.153:0/3406944666 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff450034140 0x7ff4500365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.511+0000 7ff47b64c680 1 --2- 172.21.15.153:0/3406944666 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ed90565bc0 0x55ed90593ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.511+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90594260 con 0x55ed90565bc0 2023-10-05T21:16:13.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.512+0000 7ff46ef25700 1 --2- 172.21.15.153:0/3406944666 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ed90565bc0 0x55ed90593ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.512+0000 7ff46df23700 1 --2- 172.21.15.153:0/3406944666 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff450034140 0x7ff4500365f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff46400afd0 tx=0x7ff464014000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.512+0000 7ff46ef25700 1 --2- 172.21.15.153:0/3406944666 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ed90565bc0 0x55ed90593ad0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.512+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.512+0000 7ff47b64c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.512+0000 7ff47b64c680 20 realm 2023-10-05T21:16:13.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.512+0000 7ff47b64c680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.512+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed905910f0 con 0x55ed90565bc0 2023-10-05T21:16:13.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.512+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.512+0000 7ff47b64c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.512+0000 7ff47b64c680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:16:13.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.512+0000 7ff47b64c680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.512+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90594d60 con 0x55ed90565bc0 2023-10-05T21:16:13.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.513+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.513+0000 7ff47b64c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.513+0000 7ff47b64c680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.513+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90595680 con 0x55ed90565bc0 2023-10-05T21:16:13.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.513+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.513+0000 7ff47b64c680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:13.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.513+0000 7ff47b64c680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.513+0000 7ff47b64c680 1 --2- 172.21.15.153:0/3406944666 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ed90595f40 0x55ed90598320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.513+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed905988f0 con 0x55ed90595f40 2023-10-05T21:16:13.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.513+0000 7ff46e724700 1 --2- 172.21.15.153:0/3406944666 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ed90595f40 0x55ed90598320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.513+0000 7ff46e724700 1 --2- 172.21.15.153:0/3406944666 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ed90595f40 0x55ed90598320 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.514+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff460014070 con 0x55ed90595f40 2023-10-05T21:16:13.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.514+0000 7ff47b64c680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:16:13.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.514+0000 7ff47b64c680 20 searching for the correct realm 2023-10-05T21:16:13.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.514+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x55ed90595f40 2023-10-05T21:16:13.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.514+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460014070 con 0x55ed90595f40 2023-10-05T21:16:13.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.514+0000 7ff46e724700 1 --2- 172.21.15.153:0/3406944666 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ff460041670 0x7ff4600163b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.514+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x7ff460041670 2023-10-05T21:16:13.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.514+0000 7ff46df23700 1 --2- 172.21.15.153:0/3406944666 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ff460041670 0x7ff4600163b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.514+0000 7ff46df23700 1 --2- 172.21.15.153:0/3406944666 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ff460041670 0x7ff4600163b0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.515+0000 7ff46df23700 1 -- 172.21.15.153:0/3406944666 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4640079b0 con 0x7ff460041670 2023-10-05T21:16:13.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.515+0000 7ff46df23700 1 --2- 172.21.15.153:0/3406944666 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ff464007030 0x7ff46401d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.515+0000 7ff46df23700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x7ff464007030 2023-10-05T21:16:13.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.515+0000 7ff46ef25700 1 --2- 172.21.15.153:0/3406944666 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ff464007030 0x7ff46401d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.515+0000 7ff46ef25700 1 --2- 172.21.15.153:0/3406944666 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ff464007030 0x7ff46401d430 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.516+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a570 con 0x7ff464007030 2023-10-05T21:16:13.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.516+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x55ed90565bc0 2023-10-05T21:16:13.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.516+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.516+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x55ed90565bc0 2023-10-05T21:16:13.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.516+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.516+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x7ff464007030 2023-10-05T21:16:13.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.516+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a570 con 0x7ff464007030 2023-10-05T21:16:13.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.516+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x7ff464007030 2023-10-05T21:16:13.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.516+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a570 con 0x7ff464007030 2023-10-05T21:16:13.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.516+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x7ff460041670 2023-10-05T21:16:13.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.517+0000 7ff46df23700 1 -- 172.21.15.153:0/3406944666 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff464029040 con 0x7ff460041670 2023-10-05T21:16:13.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.517+0000 7ff46df23700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x55ed90595f40 2023-10-05T21:16:13.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.517+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff460014070 con 0x55ed90595f40 2023-10-05T21:16:13.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.517+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x55ed90565bc0 2023-10-05T21:16:13.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.517+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.517+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x7ff464007030 2023-10-05T21:16:13.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.517+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a570 con 0x7ff464007030 2023-10-05T21:16:13.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.517+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x55ed90565bc0 2023-10-05T21:16:13.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.518+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.518+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x7ff460041670 2023-10-05T21:16:13.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.518+0000 7ff46df23700 1 -- 172.21.15.153:0/3406944666 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff464029040 con 0x7ff460041670 2023-10-05T21:16:13.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.518+0000 7ff46df23700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x55ed90595f40 2023-10-05T21:16:13.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.518+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460014070 con 0x55ed90595f40 2023-10-05T21:16:13.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.518+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x55ed90595f40 2023-10-05T21:16:13.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.518+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460014070 con 0x55ed90595f40 2023-10-05T21:16:13.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.518+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x7ff464007030 2023-10-05T21:16:13.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.519+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a570 con 0x7ff464007030 2023-10-05T21:16:13.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.519+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x55ed90595f40 2023-10-05T21:16:13.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.519+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460014070 con 0x55ed90595f40 2023-10-05T21:16:13.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.519+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x55ed90595f40 2023-10-05T21:16:13.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.519+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460014070 con 0x55ed90595f40 2023-10-05T21:16:13.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.519+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x55ed90565bc0 2023-10-05T21:16:13.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.519+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.519+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x55ed90565bc0 2023-10-05T21:16:13.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.519+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.519+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x7ff464007030 2023-10-05T21:16:13.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.520+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a570 con 0x7ff464007030 2023-10-05T21:16:13.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.520+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x55ed90595f40 2023-10-05T21:16:13.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.520+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460014070 con 0x55ed90595f40 2023-10-05T21:16:13.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.520+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x7ff460041670 2023-10-05T21:16:13.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.520+0000 7ff46df23700 1 -- 172.21.15.153:0/3406944666 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff464029040 con 0x7ff460041670 2023-10-05T21:16:13.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.520+0000 7ff46df23700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x55ed90565bc0 2023-10-05T21:16:13.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.521+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.521+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x7ff464007030 2023-10-05T21:16:13.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.521+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a570 con 0x7ff464007030 2023-10-05T21:16:13.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.521+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x55ed90595f40 2023-10-05T21:16:13.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.521+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460014070 con 0x55ed90595f40 2023-10-05T21:16:13.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.521+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x7ff464007030 2023-10-05T21:16:13.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.522+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a570 con 0x7ff464007030 2023-10-05T21:16:13.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.522+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x7ff460041670 2023-10-05T21:16:13.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.522+0000 7ff46df23700 1 -- 172.21.15.153:0/3406944666 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff464029040 con 0x7ff460041670 2023-10-05T21:16:13.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.522+0000 7ff46df23700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x55ed90595f40 2023-10-05T21:16:13.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.522+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460014070 con 0x55ed90595f40 2023-10-05T21:16:13.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.522+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x7ff464007030 2023-10-05T21:16:13.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.522+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a570 con 0x7ff464007030 2023-10-05T21:16:13.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.522+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x55ed90565bc0 2023-10-05T21:16:13.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.522+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.522+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a210 con 0x7ff460041670 2023-10-05T21:16:13.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.523+0000 7ff46df23700 1 -- 172.21.15.153:0/3406944666 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff464029040 con 0x7ff460041670 2023-10-05T21:16:13.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.523+0000 7ff47b64c680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:16:13.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.523+0000 7ff47b64c680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:16:13.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.523+0000 7ff47b64c680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:16:13.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.523+0000 7ff47b64c680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:16:13.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.523+0000 7ff47b64c680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.523+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90599430 con 0x55ed90565bc0 2023-10-05T21:16:13.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.523+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.523+0000 7ff47b64c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.523+0000 7ff47b64c680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.523+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed905998c0 con 0x55ed90565bc0 2023-10-05T21:16:13.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.523+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.523+0000 7ff47b64c680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:13.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.523+0000 7ff47b64c680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.523+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90599cf0 con 0x55ed90565bc0 2023-10-05T21:16:13.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.523+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.523+0000 7ff47b64c680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:16:13.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.523+0000 7ff47b64c680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.523+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059aab0 con 0x55ed90595f40 2023-10-05T21:16:13.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.524+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7ff460014070 con 0x55ed90595f40 2023-10-05T21:16:13.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.524+0000 7ff47b64c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.524+0000 7ff47b64c680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.524+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059ae60 con 0x55ed90565bc0 2023-10-05T21:16:13.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.524+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.524+0000 7ff47b64c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.524+0000 7ff47b64c680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.524+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059ae60 con 0x55ed90565bc0 2023-10-05T21:16:13.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.524+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.524+0000 7ff47b64c680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:13.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.524+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059be70 con 0x55ed90595f40 2023-10-05T21:16:13.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.524+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460014070 con 0x55ed90595f40 2023-10-05T21:16:13.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.524+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059be70 con 0x7ff460041670 2023-10-05T21:16:13.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.524+0000 7ff46df23700 1 -- 172.21.15.153:0/3406944666 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff464029040 con 0x7ff460041670 2023-10-05T21:16:13.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.524+0000 7ff46df23700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059be70 con 0x7ff464007030 2023-10-05T21:16:13.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.525+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a570 con 0x7ff464007030 2023-10-05T21:16:13.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.525+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90599cf0 con 0x55ed90565bc0 2023-10-05T21:16:13.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.525+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.525+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90599cf0 con 0x55ed90565bc0 2023-10-05T21:16:13.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.525+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.525+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90599cf0 con 0x7ff464007030 2023-10-05T21:16:13.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.526+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a570 con 0x7ff464007030 2023-10-05T21:16:13.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.526+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90599cf0 con 0x7ff464007030 2023-10-05T21:16:13.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.526+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a570 con 0x7ff464007030 2023-10-05T21:16:13.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.526+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90599cf0 con 0x7ff460041670 2023-10-05T21:16:13.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.526+0000 7ff46df23700 1 -- 172.21.15.153:0/3406944666 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff464029040 con 0x7ff460041670 2023-10-05T21:16:13.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.526+0000 7ff46df23700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90599cf0 con 0x55ed90595f40 2023-10-05T21:16:13.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.526+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff460014070 con 0x55ed90595f40 2023-10-05T21:16:13.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.526+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90599cf0 con 0x55ed90565bc0 2023-10-05T21:16:13.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.526+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.526+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90599cf0 con 0x7ff464007030 2023-10-05T21:16:13.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.527+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a570 con 0x7ff464007030 2023-10-05T21:16:13.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.527+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90599cf0 con 0x55ed90565bc0 2023-10-05T21:16:13.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.527+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.527+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90599cf0 con 0x7ff460041670 2023-10-05T21:16:13.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.527+0000 7ff46df23700 1 -- 172.21.15.153:0/3406944666 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff464029040 con 0x7ff460041670 2023-10-05T21:16:13.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.527+0000 7ff46df23700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90599cf0 con 0x55ed90595f40 2023-10-05T21:16:13.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.527+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460014070 con 0x55ed90595f40 2023-10-05T21:16:13.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.527+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90599cf0 con 0x55ed90595f40 2023-10-05T21:16:13.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.528+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460014070 con 0x55ed90595f40 2023-10-05T21:16:13.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.528+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90599cf0 con 0x7ff464007030 2023-10-05T21:16:13.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.528+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a570 con 0x7ff464007030 2023-10-05T21:16:13.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.528+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90599cf0 con 0x55ed90595f40 2023-10-05T21:16:13.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.528+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460014070 con 0x55ed90595f40 2023-10-05T21:16:13.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.528+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90599cf0 con 0x55ed90595f40 2023-10-05T21:16:13.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.528+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460014070 con 0x55ed90595f40 2023-10-05T21:16:13.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.528+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90599cf0 con 0x55ed90565bc0 2023-10-05T21:16:13.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.528+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.528+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90599cf0 con 0x55ed90565bc0 2023-10-05T21:16:13.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.529+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.529+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90599cf0 con 0x7ff464007030 2023-10-05T21:16:13.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.529+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a570 con 0x7ff464007030 2023-10-05T21:16:13.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.529+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90599cf0 con 0x55ed90595f40 2023-10-05T21:16:13.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.529+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460014070 con 0x55ed90595f40 2023-10-05T21:16:13.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.529+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90599cf0 con 0x7ff460041670 2023-10-05T21:16:13.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.529+0000 7ff46df23700 1 -- 172.21.15.153:0/3406944666 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff464029040 con 0x7ff460041670 2023-10-05T21:16:13.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.529+0000 7ff46df23700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90599cf0 con 0x55ed90565bc0 2023-10-05T21:16:13.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.530+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.530+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90599cf0 con 0x7ff464007030 2023-10-05T21:16:13.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.530+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a570 con 0x7ff464007030 2023-10-05T21:16:13.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.530+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90599cf0 con 0x55ed90595f40 2023-10-05T21:16:13.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.530+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460014070 con 0x55ed90595f40 2023-10-05T21:16:13.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.530+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90599cf0 con 0x7ff464007030 2023-10-05T21:16:13.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.530+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a570 con 0x7ff464007030 2023-10-05T21:16:13.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.530+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90599cf0 con 0x7ff460041670 2023-10-05T21:16:13.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.530+0000 7ff46df23700 1 -- 172.21.15.153:0/3406944666 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff464029040 con 0x7ff460041670 2023-10-05T21:16:13.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.530+0000 7ff46df23700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90599cf0 con 0x55ed90595f40 2023-10-05T21:16:13.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.531+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460014070 con 0x55ed90595f40 2023-10-05T21:16:13.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.531+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90599cf0 con 0x7ff464007030 2023-10-05T21:16:13.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.531+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46800a570 con 0x7ff464007030 2023-10-05T21:16:13.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.531+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90599cf0 con 0x55ed90565bc0 2023-10-05T21:16:13.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.531+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.531+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed90599cf0 con 0x7ff460041670 2023-10-05T21:16:13.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.531+0000 7ff46df23700 1 -- 172.21.15.153:0/3406944666 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff464029040 con 0x7ff460041670 2023-10-05T21:16:13.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.531+0000 7ff47b64c680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:16:13.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.531+0000 7ff47b64c680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:16:13.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.531+0000 7ff47b64c680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:16:13.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.531+0000 7ff47b64c680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:16:13.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.531+0000 7ff47b64c680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.531+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059ae60 con 0x55ed90565bc0 2023-10-05T21:16:13.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.532+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.532+0000 7ff47b64c680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:13.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.532+0000 7ff47b64c680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.532+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059b210 con 0x55ed90595f40 2023-10-05T21:16:13.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.532+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff460014070 con 0x55ed90595f40 2023-10-05T21:16:13.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.532+0000 7ff47b64c680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:16:13.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.532+0000 7ff47b64c680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.532+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a650 con 0x55ed90565bc0 2023-10-05T21:16:13.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.532+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.532+0000 7ff47b64c680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:13.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.532+0000 7ff47b64c680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.532+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059a620 con 0x55ed90565bc0 2023-10-05T21:16:13.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.532+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.532+0000 7ff47b64c680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:16:13.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.532+0000 7ff47b64c680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.532+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059bb00 con 0x7ff464007030 2023-10-05T21:16:13.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.533+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7ff46800a570 con 0x7ff464007030 2023-10-05T21:16:13.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.533+0000 7ff47b64c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.533+0000 7ff47b64c680 20 zone default found 2023-10-05T21:16:13.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.533+0000 7ff47b64c680 4 Realm: () 2023-10-05T21:16:13.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.533+0000 7ff47b64c680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:16:13.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.533+0000 7ff47b64c680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:16:13.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.533+0000 7ff47b64c680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:16:13.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.533+0000 7ff47b64c680 20 zonegroup default 2023-10-05T21:16:13.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.533+0000 7ff47b64c680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.533+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059bb00 con 0x7ff464007030 2023-10-05T21:16:13.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.533+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff46800a570 con 0x7ff464007030 2023-10-05T21:16:13.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.533+0000 7ff47b64c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.533+0000 7ff47b64c680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.533+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059d430 con 0x55ed90595f40 2023-10-05T21:16:13.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.533+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff460014070 con 0x55ed90595f40 2023-10-05T21:16:13.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.533+0000 7ff47b64c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.533+0000 7ff47b64c680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.533+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059d7e0 con 0x55ed90595f40 2023-10-05T21:16:13.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.534+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff460014070 con 0x55ed90595f40 2023-10-05T21:16:13.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.534+0000 7ff47b64c680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.534+0000 7ff47b64c680 20 started sync module instance, tier type = 2023-10-05T21:16:13.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.534+0000 7ff47b64c680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:16:13.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.534+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059caf0 con 0x7ff460041670 2023-10-05T21:16:13.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.534+0000 7ff46df23700 1 -- 172.21.15.153:0/3406944666 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v31'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff464029040 con 0x7ff460041670 2023-10-05T21:16:13.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.534+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94478817414896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059e080 con 0x7ff460041670 2023-10-05T21:16:13.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.534+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059e920 con 0x55ed90565bc0 2023-10-05T21:16:13.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.535+0000 7ff46df23700 1 -- 172.21.15.153:0/3406944666 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94478817414896] v31'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff464029040 con 0x7ff460041670 2023-10-05T21:16:13.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.535+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v31'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.535+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94478817418128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059e920 con 0x55ed90565bc0 2023-10-05T21:16:13.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.535+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059f470 con 0x55ed90595f40 2023-10-05T21:16:13.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.536+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94478817418128] v31'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.536+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v31'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff460014070 con 0x55ed90595f40 2023-10-05T21:16:13.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.536+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94478817420336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059e880 con 0x55ed90595f40 2023-10-05T21:16:13.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.536+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed905a0250 con 0x7ff460041670 2023-10-05T21:16:13.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.537+0000 7ff46df23700 1 -- 172.21.15.153:0/3406944666 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v31'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff464029040 con 0x7ff460041670 2023-10-05T21:16:13.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.537+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94478817428992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed905a0f40 con 0x7ff460041670 2023-10-05T21:16:13.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.537+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94478817420336] v31'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff460014070 con 0x55ed90595f40 2023-10-05T21:16:13.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.537+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9059f870 con 0x55ed90565bc0 2023-10-05T21:16:13.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.538+0000 7ff46df23700 1 -- 172.21.15.153:0/3406944666 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94478817428992] v31'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff464029040 con 0x7ff460041670 2023-10-05T21:16:13.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.538+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v31'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.538+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94478817425520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed905a1950 con 0x55ed90565bc0 2023-10-05T21:16:13.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.538+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed905a21f0 con 0x7ff464007030 2023-10-05T21:16:13.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.538+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94478817425520] v31'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.539+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v31'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46800a570 con 0x7ff464007030 2023-10-05T21:16:13.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.539+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94478817433232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed905a2010 con 0x7ff464007030 2023-10-05T21:16:13.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.539+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed905a2bd0 con 0x7ff464007030 2023-10-05T21:16:13.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.539+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94478817433232] v31'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46800a570 con 0x7ff464007030 2023-10-05T21:16:13.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.539+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v31'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46800a570 con 0x7ff464007030 2023-10-05T21:16:13.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.539+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94478817434336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed905a2b90 con 0x7ff464007030 2023-10-05T21:16:13.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.539+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed905a3600 con 0x7ff464007030 2023-10-05T21:16:13.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.540+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94478817434336] v31'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46800a570 con 0x7ff464007030 2023-10-05T21:16:13.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.540+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v31'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46800a570 con 0x7ff464007030 2023-10-05T21:16:13.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.540+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94478817437904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed905a3600 con 0x7ff464007030 2023-10-05T21:16:13.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.540+0000 7ff47b64c680 20 add_watcher() i=0 2023-10-05T21:16:13.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.540+0000 7ff47b64c680 20 add_watcher() i=1 2023-10-05T21:16:13.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.540+0000 7ff47b64c680 20 add_watcher() i=2 2023-10-05T21:16:13.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.540+0000 7ff47b64c680 20 add_watcher() i=3 2023-10-05T21:16:13.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.540+0000 7ff47b64c680 20 add_watcher() i=4 2023-10-05T21:16:13.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.540+0000 7ff47b64c680 20 add_watcher() i=5 2023-10-05T21:16:13.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.540+0000 7ff47b64c680 20 add_watcher() i=6 2023-10-05T21:16:13.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.541+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94478817437904] v31'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46800a570 con 0x7ff464007030 2023-10-05T21:16:13.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.541+0000 7ff47b64c680 20 add_watcher() i=7 2023-10-05T21:16:13.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.541+0000 7ff47b64c680 2 all 8 watchers are set, enabling cache 2023-10-05T21:16:13.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.541+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed905a6a10 con 0x55ed90565bc0 2023-10-05T21:16:13.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.541+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.541+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94478817440480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed905a3ed0 con 0x55ed90565bc0 2023-10-05T21:16:13.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.542+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94478817440480] v31'227 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.542+0000 7ff43ffdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:16:13.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.542+0000 7ff47b64c680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:16:13.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.542+0000 7ff47b64c680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:16:13.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.542+0000 7ff47b64c680 1 Processor -- start 2023-10-05T21:16:13.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.542+0000 7ff47b64c680 1 -- start start 2023-10-05T21:16:13.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.542+0000 7ff47b64c680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed905b1440 0x55ed905b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.542+0000 7ff47b64c680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed905b1e20 con 0x55ed905b1440 2023-10-05T21:16:13.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.543+0000 7ff46df23700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed905b1440 0x55ed905b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.543+0000 7ff46df23700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed905b1440 0x55ed905b1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54924/0 (socket says 172.21.15.153:54924) 2023-10-05T21:16:13.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.543+0000 7ff46df23700 1 -- 172.21.15.153:0/3273499835 learned_addr learned my addr 172.21.15.153:0/3273499835 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:13.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.543+0000 7ff46df23700 1 -- 172.21.15.153:0/3273499835 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed905b1f60 con 0x55ed905b1440 2023-10-05T21:16:13.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.543+0000 7ff46df23700 1 --2- 172.21.15.153:0/3273499835 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed905b1440 0x55ed905b1850 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x55ed9055ff60 tx=0x7ff464011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b3abe4f8e68617 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.543+0000 7ff43f7de700 1 -- 172.21.15.153:0/3273499835 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff464025040 con 0x55ed905b1440 2023-10-05T21:16:13.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.543+0000 7ff43f7de700 1 -- 172.21.15.153:0/3273499835 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff464039450 con 0x55ed905b1440 2023-10-05T21:16:13.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.543+0000 7ff43f7de700 1 -- 172.21.15.153:0/3273499835 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4640395c0 con 0x55ed905b1440 2023-10-05T21:16:13.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.544+0000 7ff47b64c680 1 -- 172.21.15.153:0/3273499835 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed905b1440 msgr2=0x55ed905b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.544+0000 7ff47b64c680 1 --2- 172.21.15.153:0/3273499835 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed905b1440 0x55ed905b1850 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x55ed9055ff60 tx=0x7ff464011000 comp rx=0 tx=0).stop 2023-10-05T21:16:13.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.544+0000 7ff47b64c680 1 -- 172.21.15.153:0/3273499835 shutdown_connections 2023-10-05T21:16:13.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.544+0000 7ff47b64c680 1 --2- 172.21.15.153:0/3273499835 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed905b1440 0x55ed905b1850 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.544+0000 7ff47b64c680 1 -- 172.21.15.153:0/3273499835 >> 172.21.15.153:0/3273499835 conn(0x55ed905ac640 msgr2=0x55ed905aa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.544+0000 7ff47b64c680 1 -- 172.21.15.153:0/3273499835 shutdown_connections 2023-10-05T21:16:13.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.544+0000 7ff47b64c680 1 -- 172.21.15.153:0/3273499835 wait complete. 2023-10-05T21:16:13.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.544+0000 7ff47b64c680 1 Processor -- start 2023-10-05T21:16:13.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.544+0000 7ff47b64c680 1 -- start start 2023-10-05T21:16:13.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.545+0000 7ff47b64c680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed905b1440 0x55ed905b6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.545+0000 7ff47b64c680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed905b7490 con 0x55ed905b1440 2023-10-05T21:16:13.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.545+0000 7ff46df23700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed905b1440 0x55ed905b6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.545+0000 7ff46df23700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed905b1440 0x55ed905b6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54932/0 (socket says 172.21.15.153:54932) 2023-10-05T21:16:13.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.545+0000 7ff46df23700 1 -- 172.21.15.153:0/4288377048 learned_addr learned my addr 172.21.15.153:0/4288377048 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:13.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.545+0000 7ff46df23700 1 -- 172.21.15.153:0/4288377048 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed905694f0 con 0x55ed905b1440 2023-10-05T21:16:13.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.545+0000 7ff46df23700 1 --2- 172.21.15.153:0/4288377048 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed905b1440 0x55ed905b6f50 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x55ed905abbb0 tx=0x7ff464039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.545+0000 7ff43dfdb700 1 -- 172.21.15.153:0/4288377048 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff464025040 con 0x55ed905b1440 2023-10-05T21:16:13.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.545+0000 7ff43dfdb700 1 -- 172.21.15.153:0/4288377048 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff464047070 con 0x55ed905b1440 2023-10-05T21:16:13.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.545+0000 7ff43dfdb700 1 -- 172.21.15.153:0/4288377048 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff46402d6a0 con 0x55ed905b1440 2023-10-05T21:16:13.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.545+0000 7ff47b64c680 1 -- 172.21.15.153:0/4288377048 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ed905b7690 con 0x55ed905b1440 2023-10-05T21:16:13.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.546+0000 7ff47b64c680 1 -- 172.21.15.153:0/4288377048 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ed905b7b40 con 0x55ed905b1440 2023-10-05T21:16:13.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.546+0000 7ff43dfdb700 1 -- 172.21.15.153:0/4288377048 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7ff464049070 con 0x55ed905b1440 2023-10-05T21:16:13.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.546+0000 7ff43dfdb700 1 --2- 172.21.15.153:0/4288377048 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff3b4034190 0x7ff3b4036640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.546+0000 7ff43dfdb700 1 -- 172.21.15.153:0/4288377048 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7ff464032030 con 0x55ed905b1440 2023-10-05T21:16:13.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.546+0000 7ff46ef25700 1 --2- 172.21.15.153:0/4288377048 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff3b4034190 0x7ff3b4036640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.547+0000 7ff47b64c680 5 note: GC not initialized 2023-10-05T21:16:13.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.547+0000 7ff46ef25700 1 --2- 172.21.15.153:0/4288377048 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff3b4034190 0x7ff3b4036640 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x55ed905a2880 tx=0x7ff468036440 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.548+0000 7ff3aeffd700 20 reqs_thread_entry: start 2023-10-05T21:16:13.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.548+0000 7ff3acff9700 20 reqs_thread_entry: start 2023-10-05T21:16:13.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.548+0000 7ff47b64c680 20 init_complete bucket index max shards: 11 2023-10-05T21:16:13.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.548+0000 7ff47b64c680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:16:13.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.548+0000 7ff3a2ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:16:43 2023 2023-10-05T21:16:13.586 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:16:13.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.548+0000 7ff3a27fc700 20 reqs_thread_entry: start 2023-10-05T21:16:13.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.548+0000 7ff47b64c680 20 get_system_obj_state: rctx=0x7ffea18d9598 obj=default.rgw.meta:users.uid:foo state=0x55ed90412240 s->prefetch_data=0 2023-10-05T21:16:13.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.548+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9061c7b0 con 0x55ed90565bc0 2023-10-05T21:16:13.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.549+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.549+0000 7ff47b64c680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:16:13.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.549+0000 7ff47b64c680 20 Read xattr: user.rgw.idtag 2023-10-05T21:16:13.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.549+0000 7ff47b64c680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.549+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9061ea40 con 0x55ed90565bc0 2023-10-05T21:16:13.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.549+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.549+0000 7ff47b64c680 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T21:16:13.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.549+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:104 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9061ea40 con 0x7ff464007030 2023-10-05T21:16:13.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.549+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(104 usage.10 [call out=1268b] v0'0 uv32 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7ff46800a570 con 0x7ff464007030 2023-10-05T21:16:13.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.550+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94478817414896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9061e550 con 0x7ff460041670 2023-10-05T21:16:13.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.551+0000 7ff46df23700 1 -- 172.21.15.153:0/3406944666 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(105 notify.0 [watch unwatch cookie 94478817414896] v31'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46403f020 con 0x7ff460041670 2023-10-05T21:16:13.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.551+0000 7ff47b64c680 20 remove_watcher() i=0 2023-10-05T21:16:13.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.551+0000 7ff47b64c680 2 removed watcher, disabling cache 2023-10-05T21:16:13.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.551+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94478817418128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9061e550 con 0x55ed90565bc0 2023-10-05T21:16:13.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.551+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(106 notify.1 [watch unwatch cookie 94478817418128] v31'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.551+0000 7ff47b64c680 20 remove_watcher() i=1 2023-10-05T21:16:13.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.551+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94478817420336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9061e550 con 0x55ed90595f40 2023-10-05T21:16:13.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.552+0000 7ff46e724700 1 -- 172.21.15.153:0/3406944666 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(107 notify.2 [watch unwatch cookie 94478817420336] v31'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff460014070 con 0x55ed90595f40 2023-10-05T21:16:13.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.552+0000 7ff47b64c680 20 remove_watcher() i=2 2023-10-05T21:16:13.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.552+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94478817428992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9061e550 con 0x7ff460041670 2023-10-05T21:16:13.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.553+0000 7ff46df23700 1 -- 172.21.15.153:0/3406944666 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(108 notify.3 [watch unwatch cookie 94478817428992] v31'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46403f020 con 0x7ff460041670 2023-10-05T21:16:13.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.553+0000 7ff47b64c680 20 remove_watcher() i=3 2023-10-05T21:16:13.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.553+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94478817425520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9061e550 con 0x55ed90565bc0 2023-10-05T21:16:13.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.554+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(109 notify.4 [watch unwatch cookie 94478817425520] v31'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.554+0000 7ff47b64c680 20 remove_watcher() i=4 2023-10-05T21:16:13.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.554+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94478817433232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9061e550 con 0x7ff464007030 2023-10-05T21:16:13.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.555+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(110 notify.5 [watch unwatch cookie 94478817433232] v31'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46800a570 con 0x7ff464007030 2023-10-05T21:16:13.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.555+0000 7ff47b64c680 20 remove_watcher() i=5 2023-10-05T21:16:13.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.555+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:111 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94478817434336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9061e550 con 0x7ff464007030 2023-10-05T21:16:13.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.556+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(111 notify.6 [watch unwatch cookie 94478817434336] v31'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46800a570 con 0x7ff464007030 2023-10-05T21:16:13.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.556+0000 7ff47b64c680 20 remove_watcher() i=6 2023-10-05T21:16:13.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.556+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94478817437904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9061e550 con 0x7ff464007030 2023-10-05T21:16:13.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.556+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(112 notify.7 [watch unwatch cookie 94478817437904] v31'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46800a570 con 0x7ff464007030 2023-10-05T21:16:13.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.556+0000 7ff47b64c680 20 remove_watcher() i=7 2023-10-05T21:16:13.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.557+0000 7ff43ffdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:16:13.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.557+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:113 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94478817440480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ed9061e550 con 0x55ed90565bc0 2023-10-05T21:16:13.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.558+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(113 data_loggenerations_metadata [watch unwatch cookie 94478817440480] v31'228 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff46800a570 con 0x55ed90565bc0 2023-10-05T21:16:13.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.558+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ff464007030 msgr2=0x7ff46401d430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.558+0000 7ff47b64c680 1 --2- 172.21.15.153:0/3406944666 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ff464007030 0x7ff46401d430 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.558+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ed90565bc0 msgr2=0x55ed90593ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.558+0000 7ff47b64c680 1 --2- 172.21.15.153:0/3406944666 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55ed90565bc0 0x55ed90593ad0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.558+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ff460041670 msgr2=0x7ff4600163b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.558+0000 7ff47b64c680 1 --2- 172.21.15.153:0/3406944666 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ff460041670 0x7ff4600163b0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.558+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ed90595f40 msgr2=0x55ed90598320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.558+0000 7ff47b64c680 1 --2- 172.21.15.153:0/3406944666 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55ed90595f40 0x55ed90598320 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.558+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff450034140 msgr2=0x7ff4500365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.558+0000 7ff47b64c680 1 --2- 172.21.15.153:0/3406944666 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff450034140 0x7ff4500365f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff46400afd0 tx=0x7ff464014000 comp rx=0 tx=0).stop 2023-10-05T21:16:13.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.558+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed904d30b0 msgr2=0x55ed90587db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.558+0000 7ff46ef25700 1 -- 172.21.15.153:0/3406944666 reap_dead start 2023-10-05T21:16:13.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.558+0000 7ff47b64c680 1 --2- 172.21.15.153:0/3406944666 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed904d30b0 0x55ed90587db0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x55ed90581690 tx=0x7ff460016000 comp rx=0 tx=0).stop 2023-10-05T21:16:13.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.558+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 shutdown_connections 2023-10-05T21:16:13.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.558+0000 7ff47b64c680 1 --2- 172.21.15.153:0/3406944666 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed904d30b0 0x55ed90587db0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.558+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 >> 172.21.15.153:0/3406944666 conn(0x55ed90559b90 msgr2=0x55ed9057ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.558+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 shutdown_connections 2023-10-05T21:16:13.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.558+0000 7ff47b64c680 1 -- 172.21.15.153:0/3406944666 wait complete. 2023-10-05T21:16:13.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.559+0000 7ff47b64c680 1 -- 172.21.15.153:0/4288377048 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff3b4034190 msgr2=0x7ff3b4036640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.559+0000 7ff47b64c680 1 --2- 172.21.15.153:0/4288377048 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff3b4034190 0x7ff3b4036640 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x55ed905a2880 tx=0x7ff468036440 comp rx=0 tx=0).stop 2023-10-05T21:16:13.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.559+0000 7ff47b64c680 1 -- 172.21.15.153:0/4288377048 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed905b1440 msgr2=0x55ed905b6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.559+0000 7ff47b64c680 1 --2- 172.21.15.153:0/4288377048 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed905b1440 0x55ed905b6f50 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x55ed905abbb0 tx=0x7ff464039000 comp rx=0 tx=0).stop 2023-10-05T21:16:13.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.559+0000 7ff47b64c680 1 -- 172.21.15.153:0/4288377048 shutdown_connections 2023-10-05T21:16:13.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.559+0000 7ff47b64c680 1 --2- 172.21.15.153:0/4288377048 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff3b4034190 0x7ff3b4036640 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.559+0000 7ff47b64c680 1 --2- 172.21.15.153:0/4288377048 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ed905b1440 0x55ed905b6f50 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.559+0000 7ff47b64c680 1 -- 172.21.15.153:0/4288377048 >> 172.21.15.153:0/4288377048 conn(0x55ed905ac640 msgr2=0x55ed905aa770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.559+0000 7ff47b64c680 1 -- 172.21.15.153:0/4288377048 shutdown_connections 2023-10-05T21:16:13.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.559+0000 7ff47b64c680 1 -- 172.21.15.153:0/4288377048 wait complete. 2023-10-05T21:16:13.597 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:16:13.597 INFO:teuthology.orchestra.run.smithi153.stdout: "entries": [ 2023-10-05T21:16:13.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.597 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:16:13.597 INFO:teuthology.orchestra.run.smithi153.stdout: "buckets": [ 2023-10-05T21:16:13.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.597 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "", 2023-10-05T21:16:13.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:13.598 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:13.598 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:13.598 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [] 2023-10-05T21:16:13.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.598 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo", 2023-10-05T21:16:13.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:13.598 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:13.598 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:13.598 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [ 2023-10-05T21:16:13.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.599 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "delete_obj", 2023-10-05T21:16:13.599 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:13.599 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.599 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 4, 2023-10-05T21:16:13.599 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 4 2023-10-05T21:16:13.599 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.599 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:13.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.599 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo2", 2023-10-05T21:16:13.599 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:13.599 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:13.600 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:13.600 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [] 2023-10-05T21:16:13.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.600 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo3", 2023-10-05T21:16:13.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:13.600 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:13.600 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:13.600 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [] 2023-10-05T21:16:13.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.601 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo4", 2023-10-05T21:16:13.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:13.601 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:13.601 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:13.601 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [] 2023-10-05T21:16:13.601 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.601 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:13.601 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.601 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:16:13.601 INFO:teuthology.orchestra.run.smithi153.stdout: "summary": [ 2023-10-05T21:16:13.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.601 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:16:13.601 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [ 2023-10-05T21:16:13.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.602 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "delete_obj", 2023-10-05T21:16:13.602 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:13.602 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.602 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 4, 2023-10-05T21:16:13.602 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 4 2023-10-05T21:16:13.602 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.602 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:16:13.602 INFO:teuthology.orchestra.run.smithi153.stdout: "total": { 2023-10-05T21:16:13.602 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:13.602 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.603 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 4, 2023-10-05T21:16:13.603 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 4 2023-10-05T21:16:13.603 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.603 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.603 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:13.603 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:16:13.603 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2023-10-05T21:16:13.603 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2023-10-05T21:16:13.603 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2023-10-05T21:16:13.604 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2023-10-05T21:16:13.650 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:16:13.650 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:16:13.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.649+0000 7f00d5f67680 1 Processor -- start 2023-10-05T21:16:13.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.649+0000 7f00d5f67680 1 -- start start 2023-10-05T21:16:13.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.649+0000 7f00d5f67680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x560184190bc0 0x560184192fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.649+0000 7f00d5f67680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5601840d7930 con 0x5601840fe0b0 2023-10-05T21:16:13.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.649+0000 7f00d5f67680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x560184097db0 con 0x560184190bc0 2023-10-05T21:16:13.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.650+0000 7f00c883e700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x560184190bc0 0x560184192fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.650+0000 7f00c903f700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x5601840fe0b0 0x56018418f4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:57832/0 (socket says 172.21.15.153:57832) 2023-10-05T21:16:13.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.650+0000 7f00c883e700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x560184190bc0 0x560184192fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54936/0 (socket says 172.21.15.153:54936) 2023-10-05T21:16:13.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.650+0000 7f00c903f700 1 -- 172.21.15.153:0/2926185710 learned_addr learned my addr 172.21.15.153:0/2926185710 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:16:13.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.650+0000 7f00c883e700 1 -- 172.21.15.153:0/2926185710 >> v1:172.21.15.111:6789/0 conn(0x5601840fe0b0 legacy=0x56018418f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.650+0000 7f00c883e700 1 -- 172.21.15.153:0/2926185710 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601841944f0 con 0x560184190bc0 2023-10-05T21:16:13.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.650+0000 7f00c3fff700 1 -- 172.21.15.153:0/2926185710 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1468167545 0 0) 0x5601840d7930 con 0x5601840fe0b0 2023-10-05T21:16:13.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.650+0000 7f00c883e700 1 --2- 172.21.15.153:0/2926185710 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560184190bc0 0x560184192fa0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f00b400a5d0 tx=0x7f00b4005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f3e3de481c1581 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.650+0000 7f00c3fff700 1 -- 172.21.15.153:0/2926185710 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00b40086a0 con 0x560184190bc0 2023-10-05T21:16:13.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.650+0000 7f00c3fff700 1 -- 172.21.15.153:0/2926185710 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b4008800 con 0x560184190bc0 2023-10-05T21:16:13.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.650+0000 7f00c3fff700 1 -- 172.21.15.153:0/2926185710 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00b4008ad0 con 0x560184190bc0 2023-10-05T21:16:13.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.651+0000 7f00d5f67680 1 -- 172.21.15.153:0/2926185710 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560184190bc0 msgr2=0x560184192fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.651+0000 7f00d5f67680 1 --2- 172.21.15.153:0/2926185710 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560184190bc0 0x560184192fa0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f00b400a5d0 tx=0x7f00b4005a50 comp rx=0 tx=0).stop 2023-10-05T21:16:13.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.651+0000 7f00d5f67680 1 -- 172.21.15.153:0/2926185710 shutdown_connections 2023-10-05T21:16:13.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.651+0000 7f00d5f67680 1 --2- 172.21.15.153:0/2926185710 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560184190bc0 0x560184192fa0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.651+0000 7f00d5f67680 1 -- 172.21.15.153:0/2926185710 >> 172.21.15.153:0/2926185710 conn(0x560184184b90 msgr2=0x560184186fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.651+0000 7f00d5f67680 1 -- 172.21.15.153:0/2926185710 shutdown_connections 2023-10-05T21:16:13.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.651+0000 7f00d5f67680 1 -- 172.21.15.153:0/2926185710 wait complete. 2023-10-05T21:16:13.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.651+0000 7f00d5f67680 1 Processor -- start 2023-10-05T21:16:13.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.652+0000 7f00d5f67680 1 -- start start 2023-10-05T21:16:13.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.652+0000 7f00d5f67680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5601840fe0b0 0x5601841ab980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.652+0000 7f00d5f67680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x560184037ea0 con 0x5601840fe0b0 2023-10-05T21:16:13.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.652+0000 7f00c903f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5601840fe0b0 0x5601841ab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.652+0000 7f00c903f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5601840fe0b0 0x5601841ab980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54946/0 (socket says 172.21.15.153:54946) 2023-10-05T21:16:13.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.652+0000 7f00c903f700 1 -- 172.21.15.153:0/587047387 learned_addr learned my addr 172.21.15.153:0/587047387 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:13.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.652+0000 7f00c903f700 1 -- 172.21.15.153:0/587047387 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b4005cf0 con 0x5601840fe0b0 2023-10-05T21:16:13.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.652+0000 7f00c903f700 1 --2- 172.21.15.153:0/587047387 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5601840fe0b0 0x5601841ab980 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f00c4006f90 tx=0x7f00c4006990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e387bd96bb448c87 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.652+0000 7f00c2ffd700 1 -- 172.21.15.153:0/587047387 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00c40020d0 con 0x5601840fe0b0 2023-10-05T21:16:13.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.652+0000 7f00c2ffd700 1 -- 172.21.15.153:0/587047387 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c4006320 con 0x5601840fe0b0 2023-10-05T21:16:13.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.652+0000 7f00c2ffd700 1 -- 172.21.15.153:0/587047387 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00c40046a0 con 0x5601840fe0b0 2023-10-05T21:16:13.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.653+0000 7f00d5f67680 1 -- 172.21.15.153:0/587047387 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5601840fe0b0 msgr2=0x5601841ab980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.653+0000 7f00d5f67680 1 --2- 172.21.15.153:0/587047387 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5601840fe0b0 0x5601841ab980 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f00c4006f90 tx=0x7f00c4006990 comp rx=0 tx=0).stop 2023-10-05T21:16:13.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.653+0000 7f00d5f67680 1 -- 172.21.15.153:0/587047387 shutdown_connections 2023-10-05T21:16:13.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.653+0000 7f00d5f67680 1 --2- 172.21.15.153:0/587047387 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5601840fe0b0 0x5601841ab980 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.653+0000 7f00d5f67680 1 -- 172.21.15.153:0/587047387 >> 172.21.15.153:0/587047387 conn(0x560184184b90 msgr2=0x5601841a7450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.653+0000 7f00d5f67680 1 -- 172.21.15.153:0/587047387 shutdown_connections 2023-10-05T21:16:13.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.653+0000 7f00d5f67680 1 -- 172.21.15.153:0/587047387 wait complete. 2023-10-05T21:16:13.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.653+0000 7f00d5f67680 1 Processor -- start 2023-10-05T21:16:13.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.653+0000 7f00d5f67680 1 -- start start 2023-10-05T21:16:13.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.654+0000 7f00d5f67680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5601840fe0b0 0x5601841b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.654+0000 7f00d5f67680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x56018402ec80 con 0x5601840fe0b0 2023-10-05T21:16:13.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.654+0000 7f00c903f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5601840fe0b0 0x5601841b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.654+0000 7f00c903f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5601840fe0b0 0x5601841b2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54962/0 (socket says 172.21.15.153:54962) 2023-10-05T21:16:13.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.654+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 learned_addr learned my addr 172.21.15.153:0/3192613942 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:13.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.654+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c4006c70 con 0x5601840fe0b0 2023-10-05T21:16:13.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.654+0000 7f00c903f700 1 --2- 172.21.15.153:0/3192613942 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5601840fe0b0 0x5601841b2e20 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f00c4000f80 tx=0x7f00c4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.654+0000 7f00c17fa700 1 -- 172.21.15.153:0/3192613942 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00c4013850 con 0x5601840fe0b0 2023-10-05T21:16:13.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.654+0000 7f00c17fa700 1 -- 172.21.15.153:0/3192613942 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c40139b0 con 0x5601840fe0b0 2023-10-05T21:16:13.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.654+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5601841b3360 con 0x5601840fe0b0 2023-10-05T21:16:13.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.654+0000 7f00c17fa700 1 -- 172.21.15.153:0/3192613942 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00c4013ca0 con 0x5601840fe0b0 2023-10-05T21:16:13.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.654+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5601841b37b0 con 0x5601840fe0b0 2023-10-05T21:16:13.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.655+0000 7f00c17fa700 1 -- 172.21.15.153:0/3192613942 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f00c4028460 con 0x5601840fe0b0 2023-10-05T21:16:13.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.655+0000 7f00c17fa700 1 --2- 172.21.15.153:0/3192613942 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f00ac034190 0x7f00ac036640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.655+0000 7f00c17fa700 1 -- 172.21.15.153:0/3192613942 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f00c4049140 con 0x5601840fe0b0 2023-10-05T21:16:13.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.655+0000 7f00c883e700 1 --2- 172.21.15.153:0/3192613942 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f00ac034190 0x7f00ac036640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.656+0000 7f00d5f67680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.656+0000 7f00d5f67680 1 --2- 172.21.15.153:0/3192613942 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x560184190bc0 0x5601841beb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.656+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841bf320 con 0x560184190bc0 2023-10-05T21:16:13.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.656+0000 7f00c883e700 1 --2- 172.21.15.153:0/3192613942 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f00ac034190 0x7f00ac036640 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f00b4003080 tx=0x7f00b4015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.656+0000 7f00c9840700 1 --2- 172.21.15.153:0/3192613942 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x560184190bc0 0x5601841beb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.656+0000 7f00c9840700 1 --2- 172.21.15.153:0/3192613942 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x560184190bc0 0x5601841beb90 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.656+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f00bc00a500 con 0x560184190bc0 2023-10-05T21:16:13.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.656+0000 7f00d5f67680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.656+0000 7f00d5f67680 20 realm 2023-10-05T21:16:13.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.656+0000 7f00d5f67680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.656+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841bc090 con 0x560184190bc0 2023-10-05T21:16:13.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.657+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f00bc00a500 con 0x560184190bc0 2023-10-05T21:16:13.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.657+0000 7f00d5f67680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.657+0000 7f00d5f67680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:16:13.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.657+0000 7f00d5f67680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.657+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841bfdd0 con 0x560184190bc0 2023-10-05T21:16:13.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.657+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f00bc00a500 con 0x560184190bc0 2023-10-05T21:16:13.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.657+0000 7f00d5f67680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.657+0000 7f00d5f67680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.657+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841bfa10 con 0x560184190bc0 2023-10-05T21:16:13.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.657+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f00bc00a500 con 0x560184190bc0 2023-10-05T21:16:13.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.657+0000 7f00d5f67680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:13.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.657+0000 7f00d5f67680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.657+0000 7f00d5f67680 1 --2- 172.21.15.153:0/3192613942 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5601841c1190 0x5601841c3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.657+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c3ab0 con 0x5601841c1190 2023-10-05T21:16:13.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.657+0000 7f00c903f700 1 --2- 172.21.15.153:0/3192613942 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5601841c1190 0x5601841c3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.658+0000 7f00c903f700 1 --2- 172.21.15.153:0/3192613942 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5601841c1190 0x5601841c3570 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.658+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f00c4024020 con 0x5601841c1190 2023-10-05T21:16:13.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.658+0000 7f00d5f67680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:16:13.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.658+0000 7f00d5f67680 20 searching for the correct realm 2023-10-05T21:16:13.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.658+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x5601841c1190 2023-10-05T21:16:13.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.658+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00c4024020 con 0x5601841c1190 2023-10-05T21:16:13.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.658+0000 7f00c903f700 1 --2- 172.21.15.153:0/3192613942 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f00c401d350 0x7f00c400a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.658+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x7f00c401d350 2023-10-05T21:16:13.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.658+0000 7f00c883e700 1 --2- 172.21.15.153:0/3192613942 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f00c401d350 0x7f00c400a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.658+0000 7f00c883e700 1 --2- 172.21.15.153:0/3192613942 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f00c401d350 0x7f00c400a0d0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.659+0000 7f00c883e700 1 -- 172.21.15.153:0/3192613942 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00b4019040 con 0x7f00c401d350 2023-10-05T21:16:13.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.659+0000 7f00c883e700 1 --2- 172.21.15.153:0/3192613942 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f00b4007030 0x7f00b401d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.659+0000 7f00c883e700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x7f00b4007030 2023-10-05T21:16:13.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.659+0000 7f00c9840700 1 --2- 172.21.15.153:0/3192613942 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f00b4007030 0x7f00b401d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.659+0000 7f00c9840700 1 --2- 172.21.15.153:0/3192613942 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f00b4007030 0x7f00b401d420 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.660+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00bc014040 con 0x7f00b4007030 2023-10-05T21:16:13.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.660+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x560184190bc0 2023-10-05T21:16:13.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.660+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00bc014040 con 0x560184190bc0 2023-10-05T21:16:13.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.660+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x560184190bc0 2023-10-05T21:16:13.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.660+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00bc014040 con 0x560184190bc0 2023-10-05T21:16:13.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.660+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x7f00b4007030 2023-10-05T21:16:13.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.660+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00bc014040 con 0x7f00b4007030 2023-10-05T21:16:13.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.660+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x7f00b4007030 2023-10-05T21:16:13.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.661+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00bc014040 con 0x7f00b4007030 2023-10-05T21:16:13.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.661+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x7f00c401d350 2023-10-05T21:16:13.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.661+0000 7f00c883e700 1 -- 172.21.15.153:0/3192613942 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00b4019040 con 0x7f00c401d350 2023-10-05T21:16:13.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.661+0000 7f00c883e700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x5601841c1190 2023-10-05T21:16:13.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.661+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f00c4024020 con 0x5601841c1190 2023-10-05T21:16:13.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.661+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x560184190bc0 2023-10-05T21:16:13.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.661+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00bc014040 con 0x560184190bc0 2023-10-05T21:16:13.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.661+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x7f00b4007030 2023-10-05T21:16:13.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.662+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00bc014040 con 0x7f00b4007030 2023-10-05T21:16:13.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.662+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x560184190bc0 2023-10-05T21:16:13.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.662+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00bc014040 con 0x560184190bc0 2023-10-05T21:16:13.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.662+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x7f00c401d350 2023-10-05T21:16:13.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.662+0000 7f00c883e700 1 -- 172.21.15.153:0/3192613942 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00b4019040 con 0x7f00c401d350 2023-10-05T21:16:13.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.662+0000 7f00c883e700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x5601841c1190 2023-10-05T21:16:13.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.662+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00c4024020 con 0x5601841c1190 2023-10-05T21:16:13.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.662+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x5601841c1190 2023-10-05T21:16:13.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.662+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00c4024020 con 0x5601841c1190 2023-10-05T21:16:13.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.663+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x7f00b4007030 2023-10-05T21:16:13.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.663+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00bc014040 con 0x7f00b4007030 2023-10-05T21:16:13.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.663+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x5601841c1190 2023-10-05T21:16:13.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.663+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00c4024020 con 0x5601841c1190 2023-10-05T21:16:13.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.663+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x5601841c1190 2023-10-05T21:16:13.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.663+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00c4024020 con 0x5601841c1190 2023-10-05T21:16:13.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.663+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x560184190bc0 2023-10-05T21:16:13.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.663+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00bc014040 con 0x560184190bc0 2023-10-05T21:16:13.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.663+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x560184190bc0 2023-10-05T21:16:13.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.664+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f00bc022080 con 0x560184190bc0 2023-10-05T21:16:13.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.664+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x7f00b4007030 2023-10-05T21:16:13.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.664+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00bc022080 con 0x7f00b4007030 2023-10-05T21:16:13.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.664+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x5601841c1190 2023-10-05T21:16:13.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.664+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00c4024020 con 0x5601841c1190 2023-10-05T21:16:13.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.664+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x7f00c401d350 2023-10-05T21:16:13.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.664+0000 7f00c883e700 1 -- 172.21.15.153:0/3192613942 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00b4019040 con 0x7f00c401d350 2023-10-05T21:16:13.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.664+0000 7f00c883e700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x560184190bc0 2023-10-05T21:16:13.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.665+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00bc022080 con 0x560184190bc0 2023-10-05T21:16:13.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.665+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x7f00b4007030 2023-10-05T21:16:13.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.665+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00bc022080 con 0x7f00b4007030 2023-10-05T21:16:13.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.665+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x5601841c1190 2023-10-05T21:16:13.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.665+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00c4024020 con 0x5601841c1190 2023-10-05T21:16:13.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.665+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x7f00b4007030 2023-10-05T21:16:13.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.666+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00bc022080 con 0x7f00b4007030 2023-10-05T21:16:13.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.666+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x7f00c401d350 2023-10-05T21:16:13.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.666+0000 7f00c883e700 1 -- 172.21.15.153:0/3192613942 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00b4019040 con 0x7f00c401d350 2023-10-05T21:16:13.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.666+0000 7f00c883e700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x5601841c1190 2023-10-05T21:16:13.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.666+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00c4024020 con 0x5601841c1190 2023-10-05T21:16:13.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.666+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x7f00b4007030 2023-10-05T21:16:13.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.666+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00bc022080 con 0x7f00b4007030 2023-10-05T21:16:13.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.666+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x560184190bc0 2023-10-05T21:16:13.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.666+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f00bc022080 con 0x560184190bc0 2023-10-05T21:16:13.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.666+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5360 con 0x7f00c401d350 2023-10-05T21:16:13.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.667+0000 7f00c883e700 1 -- 172.21.15.153:0/3192613942 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00b4019040 con 0x7f00c401d350 2023-10-05T21:16:13.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.667+0000 7f00d5f67680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:16:13.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.667+0000 7f00d5f67680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:16:13.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.667+0000 7f00d5f67680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:16:13.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.667+0000 7f00d5f67680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:16:13.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.667+0000 7f00d5f67680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.667+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c4480 con 0x560184190bc0 2023-10-05T21:16:13.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.667+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f00bc022080 con 0x560184190bc0 2023-10-05T21:16:13.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.667+0000 7f00d5f67680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.667+0000 7f00d5f67680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.667+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c48b0 con 0x560184190bc0 2023-10-05T21:16:13.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.667+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f00bc022080 con 0x560184190bc0 2023-10-05T21:16:13.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.667+0000 7f00d5f67680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:13.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.667+0000 7f00d5f67680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.667+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c4d20 con 0x560184190bc0 2023-10-05T21:16:13.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.667+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f00bc022080 con 0x560184190bc0 2023-10-05T21:16:13.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.667+0000 7f00d5f67680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:16:13.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.667+0000 7f00d5f67680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.667+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5710 con 0x5601841c1190 2023-10-05T21:16:13.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.668+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f00c4024020 con 0x5601841c1190 2023-10-05T21:16:13.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.668+0000 7f00d5f67680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.668+0000 7f00d5f67680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.668+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5ac0 con 0x560184190bc0 2023-10-05T21:16:13.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.668+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f00bc022080 con 0x560184190bc0 2023-10-05T21:16:13.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.668+0000 7f00d5f67680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.668+0000 7f00d5f67680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.668+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c4080 con 0x560184190bc0 2023-10-05T21:16:13.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.668+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f00bc022080 con 0x560184190bc0 2023-10-05T21:16:13.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.668+0000 7f00d5f67680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:13.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.668+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c4050 con 0x5601841c1190 2023-10-05T21:16:13.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.668+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00c4024020 con 0x5601841c1190 2023-10-05T21:16:13.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.668+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c4050 con 0x7f00c401d350 2023-10-05T21:16:13.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.668+0000 7f00c883e700 1 -- 172.21.15.153:0/3192613942 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00b4019040 con 0x7f00c401d350 2023-10-05T21:16:13.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.668+0000 7f00c883e700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c4050 con 0x7f00b4007030 2023-10-05T21:16:13.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.669+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00bc022080 con 0x7f00b4007030 2023-10-05T21:16:13.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.669+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5ac0 con 0x560184190bc0 2023-10-05T21:16:13.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.669+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00bc022080 con 0x560184190bc0 2023-10-05T21:16:13.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.669+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5ac0 con 0x560184190bc0 2023-10-05T21:16:13.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.669+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00bc022080 con 0x560184190bc0 2023-10-05T21:16:13.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.669+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5ac0 con 0x7f00b4007030 2023-10-05T21:16:13.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.670+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00bc022080 con 0x7f00b4007030 2023-10-05T21:16:13.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.670+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5ac0 con 0x7f00b4007030 2023-10-05T21:16:13.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.670+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00bc022080 con 0x7f00b4007030 2023-10-05T21:16:13.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.670+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5ac0 con 0x7f00c401d350 2023-10-05T21:16:13.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.670+0000 7f00c883e700 1 -- 172.21.15.153:0/3192613942 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00b4019040 con 0x7f00c401d350 2023-10-05T21:16:13.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.670+0000 7f00c883e700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5ac0 con 0x5601841c1190 2023-10-05T21:16:13.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.671+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f00c4024020 con 0x5601841c1190 2023-10-05T21:16:13.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.671+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5ac0 con 0x560184190bc0 2023-10-05T21:16:13.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.671+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00bc022080 con 0x560184190bc0 2023-10-05T21:16:13.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.671+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5ac0 con 0x7f00b4007030 2023-10-05T21:16:13.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.671+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00bc022080 con 0x7f00b4007030 2023-10-05T21:16:13.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.671+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5ac0 con 0x560184190bc0 2023-10-05T21:16:13.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.671+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00bc022080 con 0x560184190bc0 2023-10-05T21:16:13.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.671+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5ac0 con 0x7f00c401d350 2023-10-05T21:16:13.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.671+0000 7f00c883e700 1 -- 172.21.15.153:0/3192613942 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00b4019040 con 0x7f00c401d350 2023-10-05T21:16:13.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.671+0000 7f00c883e700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5ac0 con 0x5601841c1190 2023-10-05T21:16:13.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.672+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00c4024020 con 0x5601841c1190 2023-10-05T21:16:13.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.672+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5ac0 con 0x5601841c1190 2023-10-05T21:16:13.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.672+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00c4024020 con 0x5601841c1190 2023-10-05T21:16:13.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.672+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5ac0 con 0x7f00b4007030 2023-10-05T21:16:13.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.672+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00bc022080 con 0x7f00b4007030 2023-10-05T21:16:13.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.672+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5ac0 con 0x5601841c1190 2023-10-05T21:16:13.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.672+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00c4024020 con 0x5601841c1190 2023-10-05T21:16:13.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.672+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5ac0 con 0x5601841c1190 2023-10-05T21:16:13.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.673+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00c4024020 con 0x5601841c1190 2023-10-05T21:16:13.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.673+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5ac0 con 0x560184190bc0 2023-10-05T21:16:13.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.673+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00bc022080 con 0x560184190bc0 2023-10-05T21:16:13.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.673+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5ac0 con 0x560184190bc0 2023-10-05T21:16:13.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.673+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f00bc022080 con 0x560184190bc0 2023-10-05T21:16:13.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.673+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5ac0 con 0x7f00b4007030 2023-10-05T21:16:13.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.673+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00bc022080 con 0x7f00b4007030 2023-10-05T21:16:13.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.673+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5ac0 con 0x5601841c1190 2023-10-05T21:16:13.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.673+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00c4024020 con 0x5601841c1190 2023-10-05T21:16:13.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.673+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5ac0 con 0x7f00c401d350 2023-10-05T21:16:13.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.674+0000 7f00c883e700 1 -- 172.21.15.153:0/3192613942 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00b4019040 con 0x7f00c401d350 2023-10-05T21:16:13.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.674+0000 7f00c883e700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5ac0 con 0x560184190bc0 2023-10-05T21:16:13.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.674+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00bc022080 con 0x560184190bc0 2023-10-05T21:16:13.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.674+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5ac0 con 0x7f00b4007030 2023-10-05T21:16:13.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.674+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00bc022080 con 0x7f00b4007030 2023-10-05T21:16:13.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.674+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5ac0 con 0x5601841c1190 2023-10-05T21:16:13.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.675+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00c4024020 con 0x5601841c1190 2023-10-05T21:16:13.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.675+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5ac0 con 0x7f00b4007030 2023-10-05T21:16:13.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.675+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00bc022080 con 0x7f00b4007030 2023-10-05T21:16:13.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.675+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5ac0 con 0x7f00c401d350 2023-10-05T21:16:13.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.675+0000 7f00c883e700 1 -- 172.21.15.153:0/3192613942 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00b4019040 con 0x7f00c401d350 2023-10-05T21:16:13.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.675+0000 7f00c883e700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5ac0 con 0x5601841c1190 2023-10-05T21:16:13.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.675+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00c4024020 con 0x5601841c1190 2023-10-05T21:16:13.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.675+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5ac0 con 0x7f00b4007030 2023-10-05T21:16:13.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.676+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00bc022080 con 0x7f00b4007030 2023-10-05T21:16:13.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.676+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5ac0 con 0x560184190bc0 2023-10-05T21:16:13.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.676+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f00bc022080 con 0x560184190bc0 2023-10-05T21:16:13.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.676+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c5ac0 con 0x7f00c401d350 2023-10-05T21:16:13.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.676+0000 7f00c883e700 1 -- 172.21.15.153:0/3192613942 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f00b4019040 con 0x7f00c401d350 2023-10-05T21:16:13.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.676+0000 7f00d5f67680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:16:13.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.676+0000 7f00d5f67680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:16:13.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.676+0000 7f00d5f67680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:16:13.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.676+0000 7f00d5f67680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:16:13.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.676+0000 7f00d5f67680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.676+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c4050 con 0x560184190bc0 2023-10-05T21:16:13.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.676+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f00bc022080 con 0x560184190bc0 2023-10-05T21:16:13.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.676+0000 7f00d5f67680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:13.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.676+0000 7f00d5f67680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.676+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c6400 con 0x5601841c1190 2023-10-05T21:16:13.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.677+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f00c4024020 con 0x5601841c1190 2023-10-05T21:16:13.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.677+0000 7f00d5f67680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:16:13.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.677+0000 7f00d5f67680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.677+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c6cf0 con 0x560184190bc0 2023-10-05T21:16:13.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.677+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f00bc022080 con 0x560184190bc0 2023-10-05T21:16:13.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.677+0000 7f00d5f67680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:13.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.677+0000 7f00d5f67680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.677+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c6cf0 con 0x560184190bc0 2023-10-05T21:16:13.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.677+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f00bc022080 con 0x560184190bc0 2023-10-05T21:16:13.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.677+0000 7f00d5f67680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:16:13.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.677+0000 7f00d5f67680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.677+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c6cf0 con 0x7f00b4007030 2023-10-05T21:16:13.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.677+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f00bc022080 con 0x7f00b4007030 2023-10-05T21:16:13.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.677+0000 7f00d5f67680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.677+0000 7f00d5f67680 20 zone default found 2023-10-05T21:16:13.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.677+0000 7f00d5f67680 4 Realm: () 2023-10-05T21:16:13.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.677+0000 7f00d5f67680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:16:13.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.677+0000 7f00d5f67680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:16:13.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.677+0000 7f00d5f67680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:16:13.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.677+0000 7f00d5f67680 20 zonegroup default 2023-10-05T21:16:13.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.677+0000 7f00d5f67680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.677+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c6cf0 con 0x7f00b4007030 2023-10-05T21:16:13.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.678+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f00bc022080 con 0x7f00b4007030 2023-10-05T21:16:13.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.678+0000 7f00d5f67680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.678+0000 7f00d5f67680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.678+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c8960 con 0x5601841c1190 2023-10-05T21:16:13.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.678+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f00c4024020 con 0x5601841c1190 2023-10-05T21:16:13.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.678+0000 7f00d5f67680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.678+0000 7f00d5f67680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.678+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c8d10 con 0x5601841c1190 2023-10-05T21:16:13.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.678+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f00c4024020 con 0x5601841c1190 2023-10-05T21:16:13.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.678+0000 7f00d5f67680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.678+0000 7f00d5f67680 20 started sync module instance, tier type = 2023-10-05T21:16:13.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.678+0000 7f00d5f67680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:16:13.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.678+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c8020 con 0x7f00c401d350 2023-10-05T21:16:13.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.679+0000 7f00c883e700 1 -- 172.21.15.153:0/3192613942 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v31'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f00b4019040 con 0x7f00c401d350 2023-10-05T21:16:13.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.679+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94564511415088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c90c0 con 0x7f00c401d350 2023-10-05T21:16:13.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.679+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c9a80 con 0x560184190bc0 2023-10-05T21:16:13.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.680+0000 7f00c883e700 1 -- 172.21.15.153:0/3192613942 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94564511415088] v31'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f00b4019040 con 0x7f00c401d350 2023-10-05T21:16:13.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.680+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v31'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f00bc022080 con 0x560184190bc0 2023-10-05T21:16:13.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.680+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94564511421744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c9e80 con 0x560184190bc0 2023-10-05T21:16:13.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.680+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841ca890 con 0x5601841c1190 2023-10-05T21:16:13.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.681+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v31'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f00c4024020 con 0x5601841c1190 2023-10-05T21:16:13.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.681+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94564511421744] v31'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f00bc022080 con 0x560184190bc0 2023-10-05T21:16:13.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.681+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94564511425440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841cb180 con 0x5601841c1190 2023-10-05T21:16:13.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.681+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841cba20 con 0x7f00c401d350 2023-10-05T21:16:13.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.682+0000 7f00c883e700 1 -- 172.21.15.153:0/3192613942 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v31'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f00b4019040 con 0x7f00c401d350 2023-10-05T21:16:13.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.682+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94564511425440] v31'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f00c4024020 con 0x5601841c1190 2023-10-05T21:16:13.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.682+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94564511429936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841cc2c0 con 0x7f00c401d350 2023-10-05T21:16:13.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.682+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841cc7e0 con 0x560184190bc0 2023-10-05T21:16:13.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.682+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v31'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f00bc022080 con 0x560184190bc0 2023-10-05T21:16:13.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.682+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94564511434720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841cd120 con 0x560184190bc0 2023-10-05T21:16:13.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.682+0000 7f00c883e700 1 -- 172.21.15.153:0/3192613942 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94564511429936] v31'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f00b4019040 con 0x7f00c401d350 2023-10-05T21:16:13.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.682+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841cbdd0 con 0x7f00b4007030 2023-10-05T21:16:13.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.683+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94564511434720] v31'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f00bc022080 con 0x560184190bc0 2023-10-05T21:16:13.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.683+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v31'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f00bc022080 con 0x7f00b4007030 2023-10-05T21:16:13.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.683+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94564511435824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841cd080 con 0x7f00b4007030 2023-10-05T21:16:13.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.683+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841ce020 con 0x7f00b4007030 2023-10-05T21:16:13.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.684+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94564511435824] v31'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f00bc022080 con 0x7f00b4007030 2023-10-05T21:16:13.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.684+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v31'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f00bc022080 con 0x7f00b4007030 2023-10-05T21:16:13.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.684+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94564511438400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841cdf80 con 0x7f00b4007030 2023-10-05T21:16:13.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.684+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841cea10 con 0x7f00b4007030 2023-10-05T21:16:13.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.685+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94564511438400] v31'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f00bc022080 con 0x7f00b4007030 2023-10-05T21:16:13.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.685+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v31'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f00bc022080 con 0x7f00b4007030 2023-10-05T21:16:13.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.685+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94564511442080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841cdf80 con 0x7f00b4007030 2023-10-05T21:16:13.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.685+0000 7f00d5f67680 20 add_watcher() i=0 2023-10-05T21:16:13.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.685+0000 7f00d5f67680 20 add_watcher() i=1 2023-10-05T21:16:13.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.685+0000 7f00d5f67680 20 add_watcher() i=2 2023-10-05T21:16:13.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.685+0000 7f00d5f67680 20 add_watcher() i=3 2023-10-05T21:16:13.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.685+0000 7f00d5f67680 20 add_watcher() i=4 2023-10-05T21:16:13.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.685+0000 7f00d5f67680 20 add_watcher() i=5 2023-10-05T21:16:13.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.685+0000 7f00d5f67680 20 add_watcher() i=6 2023-10-05T21:16:13.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.685+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94564511442080] v31'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f00bc022080 con 0x7f00b4007030 2023-10-05T21:16:13.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.685+0000 7f00d5f67680 20 add_watcher() i=7 2023-10-05T21:16:13.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.685+0000 7f00d5f67680 2 all 8 watchers are set, enabling cache 2023-10-05T21:16:13.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.685+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841d1e10 con 0x560184190bc0 2023-10-05T21:16:13.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.686+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f00bc022080 con 0x560184190bc0 2023-10-05T21:16:13.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.686+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94564511439968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841cf2d0 con 0x560184190bc0 2023-10-05T21:16:13.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.687+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94564511439968] v31'229 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f00bc022080 con 0x560184190bc0 2023-10-05T21:16:13.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.687+0000 7f009a7e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:16:13.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.687+0000 7f00d5f67680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:16:13.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.687+0000 7f00d5f67680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:16:13.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.687+0000 7f00d5f67680 1 Processor -- start 2023-10-05T21:16:13.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.687+0000 7f00d5f67680 1 -- start start 2023-10-05T21:16:13.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.687+0000 7f00d5f67680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5601841dc7f0 0x5601841dcc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.687+0000 7f00d5f67680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601841dd1d0 con 0x5601841dc7f0 2023-10-05T21:16:13.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.687+0000 7f00c883e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5601841dc7f0 0x5601841dcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.687+0000 7f00c883e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5601841dc7f0 0x5601841dcc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54972/0 (socket says 172.21.15.153:54972) 2023-10-05T21:16:13.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.687+0000 7f00c883e700 1 -- 172.21.15.153:0/1622709927 learned_addr learned my addr 172.21.15.153:0/1622709927 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:13.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.688+0000 7f00c883e700 1 -- 172.21.15.153:0/1622709927 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601841dd310 con 0x5601841dc7f0 2023-10-05T21:16:13.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.688+0000 7f00c883e700 1 --2- 172.21.15.153:0/1622709927 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5601841dc7f0 0x5601841dcc00 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x56018418af60 tx=0x7f00b4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b603ff6f28e0aca0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.688+0000 7f0099fe3700 1 -- 172.21.15.153:0/1622709927 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00b401ddc0 con 0x5601841dc7f0 2023-10-05T21:16:13.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.688+0000 7f0099fe3700 1 -- 172.21.15.153:0/1622709927 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b402b450 con 0x5601841dc7f0 2023-10-05T21:16:13.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.688+0000 7f0099fe3700 1 -- 172.21.15.153:0/1622709927 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00b402b600 con 0x5601841dc7f0 2023-10-05T21:16:13.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.689+0000 7f00d5f67680 1 -- 172.21.15.153:0/1622709927 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5601841dc7f0 msgr2=0x5601841dcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.689+0000 7f00d5f67680 1 --2- 172.21.15.153:0/1622709927 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5601841dc7f0 0x5601841dcc00 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x56018418af60 tx=0x7f00b4012000 comp rx=0 tx=0).stop 2023-10-05T21:16:13.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.689+0000 7f00d5f67680 1 -- 172.21.15.153:0/1622709927 shutdown_connections 2023-10-05T21:16:13.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.689+0000 7f00d5f67680 1 --2- 172.21.15.153:0/1622709927 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5601841dc7f0 0x5601841dcc00 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.689+0000 7f00d5f67680 1 -- 172.21.15.153:0/1622709927 >> 172.21.15.153:0/1622709927 conn(0x5601841d79f0 msgr2=0x5601841d5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.689+0000 7f00d5f67680 1 -- 172.21.15.153:0/1622709927 shutdown_connections 2023-10-05T21:16:13.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.689+0000 7f00d5f67680 1 -- 172.21.15.153:0/1622709927 wait complete. 2023-10-05T21:16:13.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.689+0000 7f00d5f67680 1 Processor -- start 2023-10-05T21:16:13.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.689+0000 7f00d5f67680 1 -- start start 2023-10-05T21:16:13.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.689+0000 7f00d5f67680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5601841dc7f0 0x5601841e23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.689+0000 7f00d5f67680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601841e2910 con 0x5601841dc7f0 2023-10-05T21:16:13.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.689+0000 7f00c883e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5601841dc7f0 0x5601841e23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.689+0000 7f00c883e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5601841dc7f0 0x5601841e23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54980/0 (socket says 172.21.15.153:54980) 2023-10-05T21:16:13.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.690+0000 7f00c883e700 1 -- 172.21.15.153:0/3621262843 learned_addr learned my addr 172.21.15.153:0/3621262843 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:13.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.690+0000 7f00c883e700 1 -- 172.21.15.153:0/3621262843 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601841944f0 con 0x5601841dc7f0 2023-10-05T21:16:13.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.690+0000 7f00c883e700 1 --2- 172.21.15.153:0/3621262843 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5601841dc7f0 0x5601841e23d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f00b402c000 tx=0x7f00b4031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.690+0000 7f000bfff700 1 -- 172.21.15.153:0/3621262843 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00b4037840 con 0x5601841dc7f0 2023-10-05T21:16:13.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.690+0000 7f000bfff700 1 -- 172.21.15.153:0/3621262843 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b40379c0 con 0x5601841dc7f0 2023-10-05T21:16:13.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.690+0000 7f00d5f67680 1 -- 172.21.15.153:0/3621262843 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5601841e2b10 con 0x5601841dc7f0 2023-10-05T21:16:13.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.690+0000 7f000bfff700 1 -- 172.21.15.153:0/3621262843 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00b4037cb0 con 0x5601841dc7f0 2023-10-05T21:16:13.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.690+0000 7f00d5f67680 1 -- 172.21.15.153:0/3621262843 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5601841e2f60 con 0x5601841dc7f0 2023-10-05T21:16:13.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.691+0000 7f000bfff700 1 -- 172.21.15.153:0/3621262843 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f00b4026040 con 0x5601841dc7f0 2023-10-05T21:16:13.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.691+0000 7f000bfff700 1 --2- 172.21.15.153:0/3621262843 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0010034190 0x7f0010036640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.691+0000 7f000bfff700 1 -- 172.21.15.153:0/3621262843 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f00b4031070 con 0x5601841dc7f0 2023-10-05T21:16:13.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.691+0000 7f00c9840700 1 --2- 172.21.15.153:0/3621262843 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0010034190 0x7f0010036640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.691+0000 7f00d5f67680 5 note: GC not initialized 2023-10-05T21:16:13.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.692+0000 7f00c9840700 1 --2- 172.21.15.153:0/3621262843 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0010034190 0x7f0010036640 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x5601841ce1f0 tx=0x7f00bc005500 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.692+0000 7f00097fa700 20 reqs_thread_entry: start 2023-10-05T21:16:13.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.693+0000 7f0002ffd700 20 reqs_thread_entry: start 2023-10-05T21:16:13.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.693+0000 7f00d5f67680 20 init_complete bucket index max shards: 11 2023-10-05T21:16:13.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.693+0000 7f00d5f67680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:16:13.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.693+0000 7f00017fa700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:16:43 2023 2023-10-05T21:16:13.741 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:16:13.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.693+0000 7f0000ff9700 20 reqs_thread_entry: start 2023-10-05T21:16:13.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.693+0000 7f00d5f67680 20 get_system_obj_state: rctx=0x7ffe93d6a6b8 obj=default.rgw.meta:users.uid:foo state=0x56018403d240 s->prefetch_data=0 2023-10-05T21:16:13.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.693+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560184247db0 con 0x560184190bc0 2023-10-05T21:16:13.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.693+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f00bc022080 con 0x560184190bc0 2023-10-05T21:16:13.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.693+0000 7f00d5f67680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:16:13.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.693+0000 7f00d5f67680 20 Read xattr: user.rgw.idtag 2023-10-05T21:16:13.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.693+0000 7f00d5f67680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.693+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56018424a040 con 0x560184190bc0 2023-10-05T21:16:13.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.694+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f00bc022080 con 0x560184190bc0 2023-10-05T21:16:13.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.694+0000 7f00d5f67680 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T21:16:13.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.694+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:104 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56018424a040 con 0x7f00b4007030 2023-10-05T21:16:13.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.694+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(104 usage.10 [call out=1268b] v0'0 uv32 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f00bc022080 con 0x7f00b4007030 2023-10-05T21:16:13.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.695+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94564511415088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560184206930 con 0x7f00c401d350 2023-10-05T21:16:13.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.695+0000 7f00c883e700 1 -- 172.21.15.153:0/3192613942 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(105 notify.0 [watch unwatch cookie 94564511415088] v31'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f00b4046070 con 0x7f00c401d350 2023-10-05T21:16:13.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.695+0000 7f00d5f67680 20 remove_watcher() i=0 2023-10-05T21:16:13.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.695+0000 7f00d5f67680 2 removed watcher, disabling cache 2023-10-05T21:16:13.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.695+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94564511421744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c7b30 con 0x560184190bc0 2023-10-05T21:16:13.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.696+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(106 notify.1 [watch unwatch cookie 94564511421744] v31'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f00bc022080 con 0x560184190bc0 2023-10-05T21:16:13.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.696+0000 7f00d5f67680 20 remove_watcher() i=1 2023-10-05T21:16:13.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.696+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94564511425440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c9530 con 0x5601841c1190 2023-10-05T21:16:13.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.697+0000 7f00c903f700 1 -- 172.21.15.153:0/3192613942 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(107 notify.2 [watch unwatch cookie 94564511425440] v31'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f00c4024020 con 0x5601841c1190 2023-10-05T21:16:13.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.697+0000 7f00d5f67680 20 remove_watcher() i=2 2023-10-05T21:16:13.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.697+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94564511429936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841c9530 con 0x7f00c401d350 2023-10-05T21:16:13.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.698+0000 7f00c883e700 1 -- 172.21.15.153:0/3192613942 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(108 notify.3 [watch unwatch cookie 94564511429936] v31'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f00b4046070 con 0x7f00c401d350 2023-10-05T21:16:13.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.698+0000 7f00d5f67680 20 remove_watcher() i=3 2023-10-05T21:16:13.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.698+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94564511434720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841cb530 con 0x560184190bc0 2023-10-05T21:16:13.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.699+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(109 notify.4 [watch unwatch cookie 94564511434720] v31'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f00bc022080 con 0x560184190bc0 2023-10-05T21:16:13.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.699+0000 7f00d5f67680 20 remove_watcher() i=4 2023-10-05T21:16:13.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.699+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94564511435824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841cc7e0 con 0x7f00b4007030 2023-10-05T21:16:13.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.699+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(110 notify.5 [watch unwatch cookie 94564511435824] v31'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f00bc022080 con 0x7f00b4007030 2023-10-05T21:16:13.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.699+0000 7f00d5f67680 20 remove_watcher() i=5 2023-10-05T21:16:13.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.699+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:111 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94564511438400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841ca3a0 con 0x7f00b4007030 2023-10-05T21:16:13.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.700+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(111 notify.6 [watch unwatch cookie 94564511438400] v31'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f00bc022080 con 0x7f00b4007030 2023-10-05T21:16:13.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.700+0000 7f00d5f67680 20 remove_watcher() i=6 2023-10-05T21:16:13.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.700+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94564511442080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841ca3a0 con 0x7f00b4007030 2023-10-05T21:16:13.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.701+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(112 notify.7 [watch unwatch cookie 94564511442080] v31'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f00bc022080 con 0x7f00b4007030 2023-10-05T21:16:13.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.701+0000 7f00d5f67680 20 remove_watcher() i=7 2023-10-05T21:16:13.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.702+0000 7f009a7e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:16:13.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.702+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:113 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94564511439968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601841ce4a0 con 0x560184190bc0 2023-10-05T21:16:13.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.702+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(113 data_loggenerations_metadata [watch unwatch cookie 94564511439968] v31'230 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f00bc022080 con 0x560184190bc0 2023-10-05T21:16:13.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.702+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f00b4007030 msgr2=0x7f00b401d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.702+0000 7f00d5f67680 1 --2- 172.21.15.153:0/3192613942 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f00b4007030 0x7f00b401d420 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.702+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x560184190bc0 msgr2=0x5601841beb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.702+0000 7f00d5f67680 1 --2- 172.21.15.153:0/3192613942 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x560184190bc0 0x5601841beb90 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.702+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f00c401d350 msgr2=0x7f00c400a0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.702+0000 7f00d5f67680 1 --2- 172.21.15.153:0/3192613942 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f00c401d350 0x7f00c400a0d0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.702+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5601841c1190 msgr2=0x5601841c3570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.702+0000 7f00d5f67680 1 --2- 172.21.15.153:0/3192613942 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5601841c1190 0x5601841c3570 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.703+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f00ac034190 msgr2=0x7f00ac036640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.703+0000 7f00d5f67680 1 --2- 172.21.15.153:0/3192613942 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f00ac034190 0x7f00ac036640 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f00b4003080 tx=0x7f00b4015000 comp rx=0 tx=0).stop 2023-10-05T21:16:13.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.703+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5601840fe0b0 msgr2=0x5601841b2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.703+0000 7f00d5f67680 1 --2- 172.21.15.153:0/3192613942 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5601840fe0b0 0x5601841b2e20 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f00c4000f80 tx=0x7f00c4014000 comp rx=0 tx=0).stop 2023-10-05T21:16:13.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.703+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 reap_dead start 2023-10-05T21:16:13.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.703+0000 7f00c9840700 1 -- 172.21.15.153:0/3192613942 reap_dead start 2023-10-05T21:16:13.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.703+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 shutdown_connections 2023-10-05T21:16:13.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.703+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 >> 172.21.15.153:0/3192613942 conn(0x560184184b90 msgr2=0x5601841a5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.703+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 shutdown_connections 2023-10-05T21:16:13.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.703+0000 7f00d5f67680 1 -- 172.21.15.153:0/3192613942 wait complete. 2023-10-05T21:16:13.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.703+0000 7f00d5f67680 1 -- 172.21.15.153:0/3621262843 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0010034190 msgr2=0x7f0010036640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.703+0000 7f00d5f67680 1 --2- 172.21.15.153:0/3621262843 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0010034190 0x7f0010036640 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x5601841ce1f0 tx=0x7f00bc005500 comp rx=0 tx=0).stop 2023-10-05T21:16:13.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.703+0000 7f00d5f67680 1 -- 172.21.15.153:0/3621262843 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5601841dc7f0 msgr2=0x5601841e23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.703+0000 7f00d5f67680 1 --2- 172.21.15.153:0/3621262843 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5601841dc7f0 0x5601841e23d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f00b402c000 tx=0x7f00b4031000 comp rx=0 tx=0).stop 2023-10-05T21:16:13.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.703+0000 7f00d5f67680 1 -- 172.21.15.153:0/3621262843 shutdown_connections 2023-10-05T21:16:13.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.703+0000 7f00d5f67680 1 --2- 172.21.15.153:0/3621262843 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f0010034190 0x7f0010036640 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.703+0000 7f00d5f67680 1 --2- 172.21.15.153:0/3621262843 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5601841dc7f0 0x5601841e23d0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.703+0000 7f00d5f67680 1 -- 172.21.15.153:0/3621262843 >> 172.21.15.153:0/3621262843 conn(0x5601841d79f0 msgr2=0x5601841d5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.703+0000 7f00d5f67680 1 -- 172.21.15.153:0/3621262843 shutdown_connections 2023-10-05T21:16:13.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.703+0000 7f00d5f67680 1 -- 172.21.15.153:0/3621262843 wait complete. 2023-10-05T21:16:13.748 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:16:13.748 INFO:teuthology.orchestra.run.smithi153.stdout: "entries": [ 2023-10-05T21:16:13.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.749 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:16:13.749 INFO:teuthology.orchestra.run.smithi153.stdout: "buckets": [ 2023-10-05T21:16:13.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.749 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "", 2023-10-05T21:16:13.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:13.749 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:13.749 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:13.749 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [] 2023-10-05T21:16:13.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.750 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo", 2023-10-05T21:16:13.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:13.750 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:13.750 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:13.750 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [ 2023-10-05T21:16:13.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.750 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "delete_bucket", 2023-10-05T21:16:13.750 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 217, 2023-10-05T21:16:13.750 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.751 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 2, 2023-10-05T21:16:13.751 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:13.751 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.751 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:13.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.751 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo2", 2023-10-05T21:16:13.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:13.751 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:13.751 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:13.751 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [ 2023-10-05T21:16:13.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.752 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "delete_bucket", 2023-10-05T21:16:13.752 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:13.752 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.752 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:13.752 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:13.752 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.752 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:13.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.752 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo3", 2023-10-05T21:16:13.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:13.753 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:13.753 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:13.753 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [ 2023-10-05T21:16:13.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.753 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "delete_bucket", 2023-10-05T21:16:13.753 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:13.753 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.753 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:13.753 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:13.753 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.753 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:13.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.754 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket": "myfoo4", 2023-10-05T21:16:13.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2023-10-05T21:00:00.000000Z", 2023-10-05T21:16:13.754 INFO:teuthology.orchestra.run.smithi153.stdout: "epoch": 1696539600, 2023-10-05T21:16:13.754 INFO:teuthology.orchestra.run.smithi153.stdout: "owner": "foo", 2023-10-05T21:16:13.754 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [ 2023-10-05T21:16:13.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.754 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "delete_bucket", 2023-10-05T21:16:13.754 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 0, 2023-10-05T21:16:13.754 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.754 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 1, 2023-10-05T21:16:13.755 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 1 2023-10-05T21:16:13.755 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.755 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:13.755 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.755 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:13.755 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.755 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:16:13.755 INFO:teuthology.orchestra.run.smithi153.stdout: "summary": [ 2023-10-05T21:16:13.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.755 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo", 2023-10-05T21:16:13.755 INFO:teuthology.orchestra.run.smithi153.stdout: "categories": [ 2023-10-05T21:16:13.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.756 INFO:teuthology.orchestra.run.smithi153.stdout: "category": "delete_bucket", 2023-10-05T21:16:13.756 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 217, 2023-10-05T21:16:13.756 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.756 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 5, 2023-10-05T21:16:13.756 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 4 2023-10-05T21:16:13.756 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.756 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:16:13.756 INFO:teuthology.orchestra.run.smithi153.stdout: "total": { 2023-10-05T21:16:13.756 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_sent": 217, 2023-10-05T21:16:13.756 INFO:teuthology.orchestra.run.smithi153.stdout: "bytes_received": 0, 2023-10-05T21:16:13.756 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": 5, 2023-10-05T21:16:13.757 INFO:teuthology.orchestra.run.smithi153.stdout: "successful_ops": 4 2023-10-05T21:16:13.757 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.757 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.757 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:16:13.757 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:16:13.757 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 217, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 217, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 217, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2023-10-05T21:16:13.757 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2023-10-05T21:16:13.757 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2023-10-05T21:16:13.758 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2023-10-05T21:16:13.810 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:16:13.810 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:16:13.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.810+0000 7f5ad5199680 1 Processor -- start 2023-10-05T21:16:13.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.810+0000 7f5ad5199680 1 -- start start 2023-10-05T21:16:13.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.810+0000 7f5ad5199680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x560d700d40b0 0x560d701630d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.810+0000 7f5ad5199680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560d700ad930 con 0x560d70163610 2023-10-05T21:16:13.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.810+0000 7f5ad5199680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x560d7006ddb0 con 0x560d700d40b0 2023-10-05T21:16:13.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.810+0000 7f5ac7a70700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x560d70163610 0x560d701659f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:57848/0 (socket says 172.21.15.153:57848) 2023-10-05T21:16:13.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.810+0000 7f5ac7a70700 1 -- 172.21.15.153:0/2489705480 learned_addr learned my addr 172.21.15.153:0/2489705480 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:16:13.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.810+0000 7f5ac8271700 1 --2- 172.21.15.153:0/2489705480 >> v2:172.21.15.111:3300/0 conn(0x560d700d40b0 0x560d701630d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.810+0000 7f5ac8271700 1 -- 172.21.15.153:0/2489705480 >> v1:172.21.15.111:6789/0 conn(0x560d70163610 legacy=0x560d701659f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.810+0000 7f5ac726f700 1 -- 172.21.15.153:0/2489705480 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3007494570 0 0) 0x560d700ad930 con 0x560d70163610 2023-10-05T21:16:13.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.810+0000 7f5ac8271700 1 -- 172.21.15.153:0/2489705480 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d70168220 con 0x560d700d40b0 2023-10-05T21:16:13.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.811+0000 7f5ac8271700 1 --2- 172.21.15.153:0/2489705480 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d700d40b0 0x560d701630d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f5ab800a5d0 tx=0x7f5ab8005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb75ba866e7d8bdb server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.811+0000 7f5ac726f700 1 -- 172.21.15.153:0/2489705480 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ab80086a0 con 0x560d700d40b0 2023-10-05T21:16:13.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.811+0000 7f5ac726f700 1 -- 172.21.15.153:0/2489705480 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab8008800 con 0x560d700d40b0 2023-10-05T21:16:13.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.811+0000 7f5ac726f700 1 -- 172.21.15.153:0/2489705480 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ab8008ad0 con 0x560d700d40b0 2023-10-05T21:16:13.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.811+0000 7f5ad5199680 1 -- 172.21.15.153:0/2489705480 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d700d40b0 msgr2=0x560d701630d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.811+0000 7f5ad5199680 1 --2- 172.21.15.153:0/2489705480 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d700d40b0 0x560d701630d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f5ab800a5d0 tx=0x7f5ab8005a50 comp rx=0 tx=0).stop 2023-10-05T21:16:13.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.811+0000 7f5ad5199680 1 -- 172.21.15.153:0/2489705480 shutdown_connections 2023-10-05T21:16:13.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.811+0000 7f5ad5199680 1 --2- 172.21.15.153:0/2489705480 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d700d40b0 0x560d701630d0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.811+0000 7f5ad5199680 1 -- 172.21.15.153:0/2489705480 >> 172.21.15.153:0/2489705480 conn(0x560d7015abc0 msgr2=0x560d7015cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.811+0000 7f5ad5199680 1 -- 172.21.15.153:0/2489705480 shutdown_connections 2023-10-05T21:16:13.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.811+0000 7f5ad5199680 1 -- 172.21.15.153:0/2489705480 wait complete. 2023-10-05T21:16:13.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.812+0000 7f5ad5199680 1 Processor -- start 2023-10-05T21:16:13.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.812+0000 7f5ad5199680 1 -- start start 2023-10-05T21:16:13.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.812+0000 7f5ad5199680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d700d40b0 0x560d7017f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.812+0000 7f5ad5199680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d7000dea0 con 0x560d700d40b0 2023-10-05T21:16:13.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.812+0000 7f5ac8271700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d700d40b0 0x560d7017f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.812+0000 7f5ac8271700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d700d40b0 0x560d7017f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:54998/0 (socket says 172.21.15.153:54998) 2023-10-05T21:16:13.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.812+0000 7f5ac8271700 1 -- 172.21.15.153:0/2623938027 learned_addr learned my addr 172.21.15.153:0/2623938027 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:13.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.812+0000 7f5ac8271700 1 -- 172.21.15.153:0/2623938027 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab8005cf0 con 0x560d700d40b0 2023-10-05T21:16:13.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.813+0000 7f5ac8271700 1 --2- 172.21.15.153:0/2623938027 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d700d40b0 0x560d7017f820 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8000c00 tx=0x7f5ab8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8684fc7e6fa80d98 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.813+0000 7f5ac626d700 1 -- 172.21.15.153:0/2623938027 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ab80086a0 con 0x560d700d40b0 2023-10-05T21:16:13.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.813+0000 7f5ac626d700 1 -- 172.21.15.153:0/2623938027 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab8008970 con 0x560d700d40b0 2023-10-05T21:16:13.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.813+0000 7f5ac626d700 1 -- 172.21.15.153:0/2623938027 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ab8008b20 con 0x560d700d40b0 2023-10-05T21:16:13.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.813+0000 7f5ad5199680 1 -- 172.21.15.153:0/2623938027 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d700d40b0 msgr2=0x560d7017f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.813+0000 7f5ad5199680 1 --2- 172.21.15.153:0/2623938027 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d700d40b0 0x560d7017f820 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8000c00 tx=0x7f5ab8015000 comp rx=0 tx=0).stop 2023-10-05T21:16:13.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.813+0000 7f5ad5199680 1 -- 172.21.15.153:0/2623938027 shutdown_connections 2023-10-05T21:16:13.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.813+0000 7f5ad5199680 1 --2- 172.21.15.153:0/2623938027 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d700d40b0 0x560d7017f820 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.813+0000 7f5ad5199680 1 -- 172.21.15.153:0/2623938027 >> 172.21.15.153:0/2623938027 conn(0x560d7015abc0 msgr2=0x560d7017b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.813+0000 7f5ad5199680 1 -- 172.21.15.153:0/2623938027 shutdown_connections 2023-10-05T21:16:13.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.813+0000 7f5ad5199680 1 -- 172.21.15.153:0/2623938027 wait complete. 2023-10-05T21:16:13.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.814+0000 7f5ad5199680 1 Processor -- start 2023-10-05T21:16:13.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.814+0000 7f5ad5199680 1 -- start start 2023-10-05T21:16:13.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.814+0000 7f5ad5199680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d700d40b0 0x560d70186bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.814+0000 7f5ad5199680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d70004c80 con 0x560d700d40b0 2023-10-05T21:16:13.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.814+0000 7f5ac8271700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d700d40b0 0x560d70186bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.814+0000 7f5ac8271700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d700d40b0 0x560d70186bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:55006/0 (socket says 172.21.15.153:55006) 2023-10-05T21:16:13.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.814+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 learned_addr learned my addr 172.21.15.153:0/2098209569 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:13.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.814+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d70168220 con 0x560d700d40b0 2023-10-05T21:16:13.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.814+0000 7f5ac8271700 1 --2- 172.21.15.153:0/2098209569 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d700d40b0 0x560d70186bd0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5ab800a520 tx=0x7f5ab801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.814+0000 7f5ac4a6a700 1 -- 172.21.15.153:0/2098209569 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ab801d420 con 0x560d700d40b0 2023-10-05T21:16:13.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.814+0000 7f5ac4a6a700 1 -- 172.21.15.153:0/2098209569 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab801d580 con 0x560d700d40b0 2023-10-05T21:16:13.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.815+0000 7f5ac4a6a700 1 -- 172.21.15.153:0/2098209569 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ab801d730 con 0x560d700d40b0 2023-10-05T21:16:13.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.815+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560d70187110 con 0x560d700d40b0 2023-10-05T21:16:13.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.815+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d70187500 con 0x560d700d40b0 2023-10-05T21:16:13.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.815+0000 7f5ad5199680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.815+0000 7f5ac4a6a700 1 -- 172.21.15.153:0/2098209569 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f5ab801d9a0 con 0x560d700d40b0 2023-10-05T21:16:13.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.816+0000 7f5ac4a6a700 1 --2- 172.21.15.153:0/2098209569 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5ab4034140 0x7f5ab40365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.816+0000 7f5ac4a6a700 1 -- 172.21.15.153:0/2098209569 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f5ab804a3f0 con 0x560d700d40b0 2023-10-05T21:16:13.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.816+0000 7f5ac7a70700 1 --2- 172.21.15.153:0/2098209569 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5ab4034140 0x7f5ab40365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.816+0000 7f5ad5199680 1 --2- 172.21.15.153:0/2098209569 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x560d70163610 0x560d701929e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.816+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70193170 con 0x560d70163610 2023-10-05T21:16:13.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.816+0000 7f5ac8a72700 1 --2- 172.21.15.153:0/2098209569 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x560d70163610 0x560d701929e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.816+0000 7f5ac7a70700 1 --2- 172.21.15.153:0/2098209569 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5ab4034140 0x7f5ab40365f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0011e0 tx=0x7f5abc0013a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.816+0000 7f5ac8a72700 1 --2- 172.21.15.153:0/2098209569 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x560d70163610 0x560d701929e0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.817+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.817+0000 7f5ad5199680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.817+0000 7f5ad5199680 20 realm 2023-10-05T21:16:13.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.817+0000 7f5ad5199680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.817+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d7018ff00 con 0x560d70163610 2023-10-05T21:16:13.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.817+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.817+0000 7f5ad5199680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.817+0000 7f5ad5199680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:16:13.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.817+0000 7f5ad5199680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.817+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70193c20 con 0x560d70163610 2023-10-05T21:16:13.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.817+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.817+0000 7f5ad5199680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.817+0000 7f5ad5199680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.817+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70194510 con 0x560d70163610 2023-10-05T21:16:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.817+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.817+0000 7f5ad5199680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.817+0000 7f5ad5199680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.817+0000 7f5ad5199680 1 --2- 172.21.15.153:0/2098209569 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x560d70194dd0 0x560d701971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.817+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701977c0 con 0x560d70194dd0 2023-10-05T21:16:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.818+0000 7f5ac8271700 1 --2- 172.21.15.153:0/2098209569 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x560d70194dd0 0x560d701971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.818+0000 7f5ac8271700 1 --2- 172.21.15.153:0/2098209569 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x560d70194dd0 0x560d701971b0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.818+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f5ab8036070 con 0x560d70194dd0 2023-10-05T21:16:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.818+0000 7f5ad5199680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:16:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.818+0000 7f5ad5199680 20 searching for the correct realm 2023-10-05T21:16:13.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.818+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x560d70194dd0 2023-10-05T21:16:13.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.818+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ab8036070 con 0x560d70194dd0 2023-10-05T21:16:13.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.818+0000 7f5ac8271700 1 --2- 172.21.15.153:0/2098209569 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f5ab8039030 0x7f5ab8048a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.818+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x7f5ab8039030 2023-10-05T21:16:13.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.819+0000 7f5ac7a70700 1 --2- 172.21.15.153:0/2098209569 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f5ab8039030 0x7f5ab8048a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.819+0000 7f5ac7a70700 1 --2- 172.21.15.153:0/2098209569 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f5ab8039030 0x7f5ab8048a00 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.819+0000 7f5ac7a70700 1 -- 172.21.15.153:0/2098209569 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5abc006070 con 0x7f5ab8039030 2023-10-05T21:16:13.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.819+0000 7f5ac7a70700 1 --2- 172.21.15.153:0/2098209569 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f5abc00d8e0 0x7f5abc00c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.819+0000 7f5ac7a70700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x7f5abc00d8e0 2023-10-05T21:16:13.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.819+0000 7f5ac8a72700 1 --2- 172.21.15.153:0/2098209569 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f5abc00d8e0 0x7f5abc00c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.820+0000 7f5ac8a72700 1 --2- 172.21.15.153:0/2098209569 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f5abc00d8e0 0x7f5abc00c360 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.820+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.820+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x560d70163610 2023-10-05T21:16:13.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.820+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.820+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x560d70163610 2023-10-05T21:16:13.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.820+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.820+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x7f5abc00d8e0 2023-10-05T21:16:13.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.821+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.821+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x7f5abc00d8e0 2023-10-05T21:16:13.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.821+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.821+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x7f5ab8039030 2023-10-05T21:16:13.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.821+0000 7f5ac7a70700 1 -- 172.21.15.153:0/2098209569 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5abc006070 con 0x7f5ab8039030 2023-10-05T21:16:13.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.821+0000 7f5ac7a70700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x560d70194dd0 2023-10-05T21:16:13.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.821+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5ab8036070 con 0x560d70194dd0 2023-10-05T21:16:13.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.821+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x560d70163610 2023-10-05T21:16:13.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.821+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.821+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x7f5abc00d8e0 2023-10-05T21:16:13.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.822+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.822+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x560d70163610 2023-10-05T21:16:13.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.822+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.822+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x7f5ab8039030 2023-10-05T21:16:13.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.822+0000 7f5ac7a70700 1 -- 172.21.15.153:0/2098209569 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5abc006070 con 0x7f5ab8039030 2023-10-05T21:16:13.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.822+0000 7f5ac7a70700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x560d70194dd0 2023-10-05T21:16:13.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.822+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ab8036070 con 0x560d70194dd0 2023-10-05T21:16:13.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.822+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x560d70194dd0 2023-10-05T21:16:13.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.823+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ab8036070 con 0x560d70194dd0 2023-10-05T21:16:13.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.823+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x7f5abc00d8e0 2023-10-05T21:16:13.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.823+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.823+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x560d70194dd0 2023-10-05T21:16:13.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.823+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ab8036070 con 0x560d70194dd0 2023-10-05T21:16:13.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.823+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x560d70194dd0 2023-10-05T21:16:13.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.823+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ab8036070 con 0x560d70194dd0 2023-10-05T21:16:13.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.823+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x560d70163610 2023-10-05T21:16:13.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.824+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.824+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x560d70163610 2023-10-05T21:16:13.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.824+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.824+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x7f5abc00d8e0 2023-10-05T21:16:13.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.824+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.824+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x560d70194dd0 2023-10-05T21:16:13.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.825+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ab8036070 con 0x560d70194dd0 2023-10-05T21:16:13.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.825+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x7f5ab8039030 2023-10-05T21:16:13.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.825+0000 7f5ac7a70700 1 -- 172.21.15.153:0/2098209569 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5abc006070 con 0x7f5ab8039030 2023-10-05T21:16:13.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.825+0000 7f5ac7a70700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x560d70163610 2023-10-05T21:16:13.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.825+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.825+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x7f5abc00d8e0 2023-10-05T21:16:13.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.825+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.825+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x560d70194dd0 2023-10-05T21:16:13.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.825+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ab8036070 con 0x560d70194dd0 2023-10-05T21:16:13.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.826+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x7f5abc00d8e0 2023-10-05T21:16:13.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.826+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.826+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x7f5ab8039030 2023-10-05T21:16:13.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.826+0000 7f5ac7a70700 1 -- 172.21.15.153:0/2098209569 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5abc006070 con 0x7f5ab8039030 2023-10-05T21:16:13.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.826+0000 7f5ac7a70700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x560d70194dd0 2023-10-05T21:16:13.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.826+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ab8036070 con 0x560d70194dd0 2023-10-05T21:16:13.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.826+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x7f5abc00d8e0 2023-10-05T21:16:13.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.827+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.827+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x560d70163610 2023-10-05T21:16:13.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.827+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.827+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701992a0 con 0x7f5ab8039030 2023-10-05T21:16:13.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.827+0000 7f5ac7a70700 1 -- 172.21.15.153:0/2098209569 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5abc006070 con 0x7f5ab8039030 2023-10-05T21:16:13.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.827+0000 7f5ad5199680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:16:13.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.827+0000 7f5ad5199680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:16:13.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.827+0000 7f5ad5199680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:16:13.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.827+0000 7f5ad5199680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:16:13.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.827+0000 7f5ad5199680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.827+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701981f0 con 0x560d70163610 2023-10-05T21:16:13.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.827+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.827+0000 7f5ad5199680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.827+0000 7f5ad5199680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.827+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701985f0 con 0x560d70163610 2023-10-05T21:16:13.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.828+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.828+0000 7f5ad5199680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:13.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.828+0000 7f5ad5199680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.828+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199730 con 0x560d70163610 2023-10-05T21:16:13.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.828+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.828+0000 7f5ad5199680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:16:13.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.828+0000 7f5ad5199680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.828+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199ae0 con 0x560d70194dd0 2023-10-05T21:16:13.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.828+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f5ab8036070 con 0x560d70194dd0 2023-10-05T21:16:13.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.828+0000 7f5ad5199680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.828+0000 7f5ad5199680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.828+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199e90 con 0x560d70163610 2023-10-05T21:16:13.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.828+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.828+0000 7f5ad5199680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.828+0000 7f5ad5199680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.828+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199ec0 con 0x560d70163610 2023-10-05T21:16:13.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.829+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.829+0000 7f5ad5199680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:13.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.829+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199e90 con 0x560d70194dd0 2023-10-05T21:16:13.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.829+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ab8036070 con 0x560d70194dd0 2023-10-05T21:16:13.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.829+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199e90 con 0x7f5ab8039030 2023-10-05T21:16:13.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.829+0000 7f5ac7a70700 1 -- 172.21.15.153:0/2098209569 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5abc006070 con 0x7f5ab8039030 2023-10-05T21:16:13.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.829+0000 7f5ac7a70700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199e90 con 0x7f5abc00d8e0 2023-10-05T21:16:13.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.829+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.829+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199730 con 0x560d70163610 2023-10-05T21:16:13.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.830+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.830+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199730 con 0x560d70163610 2023-10-05T21:16:13.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.830+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.830+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199730 con 0x7f5abc00d8e0 2023-10-05T21:16:13.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.830+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.830+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199730 con 0x7f5abc00d8e0 2023-10-05T21:16:13.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.830+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.830+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199730 con 0x7f5ab8039030 2023-10-05T21:16:13.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.830+0000 7f5ac7a70700 1 -- 172.21.15.153:0/2098209569 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5abc006070 con 0x7f5ab8039030 2023-10-05T21:16:13.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.830+0000 7f5ac7a70700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199730 con 0x560d70194dd0 2023-10-05T21:16:13.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.831+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5ab8036070 con 0x560d70194dd0 2023-10-05T21:16:13.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.831+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199730 con 0x560d70163610 2023-10-05T21:16:13.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.831+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.831+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199730 con 0x7f5abc00d8e0 2023-10-05T21:16:13.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.831+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.831+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199730 con 0x560d70163610 2023-10-05T21:16:13.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.831+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.831+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199730 con 0x7f5ab8039030 2023-10-05T21:16:13.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.831+0000 7f5ac7a70700 1 -- 172.21.15.153:0/2098209569 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5abc006070 con 0x7f5ab8039030 2023-10-05T21:16:13.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.831+0000 7f5ac7a70700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199730 con 0x560d70194dd0 2023-10-05T21:16:13.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.832+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ab8036070 con 0x560d70194dd0 2023-10-05T21:16:13.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.832+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199730 con 0x560d70194dd0 2023-10-05T21:16:13.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.832+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ab8036070 con 0x560d70194dd0 2023-10-05T21:16:13.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.832+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199730 con 0x7f5abc00d8e0 2023-10-05T21:16:13.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.832+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.832+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199730 con 0x560d70194dd0 2023-10-05T21:16:13.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.832+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ab8036070 con 0x560d70194dd0 2023-10-05T21:16:13.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.832+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199730 con 0x560d70194dd0 2023-10-05T21:16:13.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.832+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ab8036070 con 0x560d70194dd0 2023-10-05T21:16:13.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.832+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199730 con 0x560d70163610 2023-10-05T21:16:13.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.833+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.833+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199730 con 0x560d70163610 2023-10-05T21:16:13.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.833+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.833+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199730 con 0x7f5abc00d8e0 2023-10-05T21:16:13.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.833+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.833+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199730 con 0x560d70194dd0 2023-10-05T21:16:13.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.833+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ab8036070 con 0x560d70194dd0 2023-10-05T21:16:13.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.833+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199730 con 0x7f5ab8039030 2023-10-05T21:16:13.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.834+0000 7f5ac7a70700 1 -- 172.21.15.153:0/2098209569 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5abc006070 con 0x7f5ab8039030 2023-10-05T21:16:13.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.834+0000 7f5ac7a70700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199730 con 0x560d70163610 2023-10-05T21:16:13.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.834+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.834+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199730 con 0x7f5abc00d8e0 2023-10-05T21:16:13.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.834+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.834+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199730 con 0x560d70194dd0 2023-10-05T21:16:13.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.834+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ab8036070 con 0x560d70194dd0 2023-10-05T21:16:13.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.834+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199730 con 0x7f5abc00d8e0 2023-10-05T21:16:13.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.834+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.834+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199730 con 0x7f5ab8039030 2023-10-05T21:16:13.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.835+0000 7f5ac7a70700 1 -- 172.21.15.153:0/2098209569 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5abc006070 con 0x7f5ab8039030 2023-10-05T21:16:13.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.835+0000 7f5ac7a70700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199730 con 0x560d70194dd0 2023-10-05T21:16:13.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.835+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ab8036070 con 0x560d70194dd0 2023-10-05T21:16:13.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.835+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199730 con 0x7f5abc00d8e0 2023-10-05T21:16:13.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.835+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.835+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199730 con 0x560d70163610 2023-10-05T21:16:13.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.835+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.835+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199730 con 0x7f5ab8039030 2023-10-05T21:16:13.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.836+0000 7f5ac7a70700 1 -- 172.21.15.153:0/2098209569 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5abc006070 con 0x7f5ab8039030 2023-10-05T21:16:13.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.836+0000 7f5ad5199680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:16:13.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.836+0000 7f5ad5199680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:16:13.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.836+0000 7f5ad5199680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:16:13.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.836+0000 7f5ad5199680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:16:13.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.836+0000 7f5ad5199680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.836+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d70199e90 con 0x560d70163610 2023-10-05T21:16:13.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.836+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.836+0000 7f5ad5199680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:13.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.836+0000 7f5ad5199680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.836+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d7019a2f0 con 0x560d70194dd0 2023-10-05T21:16:13.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.836+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f5ab8036070 con 0x560d70194dd0 2023-10-05T21:16:13.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.836+0000 7f5ad5199680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:16:13.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.836+0000 7f5ad5199680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.836+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d7019abe0 con 0x560d70163610 2023-10-05T21:16:13.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.836+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.836+0000 7f5ad5199680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:13.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.836+0000 7f5ad5199680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.836+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d7019abe0 con 0x560d70163610 2023-10-05T21:16:13.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.837+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.837+0000 7f5ad5199680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:16:13.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.837+0000 7f5ad5199680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.837+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d7019b020 con 0x7f5abc00d8e0 2023-10-05T21:16:13.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.837+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.837+0000 7f5ad5199680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.837+0000 7f5ad5199680 20 zone default found 2023-10-05T21:16:13.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.837+0000 7f5ad5199680 4 Realm: () 2023-10-05T21:16:13.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.837+0000 7f5ad5199680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:16:13.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.837+0000 7f5ad5199680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:16:13.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.837+0000 7f5ad5199680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:16:13.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.837+0000 7f5ad5199680 20 zonegroup default 2023-10-05T21:16:13.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.837+0000 7f5ad5199680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.837+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d7019b020 con 0x7f5abc00d8e0 2023-10-05T21:16:13.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.837+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.837+0000 7f5ad5199680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.837+0000 7f5ad5199680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.837+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d7019c690 con 0x560d70194dd0 2023-10-05T21:16:13.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.837+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5ab8036070 con 0x560d70194dd0 2023-10-05T21:16:13.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.837+0000 7f5ad5199680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.838+0000 7f5ad5199680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.838+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d7019ca40 con 0x560d70194dd0 2023-10-05T21:16:13.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.838+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5ab8036070 con 0x560d70194dd0 2023-10-05T21:16:13.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.838+0000 7f5ad5199680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.838+0000 7f5ad5199680 20 started sync module instance, tier type = 2023-10-05T21:16:13.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.838+0000 7f5ad5199680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:16:13.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.838+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d7019bda0 con 0x7f5ab8039030 2023-10-05T21:16:13.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.839+0000 7f5ac7a70700 1 -- 172.21.15.153:0/2098209569 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v31'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5abc006070 con 0x7f5ab8039030 2023-10-05T21:16:13.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.839+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94615715299744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d7019d2e0 con 0x7f5ab8039030 2023-10-05T21:16:13.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.839+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d7019db80 con 0x560d70163610 2023-10-05T21:16:13.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.839+0000 7f5ac7a70700 1 -- 172.21.15.153:0/2098209569 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94615715299744] v31'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5abc006070 con 0x7f5ab8039030 2023-10-05T21:16:13.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.839+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v31'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.839+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94615715305104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d7019cf30 con 0x560d70163610 2023-10-05T21:16:13.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.839+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d7019e7f0 con 0x560d70194dd0 2023-10-05T21:16:13.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.840+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94615715305104] v31'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.840+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v31'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ab8036070 con 0x560d70194dd0 2023-10-05T21:16:13.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.840+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94615715308160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d7019ebf0 con 0x560d70194dd0 2023-10-05T21:16:13.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.840+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d7019f600 con 0x7f5ab8039030 2023-10-05T21:16:13.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.841+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94615715308160] v31'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ab8036070 con 0x560d70194dd0 2023-10-05T21:16:13.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.841+0000 7f5ac7a70700 1 -- 172.21.15.153:0/2098209569 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v31'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5abc006070 con 0x7f5ab8039030 2023-10-05T21:16:13.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.841+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94615715311888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d7019f9b0 con 0x7f5ab8039030 2023-10-05T21:16:13.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.841+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701a03c0 con 0x560d70163610 2023-10-05T21:16:13.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.842+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v31'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.842+0000 7f5ac7a70700 1 -- 172.21.15.153:0/2098209569 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94615715311888] v31'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5abc006070 con 0x7f5ab8039030 2023-10-05T21:16:13.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.842+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94615715315968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701a0b00 con 0x560d70163610 2023-10-05T21:16:13.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.842+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701a1510 con 0x7f5abc00d8e0 2023-10-05T21:16:13.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.843+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94615715315968] v31'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.843+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v31'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.843+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94615715317072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701a0ac0 con 0x7f5abc00d8e0 2023-10-05T21:16:13.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.843+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701a1bd0 con 0x7f5abc00d8e0 2023-10-05T21:16:13.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.843+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94615715317072] v31'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.843+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v31'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.843+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94615715321472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701a1b90 con 0x7f5abc00d8e0 2023-10-05T21:16:13.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.843+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701a2640 con 0x7f5abc00d8e0 2023-10-05T21:16:13.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.844+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94615715321472] v31'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.844+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v31'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.844+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94615715319840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701a2600 con 0x7f5abc00d8e0 2023-10-05T21:16:13.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.844+0000 7f5ad5199680 20 add_watcher() i=0 2023-10-05T21:16:13.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.844+0000 7f5ad5199680 20 add_watcher() i=1 2023-10-05T21:16:13.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.844+0000 7f5ad5199680 20 add_watcher() i=2 2023-10-05T21:16:13.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.844+0000 7f5ad5199680 20 add_watcher() i=3 2023-10-05T21:16:13.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.844+0000 7f5ad5199680 20 add_watcher() i=4 2023-10-05T21:16:13.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.844+0000 7f5ad5199680 20 add_watcher() i=5 2023-10-05T21:16:13.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.844+0000 7f5ad5199680 20 add_watcher() i=6 2023-10-05T21:16:13.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.845+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94615715319840] v31'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.845+0000 7f5ad5199680 20 add_watcher() i=7 2023-10-05T21:16:13.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.845+0000 7f5ad5199680 2 all 8 watchers are set, enabling cache 2023-10-05T21:16:13.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.845+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701a5a40 con 0x560d70163610 2023-10-05T21:16:13.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.845+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.845+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94615715324640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701a2f00 con 0x560d70163610 2023-10-05T21:16:13.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.846+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94615715324640] v31'231 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.846+0000 7f5a99fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:16:13.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.846+0000 7f5ad5199680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:16:13.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.846+0000 7f5ad5199680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:16:13.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.846+0000 7f5ad5199680 1 Processor -- start 2023-10-05T21:16:13.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.847+0000 7f5ad5199680 1 -- start start 2023-10-05T21:16:13.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.847+0000 7f5ad5199680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d701af670 0x560d701afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.847+0000 7f5ad5199680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d701b0090 con 0x560d701af670 2023-10-05T21:16:13.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.847+0000 7f5ac7a70700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d701af670 0x560d701afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.847+0000 7f5ac7a70700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d701af670 0x560d701afa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:55012/0 (socket says 172.21.15.153:55012) 2023-10-05T21:16:13.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.847+0000 7f5ac7a70700 1 -- 172.21.15.153:0/2325439113 learned_addr learned my addr 172.21.15.153:0/2325439113 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:13.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.847+0000 7f5ac7a70700 1 -- 172.21.15.153:0/2325439113 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d701b0570 con 0x560d701af670 2023-10-05T21:16:13.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.847+0000 7f5ac7a70700 1 --2- 172.21.15.153:0/2325439113 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d701af670 0x560d701afa80 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x560d70197c40 tx=0x7f5abc006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99bc08aa28cc2a06 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.847+0000 7f5a997e2700 1 -- 172.21.15.153:0/2325439113 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5abc023040 con 0x560d701af670 2023-10-05T21:16:13.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.848+0000 7f5a997e2700 1 -- 172.21.15.153:0/2325439113 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5abc024040 con 0x560d701af670 2023-10-05T21:16:13.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.848+0000 7f5a997e2700 1 -- 172.21.15.153:0/2325439113 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5abc013040 con 0x560d701af670 2023-10-05T21:16:13.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.848+0000 7f5ad5199680 1 -- 172.21.15.153:0/2325439113 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d701af670 msgr2=0x560d701afa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.848+0000 7f5ad5199680 1 --2- 172.21.15.153:0/2325439113 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d701af670 0x560d701afa80 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x560d70197c40 tx=0x7f5abc006000 comp rx=0 tx=0).stop 2023-10-05T21:16:13.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.848+0000 7f5ad5199680 1 -- 172.21.15.153:0/2325439113 shutdown_connections 2023-10-05T21:16:13.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.848+0000 7f5ad5199680 1 --2- 172.21.15.153:0/2325439113 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d701af670 0x560d701afa80 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.848+0000 7f5ad5199680 1 -- 172.21.15.153:0/2325439113 >> 172.21.15.153:0/2325439113 conn(0x560d701ab970 msgr2=0x560d701a9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.848+0000 7f5ad5199680 1 -- 172.21.15.153:0/2325439113 shutdown_connections 2023-10-05T21:16:13.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.848+0000 7f5ad5199680 1 -- 172.21.15.153:0/2325439113 wait complete. 2023-10-05T21:16:13.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.849+0000 7f5ad5199680 1 Processor -- start 2023-10-05T21:16:13.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.849+0000 7f5ad5199680 1 -- start start 2023-10-05T21:16:13.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.849+0000 7f5ad5199680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d701af670 0x560d701b6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.849+0000 7f5ad5199680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d701b6870 con 0x560d701af670 2023-10-05T21:16:13.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.849+0000 7f5ac7a70700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d701af670 0x560d701b6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.849+0000 7f5ac7a70700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d701af670 0x560d701b6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:55028/0 (socket says 172.21.15.153:55028) 2023-10-05T21:16:13.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.849+0000 7f5ac7a70700 1 -- 172.21.15.153:0/1481045069 learned_addr learned my addr 172.21.15.153:0/1481045069 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:13.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.849+0000 7f5ac7a70700 1 -- 172.21.15.153:0/1481045069 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5abc00ed20 con 0x560d701af670 2023-10-05T21:16:13.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.849+0000 7f5ac7a70700 1 --2- 172.21.15.153:0/1481045069 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d701af670 0x560d701b6330 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f5abc00dfd0 tx=0x7f5abc030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.850+0000 7f5a137fe700 1 -- 172.21.15.153:0/1481045069 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5abc023040 con 0x560d701af670 2023-10-05T21:16:13.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.850+0000 7f5a137fe700 1 -- 172.21.15.153:0/1481045069 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5abc01e5f0 con 0x560d701af670 2023-10-05T21:16:13.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.850+0000 7f5ad5199680 1 -- 172.21.15.153:0/1481045069 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560d701b6a70 con 0x560d701af670 2023-10-05T21:16:13.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.850+0000 7f5a137fe700 1 -- 172.21.15.153:0/1481045069 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5abc01e780 con 0x560d701af670 2023-10-05T21:16:13.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.850+0000 7f5ad5199680 1 -- 172.21.15.153:0/1481045069 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d701b6ec0 con 0x560d701af670 2023-10-05T21:16:13.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.850+0000 7f5a137fe700 1 -- 172.21.15.153:0/1481045069 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f5abc01e8e0 con 0x560d701af670 2023-10-05T21:16:13.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.851+0000 7f5a137fe700 1 --2- 172.21.15.153:0/1481045069 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5a08034140 0x7f5a080365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.851+0000 7f5a137fe700 1 -- 172.21.15.153:0/1481045069 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f5abc04fc00 con 0x560d701af670 2023-10-05T21:16:13.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.851+0000 7f5ac8a72700 1 --2- 172.21.15.153:0/1481045069 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5a08034140 0x7f5a080365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.851+0000 7f5ad5199680 5 note: GC not initialized 2023-10-05T21:16:13.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.851+0000 7f5ac8a72700 1 --2- 172.21.15.153:0/1481045069 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5a08034140 0x7f5a080365f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x560d701a2880 tx=0x7f5ac0037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.852+0000 7f5a10ff9700 20 reqs_thread_entry: start 2023-10-05T21:16:13.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.852+0000 7f5a067fc700 20 reqs_thread_entry: start 2023-10-05T21:16:13.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.852+0000 7f5ad5199680 20 init_complete bucket index max shards: 11 2023-10-05T21:16:13.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.852+0000 7f5ad5199680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:16:13.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.852+0000 7f5a04ff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:16:44 2023 2023-10-05T21:16:13.883 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:16:13.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.852+0000 7f59ebfff700 20 reqs_thread_entry: start 2023-10-05T21:16:13.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.852+0000 7f5ad5199680 20 get_system_obj_state: rctx=0x7ffc93d61fa8 obj=default.rgw.meta:users.uid:bar state=0x560d70013240 s->prefetch_data=0 2023-10-05T21:16:13.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.852+0000 7f5ad5199680 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2023-10-05T21:16:13.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.852+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:102 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d7021bc10 con 0x7f5abc00d8e0 2023-10-05T21:16:13.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.852+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(102 bar [call,getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.853+0000 7f5ad5199680 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2023-10-05T21:16:13.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.853+0000 7f5ad5199680 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2023-10-05T21:16:13.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.853+0000 7f5ad5199680 20 get_system_obj_state: rctx=0x7ffc93d61c98 obj=default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A state=0x560d70013240 s->prefetch_data=0 2023-10-05T21:16:13.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.853+0000 7f5ad5199680 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2023-10-05T21:16:13.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.853+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d7021ac00 con 0x560d70163610 2023-10-05T21:16:13.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.853+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(103 NX5QOQKC6BH2IDN8HC7A [getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.853+0000 7f5ad5199680 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2023-10-05T21:16:13.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.853+0000 7f5ad5199680 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2023-10-05T21:16:13.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.853+0000 7f5ad5199680 20 get_system_obj_state: rctx=0x7ffc93d61528 obj=default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A state=0x560d70013240 s->prefetch_data=0 2023-10-05T21:16:13.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.853+0000 7f5ad5199680 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2023-10-05T21:16:13.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.853+0000 7f5ad5199680 20 get_system_obj_state: rctx=0x7ffc93d61bd8 obj=default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A state=0x560d70013240 s->prefetch_data=0 2023-10-05T21:16:13.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.853+0000 7f5ad5199680 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2023-10-05T21:16:13.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.853+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:104 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d7021e490 con 0x7f5abc00d8e0 2023-10-05T21:16:13.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.854+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(104 bar [delete,create,call,writefull 0~346] v31'6 uv6 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.854+0000 7f5ad5199680 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2023-10-05T21:16:13.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.854+0000 7f5ad5199680 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2023-10-05T21:16:13.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.854+0000 7f5ad5199680 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2023-10-05T21:16:13.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.854+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:105 7.9 7:93e5b521:::notify.7:head [notify cookie 94615715831424 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d7021f150 con 0x7f5abc00d8e0 2023-10-05T21:16:13.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.854+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== watch-notify(notify (1) cookie 94615715319840 notify 133143986199 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x7f5ac002d040 con 0x7f5abc00d8e0 2023-10-05T21:16:13.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.854+0000 7f5ac626d700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986199 cookie 94615715319840 notifier 4706 bl.length()=522 2023-10-05T21:16:13.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.854+0000 7f5ac626d700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2023-10-05T21:16:13.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.854+0000 7f5ac626d700 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2023-10-05T21:16:13.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.854+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(105 notify.7 [notify cookie 94615715831424 out=8b] v0'0 uv240 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.854+0000 7f5ac626d700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:106 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5aa8003d90 con 0x7f5abc00d8e0 2023-10-05T21:16:13.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.854+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 31 ==== osd_op_reply(106 notify.7 [notify-ack] v0'0 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.854+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 32 ==== watch-notify(notify_complete (2) cookie 94615715831424 notify 133143986199 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f5ac0015430 con 0x7f5abc00d8e0 2023-10-05T21:16:13.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.854+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:107 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d7021de80 con 0x560d70163610 2023-10-05T21:16:13.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.855+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(107 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v31'4 uv4 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.855+0000 7f5ad5199680 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2023-10-05T21:16:13.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.855+0000 7f5ad5199680 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2023-10-05T21:16:13.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.855+0000 7f5ad5199680 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2023-10-05T21:16:13.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.855+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:108 7.3 7:c609908c:::notify.5:head [notify cookie 94615715834688 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d7021de80 con 0x7f5abc00d8e0 2023-10-05T21:16:13.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.855+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 33 ==== watch-notify(notify (1) cookie 94615715317072 notify 133143986200 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x7f5ac0015430 con 0x7f5abc00d8e0 2023-10-05T21:16:13.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.855+0000 7f5ac626d700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986200 cookie 94615715317072 notifier 4706 bl.length()=177 2023-10-05T21:16:13.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.855+0000 7f5ac626d700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2023-10-05T21:16:13.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.855+0000 7f5ac626d700 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2023-10-05T21:16:13.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.855+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 34 ==== osd_op_reply(108 notify.5 [notify cookie 94615715834688 out=8b] v0'0 uv240 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.856+0000 7f5ac626d700 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5aa8003d90 con 0x7f5abc00d8e0 2023-10-05T21:16:13.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.856+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 35 ==== osd_op_reply(109 notify.5 [notify-ack] v0'0 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.856+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 36 ==== watch-notify(notify_complete (2) cookie 94615715834688 notify 133143986200 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f5ac0015660 con 0x7f5abc00d8e0 2023-10-05T21:16:13.888 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:16:13.888 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "bar", 2023-10-05T21:16:13.888 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Bar", 2023-10-05T21:16:13.888 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "", 2023-10-05T21:16:13.888 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2023-10-05T21:16:13.888 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 4, 2023-10-05T21:16:13.888 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [], 2023-10-05T21:16:13.888 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2023-10-05T21:16:13.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:13.889 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "bar", 2023-10-05T21:16:13.889 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "NX5QOQKC6BH2IDN8HC7A", 2023-10-05T21:16:13.889 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn" 2023-10-05T21:16:13.889 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:13.889 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:16:13.889 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [], 2023-10-05T21:16:13.889 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2023-10-05T21:16:13.889 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2023-10-05T21:16:13.889 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2023-10-05T21:16:13.889 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2023-10-05T21:16:13.889 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2023-10-05T21:16:13.889 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:16:13.889 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:16:13.890 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:16:13.890 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:16:13.890 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:16:13.890 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:16:13.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.890 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2023-10-05T21:16:13.890 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:16:13.890 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:16:13.890 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:16:13.890 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:16:13.890 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:16:13.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:13.891 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2023-10-05T21:16:13.891 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2023-10-05T21:16:13.891 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [] 2023-10-05T21:16:13.891 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:16:13.891 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:16:13.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.856+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:110 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94615715299744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d7021eb40 con 0x7f5ab8039030 2023-10-05T21:16:13.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.857+0000 7f5ac7a70700 1 -- 172.21.15.153:0/2098209569 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(110 notify.0 [watch unwatch cookie 94615715299744] v31'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5abc006070 con 0x7f5ab8039030 2023-10-05T21:16:13.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.857+0000 7f5ad5199680 20 remove_watcher() i=0 2023-10-05T21:16:13.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.857+0000 7f5ad5199680 2 removed watcher, disabling cache 2023-10-05T21:16:13.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.857+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:111 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94615715305104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d7019c1a0 con 0x560d70163610 2023-10-05T21:16:13.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.858+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(111 notify.1 [watch unwatch cookie 94615715305104] v31'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.858+0000 7f5ad5199680 20 remove_watcher() i=1 2023-10-05T21:16:13.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.858+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:112 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94615715308160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d7019d690 con 0x560d70194dd0 2023-10-05T21:16:13.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.858+0000 7f5ac8271700 1 -- 172.21.15.153:0/2098209569 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(112 notify.2 [watch unwatch cookie 94615715308160] v31'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ab8036070 con 0x560d70194dd0 2023-10-05T21:16:13.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.858+0000 7f5ad5199680 20 remove_watcher() i=2 2023-10-05T21:16:13.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.858+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:113 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94615715311888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d7019d690 con 0x7f5ab8039030 2023-10-05T21:16:13.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.859+0000 7f5ac7a70700 1 -- 172.21.15.153:0/2098209569 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(113 notify.3 [watch unwatch cookie 94615715311888] v31'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5abc006070 con 0x7f5ab8039030 2023-10-05T21:16:13.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.859+0000 7f5ad5199680 20 remove_watcher() i=3 2023-10-05T21:16:13.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.859+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:114 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94615715315968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d7019f110 con 0x560d70163610 2023-10-05T21:16:13.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.860+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(114 notify.4 [watch unwatch cookie 94615715315968] v31'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.860+0000 7f5ad5199680 20 remove_watcher() i=4 2023-10-05T21:16:13.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.860+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:115 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94615715317072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701a0100 con 0x7f5abc00d8e0 2023-10-05T21:16:13.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.861+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 37 ==== osd_op_reply(115 notify.5 [watch unwatch cookie 94615715317072] v31'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.861+0000 7f5ad5199680 20 remove_watcher() i=5 2023-10-05T21:16:13.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.861+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:116 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94615715321472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701a05f0 con 0x7f5abc00d8e0 2023-10-05T21:16:13.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.861+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 38 ==== osd_op_reply(116 notify.6 [watch unwatch cookie 94615715321472] v31'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.861+0000 7f5ad5199680 20 remove_watcher() i=6 2023-10-05T21:16:13.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.861+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:117 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94615715319840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d701a05f0 con 0x7f5abc00d8e0 2023-10-05T21:16:13.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.862+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.0 v2:172.21.15.111:6800/111394 39 ==== osd_op_reply(117 notify.7 [watch unwatch cookie 94615715319840] v31'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac000a570 con 0x7f5abc00d8e0 2023-10-05T21:16:13.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.862+0000 7f5ad5199680 20 remove_watcher() i=7 2023-10-05T21:16:13.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.863+0000 7f5a99fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:16:13.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.863+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:118 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94615715324640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560d7019d690 con 0x560d70163610 2023-10-05T21:16:13.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.864+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(118 data_loggenerations_metadata [watch unwatch cookie 94615715324640] v31'232 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5ac000a570 con 0x560d70163610 2023-10-05T21:16:13.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.864+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f5abc00d8e0 msgr2=0x7f5abc00c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.864+0000 7f5ad5199680 1 --2- 172.21.15.153:0/2098209569 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f5abc00d8e0 0x7f5abc00c360 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.864+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x560d70163610 msgr2=0x560d701929e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.864+0000 7f5ad5199680 1 --2- 172.21.15.153:0/2098209569 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x560d70163610 0x560d701929e0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.864+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f5ab8039030 msgr2=0x7f5ab8048a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.864+0000 7f5ad5199680 1 --2- 172.21.15.153:0/2098209569 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f5ab8039030 0x7f5ab8048a00 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.864+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x560d70194dd0 msgr2=0x560d701971b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.864+0000 7f5ad5199680 1 --2- 172.21.15.153:0/2098209569 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x560d70194dd0 0x560d701971b0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.864+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5ab4034140 msgr2=0x7f5ab40365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.864+0000 7f5ad5199680 1 --2- 172.21.15.153:0/2098209569 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5ab4034140 0x7f5ab40365f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0011e0 tx=0x7f5abc0013a0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.864+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d700d40b0 msgr2=0x560d70186bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.864+0000 7f5ac8a72700 1 -- 172.21.15.153:0/2098209569 reap_dead start 2023-10-05T21:16:13.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.864+0000 7f5ad5199680 1 --2- 172.21.15.153:0/2098209569 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d700d40b0 0x560d70186bd0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5ab800a520 tx=0x7f5ab801d000 comp rx=0 tx=0).stop 2023-10-05T21:16:13.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.864+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 shutdown_connections 2023-10-05T21:16:13.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.864+0000 7f5ad5199680 1 --2- 172.21.15.153:0/2098209569 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d700d40b0 0x560d70186bd0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.864+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 >> 172.21.15.153:0/2098209569 conn(0x560d7015abc0 msgr2=0x560d70179b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.864+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 shutdown_connections 2023-10-05T21:16:13.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.864+0000 7f5ad5199680 1 -- 172.21.15.153:0/2098209569 wait complete. 2023-10-05T21:16:13.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.864+0000 7f5ad5199680 1 -- 172.21.15.153:0/1481045069 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5a08034140 msgr2=0x7f5a080365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.864+0000 7f5ad5199680 1 --2- 172.21.15.153:0/1481045069 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5a08034140 0x7f5a080365f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x560d701a2880 tx=0x7f5ac0037450 comp rx=0 tx=0).stop 2023-10-05T21:16:13.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.864+0000 7f5ad5199680 1 -- 172.21.15.153:0/1481045069 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d701af670 msgr2=0x560d701b6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.864+0000 7f5ad5199680 1 --2- 172.21.15.153:0/1481045069 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d701af670 0x560d701b6330 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f5abc00dfd0 tx=0x7f5abc030000 comp rx=0 tx=0).stop 2023-10-05T21:16:13.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.864+0000 7f5ad5199680 1 -- 172.21.15.153:0/1481045069 shutdown_connections 2023-10-05T21:16:13.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.864+0000 7f5ad5199680 1 --2- 172.21.15.153:0/1481045069 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f5a08034140 0x7f5a080365f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.864+0000 7f5ad5199680 1 --2- 172.21.15.153:0/1481045069 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560d701af670 0x560d701b6330 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.864+0000 7f5ad5199680 1 -- 172.21.15.153:0/1481045069 >> 172.21.15.153:0/1481045069 conn(0x560d701ab970 msgr2=0x560d701a9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.864+0000 7f5ad5199680 1 -- 172.21.15.153:0/1481045069 shutdown_connections 2023-10-05T21:16:13.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.864+0000 7f5ad5199680 1 -- 172.21.15.153:0/1481045069 wait complete. 2023-10-05T21:16:13.902 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:16:13.912 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2023-10-05T21:16:13.916 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2023-10-05T21:16:13.916 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2023-10-05T21:16:13.916 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2023-10-05T21:16:13.917 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2023-10-05T21:16:13.962 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:16:13.962 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:16:13.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.962+0000 7f3c8ef43680 1 Processor -- start 2023-10-05T21:16:13.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.962+0000 7f3c8ef43680 1 -- start start 2023-10-05T21:16:13.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.962+0000 7f3c8ef43680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x556c78f1f0b0 0x556c78fb04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.962+0000 7f3c8ef43680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556c78ef8930 con 0x556c78fb09e0 2023-10-05T21:16:13.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.962+0000 7f3c8ef43680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x556c78eb8db0 con 0x556c78f1f0b0 2023-10-05T21:16:13.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.962+0000 7f3c8201b700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x556c78f1f0b0 0x556c78fb04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.962+0000 7f3c8201b700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x556c78f1f0b0 0x556c78fb04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:55038/0 (socket says 172.21.15.153:55038) 2023-10-05T21:16:13.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.962+0000 7f3c8181a700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x556c78fb09e0 0x556c78fb2dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:57858/0 (socket says 172.21.15.153:57858) 2023-10-05T21:16:13.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.962+0000 7f3c8201b700 1 -- 172.21.15.153:0/2669152752 learned_addr learned my addr 172.21.15.153:0/2669152752 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:13.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.963+0000 7f3c8201b700 1 -- 172.21.15.153:0/2669152752 >> v1:172.21.15.111:6789/0 conn(0x556c78fb09e0 legacy=0x556c78fb2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.963+0000 7f3c8201b700 1 -- 172.21.15.153:0/2669152752 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c78fb54f0 con 0x556c78f1f0b0 2023-10-05T21:16:13.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.963+0000 7f3c81019700 1 -- 172.21.15.153:0/2669152752 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819128373 0 0) 0x556c78ef8930 con 0x556c78fb09e0 2023-10-05T21:16:13.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.963+0000 7f3c8201b700 1 --2- 172.21.15.153:0/2669152752 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556c78f1f0b0 0x556c78fb04a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3c7400a650 tx=0x7f3c74005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f660e820d1748a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.963+0000 7f3c81019700 1 -- 172.21.15.153:0/2669152752 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c74008760 con 0x556c78f1f0b0 2023-10-05T21:16:13.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.963+0000 7f3c81019700 1 -- 172.21.15.153:0/2669152752 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c740088c0 con 0x556c78f1f0b0 2023-10-05T21:16:13.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.963+0000 7f3c81019700 1 -- 172.21.15.153:0/2669152752 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c74008bb0 con 0x556c78f1f0b0 2023-10-05T21:16:13.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.964+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2669152752 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556c78f1f0b0 msgr2=0x556c78fb04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.964+0000 7f3c8ef43680 1 --2- 172.21.15.153:0/2669152752 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556c78f1f0b0 0x556c78fb04a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3c7400a650 tx=0x7f3c74005b10 comp rx=0 tx=0).stop 2023-10-05T21:16:13.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.964+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2669152752 shutdown_connections 2023-10-05T21:16:13.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.964+0000 7f3c8ef43680 1 --2- 172.21.15.153:0/2669152752 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556c78f1f0b0 0x556c78fb04a0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.964+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2669152752 >> 172.21.15.153:0/2669152752 conn(0x556c78fa5b90 msgr2=0x556c78fa7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.964+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2669152752 shutdown_connections 2023-10-05T21:16:13.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.964+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2669152752 wait complete. 2023-10-05T21:16:13.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.964+0000 7f3c8ef43680 1 Processor -- start 2023-10-05T21:16:13.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.964+0000 7f3c8ef43680 1 -- start start 2023-10-05T21:16:13.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.965+0000 7f3c8ef43680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556c78f1f0b0 0x556c78fcc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.965+0000 7f3c8ef43680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c78e58ea0 con 0x556c78f1f0b0 2023-10-05T21:16:13.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.965+0000 7f3c8201b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556c78f1f0b0 0x556c78fcc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.965+0000 7f3c8201b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556c78f1f0b0 0x556c78fcc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:55044/0 (socket says 172.21.15.153:55044) 2023-10-05T21:16:13.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.965+0000 7f3c8201b700 1 -- 172.21.15.153:0/1923938449 learned_addr learned my addr 172.21.15.153:0/1923938449 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:13.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.965+0000 7f3c8201b700 1 -- 172.21.15.153:0/1923938449 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c74005db0 con 0x556c78f1f0b0 2023-10-05T21:16:13.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.965+0000 7f3c8201b700 1 --2- 172.21.15.153:0/1923938449 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556c78f1f0b0 0x556c78fcc950 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3c7400a5a0 tx=0x7f3c74015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15394362700bc9f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.965+0000 7f3c73fff700 1 -- 172.21.15.153:0/1923938449 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c740055f0 con 0x556c78f1f0b0 2023-10-05T21:16:13.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.965+0000 7f3c73fff700 1 -- 172.21.15.153:0/1923938449 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c74008a30 con 0x556c78f1f0b0 2023-10-05T21:16:13.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.965+0000 7f3c73fff700 1 -- 172.21.15.153:0/1923938449 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c74008d00 con 0x556c78f1f0b0 2023-10-05T21:16:13.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.966+0000 7f3c8ef43680 1 -- 172.21.15.153:0/1923938449 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556c78f1f0b0 msgr2=0x556c78fcc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:13.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.966+0000 7f3c8ef43680 1 --2- 172.21.15.153:0/1923938449 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556c78f1f0b0 0x556c78fcc950 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3c7400a5a0 tx=0x7f3c74015000 comp rx=0 tx=0).stop 2023-10-05T21:16:13.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.966+0000 7f3c8ef43680 1 -- 172.21.15.153:0/1923938449 shutdown_connections 2023-10-05T21:16:13.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.966+0000 7f3c8ef43680 1 --2- 172.21.15.153:0/1923938449 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556c78f1f0b0 0x556c78fcc950 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:13.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.966+0000 7f3c8ef43680 1 -- 172.21.15.153:0/1923938449 >> 172.21.15.153:0/1923938449 conn(0x556c78fa5b90 msgr2=0x556c78fc8420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:13.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.966+0000 7f3c8ef43680 1 -- 172.21.15.153:0/1923938449 shutdown_connections 2023-10-05T21:16:13.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.966+0000 7f3c8ef43680 1 -- 172.21.15.153:0/1923938449 wait complete. 2023-10-05T21:16:13.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.966+0000 7f3c8ef43680 1 Processor -- start 2023-10-05T21:16:13.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.966+0000 7f3c8ef43680 1 -- start start 2023-10-05T21:16:13.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.966+0000 7f3c8ef43680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556c78f1f0b0 0x556c78fd3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.966+0000 7f3c8ef43680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c78e4fc80 con 0x556c78f1f0b0 2023-10-05T21:16:13.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.967+0000 7f3c8201b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556c78f1f0b0 0x556c78fd3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.967+0000 7f3c8201b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556c78f1f0b0 0x556c78fd3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:55052/0 (socket says 172.21.15.153:55052) 2023-10-05T21:16:13.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.967+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 learned_addr learned my addr 172.21.15.153:0/2376030819 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:13.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.967+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c78fb54f0 con 0x556c78f1f0b0 2023-10-05T21:16:13.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.967+0000 7f3c8201b700 1 --2- 172.21.15.153:0/2376030819 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556c78f1f0b0 0x556c78fd3cb0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3c74020040 tx=0x7f3c7401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.967+0000 7f3c727fc700 1 -- 172.21.15.153:0/2376030819 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c74027850 con 0x556c78f1f0b0 2023-10-05T21:16:13.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.967+0000 7f3c727fc700 1 -- 172.21.15.153:0/2376030819 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c740279d0 con 0x556c78f1f0b0 2023-10-05T21:16:13.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.967+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556c78fd41f0 con 0x556c78f1f0b0 2023-10-05T21:16:13.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.967+0000 7f3c727fc700 1 -- 172.21.15.153:0/2376030819 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c74027cc0 con 0x556c78f1f0b0 2023-10-05T21:16:13.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.967+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556c78fd4640 con 0x556c78f1f0b0 2023-10-05T21:16:13.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.968+0000 7f3c727fc700 1 -- 172.21.15.153:0/2376030819 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f3c7402f070 con 0x556c78f1f0b0 2023-10-05T21:16:13.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.968+0000 7f3c8ef43680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.968+0000 7f3c727fc700 1 --2- 172.21.15.153:0/2376030819 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3c640340f0 0x7f3c640365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.968+0000 7f3c727fc700 1 -- 172.21.15.153:0/2376030819 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f3c7404a380 con 0x556c78f1f0b0 2023-10-05T21:16:13.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.968+0000 7f3c8181a700 1 --2- 172.21.15.153:0/2376030819 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3c640340f0 0x7f3c640365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.968+0000 7f3c8ef43680 1 --2- 172.21.15.153:0/2376030819 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x556c78fb09e0 0x556c78fdfa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.968+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe01a0 con 0x556c78fb09e0 2023-10-05T21:16:13.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.969+0000 7f3c8281c700 1 --2- 172.21.15.153:0/2376030819 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x556c78fb09e0 0x556c78fdfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.969+0000 7f3c8181a700 1 --2- 172.21.15.153:0/2376030819 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3c640340f0 0x7f3c640365a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3c780011e0 tx=0x7f3c78001460 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.969+0000 7f3c8281c700 1 --2- 172.21.15.153:0/2376030819 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x556c78fb09e0 0x556c78fdfa10 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.969+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3c7c00a570 con 0x556c78fb09e0 2023-10-05T21:16:13.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.969+0000 7f3c8ef43680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.969+0000 7f3c8ef43680 20 realm 2023-10-05T21:16:13.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.969+0000 7f3c8ef43680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.969+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fdcff0 con 0x556c78fb09e0 2023-10-05T21:16:13.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.969+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3c7c00a570 con 0x556c78fb09e0 2023-10-05T21:16:13.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.969+0000 7f3c8ef43680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.969+0000 7f3c8ef43680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:16:13.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.969+0000 7f3c8ef43680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.969+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe0ca0 con 0x556c78fb09e0 2023-10-05T21:16:13.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.970+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3c7c00a570 con 0x556c78fb09e0 2023-10-05T21:16:13.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.970+0000 7f3c8ef43680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:13.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.970+0000 7f3c8ef43680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.970+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe08f0 con 0x556c78fb09e0 2023-10-05T21:16:13.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.970+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3c7c00a570 con 0x556c78fb09e0 2023-10-05T21:16:13.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.970+0000 7f3c8ef43680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:13.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.970+0000 7f3c8ef43680 20 rados->read ofs=0 len=0 2023-10-05T21:16:13.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.970+0000 7f3c8ef43680 1 --2- 172.21.15.153:0/2376030819 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x556c78fe2060 0x556c78fe4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.970+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe4980 con 0x556c78fe2060 2023-10-05T21:16:13.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.970+0000 7f3c8201b700 1 --2- 172.21.15.153:0/2376030819 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x556c78fe2060 0x556c78fe4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.970+0000 7f3c8201b700 1 --2- 172.21.15.153:0/2376030819 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x556c78fe2060 0x556c78fe4440 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.971+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:13.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.971+0000 7f3c8ef43680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:16:13.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.971+0000 7f3c8ef43680 20 searching for the correct realm 2023-10-05T21:16:13.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.971+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe6330 con 0x556c78fe2060 2023-10-05T21:16:13.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.971+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:13.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.971+0000 7f3c8201b700 1 --2- 172.21.15.153:0/2376030819 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f3c7403a030 0x7f3c740113b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.971+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe6330 con 0x7f3c7403a030 2023-10-05T21:16:13.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.971+0000 7f3c8181a700 1 --2- 172.21.15.153:0/2376030819 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f3c7403a030 0x7f3c740113b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.971+0000 7f3c8181a700 1 --2- 172.21.15.153:0/2376030819 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f3c7403a030 0x7f3c740113b0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.972+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7800f600 con 0x7f3c7403a030 2023-10-05T21:16:13.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.972+0000 7f3c8181a700 1 --2- 172.21.15.153:0/2376030819 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f3c7800e8c0 0x7f3c7800d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:13.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.972+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe6330 con 0x7f3c7800e8c0 2023-10-05T21:16:13.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.972+0000 7f3c8281c700 1 --2- 172.21.15.153:0/2376030819 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f3c7800e8c0 0x7f3c7800d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:13.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.972+0000 7f3c8281c700 1 --2- 172.21.15.153:0/2376030819 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f3c7800e8c0 0x7f3c7800d310 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:13.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.973+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7c00a570 con 0x7f3c7800e8c0 2023-10-05T21:16:13.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.973+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe6330 con 0x556c78fb09e0 2023-10-05T21:16:13.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.973+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7c00a570 con 0x556c78fb09e0 2023-10-05T21:16:13.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.973+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe6330 con 0x556c78fb09e0 2023-10-05T21:16:14.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.973+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7c00a570 con 0x556c78fb09e0 2023-10-05T21:16:14.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.973+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe6330 con 0x7f3c7800e8c0 2023-10-05T21:16:14.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.973+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7c00a570 con 0x7f3c7800e8c0 2023-10-05T21:16:14.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.973+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe6330 con 0x7f3c7800e8c0 2023-10-05T21:16:14.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.973+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7c00a570 con 0x7f3c7800e8c0 2023-10-05T21:16:14.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.973+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe6330 con 0x7f3c7403a030 2023-10-05T21:16:14.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.974+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7800f600 con 0x7f3c7403a030 2023-10-05T21:16:14.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.974+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe6330 con 0x556c78fe2060 2023-10-05T21:16:14.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.974+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:14.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.974+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe6330 con 0x556c78fb09e0 2023-10-05T21:16:14.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.974+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7c00a570 con 0x556c78fb09e0 2023-10-05T21:16:14.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.974+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe6330 con 0x7f3c7800e8c0 2023-10-05T21:16:14.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.974+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7c00a570 con 0x7f3c7800e8c0 2023-10-05T21:16:14.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.974+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe6330 con 0x556c78fb09e0 2023-10-05T21:16:14.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.974+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7c00a570 con 0x556c78fb09e0 2023-10-05T21:16:14.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.974+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe6330 con 0x7f3c7403a030 2023-10-05T21:16:14.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.975+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7800f600 con 0x7f3c7403a030 2023-10-05T21:16:14.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.975+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3c7801f040 con 0x556c78fe2060 2023-10-05T21:16:14.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.975+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:14.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.975+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3c7801f040 con 0x556c78fe2060 2023-10-05T21:16:14.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.975+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:14.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.975+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3c7801f040 con 0x7f3c7800e8c0 2023-10-05T21:16:14.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.975+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7c00a570 con 0x7f3c7800e8c0 2023-10-05T21:16:14.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.975+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3c7801f040 con 0x556c78fe2060 2023-10-05T21:16:14.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.975+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:14.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.975+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3c7801f040 con 0x556c78fe2060 2023-10-05T21:16:14.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.976+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:14.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.976+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3c7801f040 con 0x556c78fb09e0 2023-10-05T21:16:14.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.976+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7c00a570 con 0x556c78fb09e0 2023-10-05T21:16:14.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.976+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3c7801f040 con 0x556c78fb09e0 2023-10-05T21:16:14.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.976+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f3c7c00a570 con 0x556c78fb09e0 2023-10-05T21:16:14.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.976+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3c7801f040 con 0x7f3c7800e8c0 2023-10-05T21:16:14.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.977+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7c00a570 con 0x7f3c7800e8c0 2023-10-05T21:16:14.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.977+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3c7801f040 con 0x556c78fe2060 2023-10-05T21:16:14.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.977+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:14.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.977+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3c7801f040 con 0x7f3c7403a030 2023-10-05T21:16:14.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.977+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7800f600 con 0x7f3c7403a030 2023-10-05T21:16:14.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.977+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3c7801f040 con 0x556c78fb09e0 2023-10-05T21:16:14.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.977+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7c00a570 con 0x556c78fb09e0 2023-10-05T21:16:14.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.977+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3c7801f040 con 0x7f3c7800e8c0 2023-10-05T21:16:14.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.978+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7c00a570 con 0x7f3c7800e8c0 2023-10-05T21:16:14.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.978+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3c7801f040 con 0x556c78fe2060 2023-10-05T21:16:14.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.978+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:14.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.978+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3c7801f040 con 0x7f3c7800e8c0 2023-10-05T21:16:14.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.978+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7c00a570 con 0x7f3c7800e8c0 2023-10-05T21:16:14.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.978+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3c7801f040 con 0x7f3c7403a030 2023-10-05T21:16:14.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.978+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7800f600 con 0x7f3c7403a030 2023-10-05T21:16:14.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.978+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3c7801f040 con 0x556c78fe2060 2023-10-05T21:16:14.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.979+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:14.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.979+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3c7801f040 con 0x7f3c7800e8c0 2023-10-05T21:16:14.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.979+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7c00a570 con 0x7f3c7800e8c0 2023-10-05T21:16:14.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.979+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3c7801f040 con 0x556c78fb09e0 2023-10-05T21:16:14.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.979+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f3c7c00a570 con 0x556c78fb09e0 2023-10-05T21:16:14.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.979+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3c7801f040 con 0x7f3c7403a030 2023-10-05T21:16:14.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.979+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7800f600 con 0x7f3c7403a030 2023-10-05T21:16:14.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.979+0000 7f3c8ef43680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:16:14.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.979+0000 7f3c8ef43680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:16:14.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.979+0000 7f3c8ef43680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:16:14.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.979+0000 7f3c8ef43680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:16:14.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.979+0000 7f3c8ef43680 20 rados->read ofs=0 len=0 2023-10-05T21:16:14.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.979+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe5280 con 0x556c78fb09e0 2023-10-05T21:16:14.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.979+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3c7c00a570 con 0x556c78fb09e0 2023-10-05T21:16:14.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.979+0000 7f3c8ef43680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:14.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.979+0000 7f3c8ef43680 20 rados->read ofs=0 len=0 2023-10-05T21:16:14.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.980+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe5680 con 0x556c78fb09e0 2023-10-05T21:16:14.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.980+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3c7c00a570 con 0x556c78fb09e0 2023-10-05T21:16:14.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.980+0000 7f3c8ef43680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:14.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.980+0000 7f3c8ef43680 20 rados->read ofs=0 len=0 2023-10-05T21:16:14.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.980+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe67c0 con 0x556c78fb09e0 2023-10-05T21:16:14.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.980+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.980+0000 7f3c8ef43680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:16:14.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.980+0000 7f3c8ef43680 20 rados->read ofs=0 len=0 2023-10-05T21:16:14.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.980+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe6b70 con 0x556c78fe2060 2023-10-05T21:16:14.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.980+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:14.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.980+0000 7f3c8ef43680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:14.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.980+0000 7f3c8ef43680 20 rados->read ofs=0 len=0 2023-10-05T21:16:14.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.980+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe6f20 con 0x556c78fb09e0 2023-10-05T21:16:14.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.980+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.980+0000 7f3c8ef43680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:14.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.980+0000 7f3c8ef43680 20 rados->read ofs=0 len=0 2023-10-05T21:16:14.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.980+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe6f20 con 0x556c78fb09e0 2023-10-05T21:16:14.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.981+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.981+0000 7f3c8ef43680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:14.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.981+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe6f20 con 0x556c78fe2060 2023-10-05T21:16:14.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.981+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:14.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.981+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe6f20 con 0x7f3c7403a030 2023-10-05T21:16:14.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.981+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7800f600 con 0x7f3c7403a030 2023-10-05T21:16:14.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.981+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe6f20 con 0x7f3c7800e8c0 2023-10-05T21:16:14.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.981+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.981+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe67c0 con 0x556c78fb09e0 2023-10-05T21:16:14.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.982+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.982+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe67c0 con 0x556c78fb09e0 2023-10-05T21:16:14.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.982+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.982+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe67c0 con 0x7f3c7800e8c0 2023-10-05T21:16:14.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.982+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.982+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe67c0 con 0x7f3c7800e8c0 2023-10-05T21:16:14.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.982+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.982+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe67c0 con 0x7f3c7403a030 2023-10-05T21:16:14.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.983+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7800f600 con 0x7f3c7403a030 2023-10-05T21:16:14.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.983+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe67c0 con 0x556c78fe2060 2023-10-05T21:16:14.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.983+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:14.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.983+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe67c0 con 0x556c78fb09e0 2023-10-05T21:16:14.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.983+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.983+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe67c0 con 0x7f3c7800e8c0 2023-10-05T21:16:14.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.983+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.983+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe67c0 con 0x556c78fb09e0 2023-10-05T21:16:14.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.983+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.983+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe67c0 con 0x7f3c7403a030 2023-10-05T21:16:14.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.984+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7800f600 con 0x7f3c7403a030 2023-10-05T21:16:14.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.984+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe67c0 con 0x556c78fe2060 2023-10-05T21:16:14.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.984+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:14.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.984+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe67c0 con 0x556c78fe2060 2023-10-05T21:16:14.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.984+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:14.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.984+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe67c0 con 0x7f3c7800e8c0 2023-10-05T21:16:14.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.984+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.984+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe67c0 con 0x556c78fe2060 2023-10-05T21:16:14.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.984+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:14.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.984+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe67c0 con 0x556c78fe2060 2023-10-05T21:16:14.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.985+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:14.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.985+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe67c0 con 0x556c78fb09e0 2023-10-05T21:16:14.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.985+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.985+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe67c0 con 0x556c78fb09e0 2023-10-05T21:16:14.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.985+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.985+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe67c0 con 0x7f3c7800e8c0 2023-10-05T21:16:14.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.985+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.985+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe67c0 con 0x556c78fe2060 2023-10-05T21:16:14.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.986+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:14.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.986+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe67c0 con 0x7f3c7403a030 2023-10-05T21:16:14.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.986+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7800f600 con 0x7f3c7403a030 2023-10-05T21:16:14.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.986+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe67c0 con 0x556c78fb09e0 2023-10-05T21:16:14.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.986+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.986+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe67c0 con 0x7f3c7800e8c0 2023-10-05T21:16:14.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.987+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.987+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe67c0 con 0x556c78fe2060 2023-10-05T21:16:14.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.987+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:14.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.987+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe67c0 con 0x7f3c7800e8c0 2023-10-05T21:16:14.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.987+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.987+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe67c0 con 0x7f3c7403a030 2023-10-05T21:16:14.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.987+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7800f600 con 0x7f3c7403a030 2023-10-05T21:16:14.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.987+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe67c0 con 0x556c78fe2060 2023-10-05T21:16:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.987+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.987+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe67c0 con 0x7f3c7800e8c0 2023-10-05T21:16:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.988+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.988+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe67c0 con 0x556c78fb09e0 2023-10-05T21:16:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.988+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.988+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe67c0 con 0x7f3c7403a030 2023-10-05T21:16:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.988+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3c7800f600 con 0x7f3c7403a030 2023-10-05T21:16:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.988+0000 7f3c8ef43680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:16:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.988+0000 7f3c8ef43680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:16:14.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.988+0000 7f3c8ef43680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:16:14.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.988+0000 7f3c8ef43680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:16:14.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.988+0000 7f3c8ef43680 20 rados->read ofs=0 len=0 2023-10-05T21:16:14.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.988+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe6f20 con 0x556c78fb09e0 2023-10-05T21:16:14.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.988+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.988+0000 7f3c8ef43680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:14.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.988+0000 7f3c8ef43680 20 rados->read ofs=0 len=0 2023-10-05T21:16:14.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.988+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe7380 con 0x556c78fe2060 2023-10-05T21:16:14.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.989+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:14.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.989+0000 7f3c8ef43680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:16:14.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.989+0000 7f3c8ef43680 20 rados->read ofs=0 len=0 2023-10-05T21:16:14.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.989+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe7c70 con 0x556c78fb09e0 2023-10-05T21:16:14.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.989+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.989+0000 7f3c8ef43680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:14.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.989+0000 7f3c8ef43680 20 rados->read ofs=0 len=0 2023-10-05T21:16:14.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.989+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe7c70 con 0x556c78fb09e0 2023-10-05T21:16:14.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.989+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.989+0000 7f3c8ef43680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:16:14.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.989+0000 7f3c8ef43680 20 rados->read ofs=0 len=0 2023-10-05T21:16:14.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.989+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe7c70 con 0x7f3c7800e8c0 2023-10-05T21:16:14.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.990+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.990+0000 7f3c8ef43680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:14.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.990+0000 7f3c8ef43680 20 zone default found 2023-10-05T21:16:14.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.990+0000 7f3c8ef43680 4 Realm: () 2023-10-05T21:16:14.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.990+0000 7f3c8ef43680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:16:14.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.990+0000 7f3c8ef43680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:16:14.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.990+0000 7f3c8ef43680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:16:14.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.990+0000 7f3c8ef43680 20 zonegroup default 2023-10-05T21:16:14.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.990+0000 7f3c8ef43680 20 rados->read ofs=0 len=0 2023-10-05T21:16:14.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.990+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe7c70 con 0x7f3c7800e8c0 2023-10-05T21:16:14.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.990+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.990+0000 7f3c8ef43680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:14.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.990+0000 7f3c8ef43680 20 rados->read ofs=0 len=0 2023-10-05T21:16:14.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.990+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe7c70 con 0x556c78fe2060 2023-10-05T21:16:14.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.990+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:14.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.990+0000 7f3c8ef43680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:14.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.990+0000 7f3c8ef43680 20 rados->read ofs=0 len=0 2023-10-05T21:16:14.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.990+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe9b30 con 0x556c78fe2060 2023-10-05T21:16:14.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.990+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:14.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.990+0000 7f3c8ef43680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:14.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.990+0000 7f3c8ef43680 20 started sync module instance, tier type = 2023-10-05T21:16:14.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.990+0000 7f3c8ef43680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:16:14.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.990+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe91f0 con 0x7f3c7403a030 2023-10-05T21:16:14.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.991+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v31'243 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c7800f600 con 0x7f3c7403a030 2023-10-05T21:16:14.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.991+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93924374779376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fea3d0 con 0x7f3c7403a030 2023-10-05T21:16:14.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.991+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78feac70 con 0x556c78fb09e0 2023-10-05T21:16:14.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.992+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 93924374779376] v31'244 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c7800f600 con 0x7f3c7403a030 2023-10-05T21:16:14.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.992+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v31'243 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.992+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93924374781664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78feac70 con 0x556c78fb09e0 2023-10-05T21:16:14.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.992+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78feb840 con 0x556c78fe2060 2023-10-05T21:16:14.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.993+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v31'243 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:14.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.993+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 93924374781664] v31'244 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.993+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93924374786768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78feb800 con 0x556c78fe2060 2023-10-05T21:16:14.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.993+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fec300 con 0x7f3c7403a030 2023-10-05T21:16:14.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.994+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 93924374786768] v31'244 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:14.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.994+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v31'243 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c7800f600 con 0x7f3c7403a030 2023-10-05T21:16:14.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.994+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 93924374783872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fec700 con 0x7f3c7403a030 2023-10-05T21:16:14.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.994+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fecfe0 con 0x556c78fb09e0 2023-10-05T21:16:14.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.995+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 93924374783872] v31'244 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c7800f600 con 0x7f3c7403a030 2023-10-05T21:16:14.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.995+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v31'243 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.995+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 93924374789184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fed3e0 con 0x556c78fb09e0 2023-10-05T21:16:14.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.995+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fede30 con 0x7f3c7800e8c0 2023-10-05T21:16:14.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.996+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 93924374789184] v31'244 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.996+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v31'243 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.996+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 93924374792880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78feddf0 con 0x7f3c7800e8c0 2023-10-05T21:16:14.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.996+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fee8c0 con 0x7f3c7800e8c0 2023-10-05T21:16:14.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.997+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 93924374792880] v31'244 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.997+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v31'243 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.997+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93924374797104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fee8c0 con 0x7f3c7800e8c0 2023-10-05T21:16:14.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.997+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fef2d0 con 0x7f3c7800e8c0 2023-10-05T21:16:14.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.997+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 93924374797104] v31'244 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.997+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v31'243 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.997+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93924374799312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fef2d0 con 0x7f3c7800e8c0 2023-10-05T21:16:14.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.997+0000 7f3c8ef43680 20 add_watcher() i=0 2023-10-05T21:16:14.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.997+0000 7f3c8ef43680 20 add_watcher() i=1 2023-10-05T21:16:14.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.997+0000 7f3c8ef43680 20 add_watcher() i=2 2023-10-05T21:16:14.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.997+0000 7f3c8ef43680 20 add_watcher() i=3 2023-10-05T21:16:14.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.997+0000 7f3c8ef43680 20 add_watcher() i=4 2023-10-05T21:16:14.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.997+0000 7f3c8ef43680 20 add_watcher() i=5 2023-10-05T21:16:14.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.997+0000 7f3c8ef43680 20 add_watcher() i=6 2023-10-05T21:16:14.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.998+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 93924374799312] v31'244 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.998+0000 7f3c8ef43680 20 add_watcher() i=7 2023-10-05T21:16:14.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.998+0000 7f3c8ef43680 2 all 8 watchers are set, enabling cache 2023-10-05T21:16:14.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.998+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78ff27d0 con 0x556c78fb09e0 2023-10-05T21:16:14.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.998+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.999+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93924374802352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fefc90 con 0x556c78fb09e0 2023-10-05T21:16:14.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.999+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 93924374802352] v31'233 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.999+0000 7f3c53fdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:16:14.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.999+0000 7f3c8ef43680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:16:14.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:13.999+0000 7f3c8ef43680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:16:14.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.000+0000 7f3c8ef43680 1 Processor -- start 2023-10-05T21:16:14.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.000+0000 7f3c8ef43680 1 -- start start 2023-10-05T21:16:14.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.000+0000 7f3c8ef43680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556c78ffc400 0x556c78ffc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:14.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.000+0000 7f3c8ef43680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c78ffce20 con 0x556c78ffc400 2023-10-05T21:16:14.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.000+0000 7f3c8181a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556c78ffc400 0x556c78ffc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:14.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.000+0000 7f3c8181a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556c78ffc400 0x556c78ffc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:55068/0 (socket says 172.21.15.153:55068) 2023-10-05T21:16:14.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.000+0000 7f3c8181a700 1 -- 172.21.15.153:0/2200339741 learned_addr learned my addr 172.21.15.153:0/2200339741 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:14.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.000+0000 7f3c8181a700 1 -- 172.21.15.153:0/2200339741 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c78ffd300 con 0x556c78ffc400 2023-10-05T21:16:14.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.001+0000 7f3c8181a700 1 --2- 172.21.15.153:0/2200339741 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556c78ffc400 0x556c78ffc810 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x556c78fe1ad0 tx=0x7f3c78006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d36cc199c4852de0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:14.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.001+0000 7f3c537de700 1 -- 172.21.15.153:0/2200339741 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c7800dae0 con 0x556c78ffc400 2023-10-05T21:16:14.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.001+0000 7f3c537de700 1 -- 172.21.15.153:0/2200339741 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7800dc60 con 0x556c78ffc400 2023-10-05T21:16:14.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.001+0000 7f3c537de700 1 -- 172.21.15.153:0/2200339741 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c7800de10 con 0x556c78ffc400 2023-10-05T21:16:14.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.001+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2200339741 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556c78ffc400 msgr2=0x556c78ffc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:14.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.001+0000 7f3c8ef43680 1 --2- 172.21.15.153:0/2200339741 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556c78ffc400 0x556c78ffc810 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x556c78fe1ad0 tx=0x7f3c78006000 comp rx=0 tx=0).stop 2023-10-05T21:16:14.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.001+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2200339741 shutdown_connections 2023-10-05T21:16:14.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.001+0000 7f3c8ef43680 1 --2- 172.21.15.153:0/2200339741 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556c78ffc400 0x556c78ffc810 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:14.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.001+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2200339741 >> 172.21.15.153:0/2200339741 conn(0x556c78ff8700 msgr2=0x556c78ff6800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:14.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.001+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2200339741 shutdown_connections 2023-10-05T21:16:14.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.001+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2200339741 wait complete. 2023-10-05T21:16:14.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.002+0000 7f3c8ef43680 1 Processor -- start 2023-10-05T21:16:14.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.002+0000 7f3c8ef43680 1 -- start start 2023-10-05T21:16:14.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.002+0000 7f3c8ef43680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556c78ffc400 0x556c79003170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:14.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.002+0000 7f3c8ef43680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c790036b0 con 0x556c78ffc400 2023-10-05T21:16:14.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.002+0000 7f3c8181a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556c78ffc400 0x556c79003170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:14.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.002+0000 7f3c8181a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556c78ffc400 0x556c79003170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:55080/0 (socket says 172.21.15.153:55080) 2023-10-05T21:16:14.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.002+0000 7f3c8181a700 1 -- 172.21.15.153:0/2965219108 learned_addr learned my addr 172.21.15.153:0/2965219108 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:14.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.002+0000 7f3c8181a700 1 -- 172.21.15.153:0/2965219108 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c78006070 con 0x556c78ffc400 2023-10-05T21:16:14.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.003+0000 7f3c8181a700 1 --2- 172.21.15.153:0/2965219108 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556c78ffc400 0x556c79003170 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x556c78fdcf80 tx=0x7f3c78032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:14.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.003+0000 7f3c51fdb700 1 -- 172.21.15.153:0/2965219108 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c7803da10 con 0x556c78ffc400 2023-10-05T21:16:14.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.003+0000 7f3c51fdb700 1 -- 172.21.15.153:0/2965219108 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7803db70 con 0x556c78ffc400 2023-10-05T21:16:14.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.003+0000 7f3c51fdb700 1 -- 172.21.15.153:0/2965219108 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c7803dce0 con 0x556c78ffc400 2023-10-05T21:16:14.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.003+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2965219108 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556c790038b0 con 0x556c78ffc400 2023-10-05T21:16:14.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.003+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2965219108 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556c79003d00 con 0x556c78ffc400 2023-10-05T21:16:14.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.004+0000 7f3c51fdb700 1 -- 172.21.15.153:0/2965219108 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f3c7801a040 con 0x556c78ffc400 2023-10-05T21:16:14.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.004+0000 7f3c51fdb700 1 --2- 172.21.15.153:0/2965219108 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3bc80340a0 0x7f3bc8036550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:14.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.004+0000 7f3c51fdb700 1 -- 172.21.15.153:0/2965219108 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f3c78052c00 con 0x556c78ffc400 2023-10-05T21:16:14.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.004+0000 7f3c8281c700 1 --2- 172.21.15.153:0/2965219108 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3bc80340a0 0x7f3bc8036550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:14.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.004+0000 7f3c8ef43680 5 note: GC not initialized 2023-10-05T21:16:14.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.004+0000 7f3c8281c700 1 --2- 172.21.15.153:0/2965219108 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3bc80340a0 0x7f3bc8036550 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x556c78fef4e0 tx=0x7f3c7c00afb0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:14.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.005+0000 7f3bc2ffd700 20 reqs_thread_entry: start 2023-10-05T21:16:14.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.005+0000 7f3bc0ff9700 20 reqs_thread_entry: start 2023-10-05T21:16:14.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.005+0000 7f3c8ef43680 20 init_complete bucket index max shards: 11 2023-10-05T21:16:14.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.005+0000 7f3c8ef43680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:16:14.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.005+0000 7f3bb6ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:16:44 2023 2023-10-05T21:16:14.051 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:16:14.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.005+0000 7f3bb67fc700 20 reqs_thread_entry: start 2023-10-05T21:16:14.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.005+0000 7f3c8ef43680 20 get_system_obj_state: rctx=0x7ffe4d6b54d8 obj=default.rgw.meta:users.uid:bar state=0x556c78e5e240 s->prefetch_data=0 2023-10-05T21:16:14.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.005+0000 7f3c8ef43680 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2023-10-05T21:16:14.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.005+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:102 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c79068a20 con 0x7f3c7800e8c0 2023-10-05T21:16:14.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.006+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(102 bar [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.006+0000 7f3c8ef43680 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x16 2023-10-05T21:16:14.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.006+0000 7f3c8ef43680 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2023-10-05T21:16:14.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.006+0000 7f3c8ef43680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:16:14.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.006+0000 7f3c8ef43680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:16:14.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.006+0000 7f3c8ef43680 20 Read xattr: user.rgw.idtag 2023-10-05T21:16:14.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.006+0000 7f3c8ef43680 10 cache get: name=default.rgw.meta+users.uid+bar : type miss (requested=0x13, cached=0x16) 2023-10-05T21:16:14.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.006+0000 7f3c8ef43680 20 rados->read ofs=0 len=0 2023-10-05T21:16:14.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.006+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:103 8.e 8:718f6a54:users.uid::bar:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c7906afa0 con 0x7f3c7800e8c0 2023-10-05T21:16:14.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.006+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(103 bar [call,call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv6 ondisk = 0) v8 ==== 273+0+469 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.007+0000 7f3c8ef43680 20 rados_obj.operate() r=0 bl.length=346 2023-10-05T21:16:14.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.007+0000 7f3c8ef43680 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2023-10-05T21:16:14.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.007+0000 7f3c8ef43680 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2023-10-05T21:16:14.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.007+0000 7f3c8ef43680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:16:14.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.007+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:104 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~181 in=181b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c79069d50 con 0x7f3c7403a030 2023-10-05T21:16:14.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.007+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(104 bud [create,call,writefull 0~181] v31'1 uv1 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7f3c7800f600 con 0x7f3c7403a030 2023-10-05T21:16:14.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.007+0000 7f3c8ef43680 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2023-10-05T21:16:14.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.007+0000 7f3c8ef43680 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2023-10-05T21:16:14.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.007+0000 7f3c8ef43680 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2023-10-05T21:16:14.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.007+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:105 7.3 7:c609908c:::notify.5:head [notify cookie 93924375304288 in=369b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c79069cf0 con 0x7f3c7800e8c0 2023-10-05T21:16:14.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.008+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== watch-notify(notify (1) cookie 93924374792880 notify 133143986202 ret 0) v3 ==== 399+0+0 (crc 0 0 0) 0x7f3c7c0155c0 con 0x7f3c7800e8c0 2023-10-05T21:16:14.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.008+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(105 notify.5 [notify cookie 93924375304288 out=8b] v0'0 uv243 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.008+0000 7f3c73fff700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986202 cookie 93924374792880 notifier 4712 bl.length()=357 2023-10-05T21:16:14.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.008+0000 7f3c73fff700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2023-10-05T21:16:14.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.008+0000 7f3c73fff700 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2023-10-05T21:16:14.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.008+0000 7f3c73fff700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3c68003d90 con 0x7f3c7800e8c0 2023-10-05T21:16:14.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.008+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 31 ==== osd_op_reply(106 notify.5 [notify-ack] v0'0 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.008+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 32 ==== watch-notify(notify_complete (2) cookie 93924375304288 notify 133143986202 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f3c7c015c50 con 0x7f3c7800e8c0 2023-10-05T21:16:14.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.008+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:107 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c7906c630 con 0x556c78fb09e0 2023-10-05T21:16:14.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.009+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(107 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) v8 ==== 155+0+184 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.009+0000 7f3c8ef43680 20 get_system_obj_state: rctx=0x7ffe4d6b5440 obj=default.rgw.meta:root:.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 state=0x556c78e5e240 s->prefetch_data=0 2023-10-05T21:16:14.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.009+0000 7f3c8ef43680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 : miss 2023-10-05T21:16:14.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.009+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:108 8.1c 8:3bd4508d:root::.bucket.meta.myfoo6%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c79068a30 con 0x556c78fe2060 2023-10-05T21:16:14.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.009+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(108 .bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 291+0+282 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:14.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.009+0000 7f3c8ef43680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 info.flags=0x16 2023-10-05T21:16:14.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.009+0000 7f3c8ef43680 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 to cache LRU end 2023-10-05T21:16:14.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.009+0000 7f3c8ef43680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:16:14.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.009+0000 7f3c8ef43680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:16:14.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.009+0000 7f3c8ef43680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:16:14.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.009+0000 7f3c8ef43680 20 Read xattr: user.rgw.acl 2023-10-05T21:16:14.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.009+0000 7f3c8ef43680 20 Read xattr: user.rgw.idtag 2023-10-05T21:16:14.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.009+0000 7f3c8ef43680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 : type miss (requested=0x13, cached=0x16) 2023-10-05T21:16:14.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.009+0000 7f3c8ef43680 20 rados->read ofs=0 len=0 2023-10-05T21:16:14.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.009+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:109 8.1c 8:3bd4508d:root::.bucket.meta.myfoo6%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c7906f0a0 con 0x556c78fe2060 2023-10-05T21:16:14.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.009+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(109 .bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 [call,call out=48b,read 0~353 out=353b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 333+0+619 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:14.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.009+0000 7f3c8ef43680 20 rados_obj.operate() r=0 bl.length=353 2023-10-05T21:16:14.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.009+0000 7f3c8ef43680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 info.flags=0x13 2023-10-05T21:16:14.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.009+0000 7f3c8ef43680 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 to cache LRU end 2023-10-05T21:16:14.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.009+0000 7f3c8ef43680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:16:14.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.009+0000 7f3c8ef43680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:16:14.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.009+0000 7f3c8ef43680 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 2023-10-05T21:16:14.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.009+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:110 8.1c 8:3bd4508d:root::.bucket.meta.myfoo6%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~353 in=353b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c790754a0 con 0x556c78fe2060 2023-10-05T21:16:14.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.010+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(110 .bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 [delete,create,call,call,writefull 0~353,setxattr (117)] v31'2 uv2 ondisk = 0) v8 ==== 417+0+0 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:14.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.010+0000 7f3c8ef43680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 info.flags=0x17 2023-10-05T21:16:14.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.010+0000 7f3c8ef43680 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 to cache LRU end 2023-10-05T21:16:14.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.010+0000 7f3c8ef43680 10 updating xattr: name=user.rgw.acl bl.length()=117 2023-10-05T21:16:14.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.010+0000 7f3c8ef43680 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7, ofs0, ns] 2023-10-05T21:16:14.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.010+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [notify cookie 93924375312384 in=733b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c7906fbc0 con 0x7f3c7800e8c0 2023-10-05T21:16:14.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.011+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 33 ==== watch-notify(notify (1) cookie 93924374792880 notify 133143986203 ret 0) v3 ==== 763+0+0 (crc 0 0 0) 0x7f3c7c015c50 con 0x7f3c7800e8c0 2023-10-05T21:16:14.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.011+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 34 ==== osd_op_reply(111 notify.5 [notify cookie 93924375312384 out=8b] v0'0 uv243 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.011+0000 7f3c73fff700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986203 cookie 93924374792880 notifier 4712 bl.length()=721 2023-10-05T21:16:14.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.011+0000 7f3c73fff700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 info.flags=0x17 2023-10-05T21:16:14.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.011+0000 7f3c73fff700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 to cache LRU end 2023-10-05T21:16:14.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.011+0000 7f3c73fff700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2023-10-05T21:16:14.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.011+0000 7f3c73fff700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3c68003d90 con 0x7f3c7800e8c0 2023-10-05T21:16:14.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.011+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 35 ==== osd_op_reply(112 notify.5 [notify-ack] v0'0 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.011+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 36 ==== watch-notify(notify_complete (2) cookie 93924375312384 notify 133143986203 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f3c7c04e7e0 con 0x7f3c7800e8c0 2023-10-05T21:16:14.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.011+0000 7f3c8ef43680 20 handle_bi_update(): bucket=:myfoo6[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7]): orig_sources= new_sources= 2023-10-05T21:16:14.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.011+0000 7f3c8ef43680 20 handle_bi_update(): bucket=:myfoo6[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7]): potential sources added=[] removed=[] 2023-10-05T21:16:14.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.011+0000 7f3c8ef43680 20 handle_bi_update(): bucket=:myfoo6[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7]): orig_dests= new_dests= 2023-10-05T21:16:14.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.011+0000 7f3c8ef43680 20 handle_bi_update(): bucket=:myfoo6[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7]): potential dests added=[] removed=[] 2023-10-05T21:16:14.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.011+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:113 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.remove_bucket in=59b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c790754a0 con 0x556c78fb09e0 2023-10-05T21:16:14.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.012+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(113 bar.buckets [call] v31'4 uv4 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.012+0000 7f3c8ef43680 20 get_system_obj_state: rctx=0x7ffe4d6b4d28 obj=default.rgw.meta:root:myfoo6 state=0x556c78e5e240 s->prefetch_data=0 2023-10-05T21:16:14.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.012+0000 7f3c8ef43680 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2023-10-05T21:16:14.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.012+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:114 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c7906b800 con 0x556c78fb09e0 2023-10-05T21:16:14.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.012+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(114 myfoo6 [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv16 ondisk = 0) v8 ==== 234+0+139 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.012+0000 7f3c8ef43680 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x16 2023-10-05T21:16:14.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.012+0000 7f3c8ef43680 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2023-10-05T21:16:14.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.012+0000 7f3c8ef43680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:16:14.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.012+0000 7f3c8ef43680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:16:14.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.012+0000 7f3c8ef43680 20 Read xattr: user.rgw.idtag 2023-10-05T21:16:14.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.012+0000 7f3c8ef43680 10 cache get: name=default.rgw.meta+root+myfoo6 : type miss (requested=0x13, cached=0x16) 2023-10-05T21:16:14.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.012+0000 7f3c8ef43680 20 rados->read ofs=0 len=0 2023-10-05T21:16:14.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.012+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:115 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c7906fbc0 con 0x556c78fb09e0 2023-10-05T21:16:14.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.012+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(115 myfoo6 [call,call out=48b,read 0~166 out=166b,getxattrs out=75b] v0'0 uv16 ondisk = 0) v8 ==== 276+0+289 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.012+0000 7f3c8ef43680 20 rados_obj.operate() r=0 bl.length=166 2023-10-05T21:16:14.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.012+0000 7f3c8ef43680 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x13 2023-10-05T21:16:14.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.012+0000 7f3c8ef43680 10 moving default.rgw.meta+root+myfoo6 to cache LRU end 2023-10-05T21:16:14.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.012+0000 7f3c8ef43680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:16:14.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.012+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:116 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c79073760 con 0x556c78fb09e0 2023-10-05T21:16:14.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.013+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(116 myfoo6 [delete,create,call,call,writefull 0~166] v31'17 uv17 ondisk = 0) v8 ==== 318+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.013+0000 7f3c8ef43680 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x17 2023-10-05T21:16:14.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.013+0000 7f3c8ef43680 10 moving default.rgw.meta+root+myfoo6 to cache LRU end 2023-10-05T21:16:14.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.013+0000 7f3c8ef43680 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2023-10-05T21:16:14.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.013+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:117 7.e 7:7759931f:::notify.3:head [notify cookie 93924375302144 in=352b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c79069940 con 0x7f3c7403a030 2023-10-05T21:16:14.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.013+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== watch-notify(notify (1) cookie 93924374783872 notify 133143986191 ret 0) v3 ==== 382+0+0 (crc 0 0 0) 0x556c79003d00 con 0x7f3c7403a030 2023-10-05T21:16:14.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.013+0000 7f3c73fff700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986191 cookie 93924374783872 notifier 4712 bl.length()=340 2023-10-05T21:16:14.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.013+0000 7f3c73fff700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x17 2023-10-05T21:16:14.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.013+0000 7f3c73fff700 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2023-10-05T21:16:14.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.013+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(117 notify.3 [notify cookie 93924375302144 out=8b] v0'0 uv243 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3c7800f600 con 0x7f3c7403a030 2023-10-05T21:16:14.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.013+0000 7f3c73fff700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:118 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3c68003d90 con 0x7f3c7403a030 2023-10-05T21:16:14.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.014+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(118 notify.3 [notify-ack] v0'0 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c7800f600 con 0x7f3c7403a030 2023-10-05T21:16:14.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.014+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== watch-notify(notify_complete (2) cookie 93924375302144 notify 133143986191 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x556c790038b0 con 0x7f3c7403a030 2023-10-05T21:16:14.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.014+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:119 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c79074b50 con 0x556c78fb09e0 2023-10-05T21:16:14.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.015+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(119 bud.buckets [call] v31'3 uv3 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.015+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:120 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c79070710 con 0x556c78fb09e0 2023-10-05T21:16:14.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.015+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== osd_op_reply(120 myfoo6 [delete,create,call,writefull 0~166] v31'18 uv18 ondisk = 0) v8 ==== 276+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.015+0000 7f3c8ef43680 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2023-10-05T21:16:14.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.015+0000 7f3c8ef43680 10 moving default.rgw.meta+root+myfoo6 to cache LRU end 2023-10-05T21:16:14.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.015+0000 7f3c8ef43680 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2023-10-05T21:16:14.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.015+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:121 7.e 7:7759931f:::notify.3:head [notify cookie 93924375348832 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c79074fa0 con 0x7f3c7403a030 2023-10-05T21:16:14.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.016+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 22 ==== watch-notify(notify (1) cookie 93924374783872 notify 133143986192 ret 0) v3 ==== 358+0+0 (crc 0 0 0) 0x556c790038b0 con 0x7f3c7403a030 2023-10-05T21:16:14.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.016+0000 7f3c737fe700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986192 cookie 93924374783872 notifier 4712 bl.length()=316 2023-10-05T21:16:14.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.016+0000 7f3c737fe700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2023-10-05T21:16:14.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.016+0000 7f3c737fe700 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2023-10-05T21:16:14.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.016+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 23 ==== osd_op_reply(121 notify.3 [notify cookie 93924375348832 out=8b] v0'0 uv243 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3c7800f600 con 0x7f3c7403a030 2023-10-05T21:16:14.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.016+0000 7f3c737fe700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:122 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3bd0003390 con 0x7f3c7403a030 2023-10-05T21:16:14.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.016+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 24 ==== osd_op_reply(122 notify.3 [notify-ack] v0'0 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c7800f600 con 0x7f3c7403a030 2023-10-05T21:16:14.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.016+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 25 ==== watch-notify(notify_complete (2) cookie 93924375348832 notify 133143986192 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f3c78006070 con 0x7f3c7403a030 2023-10-05T21:16:14.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.016+0000 7f3c8ef43680 10 int RGWRados::cls_bucket_list_unordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, uint32_t, bool, std::vector&, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter) :myfoo6[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7]) start_after="", prefix="", shard_id=-1", num_entries=1100, list_versions=1, force_check_filter is unset 2023-10-05T21:16:14.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.016+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:123 4.24 4:250a2177:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c79074b50 con 0x7f3c7800e8c0 2023-10-05T21:16:14.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.016+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 37 ==== osd_op_reply(123 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.0 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.016+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:124 4.1 4:80edd8c1:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c79074f90 con 0x7f3c7403a030 2023-10-05T21:16:14.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.017+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 26 ==== osd_op_reply(124 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.1 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3c7800f600 con 0x7f3c7403a030 2023-10-05T21:16:14.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.017+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:125 4.4 4:2044a8d5:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c79074f90 con 0x7f3c7800e8c0 2023-10-05T21:16:14.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.017+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 38 ==== osd_op_reply(125 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.2 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.017+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:126 4.19 4:9b1150cc:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c79074f90 con 0x556c78fe2060 2023-10-05T21:16:14.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.018+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== osd_op_reply(126 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:14.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.018+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:127 4.7 4:e2793aa7:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c79074f90 con 0x7f3c7800e8c0 2023-10-05T21:16:14.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.018+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 39 ==== osd_op_reply(127 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.4 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.018+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:128 4.b 4:d2b63918:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c79074b50 con 0x7f3c7403a030 2023-10-05T21:16:14.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.018+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 27 ==== osd_op_reply(128 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.5 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3c7800f600 con 0x7f3c7403a030 2023-10-05T21:16:14.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.018+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:129 4.18 4:1be2c7da:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c79074b50 con 0x7f3c7403a030 2023-10-05T21:16:14.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.019+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 28 ==== osd_op_reply(129 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.6 [call out=85b] v0'0 uv10 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3c7800f600 con 0x7f3c7403a030 2023-10-05T21:16:14.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.019+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:130 4.28 4:15f0786f:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c79074fd0 con 0x556c78fb09e0 2023-10-05T21:16:14.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.019+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 42 ==== osd_op_reply(130 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.019+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:131 4.39 4:9fce90f7:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c79074fd0 con 0x556c78fe2060 2023-10-05T21:16:14.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.019+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(131 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.8 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:14.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.019+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:132 4.3c 4:3e7461c4:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c79074fd0 con 0x556c78fb09e0 2023-10-05T21:16:14.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.020+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 43 ==== osd_op_reply(132 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.9 [call out=378b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+378 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.020+0000 7f3c8ef43680 10 cls_bucket_list_unordered: got thirteen 2023-10-05T21:16:14.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.020+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:133 4.a 4:525ffd34:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c79074fd0 con 0x7f3c7403a030 2023-10-05T21:16:14.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.020+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 29 ==== osd_op_reply(133 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.10 [call out=85b] v0'0 uv21 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f3c7800f600 con 0x7f3c7403a030 2023-10-05T21:16:14.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.020+0000 7f3c8ef43680 20 get_obj_state: rctx=0x7ffe4d6b4d80 obj=myfoo6:thirteen state=0x556c7906ed98 s->prefetch_data=0 2023-10-05T21:16:14.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.020+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:134 3.29 3:968f03b7:::193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c79074fd0 con 0x7f3c7800e8c0 2023-10-05T21:16:14.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.020+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 40 ==== osd_op_reply(134 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7_thirteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 238+0+872 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.021+0000 7f3c8ef43680 10 manifest: total_size = 8 2023-10-05T21:16:14.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.021+0000 7f3c8ef43680 20 get_obj_state: setting s->obj_tag to 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4220.17805296116621627851 2023-10-05T21:16:14.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.021+0000 7f3c8ef43680 20 Read xattr rgw_rados: user.rgw.acl 2023-10-05T21:16:14.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.021+0000 7f3c8ef43680 20 Read xattr rgw_rados: user.rgw.content_type 2023-10-05T21:16:14.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.021+0000 7f3c8ef43680 20 Read xattr rgw_rados: user.rgw.etag 2023-10-05T21:16:14.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.021+0000 7f3c8ef43680 20 Read xattr rgw_rados: user.rgw.idtag 2023-10-05T21:16:14.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.021+0000 7f3c8ef43680 20 Read xattr rgw_rados: user.rgw.manifest 2023-10-05T21:16:14.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.021+0000 7f3c8ef43680 20 Read xattr rgw_rados: user.rgw.pg_ver 2023-10-05T21:16:14.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.021+0000 7f3c8ef43680 20 Read xattr rgw_rados: user.rgw.source_zone 2023-10-05T21:16:14.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.021+0000 7f3c8ef43680 20 Read xattr rgw_rados: user.rgw.tail_tag 2023-10-05T21:16:14.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.021+0000 7f3c8ef43680 20 get_obj_state: rctx=0x7ffe4d6b4d80 obj=myfoo6:thirteen state=0x556c7906ed98 s->prefetch_data=0 2023-10-05T21:16:14.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.021+0000 7f3c8ef43680 20 get_system_obj_state: rctx=0x7ffe4d6b3470 obj=default.rgw.meta:root:.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 state=0x556c78e5e240 s->prefetch_data=0 2023-10-05T21:16:14.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.021+0000 7f3c8ef43680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 : hit (requested=0x16, cached=0x17) 2023-10-05T21:16:14.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.021+0000 7f3c8ef43680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:16:14.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.021+0000 7f3c8ef43680 20 Read xattr: user.rgw.acl 2023-10-05T21:16:14.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.021+0000 7f3c8ef43680 20 Read xattr: user.rgw.idtag 2023-10-05T21:16:14.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.021+0000 7f3c8ef43680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 : hit (requested=0x13, cached=0x17) 2023-10-05T21:16:14.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.021+0000 7f3c8ef43680 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 2023-10-05T21:16:14.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.021+0000 7f3c8ef43680 20 bucket index object: default.rgw.buckets.index:.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.9 2023-10-05T21:16:14.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.021+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:135 4.3c 4:3e7461c4:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c79078fa0 con 0x556c78fb09e0 2023-10-05T21:16:14.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.021+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 44 ==== osd_op_reply(135 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.9 [stat,call,call] v31'4 uv4 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.021+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:136 3.29 3:968f03b7:::193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7_thirteen:head [cmpxattr user.rgw.idtag (63) op 1 mode 1 in=77b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c79077470 con 0x7f3c7800e8c0 2023-10-05T21:16:14.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.022+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 41 ==== osd_op_reply(136 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7_thirteen [cmpxattr (63) op 1 mode 1,setxattr (117),setxattr (33)] v31'2 uv2 ondisk = 0) v8 ==== 280+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.022+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:137 4.3c 4:3e7461c4:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=267b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c79077350 con 0x556c78fb09e0 2023-10-05T21:16:14.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.022+0000 7f3c8ef43680 10 cache get: name=default.rgw.log++bucket.sync-source-hints.myfoo6 : miss 2023-10-05T21:16:14.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.022+0000 7f3c8ef43680 20 rados->read ofs=0 len=0 2023-10-05T21:16:14.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.022+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:138 6.9 6:936e6ff6:::bucket.sync-source-hints.myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c79077350 con 0x556c78fe2060 2023-10-05T21:16:14.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.023+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 31 ==== osd_op_reply(138 bucket.sync-source-hints.myfoo6 [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 217+0+0 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:14.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.023+0000 7f3c8ef43680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:14.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.023+0000 7f3c8ef43680 10 cache put: name=default.rgw.log++bucket.sync-source-hints.myfoo6 info.flags=0x0 2023-10-05T21:16:14.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.023+0000 7f3c8ef43680 10 adding default.rgw.log++bucket.sync-source-hints.myfoo6 to cache LRU end 2023-10-05T21:16:14.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.023+0000 7f3c8ef43680 10 cache get: name=default.rgw.log++bucket.sync-target-hints.myfoo6 : miss 2023-10-05T21:16:14.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.023+0000 7f3c8ef43680 20 rados->read ofs=0 len=0 2023-10-05T21:16:14.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.023+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:139 6.19 6:9e3df8ab:::bucket.sync-target-hints.myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c79077350 con 0x556c78fb09e0 2023-10-05T21:16:14.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.023+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 45 ==== osd_op_reply(139 bucket.sync-target-hints.myfoo6 [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 217+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.023+0000 7f3c8ef43680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:14.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.023+0000 7f3c8ef43680 10 cache put: name=default.rgw.log++bucket.sync-target-hints.myfoo6 info.flags=0x0 2023-10-05T21:16:14.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.023+0000 7f3c8ef43680 10 adding default.rgw.log++bucket.sync-target-hints.myfoo6 to cache LRU end 2023-10-05T21:16:14.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.023+0000 7f3c8ef43680 10 chain_cache_entry: cache_locator= 2023-10-05T21:16:14.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.023+0000 7f3c8ef43680 20 chain_cache_entry: couldn't find cache locator 2023-10-05T21:16:14.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.023+0000 7f3c8ef43680 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2023-10-05T21:16:14.069 INFO:teuthology.orchestra.run.smithi153.stderr:1 objects processed in :myfoo6[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7]). Next marker thirteen 2023-10-05T21:16:14.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.023+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:140 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c7906f0a0 con 0x7f3c7403a030 2023-10-05T21:16:14.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.023+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 46 ==== osd_op_reply(137 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.9 [stat,call,call] v31'5 uv5 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.023+0000 7f3c737fe700 20 handle_completion(): completion ok for obj=thirteen 2023-10-05T21:16:14.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.024+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 30 ==== osd_op_reply(140 bud [delete,create,call,writefull 0~346] v31'2 uv2 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f3c7800f600 con 0x7f3c7403a030 2023-10-05T21:16:14.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.024+0000 7f3c8ef43680 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2023-10-05T21:16:14.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.024+0000 7f3c8ef43680 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2023-10-05T21:16:14.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.024+0000 7f3c8ef43680 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2023-10-05T21:16:14.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.024+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:141 7.3 7:c609908c:::notify.5:head [notify cookie 93924375325616 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c7906f000 con 0x7f3c7800e8c0 2023-10-05T21:16:14.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.024+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 42 ==== watch-notify(notify (1) cookie 93924374792880 notify 133143986204 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x7f3c7c06a040 con 0x7f3c7800e8c0 2023-10-05T21:16:14.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.024+0000 7f3c73fff700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986204 cookie 93924374792880 notifier 4712 bl.length()=522 2023-10-05T21:16:14.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.024+0000 7f3c73fff700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2023-10-05T21:16:14.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.024+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 43 ==== osd_op_reply(141 notify.5 [notify cookie 93924375325616 out=8b] v0'0 uv243 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.024+0000 7f3c73fff700 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2023-10-05T21:16:14.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.024+0000 7f3c73fff700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:142 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3c68003d90 con 0x7f3c7800e8c0 2023-10-05T21:16:14.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.024+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 44 ==== osd_op_reply(142 notify.5 [notify-ack] v0'0 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.024+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 45 ==== watch-notify(notify_complete (2) cookie 93924375325616 notify 133143986204 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f3c7c066000 con 0x7f3c7800e8c0 2023-10-05T21:16:14.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.024+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:143 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c7906f0a0 con 0x556c78fb09e0 2023-10-05T21:16:14.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.025+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 47 ==== osd_op_reply(143 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v31'5 uv5 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.025+0000 7f3c8ef43680 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2023-10-05T21:16:14.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.025+0000 7f3c8ef43680 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2023-10-05T21:16:14.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.025+0000 7f3c8ef43680 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2023-10-05T21:16:14.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.025+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:144 7.3 7:c609908c:::notify.5:head [notify cookie 93924375325616 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c7906f000 con 0x7f3c7800e8c0 2023-10-05T21:16:14.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.025+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 46 ==== watch-notify(notify (1) cookie 93924374792880 notify 133143986205 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x7f3c7c066000 con 0x7f3c7800e8c0 2023-10-05T21:16:14.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.025+0000 7f3c73fff700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986205 cookie 93924374792880 notifier 4712 bl.length()=177 2023-10-05T21:16:14.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.025+0000 7f3c73fff700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2023-10-05T21:16:14.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.025+0000 7f3c73fff700 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2023-10-05T21:16:14.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.025+0000 7f3c73fff700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:145 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3c68003d90 con 0x7f3c7800e8c0 2023-10-05T21:16:14.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.025+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 47 ==== osd_op_reply(144 notify.5 [notify cookie 93924375325616 out=8b] v0'0 uv243 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.026+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 48 ==== osd_op_reply(145 notify.5 [notify-ack] v0'0 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.026+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 49 ==== watch-notify(notify_complete (2) cookie 93924375325616 notify 133143986205 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f3c7c04e7e0 con 0x7f3c7800e8c0 2023-10-05T21:16:14.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.026+0000 7f3c8ef43680 10 removing user index: bar 2023-10-05T21:16:14.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.026+0000 7f3c8ef43680 10 removing default.rgw.meta+users.uid+bar from cache 2023-10-05T21:16:14.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.026+0000 7f3c8ef43680 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2023-10-05T21:16:14.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.026+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:146 7.9 7:93e5b521:::notify.7:head [notify cookie 93924375325616 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c7906f000 con 0x7f3c7800e8c0 2023-10-05T21:16:14.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.026+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 50 ==== watch-notify(notify (1) cookie 93924374799312 notify 133143986206 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x7f3c7c04e7e0 con 0x7f3c7800e8c0 2023-10-05T21:16:14.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.026+0000 7f3c737fe700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986206 cookie 93924374799312 notifier 4712 bl.length()=152 2023-10-05T21:16:14.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.026+0000 7f3c737fe700 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:147 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3bd0003350 con 0x7f3c7800e8c0 2023-10-05T21:16:14.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.026+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 51 ==== osd_op_reply(146 notify.7 [notify cookie 93924375325616 out=8b] v0'0 uv243 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.026+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 52 ==== watch-notify(notify_complete (2) cookie 93924375325616 notify 133143986206 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f3c7c04ee40 con 0x7f3c7800e8c0 2023-10-05T21:16:14.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.026+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 53 ==== osd_op_reply(147 notify.7 [notify-ack] v0'0 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.026+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:148 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c7906f0a0 con 0x7f3c7800e8c0 2023-10-05T21:16:14.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.027+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 54 ==== osd_op_reply(148 bar [delete] v31'7 uv7 ondisk = 0) v8 ==== 147+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.073 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:16:14.073 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "bud", 2023-10-05T21:16:14.073 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Bar", 2023-10-05T21:16:14.073 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "", 2023-10-05T21:16:14.074 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2023-10-05T21:16:14.074 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 4, 2023-10-05T21:16:14.074 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [], 2023-10-05T21:16:14.074 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2023-10-05T21:16:14.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:14.074 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "bud", 2023-10-05T21:16:14.074 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "NX5QOQKC6BH2IDN8HC7A", 2023-10-05T21:16:14.074 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn" 2023-10-05T21:16:14.074 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:14.074 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:16:14.074 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [], 2023-10-05T21:16:14.075 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2023-10-05T21:16:14.075 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2023-10-05T21:16:14.075 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2023-10-05T21:16:14.075 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2023-10-05T21:16:14.075 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2023-10-05T21:16:14.075 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:16:14.075 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:16:14.075 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:16:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:16:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:16:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:16:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2023-10-05T21:16:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:16:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:16:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:16:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:16:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:16:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:14.076 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2023-10-05T21:16:14.077 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2023-10-05T21:16:14.077 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [] 2023-10-05T21:16:14.077 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:16:14.077 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:16:14.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.027+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:149 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93924374779376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c79027210 con 0x7f3c7403a030 2023-10-05T21:16:14.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.028+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 31 ==== osd_op_reply(149 notify.0 [watch unwatch cookie 93924374779376] v31'245 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c7800f600 con 0x7f3c7403a030 2023-10-05T21:16:14.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.028+0000 7f3c8ef43680 20 remove_watcher() i=0 2023-10-05T21:16:14.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.028+0000 7f3c8ef43680 2 removed watcher, disabling cache 2023-10-05T21:16:14.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.028+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:150 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93924374781664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe95f0 con 0x556c78fb09e0 2023-10-05T21:16:14.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.029+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 48 ==== osd_op_reply(150 notify.1 [watch unwatch cookie 93924374781664] v31'245 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.029+0000 7f3c8ef43680 20 remove_watcher() i=1 2023-10-05T21:16:14.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.029+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:151 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93924374786768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fe95f0 con 0x556c78fe2060 2023-10-05T21:16:14.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.029+0000 7f3c8201b700 1 -- 172.21.15.153:0/2376030819 <== osd.3 v2:172.21.15.153:6800/140455 32 ==== osd_op_reply(151 notify.2 [watch unwatch cookie 93924374786768] v31'245 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c74037070 con 0x556c78fe2060 2023-10-05T21:16:14.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.029+0000 7f3c8ef43680 20 remove_watcher() i=2 2023-10-05T21:16:14.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.029+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:152 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93924374783872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78feb2d0 con 0x7f3c7403a030 2023-10-05T21:16:14.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.030+0000 7f3c8181a700 1 -- 172.21.15.153:0/2376030819 <== osd.2 v2:172.21.15.153:6807/140454 32 ==== osd_op_reply(152 notify.3 [watch unwatch cookie 93924374783872] v31'245 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c7800f600 con 0x7f3c7403a030 2023-10-05T21:16:14.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.030+0000 7f3c8ef43680 20 remove_watcher() i=3 2023-10-05T21:16:14.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.030+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:153 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93924374789184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fea780 con 0x556c78fb09e0 2023-10-05T21:16:14.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.031+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 49 ==== osd_op_reply(153 notify.4 [watch unwatch cookie 93924374789184] v31'245 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.031+0000 7f3c8ef43680 20 remove_watcher() i=4 2023-10-05T21:16:14.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.031+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:154 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93924374792880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78feb2d0 con 0x7f3c7800e8c0 2023-10-05T21:16:14.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.032+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 55 ==== osd_op_reply(154 notify.5 [watch unwatch cookie 93924374792880] v31'245 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.032+0000 7f3c8ef43680 20 remove_watcher() i=5 2023-10-05T21:16:14.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.032+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:155 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93924374797104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78febc40 con 0x7f3c7800e8c0 2023-10-05T21:16:14.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.033+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 56 ==== osd_op_reply(155 notify.6 [watch unwatch cookie 93924374797104] v31'245 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.033+0000 7f3c8ef43680 20 remove_watcher() i=6 2023-10-05T21:16:14.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.033+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:156 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93924374799312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78fea780 con 0x7f3c7800e8c0 2023-10-05T21:16:14.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.034+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.0 v2:172.21.15.111:6800/111394 57 ==== osd_op_reply(156 notify.7 [watch unwatch cookie 93924374799312] v31'245 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x7f3c7800e8c0 2023-10-05T21:16:14.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.034+0000 7f3c8ef43680 20 remove_watcher() i=7 2023-10-05T21:16:14.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.034+0000 7f3c53fdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:16:14.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.034+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:157 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93924374802352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556c78feb2d0 con 0x556c78fb09e0 2023-10-05T21:16:14.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.035+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 <== osd.1 v2:172.21.15.153:6816/140456 50 ==== osd_op_reply(157 data_loggenerations_metadata [watch unwatch cookie 93924374802352] v31'234 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3c7c02e180 con 0x556c78fb09e0 2023-10-05T21:16:14.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.035+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f3c7800e8c0 msgr2=0x7f3c7800d310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:14.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.035+0000 7f3c8ef43680 1 --2- 172.21.15.153:0/2376030819 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f3c7800e8c0 0x7f3c7800d310 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:14.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.035+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x556c78fb09e0 msgr2=0x556c78fdfa10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:14.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.035+0000 7f3c8ef43680 1 --2- 172.21.15.153:0/2376030819 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x556c78fb09e0 0x556c78fdfa10 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:14.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.035+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f3c7403a030 msgr2=0x7f3c740113b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:14.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.035+0000 7f3c8ef43680 1 --2- 172.21.15.153:0/2376030819 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f3c7403a030 0x7f3c740113b0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:14.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.035+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x556c78fe2060 msgr2=0x556c78fe4440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:14.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.035+0000 7f3c8ef43680 1 --2- 172.21.15.153:0/2376030819 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x556c78fe2060 0x556c78fe4440 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:14.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.035+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3c640340f0 msgr2=0x7f3c640365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:14.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.035+0000 7f3c8ef43680 1 --2- 172.21.15.153:0/2376030819 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3c640340f0 0x7f3c640365a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3c780011e0 tx=0x7f3c78001460 comp rx=0 tx=0).stop 2023-10-05T21:16:14.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.035+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556c78f1f0b0 msgr2=0x556c78fd3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:14.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.035+0000 7f3c8ef43680 1 --2- 172.21.15.153:0/2376030819 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556c78f1f0b0 0x556c78fd3cb0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3c74020040 tx=0x7f3c7401d000 comp rx=0 tx=0).stop 2023-10-05T21:16:14.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.035+0000 7f3c8281c700 1 -- 172.21.15.153:0/2376030819 reap_dead start 2023-10-05T21:16:14.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.035+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 shutdown_connections 2023-10-05T21:16:14.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.035+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 >> 172.21.15.153:0/2376030819 conn(0x556c78fa5b90 msgr2=0x556c78fc6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:14.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.035+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 shutdown_connections 2023-10-05T21:16:14.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.035+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2376030819 wait complete. 2023-10-05T21:16:14.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.036+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2965219108 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3bc80340a0 msgr2=0x7f3bc8036550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:14.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.036+0000 7f3c8ef43680 1 --2- 172.21.15.153:0/2965219108 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3bc80340a0 0x7f3bc8036550 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x556c78fef4e0 tx=0x7f3c7c00afb0 comp rx=0 tx=0).stop 2023-10-05T21:16:14.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.036+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2965219108 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556c78ffc400 msgr2=0x556c79003170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:14.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.036+0000 7f3c8ef43680 1 --2- 172.21.15.153:0/2965219108 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556c78ffc400 0x556c79003170 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x556c78fdcf80 tx=0x7f3c78032000 comp rx=0 tx=0).stop 2023-10-05T21:16:14.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.036+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2965219108 shutdown_connections 2023-10-05T21:16:14.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.036+0000 7f3c8ef43680 1 --2- 172.21.15.153:0/2965219108 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f3bc80340a0 0x7f3bc8036550 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:14.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.036+0000 7f3c8ef43680 1 --2- 172.21.15.153:0/2965219108 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556c78ffc400 0x556c79003170 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:14.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.036+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2965219108 >> 172.21.15.153:0/2965219108 conn(0x556c78ff8700 msgr2=0x556c78ff67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:14.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.036+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2965219108 shutdown_connections 2023-10-05T21:16:14.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:14.036+0000 7f3c8ef43680 1 -- 172.21.15.153:0/2965219108 wait complete. 2023-10-05T21:16:14.087 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:16:19.093 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2023-10-05T21:16:19.093 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2023-10-05T21:16:19.093 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2023-10-05T21:16:19.093 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2023-10-05T21:16:19.094 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2023-10-05T21:16:19.153 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:16:19.153 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:16:19.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.152+0000 7feddc9dd680 1 Processor -- start 2023-10-05T21:16:19.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.152+0000 7feddc9dd680 1 -- start start 2023-10-05T21:16:19.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.152+0000 7feddc9dd680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55934804c980 0x55934804ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.152+0000 7feddc9dd680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559347f96930 con 0x559348048940 2023-10-05T21:16:19.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.152+0000 7feddc9dd680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x559347f56db0 con 0x55934804c980 2023-10-05T21:16:19.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.153+0000 7fedcf2b4700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55934804c980 0x55934804ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.153+0000 7fedcf2b4700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55934804c980 0x55934804ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:53118/0 (socket says 172.21.15.153:53118) 2023-10-05T21:16:19.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.153+0000 7fedcf2b4700 1 -- 172.21.15.153:0/2498455545 learned_addr learned my addr 172.21.15.153:0/2498455545 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:19.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.153+0000 7fedcf2b4700 1 -- 172.21.15.153:0/2498455545 >> v1:172.21.15.111:6789/0 conn(0x559348048940 legacy=0x559348048d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.153+0000 7fedcf2b4700 1 -- 172.21.15.153:0/2498455545 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593480502b0 con 0x55934804c980 2023-10-05T21:16:19.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.153+0000 7fedcf2b4700 1 --2- 172.21.15.153:0/2498455545 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55934804c980 0x55934804ed60 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fedc400a650 tx=0x7fedc4005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a19ec8d4f8c6e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.153+0000 7fedceab3700 1 -- 172.21.15.153:0/2498455545 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fedc4008760 con 0x55934804c980 2023-10-05T21:16:19.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.153+0000 7fedceab3700 1 -- 172.21.15.153:0/2498455545 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc40088c0 con 0x55934804c980 2023-10-05T21:16:19.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.153+0000 7fedceab3700 1 -- 172.21.15.153:0/2498455545 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fedc4008bb0 con 0x55934804c980 2023-10-05T21:16:19.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.154+0000 7feddc9dd680 1 -- 172.21.15.153:0/2498455545 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55934804c980 msgr2=0x55934804ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.154+0000 7feddc9dd680 1 --2- 172.21.15.153:0/2498455545 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55934804c980 0x55934804ed60 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fedc400a650 tx=0x7fedc4005b10 comp rx=0 tx=0).stop 2023-10-05T21:16:19.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.154+0000 7feddc9dd680 1 -- 172.21.15.153:0/2498455545 shutdown_connections 2023-10-05T21:16:19.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.154+0000 7feddc9dd680 1 --2- 172.21.15.153:0/2498455545 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55934804c980 0x55934804ed60 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.154+0000 7feddc9dd680 1 -- 172.21.15.153:0/2498455545 >> 172.21.15.153:0/2498455545 conn(0x559348043340 msgr2=0x559348045750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:19.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.154+0000 7feddc9dd680 1 -- 172.21.15.153:0/2498455545 shutdown_connections 2023-10-05T21:16:19.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.154+0000 7feddc9dd680 1 -- 172.21.15.153:0/2498455545 wait complete. 2023-10-05T21:16:19.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.155+0000 7feddc9dd680 1 Processor -- start 2023-10-05T21:16:19.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.155+0000 7feddc9dd680 1 -- start start 2023-10-05T21:16:19.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.155+0000 7feddc9dd680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559348048940 0x559348067890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.155+0000 7feddc9dd680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x559347ef6ea0 con 0x559348048940 2023-10-05T21:16:19.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.155+0000 7fedcfab5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559348048940 0x559348067890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.156+0000 7fedcfab5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559348048940 0x559348067890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:53126/0 (socket says 172.21.15.153:53126) 2023-10-05T21:16:19.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.156+0000 7fedcfab5700 1 -- 172.21.15.153:0/3298664604 learned_addr learned my addr 172.21.15.153:0/3298664604 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:19.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.156+0000 7fedcfab5700 1 -- 172.21.15.153:0/3298664604 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc4005db0 con 0x559348048940 2023-10-05T21:16:19.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.156+0000 7fedcfab5700 1 --2- 172.21.15.153:0/3298664604 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559348048940 0x559348067890 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fedc0001d30 tx=0x7fedc0001900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f10094c4f658930 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.156+0000 7fedcdab1700 1 -- 172.21.15.153:0/3298664604 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fedc0014070 con 0x559348048940 2023-10-05T21:16:19.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.156+0000 7fedcdab1700 1 -- 172.21.15.153:0/3298664604 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc0008070 con 0x559348048940 2023-10-05T21:16:19.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.156+0000 7fedcdab1700 1 -- 172.21.15.153:0/3298664604 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fedc000bd30 con 0x559348048940 2023-10-05T21:16:19.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.156+0000 7feddc9dd680 1 -- 172.21.15.153:0/3298664604 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559348048940 msgr2=0x559348067890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.156+0000 7feddc9dd680 1 --2- 172.21.15.153:0/3298664604 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559348048940 0x559348067890 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fedc0001d30 tx=0x7fedc0001900 comp rx=0 tx=0).stop 2023-10-05T21:16:19.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.157+0000 7feddc9dd680 1 -- 172.21.15.153:0/3298664604 shutdown_connections 2023-10-05T21:16:19.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.157+0000 7feddc9dd680 1 --2- 172.21.15.153:0/3298664604 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559348048940 0x559348067890 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.157+0000 7feddc9dd680 1 -- 172.21.15.153:0/3298664604 >> 172.21.15.153:0/3298664604 conn(0x559348043340 msgr2=0x559348063360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:19.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.157+0000 7feddc9dd680 1 -- 172.21.15.153:0/3298664604 shutdown_connections 2023-10-05T21:16:19.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.157+0000 7feddc9dd680 1 -- 172.21.15.153:0/3298664604 wait complete. 2023-10-05T21:16:19.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.157+0000 7feddc9dd680 1 Processor -- start 2023-10-05T21:16:19.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.157+0000 7feddc9dd680 1 -- start start 2023-10-05T21:16:19.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.157+0000 7feddc9dd680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559348048940 0x55934806eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.157+0000 7feddc9dd680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x559347eedc80 con 0x559348048940 2023-10-05T21:16:19.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.158+0000 7fedcfab5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559348048940 0x55934806eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.158+0000 7fedcfab5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559348048940 0x55934806eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:53134/0 (socket says 172.21.15.153:53134) 2023-10-05T21:16:19.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.158+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 learned_addr learned my addr 172.21.15.153:0/4072381494 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:19.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.158+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc000a040 con 0x559348048940 2023-10-05T21:16:19.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.158+0000 7fedcfab5700 1 --2- 172.21.15.153:0/4072381494 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559348048940 0x55934806eda0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fedc0003000 tx=0x7fedc0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.158+0000 7fedb7fff700 1 -- 172.21.15.153:0/4072381494 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fedc0021070 con 0x559348048940 2023-10-05T21:16:19.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.158+0000 7fedb7fff700 1 -- 172.21.15.153:0/4072381494 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc001c110 con 0x559348048940 2023-10-05T21:16:19.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.158+0000 7fedb7fff700 1 -- 172.21.15.153:0/4072381494 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fedc001c3e0 con 0x559348048940 2023-10-05T21:16:19.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.158+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55934806f2e0 con 0x559348048940 2023-10-05T21:16:19.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.158+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55934806f790 con 0x559348048940 2023-10-05T21:16:19.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.159+0000 7fedb7fff700 1 -- 172.21.15.153:0/4072381494 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fedc001a550 con 0x559348048940 2023-10-05T21:16:19.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.159+0000 7feddc9dd680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.160+0000 7fedb7fff700 1 --2- 172.21.15.153:0/4072381494 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fedbc0340d0 0x7fedbc036580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.160+0000 7fedb7fff700 1 -- 172.21.15.153:0/4072381494 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fedc004a070 con 0x559348048940 2023-10-05T21:16:19.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.160+0000 7fedcf2b4700 1 --2- 172.21.15.153:0/4072381494 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fedbc0340d0 0x7fedbc036580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.160+0000 7feddc9dd680 1 --2- 172.21.15.153:0/4072381494 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55934804c980 0x559348079a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.160+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55934807a1b0 con 0x55934804c980 2023-10-05T21:16:19.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.160+0000 7fedd02b6700 1 --2- 172.21.15.153:0/4072381494 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55934804c980 0x559348079a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.160+0000 7fedcf2b4700 1 --2- 172.21.15.153:0/4072381494 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fedbc0340d0 0x7fedbc036580 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fedc4005b50 tx=0x7fedc4015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.160+0000 7fedd02b6700 1 --2- 172.21.15.153:0/4072381494 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55934804c980 0x559348079a20 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.161+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.161+0000 7feddc9dd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.161+0000 7feddc9dd680 20 realm 2023-10-05T21:16:19.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.161+0000 7feddc9dd680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.161+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348077060 con 0x55934804c980 2023-10-05T21:16:19.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.161+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.161+0000 7feddc9dd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.161+0000 7feddc9dd680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:16:19.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.161+0000 7feddc9dd680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.161+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55934807ac60 con 0x55934804c980 2023-10-05T21:16:19.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.161+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.161+0000 7feddc9dd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.161+0000 7feddc9dd680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.161+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55934807b580 con 0x55934804c980 2023-10-05T21:16:19.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.161+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.161+0000 7feddc9dd680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:19.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.161+0000 7feddc9dd680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.161+0000 7feddc9dd680 1 --2- 172.21.15.153:0/4072381494 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55934807be40 0x55934807e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.161+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55934807e870 con 0x55934807be40 2023-10-05T21:16:19.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.162+0000 7fedcfab5700 1 --2- 172.21.15.153:0/4072381494 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55934807be40 0x55934807e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.162+0000 7fedcfab5700 1 --2- 172.21.15.153:0/4072381494 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55934807be40 0x55934807e220 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.162+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fedc0016070 con 0x55934807be40 2023-10-05T21:16:19.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.162+0000 7feddc9dd680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:16:19.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.162+0000 7feddc9dd680 20 searching for the correct realm 2023-10-05T21:16:19.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.162+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x55934807be40 2023-10-05T21:16:19.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.162+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc0016070 con 0x55934807be40 2023-10-05T21:16:19.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.162+0000 7fedcfab5700 1 --2- 172.21.15.153:0/4072381494 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fedc0030060 0x7fedc00427a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.163+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x7fedc0030060 2023-10-05T21:16:19.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.163+0000 7fedcf2b4700 1 --2- 172.21.15.153:0/4072381494 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fedc0030060 0x7fedc00427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.163+0000 7fedcf2b4700 1 --2- 172.21.15.153:0/4072381494 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fedc0030060 0x7fedc00427a0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.163+0000 7fedcf2b4700 1 -- 172.21.15.153:0/4072381494 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc4012450 con 0x7fedc0030060 2023-10-05T21:16:19.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.163+0000 7fedcf2b4700 1 --2- 172.21.15.153:0/4072381494 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fedc4007030 0x7fedc401c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.163+0000 7fedcf2b4700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x7fedc4007030 2023-10-05T21:16:19.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.163+0000 7fedd02b6700 1 --2- 172.21.15.153:0/4072381494 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fedc4007030 0x7fedc401c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.164+0000 7fedd02b6700 1 --2- 172.21.15.153:0/4072381494 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fedc4007030 0x7fedc401c920 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.164+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.164+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x55934804c980 2023-10-05T21:16:19.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.164+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.164+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x55934804c980 2023-10-05T21:16:19.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.165+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.165+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x7fedc4007030 2023-10-05T21:16:19.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.165+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.165+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x7fedc4007030 2023-10-05T21:16:19.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.165+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.165+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x7fedc0030060 2023-10-05T21:16:19.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.165+0000 7fedcf2b4700 1 -- 172.21.15.153:0/4072381494 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc4012450 con 0x7fedc0030060 2023-10-05T21:16:19.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.165+0000 7fedcf2b4700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x55934807be40 2023-10-05T21:16:19.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.166+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fedc0016070 con 0x55934807be40 2023-10-05T21:16:19.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.166+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x55934804c980 2023-10-05T21:16:19.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.166+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.166+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x7fedc4007030 2023-10-05T21:16:19.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.166+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.166+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x55934804c980 2023-10-05T21:16:19.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.166+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.166+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x7fedc0030060 2023-10-05T21:16:19.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.167+0000 7fedcf2b4700 1 -- 172.21.15.153:0/4072381494 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc4012450 con 0x7fedc0030060 2023-10-05T21:16:19.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.167+0000 7fedcf2b4700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x55934807be40 2023-10-05T21:16:19.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.167+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc0016070 con 0x55934807be40 2023-10-05T21:16:19.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.167+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x55934807be40 2023-10-05T21:16:19.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.167+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc0016070 con 0x55934807be40 2023-10-05T21:16:19.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.167+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x7fedc4007030 2023-10-05T21:16:19.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.168+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.168+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x55934807be40 2023-10-05T21:16:19.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.168+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc0016070 con 0x55934807be40 2023-10-05T21:16:19.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.168+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x55934807be40 2023-10-05T21:16:19.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.168+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc0016070 con 0x55934807be40 2023-10-05T21:16:19.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.168+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x55934804c980 2023-10-05T21:16:19.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.168+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.168+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x55934804c980 2023-10-05T21:16:19.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.168+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.168+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x7fedc4007030 2023-10-05T21:16:19.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.169+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.169+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x55934807be40 2023-10-05T21:16:19.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.169+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc0016070 con 0x55934807be40 2023-10-05T21:16:19.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.169+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x7fedc0030060 2023-10-05T21:16:19.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.169+0000 7fedcf2b4700 1 -- 172.21.15.153:0/4072381494 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc4012450 con 0x7fedc0030060 2023-10-05T21:16:19.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.169+0000 7fedcf2b4700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x55934804c980 2023-10-05T21:16:19.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.170+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.170+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x7fedc4007030 2023-10-05T21:16:19.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.170+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.170+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x55934807be40 2023-10-05T21:16:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.170+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc0016070 con 0x55934807be40 2023-10-05T21:16:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.170+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x7fedc4007030 2023-10-05T21:16:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.171+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.171+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x7fedc0030060 2023-10-05T21:16:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.171+0000 7fedcf2b4700 1 -- 172.21.15.153:0/4072381494 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc4012450 con 0x7fedc0030060 2023-10-05T21:16:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.171+0000 7fedcf2b4700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x55934807be40 2023-10-05T21:16:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.171+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc0016070 con 0x55934807be40 2023-10-05T21:16:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.171+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x7fedc4007030 2023-10-05T21:16:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.171+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.171+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x55934804c980 2023-10-05T21:16:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.172+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.172+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480803e0 con 0x7fedc0030060 2023-10-05T21:16:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.172+0000 7fedcf2b4700 1 -- 172.21.15.153:0/4072381494 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc4012450 con 0x7fedc0030060 2023-10-05T21:16:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.172+0000 7feddc9dd680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:16:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.172+0000 7feddc9dd680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:16:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.172+0000 7feddc9dd680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:16:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.172+0000 7feddc9dd680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:16:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.172+0000 7feddc9dd680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.172+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55934807f330 con 0x55934804c980 2023-10-05T21:16:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.172+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.172+0000 7feddc9dd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.172+0000 7feddc9dd680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.172+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55934807f730 con 0x55934804c980 2023-10-05T21:16:19.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.172+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.172+0000 7feddc9dd680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:19.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.172+0000 7feddc9dd680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.172+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080870 con 0x55934804c980 2023-10-05T21:16:19.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.173+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.173+0000 7feddc9dd680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:16:19.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.173+0000 7feddc9dd680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.173+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080c20 con 0x55934807be40 2023-10-05T21:16:19.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.173+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fedc0016070 con 0x55934807be40 2023-10-05T21:16:19.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.173+0000 7feddc9dd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.173+0000 7feddc9dd680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.173+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080fd0 con 0x55934804c980 2023-10-05T21:16:19.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.173+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.173+0000 7feddc9dd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.173+0000 7feddc9dd680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.173+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080fd0 con 0x55934804c980 2023-10-05T21:16:19.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.173+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.173+0000 7feddc9dd680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:19.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.173+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080fd0 con 0x55934807be40 2023-10-05T21:16:19.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.174+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc0016070 con 0x55934807be40 2023-10-05T21:16:19.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.174+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080fd0 con 0x7fedc0030060 2023-10-05T21:16:19.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.174+0000 7fedcf2b4700 1 -- 172.21.15.153:0/4072381494 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc4012450 con 0x7fedc0030060 2023-10-05T21:16:19.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.174+0000 7fedcf2b4700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080fd0 con 0x7fedc4007030 2023-10-05T21:16:19.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.174+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.174+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080870 con 0x55934804c980 2023-10-05T21:16:19.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.174+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.174+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080870 con 0x55934804c980 2023-10-05T21:16:19.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.175+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.175+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080870 con 0x7fedc4007030 2023-10-05T21:16:19.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.175+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.175+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080870 con 0x7fedc4007030 2023-10-05T21:16:19.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.175+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.175+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080870 con 0x7fedc0030060 2023-10-05T21:16:19.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.176+0000 7fedcf2b4700 1 -- 172.21.15.153:0/4072381494 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc4012450 con 0x7fedc0030060 2023-10-05T21:16:19.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.176+0000 7fedcf2b4700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080870 con 0x55934807be40 2023-10-05T21:16:19.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.176+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fedc0016070 con 0x55934807be40 2023-10-05T21:16:19.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.176+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080870 con 0x55934804c980 2023-10-05T21:16:19.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.176+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.176+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080870 con 0x7fedc4007030 2023-10-05T21:16:19.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.176+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.176+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080870 con 0x55934804c980 2023-10-05T21:16:19.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.176+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.176+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080870 con 0x7fedc0030060 2023-10-05T21:16:19.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.177+0000 7fedcf2b4700 1 -- 172.21.15.153:0/4072381494 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc4012450 con 0x7fedc0030060 2023-10-05T21:16:19.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.177+0000 7fedcf2b4700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080870 con 0x55934807be40 2023-10-05T21:16:19.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.177+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc0016070 con 0x55934807be40 2023-10-05T21:16:19.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.177+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080870 con 0x55934807be40 2023-10-05T21:16:19.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.177+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc0016070 con 0x55934807be40 2023-10-05T21:16:19.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.177+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080870 con 0x7fedc4007030 2023-10-05T21:16:19.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.177+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.177+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080870 con 0x55934807be40 2023-10-05T21:16:19.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.178+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc0016070 con 0x55934807be40 2023-10-05T21:16:19.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.178+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080870 con 0x55934807be40 2023-10-05T21:16:19.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.178+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc0058040 con 0x55934807be40 2023-10-05T21:16:19.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.178+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080870 con 0x55934804c980 2023-10-05T21:16:19.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.178+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.178+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080870 con 0x55934804c980 2023-10-05T21:16:19.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.178+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.178+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080870 con 0x7fedc4007030 2023-10-05T21:16:19.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.179+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.179+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080870 con 0x55934807be40 2023-10-05T21:16:19.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.179+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc0058040 con 0x55934807be40 2023-10-05T21:16:19.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.179+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080870 con 0x7fedc0030060 2023-10-05T21:16:19.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.179+0000 7fedcf2b4700 1 -- 172.21.15.153:0/4072381494 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc4012450 con 0x7fedc0030060 2023-10-05T21:16:19.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.179+0000 7fedcf2b4700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080870 con 0x55934804c980 2023-10-05T21:16:19.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.179+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.179+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080870 con 0x7fedc4007030 2023-10-05T21:16:19.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.180+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.180+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080870 con 0x55934807be40 2023-10-05T21:16:19.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.180+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc0058040 con 0x55934807be40 2023-10-05T21:16:19.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.180+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080870 con 0x7fedc4007030 2023-10-05T21:16:19.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.180+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.180+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080870 con 0x7fedc0030060 2023-10-05T21:16:19.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.180+0000 7fedcf2b4700 1 -- 172.21.15.153:0/4072381494 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc4012450 con 0x7fedc0030060 2023-10-05T21:16:19.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.181+0000 7fedcf2b4700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080870 con 0x55934807be40 2023-10-05T21:16:19.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.181+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc0058040 con 0x55934807be40 2023-10-05T21:16:19.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.181+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fedc005c040 con 0x7fedc4007030 2023-10-05T21:16:19.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.181+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.181+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fedc005c040 con 0x55934804c980 2023-10-05T21:16:19.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.181+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.181+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fedc005c040 con 0x7fedc0030060 2023-10-05T21:16:19.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.182+0000 7fedcf2b4700 1 -- 172.21.15.153:0/4072381494 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fedc4012450 con 0x7fedc0030060 2023-10-05T21:16:19.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.182+0000 7feddc9dd680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:16:19.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.182+0000 7feddc9dd680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:16:19.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.182+0000 7feddc9dd680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:16:19.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.182+0000 7feddc9dd680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:16:19.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.182+0000 7feddc9dd680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.182+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348080fd0 con 0x55934804c980 2023-10-05T21:16:19.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.182+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.182+0000 7feddc9dd680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:19.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.182+0000 7feddc9dd680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.182+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480813d0 con 0x55934807be40 2023-10-05T21:16:19.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.182+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fedc0058040 con 0x55934807be40 2023-10-05T21:16:19.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.182+0000 7feddc9dd680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:16:19.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.182+0000 7feddc9dd680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.182+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348081c70 con 0x55934804c980 2023-10-05T21:16:19.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.182+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.182+0000 7feddc9dd680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:19.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.182+0000 7feddc9dd680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.182+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348081c70 con 0x55934804c980 2023-10-05T21:16:19.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.183+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.183+0000 7feddc9dd680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:16:19.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.183+0000 7feddc9dd680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.183+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348081d70 con 0x7fedc4007030 2023-10-05T21:16:19.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.183+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.183+0000 7feddc9dd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.183+0000 7feddc9dd680 20 zone default found 2023-10-05T21:16:19.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.183+0000 7feddc9dd680 4 Realm: () 2023-10-05T21:16:19.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.183+0000 7feddc9dd680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:16:19.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.183+0000 7feddc9dd680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:16:19.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.183+0000 7feddc9dd680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:16:19.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.183+0000 7feddc9dd680 20 zonegroup default 2023-10-05T21:16:19.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.183+0000 7feddc9dd680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.183+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348081d70 con 0x7fedc4007030 2023-10-05T21:16:19.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.183+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.183+0000 7feddc9dd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.183+0000 7feddc9dd680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.183+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480836f0 con 0x55934807be40 2023-10-05T21:16:19.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.184+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fedc0058040 con 0x55934807be40 2023-10-05T21:16:19.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.184+0000 7feddc9dd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.184+0000 7feddc9dd680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.184+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348083aa0 con 0x55934807be40 2023-10-05T21:16:19.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.184+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fedc0058040 con 0x55934807be40 2023-10-05T21:16:19.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.184+0000 7feddc9dd680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.184+0000 7feddc9dd680 20 started sync module instance, tier type = 2023-10-05T21:16:19.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.184+0000 7feddc9dd680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:16:19.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.184+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348082db0 con 0x7fedc0030060 2023-10-05T21:16:19.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.185+0000 7fedcf2b4700 1 -- 172.21.15.153:0/4072381494 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v31'246 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fedc4012450 con 0x7fedc0030060 2023-10-05T21:16:19.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.185+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94091057050032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348084340 con 0x7fedc0030060 2023-10-05T21:16:19.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.185+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348084be0 con 0x55934804c980 2023-10-05T21:16:19.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.186+0000 7fedcf2b4700 1 -- 172.21.15.153:0/4072381494 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94091057050032] v31'247 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fedc4012450 con 0x7fedc0030060 2023-10-05T21:16:19.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.186+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v31'246 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.186+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94091057053264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348084be0 con 0x55934804c980 2023-10-05T21:16:19.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.186+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480857c0 con 0x55934807be40 2023-10-05T21:16:19.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.187+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v31'246 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fedc0058040 con 0x55934807be40 2023-10-05T21:16:19.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.187+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94091057053264] v31'247 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.187+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94091057055472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348084b40 con 0x55934807be40 2023-10-05T21:16:19.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.187+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480865a0 con 0x7fedc0030060 2023-10-05T21:16:19.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.188+0000 7fedcf2b4700 1 -- 172.21.15.153:0/4072381494 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v31'246 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fedc4012450 con 0x7fedc0030060 2023-10-05T21:16:19.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.188+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94091057055472] v31'247 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fedc0058040 con 0x55934807be40 2023-10-05T21:16:19.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.188+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94091057060800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348086950 con 0x7fedc0030060 2023-10-05T21:16:19.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.188+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348087360 con 0x55934804c980 2023-10-05T21:16:19.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.189+0000 7fedcf2b4700 1 -- 172.21.15.153:0/4072381494 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94091057060800] v31'247 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fedc4012450 con 0x7fedc0030060 2023-10-05T21:16:19.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.189+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v31'246 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.189+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94091057065584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480877b0 con 0x55934804c980 2023-10-05T21:16:19.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.189+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480881c0 con 0x7fedc4007030 2023-10-05T21:16:19.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.190+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94091057065584] v31'247 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.190+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v31'246 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.190+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94091057067280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480881c0 con 0x7fedc4007030 2023-10-05T21:16:19.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.190+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348088bd0 con 0x7fedc4007030 2023-10-05T21:16:19.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.191+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(96 notify.6 [create] v31'246 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.191+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(95 notify.5 [watch watch cookie 94091057067280] v31'247 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.191+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94091057071840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348089020 con 0x7fedc4007030 2023-10-05T21:16:19.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.191+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480896b0 con 0x7fedc4007030 2023-10-05T21:16:19.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.192+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94091057071840] v31'247 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.192+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v31'246 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.192+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94091057072944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348088f80 con 0x7fedc4007030 2023-10-05T21:16:19.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.192+0000 7feddc9dd680 20 add_watcher() i=0 2023-10-05T21:16:19.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.192+0000 7feddc9dd680 20 add_watcher() i=1 2023-10-05T21:16:19.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.192+0000 7feddc9dd680 20 add_watcher() i=2 2023-10-05T21:16:19.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.192+0000 7feddc9dd680 20 add_watcher() i=3 2023-10-05T21:16:19.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.192+0000 7feddc9dd680 20 add_watcher() i=4 2023-10-05T21:16:19.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.192+0000 7feddc9dd680 20 add_watcher() i=5 2023-10-05T21:16:19.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.192+0000 7feddc9dd680 20 add_watcher() i=6 2023-10-05T21:16:19.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.193+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94091057072944] v31'247 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.193+0000 7feddc9dd680 20 add_watcher() i=7 2023-10-05T21:16:19.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.193+0000 7feddc9dd680 2 all 8 watchers are set, enabling cache 2023-10-05T21:16:19.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.193+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55934808cbd0 con 0x55934804c980 2023-10-05T21:16:19.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.193+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.193+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94091057075888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348089ff0 con 0x55934804c980 2023-10-05T21:16:19.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.194+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94091057075888] v31'235 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.194+0000 7feda17e2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:16:19.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.194+0000 7feddc9dd680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:16:19.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.194+0000 7feddc9dd680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:16:19.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.194+0000 7feddc9dd680 1 Processor -- start 2023-10-05T21:16:19.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.194+0000 7feddc9dd680 1 -- start start 2023-10-05T21:16:19.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.194+0000 7feddc9dd680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5593480966b0 0x559348096ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.194+0000 7feddc9dd680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593480970d0 con 0x5593480966b0 2023-10-05T21:16:19.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.195+0000 7fedcf2b4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5593480966b0 0x559348096ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.195+0000 7fedcf2b4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5593480966b0 0x559348096ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:53136/0 (socket says 172.21.15.153:53136) 2023-10-05T21:16:19.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.195+0000 7fedcf2b4700 1 -- 172.21.15.153:0/1686366550 learned_addr learned my addr 172.21.15.153:0/1686366550 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:19.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.195+0000 7fedcf2b4700 1 -- 172.21.15.153:0/1686366550 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593480975b0 con 0x5593480966b0 2023-10-05T21:16:19.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.195+0000 7fedcf2b4700 1 --2- 172.21.15.153:0/1686366550 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5593480966b0 0x559348096ac0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x55934804a5c0 tx=0x7fedc4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51f5f50c8db7bed server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.195+0000 7feda0fe1700 1 -- 172.21.15.153:0/1686366550 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fedc402a440 con 0x5593480966b0 2023-10-05T21:16:19.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.195+0000 7feda0fe1700 1 -- 172.21.15.153:0/1686366550 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc4030040 con 0x5593480966b0 2023-10-05T21:16:19.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.195+0000 7feda0fe1700 1 -- 172.21.15.153:0/1686366550 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fedc402a780 con 0x5593480966b0 2023-10-05T21:16:19.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.196+0000 7feddc9dd680 1 -- 172.21.15.153:0/1686366550 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5593480966b0 msgr2=0x559348096ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.196+0000 7feddc9dd680 1 --2- 172.21.15.153:0/1686366550 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5593480966b0 0x559348096ac0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x55934804a5c0 tx=0x7fedc4011000 comp rx=0 tx=0).stop 2023-10-05T21:16:19.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.196+0000 7feddc9dd680 1 -- 172.21.15.153:0/1686366550 shutdown_connections 2023-10-05T21:16:19.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.196+0000 7feddc9dd680 1 --2- 172.21.15.153:0/1686366550 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5593480966b0 0x559348096ac0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.196+0000 7feddc9dd680 1 -- 172.21.15.153:0/1686366550 >> 172.21.15.153:0/1686366550 conn(0x5593480929b0 msgr2=0x559348090ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:19.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.196+0000 7feddc9dd680 1 -- 172.21.15.153:0/1686366550 shutdown_connections 2023-10-05T21:16:19.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.196+0000 7feddc9dd680 1 -- 172.21.15.153:0/1686366550 wait complete. 2023-10-05T21:16:19.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.196+0000 7feddc9dd680 1 Processor -- start 2023-10-05T21:16:19.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.197+0000 7feddc9dd680 1 -- start start 2023-10-05T21:16:19.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.197+0000 7feddc9dd680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5593480966b0 0x55934809d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.197+0000 7feddc9dd680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55934809d840 con 0x5593480966b0 2023-10-05T21:16:19.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.197+0000 7fedcf2b4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5593480966b0 0x55934809d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.197+0000 7fedcf2b4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5593480966b0 0x55934809d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:53140/0 (socket says 172.21.15.153:53140) 2023-10-05T21:16:19.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.197+0000 7fedcf2b4700 1 -- 172.21.15.153:0/3952370577 learned_addr learned my addr 172.21.15.153:0/3952370577 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:19.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.197+0000 7fedcf2b4700 1 -- 172.21.15.153:0/3952370577 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593480502b0 con 0x5593480966b0 2023-10-05T21:16:19.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.198+0000 7fedcf2b4700 1 --2- 172.21.15.153:0/3952370577 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5593480966b0 0x55934809d300 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fedc4036040 tx=0x7fedc402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.198+0000 7fed1affd700 1 -- 172.21.15.153:0/3952370577 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fedc4009430 con 0x5593480966b0 2023-10-05T21:16:19.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.198+0000 7fed1affd700 1 -- 172.21.15.153:0/3952370577 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc4042070 con 0x5593480966b0 2023-10-05T21:16:19.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.198+0000 7feddc9dd680 1 -- 172.21.15.153:0/3952370577 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55934809da40 con 0x5593480966b0 2023-10-05T21:16:19.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.198+0000 7fed1affd700 1 -- 172.21.15.153:0/3952370577 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fedc4009730 con 0x5593480966b0 2023-10-05T21:16:19.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.198+0000 7feddc9dd680 1 -- 172.21.15.153:0/3952370577 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55934809def0 con 0x5593480966b0 2023-10-05T21:16:19.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.199+0000 7fed1affd700 1 -- 172.21.15.153:0/3952370577 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fedc4009890 con 0x5593480966b0 2023-10-05T21:16:19.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.199+0000 7fed1affd700 1 --2- 172.21.15.153:0/3952370577 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fed10034140 0x7fed100365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.199+0000 7fed1affd700 1 -- 172.21.15.153:0/3952370577 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fedc4044070 con 0x5593480966b0 2023-10-05T21:16:19.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.199+0000 7fedd02b6700 1 --2- 172.21.15.153:0/3952370577 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fed10034140 0x7fed100365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.199+0000 7feddc9dd680 5 note: GC not initialized 2023-10-05T21:16:19.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.199+0000 7fedd02b6700 1 --2- 172.21.15.153:0/3952370577 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fed10034140 0x7fed100365f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x559348089150 tx=0x7fedc8037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.200+0000 7fed0ffff700 20 reqs_thread_entry: start 2023-10-05T21:16:19.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.200+0000 7fed0dffb700 20 reqs_thread_entry: start 2023-10-05T21:16:19.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.200+0000 7feddc9dd680 20 init_complete bucket index max shards: 11 2023-10-05T21:16:19.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.200+0000 7feddc9dd680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:16:19.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.200+0000 7fecfbfff700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:16:49 2023 2023-10-05T21:16:19.228 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:16:19.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.200+0000 7fecfb7fe700 20 reqs_thread_entry: start 2023-10-05T21:16:19.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.200+0000 7feddc9dd680 20 get_system_obj_state: rctx=0x7ffe6da205b8 obj=default.rgw.meta:users.uid:fud state=0x559347efc240 s->prefetch_data=0 2023-10-05T21:16:19.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.200+0000 7feddc9dd680 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2023-10-05T21:16:19.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.200+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348102cf0 con 0x7fedc4007030 2023-10-05T21:16:19.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.201+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(102 fud [call,getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.201+0000 7feddc9dd680 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2023-10-05T21:16:19.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.201+0000 7feddc9dd680 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T21:16:19.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.201+0000 7feddc9dd680 20 get_system_obj_state: rctx=0x7ffe6da202a8 obj=default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ state=0x559347efc240 s->prefetch_data=0 2023-10-05T21:16:19.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.201+0000 7feddc9dd680 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2023-10-05T21:16:19.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.201+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:103 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348101ce0 con 0x7fedc4007030 2023-10-05T21:16:19.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.201+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(103 p5YnriCv1nAtykxBrupQ [getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.201+0000 7feddc9dd680 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2023-10-05T21:16:19.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.201+0000 7feddc9dd680 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-10-05T21:16:19.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.201+0000 7feddc9dd680 20 get_system_obj_state: rctx=0x7ffe6da1fb38 obj=default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ state=0x559347efc240 s->prefetch_data=0 2023-10-05T21:16:19.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.201+0000 7feddc9dd680 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2023-10-05T21:16:19.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.201+0000 7feddc9dd680 20 get_system_obj_state: rctx=0x7ffe6da201e8 obj=default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ state=0x559347efc240 s->prefetch_data=0 2023-10-05T21:16:19.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.201+0000 7feddc9dd680 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2023-10-05T21:16:19.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.201+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:104 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593481051d0 con 0x7fedc4007030 2023-10-05T21:16:19.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.202+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(104 fud [delete,create,call,writefull 0~346] v31'8 uv8 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.202+0000 7feddc9dd680 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2023-10-05T21:16:19.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.202+0000 7feddc9dd680 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T21:16:19.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.202+0000 7feddc9dd680 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2023-10-05T21:16:19.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.202+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:105 7.3 7:c609908c:::notify.5:head [notify cookie 94091057580992 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348105eb0 con 0x7fedc4007030 2023-10-05T21:16:19.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.203+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== watch-notify(notify (1) cookie 94091057067280 notify 133143986207 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x7fedc802d040 con 0x7fedc4007030 2023-10-05T21:16:19.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.203+0000 7fedcdab1700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986207 cookie 94091057067280 notifier 4718 bl.length()=522 2023-10-05T21:16:19.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.203+0000 7fedcdab1700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2023-10-05T21:16:19.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.203+0000 7fedcdab1700 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T21:16:19.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.203+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 31 ==== osd_op_reply(105 notify.5 [notify cookie 94091057580992 out=8b] v0'0 uv246 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.203+0000 7fedcdab1700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fedb0003d90 con 0x7fedc4007030 2023-10-05T21:16:19.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.203+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 32 ==== osd_op_reply(106 notify.5 [notify-ack] v0'0 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.203+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 33 ==== watch-notify(notify_complete (2) cookie 94091057580992 notify 133143986207 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fedc8015430 con 0x7fedc4007030 2023-10-05T21:16:19.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.203+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:107 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348104bc0 con 0x7fedc4007030 2023-10-05T21:16:19.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.204+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 34 ==== osd_op_reply(107 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v31'9 uv9 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.204+0000 7feddc9dd680 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2023-10-05T21:16:19.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.204+0000 7feddc9dd680 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-10-05T21:16:19.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.204+0000 7feddc9dd680 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2023-10-05T21:16:19.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.204+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [notify cookie 94091057580992 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593481062f0 con 0x55934807be40 2023-10-05T21:16:19.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.204+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== watch-notify(notify (1) cookie 94091057055472 notify 133143986195 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x55934806f790 con 0x55934807be40 2023-10-05T21:16:19.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.204+0000 7fedcd2b0700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986195 cookie 94091057055472 notifier 4718 bl.length()=177 2023-10-05T21:16:19.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.204+0000 7fedcd2b0700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2023-10-05T21:16:19.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.204+0000 7fedcd2b0700 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-10-05T21:16:19.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.204+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(108 notify.2 [notify cookie 94091057580992 out=8b] v0'0 uv246 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fedc0058040 con 0x55934807be40 2023-10-05T21:16:19.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.204+0000 7fedcd2b0700 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:109 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fed20003450 con 0x55934807be40 2023-10-05T21:16:19.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.205+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(109 notify.2 [notify-ack] v0'0 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fedc0058040 con 0x55934807be40 2023-10-05T21:16:19.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.205+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== watch-notify(notify_complete (2) cookie 94091057580992 notify 133143986195 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55934806f2e0 con 0x55934807be40 2023-10-05T21:16:19.232 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:16:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "fud", 2023-10-05T21:16:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Fud", 2023-10-05T21:16:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "", 2023-10-05T21:16:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2023-10-05T21:16:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 4, 2023-10-05T21:16:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [], 2023-10-05T21:16:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2023-10-05T21:16:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:16:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "fud", 2023-10-05T21:16:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "p5YnriCv1nAtykxBrupQ", 2023-10-05T21:16:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh" 2023-10-05T21:16:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:16:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:16:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [], 2023-10-05T21:16:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2023-10-05T21:16:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2023-10-05T21:16:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2023-10-05T21:16:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2023-10-05T21:16:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2023-10-05T21:16:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:16:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:16:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:16:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:16:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:16:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:16:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2023-10-05T21:16:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:16:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:16:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:16:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:16:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:16:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:16:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2023-10-05T21:16:19.236 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2023-10-05T21:16:19.236 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [] 2023-10-05T21:16:19.236 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:16:19.236 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:16:19.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.205+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:110 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94091057050032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480c1380 con 0x7fedc0030060 2023-10-05T21:16:19.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.206+0000 7fedcf2b4700 1 -- 172.21.15.153:0/4072381494 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(110 notify.0 [watch unwatch cookie 94091057050032] v31'248 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fedc403a020 con 0x7fedc0030060 2023-10-05T21:16:19.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.206+0000 7feddc9dd680 20 remove_watcher() i=0 2023-10-05T21:16:19.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.206+0000 7feddc9dd680 2 removed watcher, disabling cache 2023-10-05T21:16:19.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.206+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:111 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94091057053264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480831b0 con 0x55934804c980 2023-10-05T21:16:19.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.207+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(111 notify.1 [watch unwatch cookie 94091057053264] v31'248 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.207+0000 7feddc9dd680 20 remove_watcher() i=1 2023-10-05T21:16:19.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.207+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:112 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94091057055472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480831b0 con 0x55934807be40 2023-10-05T21:16:19.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.207+0000 7fedcfab5700 1 -- 172.21.15.153:0/4072381494 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(112 notify.2 [watch unwatch cookie 94091057055472] v31'248 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fedc0058040 con 0x55934807be40 2023-10-05T21:16:19.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.208+0000 7feddc9dd680 20 remove_watcher() i=2 2023-10-05T21:16:19.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.208+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:113 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94091057060800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480846f0 con 0x7fedc0030060 2023-10-05T21:16:19.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.208+0000 7fedcf2b4700 1 -- 172.21.15.153:0/4072381494 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(113 notify.3 [watch unwatch cookie 94091057060800] v31'248 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fedc403a020 con 0x7fedc0030060 2023-10-05T21:16:19.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.208+0000 7feddc9dd680 20 remove_watcher() i=3 2023-10-05T21:16:19.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.208+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:114 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94091057065584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480831b0 con 0x55934804c980 2023-10-05T21:16:19.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.209+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(114 notify.4 [watch unwatch cookie 94091057065584] v31'248 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.209+0000 7feddc9dd680 20 remove_watcher() i=4 2023-10-05T21:16:19.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.209+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:115 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94091057067280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5593480846f0 con 0x7fedc4007030 2023-10-05T21:16:19.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.210+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 35 ==== osd_op_reply(115 notify.5 [watch unwatch cookie 94091057067280] v31'248 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.210+0000 7feddc9dd680 20 remove_watcher() i=5 2023-10-05T21:16:19.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.210+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:116 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94091057071840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348086e70 con 0x7fedc4007030 2023-10-05T21:16:19.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.211+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 36 ==== osd_op_reply(116 notify.6 [watch unwatch cookie 94091057071840] v31'248 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.211+0000 7feddc9dd680 20 remove_watcher() i=6 2023-10-05T21:16:19.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.211+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:117 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94091057072944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348086e70 con 0x7fedc4007030 2023-10-05T21:16:19.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.212+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.0 v2:172.21.15.111:6800/111394 37 ==== osd_op_reply(117 notify.7 [watch unwatch cookie 94091057072944] v31'248 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fedc800a570 con 0x7fedc4007030 2023-10-05T21:16:19.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.212+0000 7feddc9dd680 20 remove_watcher() i=7 2023-10-05T21:16:19.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.212+0000 7feda17e2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:16:19.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.212+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:118 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94091057075888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559348086e70 con 0x55934804c980 2023-10-05T21:16:19.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.213+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(118 data_loggenerations_metadata [watch unwatch cookie 94091057075888] v31'236 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fedc800a570 con 0x55934804c980 2023-10-05T21:16:19.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.213+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fedc4007030 msgr2=0x7fedc401c920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.213+0000 7feddc9dd680 1 --2- 172.21.15.153:0/4072381494 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fedc4007030 0x7fedc401c920 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.213+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55934804c980 msgr2=0x559348079a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.213+0000 7feddc9dd680 1 --2- 172.21.15.153:0/4072381494 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55934804c980 0x559348079a20 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.213+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fedc0030060 msgr2=0x7fedc00427a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.213+0000 7feddc9dd680 1 --2- 172.21.15.153:0/4072381494 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fedc0030060 0x7fedc00427a0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.213+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55934807be40 msgr2=0x55934807e220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.213+0000 7feddc9dd680 1 --2- 172.21.15.153:0/4072381494 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55934807be40 0x55934807e220 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.213+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fedbc0340d0 msgr2=0x7fedbc036580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.213+0000 7feddc9dd680 1 --2- 172.21.15.153:0/4072381494 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fedbc0340d0 0x7fedbc036580 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fedc4005b50 tx=0x7fedc4015000 comp rx=0 tx=0).stop 2023-10-05T21:16:19.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.213+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559348048940 msgr2=0x55934806eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.213+0000 7fedd02b6700 1 -- 172.21.15.153:0/4072381494 reap_dead start 2023-10-05T21:16:19.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.213+0000 7feddc9dd680 1 --2- 172.21.15.153:0/4072381494 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559348048940 0x55934806eda0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fedc0003000 tx=0x7fedc0016000 comp rx=0 tx=0).stop 2023-10-05T21:16:19.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.214+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 shutdown_connections 2023-10-05T21:16:19.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.214+0000 7feddc9dd680 1 --2- 172.21.15.153:0/4072381494 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559348048940 0x55934806eda0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.214+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 >> 172.21.15.153:0/4072381494 conn(0x559348043340 msgr2=0x559348061c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:19.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.214+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 shutdown_connections 2023-10-05T21:16:19.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.214+0000 7feddc9dd680 1 -- 172.21.15.153:0/4072381494 wait complete. 2023-10-05T21:16:19.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.214+0000 7feddc9dd680 1 -- 172.21.15.153:0/3952370577 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fed10034140 msgr2=0x7fed100365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.214+0000 7feddc9dd680 1 --2- 172.21.15.153:0/3952370577 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fed10034140 0x7fed100365f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x559348089150 tx=0x7fedc8037450 comp rx=0 tx=0).stop 2023-10-05T21:16:19.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.214+0000 7feddc9dd680 1 -- 172.21.15.153:0/3952370577 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5593480966b0 msgr2=0x55934809d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.214+0000 7feddc9dd680 1 --2- 172.21.15.153:0/3952370577 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5593480966b0 0x55934809d300 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fedc4036040 tx=0x7fedc402c000 comp rx=0 tx=0).stop 2023-10-05T21:16:19.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.214+0000 7feddc9dd680 1 -- 172.21.15.153:0/3952370577 shutdown_connections 2023-10-05T21:16:19.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.214+0000 7feddc9dd680 1 --2- 172.21.15.153:0/3952370577 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fed10034140 0x7fed100365f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.214+0000 7feddc9dd680 1 --2- 172.21.15.153:0/3952370577 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5593480966b0 0x55934809d300 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.214+0000 7feddc9dd680 1 -- 172.21.15.153:0/3952370577 >> 172.21.15.153:0/3952370577 conn(0x5593480929b0 msgr2=0x559348090a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:19.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.214+0000 7feddc9dd680 1 -- 172.21.15.153:0/3952370577 shutdown_connections 2023-10-05T21:16:19.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.214+0000 7feddc9dd680 1 -- 172.21.15.153:0/3952370577 wait complete. 2023-10-05T21:16:19.246 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:16:19.257 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2023-10-05T21:16:19.262 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2023-10-05T21:16:19.262 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2023-10-05T21:16:19.262 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2023-10-05T21:16:19.262 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2023-10-05T21:16:19.309 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:16:19.309 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:16:19.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.307+0000 7f64ad2a9680 1 Processor -- start 2023-10-05T21:16:19.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.307+0000 7f64ad2a9680 1 -- start start 2023-10-05T21:16:19.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.307+0000 7f64ad2a9680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x556faa7162c0 0x556faa7166d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.307+0000 7f64ad2a9680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556faa664930 con 0x556faa716c10 2023-10-05T21:16:19.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.307+0000 7f64ad2a9680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x556faa624db0 con 0x556faa7162c0 2023-10-05T21:16:19.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.308+0000 7f64a0381700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x556faa7162c0 0x556faa7166d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.308+0000 7f64a0381700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x556faa7162c0 0x556faa7166d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:53154/0 (socket says 172.21.15.153:53154) 2023-10-05T21:16:19.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.308+0000 7f64a0381700 1 -- 172.21.15.153:0/709598647 learned_addr learned my addr 172.21.15.153:0/709598647 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:19.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.308+0000 7f649fb80700 1 --1- 172.21.15.153:0/709598647 >> v1:172.21.15.111:6789/0 conn(0x556faa716c10 0x556faa717600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:38812/0 (socket says 172.21.15.153:38812) 2023-10-05T21:16:19.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.308+0000 7f64a0381700 1 -- 172.21.15.153:0/709598647 >> v1:172.21.15.111:6789/0 conn(0x556faa716c10 legacy=0x556faa717600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.308+0000 7f64a0381700 1 -- 172.21.15.153:0/709598647 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556faa717eb0 con 0x556faa7162c0 2023-10-05T21:16:19.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.308+0000 7f64a0381700 1 --2- 172.21.15.153:0/709598647 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556faa7162c0 0x556faa7166d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f649400a760 tx=0x7f6494005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6da6f500246e3d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.308+0000 7f649f37f700 1 -- 172.21.15.153:0/709598647 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f649400f070 con 0x556faa7162c0 2023-10-05T21:16:19.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.308+0000 7f649f37f700 1 -- 172.21.15.153:0/709598647 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f649400a2e0 con 0x556faa7162c0 2023-10-05T21:16:19.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.308+0000 7f649f37f700 1 -- 172.21.15.153:0/709598647 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f64940085b0 con 0x556faa7162c0 2023-10-05T21:16:19.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.309+0000 7f64ad2a9680 1 -- 172.21.15.153:0/709598647 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556faa7162c0 msgr2=0x556faa7166d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.309+0000 7f64ad2a9680 1 --2- 172.21.15.153:0/709598647 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556faa7162c0 0x556faa7166d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f649400a760 tx=0x7f6494005b10 comp rx=0 tx=0).stop 2023-10-05T21:16:19.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.309+0000 7f64ad2a9680 1 -- 172.21.15.153:0/709598647 shutdown_connections 2023-10-05T21:16:19.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.309+0000 7f64ad2a9680 1 --2- 172.21.15.153:0/709598647 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556faa7162c0 0x556faa7166d0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.309+0000 7f64ad2a9680 1 -- 172.21.15.153:0/709598647 >> 172.21.15.153:0/709598647 conn(0x556faa711b90 msgr2=0x556faa713fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:19.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.309+0000 7f64ad2a9680 1 -- 172.21.15.153:0/709598647 shutdown_connections 2023-10-05T21:16:19.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.309+0000 7f64ad2a9680 1 -- 172.21.15.153:0/709598647 wait complete. 2023-10-05T21:16:19.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.310+0000 7f64ad2a9680 1 Processor -- start 2023-10-05T21:16:19.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.310+0000 7f64ad2a9680 1 -- start start 2023-10-05T21:16:19.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.310+0000 7f64ad2a9680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556faa7162c0 0x556faa738af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.310+0000 7f64ad2a9680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x556faa5c4ea0 con 0x556faa7162c0 2023-10-05T21:16:19.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.310+0000 7f64a0381700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556faa7162c0 0x556faa738af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.310+0000 7f64a0381700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556faa7162c0 0x556faa738af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:53162/0 (socket says 172.21.15.153:53162) 2023-10-05T21:16:19.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.310+0000 7f64a0381700 1 -- 172.21.15.153:0/1540003771 learned_addr learned my addr 172.21.15.153:0/1540003771 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:19.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.310+0000 7f64a0381700 1 -- 172.21.15.153:0/1540003771 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6494005db0 con 0x556faa7162c0 2023-10-05T21:16:19.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.310+0000 7f64a0381700 1 --2- 172.21.15.153:0/1540003771 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556faa7162c0 0x556faa738af0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x556faa717e80 tx=0x7f6494018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148274d7af80a521 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.311+0000 7f649e37d700 1 -- 172.21.15.153:0/1540003771 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6494005c10 con 0x556faa7162c0 2023-10-05T21:16:19.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.311+0000 7f649e37d700 1 -- 172.21.15.153:0/1540003771 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f649401d440 con 0x556faa7162c0 2023-10-05T21:16:19.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.311+0000 7f649e37d700 1 -- 172.21.15.153:0/1540003771 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f649401d710 con 0x556faa7162c0 2023-10-05T21:16:19.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.311+0000 7f64ad2a9680 1 -- 172.21.15.153:0/1540003771 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556faa7162c0 msgr2=0x556faa738af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.311+0000 7f64ad2a9680 1 --2- 172.21.15.153:0/1540003771 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556faa7162c0 0x556faa738af0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x556faa717e80 tx=0x7f6494018000 comp rx=0 tx=0).stop 2023-10-05T21:16:19.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.311+0000 7f64ad2a9680 1 -- 172.21.15.153:0/1540003771 shutdown_connections 2023-10-05T21:16:19.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.311+0000 7f64ad2a9680 1 --2- 172.21.15.153:0/1540003771 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556faa7162c0 0x556faa738af0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.311+0000 7f64ad2a9680 1 -- 172.21.15.153:0/1540003771 >> 172.21.15.153:0/1540003771 conn(0x556faa711b90 msgr2=0x556faa7301b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:19.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.311+0000 7f64ad2a9680 1 -- 172.21.15.153:0/1540003771 shutdown_connections 2023-10-05T21:16:19.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.311+0000 7f64ad2a9680 1 -- 172.21.15.153:0/1540003771 wait complete. 2023-10-05T21:16:19.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.311+0000 7f64ad2a9680 1 Processor -- start 2023-10-05T21:16:19.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.311+0000 7f64ad2a9680 1 -- start start 2023-10-05T21:16:19.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.312+0000 7f64ad2a9680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556faa7162c0 0x556faa73ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.312+0000 7f64ad2a9680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x556faa5bbc80 con 0x556faa7162c0 2023-10-05T21:16:19.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.312+0000 7f64a0381700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556faa7162c0 0x556faa73ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.312+0000 7f64a0381700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556faa7162c0 0x556faa73ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:53168/0 (socket says 172.21.15.153:53168) 2023-10-05T21:16:19.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.312+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 learned_addr learned my addr 172.21.15.153:0/646833253 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:19.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.312+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556faa717eb0 con 0x556faa7162c0 2023-10-05T21:16:19.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.312+0000 7f64a0381700 1 --2- 172.21.15.153:0/646833253 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556faa7162c0 0x556faa73ff40 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6494003010 tx=0x7f649401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.312+0000 7f649cb7a700 1 -- 172.21.15.153:0/646833253 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6494026650 con 0x556faa7162c0 2023-10-05T21:16:19.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.312+0000 7f649cb7a700 1 -- 172.21.15.153:0/646833253 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64940267b0 con 0x556faa7162c0 2023-10-05T21:16:19.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.312+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556faa740480 con 0x556faa7162c0 2023-10-05T21:16:19.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.312+0000 7f649cb7a700 1 -- 172.21.15.153:0/646833253 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6494026a80 con 0x556faa7162c0 2023-10-05T21:16:19.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.312+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556faa740870 con 0x556faa7162c0 2023-10-05T21:16:19.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.313+0000 7f649cb7a700 1 -- 172.21.15.153:0/646833253 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f6494024070 con 0x556faa7162c0 2023-10-05T21:16:19.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.313+0000 7f649cb7a700 1 --2- 172.21.15.153:0/646833253 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f648c034140 0x7f648c0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.313+0000 7f649cb7a700 1 -- 172.21.15.153:0/646833253 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f6494048da0 con 0x556faa7162c0 2023-10-05T21:16:19.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.313+0000 7f649fb80700 1 --2- 172.21.15.153:0/646833253 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f648c034140 0x7f648c0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.314+0000 7f64ad2a9680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.314+0000 7f64ad2a9680 1 --2- 172.21.15.153:0/646833253 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x556faa749bf0 0x556faa74c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.314+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa74c7f0 con 0x556faa749bf0 2023-10-05T21:16:19.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.314+0000 7f649fb80700 1 --2- 172.21.15.153:0/646833253 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f648c034140 0x7f648c0365f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6490001e70 tx=0x7f6490001390 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.314+0000 7f64a0b82700 1 --2- 172.21.15.153:0/646833253 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x556faa749bf0 0x556faa74c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.314+0000 7f64a0b82700 1 --2- 172.21.15.153:0/646833253 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x556faa749bf0 0x556faa74c060 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.314+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.314+0000 7f64ad2a9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.314+0000 7f64ad2a9680 20 realm 2023-10-05T21:16:19.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.314+0000 7f64ad2a9680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.315+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa749210 con 0x556faa749bf0 2023-10-05T21:16:19.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.315+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.315+0000 7f64ad2a9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.315+0000 7f64ad2a9680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:16:19.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.315+0000 7f64ad2a9680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.315+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa74d2a0 con 0x556faa749bf0 2023-10-05T21:16:19.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.315+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.315+0000 7f64ad2a9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.315+0000 7f64ad2a9680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.315+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa74dbc0 con 0x556faa749bf0 2023-10-05T21:16:19.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.315+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.315+0000 7f64ad2a9680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:19.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.315+0000 7f64ad2a9680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.315+0000 7f64ad2a9680 1 --2- 172.21.15.153:0/646833253 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x556faa74e480 0x556faa750860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.315+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa750eb0 con 0x556faa74e480 2023-10-05T21:16:19.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.315+0000 7f64a0381700 1 --2- 172.21.15.153:0/646833253 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x556faa74e480 0x556faa750860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.316+0000 7f64a0381700 1 --2- 172.21.15.153:0/646833253 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x556faa74e480 0x556faa750860 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.316+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f649402c070 con 0x556faa74e480 2023-10-05T21:16:19.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.316+0000 7f64ad2a9680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:16:19.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.316+0000 7f64ad2a9680 20 searching for the correct realm 2023-10-05T21:16:19.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.316+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa752760 con 0x556faa74e480 2023-10-05T21:16:19.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.316+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649402c070 con 0x556faa74e480 2023-10-05T21:16:19.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.316+0000 7f64a0381700 1 --2- 172.21.15.153:0/646833253 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f6494026c30 0x7f64940125c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.316+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa752760 con 0x7f6494026c30 2023-10-05T21:16:19.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.316+0000 7f649fb80700 1 --2- 172.21.15.153:0/646833253 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f6494026c30 0x7f64940125c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.317+0000 7f649fb80700 1 --2- 172.21.15.153:0/646833253 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f6494026c30 0x7f64940125c0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.317+0000 7f649fb80700 1 -- 172.21.15.153:0/646833253 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649000f560 con 0x7f6494026c30 2023-10-05T21:16:19.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.317+0000 7f649fb80700 1 --2- 172.21.15.153:0/646833253 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f649000e8c0 0x7f649000d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.317+0000 7f649fb80700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa752760 con 0x7f649000e8c0 2023-10-05T21:16:19.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.317+0000 7f64a0b82700 1 --2- 172.21.15.153:0/646833253 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f649000e8c0 0x7f649000d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.318+0000 7f64a0b82700 1 --2- 172.21.15.153:0/646833253 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f649000e8c0 0x7f649000d310 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.318+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649800a570 con 0x7f649000e8c0 2023-10-05T21:16:19.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.318+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa752760 con 0x556faa749bf0 2023-10-05T21:16:19.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.318+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.318+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa752760 con 0x556faa749bf0 2023-10-05T21:16:19.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.318+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.318+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa752760 con 0x7f649000e8c0 2023-10-05T21:16:19.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.319+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649800a570 con 0x7f649000e8c0 2023-10-05T21:16:19.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.319+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa752760 con 0x7f649000e8c0 2023-10-05T21:16:19.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.319+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649800a570 con 0x7f649000e8c0 2023-10-05T21:16:19.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.319+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa752760 con 0x7f6494026c30 2023-10-05T21:16:19.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.319+0000 7f649fb80700 1 -- 172.21.15.153:0/646833253 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649000f560 con 0x7f6494026c30 2023-10-05T21:16:19.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.319+0000 7f649fb80700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa752760 con 0x556faa74e480 2023-10-05T21:16:19.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.319+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f649402c070 con 0x556faa74e480 2023-10-05T21:16:19.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.319+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa752760 con 0x556faa749bf0 2023-10-05T21:16:19.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.319+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.319+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa752760 con 0x7f649000e8c0 2023-10-05T21:16:19.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.320+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649800a570 con 0x7f649000e8c0 2023-10-05T21:16:19.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.320+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa752760 con 0x556faa749bf0 2023-10-05T21:16:19.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.320+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.320+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa752760 con 0x7f6494026c30 2023-10-05T21:16:19.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.320+0000 7f649fb80700 1 -- 172.21.15.153:0/646833253 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649000f560 con 0x7f6494026c30 2023-10-05T21:16:19.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.320+0000 7f649fb80700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f649001f040 con 0x556faa74e480 2023-10-05T21:16:19.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.320+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649402c070 con 0x556faa74e480 2023-10-05T21:16:19.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.320+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f649001f040 con 0x556faa74e480 2023-10-05T21:16:19.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.321+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649402c070 con 0x556faa74e480 2023-10-05T21:16:19.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.321+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f649001f040 con 0x7f649000e8c0 2023-10-05T21:16:19.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.321+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649800a570 con 0x7f649000e8c0 2023-10-05T21:16:19.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.321+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f649001f040 con 0x556faa74e480 2023-10-05T21:16:19.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.321+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649402c070 con 0x556faa74e480 2023-10-05T21:16:19.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.321+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f649001f040 con 0x556faa74e480 2023-10-05T21:16:19.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.321+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649402c070 con 0x556faa74e480 2023-10-05T21:16:19.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.321+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f649001f040 con 0x556faa749bf0 2023-10-05T21:16:19.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.322+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.322+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f649001f040 con 0x556faa749bf0 2023-10-05T21:16:19.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.322+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.322+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f649001f040 con 0x7f649000e8c0 2023-10-05T21:16:19.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.322+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649800a570 con 0x7f649000e8c0 2023-10-05T21:16:19.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.322+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f649001f040 con 0x556faa74e480 2023-10-05T21:16:19.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.322+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649402c070 con 0x556faa74e480 2023-10-05T21:16:19.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.322+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f649001f040 con 0x7f6494026c30 2023-10-05T21:16:19.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.322+0000 7f649fb80700 1 -- 172.21.15.153:0/646833253 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649000f560 con 0x7f6494026c30 2023-10-05T21:16:19.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.323+0000 7f649fb80700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f649001f040 con 0x556faa749bf0 2023-10-05T21:16:19.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.323+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.323+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f649001f040 con 0x7f649000e8c0 2023-10-05T21:16:19.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.323+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649800a570 con 0x7f649000e8c0 2023-10-05T21:16:19.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.323+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f649001f040 con 0x556faa74e480 2023-10-05T21:16:19.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.323+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649402c070 con 0x556faa74e480 2023-10-05T21:16:19.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.323+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f649001f040 con 0x7f649000e8c0 2023-10-05T21:16:19.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.324+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649800a570 con 0x7f649000e8c0 2023-10-05T21:16:19.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.324+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f649001f040 con 0x7f6494026c30 2023-10-05T21:16:19.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.324+0000 7f649fb80700 1 -- 172.21.15.153:0/646833253 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649000f560 con 0x7f6494026c30 2023-10-05T21:16:19.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.324+0000 7f649fb80700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f649001f040 con 0x556faa74e480 2023-10-05T21:16:19.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.324+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649402c070 con 0x556faa74e480 2023-10-05T21:16:19.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.324+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f649001f040 con 0x7f649000e8c0 2023-10-05T21:16:19.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.324+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649800a570 con 0x7f649000e8c0 2023-10-05T21:16:19.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.324+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f649001f040 con 0x556faa749bf0 2023-10-05T21:16:19.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.325+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.325+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f649001f040 con 0x7f6494026c30 2023-10-05T21:16:19.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.325+0000 7f649fb80700 1 -- 172.21.15.153:0/646833253 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649000f560 con 0x7f6494026c30 2023-10-05T21:16:19.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.325+0000 7f64ad2a9680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:16:19.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.325+0000 7f64ad2a9680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:16:19.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.325+0000 7f64ad2a9680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:16:19.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.325+0000 7f64ad2a9680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:16:19.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.325+0000 7f64ad2a9680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.325+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751900 con 0x556faa749bf0 2023-10-05T21:16:19.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.325+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.325+0000 7f64ad2a9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.325+0000 7f64ad2a9680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.325+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751530 con 0x556faa749bf0 2023-10-05T21:16:19.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.325+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.325+0000 7f64ad2a9680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:19.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.325+0000 7f64ad2a9680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.325+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751de0 con 0x556faa749bf0 2023-10-05T21:16:19.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.325+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.325+0000 7f64ad2a9680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:16:19.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.325+0000 7f64ad2a9680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.325+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa753000 con 0x556faa74e480 2023-10-05T21:16:19.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.326+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f649402c070 con 0x556faa74e480 2023-10-05T21:16:19.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.326+0000 7f64ad2a9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.326+0000 7f64ad2a9680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.326+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa7533b0 con 0x556faa749bf0 2023-10-05T21:16:19.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.326+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.326+0000 7f64ad2a9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.326+0000 7f64ad2a9680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.326+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa7533b0 con 0x556faa749bf0 2023-10-05T21:16:19.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.326+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.326+0000 7f64ad2a9680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:19.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.326+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa7543c0 con 0x556faa74e480 2023-10-05T21:16:19.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.326+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649402c070 con 0x556faa74e480 2023-10-05T21:16:19.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.326+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa7543c0 con 0x7f6494026c30 2023-10-05T21:16:19.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.327+0000 7f649fb80700 1 -- 172.21.15.153:0/646833253 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649000f560 con 0x7f6494026c30 2023-10-05T21:16:19.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.327+0000 7f649fb80700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa7543c0 con 0x7f649000e8c0 2023-10-05T21:16:19.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.327+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649800a570 con 0x7f649000e8c0 2023-10-05T21:16:19.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.327+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751de0 con 0x556faa749bf0 2023-10-05T21:16:19.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.327+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.327+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751de0 con 0x556faa749bf0 2023-10-05T21:16:19.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.327+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.327+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751de0 con 0x7f649000e8c0 2023-10-05T21:16:19.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.328+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649800a570 con 0x7f649000e8c0 2023-10-05T21:16:19.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.328+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751de0 con 0x7f649000e8c0 2023-10-05T21:16:19.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.328+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649800a570 con 0x7f649000e8c0 2023-10-05T21:16:19.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.328+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751de0 con 0x7f6494026c30 2023-10-05T21:16:19.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.328+0000 7f649fb80700 1 -- 172.21.15.153:0/646833253 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649000f560 con 0x7f6494026c30 2023-10-05T21:16:19.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.328+0000 7f649fb80700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751de0 con 0x556faa74e480 2023-10-05T21:16:19.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.329+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f649402c070 con 0x556faa74e480 2023-10-05T21:16:19.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.329+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751de0 con 0x556faa749bf0 2023-10-05T21:16:19.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.329+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.329+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751de0 con 0x7f649000e8c0 2023-10-05T21:16:19.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.329+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649800a570 con 0x7f649000e8c0 2023-10-05T21:16:19.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.329+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751de0 con 0x556faa749bf0 2023-10-05T21:16:19.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.329+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.329+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751de0 con 0x7f6494026c30 2023-10-05T21:16:19.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.329+0000 7f649fb80700 1 -- 172.21.15.153:0/646833253 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649000f560 con 0x7f6494026c30 2023-10-05T21:16:19.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.330+0000 7f649fb80700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751de0 con 0x556faa74e480 2023-10-05T21:16:19.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.330+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649402c070 con 0x556faa74e480 2023-10-05T21:16:19.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.330+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751de0 con 0x556faa74e480 2023-10-05T21:16:19.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.330+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649402c070 con 0x556faa74e480 2023-10-05T21:16:19.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.330+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751de0 con 0x7f649000e8c0 2023-10-05T21:16:19.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.330+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649800a570 con 0x7f649000e8c0 2023-10-05T21:16:19.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.330+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751de0 con 0x556faa74e480 2023-10-05T21:16:19.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.330+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649402c070 con 0x556faa74e480 2023-10-05T21:16:19.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.330+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751de0 con 0x556faa74e480 2023-10-05T21:16:19.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.331+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649402c070 con 0x556faa74e480 2023-10-05T21:16:19.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.331+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751de0 con 0x556faa749bf0 2023-10-05T21:16:19.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.331+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.331+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751de0 con 0x556faa749bf0 2023-10-05T21:16:19.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.331+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.331+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751de0 con 0x7f649000e8c0 2023-10-05T21:16:19.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.331+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649800a570 con 0x7f649000e8c0 2023-10-05T21:16:19.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.331+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751de0 con 0x556faa74e480 2023-10-05T21:16:19.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.332+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649402c070 con 0x556faa74e480 2023-10-05T21:16:19.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.332+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751de0 con 0x7f6494026c30 2023-10-05T21:16:19.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.332+0000 7f649fb80700 1 -- 172.21.15.153:0/646833253 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649000f560 con 0x7f6494026c30 2023-10-05T21:16:19.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.332+0000 7f649fb80700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751de0 con 0x556faa749bf0 2023-10-05T21:16:19.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.332+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.332+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751de0 con 0x7f649000e8c0 2023-10-05T21:16:19.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.332+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649800a570 con 0x7f649000e8c0 2023-10-05T21:16:19.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.332+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751de0 con 0x556faa74e480 2023-10-05T21:16:19.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.333+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649402c070 con 0x556faa74e480 2023-10-05T21:16:19.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.333+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751de0 con 0x7f649000e8c0 2023-10-05T21:16:19.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.333+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649800a570 con 0x7f649000e8c0 2023-10-05T21:16:19.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.333+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751de0 con 0x7f6494026c30 2023-10-05T21:16:19.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.333+0000 7f649fb80700 1 -- 172.21.15.153:0/646833253 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649000f560 con 0x7f6494026c30 2023-10-05T21:16:19.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.333+0000 7f649fb80700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751de0 con 0x556faa74e480 2023-10-05T21:16:19.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.333+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649402c070 con 0x556faa74e480 2023-10-05T21:16:19.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.333+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751de0 con 0x7f649000e8c0 2023-10-05T21:16:19.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.334+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649800a570 con 0x7f649000e8c0 2023-10-05T21:16:19.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.334+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751de0 con 0x556faa749bf0 2023-10-05T21:16:19.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.334+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.334+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa751de0 con 0x7f6494026c30 2023-10-05T21:16:19.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.334+0000 7f649fb80700 1 -- 172.21.15.153:0/646833253 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f649000f560 con 0x7f6494026c30 2023-10-05T21:16:19.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.334+0000 7f64ad2a9680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:16:19.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.334+0000 7f64ad2a9680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:16:19.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.334+0000 7f64ad2a9680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:16:19.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.334+0000 7f64ad2a9680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:16:19.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.334+0000 7f64ad2a9680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.334+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa7533b0 con 0x556faa749bf0 2023-10-05T21:16:19.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.334+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.334+0000 7f64ad2a9680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:19.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.334+0000 7f64ad2a9680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.334+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa753760 con 0x556faa74e480 2023-10-05T21:16:19.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.335+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f649402c070 con 0x556faa74e480 2023-10-05T21:16:19.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.335+0000 7f64ad2a9680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:16:19.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.335+0000 7f64ad2a9680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.335+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa754000 con 0x556faa749bf0 2023-10-05T21:16:19.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.335+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.335+0000 7f64ad2a9680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:19.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.335+0000 7f64ad2a9680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.335+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa754000 con 0x556faa749bf0 2023-10-05T21:16:19.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.335+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.335+0000 7f64ad2a9680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:16:19.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.335+0000 7f64ad2a9680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.335+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa754100 con 0x7f649000e8c0 2023-10-05T21:16:19.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.335+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f649800a570 con 0x7f649000e8c0 2023-10-05T21:16:19.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.335+0000 7f64ad2a9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.335+0000 7f64ad2a9680 20 zone default found 2023-10-05T21:16:19.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.335+0000 7f64ad2a9680 4 Realm: () 2023-10-05T21:16:19.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.335+0000 7f64ad2a9680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:16:19.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.335+0000 7f64ad2a9680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:16:19.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.335+0000 7f64ad2a9680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:16:19.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.335+0000 7f64ad2a9680 20 zonegroup default 2023-10-05T21:16:19.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.335+0000 7f64ad2a9680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.335+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa754100 con 0x7f649000e8c0 2023-10-05T21:16:19.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.336+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f649800a570 con 0x7f649000e8c0 2023-10-05T21:16:19.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.336+0000 7f64ad2a9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.336+0000 7f64ad2a9680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.336+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa755a80 con 0x556faa74e480 2023-10-05T21:16:19.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.336+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f649402c070 con 0x556faa74e480 2023-10-05T21:16:19.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.336+0000 7f64ad2a9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.336+0000 7f64ad2a9680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.336+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa755e30 con 0x556faa74e480 2023-10-05T21:16:19.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.336+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f649402c070 con 0x556faa74e480 2023-10-05T21:16:19.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.336+0000 7f64ad2a9680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.336+0000 7f64ad2a9680 20 started sync module instance, tier type = 2023-10-05T21:16:19.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.336+0000 7f64ad2a9680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:16:19.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.336+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa755190 con 0x7f6494026c30 2023-10-05T21:16:19.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.337+0000 7f649fb80700 1 -- 172.21.15.153:0/646833253 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v31'249 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f649000f560 con 0x7f6494026c30 2023-10-05T21:16:19.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.337+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93938089547152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa7566d0 con 0x7f6494026c30 2023-10-05T21:16:19.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.337+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa756f70 con 0x556faa749bf0 2023-10-05T21:16:19.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.338+0000 7f649fb80700 1 -- 172.21.15.153:0/646833253 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 93938089547152] v31'250 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f649000f560 con 0x7f6494026c30 2023-10-05T21:16:19.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.338+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v31'249 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.338+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93938089552512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa756320 con 0x556faa749bf0 2023-10-05T21:16:19.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.338+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa757be0 con 0x556faa74e480 2023-10-05T21:16:19.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.338+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 93938089552512] v31'250 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.339+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v31'249 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f649402c070 con 0x556faa74e480 2023-10-05T21:16:19.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.339+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93938089555568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa757fe0 con 0x556faa74e480 2023-10-05T21:16:19.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.339+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa7589f0 con 0x7f6494026c30 2023-10-05T21:16:19.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.339+0000 7f649fb80700 1 -- 172.21.15.153:0/646833253 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v31'249 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f649000f560 con 0x7f6494026c30 2023-10-05T21:16:19.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.339+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 93938089555568] v31'250 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f649402c070 con 0x556faa74e480 2023-10-05T21:16:19.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.339+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 93938089559296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa7592e0 con 0x7f6494026c30 2023-10-05T21:16:19.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.339+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa759b80 con 0x556faa749bf0 2023-10-05T21:16:19.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.340+0000 7f649fb80700 1 -- 172.21.15.153:0/646833253 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 93938089559296] v31'250 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f649000f560 con 0x7f6494026c30 2023-10-05T21:16:19.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.340+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v31'249 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.340+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 93938089563792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa759ae0 con 0x556faa749bf0 2023-10-05T21:16:19.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.340+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa75a9e0 con 0x7f649000e8c0 2023-10-05T21:16:19.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.341+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 93938089563792] v31'250 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.341+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v31'249 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f649800a570 con 0x7f649000e8c0 2023-10-05T21:16:19.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.341+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 93938089566000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa75a9a0 con 0x7f649000e8c0 2023-10-05T21:16:19.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.341+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa75b480 con 0x7f649000e8c0 2023-10-05T21:16:19.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.342+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(96 notify.6 [create] v31'249 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f649800a570 con 0x7f649000e8c0 2023-10-05T21:16:19.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.342+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(95 notify.5 [watch watch cookie 93938089566000] v31'250 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f649800a570 con 0x7f649000e8c0 2023-10-05T21:16:19.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.342+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93938089570128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa75b8f0 con 0x7f649000e8c0 2023-10-05T21:16:19.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.342+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa75c2d0 con 0x7f649000e8c0 2023-10-05T21:16:19.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.343+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 93938089570128] v31'250 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f649800a570 con 0x7f649000e8c0 2023-10-05T21:16:19.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.343+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v31'249 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f649800a570 con 0x7f649000e8c0 2023-10-05T21:16:19.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.343+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93938089571232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa75b8b0 con 0x7f649000e8c0 2023-10-05T21:16:19.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.343+0000 7f64ad2a9680 20 add_watcher() i=0 2023-10-05T21:16:19.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.343+0000 7f64ad2a9680 20 add_watcher() i=1 2023-10-05T21:16:19.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.343+0000 7f64ad2a9680 20 add_watcher() i=2 2023-10-05T21:16:19.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.343+0000 7f64ad2a9680 20 add_watcher() i=3 2023-10-05T21:16:19.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.343+0000 7f64ad2a9680 20 add_watcher() i=4 2023-10-05T21:16:19.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.343+0000 7f64ad2a9680 20 add_watcher() i=5 2023-10-05T21:16:19.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.343+0000 7f64ad2a9680 20 add_watcher() i=6 2023-10-05T21:16:19.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.344+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 93938089571232] v31'250 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f649800a570 con 0x7f649000e8c0 2023-10-05T21:16:19.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.344+0000 7f64ad2a9680 20 add_watcher() i=7 2023-10-05T21:16:19.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.344+0000 7f64ad2a9680 2 all 8 watchers are set, enabling cache 2023-10-05T21:16:19.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.344+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa75f390 con 0x556faa749bf0 2023-10-05T21:16:19.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.344+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.344+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93938089573856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa75c850 con 0x556faa749bf0 2023-10-05T21:16:19.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.345+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 93938089573856] v31'237 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.345+0000 7f6471fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:16:19.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.345+0000 7f64ad2a9680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:16:19.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.345+0000 7f64ad2a9680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:16:19.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.345+0000 7f64ad2a9680 1 Processor -- start 2023-10-05T21:16:19.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.345+0000 7f64ad2a9680 1 -- start start 2023-10-05T21:16:19.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.345+0000 7f64ad2a9680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556faa768ec0 0x556faa7692d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.346+0000 7f64ad2a9680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x556faa7698e0 con 0x556faa768ec0 2023-10-05T21:16:19.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.346+0000 7f649fb80700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556faa768ec0 0x556faa7692d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.346+0000 7f649fb80700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556faa768ec0 0x556faa7692d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:53182/0 (socket says 172.21.15.153:53182) 2023-10-05T21:16:19.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.346+0000 7f649fb80700 1 -- 172.21.15.153:0/4259476309 learned_addr learned my addr 172.21.15.153:0/4259476309 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:19.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.346+0000 7f649fb80700 1 -- 172.21.15.153:0/4259476309 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556faa769dc0 con 0x556faa768ec0 2023-10-05T21:16:19.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.346+0000 7f649fb80700 1 --2- 172.21.15.153:0/4259476309 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556faa768ec0 0x556faa7692d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x556faa74d8e0 tx=0x7f6490006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b3a32092671065 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.379 DEBUG:teuthology.orchestra.run:got remote process result: 17 2023-10-05T21:16:19.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.346+0000 7f64717e2700 1 -- 172.21.15.153:0/4259476309 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f649000da60 con 0x556faa768ec0 2023-10-05T21:16:19.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.346+0000 7f64717e2700 1 -- 172.21.15.153:0/4259476309 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f649000dbc0 con 0x556faa768ec0 2023-10-05T21:16:19.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.346+0000 7f64717e2700 1 -- 172.21.15.153:0/4259476309 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f649000dd70 con 0x556faa768ec0 2023-10-05T21:16:19.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.347+0000 7f64ad2a9680 1 -- 172.21.15.153:0/4259476309 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556faa768ec0 msgr2=0x556faa7692d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.347+0000 7f64ad2a9680 1 --2- 172.21.15.153:0/4259476309 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556faa768ec0 0x556faa7692d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x556faa74d8e0 tx=0x7f6490006000 comp rx=0 tx=0).stop 2023-10-05T21:16:19.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.347+0000 7f64ad2a9680 1 -- 172.21.15.153:0/4259476309 shutdown_connections 2023-10-05T21:16:19.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.347+0000 7f64ad2a9680 1 --2- 172.21.15.153:0/4259476309 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556faa768ec0 0x556faa7692d0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.347+0000 7f64ad2a9680 1 -- 172.21.15.153:0/4259476309 >> 172.21.15.153:0/4259476309 conn(0x556faa7651c0 msgr2=0x556faa7632c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:19.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.347+0000 7f64ad2a9680 1 -- 172.21.15.153:0/4259476309 shutdown_connections 2023-10-05T21:16:19.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.347+0000 7f64ad2a9680 1 -- 172.21.15.153:0/4259476309 wait complete. 2023-10-05T21:16:19.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.348+0000 7f64ad2a9680 1 Processor -- start 2023-10-05T21:16:19.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.348+0000 7f64ad2a9680 1 -- start start 2023-10-05T21:16:19.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.348+0000 7f64ad2a9680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556faa768ec0 0x556faa76fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.348+0000 7f64ad2a9680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x556faa7700e0 con 0x556faa768ec0 2023-10-05T21:16:19.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.348+0000 7f649fb80700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556faa768ec0 0x556faa76fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.348+0000 7f649fb80700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556faa768ec0 0x556faa76fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:53192/0 (socket says 172.21.15.153:53192) 2023-10-05T21:16:19.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.348+0000 7f649fb80700 1 -- 172.21.15.153:0/1239613339 learned_addr learned my addr 172.21.15.153:0/1239613339 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:19.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.348+0000 7f649fb80700 1 -- 172.21.15.153:0/1239613339 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6490006070 con 0x556faa768ec0 2023-10-05T21:16:19.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.349+0000 7f649fb80700 1 --2- 172.21.15.153:0/1239613339 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556faa768ec0 0x556faa76fba0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f649000f4b0 tx=0x7f6490032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.349+0000 7f63eb7fe700 1 -- 172.21.15.153:0/1239613339 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f649003d9f0 con 0x556faa768ec0 2023-10-05T21:16:19.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.349+0000 7f63eb7fe700 1 -- 172.21.15.153:0/1239613339 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f649003db50 con 0x556faa768ec0 2023-10-05T21:16:19.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.349+0000 7f64ad2a9680 1 -- 172.21.15.153:0/1239613339 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556faa7702e0 con 0x556faa768ec0 2023-10-05T21:16:19.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.349+0000 7f63eb7fe700 1 -- 172.21.15.153:0/1239613339 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f649003dd20 con 0x556faa768ec0 2023-10-05T21:16:19.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.349+0000 7f64ad2a9680 1 -- 172.21.15.153:0/1239613339 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556faa770730 con 0x556faa768ec0 2023-10-05T21:16:19.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.350+0000 7f63eb7fe700 1 -- 172.21.15.153:0/1239613339 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f649001a040 con 0x556faa768ec0 2023-10-05T21:16:19.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.350+0000 7f63eb7fe700 1 --2- 172.21.15.153:0/1239613339 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f63e0034140 0x7f63e00365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.350+0000 7f63eb7fe700 1 -- 172.21.15.153:0/1239613339 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f6490048c30 con 0x556faa768ec0 2023-10-05T21:16:19.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.350+0000 7f64a0b82700 1 --2- 172.21.15.153:0/1239613339 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f63e0034140 0x7f63e00365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.350+0000 7f64ad2a9680 5 note: GC not initialized 2023-10-05T21:16:19.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.350+0000 7f64a0b82700 1 --2- 172.21.15.153:0/1239613339 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f63e0034140 0x7f63e00365f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x556faa75bab0 tx=0x7f6498037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.351+0000 7f63e8ff9700 20 reqs_thread_entry: start 2023-10-05T21:16:19.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.351+0000 7f63de7fc700 20 reqs_thread_entry: start 2023-10-05T21:16:19.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.351+0000 7f64ad2a9680 20 init_complete bucket index max shards: 11 2023-10-05T21:16:19.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.351+0000 7f64ad2a9680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:16:19.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.351+0000 7f63dcff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:16:49 2023 2023-10-05T21:16:19.382 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:16:19.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.351+0000 7f63c3fff700 20 reqs_thread_entry: start 2023-10-05T21:16:19.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.352+0000 7f64ad2a9680 20 get_system_obj_state: rctx=0x7fff648de668 obj=default.rgw.meta:users.uid:bud state=0x556faa5ca240 s->prefetch_data=0 2023-10-05T21:16:19.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.352+0000 7f64ad2a9680 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2023-10-05T21:16:19.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.352+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:102 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa7d5480 con 0x7f6494026c30 2023-10-05T21:16:19.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.352+0000 7f649fb80700 1 -- 172.21.15.153:0/646833253 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(102 bud [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f649000f560 con 0x7f6494026c30 2023-10-05T21:16:19.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.352+0000 7f64ad2a9680 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x16 2023-10-05T21:16:19.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.352+0000 7f64ad2a9680 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2023-10-05T21:16:19.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.352+0000 7f64ad2a9680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:16:19.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.352+0000 7f64ad2a9680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:16:19.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.352+0000 7f64ad2a9680 20 Read xattr: user.rgw.idtag 2023-10-05T21:16:19.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.352+0000 7f64ad2a9680 10 cache get: name=default.rgw.meta+users.uid+bud : type miss (requested=0x13, cached=0x16) 2023-10-05T21:16:19.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.352+0000 7f64ad2a9680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.352+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:103 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa7d7a00 con 0x7f6494026c30 2023-10-05T21:16:19.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.352+0000 7f649fb80700 1 -- 172.21.15.153:0/646833253 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(103 bud [call,call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 273+0+469 (crc 0 0 0) 0x7f649000f560 con 0x7f6494026c30 2023-10-05T21:16:19.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.352+0000 7f64ad2a9680 20 rados_obj.operate() r=0 bl.length=346 2023-10-05T21:16:19.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.352+0000 7f64ad2a9680 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2023-10-05T21:16:19.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.352+0000 7f64ad2a9680 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2023-10-05T21:16:19.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.352+0000 7f64ad2a9680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:16:19.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.352+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:104 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~181 in=181b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa7d67b0 con 0x7f649000e8c0 2023-10-05T21:16:19.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.353+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(104 fud [create,call,writefull 0~181] v31'9 uv8 ondisk = -17 ((17) File exists)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f649800a570 con 0x7f649000e8c0 2023-10-05T21:16:19.384 INFO:teuthology.orchestra.run.smithi153.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2023-10-05T21:16:19.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.354+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93938089547152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa794160 con 0x7f6494026c30 2023-10-05T21:16:19.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.354+0000 7f649fb80700 1 -- 172.21.15.153:0/646833253 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(105 notify.0 [watch unwatch cookie 93938089547152] v31'251 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f649000f560 con 0x7f6494026c30 2023-10-05T21:16:19.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.354+0000 7f64ad2a9680 20 remove_watcher() i=0 2023-10-05T21:16:19.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.354+0000 7f64ad2a9680 2 removed watcher, disabling cache 2023-10-05T21:16:19.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.354+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93938089552512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa755590 con 0x556faa749bf0 2023-10-05T21:16:19.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.355+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(106 notify.1 [watch unwatch cookie 93938089552512] v31'251 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.355+0000 7f64ad2a9680 20 remove_watcher() i=1 2023-10-05T21:16:19.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.355+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93938089555568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa756a80 con 0x556faa74e480 2023-10-05T21:16:19.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.356+0000 7f64a0381700 1 -- 172.21.15.153:0/646833253 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(107 notify.2 [watch unwatch cookie 93938089555568] v31'251 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f649402c070 con 0x556faa74e480 2023-10-05T21:16:19.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.356+0000 7f64ad2a9680 20 remove_watcher() i=2 2023-10-05T21:16:19.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.356+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93938089559296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa756a80 con 0x7f6494026c30 2023-10-05T21:16:19.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.357+0000 7f649fb80700 1 -- 172.21.15.153:0/646833253 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(108 notify.3 [watch unwatch cookie 93938089559296] v31'251 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6490057040 con 0x7f6494026c30 2023-10-05T21:16:19.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.357+0000 7f64ad2a9680 20 remove_watcher() i=3 2023-10-05T21:16:19.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.357+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93938089563792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa756a80 con 0x556faa749bf0 2023-10-05T21:16:19.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.358+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(109 notify.4 [watch unwatch cookie 93938089563792] v31'251 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.358+0000 7f64ad2a9680 20 remove_watcher() i=4 2023-10-05T21:16:19.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.358+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93938089566000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa756a80 con 0x7f649000e8c0 2023-10-05T21:16:19.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.359+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(110 notify.5 [watch unwatch cookie 93938089566000] v31'251 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f649800a570 con 0x7f649000e8c0 2023-10-05T21:16:19.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.359+0000 7f64ad2a9680 20 remove_watcher() i=5 2023-10-05T21:16:19.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.359+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:111 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93938089570128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa759f30 con 0x7f649000e8c0 2023-10-05T21:16:19.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.360+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(111 notify.6 [watch unwatch cookie 93938089570128] v31'251 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f649800a570 con 0x7f649000e8c0 2023-10-05T21:16:19.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.360+0000 7f64ad2a9680 20 remove_watcher() i=6 2023-10-05T21:16:19.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.360+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93938089571232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa756a80 con 0x7f649000e8c0 2023-10-05T21:16:19.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.361+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(112 notify.7 [watch unwatch cookie 93938089571232] v31'251 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f649800a570 con 0x7f649000e8c0 2023-10-05T21:16:19.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.361+0000 7f64ad2a9680 20 remove_watcher() i=7 2023-10-05T21:16:19.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.361+0000 7f6471fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:16:19.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.361+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:113 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93938089573856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556faa756a80 con 0x556faa749bf0 2023-10-05T21:16:19.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.362+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(113 data_loggenerations_metadata [watch unwatch cookie 93938089573856] v31'238 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f649800a570 con 0x556faa749bf0 2023-10-05T21:16:19.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.362+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f649000e8c0 msgr2=0x7f649000d310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.362+0000 7f64ad2a9680 1 --2- 172.21.15.153:0/646833253 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f649000e8c0 0x7f649000d310 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.362+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x556faa749bf0 msgr2=0x556faa74c060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.362+0000 7f64ad2a9680 1 --2- 172.21.15.153:0/646833253 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x556faa749bf0 0x556faa74c060 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.362+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f6494026c30 msgr2=0x7f64940125c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.362+0000 7f64ad2a9680 1 --2- 172.21.15.153:0/646833253 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f6494026c30 0x7f64940125c0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.362+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x556faa74e480 msgr2=0x556faa750860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.362+0000 7f64ad2a9680 1 --2- 172.21.15.153:0/646833253 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x556faa74e480 0x556faa750860 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.362+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f648c034140 msgr2=0x7f648c0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.362+0000 7f64ad2a9680 1 --2- 172.21.15.153:0/646833253 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f648c034140 0x7f648c0365f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6490001e70 tx=0x7f6490001390 comp rx=0 tx=0).stop 2023-10-05T21:16:19.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.362+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556faa7162c0 msgr2=0x556faa73ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.362+0000 7f64ad2a9680 1 --2- 172.21.15.153:0/646833253 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556faa7162c0 0x556faa73ff40 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6494003010 tx=0x7f649401c000 comp rx=0 tx=0).stop 2023-10-05T21:16:19.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.362+0000 7f64a0b82700 1 -- 172.21.15.153:0/646833253 reap_dead start 2023-10-05T21:16:19.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.362+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 shutdown_connections 2023-10-05T21:16:19.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.362+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 >> 172.21.15.153:0/646833253 conn(0x556faa711b90 msgr2=0x556faa72e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:19.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.362+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 shutdown_connections 2023-10-05T21:16:19.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.362+0000 7f64ad2a9680 1 -- 172.21.15.153:0/646833253 wait complete. 2023-10-05T21:16:19.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.363+0000 7f64ad2a9680 1 -- 172.21.15.153:0/1239613339 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f63e0034140 msgr2=0x7f63e00365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.363+0000 7f64ad2a9680 1 --2- 172.21.15.153:0/1239613339 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f63e0034140 0x7f63e00365f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x556faa75bab0 tx=0x7f6498037450 comp rx=0 tx=0).stop 2023-10-05T21:16:19.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.363+0000 7f64ad2a9680 1 -- 172.21.15.153:0/1239613339 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556faa768ec0 msgr2=0x556faa76fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.363+0000 7f64ad2a9680 1 --2- 172.21.15.153:0/1239613339 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556faa768ec0 0x556faa76fba0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f649000f4b0 tx=0x7f6490032000 comp rx=0 tx=0).stop 2023-10-05T21:16:19.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.363+0000 7f64ad2a9680 1 -- 172.21.15.153:0/1239613339 shutdown_connections 2023-10-05T21:16:19.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.363+0000 7f64ad2a9680 1 --2- 172.21.15.153:0/1239613339 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f63e0034140 0x7f63e00365f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.363+0000 7f64ad2a9680 1 --2- 172.21.15.153:0/1239613339 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556faa768ec0 0x556faa76fba0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.363+0000 7f64ad2a9680 1 -- 172.21.15.153:0/1239613339 >> 172.21.15.153:0/1239613339 conn(0x556faa7651c0 msgr2=0x556faa763290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:19.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.363+0000 7f64ad2a9680 1 -- 172.21.15.153:0/1239613339 shutdown_connections 2023-10-05T21:16:19.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.363+0000 7f64ad2a9680 1 -- 172.21.15.153:0/1239613339 wait complete. 2023-10-05T21:16:19.434 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2023-10-05T21:16:19.435 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2023-10-05T21:16:19.438 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2023-10-05T21:16:19.438 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2023-10-05T21:16:19.439 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2023-10-05T21:16:19.439 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2023-10-05T21:16:19.439 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2023-10-05T21:16:19.484 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:16:19.484 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:16:19.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.482+0000 7faf190ef680 1 Processor -- start 2023-10-05T21:16:19.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.482+0000 7faf190ef680 1 -- start start 2023-10-05T21:16:19.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.482+0000 7faf190ef680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x564307126bf0 0x564307128fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.482+0000 7faf190ef680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56430706f930 con 0x5643071207c0 2023-10-05T21:16:19.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.482+0000 7faf190ef680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x56430702fdb0 con 0x564307126bf0 2023-10-05T21:16:19.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.483+0000 7faf0b9c6700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x564307126bf0 0x564307128fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.483+0000 7faf0c1c7700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x5643071207c0 0x564307120bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:38826/0 (socket says 172.21.15.153:38826) 2023-10-05T21:16:19.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.483+0000 7faf0c1c7700 1 -- 172.21.15.153:0/851888087 learned_addr learned my addr 172.21.15.153:0/851888087 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:16:19.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.483+0000 7faf0b9c6700 1 -- 172.21.15.153:0/851888087 >> v1:172.21.15.111:6789/0 conn(0x5643071207c0 legacy=0x564307120bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.483+0000 7faf0b9c6700 1 -- 172.21.15.153:0/851888087 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56430712a520 con 0x564307126bf0 2023-10-05T21:16:19.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.483+0000 7faf0b1c5700 1 -- 172.21.15.153:0/851888087 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1918316681 0 0) 0x56430706f930 con 0x5643071207c0 2023-10-05T21:16:19.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.483+0000 7faf0b9c6700 1 --2- 172.21.15.153:0/851888087 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564307126bf0 0x564307128fd0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7faefc00a5d0 tx=0x7faefc005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b27eb8c87411fe server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.483+0000 7faf0b1c5700 1 -- 172.21.15.153:0/851888087 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faefc0086a0 con 0x564307126bf0 2023-10-05T21:16:19.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.483+0000 7faf0b1c5700 1 -- 172.21.15.153:0/851888087 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc008800 con 0x564307126bf0 2023-10-05T21:16:19.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.483+0000 7faf0b1c5700 1 -- 172.21.15.153:0/851888087 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faefc008ad0 con 0x564307126bf0 2023-10-05T21:16:19.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.484+0000 7faf190ef680 1 -- 172.21.15.153:0/851888087 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564307126bf0 msgr2=0x564307128fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.484+0000 7faf190ef680 1 --2- 172.21.15.153:0/851888087 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564307126bf0 0x564307128fd0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7faefc00a5d0 tx=0x7faefc005a50 comp rx=0 tx=0).stop 2023-10-05T21:16:19.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.484+0000 7faf190ef680 1 -- 172.21.15.153:0/851888087 shutdown_connections 2023-10-05T21:16:19.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.484+0000 7faf190ef680 1 --2- 172.21.15.153:0/851888087 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564307126bf0 0x564307128fd0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.484+0000 7faf190ef680 1 -- 172.21.15.153:0/851888087 >> 172.21.15.153:0/851888087 conn(0x56430711c310 msgr2=0x56430711e720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:19.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.484+0000 7faf190ef680 1 -- 172.21.15.153:0/851888087 shutdown_connections 2023-10-05T21:16:19.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.484+0000 7faf190ef680 1 -- 172.21.15.153:0/851888087 wait complete. 2023-10-05T21:16:19.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.485+0000 7faf190ef680 1 Processor -- start 2023-10-05T21:16:19.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.485+0000 7faf190ef680 1 -- start start 2023-10-05T21:16:19.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.485+0000 7faf190ef680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5643071207c0 0x564307141940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.485+0000 7faf190ef680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x564306fcfea0 con 0x5643071207c0 2023-10-05T21:16:19.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.485+0000 7faf0c1c7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5643071207c0 0x564307141940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.485+0000 7faf0c1c7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5643071207c0 0x564307141940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:53202/0 (socket says 172.21.15.153:53202) 2023-10-05T21:16:19.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.485+0000 7faf0c1c7700 1 -- 172.21.15.153:0/1284944160 learned_addr learned my addr 172.21.15.153:0/1284944160 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:19.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.485+0000 7faf0c1c7700 1 -- 172.21.15.153:0/1284944160 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faefc005cf0 con 0x5643071207c0 2023-10-05T21:16:19.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.485+0000 7faf0c1c7700 1 --2- 172.21.15.153:0/1284944160 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5643071207c0 0x564307141940 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7faf00001dc0 tx=0x7faf00001790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4452cac91db4c5c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.486+0000 7faf0a1c3700 1 -- 172.21.15.153:0/1284944160 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf0000bce0 con 0x5643071207c0 2023-10-05T21:16:19.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.486+0000 7faf0a1c3700 1 -- 172.21.15.153:0/1284944160 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0000be40 con 0x5643071207c0 2023-10-05T21:16:19.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.486+0000 7faf0a1c3700 1 -- 172.21.15.153:0/1284944160 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf0000e5d0 con 0x5643071207c0 2023-10-05T21:16:19.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.486+0000 7faf190ef680 1 -- 172.21.15.153:0/1284944160 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5643071207c0 msgr2=0x564307141940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.486+0000 7faf190ef680 1 --2- 172.21.15.153:0/1284944160 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5643071207c0 0x564307141940 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7faf00001dc0 tx=0x7faf00001790 comp rx=0 tx=0).stop 2023-10-05T21:16:19.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.486+0000 7faf190ef680 1 -- 172.21.15.153:0/1284944160 shutdown_connections 2023-10-05T21:16:19.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.486+0000 7faf190ef680 1 --2- 172.21.15.153:0/1284944160 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5643071207c0 0x564307141940 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.486+0000 7faf190ef680 1 -- 172.21.15.153:0/1284944160 >> 172.21.15.153:0/1284944160 conn(0x56430711c310 msgr2=0x56430713d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:19.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.486+0000 7faf190ef680 1 -- 172.21.15.153:0/1284944160 shutdown_connections 2023-10-05T21:16:19.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.486+0000 7faf190ef680 1 -- 172.21.15.153:0/1284944160 wait complete. 2023-10-05T21:16:19.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.486+0000 7faf190ef680 1 Processor -- start 2023-10-05T21:16:19.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.486+0000 7faf190ef680 1 -- start start 2023-10-05T21:16:19.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.487+0000 7faf190ef680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5643071207c0 0x564307148e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.487+0000 7faf190ef680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x564306fc6c80 con 0x5643071207c0 2023-10-05T21:16:19.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.487+0000 7faf0c1c7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5643071207c0 0x564307148e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.487+0000 7faf0c1c7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5643071207c0 0x564307148e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:53212/0 (socket says 172.21.15.153:53212) 2023-10-05T21:16:19.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.487+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 learned_addr learned my addr 172.21.15.153:0/946936814 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:19.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.487+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf00001a70 con 0x5643071207c0 2023-10-05T21:16:19.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.487+0000 7faf0c1c7700 1 --2- 172.21.15.153:0/946936814 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5643071207c0 0x564307148e10 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7faf000017d0 tx=0x7faf00016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.487+0000 7faf089c0700 1 -- 172.21.15.153:0/946936814 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf0001f070 con 0x5643071207c0 2023-10-05T21:16:19.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.487+0000 7faf089c0700 1 -- 172.21.15.153:0/946936814 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0001a4d0 con 0x5643071207c0 2023-10-05T21:16:19.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.487+0000 7faf089c0700 1 -- 172.21.15.153:0/946936814 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf0001a7a0 con 0x5643071207c0 2023-10-05T21:16:19.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.487+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564307149350 con 0x5643071207c0 2023-10-05T21:16:19.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.488+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5643071497a0 con 0x5643071207c0 2023-10-05T21:16:19.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.488+0000 7faf089c0700 1 -- 172.21.15.153:0/946936814 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7faf0001a900 con 0x5643071207c0 2023-10-05T21:16:19.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.488+0000 7faf190ef680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.488+0000 7faf089c0700 1 --2- 172.21.15.153:0/946936814 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7faef80340f0 0x7faef80365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.488+0000 7faf089c0700 1 -- 172.21.15.153:0/946936814 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7faf000490c0 con 0x5643071207c0 2023-10-05T21:16:19.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.489+0000 7faf0b9c6700 1 --2- 172.21.15.153:0/946936814 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7faef80340f0 0x7faef80365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.489+0000 7faf190ef680 1 --2- 172.21.15.153:0/946936814 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x564307126bf0 0x564307154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.489+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307155330 con 0x564307126bf0 2023-10-05T21:16:19.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.489+0000 7faf0c9c8700 1 --2- 172.21.15.153:0/946936814 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x564307126bf0 0x564307154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.489+0000 7faf0b9c6700 1 --2- 172.21.15.153:0/946936814 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7faef80340f0 0x7faef80365a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faefc003080 tx=0x7faefc015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.489+0000 7faf0c9c8700 1 --2- 172.21.15.153:0/946936814 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x564307126bf0 0x564307154ba0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.489+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.489+0000 7faf190ef680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.489+0000 7faf190ef680 20 realm 2023-10-05T21:16:19.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.489+0000 7faf190ef680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.489+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307152180 con 0x564307126bf0 2023-10-05T21:16:19.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.490+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.490+0000 7faf190ef680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.490+0000 7faf190ef680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:16:19.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.490+0000 7faf190ef680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.490+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307155e30 con 0x564307126bf0 2023-10-05T21:16:19.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.490+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.490+0000 7faf190ef680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.490+0000 7faf190ef680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.490+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307156750 con 0x564307126bf0 2023-10-05T21:16:19.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.490+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.490+0000 7faf190ef680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:19.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.490+0000 7faf190ef680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.490+0000 7faf190ef680 1 --2- 172.21.15.153:0/946936814 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x564307157010 0x5643071593f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.490+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307159a40 con 0x564307157010 2023-10-05T21:16:19.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.490+0000 7faf0c1c7700 1 --2- 172.21.15.153:0/946936814 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x564307157010 0x5643071593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.490+0000 7faf0c1c7700 1 --2- 172.21.15.153:0/946936814 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x564307157010 0x5643071593f0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.491+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.491+0000 7faf190ef680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:16:19.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.491+0000 7faf190ef680 20 searching for the correct realm 2023-10-05T21:16:19.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.491+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x564307157010 2023-10-05T21:16:19.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.491+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.491+0000 7faf0c1c7700 1 --2- 172.21.15.153:0/946936814 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7faf0002d020 0x7faf0002c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.491+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x7faf0002d020 2023-10-05T21:16:19.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.491+0000 7faf0b9c6700 1 --2- 172.21.15.153:0/946936814 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7faf0002d020 0x7faf0002c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.491+0000 7faf0b9c6700 1 --2- 172.21.15.153:0/946936814 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7faf0002d020 0x7faf0002c5d0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.492+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faefc019040 con 0x7faf0002d020 2023-10-05T21:16:19.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.492+0000 7faf0b9c6700 1 --2- 172.21.15.153:0/946936814 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7faefc007030 0x7faefc01d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.492+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x7faefc007030 2023-10-05T21:16:19.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.492+0000 7faf0c9c8700 1 --2- 172.21.15.153:0/946936814 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7faefc007030 0x7faefc01d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.492+0000 7faf0c9c8700 1 --2- 172.21.15.153:0/946936814 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7faefc007030 0x7faefc01d420 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.493+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.493+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x564307126bf0 2023-10-05T21:16:19.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.493+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.493+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x564307126bf0 2023-10-05T21:16:19.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.493+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.493+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x7faefc007030 2023-10-05T21:16:19.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.493+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.493+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x7faefc007030 2023-10-05T21:16:19.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.494+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.494+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x7faf0002d020 2023-10-05T21:16:19.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.494+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faefc019040 con 0x7faf0002d020 2023-10-05T21:16:19.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.494+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x564307157010 2023-10-05T21:16:19.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.494+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.494+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x564307126bf0 2023-10-05T21:16:19.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.494+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.494+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x7faefc007030 2023-10-05T21:16:19.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.495+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.495+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x564307126bf0 2023-10-05T21:16:19.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.495+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.495+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x7faf0002d020 2023-10-05T21:16:19.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.495+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faefc019040 con 0x7faf0002d020 2023-10-05T21:16:19.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.495+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x564307157010 2023-10-05T21:16:19.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.495+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.495+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x564307157010 2023-10-05T21:16:19.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.495+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.495+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x7faefc007030 2023-10-05T21:16:19.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.496+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.496+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x564307157010 2023-10-05T21:16:19.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.496+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.496+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x564307157010 2023-10-05T21:16:19.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.496+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.496+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x564307126bf0 2023-10-05T21:16:19.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.496+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.496+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x564307126bf0 2023-10-05T21:16:19.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.497+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.497+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x7faefc007030 2023-10-05T21:16:19.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.497+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.497+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x564307157010 2023-10-05T21:16:19.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.498+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.498+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x7faf0002d020 2023-10-05T21:16:19.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.498+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faefc019040 con 0x7faf0002d020 2023-10-05T21:16:19.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.498+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x564307126bf0 2023-10-05T21:16:19.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.498+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.498+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x7faefc007030 2023-10-05T21:16:19.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.498+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.498+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x564307157010 2023-10-05T21:16:19.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.498+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.499+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x7faefc007030 2023-10-05T21:16:19.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.499+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.499+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x7faf0002d020 2023-10-05T21:16:19.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.499+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faefc019040 con 0x7faf0002d020 2023-10-05T21:16:19.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.499+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x564307157010 2023-10-05T21:16:19.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.499+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.499+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x7faefc007030 2023-10-05T21:16:19.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.500+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.500+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x564307126bf0 2023-10-05T21:16:19.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.500+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.500+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715b5b0 con 0x7faf0002d020 2023-10-05T21:16:19.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.500+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faefc019040 con 0x7faf0002d020 2023-10-05T21:16:19.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.500+0000 7faf190ef680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:16:19.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.500+0000 7faf190ef680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:16:19.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.500+0000 7faf190ef680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:16:19.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.500+0000 7faf190ef680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:16:19.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.500+0000 7faf190ef680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.500+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715a500 con 0x564307126bf0 2023-10-05T21:16:19.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.500+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.500+0000 7faf190ef680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.500+0000 7faf190ef680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.500+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715a900 con 0x564307126bf0 2023-10-05T21:16:19.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.501+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.501+0000 7faf190ef680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:19.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.501+0000 7faf190ef680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.501+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ba40 con 0x564307126bf0 2023-10-05T21:16:19.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.501+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.501+0000 7faf190ef680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:16:19.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.501+0000 7faf190ef680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.501+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715bdf0 con 0x564307157010 2023-10-05T21:16:19.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.501+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.501+0000 7faf190ef680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.501+0000 7faf190ef680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.501+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715c1a0 con 0x564307126bf0 2023-10-05T21:16:19.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.501+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.501+0000 7faf190ef680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.501+0000 7faf190ef680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.501+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715c1a0 con 0x564307126bf0 2023-10-05T21:16:19.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.502+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.502+0000 7faf190ef680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:19.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.502+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715c1a0 con 0x564307157010 2023-10-05T21:16:19.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.502+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.502+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715c1a0 con 0x7faf0002d020 2023-10-05T21:16:19.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.502+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faefc019040 con 0x7faf0002d020 2023-10-05T21:16:19.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.502+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715c1a0 con 0x7faefc007030 2023-10-05T21:16:19.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.502+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.502+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ba40 con 0x564307126bf0 2023-10-05T21:16:19.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.503+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.503+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ba40 con 0x564307126bf0 2023-10-05T21:16:19.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.503+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.503+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ba40 con 0x7faefc007030 2023-10-05T21:16:19.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.503+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.503+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ba40 con 0x7faefc007030 2023-10-05T21:16:19.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.503+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.503+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ba40 con 0x7faf0002d020 2023-10-05T21:16:19.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.504+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faefc019040 con 0x7faf0002d020 2023-10-05T21:16:19.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.504+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ba40 con 0x564307157010 2023-10-05T21:16:19.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.504+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.504+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ba40 con 0x564307126bf0 2023-10-05T21:16:19.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.504+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.504+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ba40 con 0x7faefc007030 2023-10-05T21:16:19.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.504+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.504+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ba40 con 0x564307126bf0 2023-10-05T21:16:19.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.505+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.505+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ba40 con 0x7faf0002d020 2023-10-05T21:16:19.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.505+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faefc019040 con 0x7faf0002d020 2023-10-05T21:16:19.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.505+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ba40 con 0x564307157010 2023-10-05T21:16:19.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.505+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.505+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ba40 con 0x564307157010 2023-10-05T21:16:19.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.505+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.505+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ba40 con 0x7faefc007030 2023-10-05T21:16:19.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.506+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.506+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ba40 con 0x564307157010 2023-10-05T21:16:19.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.506+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.506+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ba40 con 0x564307157010 2023-10-05T21:16:19.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.506+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.506+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ba40 con 0x564307126bf0 2023-10-05T21:16:19.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.506+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.506+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ba40 con 0x564307126bf0 2023-10-05T21:16:19.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.506+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.506+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ba40 con 0x7faefc007030 2023-10-05T21:16:19.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.507+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.507+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ba40 con 0x564307157010 2023-10-05T21:16:19.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.507+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.507+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ba40 con 0x7faf0002d020 2023-10-05T21:16:19.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.507+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faefc019040 con 0x7faf0002d020 2023-10-05T21:16:19.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.507+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ba40 con 0x564307126bf0 2023-10-05T21:16:19.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.507+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.507+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ba40 con 0x7faefc007030 2023-10-05T21:16:19.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.508+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.508+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ba40 con 0x564307157010 2023-10-05T21:16:19.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.508+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.508+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ba40 con 0x7faefc007030 2023-10-05T21:16:19.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.509+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.509+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ba40 con 0x7faf0002d020 2023-10-05T21:16:19.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.509+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faefc019040 con 0x7faf0002d020 2023-10-05T21:16:19.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.509+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ba40 con 0x564307157010 2023-10-05T21:16:19.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.509+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.509+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ba40 con 0x7faefc007030 2023-10-05T21:16:19.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.510+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.510+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ba40 con 0x564307126bf0 2023-10-05T21:16:19.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.510+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.510+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ba40 con 0x7faf0002d020 2023-10-05T21:16:19.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.510+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faefc019040 con 0x7faf0002d020 2023-10-05T21:16:19.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.510+0000 7faf190ef680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:16:19.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.510+0000 7faf190ef680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:16:19.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.510+0000 7faf190ef680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:16:19.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.510+0000 7faf190ef680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:16:19.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.510+0000 7faf190ef680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.510+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715c1a0 con 0x564307126bf0 2023-10-05T21:16:19.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.510+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.510+0000 7faf190ef680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:19.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.510+0000 7faf190ef680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.510+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715c5a0 con 0x564307157010 2023-10-05T21:16:19.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.511+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.511+0000 7faf190ef680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:16:19.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.511+0000 7faf190ef680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.511+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ce40 con 0x564307126bf0 2023-10-05T21:16:19.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.511+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.511+0000 7faf190ef680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:19.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.511+0000 7faf190ef680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.511+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ce40 con 0x564307126bf0 2023-10-05T21:16:19.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.511+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.511+0000 7faf190ef680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:16:19.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.511+0000 7faf190ef680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.511+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ce40 con 0x7faefc007030 2023-10-05T21:16:19.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.512+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.512+0000 7faf190ef680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.512+0000 7faf190ef680 20 zone default found 2023-10-05T21:16:19.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.512+0000 7faf190ef680 4 Realm: () 2023-10-05T21:16:19.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.512+0000 7faf190ef680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:16:19.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.512+0000 7faf190ef680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:16:19.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.512+0000 7faf190ef680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:16:19.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.512+0000 7faf190ef680 20 zonegroup default 2023-10-05T21:16:19.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.512+0000 7faf190ef680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.512+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715ce40 con 0x7faefc007030 2023-10-05T21:16:19.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.512+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.512+0000 7faf190ef680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.512+0000 7faf190ef680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.512+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715e7c0 con 0x564307157010 2023-10-05T21:16:19.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.512+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.512+0000 7faf190ef680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.512+0000 7faf190ef680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.512+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715eb70 con 0x564307157010 2023-10-05T21:16:19.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.513+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.513+0000 7faf190ef680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.513+0000 7faf190ef680 20 started sync module instance, tier type = 2023-10-05T21:16:19.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.513+0000 7faf190ef680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:16:19.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.513+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715de80 con 0x7faf0002d020 2023-10-05T21:16:19.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.513+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v31'252 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faefc019040 con 0x7faf0002d020 2023-10-05T21:16:19.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.513+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94845881672320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715f410 con 0x7faf0002d020 2023-10-05T21:16:19.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.514+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715fcb0 con 0x564307126bf0 2023-10-05T21:16:19.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.514+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94845881672320] v31'253 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faefc019040 con 0x7faf0002d020 2023-10-05T21:16:19.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.514+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v31'252 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.514+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94845881675552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430715fcf0 con 0x564307126bf0 2023-10-05T21:16:19.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.514+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071608d0 con 0x564307157010 2023-10-05T21:16:19.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.515+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94845881675552] v31'253 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.515+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v31'252 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.515+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94845881680768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307160cd0 con 0x564307157010 2023-10-05T21:16:19.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.515+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071616e0 con 0x7faf0002d020 2023-10-05T21:16:19.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.516+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v31'252 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faefc019040 con 0x7faf0002d020 2023-10-05T21:16:19.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.516+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94845881680768] v31'253 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.516+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94845881686672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307161ee0 con 0x7faf0002d020 2023-10-05T21:16:19.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.516+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307162800 con 0x564307126bf0 2023-10-05T21:16:19.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.517+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94845881686672] v31'253 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faefc019040 con 0x7faf0002d020 2023-10-05T21:16:19.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.517+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v31'252 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.517+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94845881688720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307162c00 con 0x564307126bf0 2023-10-05T21:16:19.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.517+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307163610 con 0x7faefc007030 2023-10-05T21:16:19.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.518+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94845881688720] v31'253 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.518+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v31'252 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.518+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94845881677760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307163610 con 0x7faefc007030 2023-10-05T21:16:19.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.518+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071640b0 con 0x7faefc007030 2023-10-05T21:16:19.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.519+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(96 notify.6 [create] v31'252 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.519+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(95 notify.5 [watch watch cookie 94845881677760] v31'253 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.519+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94845881695104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071640b0 con 0x7faefc007030 2023-10-05T21:16:19.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.519+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307164b50 con 0x7faefc007030 2023-10-05T21:16:19.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.520+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94845881695104] v31'253 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.520+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v31'252 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.520+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94845881692448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307164b10 con 0x7faefc007030 2023-10-05T21:16:19.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.520+0000 7faf190ef680 20 add_watcher() i=0 2023-10-05T21:16:19.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.520+0000 7faf190ef680 20 add_watcher() i=1 2023-10-05T21:16:19.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.520+0000 7faf190ef680 20 add_watcher() i=2 2023-10-05T21:16:19.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.520+0000 7faf190ef680 20 add_watcher() i=3 2023-10-05T21:16:19.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.520+0000 7faf190ef680 20 add_watcher() i=4 2023-10-05T21:16:19.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.520+0000 7faf190ef680 20 add_watcher() i=5 2023-10-05T21:16:19.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.520+0000 7faf190ef680 20 add_watcher() i=6 2023-10-05T21:16:19.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.520+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94845881692448] v31'253 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.520+0000 7faf190ef680 20 add_watcher() i=7 2023-10-05T21:16:19.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.520+0000 7faf190ef680 2 all 8 watchers are set, enabling cache 2023-10-05T21:16:19.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.520+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307167f20 con 0x564307126bf0 2023-10-05T21:16:19.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.521+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.521+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94845881698288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071653e0 con 0x564307126bf0 2023-10-05T21:16:19.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.522+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94845881698288] v31'239 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.522+0000 7faeddfe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:16:19.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.522+0000 7faf190ef680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:16:19.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.522+0000 7faf190ef680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:16:19.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.522+0000 7faf190ef680 1 Processor -- start 2023-10-05T21:16:19.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.522+0000 7faf190ef680 1 -- start start 2023-10-05T21:16:19.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.522+0000 7faf190ef680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564307171b90 0x564307171fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.522+0000 7faf190ef680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643071725b0 con 0x564307171b90 2023-10-05T21:16:19.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.523+0000 7faf0b9c6700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564307171b90 0x564307171fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.523+0000 7faf0b9c6700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564307171b90 0x564307171fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:53222/0 (socket says 172.21.15.153:53222) 2023-10-05T21:16:19.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.523+0000 7faf0b9c6700 1 -- 172.21.15.153:0/1859492969 learned_addr learned my addr 172.21.15.153:0/1859492969 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:19.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.523+0000 7faf0b9c6700 1 -- 172.21.15.153:0/1859492969 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564307172a90 con 0x564307171b90 2023-10-05T21:16:19.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.523+0000 7faf0b9c6700 1 --2- 172.21.15.153:0/1859492969 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564307171b90 0x564307171fa0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x564307121490 tx=0x7faefc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=689cdd088274f182 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.523+0000 7faedd7e2700 1 -- 172.21.15.153:0/1859492969 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faefc01ddc0 con 0x564307171b90 2023-10-05T21:16:19.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.523+0000 7faedd7e2700 1 -- 172.21.15.153:0/1859492969 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc02b440 con 0x564307171b90 2023-10-05T21:16:19.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.523+0000 7faedd7e2700 1 -- 172.21.15.153:0/1859492969 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faefc02b5f0 con 0x564307171b90 2023-10-05T21:16:19.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.524+0000 7faf190ef680 1 -- 172.21.15.153:0/1859492969 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564307171b90 msgr2=0x564307171fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.524+0000 7faf190ef680 1 --2- 172.21.15.153:0/1859492969 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564307171b90 0x564307171fa0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x564307121490 tx=0x7faefc012000 comp rx=0 tx=0).stop 2023-10-05T21:16:19.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.524+0000 7faf190ef680 1 -- 172.21.15.153:0/1859492969 shutdown_connections 2023-10-05T21:16:19.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.524+0000 7faf190ef680 1 --2- 172.21.15.153:0/1859492969 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564307171b90 0x564307171fa0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.524+0000 7faf190ef680 1 -- 172.21.15.153:0/1859492969 >> 172.21.15.153:0/1859492969 conn(0x56430716de90 msgr2=0x56430716bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:19.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.524+0000 7faf190ef680 1 -- 172.21.15.153:0/1859492969 shutdown_connections 2023-10-05T21:16:19.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.524+0000 7faf190ef680 1 -- 172.21.15.153:0/1859492969 wait complete. 2023-10-05T21:16:19.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.524+0000 7faf190ef680 1 Processor -- start 2023-10-05T21:16:19.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.524+0000 7faf190ef680 1 -- start start 2023-10-05T21:16:19.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.525+0000 7faf190ef680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564307171b90 0x564307178890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.525+0000 7faf190ef680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x564307178dd0 con 0x564307171b90 2023-10-05T21:16:19.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.525+0000 7faf0b9c6700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564307171b90 0x564307178890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.525+0000 7faf0b9c6700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564307171b90 0x564307178890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:53224/0 (socket says 172.21.15.153:53224) 2023-10-05T21:16:19.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.525+0000 7faf0b9c6700 1 -- 172.21.15.153:0/34247955 learned_addr learned my addr 172.21.15.153:0/34247955 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:19.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.525+0000 7faf0b9c6700 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56430712a520 con 0x564307171b90 2023-10-05T21:16:19.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.526+0000 7faf0b9c6700 1 --2- 172.21.15.153:0/34247955 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564307171b90 0x564307178890 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x56430716d400 tx=0x7faefc030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.526+0000 7fae577fe700 1 -- 172.21.15.153:0/34247955 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faefc03f670 con 0x564307171b90 2023-10-05T21:16:19.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.526+0000 7fae577fe700 1 -- 172.21.15.153:0/34247955 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc03f7d0 con 0x564307171b90 2023-10-05T21:16:19.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.526+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564307178fd0 con 0x564307171b90 2023-10-05T21:16:19.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.526+0000 7fae577fe700 1 -- 172.21.15.153:0/34247955 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faefc03f980 con 0x564307171b90 2023-10-05T21:16:19.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.526+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5643071793c0 con 0x564307171b90 2023-10-05T21:16:19.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.527+0000 7fae577fe700 1 -- 172.21.15.153:0/34247955 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7faefc047070 con 0x564307171b90 2023-10-05T21:16:19.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.527+0000 7fae577fe700 1 --2- 172.21.15.153:0/34247955 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fae4c034140 0x7fae4c0365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.527+0000 7fae577fe700 1 -- 172.21.15.153:0/34247955 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7faefc030070 con 0x564307171b90 2023-10-05T21:16:19.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.527+0000 7faf0c9c8700 1 --2- 172.21.15.153:0/34247955 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fae4c034140 0x7fae4c0365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.527+0000 7faf190ef680 1 --2- 172.21.15.153:0/34247955 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x564307183690 0x564307185b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.527+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307186240 con 0x564307183690 2023-10-05T21:16:19.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.527+0000 7faf0c1c7700 1 --2- 172.21.15.153:0/34247955 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x564307183690 0x564307185b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.527+0000 7faf0c9c8700 1 --2- 172.21.15.153:0/34247955 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fae4c034140 0x7fae4c0365f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x564307164d70 tx=0x7faf04037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.527+0000 7faf0c1c7700 1 --2- 172.21.15.153:0/34247955 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x564307183690 0x564307185b40 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.528+0000 7faf0c1c7700 1 -- 172.21.15.153:0/34247955 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v31'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faf00014070 con 0x564307183690 2023-10-05T21:16:19.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.528+0000 7faf190ef680 1 --2- 172.21.15.153:0/34247955 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x564307186f80 0x564307189360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.528+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307189a60 con 0x564307186f80 2023-10-05T21:16:19.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.528+0000 7faf0b9c6700 1 --2- 172.21.15.153:0/34247955 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x564307186f80 0x564307189360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.529+0000 7faf0b9c6700 1 --2- 172.21.15.153:0/34247955 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x564307186f80 0x564307189360 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.530+0000 7faf0b9c6700 1 -- 172.21.15.153:0/34247955 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v31'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faefc033040 con 0x564307186f80 2023-10-05T21:16:19.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.530+0000 7faf190ef680 1 --2- 172.21.15.153:0/34247955 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x56430718a7f0 0x56430718cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.530+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430718d360 con 0x56430718a7f0 2023-10-05T21:16:19.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.530+0000 7faf0c9c8700 1 --2- 172.21.15.153:0/34247955 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x56430718a7f0 0x56430718cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.530+0000 7faf0c9c8700 1 --2- 172.21.15.153:0/34247955 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x56430718a7f0 0x56430718cc10 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.531+0000 7faf0c9c8700 1 -- 172.21.15.153:0/34247955 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v31'32 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x56430718a7f0 2023-10-05T21:16:19.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.531+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430718db60 con 0x564307183690 2023-10-05T21:16:19.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.531+0000 7faf0c1c7700 1 -- 172.21.15.153:0/34247955 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v31'240 uv186 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faf00014070 con 0x564307183690 2023-10-05T21:16:19.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.532+0000 7faf190ef680 1 --2- 172.21.15.153:0/34247955 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x56430718e790 0x564307190c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.532+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071912d0 con 0x56430718e790 2023-10-05T21:16:19.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.532+0000 7faf0c1c7700 1 --2- 172.21.15.153:0/34247955 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x56430718e790 0x564307190c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.532+0000 7faf0c1c7700 1 --2- 172.21.15.153:0/34247955 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x56430718e790 0x564307190c20 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.533+0000 7faf0c1c7700 1 -- 172.21.15.153:0/34247955 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v31'73 uv58 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faf00014070 con 0x56430718e790 2023-10-05T21:16:19.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.533+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307191a00 con 0x56430718a7f0 2023-10-05T21:16:19.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.533+0000 7faf0c9c8700 1 -- 172.21.15.153:0/34247955 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v31'45 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x56430718a7f0 2023-10-05T21:16:19.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.533+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071920e0 con 0x564307183690 2023-10-05T21:16:19.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.534+0000 7faf0c1c7700 1 -- 172.21.15.153:0/34247955 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v31'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faf00014070 con 0x564307183690 2023-10-05T21:16:19.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.534+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071920e0 con 0x564307186f80 2023-10-05T21:16:19.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.535+0000 7faf0b9c6700 1 -- 172.21.15.153:0/34247955 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v31'49 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faefc033040 con 0x564307186f80 2023-10-05T21:16:19.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.535+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071927c0 con 0x56430718e790 2023-10-05T21:16:19.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.536+0000 7faf0c1c7700 1 -- 172.21.15.153:0/34247955 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v31'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faf00014070 con 0x56430718e790 2023-10-05T21:16:19.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.536+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071927c0 con 0x56430718a7f0 2023-10-05T21:16:19.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.536+0000 7faf0c9c8700 1 -- 172.21.15.153:0/34247955 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v31'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x56430718a7f0 2023-10-05T21:16:19.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.537+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307192e80 con 0x56430718e790 2023-10-05T21:16:19.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.537+0000 7faf0c1c7700 1 -- 172.21.15.153:0/34247955 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v31'74 uv60 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faf00014070 con 0x56430718e790 2023-10-05T21:16:19.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.537+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307192d60 con 0x564307186f80 2023-10-05T21:16:19.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.538+0000 7faf0b9c6700 1 -- 172.21.15.153:0/34247955 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v31'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faefc033040 con 0x564307186f80 2023-10-05T21:16:19.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.538+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307193380 con 0x56430718e790 2023-10-05T21:16:19.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.539+0000 7faf0c1c7700 1 -- 172.21.15.153:0/34247955 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v31'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faf00014070 con 0x56430718e790 2023-10-05T21:16:19.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.539+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307193380 con 0x564307186f80 2023-10-05T21:16:19.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.540+0000 7faf0b9c6700 1 -- 172.21.15.153:0/34247955 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v31'51 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faefc033040 con 0x564307186f80 2023-10-05T21:16:19.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.540+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307193870 con 0x564307183690 2023-10-05T21:16:19.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.540+0000 7faf0c1c7700 1 -- 172.21.15.153:0/34247955 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v31'241 uv182 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faf00014070 con 0x564307183690 2023-10-05T21:16:19.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.540+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307192d60 con 0x56430718a7f0 2023-10-05T21:16:19.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.541+0000 7faf0c9c8700 1 -- 172.21.15.153:0/34247955 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v31'62 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x56430718a7f0 2023-10-05T21:16:19.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.541+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307192d60 con 0x56430718e790 2023-10-05T21:16:19.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.542+0000 7faf0c1c7700 1 -- 172.21.15.153:0/34247955 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v31'75 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faf00014070 con 0x56430718e790 2023-10-05T21:16:19.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.542+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307192d60 con 0x56430718a7f0 2023-10-05T21:16:19.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.543+0000 7faf0c9c8700 1 -- 172.21.15.153:0/34247955 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v31'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x56430718a7f0 2023-10-05T21:16:19.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.543+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307192d60 con 0x564307183690 2023-10-05T21:16:19.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.544+0000 7faf0c1c7700 1 -- 172.21.15.153:0/34247955 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v31'38 uv32 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faf00014070 con 0x564307183690 2023-10-05T21:16:19.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.544+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307192d60 con 0x564307183690 2023-10-05T21:16:19.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.545+0000 7faf0c1c7700 1 -- 172.21.15.153:0/34247955 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v31'242 uv184 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faf00014070 con 0x564307183690 2023-10-05T21:16:19.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.545+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307192d60 con 0x56430718a7f0 2023-10-05T21:16:19.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.545+0000 7faf0c9c8700 1 -- 172.21.15.153:0/34247955 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v31'63 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x56430718a7f0 2023-10-05T21:16:19.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.545+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307192d60 con 0x56430718e790 2023-10-05T21:16:19.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.546+0000 7faf0c1c7700 1 -- 172.21.15.153:0/34247955 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v31'53 uv37 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faf00014070 con 0x56430718e790 2023-10-05T21:16:19.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.546+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307192d60 con 0x56430718a7f0 2023-10-05T21:16:19.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.547+0000 7faf0c9c8700 1 -- 172.21.15.153:0/34247955 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v31'31 uv26 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x56430718a7f0 2023-10-05T21:16:19.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.547+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307193c20 con 0x56430718a7f0 2023-10-05T21:16:19.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.547+0000 7faf0c9c8700 1 -- 172.21.15.153:0/34247955 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v31'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x56430718a7f0 2023-10-05T21:16:19.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.547+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307193c20 con 0x56430718a7f0 2023-10-05T21:16:19.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.548+0000 7faf0c9c8700 1 -- 172.21.15.153:0/34247955 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v31'37 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x56430718a7f0 2023-10-05T21:16:19.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.548+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307193c20 con 0x56430718a7f0 2023-10-05T21:16:19.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.549+0000 7faf0c9c8700 1 -- 172.21.15.153:0/34247955 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v31'46 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x56430718a7f0 2023-10-05T21:16:19.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.549+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307193c20 con 0x564307186f80 2023-10-05T21:16:19.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.550+0000 7faf0b9c6700 1 -- 172.21.15.153:0/34247955 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v31'29 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faefc033040 con 0x564307186f80 2023-10-05T21:16:19.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.550+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307193cb0 con 0x56430718a7f0 2023-10-05T21:16:19.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.551+0000 7faf0c9c8700 1 -- 172.21.15.153:0/34247955 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v31'32 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x56430718a7f0 2023-10-05T21:16:19.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.551+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307193cb0 con 0x564307186f80 2023-10-05T21:16:19.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.552+0000 7faf0b9c6700 1 -- 172.21.15.153:0/34247955 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v31'50 uv38 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faefc033040 con 0x564307186f80 2023-10-05T21:16:19.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.552+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307193c20 con 0x56430718a7f0 2023-10-05T21:16:19.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.553+0000 7faf0c9c8700 1 -- 172.21.15.153:0/34247955 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v31'64 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x56430718a7f0 2023-10-05T21:16:19.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.553+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307193c20 con 0x564307186f80 2023-10-05T21:16:19.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.553+0000 7faf0b9c6700 1 -- 172.21.15.153:0/34247955 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v31'52 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faefc033040 con 0x564307186f80 2023-10-05T21:16:19.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.553+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307193cb0 con 0x56430718e790 2023-10-05T21:16:19.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.554+0000 7faf0c1c7700 1 -- 172.21.15.153:0/34247955 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v31'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faf00014070 con 0x56430718e790 2023-10-05T21:16:19.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.555+0000 7fae54ff9700 20 reqs_thread_entry: start 2023-10-05T21:16:19.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.555+0000 7fae4a7fc700 20 reqs_thread_entry: start 2023-10-05T21:16:19.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.555+0000 7faf190ef680 20 init_complete bucket index max shards: 11 2023-10-05T21:16:19.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.556+0000 7faf190ef680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:16:19.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.556+0000 7fae48ff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:16:49 2023 2023-10-05T21:16:19.588 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:16:19.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.556+0000 7fae2ffff700 20 reqs_thread_entry: start 2023-10-05T21:16:19.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.556+0000 7faf190ef680 20 get_system_obj_state: rctx=0x7ffc941bb558 obj=default.rgw.meta:users.uid:bud state=0x564307095340 s->prefetch_data=0 2023-10-05T21:16:19.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.556+0000 7faf190ef680 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2023-10-05T21:16:19.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.556+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:102 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071eed60 con 0x7faf0002d020 2023-10-05T21:16:19.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.556+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(102 bud [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7faefc05c0a0 con 0x7faf0002d020 2023-10-05T21:16:19.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.556+0000 7faf190ef680 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x16 2023-10-05T21:16:19.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.556+0000 7faf190ef680 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2023-10-05T21:16:19.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.556+0000 7faf190ef680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:16:19.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.556+0000 7faf190ef680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:16:19.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.556+0000 7faf190ef680 20 Read xattr: user.rgw.idtag 2023-10-05T21:16:19.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.556+0000 7faf190ef680 10 cache get: name=default.rgw.meta+users.uid+bud : type miss (requested=0x13, cached=0x16) 2023-10-05T21:16:19.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.556+0000 7faf190ef680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.556+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:103 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f0ff0 con 0x7faf0002d020 2023-10-05T21:16:19.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.556+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(103 bud [call,call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 273+0+469 (crc 0 0 0) 0x7faefc05c0a0 con 0x7faf0002d020 2023-10-05T21:16:19.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.556+0000 7faf190ef680 20 rados_obj.operate() r=0 bl.length=346 2023-10-05T21:16:19.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.556+0000 7faf190ef680 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2023-10-05T21:16:19.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.556+0000 7faf190ef680 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2023-10-05T21:16:19.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.556+0000 7faf190ef680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:16:19.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.556+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:104 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f0ff0 con 0x564307126bf0 2023-10-05T21:16:19.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.557+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(104 bud.buckets [call out=184b] v0'0 uv3 ondisk = 0) v8 ==== 155+0+184 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.557+0000 7faf190ef680 20 get_system_obj_state: rctx=0x7ffc941bb210 obj=default.rgw.meta:root:.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 state=0x564307095340 s->prefetch_data=0 2023-10-05T21:16:19.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.557+0000 7faf190ef680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 : miss 2023-10-05T21:16:19.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.557+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:105 8.1c 8:3bd4508d:root::.bucket.meta.myfoo6%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f0b00 con 0x564307157010 2023-10-05T21:16:19.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.557+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(105 .bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 [call out=48b,getxattrs out=212b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 291+0+276 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.557+0000 7faf190ef680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 info.flags=0x16 2023-10-05T21:16:19.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.557+0000 7faf190ef680 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 to cache LRU end 2023-10-05T21:16:19.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.557+0000 7faf190ef680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:16:19.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.557+0000 7faf190ef680 10 updating xattr: name=user.rgw.acl bl.length()=117 2023-10-05T21:16:19.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.557+0000 7faf190ef680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:16:19.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.557+0000 7faf190ef680 20 Read xattr: user.rgw.acl 2023-10-05T21:16:19.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.557+0000 7faf190ef680 20 Read xattr: user.rgw.idtag 2023-10-05T21:16:19.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.557+0000 7faf190ef680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 : type miss (requested=0x13, cached=0x16) 2023-10-05T21:16:19.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.557+0000 7faf190ef680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.557+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:106 8.1c 8:3bd4508d:root::.bucket.meta.myfoo6%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f3670 con 0x564307157010 2023-10-05T21:16:19.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.558+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(106 .bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 [call,call out=48b,read 0~353 out=353b,getxattrs out=212b] v0'0 uv2 ondisk = 0) v8 ==== 333+0+613 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.558+0000 7faf190ef680 20 rados_obj.operate() r=0 bl.length=353 2023-10-05T21:16:19.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.558+0000 7faf190ef680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 info.flags=0x13 2023-10-05T21:16:19.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.558+0000 7faf190ef680 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 to cache LRU end 2023-10-05T21:16:19.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.558+0000 7faf190ef680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:16:19.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.558+0000 7faf190ef680 10 updating xattr: name=user.rgw.acl bl.length()=117 2023-10-05T21:16:19.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.558+0000 7faf190ef680 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 2023-10-05T21:16:19.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.558+0000 7faf190ef680 10 int RGWRados::cls_bucket_list_unordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, uint32_t, bool, std::vector&, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter) :myfoo6[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7]) start_after="", prefix="", shard_id=-1", num_entries=1100, list_versions=1, force_check_filter is unset 2023-10-05T21:16:19.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.558+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:107 4.24 4:250a2177:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430726e9a0 con 0x7faefc007030 2023-10-05T21:16:19.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.558+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(107 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.0 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.558+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:108 4.1 4:80edd8c1:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430726e9a0 con 0x7faf0002d020 2023-10-05T21:16:19.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.558+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(108 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.1 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faefc05c0a0 con 0x7faf0002d020 2023-10-05T21:16:19.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.558+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 4.4 4:2044a8d5:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430726e9a0 con 0x7faefc007030 2023-10-05T21:16:19.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.559+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(109 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.2 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.559+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:110 4.19 4:9b1150cc:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430726e9a0 con 0x564307157010 2023-10-05T21:16:19.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.559+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(110 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.559+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:111 4.7 4:e2793aa7:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430726e9a0 con 0x7faefc007030 2023-10-05T21:16:19.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.560+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(111 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.4 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.560+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:112 4.b 4:d2b63918:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430726e9a0 con 0x7faf0002d020 2023-10-05T21:16:19.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.560+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(112 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.5 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faefc05c0a0 con 0x7faf0002d020 2023-10-05T21:16:19.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.560+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:113 4.18 4:1be2c7da:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430726e9a0 con 0x7faf0002d020 2023-10-05T21:16:19.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.560+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== osd_op_reply(113 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.6 [call out=85b] v0'0 uv10 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faefc05c0a0 con 0x7faf0002d020 2023-10-05T21:16:19.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.560+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:114 4.28 4:15f0786f:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430726e9a0 con 0x564307126bf0 2023-10-05T21:16:19.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.561+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(114 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.561+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:115 4.39 4:9fce90f7:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430726e9a0 con 0x564307157010 2023-10-05T21:16:19.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.561+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== osd_op_reply(115 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.8 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.561+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:116 4.3c 4:3e7461c4:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430726e9a0 con 0x564307126bf0 2023-10-05T21:16:19.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.561+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(116 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.9 [call out=289b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+289 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.561+0000 7faf190ef680 10 cls_bucket_list_unordered: got thirteen 2023-10-05T21:16:19.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.561+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:117 4.a 4:525ffd34:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430726e9a0 con 0x7faf0002d020 2023-10-05T21:16:19.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.562+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 22 ==== osd_op_reply(117 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.10 [call out=85b] v0'0 uv21 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7faefc05c0a0 con 0x7faf0002d020 2023-10-05T21:16:19.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.562+0000 7faf190ef680 20 get_obj_state: rctx=0x7ffc941bb220 obj=myfoo6:thirteen state=0x5643071f1cd8 s->prefetch_data=0 2023-10-05T21:16:19.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.562+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:118 3.29 3:968f03b7:::193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f2cd0 con 0x7faefc007030 2023-10-05T21:16:19.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.562+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(118 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7_thirteen [getxattrs out=820b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 238+0+836 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.562+0000 7faf190ef680 10 manifest: total_size = 8 2023-10-05T21:16:19.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.562+0000 7faf190ef680 20 get_obj_state: setting s->obj_tag to _Vo-JYlD8RpgS837-qehoLd1AkuwMuw6 2023-10-05T21:16:19.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.562+0000 7faf190ef680 20 get_obj_state: rctx=0x7ffc941bb220 obj=myfoo6:thirteen state=0x5643071f1cd8 s->prefetch_data=0 2023-10-05T21:16:19.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.562+0000 7faf190ef680 20 prepare_atomic_modification: state is not atomic. state=0x5643071f1cd8 2023-10-05T21:16:19.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.562+0000 7faf190ef680 20 bucket index object: default.rgw.buckets.index:.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.9 2023-10-05T21:16:19.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.562+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:119 4.3c 4:3e7461c4:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f7d80 con 0x564307126bf0 2023-10-05T21:16:19.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.563+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(119 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.9 [stat,call,call] v31'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.563+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:120 3.29 3:968f03b7:::193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f5d60 con 0x7faefc007030 2023-10-05T21:16:19.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.564+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 31 ==== osd_op_reply(120 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7_thirteen [call] v31'3 uv3 ondisk = 0) v8 ==== 196+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.564+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:121 4.3c 4:3e7461c4:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f5d60 con 0x564307126bf0 2023-10-05T21:16:19.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.564+0000 7faf190ef680 10 cache get: name=default.rgw.log++bucket.sync-source-hints.myfoo6 : miss 2023-10-05T21:16:19.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.564+0000 7faf190ef680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.564+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:122 6.9 6:936e6ff6:::bucket.sync-source-hints.myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071faba0 con 0x564307157010 2023-10-05T21:16:19.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.564+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(122 bucket.sync-source-hints.myfoo6 [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 217+0+0 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.564+0000 7faf190ef680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.564+0000 7faf190ef680 10 cache put: name=default.rgw.log++bucket.sync-source-hints.myfoo6 info.flags=0x0 2023-10-05T21:16:19.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.564+0000 7faf190ef680 10 adding default.rgw.log++bucket.sync-source-hints.myfoo6 to cache LRU end 2023-10-05T21:16:19.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.564+0000 7faf190ef680 10 cache get: name=default.rgw.log++bucket.sync-target-hints.myfoo6 : miss 2023-10-05T21:16:19.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.564+0000 7faf190ef680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.564+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:123 6.19 6:9e3df8ab:::bucket.sync-target-hints.myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071faba0 con 0x564307126bf0 2023-10-05T21:16:19.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.565+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(123 bucket.sync-target-hints.myfoo6 [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 217+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.565+0000 7faf190ef680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.565+0000 7faf190ef680 10 cache put: name=default.rgw.log++bucket.sync-target-hints.myfoo6 info.flags=0x0 2023-10-05T21:16:19.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.565+0000 7faf190ef680 10 adding default.rgw.log++bucket.sync-target-hints.myfoo6 to cache LRU end 2023-10-05T21:16:19.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.565+0000 7faf190ef680 10 chain_cache_entry: cache_locator= 2023-10-05T21:16:19.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.565+0000 7faf190ef680 20 chain_cache_entry: couldn't find cache locator 2023-10-05T21:16:19.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.565+0000 7faf190ef680 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2023-10-05T21:16:19.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.565+0000 7faf190ef680 20 int RGWRados::Bucket::List::list_objects_ordered(const DoutPrefixProvider*, int64_t, std::vector*, std::map, bool>*, bool*, optional_yield): starting attempt 1 2023-10-05T21:16:19.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.565+0000 7faf190ef680 10 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): :myfoo6[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7]) start_after="_multipart_", prefix="_multipart_, delimiter="", shard_id=-1", num_entries=1001, list_versions=0, expansion_factor=1, force_check_filter is unset 2023-10-05T21:16:19.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.565+0000 7faf190ef680 10 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-10-05T21:16:19.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.565+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:124 4.24 4:250a2177:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f8a60 con 0x7faefc007030 2023-10-05T21:16:19.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.565+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:125 4.1 4:80edd8c1:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f8f50 con 0x7faf0002d020 2023-10-05T21:16:19.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.565+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:126 4.4 4:2044a8d5:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307200010 con 0x7faefc007030 2023-10-05T21:16:19.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.565+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:127 4.19 4:9b1150cc:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f8f50 con 0x564307157010 2023-10-05T21:16:19.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.565+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:128 4.7 4:e2793aa7:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307204e20 con 0x7faefc007030 2023-10-05T21:16:19.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.565+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:129 4.b 4:d2b63918:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643072077d0 con 0x7faf0002d020 2023-10-05T21:16:19.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.565+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:130 4.18 4:1be2c7da:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430720a160 con 0x7faf0002d020 2023-10-05T21:16:19.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.565+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:131 4.28 4:15f0786f:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430720cee0 con 0x564307126bf0 2023-10-05T21:16:19.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.565+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:132 4.39 4:9fce90f7:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430720fd30 con 0x564307157010 2023-10-05T21:16:19.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.565+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:133 4.3c 4:3e7461c4:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307212c00 con 0x564307126bf0 2023-10-05T21:16:19.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.565+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:134 4.a 4:525ffd34:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307215ad0 con 0x7faf0002d020 2023-10-05T21:16:19.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.565+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(121 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.9 [stat,call,call] v31'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.565+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 32 ==== osd_op_reply(124 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.0 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.565+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 23 ==== osd_op_reply(125 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.1 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faefc05c0a0 con 0x7faf0002d020 2023-10-05T21:16:19.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.565+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 33 ==== osd_op_reply(126 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.2 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.565+0000 7faf0a1c3700 20 handle_completion(): completion ok for obj=thirteen 2023-10-05T21:16:19.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.565+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 34 ==== osd_op_reply(128 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.4 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.566+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 31 ==== osd_op_reply(127 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.566+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 24 ==== osd_op_reply(129 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.5 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faefc05c0a0 con 0x7faf0002d020 2023-10-05T21:16:19.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.566+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 25 ==== osd_op_reply(130 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.6 [call out=85b] v0'0 uv10 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faefc05c0a0 con 0x7faf0002d020 2023-10-05T21:16:19.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.566+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 26 ==== osd_op_reply(134 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.10 [call out=85b] v0'0 uv21 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7faefc05c0a0 con 0x7faf0002d020 2023-10-05T21:16:19.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.566+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== osd_op_reply(131 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.566+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 32 ==== osd_op_reply(132 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.8 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.566+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 42 ==== osd_op_reply(133 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.9 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.566+0000 7faf190ef680 20 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): returning, count=0, is_truncated=0 2023-10-05T21:16:19.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.566+0000 7faf190ef680 20 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): returning, last_entry NOT SET 2023-10-05T21:16:19.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.566+0000 7faf190ef680 10 int RGWRados::Bucket::List::list_objects_ordered(const DoutPrefixProvider*, int64_t, std::vector*, std::map, bool>*, bool*, optional_yield): end of outer loop, truncated=0, count=0, attempt=1 2023-10-05T21:16:19.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.566+0000 7faf190ef680 10 int RGWRados::Bucket::List::list_objects_ordered(const DoutPrefixProvider*, int64_t, std::vector*, std::map, bool>*, bool*, optional_yield): exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-10-05T21:16:19.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.566+0000 7faf190ef680 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7])"; uploads.size()=0; is_truncated=0 2023-10-05T21:16:19.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.566+0000 7faf190ef680 10 lifecycle: RGWRados::convert_old_bucket_info(): bucket=:myfoo6[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7]) 2023-10-05T21:16:19.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.566+0000 7faf190ef680 20 lifecycle: get_system_obj_state: rctx=0x7ffc941bace8 obj=default.rgw.meta:root:myfoo6 state=0x564307095340 s->prefetch_data=0 2023-10-05T21:16:19.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.566+0000 7faf190ef680 10 lifecycle: cache get: name=default.rgw.meta+root+myfoo6 : miss 2023-10-05T21:16:19.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.566+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430720fd90 con 0x564307126bf0 2023-10-05T21:16:19.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.566+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 43 ==== osd_op_reply(135 myfoo6 [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv18 ondisk = 0) v8 ==== 234+0+139 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.566+0000 7faf190ef680 10 lifecycle: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x16 2023-10-05T21:16:19.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.566+0000 7faf190ef680 10 lifecycle: adding default.rgw.meta+root+myfoo6 to cache LRU end 2023-10-05T21:16:19.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.566+0000 7faf190ef680 10 lifecycle: updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:16:19.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.566+0000 7faf190ef680 20 lifecycle: get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:16:19.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.566+0000 7faf190ef680 20 lifecycle: Read xattr: user.rgw.idtag 2023-10-05T21:16:19.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.566+0000 7faf190ef680 10 lifecycle: cache get: name=default.rgw.meta+root+myfoo6 : type miss (requested=0x13, cached=0x16) 2023-10-05T21:16:19.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.566+0000 7faf190ef680 20 lifecycle: rados->read ofs=0 len=0 2023-10-05T21:16:19.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.566+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430720cee0 con 0x564307126bf0 2023-10-05T21:16:19.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.566+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 44 ==== osd_op_reply(136 myfoo6 [call,call out=48b,read 0~166 out=166b,getxattrs out=75b] v0'0 uv18 ondisk = 0) v8 ==== 276+0+289 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.566+0000 7faf190ef680 20 lifecycle: rados_obj.operate() r=0 bl.length=166 2023-10-05T21:16:19.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.566+0000 7faf190ef680 10 lifecycle: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x13 2023-10-05T21:16:19.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.566+0000 7faf190ef680 10 lifecycle: moving default.rgw.meta+root+myfoo6 to cache LRU end 2023-10-05T21:16:19.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.566+0000 7faf190ef680 10 lifecycle: updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:16:19.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.566+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:137 8.1c 8:3bd4508d:root::.bucket.meta.myfoo6%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~353 in=353b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071fa880 con 0x564307157010 2023-10-05T21:16:19.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.567+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 33 ==== osd_op_reply(137 .bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 [delete,create,call,call,writefull 0~353,setxattr (117)] v31'3 uv3 ondisk = 0) v8 ==== 417+0+0 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.567+0000 7faf190ef680 10 lifecycle: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 info.flags=0x17 2023-10-05T21:16:19.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.567+0000 7faf190ef680 10 lifecycle: moving default.rgw.meta+root+.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 to cache LRU end 2023-10-05T21:16:19.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.567+0000 7faf190ef680 10 lifecycle: updating xattr: name=user.rgw.acl bl.length()=117 2023-10-05T21:16:19.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.567+0000 7faf190ef680 10 lifecycle: distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7, ofs0, ns] 2023-10-05T21:16:19.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.567+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:138 7.3 7:c609908c:::notify.5:head [notify cookie 94845882303456 in=733b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430720f930 con 0x7faefc007030 2023-10-05T21:16:19.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.568+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 35 ==== watch-notify(notify (1) cookie 94845881677760 notify 133143986209 ret 0) v3 ==== 763+0+0 (crc 0 0 0) 0x7faf04029040 con 0x7faefc007030 2023-10-05T21:16:19.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.568+0000 7faf099c2700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986209 cookie 94845881677760 notifier 4730 bl.length()=721 2023-10-05T21:16:19.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.568+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 36 ==== osd_op_reply(138 notify.5 [notify cookie 94845882303456 out=8b] v0'0 uv252 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.568+0000 7faf099c2700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 info.flags=0x17 2023-10-05T21:16:19.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.568+0000 7faf099c2700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 to cache LRU end 2023-10-05T21:16:19.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.568+0000 7faf099c2700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2023-10-05T21:16:19.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.568+0000 7faf099c2700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:139 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fae5c0034e0 con 0x7faefc007030 2023-10-05T21:16:19.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.568+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 37 ==== osd_op_reply(139 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.568+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 38 ==== watch-notify(notify_complete (2) cookie 94845882303456 notify 133143986209 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7faf04066130 con 0x7faefc007030 2023-10-05T21:16:19.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.568+0000 7faf190ef680 20 lifecycle: handle_bi_update(): bucket=:myfoo6[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7]): orig_sources= new_sources= 2023-10-05T21:16:19.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.568+0000 7faf190ef680 20 lifecycle: handle_bi_update(): bucket=:myfoo6[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7]): potential sources added=[] removed=[] 2023-10-05T21:16:19.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.568+0000 7faf190ef680 20 lifecycle: handle_bi_update(): bucket=:myfoo6[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7]): orig_dests= new_dests= 2023-10-05T21:16:19.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.568+0000 7faf190ef680 20 lifecycle: handle_bi_update(): bucket=:myfoo6[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7]): potential dests added=[] removed=[] 2023-10-05T21:16:19.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.568+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 6.14 6:2f3f5e88:lc::lc.17:head [call lock.lock in=65b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f83e0 con 0x56430718e790 2023-10-05T21:16:19.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.569+0000 7faf0c1c7700 1 -- 172.21.15.153:0/34247955 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(33 lc.17 [call] v31'15 uv15 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faf00014070 con 0x56430718e790 2023-10-05T21:16:19.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.569+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:34 6.14 6:2f3f5e88:lc::lc.17:head [call rgw.lc_rm_entry in=93b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f83e0 con 0x56430718e790 2023-10-05T21:16:19.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.570+0000 7faf0c1c7700 1 -- 172.21.15.153:0/34247955 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(34 lc.17 [call] v31'16 uv16 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faf00014070 con 0x56430718e790 2023-10-05T21:16:19.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.570+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:35 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=49b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f83e0 con 0x56430718e790 2023-10-05T21:16:19.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.570+0000 7faf0c1c7700 1 -- 172.21.15.153:0/34247955 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(35 lc.17 [call] v31'17 uv17 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faf00014070 con 0x56430718e790 2023-10-05T21:16:19.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.570+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:140 4.24 4:250a2177:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f83e0 con 0x7faefc007030 2023-10-05T21:16:19.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.570+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:141 4.1 4:80edd8c1:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f1ab0 con 0x7faf0002d020 2023-10-05T21:16:19.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.570+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:142 4.4 4:2044a8d5:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f1ef0 con 0x7faefc007030 2023-10-05T21:16:19.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.570+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:143 4.19 4:9b1150cc:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643072157f0 con 0x564307157010 2023-10-05T21:16:19.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.570+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:144 4.7 4:e2793aa7:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643072157f0 con 0x7faefc007030 2023-10-05T21:16:19.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.570+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:145 4.b 4:d2b63918:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f1ef0 con 0x7faf0002d020 2023-10-05T21:16:19.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.570+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:146 4.18 4:1be2c7da:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643072157f0 con 0x7faf0002d020 2023-10-05T21:16:19.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.570+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:147 4.28 4:15f0786f:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f1ab0 con 0x564307126bf0 2023-10-05T21:16:19.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.571+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:148 4.39 4:9fce90f7:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56430720a160 con 0x564307157010 2023-10-05T21:16:19.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.571+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:149 4.3c 4:3e7461c4:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307203900 con 0x564307126bf0 2023-10-05T21:16:19.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.571+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:150 4.a 4:525ffd34:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f1ab0 con 0x7faf0002d020 2023-10-05T21:16:19.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.571+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 39 ==== osd_op_reply(140 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.0 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.571+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 40 ==== osd_op_reply(142 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.2 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.571+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 27 ==== osd_op_reply(141 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.1 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faefc05c0a0 con 0x7faf0002d020 2023-10-05T21:16:19.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.571+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 41 ==== osd_op_reply(144 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.4 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.571+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 28 ==== osd_op_reply(145 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.5 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faefc05c0a0 con 0x7faf0002d020 2023-10-05T21:16:19.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.571+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 45 ==== osd_op_reply(149 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.9 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.571+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 29 ==== osd_op_reply(150 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.10 [call out=85b] v0'0 uv21 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7faefc05c0a0 con 0x7faf0002d020 2023-10-05T21:16:19.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.571+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 46 ==== osd_op_reply(147 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.571+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 34 ==== osd_op_reply(143 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.571+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 30 ==== osd_op_reply(146 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.6 [call out=85b] v0'0 uv10 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faefc05c0a0 con 0x7faf0002d020 2023-10-05T21:16:19.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.571+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 35 ==== osd_op_reply(148 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.8 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.571+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:151 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f1ab0 con 0x564307126bf0 2023-10-05T21:16:19.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.572+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 47 ==== osd_op_reply(151 bud.buckets [call] v31'4 uv4 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.572+0000 7faf190ef680 20 get_system_obj_state: rctx=0x7ffc941ba748 obj=default.rgw.meta:root:myfoo6 state=0x564307095340 s->prefetch_data=0 2023-10-05T21:16:19.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.572+0000 7faf190ef680 10 cache get: name=default.rgw.meta+root+myfoo6 : type miss (requested=0x16, cached=0x13) 2023-10-05T21:16:19.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.572+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:152 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f1ab0 con 0x564307126bf0 2023-10-05T21:16:19.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.572+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 48 ==== osd_op_reply(152 myfoo6 [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv18 ondisk = 0) v8 ==== 234+0+139 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.572+0000 7faf190ef680 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x16 2023-10-05T21:16:19.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.572+0000 7faf190ef680 10 moving default.rgw.meta+root+myfoo6 to cache LRU end 2023-10-05T21:16:19.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.572+0000 7faf190ef680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:16:19.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.572+0000 7faf190ef680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:16:19.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.572+0000 7faf190ef680 10 cache get: name=default.rgw.meta+root+myfoo6 : hit (requested=0x11, cached=0x17) 2023-10-05T21:16:19.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.572+0000 7faf190ef680 10 removing default.rgw.meta+root+myfoo6 from cache 2023-10-05T21:16:19.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.572+0000 7faf190ef680 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2023-10-05T21:16:19.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.572+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:153 7.e 7:7759931f:::notify.3:head [notify cookie 94845882274144 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f1ab0 con 0x7faf0002d020 2023-10-05T21:16:19.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.573+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 31 ==== watch-notify(notify (1) cookie 94845881686672 notify 133143986194 ret 0) v3 ==== 192+0+0 (crc 0 0 0) 0x7faefc062060 con 0x7faf0002d020 2023-10-05T21:16:19.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.573+0000 7faf0a1c3700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986194 cookie 94845881686672 notifier 4730 bl.length()=150 2023-10-05T21:16:19.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.573+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 32 ==== osd_op_reply(153 notify.3 [notify cookie 94845882274144 out=8b] v0'0 uv252 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7faefc05c0a0 con 0x7faf0002d020 2023-10-05T21:16:19.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.573+0000 7faf0a1c3700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:154 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faeec003c50 con 0x7faf0002d020 2023-10-05T21:16:19.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.573+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 33 ==== watch-notify(notify_complete (2) cookie 94845882274144 notify 133143986194 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5643071793c0 con 0x7faf0002d020 2023-10-05T21:16:19.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.573+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 34 ==== osd_op_reply(154 notify.3 [notify-ack] v0'0 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faefc05c0a0 con 0x7faf0002d020 2023-10-05T21:16:19.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.573+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:155 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f1ab0 con 0x564307126bf0 2023-10-05T21:16:19.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.574+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 49 ==== osd_op_reply(155 myfoo6 [call,call,delete] v31'19 uv19 ondisk = 0) v8 ==== 234+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.574+0000 7faf190ef680 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 from cache 2023-10-05T21:16:19.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.574+0000 7faf190ef680 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7, ofs0, ns] 2023-10-05T21:16:19.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.574+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:156 7.3 7:c609908c:::notify.5:head [notify cookie 94845882274144 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f1ab0 con 0x7faefc007030 2023-10-05T21:16:19.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.574+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 42 ==== watch-notify(notify (1) cookie 94845881677760 notify 133143986210 ret 0) v3 ==== 249+0+0 (crc 0 0 0) 0x7faf04066130 con 0x7faefc007030 2023-10-05T21:16:19.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.574+0000 7faf0a1c3700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986210 cookie 94845881677760 notifier 4730 bl.length()=207 2023-10-05T21:16:19.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.574+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 43 ==== osd_op_reply(156 notify.5 [notify cookie 94845882274144 out=8b] v0'0 uv252 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.574+0000 7faf0a1c3700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faeec003c50 con 0x7faefc007030 2023-10-05T21:16:19.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.575+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 44 ==== watch-notify(notify_complete (2) cookie 94845882274144 notify 133143986210 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7faf0402d040 con 0x7faefc007030 2023-10-05T21:16:19.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.575+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 45 ==== osd_op_reply(157 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.575+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:158 8.1c 8:3bd4508d:root::.bucket.meta.myfoo6%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f1ab0 con 0x564307157010 2023-10-05T21:16:19.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.575+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 36 ==== osd_op_reply(158 .bucket.meta.myfoo6:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 [call,call,delete] v31'4 uv4 ondisk = 0) v8 ==== 291+0+0 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.575+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:159 4.24 4:250a2177:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f1ab0 con 0x7faefc007030 2023-10-05T21:16:19.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.575+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:160 4.1 4:80edd8c1:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f83e0 con 0x7faf0002d020 2023-10-05T21:16:19.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.575+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:161 4.4 4:2044a8d5:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307203d80 con 0x7faefc007030 2023-10-05T21:16:19.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.576+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:162 4.19 4:9b1150cc:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f1ab0 con 0x564307157010 2023-10-05T21:16:19.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.576+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:163 4.7 4:e2793aa7:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307203d80 con 0x7faefc007030 2023-10-05T21:16:19.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.576+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:164 4.b 4:d2b63918:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071ef0c0 con 0x7faf0002d020 2023-10-05T21:16:19.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.576+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:165 4.18 4:1be2c7da:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071efa30 con 0x7faf0002d020 2023-10-05T21:16:19.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.576+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:166 4.28 4:15f0786f:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307203d80 con 0x564307126bf0 2023-10-05T21:16:19.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.576+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:167 4.39 4:9fce90f7:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f1ab0 con 0x564307157010 2023-10-05T21:16:19.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.576+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:168 4.3c 4:3e7461c4:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071ef0c0 con 0x564307126bf0 2023-10-05T21:16:19.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.576+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:169 4.a 4:525ffd34:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071efa30 con 0x7faf0002d020 2023-10-05T21:16:19.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.576+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 35 ==== osd_op_reply(164 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.5 [delete] v31'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7faefc05c0a0 con 0x7faf0002d020 2023-10-05T21:16:19.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.577+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 36 ==== osd_op_reply(165 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.6 [delete] v31'12 uv12 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7faefc05c0a0 con 0x7faf0002d020 2023-10-05T21:16:19.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.577+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 37 ==== osd_op_reply(167 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.8 [delete] v31'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.577+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 38 ==== osd_op_reply(162 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.3 [delete] v31'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.577+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 46 ==== osd_op_reply(159 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.0 [delete] v31'5 uv5 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.577+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 47 ==== osd_op_reply(163 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.4 [delete] v31'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.577+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 48 ==== osd_op_reply(161 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.2 [delete] v31'3 uv3 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.577+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 37 ==== osd_op_reply(169 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.10 [delete] v31'22 uv22 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7faefc05c0a0 con 0x7faf0002d020 2023-10-05T21:16:19.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.577+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 50 ==== osd_op_reply(166 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.7 [delete] v31'3 uv3 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.577+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 51 ==== osd_op_reply(168 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.9 [delete] v31'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.577+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 38 ==== osd_op_reply(160 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7.1 [delete] v31'5 uv5 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7faefc05c0a0 con 0x7faf0002d020 2023-10-05T21:16:19.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.577+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:170 6.13 6:cce8aefd:::pubsub..bucket.myfoo6%2f193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307203d80 con 0x7faefc007030 2023-10-05T21:16:19.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.578+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 49 ==== osd_op_reply(170 pubsub..bucket.myfoo6/193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 [getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 251+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.578+0000 7faf190ef680 10 removing default.rgw.log++pubsub..bucket.myfoo6/193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 from cache 2023-10-05T21:16:19.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.578+0000 7faf190ef680 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo6/193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7, ofs0, ns] 2023-10-05T21:16:19.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.578+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:171 7.d 7:b4812045:::notify.4:head [notify cookie 94845882274144 in=216b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f1ab0 con 0x564307126bf0 2023-10-05T21:16:19.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.578+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 52 ==== watch-notify(notify (1) cookie 94845881688720 notify 133143986201 ret 0) v3 ==== 246+0+0 (crc 0 0 0) 0x7faf0402d040 con 0x564307126bf0 2023-10-05T21:16:19.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.578+0000 7faf0a1c3700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986201 cookie 94845881688720 notifier 4730 bl.length()=204 2023-10-05T21:16:19.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.578+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 53 ==== osd_op_reply(171 notify.4 [notify cookie 94845882274144 out=8b] v0'0 uv252 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.578+0000 7faf0a1c3700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:172 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faeec003c50 con 0x564307126bf0 2023-10-05T21:16:19.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.578+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 54 ==== osd_op_reply(172 notify.4 [notify-ack] v0'0 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.578+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 55 ==== watch-notify(notify_complete (2) cookie 94845882274144 notify 133143986201 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7faf04068ac0 con 0x564307126bf0 2023-10-05T21:16:19.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.578+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:173 6.13 6:cce8aefd:::pubsub..bucket.myfoo6%2f193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071ef0c0 con 0x7faefc007030 2023-10-05T21:16:19.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.579+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 50 ==== osd_op_reply(173 pubsub..bucket.myfoo6/193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.7 [delete] v31'34 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 209+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.579+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:174 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=59b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564307203d80 con 0x564307126bf0 2023-10-05T21:16:19.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.580+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 56 ==== osd_op_reply(174 bud.buckets [call] v31'5 uv5 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.580+0000 7faf190ef680 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2023-10-05T21:16:19.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.580+0000 7faf190ef680 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2023-10-05T21:16:19.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.580+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:175 7.3 7:c609908c:::notify.5:head [notify cookie 94845882274144 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f1ab0 con 0x7faefc007030 2023-10-05T21:16:19.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.580+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 51 ==== watch-notify(notify (1) cookie 94845881677760 notify 133143986211 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x7faf04068ac0 con 0x7faefc007030 2023-10-05T21:16:19.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.580+0000 7faf099c2700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986211 cookie 94845881677760 notifier 4730 bl.length()=170 2023-10-05T21:16:19.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.580+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 52 ==== osd_op_reply(175 notify.5 [notify cookie 94845882274144 out=8b] v0'0 uv252 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.580+0000 7faf099c2700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fae5c0034c0 con 0x7faefc007030 2023-10-05T21:16:19.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.580+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 53 ==== osd_op_reply(176 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.581+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 54 ==== watch-notify(notify_complete (2) cookie 94845882274144 notify 133143986211 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7faf04068cf0 con 0x7faefc007030 2023-10-05T21:16:19.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.581+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:177 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071ef0c0 con 0x564307126bf0 2023-10-05T21:16:19.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.581+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 57 ==== osd_op_reply(177 NX5QOQKC6BH2IDN8HC7A [delete] v31'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.581+0000 7faf190ef680 10 removing email index: 2023-10-05T21:16:19.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.581+0000 7faf190ef680 10 removing user buckets index 2023-10-05T21:16:19.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.581+0000 7faf190ef680 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2023-10-05T21:16:19.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.581+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:178 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94845882274144 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f1ab0 con 0x7faefc007030 2023-10-05T21:16:19.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.582+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 55 ==== watch-notify(notify (1) cookie 94845881695104 notify 133143986212 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x7faf04068cf0 con 0x7faefc007030 2023-10-05T21:16:19.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.582+0000 7faf099c2700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986212 cookie 94845881695104 notifier 4730 bl.length()=160 2023-10-05T21:16:19.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.582+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 56 ==== osd_op_reply(178 notify.6 [notify cookie 94845882274144 out=8b] v0'0 uv252 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.582+0000 7faf099c2700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:179 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fae5c0034c0 con 0x7faefc007030 2023-10-05T21:16:19.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.582+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 57 ==== watch-notify(notify_complete (2) cookie 94845882274144 notify 133143986212 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7faf04060580 con 0x7faefc007030 2023-10-05T21:16:19.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.582+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 58 ==== osd_op_reply(179 notify.6 [notify-ack] v0'0 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.582+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:180 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071ef0c0 con 0x564307126bf0 2023-10-05T21:16:19.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.583+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 58 ==== osd_op_reply(180 bud.buckets [delete] v31'6 uv6 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7faf0400a570 con 0x564307126bf0 2023-10-05T21:16:19.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.583+0000 7faf190ef680 10 removing user index: bud 2023-10-05T21:16:19.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.583+0000 7faf190ef680 10 removing default.rgw.meta+users.uid+bud from cache 2023-10-05T21:16:19.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.583+0000 7faf190ef680 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2023-10-05T21:16:19.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.583+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:181 7.3 7:c609908c:::notify.5:head [notify cookie 94845882274144 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f1ab0 con 0x7faefc007030 2023-10-05T21:16:19.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.583+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 59 ==== watch-notify(notify (1) cookie 94845881677760 notify 133143986213 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x7faf04078040 con 0x7faefc007030 2023-10-05T21:16:19.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.583+0000 7faf0a1c3700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986213 cookie 94845881677760 notifier 4730 bl.length()=152 2023-10-05T21:16:19.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.583+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 60 ==== osd_op_reply(181 notify.5 [notify cookie 94845882274144 out=8b] v0'0 uv252 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7faf0400a570 con 0x7faefc007030 2023-10-05T21:16:19.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.583+0000 7faf0a1c3700 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:182 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faeec003c50 con 0x7faefc007030 2023-10-05T21:16:19.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.583+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 61 ==== watch-notify(notify_complete (2) cookie 94845882274144 notify 133143986213 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7faf04060580 con 0x7faefc007030 2023-10-05T21:16:19.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.583+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 62 ==== osd_op_reply(182 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf0407a040 con 0x7faefc007030 2023-10-05T21:16:19.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.583+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:183 8.4 8:267425a8:users.uid::bud:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071ef0c0 con 0x7faf0002d020 2023-10-05T21:16:19.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.584+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 39 ==== osd_op_reply(183 bud [call,delete] v31'3 uv3 ondisk = 0) v8 ==== 189+0+0 (crc 0 0 0) 0x7faefc05c0a0 con 0x7faf0002d020 2023-10-05T21:16:19.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.584+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:184 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94845881672320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f1ab0 con 0x7faf0002d020 2023-10-05T21:16:19.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.585+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 40 ==== osd_op_reply(184 notify.0 [watch unwatch cookie 94845881672320] v31'254 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faefc05c0a0 con 0x7faf0002d020 2023-10-05T21:16:19.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.585+0000 7faf190ef680 20 remove_watcher() i=0 2023-10-05T21:16:19.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.585+0000 7faf190ef680 2 removed watcher, disabling cache 2023-10-05T21:16:19.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.585+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:185 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94845881675552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f1ab0 con 0x564307126bf0 2023-10-05T21:16:19.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.586+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 59 ==== osd_op_reply(185 notify.1 [watch unwatch cookie 94845881675552] v31'254 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf0407a040 con 0x564307126bf0 2023-10-05T21:16:19.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.586+0000 7faf190ef680 20 remove_watcher() i=1 2023-10-05T21:16:19.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.586+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:186 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94845881680768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f1ab0 con 0x564307157010 2023-10-05T21:16:19.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.587+0000 7faf0c1c7700 1 -- 172.21.15.153:0/946936814 <== osd.3 v2:172.21.15.153:6800/140455 39 ==== osd_op_reply(186 notify.2 [watch unwatch cookie 94845881680768] v31'254 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf00014070 con 0x564307157010 2023-10-05T21:16:19.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.587+0000 7faf190ef680 20 remove_watcher() i=2 2023-10-05T21:16:19.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.587+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:187 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94845881686672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f1ab0 con 0x7faf0002d020 2023-10-05T21:16:19.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.588+0000 7faf0b9c6700 1 -- 172.21.15.153:0/946936814 <== osd.2 v2:172.21.15.153:6807/140454 41 ==== osd_op_reply(187 notify.3 [watch unwatch cookie 94845881686672] v31'254 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faefc05c0a0 con 0x7faf0002d020 2023-10-05T21:16:19.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.588+0000 7faf190ef680 20 remove_watcher() i=3 2023-10-05T21:16:19.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.588+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:188 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94845881688720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f1ab0 con 0x564307126bf0 2023-10-05T21:16:19.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.589+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 60 ==== osd_op_reply(188 notify.4 [watch unwatch cookie 94845881688720] v31'254 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf0407a040 con 0x564307126bf0 2023-10-05T21:16:19.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.589+0000 7faf190ef680 20 remove_watcher() i=4 2023-10-05T21:16:19.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.589+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:189 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94845881677760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f1ab0 con 0x7faefc007030 2023-10-05T21:16:19.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.590+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 63 ==== osd_op_reply(189 notify.5 [watch unwatch cookie 94845881677760] v31'254 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf0407a040 con 0x7faefc007030 2023-10-05T21:16:19.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.590+0000 7faf190ef680 20 remove_watcher() i=5 2023-10-05T21:16:19.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.590+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:190 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94845881695104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f1ab0 con 0x7faefc007030 2023-10-05T21:16:19.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.591+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 64 ==== osd_op_reply(190 notify.6 [watch unwatch cookie 94845881695104] v31'254 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf0407a040 con 0x7faefc007030 2023-10-05T21:16:19.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.591+0000 7faf190ef680 20 remove_watcher() i=6 2023-10-05T21:16:19.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.591+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:191 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94845881692448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f1ab0 con 0x7faefc007030 2023-10-05T21:16:19.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.592+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.0 v2:172.21.15.111:6800/111394 65 ==== osd_op_reply(191 notify.7 [watch unwatch cookie 94845881692448] v31'254 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf0407a040 con 0x7faefc007030 2023-10-05T21:16:19.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.592+0000 7faf190ef680 20 remove_watcher() i=7 2023-10-05T21:16:19.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.593+0000 7faeddfe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:16:19.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.593+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:192 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94845881698288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643071f1ab0 con 0x564307126bf0 2023-10-05T21:16:19.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.593+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 <== osd.1 v2:172.21.15.153:6816/140456 61 ==== osd_op_reply(192 data_loggenerations_metadata [watch unwatch cookie 94845881698288] v31'243 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7faf0407a040 con 0x564307126bf0 2023-10-05T21:16:19.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.593+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7faefc007030 msgr2=0x7faefc01d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.593+0000 7faf190ef680 1 --2- 172.21.15.153:0/946936814 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7faefc007030 0x7faefc01d420 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.593+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x564307126bf0 msgr2=0x564307154ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.593+0000 7faf190ef680 1 --2- 172.21.15.153:0/946936814 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x564307126bf0 0x564307154ba0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.593+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7faf0002d020 msgr2=0x7faf0002c5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.593+0000 7faf190ef680 1 --2- 172.21.15.153:0/946936814 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7faf0002d020 0x7faf0002c5d0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.593+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x564307157010 msgr2=0x5643071593f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.593+0000 7faf190ef680 1 --2- 172.21.15.153:0/946936814 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x564307157010 0x5643071593f0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.594+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7faef80340f0 msgr2=0x7faef80365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.594+0000 7faf190ef680 1 --2- 172.21.15.153:0/946936814 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7faef80340f0 0x7faef80365a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faefc003080 tx=0x7faefc015000 comp rx=0 tx=0).stop 2023-10-05T21:16:19.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.594+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5643071207c0 msgr2=0x564307148e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.594+0000 7faf190ef680 1 --2- 172.21.15.153:0/946936814 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5643071207c0 0x564307148e10 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7faf000017d0 tx=0x7faf00016000 comp rx=0 tx=0).stop 2023-10-05T21:16:19.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.594+0000 7faf0c9c8700 1 -- 172.21.15.153:0/946936814 reap_dead start 2023-10-05T21:16:19.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.594+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 shutdown_connections 2023-10-05T21:16:19.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.594+0000 7faf190ef680 1 --2- 172.21.15.153:0/946936814 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5643071207c0 0x564307148e10 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.594+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 >> 172.21.15.153:0/946936814 conn(0x56430711c310 msgr2=0x56430713bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:19.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.594+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 shutdown_connections 2023-10-05T21:16:19.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.594+0000 7faf190ef680 1 -- 172.21.15.153:0/946936814 wait complete. 2023-10-05T21:16:19.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.594+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x564307186f80 msgr2=0x564307189360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.594+0000 7faf190ef680 1 --2- 172.21.15.153:0/34247955 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x564307186f80 0x564307189360 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.594+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x564307183690 msgr2=0x564307185b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.594+0000 7faf190ef680 1 --2- 172.21.15.153:0/34247955 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x564307183690 0x564307185b40 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.594+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x56430718e790 msgr2=0x564307190c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.594+0000 7faf190ef680 1 --2- 172.21.15.153:0/34247955 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x56430718e790 0x564307190c20 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.594+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x56430718a7f0 msgr2=0x56430718cc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.594+0000 7faf190ef680 1 --2- 172.21.15.153:0/34247955 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x56430718a7f0 0x56430718cc10 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.594+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fae4c034140 msgr2=0x7fae4c0365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.594+0000 7faf190ef680 1 --2- 172.21.15.153:0/34247955 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fae4c034140 0x7fae4c0365f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x564307164d70 tx=0x7faf04037450 comp rx=0 tx=0).stop 2023-10-05T21:16:19.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.594+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564307171b90 msgr2=0x564307178890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.594+0000 7faf190ef680 1 --2- 172.21.15.153:0/34247955 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564307171b90 0x564307178890 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x56430716d400 tx=0x7faefc030000 comp rx=0 tx=0).stop 2023-10-05T21:16:19.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.594+0000 7faf0c1c7700 1 -- 172.21.15.153:0/34247955 reap_dead start 2023-10-05T21:16:19.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.594+0000 7faf0c1c7700 1 -- 172.21.15.153:0/34247955 reap_dead start 2023-10-05T21:16:19.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.594+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 shutdown_connections 2023-10-05T21:16:19.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.594+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 >> 172.21.15.153:0/34247955 conn(0x56430716de90 msgr2=0x56430716bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:19.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.594+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 shutdown_connections 2023-10-05T21:16:19.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.594+0000 7faf190ef680 1 -- 172.21.15.153:0/34247955 wait complete. 2023-10-05T21:16:19.626 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2023-10-05T21:16:19.626 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2023-10-05T21:16:19.626 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2023-10-05T21:16:19.671 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:16:19.671 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:16:19.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.669+0000 7fa4afe58680 1 Processor -- start 2023-10-05T21:16:19.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.669+0000 7fa4afe58680 1 -- start start 2023-10-05T21:16:19.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.669+0000 7fa4afe58680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55e9ca2c07c0 0x55e9ca2c2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.669+0000 7fa4afe58680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e9ca209930 con 0x55e9ca2300b0 2023-10-05T21:16:19.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.669+0000 7fa4afe58680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e9ca1c9db0 con 0x55e9ca2c07c0 2023-10-05T21:16:19.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.670+0000 7fa4a272f700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55e9ca2c07c0 0x55e9ca2c2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.670+0000 7fa4a272f700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55e9ca2c07c0 0x55e9ca2c2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:53226/0 (socket says 172.21.15.153:53226) 2023-10-05T21:16:19.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.670+0000 7fa4a272f700 1 -- 172.21.15.153:0/357627856 learned_addr learned my addr 172.21.15.153:0/357627856 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:19.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.670+0000 7fa4a2f30700 1 --1- 172.21.15.153:0/357627856 >> v1:172.21.15.111:6789/0 conn(0x55e9ca2300b0 0x55e9ca2bf0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:38838/0 (socket says 172.21.15.153:38838) 2023-10-05T21:16:19.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.670+0000 7fa4a272f700 1 -- 172.21.15.153:0/357627856 >> v1:172.21.15.111:6789/0 conn(0x55e9ca2300b0 legacy=0x55e9ca2bf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.670+0000 7fa4a272f700 1 -- 172.21.15.153:0/357627856 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9ca2c41f0 con 0x55e9ca2c07c0 2023-10-05T21:16:19.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.670+0000 7fa4a1f2e700 1 -- 172.21.15.153:0/357627856 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 599637817 0 0) 0x55e9ca209930 con 0x55e9ca2300b0 2023-10-05T21:16:19.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.670+0000 7fa4a272f700 1 --2- 172.21.15.153:0/357627856 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca2c07c0 0x55e9ca2c2ba0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa49400a650 tx=0x7fa494005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a656b59e743b7d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.670+0000 7fa4a1f2e700 1 -- 172.21.15.153:0/357627856 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa494008760 con 0x55e9ca2c07c0 2023-10-05T21:16:19.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.670+0000 7fa4a1f2e700 1 -- 172.21.15.153:0/357627856 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4940088c0 con 0x55e9ca2c07c0 2023-10-05T21:16:19.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.670+0000 7fa4a1f2e700 1 -- 172.21.15.153:0/357627856 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa494008bb0 con 0x55e9ca2c07c0 2023-10-05T21:16:19.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.671+0000 7fa4afe58680 1 -- 172.21.15.153:0/357627856 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca2c07c0 msgr2=0x55e9ca2c2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.671+0000 7fa4afe58680 1 --2- 172.21.15.153:0/357627856 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca2c07c0 0x55e9ca2c2ba0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa49400a650 tx=0x7fa494005b10 comp rx=0 tx=0).stop 2023-10-05T21:16:19.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.671+0000 7fa4afe58680 1 -- 172.21.15.153:0/357627856 shutdown_connections 2023-10-05T21:16:19.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.671+0000 7fa4afe58680 1 --2- 172.21.15.153:0/357627856 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca2c07c0 0x55e9ca2c2ba0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.671+0000 7fa4afe58680 1 -- 172.21.15.153:0/357627856 >> 172.21.15.153:0/357627856 conn(0x55e9ca2b6b90 msgr2=0x55e9ca2b8fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:19.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.671+0000 7fa4afe58680 1 -- 172.21.15.153:0/357627856 shutdown_connections 2023-10-05T21:16:19.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.671+0000 7fa4afe58680 1 -- 172.21.15.153:0/357627856 wait complete. 2023-10-05T21:16:19.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.672+0000 7fa4afe58680 1 Processor -- start 2023-10-05T21:16:19.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.672+0000 7fa4afe58680 1 -- start start 2023-10-05T21:16:19.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.672+0000 7fa4afe58680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca2300b0 0x55e9ca2db800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.672+0000 7fa4afe58680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9ca169ea0 con 0x55e9ca2300b0 2023-10-05T21:16:19.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.672+0000 7fa4a2f30700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca2300b0 0x55e9ca2db800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.672+0000 7fa4a2f30700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca2300b0 0x55e9ca2db800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:53228/0 (socket says 172.21.15.153:53228) 2023-10-05T21:16:19.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.672+0000 7fa4a2f30700 1 -- 172.21.15.153:0/3871366976 learned_addr learned my addr 172.21.15.153:0/3871366976 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:19.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.672+0000 7fa4a2f30700 1 -- 172.21.15.153:0/3871366976 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa494005db0 con 0x55e9ca2300b0 2023-10-05T21:16:19.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.672+0000 7fa4a2f30700 1 --2- 172.21.15.153:0/3871366976 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca2300b0 0x55e9ca2db800 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa498001e70 tx=0x7fa498001870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04595e4efd3f323 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.672+0000 7fa4a0f2c700 1 -- 172.21.15.153:0/3871366976 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa498014070 con 0x55e9ca2300b0 2023-10-05T21:16:19.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.673+0000 7fa4a0f2c700 1 -- 172.21.15.153:0/3871366976 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49800f450 con 0x55e9ca2300b0 2023-10-05T21:16:19.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.673+0000 7fa4a0f2c700 1 -- 172.21.15.153:0/3871366976 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa49800f740 con 0x55e9ca2300b0 2023-10-05T21:16:19.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.673+0000 7fa4afe58680 1 -- 172.21.15.153:0/3871366976 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca2300b0 msgr2=0x55e9ca2db800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.673+0000 7fa4afe58680 1 --2- 172.21.15.153:0/3871366976 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca2300b0 0x55e9ca2db800 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa498001e70 tx=0x7fa498001870 comp rx=0 tx=0).stop 2023-10-05T21:16:19.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.673+0000 7fa4afe58680 1 -- 172.21.15.153:0/3871366976 shutdown_connections 2023-10-05T21:16:19.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.673+0000 7fa4afe58680 1 --2- 172.21.15.153:0/3871366976 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca2300b0 0x55e9ca2db800 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.673+0000 7fa4afe58680 1 -- 172.21.15.153:0/3871366976 >> 172.21.15.153:0/3871366976 conn(0x55e9ca2b6b90 msgr2=0x55e9ca2d72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:19.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.673+0000 7fa4afe58680 1 -- 172.21.15.153:0/3871366976 shutdown_connections 2023-10-05T21:16:19.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.673+0000 7fa4afe58680 1 -- 172.21.15.153:0/3871366976 wait complete. 2023-10-05T21:16:19.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.673+0000 7fa4afe58680 1 Processor -- start 2023-10-05T21:16:19.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.673+0000 7fa4afe58680 1 -- start start 2023-10-05T21:16:19.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.673+0000 7fa4afe58680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca2300b0 0x55e9ca2bca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.674+0000 7fa4afe58680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9ca160c80 con 0x55e9ca2300b0 2023-10-05T21:16:19.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.674+0000 7fa4a2f30700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca2300b0 0x55e9ca2bca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.674+0000 7fa4a2f30700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca2300b0 0x55e9ca2bca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:53236/0 (socket says 172.21.15.153:53236) 2023-10-05T21:16:19.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.674+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 learned_addr learned my addr 172.21.15.153:0/2509179171 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:19.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.674+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa498001b50 con 0x55e9ca2300b0 2023-10-05T21:16:19.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.674+0000 7fa4a2f30700 1 --2- 172.21.15.153:0/2509179171 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca2300b0 0x55e9ca2bca20 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fa498000c00 tx=0x7fa498016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.674+0000 7fa492ffd700 1 -- 172.21.15.153:0/2509179171 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa49800fe30 con 0x55e9ca2300b0 2023-10-05T21:16:19.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.674+0000 7fa492ffd700 1 -- 172.21.15.153:0/2509179171 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49801cae0 con 0x55e9ca2300b0 2023-10-05T21:16:19.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.674+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e9ca2bb040 con 0x55e9ca2300b0 2023-10-05T21:16:19.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.674+0000 7fa492ffd700 1 -- 172.21.15.153:0/2509179171 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa49801cdb0 con 0x55e9ca2300b0 2023-10-05T21:16:19.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.674+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e9ca2bb490 con 0x55e9ca2300b0 2023-10-05T21:16:19.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.675+0000 7fa492ffd700 1 -- 172.21.15.153:0/2509179171 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fa498023020 con 0x55e9ca2300b0 2023-10-05T21:16:19.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.675+0000 7fa492ffd700 1 --2- 172.21.15.153:0/2509179171 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa4880340f0 0x7fa4880365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.675+0000 7fa492ffd700 1 -- 172.21.15.153:0/2509179171 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fa498008030 con 0x55e9ca2300b0 2023-10-05T21:16:19.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.675+0000 7fa4a272f700 1 --2- 172.21.15.153:0/2509179171 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa4880340f0 0x7fa4880365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.675+0000 7fa4afe58680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.675+0000 7fa4afe58680 1 --2- 172.21.15.153:0/2509179171 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55e9ca2eeba0 0x55e9ca2f1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.675+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f17e0 con 0x55e9ca2eeba0 2023-10-05T21:16:19.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.676+0000 7fa4a3731700 1 --2- 172.21.15.153:0/2509179171 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55e9ca2eeba0 0x55e9ca2f1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.676+0000 7fa4a272f700 1 --2- 172.21.15.153:0/2509179171 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa4880340f0 0x7fa4880365a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x55e9ca22f8d0 tx=0x7fa494015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.676+0000 7fa4a3731700 1 --2- 172.21.15.153:0/2509179171 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55e9ca2eeba0 0x55e9ca2f1050 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.676+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.676+0000 7fa4afe58680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.676+0000 7fa4afe58680 20 realm 2023-10-05T21:16:19.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.676+0000 7fa4afe58680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.676+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2ee180 con 0x55e9ca2eeba0 2023-10-05T21:16:19.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.676+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.676+0000 7fa4afe58680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.676+0000 7fa4afe58680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:16:19.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.676+0000 7fa4afe58680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.676+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f2290 con 0x55e9ca2eeba0 2023-10-05T21:16:19.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.677+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.677+0000 7fa4afe58680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.677+0000 7fa4afe58680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.677+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f2bb0 con 0x55e9ca2eeba0 2023-10-05T21:16:19.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.677+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.677+0000 7fa4afe58680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:19.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.677+0000 7fa4afe58680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.677+0000 7fa4afe58680 1 --2- 172.21.15.153:0/2509179171 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55e9ca2f3470 0x55e9ca2f5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.677+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f5e60 con 0x55e9ca2f3470 2023-10-05T21:16:19.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.677+0000 7fa4a2f30700 1 --2- 172.21.15.153:0/2509179171 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55e9ca2f3470 0x55e9ca2f5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.677+0000 7fa4a2f30700 1 --2- 172.21.15.153:0/2509179171 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55e9ca2f3470 0x55e9ca2f5850 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.677+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa498016070 con 0x55e9ca2f3470 2023-10-05T21:16:19.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.678+0000 7fa4afe58680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:16:19.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.678+0000 7fa4afe58680 20 searching for the correct realm 2023-10-05T21:16:19.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.678+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x55e9ca2f3470 2023-10-05T21:16:19.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.678+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa498016070 con 0x55e9ca2f3470 2023-10-05T21:16:19.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.678+0000 7fa4a2f30700 1 --2- 172.21.15.153:0/2509179171 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fa49801a070 0x7fa49803d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.678+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x7fa49801a070 2023-10-05T21:16:19.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.678+0000 7fa4a272f700 1 --2- 172.21.15.153:0/2509179171 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fa49801a070 0x7fa49803d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.678+0000 7fa4a272f700 1 --2- 172.21.15.153:0/2509179171 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fa49801a070 0x7fa49803d990 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.678+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa494019040 con 0x7fa49801a070 2023-10-05T21:16:19.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.678+0000 7fa4a272f700 1 --2- 172.21.15.153:0/2509179171 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55e9ca2c07c0 0x7fa49401d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.678+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x55e9ca2c07c0 2023-10-05T21:16:19.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.679+0000 7fa4a3731700 1 --2- 172.21.15.153:0/2509179171 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55e9ca2c07c0 0x7fa49401d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.679+0000 7fa4a3731700 1 --2- 172.21.15.153:0/2509179171 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55e9ca2c07c0 0x7fa49401d420 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.679+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.679+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x55e9ca2eeba0 2023-10-05T21:16:19.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.680+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.680+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x55e9ca2eeba0 2023-10-05T21:16:19.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.680+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.680+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x55e9ca2c07c0 2023-10-05T21:16:19.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.680+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.680+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x55e9ca2c07c0 2023-10-05T21:16:19.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.680+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.680+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x7fa49801a070 2023-10-05T21:16:19.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.681+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa494019040 con 0x7fa49801a070 2023-10-05T21:16:19.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.681+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x55e9ca2f3470 2023-10-05T21:16:19.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.681+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa498016070 con 0x55e9ca2f3470 2023-10-05T21:16:19.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.681+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x55e9ca2eeba0 2023-10-05T21:16:19.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.681+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.681+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x55e9ca2c07c0 2023-10-05T21:16:19.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.681+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.681+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x55e9ca2eeba0 2023-10-05T21:16:19.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.681+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.681+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x7fa49801a070 2023-10-05T21:16:19.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.682+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa494019040 con 0x7fa49801a070 2023-10-05T21:16:19.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.682+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x55e9ca2f3470 2023-10-05T21:16:19.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.682+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa498016070 con 0x55e9ca2f3470 2023-10-05T21:16:19.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.682+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x55e9ca2f3470 2023-10-05T21:16:19.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.682+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa498016070 con 0x55e9ca2f3470 2023-10-05T21:16:19.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.682+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x55e9ca2c07c0 2023-10-05T21:16:19.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.683+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.683+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x55e9ca2f3470 2023-10-05T21:16:19.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.683+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa498016070 con 0x55e9ca2f3470 2023-10-05T21:16:19.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.683+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x55e9ca2f3470 2023-10-05T21:16:19.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.683+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa498016070 con 0x55e9ca2f3470 2023-10-05T21:16:19.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.683+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x55e9ca2eeba0 2023-10-05T21:16:19.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.683+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.683+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x55e9ca2eeba0 2023-10-05T21:16:19.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.683+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.683+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x55e9ca2c07c0 2023-10-05T21:16:19.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.684+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.684+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x55e9ca2f3470 2023-10-05T21:16:19.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.684+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa498016070 con 0x55e9ca2f3470 2023-10-05T21:16:19.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.684+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x7fa49801a070 2023-10-05T21:16:19.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.684+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa494019040 con 0x7fa49801a070 2023-10-05T21:16:19.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.684+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x55e9ca2eeba0 2023-10-05T21:16:19.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.684+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.685+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x55e9ca2c07c0 2023-10-05T21:16:19.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.685+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.685+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x55e9ca2f3470 2023-10-05T21:16:19.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.685+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa498016070 con 0x55e9ca2f3470 2023-10-05T21:16:19.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.685+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x55e9ca2c07c0 2023-10-05T21:16:19.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.686+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.686+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x7fa49801a070 2023-10-05T21:16:19.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.686+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa494019040 con 0x7fa49801a070 2023-10-05T21:16:19.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.686+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x55e9ca2f3470 2023-10-05T21:16:19.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.686+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa498016070 con 0x55e9ca2f3470 2023-10-05T21:16:19.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.686+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x55e9ca2c07c0 2023-10-05T21:16:19.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.686+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.686+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x55e9ca2eeba0 2023-10-05T21:16:19.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.686+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.686+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f79b0 con 0x7fa49801a070 2023-10-05T21:16:19.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.687+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa494019040 con 0x7fa49801a070 2023-10-05T21:16:19.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.687+0000 7fa4afe58680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:16:19.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.687+0000 7fa4afe58680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:16:19.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.687+0000 7fa4afe58680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:16:19.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.687+0000 7fa4afe58680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:16:19.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.687+0000 7fa4afe58680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.687+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f6aa0 con 0x55e9ca2eeba0 2023-10-05T21:16:19.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.687+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.687+0000 7fa4afe58680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.687+0000 7fa4afe58680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.687+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f7390 con 0x55e9ca2eeba0 2023-10-05T21:16:19.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.687+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.687+0000 7fa4afe58680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:19.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.687+0000 7fa4afe58680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.687+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f7e40 con 0x55e9ca2eeba0 2023-10-05T21:16:19.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.687+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.687+0000 7fa4afe58680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:16:19.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.687+0000 7fa4afe58680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.687+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f81f0 con 0x55e9ca2f3470 2023-10-05T21:16:19.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.688+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca2f3470 2023-10-05T21:16:19.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.688+0000 7fa4afe58680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.688+0000 7fa4afe58680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.688+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f85a0 con 0x55e9ca2eeba0 2023-10-05T21:16:19.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.688+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.688+0000 7fa4afe58680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.688+0000 7fa4afe58680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.688+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f85a0 con 0x55e9ca2eeba0 2023-10-05T21:16:19.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.688+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.688+0000 7fa4afe58680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:19.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.688+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f85a0 con 0x55e9ca2f3470 2023-10-05T21:16:19.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.688+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca2f3470 2023-10-05T21:16:19.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.688+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f85a0 con 0x7fa49801a070 2023-10-05T21:16:19.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.688+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa494019040 con 0x7fa49801a070 2023-10-05T21:16:19.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.689+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f85a0 con 0x55e9ca2c07c0 2023-10-05T21:16:19.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.689+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.689+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f7e40 con 0x55e9ca2eeba0 2023-10-05T21:16:19.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.689+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.689+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f7e40 con 0x55e9ca2eeba0 2023-10-05T21:16:19.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.690+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.690+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f7e40 con 0x55e9ca2c07c0 2023-10-05T21:16:19.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.690+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.690+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f7e40 con 0x55e9ca2c07c0 2023-10-05T21:16:19.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.690+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.690+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f7e40 con 0x7fa49801a070 2023-10-05T21:16:19.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.690+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa494019040 con 0x7fa49801a070 2023-10-05T21:16:19.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.690+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f7e40 con 0x55e9ca2f3470 2023-10-05T21:16:19.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.691+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca2f3470 2023-10-05T21:16:19.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.691+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f7e40 con 0x55e9ca2eeba0 2023-10-05T21:16:19.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.691+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.691+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f7e40 con 0x55e9ca2c07c0 2023-10-05T21:16:19.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.691+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.691+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f7e40 con 0x55e9ca2eeba0 2023-10-05T21:16:19.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.691+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.691+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f7e40 con 0x7fa49801a070 2023-10-05T21:16:19.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.691+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa494019040 con 0x7fa49801a070 2023-10-05T21:16:19.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.691+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f7e40 con 0x55e9ca2f3470 2023-10-05T21:16:19.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.692+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca2f3470 2023-10-05T21:16:19.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.692+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f7e40 con 0x55e9ca2f3470 2023-10-05T21:16:19.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.692+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca2f3470 2023-10-05T21:16:19.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.692+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f7e40 con 0x55e9ca2c07c0 2023-10-05T21:16:19.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.692+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.692+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f7e40 con 0x55e9ca2f3470 2023-10-05T21:16:19.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.692+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca2f3470 2023-10-05T21:16:19.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.692+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f7e40 con 0x55e9ca2f3470 2023-10-05T21:16:19.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.692+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca2f3470 2023-10-05T21:16:19.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.693+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f7e40 con 0x55e9ca2eeba0 2023-10-05T21:16:19.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.693+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.693+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f7e40 con 0x55e9ca2eeba0 2023-10-05T21:16:19.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.693+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.693+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f7e40 con 0x55e9ca2c07c0 2023-10-05T21:16:19.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.693+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.693+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f7e40 con 0x55e9ca2f3470 2023-10-05T21:16:19.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.693+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca2f3470 2023-10-05T21:16:19.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.693+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f7e40 con 0x7fa49801a070 2023-10-05T21:16:19.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.694+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa494019040 con 0x7fa49801a070 2023-10-05T21:16:19.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.694+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f7e40 con 0x55e9ca2eeba0 2023-10-05T21:16:19.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.694+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.694+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f7e40 con 0x55e9ca2c07c0 2023-10-05T21:16:19.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.694+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.694+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f7e40 con 0x55e9ca2f3470 2023-10-05T21:16:19.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.694+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca2f3470 2023-10-05T21:16:19.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.694+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f7e40 con 0x55e9ca2c07c0 2023-10-05T21:16:19.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.695+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.695+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f7e40 con 0x7fa49801a070 2023-10-05T21:16:19.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.695+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa494019040 con 0x7fa49801a070 2023-10-05T21:16:19.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.695+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f7e40 con 0x55e9ca2f3470 2023-10-05T21:16:19.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.695+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca2f3470 2023-10-05T21:16:19.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.695+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f7e40 con 0x55e9ca2c07c0 2023-10-05T21:16:19.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.695+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.695+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f7e40 con 0x55e9ca2eeba0 2023-10-05T21:16:19.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.696+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.696+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f7e40 con 0x7fa49801a070 2023-10-05T21:16:19.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.696+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa494019040 con 0x7fa49801a070 2023-10-05T21:16:19.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.696+0000 7fa4afe58680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:16:19.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.696+0000 7fa4afe58680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:16:19.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.696+0000 7fa4afe58680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:16:19.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.696+0000 7fa4afe58680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:16:19.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.696+0000 7fa4afe58680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.696+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f85a0 con 0x55e9ca2eeba0 2023-10-05T21:16:19.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.696+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.696+0000 7fa4afe58680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:19.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.696+0000 7fa4afe58680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.696+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f89a0 con 0x55e9ca2f3470 2023-10-05T21:16:19.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.696+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca2f3470 2023-10-05T21:16:19.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.696+0000 7fa4afe58680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:16:19.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.697+0000 7fa4afe58680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.697+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f9290 con 0x55e9ca2eeba0 2023-10-05T21:16:19.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.697+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.697+0000 7fa4afe58680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:19.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.697+0000 7fa4afe58680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.697+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f6fc0 con 0x55e9ca2eeba0 2023-10-05T21:16:19.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.697+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.697+0000 7fa4afe58680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:16:19.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.697+0000 7fa4afe58680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.697+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f9290 con 0x55e9ca2c07c0 2023-10-05T21:16:19.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.697+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.697+0000 7fa4afe58680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.697+0000 7fa4afe58680 20 zone default found 2023-10-05T21:16:19.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.697+0000 7fa4afe58680 4 Realm: () 2023-10-05T21:16:19.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.697+0000 7fa4afe58680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:16:19.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.697+0000 7fa4afe58680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:16:19.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.697+0000 7fa4afe58680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:16:19.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.697+0000 7fa4afe58680 20 zonegroup default 2023-10-05T21:16:19.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.697+0000 7fa4afe58680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.697+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f9290 con 0x55e9ca2c07c0 2023-10-05T21:16:19.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.698+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.698+0000 7fa4afe58680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.698+0000 7fa4afe58680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.698+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2f9290 con 0x55e9ca2f3470 2023-10-05T21:16:19.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.698+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca2f3470 2023-10-05T21:16:19.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.698+0000 7fa4afe58680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.698+0000 7fa4afe58680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.698+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2fb150 con 0x55e9ca2f3470 2023-10-05T21:16:19.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.698+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca2f3470 2023-10-05T21:16:19.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.698+0000 7fa4afe58680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.698+0000 7fa4afe58680 20 started sync module instance, tier type = 2023-10-05T21:16:19.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.698+0000 7fa4afe58680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:16:19.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.698+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2fa810 con 0x7fa49801a070 2023-10-05T21:16:19.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.699+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v31'255 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa494019040 con 0x7fa49801a070 2023-10-05T21:16:19.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.699+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94462607862800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2fb9f0 con 0x7fa49801a070 2023-10-05T21:16:19.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.699+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2fc290 con 0x55e9ca2eeba0 2023-10-05T21:16:19.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.700+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94462607862800] v31'256 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa494019040 con 0x7fa49801a070 2023-10-05T21:16:19.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.700+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v31'255 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.700+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94462607865088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2fc290 con 0x55e9ca2eeba0 2023-10-05T21:16:19.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.700+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2fce10 con 0x55e9ca2f3470 2023-10-05T21:16:19.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.701+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94462607865088] v31'256 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.701+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v31'255 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca2f3470 2023-10-05T21:16:19.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.701+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94462607870144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2fd1c0 con 0x55e9ca2f3470 2023-10-05T21:16:19.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.701+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2fdbd0 con 0x7fa49801a070 2023-10-05T21:16:19.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.702+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v31'255 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa494019040 con 0x7fa49801a070 2023-10-05T21:16:19.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.702+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94462607876048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2fe910 con 0x7fa49801a070 2023-10-05T21:16:19.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.702+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2ff320 con 0x55e9ca2eeba0 2023-10-05T21:16:19.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.702+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94462607870144] v31'256 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca2f3470 2023-10-05T21:16:19.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.702+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94462607876048] v31'256 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa494019040 con 0x7fa49801a070 2023-10-05T21:16:19.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.702+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v31'255 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.702+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94462607867296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2ff320 con 0x55e9ca2eeba0 2023-10-05T21:16:19.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.703+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2ffc10 con 0x55e9ca2c07c0 2023-10-05T21:16:19.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.703+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94462607867296] v31'256 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.703+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v31'255 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.703+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94462607880288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2ffa60 con 0x55e9ca2c07c0 2023-10-05T21:16:19.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.703+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca300640 con 0x55e9ca2c07c0 2023-10-05T21:16:19.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.704+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(96 notify.6 [create] v31'255 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.704+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(95 notify.5 [watch watch cookie 94462607880288] v31'256 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.704+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94462607884528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca300600 con 0x55e9ca2c07c0 2023-10-05T21:16:19.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.704+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca301540 con 0x55e9ca2c07c0 2023-10-05T21:16:19.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.705+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94462607884528] v31'256 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.705+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v31'255 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.705+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94462607886912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca300600 con 0x55e9ca2c07c0 2023-10-05T21:16:19.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.705+0000 7fa4afe58680 20 add_watcher() i=0 2023-10-05T21:16:19.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.705+0000 7fa4afe58680 20 add_watcher() i=1 2023-10-05T21:16:19.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.705+0000 7fa4afe58680 20 add_watcher() i=2 2023-10-05T21:16:19.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.705+0000 7fa4afe58680 20 add_watcher() i=3 2023-10-05T21:16:19.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.705+0000 7fa4afe58680 20 add_watcher() i=4 2023-10-05T21:16:19.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.705+0000 7fa4afe58680 20 add_watcher() i=5 2023-10-05T21:16:19.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.705+0000 7fa4afe58680 20 add_watcher() i=6 2023-10-05T21:16:19.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.706+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94462607886912] v31'256 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.706+0000 7fa4afe58680 20 add_watcher() i=7 2023-10-05T21:16:19.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.706+0000 7fa4afe58680 2 all 8 watchers are set, enabling cache 2023-10-05T21:16:19.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.706+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca304570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.706+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.706+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94462607888464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca301990 con 0x55e9ca2eeba0 2023-10-05T21:16:19.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.707+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94462607888464] v31'244 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.707+0000 7fa473fe7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:16:19.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.707+0000 7fa4afe58680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:16:19.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.707+0000 7fa4afe58680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:16:19.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.707+0000 7fa4afe58680 1 Processor -- start 2023-10-05T21:16:19.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.707+0000 7fa4afe58680 1 -- start start 2023-10-05T21:16:19.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.707+0000 7fa4afe58680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca30e130 0x55e9ca30e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.707+0000 7fa4afe58680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9ca30eb50 con 0x55e9ca30e130 2023-10-05T21:16:19.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.708+0000 7fa4a272f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca30e130 0x55e9ca30e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.708+0000 7fa4a272f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca30e130 0x55e9ca30e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:53244/0 (socket says 172.21.15.153:53244) 2023-10-05T21:16:19.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.708+0000 7fa4a272f700 1 -- 172.21.15.153:0/3038451950 learned_addr learned my addr 172.21.15.153:0/3038451950 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:19.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.708+0000 7fa4a272f700 1 -- 172.21.15.153:0/3038451950 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9ca30f030 con 0x55e9ca30e130 2023-10-05T21:16:19.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.708+0000 7fa4a272f700 1 --2- 172.21.15.153:0/3038451950 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca30e130 0x55e9ca30e540 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fa494002000 tx=0x7fa494012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f393bba502449e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.708+0000 7fa4737e6700 1 -- 172.21.15.153:0/3038451950 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa49401ddc0 con 0x55e9ca30e130 2023-10-05T21:16:19.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.708+0000 7fa4737e6700 1 -- 172.21.15.153:0/3038451950 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49402b440 con 0x55e9ca30e130 2023-10-05T21:16:19.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.708+0000 7fa4737e6700 1 -- 172.21.15.153:0/3038451950 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa49402b5f0 con 0x55e9ca30e130 2023-10-05T21:16:19.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.709+0000 7fa4afe58680 1 -- 172.21.15.153:0/3038451950 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca30e130 msgr2=0x55e9ca30e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.709+0000 7fa4afe58680 1 --2- 172.21.15.153:0/3038451950 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca30e130 0x55e9ca30e540 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fa494002000 tx=0x7fa494012000 comp rx=0 tx=0).stop 2023-10-05T21:16:19.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.709+0000 7fa4afe58680 1 -- 172.21.15.153:0/3038451950 shutdown_connections 2023-10-05T21:16:19.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.709+0000 7fa4afe58680 1 --2- 172.21.15.153:0/3038451950 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca30e130 0x55e9ca30e540 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.709+0000 7fa4afe58680 1 -- 172.21.15.153:0/3038451950 >> 172.21.15.153:0/3038451950 conn(0x55e9ca30a430 msgr2=0x55e9ca308530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:19.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.709+0000 7fa4afe58680 1 -- 172.21.15.153:0/3038451950 shutdown_connections 2023-10-05T21:16:19.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.709+0000 7fa4afe58680 1 -- 172.21.15.153:0/3038451950 wait complete. 2023-10-05T21:16:19.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.709+0000 7fa4afe58680 1 Processor -- start 2023-10-05T21:16:19.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.709+0000 7fa4afe58680 1 -- start start 2023-10-05T21:16:19.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.710+0000 7fa4afe58680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca30e130 0x55e9ca314e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.710+0000 7fa4afe58680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9ca315370 con 0x55e9ca30e130 2023-10-05T21:16:19.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.710+0000 7fa4a272f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca30e130 0x55e9ca314e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.710+0000 7fa4a272f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca30e130 0x55e9ca314e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:53256/0 (socket says 172.21.15.153:53256) 2023-10-05T21:16:19.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.710+0000 7fa4a272f700 1 -- 172.21.15.153:0/2834242823 learned_addr learned my addr 172.21.15.153:0/2834242823 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:19.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.710+0000 7fa4a272f700 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9ca2c41f0 con 0x55e9ca30e130 2023-10-05T21:16:19.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.710+0000 7fa4a272f700 1 --2- 172.21.15.153:0/2834242823 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca30e130 0x55e9ca314e30 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fa494012fd0 tx=0x7fa494030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.710+0000 7fa471fe3700 1 -- 172.21.15.153:0/2834242823 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa49401de70 con 0x55e9ca30e130 2023-10-05T21:16:19.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.710+0000 7fa471fe3700 1 -- 172.21.15.153:0/2834242823 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa494009640 con 0x55e9ca30e130 2023-10-05T21:16:19.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.710+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e9ca315570 con 0x55e9ca30e130 2023-10-05T21:16:19.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.710+0000 7fa471fe3700 1 -- 172.21.15.153:0/2834242823 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4940097f0 con 0x55e9ca30e130 2023-10-05T21:16:19.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.710+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e9ca315a20 con 0x55e9ca30e130 2023-10-05T21:16:19.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.711+0000 7fa471fe3700 1 -- 172.21.15.153:0/2834242823 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fa494009950 con 0x55e9ca30e130 2023-10-05T21:16:19.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.711+0000 7fa471fe3700 1 --2- 172.21.15.153:0/2834242823 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa3e8034190 0x7fa3e8036640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.711+0000 7fa471fe3700 1 -- 172.21.15.153:0/2834242823 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fa494030070 con 0x55e9ca30e130 2023-10-05T21:16:19.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.711+0000 7fa4a3731700 1 --2- 172.21.15.153:0/2834242823 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa3e8034190 0x7fa3e8036640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.711+0000 7fa4afe58680 1 --2- 172.21.15.153:0/2834242823 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55e9ca31fc50 0x55e9ca322100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.711+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca322800 con 0x55e9ca31fc50 2023-10-05T21:16:19.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.712+0000 7fa4a2f30700 1 --2- 172.21.15.153:0/2834242823 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55e9ca31fc50 0x55e9ca322100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.712+0000 7fa4a3731700 1 --2- 172.21.15.153:0/2834242823 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa3e8034190 0x7fa3e8036640 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55e9ca3008e0 tx=0x7fa49c037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.712+0000 7fa4a2f30700 1 --2- 172.21.15.153:0/2834242823 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55e9ca31fc50 0x55e9ca322100 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.713+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2834242823 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v31'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca31fc50 2023-10-05T21:16:19.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.713+0000 7fa4afe58680 1 --2- 172.21.15.153:0/2834242823 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55e9ca323540 0x55e9ca325920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.713+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca326020 con 0x55e9ca323540 2023-10-05T21:16:19.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.713+0000 7fa4a272f700 1 --2- 172.21.15.153:0/2834242823 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55e9ca323540 0x55e9ca325920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.713+0000 7fa4a272f700 1 --2- 172.21.15.153:0/2834242823 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55e9ca323540 0x55e9ca325920 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.714+0000 7fa4a272f700 1 -- 172.21.15.153:0/2834242823 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v31'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa494033040 con 0x55e9ca323540 2023-10-05T21:16:19.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.714+0000 7fa4afe58680 1 --2- 172.21.15.153:0/2834242823 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55e9ca326df0 0x55e9ca329270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.714+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3299c0 con 0x55e9ca326df0 2023-10-05T21:16:19.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.714+0000 7fa4a3731700 1 --2- 172.21.15.153:0/2834242823 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55e9ca326df0 0x55e9ca329270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.714+0000 7fa4a3731700 1 --2- 172.21.15.153:0/2834242823 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55e9ca326df0 0x55e9ca329270 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.715+0000 7fa4a3731700 1 -- 172.21.15.153:0/2834242823 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v31'33 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca326df0 2023-10-05T21:16:19.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.715+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca32a1a0 con 0x55e9ca31fc50 2023-10-05T21:16:19.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.716+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2834242823 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v31'245 uv186 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca31fc50 2023-10-05T21:16:19.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.716+0000 7fa4afe58680 1 --2- 172.21.15.153:0/2834242823 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55e9ca32adb0 0x55e9ca32d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:19.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.716+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca32d8f0 con 0x55e9ca32adb0 2023-10-05T21:16:19.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.716+0000 7fa4a2f30700 1 --2- 172.21.15.153:0/2834242823 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55e9ca32adb0 0x55e9ca32d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:19.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.716+0000 7fa4a2f30700 1 --2- 172.21.15.153:0/2834242823 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55e9ca32adb0 0x55e9ca32d240 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:19.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.717+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2834242823 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v31'76 uv58 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca32adb0 2023-10-05T21:16:19.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.717+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca32e020 con 0x55e9ca326df0 2023-10-05T21:16:19.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.718+0000 7fa4a3731700 1 -- 172.21.15.153:0/2834242823 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v31'47 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca326df0 2023-10-05T21:16:19.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.718+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca32e6a0 con 0x55e9ca31fc50 2023-10-05T21:16:19.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.719+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2834242823 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v31'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca31fc50 2023-10-05T21:16:19.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.719+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca32e6a0 con 0x55e9ca323540 2023-10-05T21:16:19.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.719+0000 7fa4a272f700 1 -- 172.21.15.153:0/2834242823 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v31'51 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa494033040 con 0x55e9ca323540 2023-10-05T21:16:19.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.719+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca32ece0 con 0x55e9ca32adb0 2023-10-05T21:16:19.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.720+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2834242823 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v31'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca32adb0 2023-10-05T21:16:19.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.720+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca32ece0 con 0x55e9ca326df0 2023-10-05T21:16:19.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.721+0000 7fa4a3731700 1 -- 172.21.15.153:0/2834242823 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v31'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca326df0 2023-10-05T21:16:19.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.721+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca32f3a0 con 0x55e9ca32adb0 2023-10-05T21:16:19.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.721+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2834242823 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v31'77 uv60 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca32adb0 2023-10-05T21:16:19.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.721+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca32f340 con 0x55e9ca323540 2023-10-05T21:16:19.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.722+0000 7fa4a272f700 1 -- 172.21.15.153:0/2834242823 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v31'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa494033040 con 0x55e9ca323540 2023-10-05T21:16:19.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.722+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca32f960 con 0x55e9ca32adb0 2023-10-05T21:16:19.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.723+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2834242823 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v31'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca32adb0 2023-10-05T21:16:19.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.723+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca32f960 con 0x55e9ca323540 2023-10-05T21:16:19.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.724+0000 7fa4a272f700 1 -- 172.21.15.153:0/2834242823 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v31'53 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa494033040 con 0x55e9ca323540 2023-10-05T21:16:19.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.724+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca32fe50 con 0x55e9ca31fc50 2023-10-05T21:16:19.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.725+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2834242823 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v31'246 uv182 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca31fc50 2023-10-05T21:16:19.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.725+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca32fe50 con 0x55e9ca326df0 2023-10-05T21:16:19.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.726+0000 7fa4a3731700 1 -- 172.21.15.153:0/2834242823 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v31'65 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca326df0 2023-10-05T21:16:19.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.726+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3304d0 con 0x55e9ca32adb0 2023-10-05T21:16:19.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.727+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2834242823 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v31'78 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca32adb0 2023-10-05T21:16:19.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.727+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3304b0 con 0x55e9ca326df0 2023-10-05T21:16:19.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.727+0000 7fa4a3731700 1 -- 172.21.15.153:0/2834242823 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v31'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca326df0 2023-10-05T21:16:19.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.727+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3304b0 con 0x55e9ca31fc50 2023-10-05T21:16:19.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.728+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2834242823 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v31'39 uv32 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca31fc50 2023-10-05T21:16:19.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.728+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca330240 con 0x55e9ca31fc50 2023-10-05T21:16:19.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.729+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2834242823 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v31'247 uv184 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca31fc50 2023-10-05T21:16:19.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.729+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca330240 con 0x55e9ca326df0 2023-10-05T21:16:19.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.730+0000 7fa4a3731700 1 -- 172.21.15.153:0/2834242823 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v31'66 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca326df0 2023-10-05T21:16:19.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.730+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca330240 con 0x55e9ca32adb0 2023-10-05T21:16:19.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.731+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2834242823 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v31'54 uv37 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca32adb0 2023-10-05T21:16:19.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.731+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca330240 con 0x55e9ca326df0 2023-10-05T21:16:19.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.731+0000 7fa4a3731700 1 -- 172.21.15.153:0/2834242823 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v31'32 uv26 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca326df0 2023-10-05T21:16:19.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.731+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca330240 con 0x55e9ca326df0 2023-10-05T21:16:19.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.732+0000 7fa4a3731700 1 -- 172.21.15.153:0/2834242823 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v31'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca326df0 2023-10-05T21:16:19.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.732+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca330240 con 0x55e9ca326df0 2023-10-05T21:16:19.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.733+0000 7fa4a3731700 1 -- 172.21.15.153:0/2834242823 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v31'38 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca326df0 2023-10-05T21:16:19.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.733+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca330240 con 0x55e9ca326df0 2023-10-05T21:16:19.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.733+0000 7fa4a3731700 1 -- 172.21.15.153:0/2834242823 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v31'48 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca326df0 2023-10-05T21:16:19.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.733+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca330240 con 0x55e9ca323540 2023-10-05T21:16:19.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.734+0000 7fa4a272f700 1 -- 172.21.15.153:0/2834242823 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v31'30 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa494033040 con 0x55e9ca323540 2023-10-05T21:16:19.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.734+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca330240 con 0x55e9ca326df0 2023-10-05T21:16:19.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.735+0000 7fa4a3731700 1 -- 172.21.15.153:0/2834242823 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v31'33 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca326df0 2023-10-05T21:16:19.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.735+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca330240 con 0x55e9ca323540 2023-10-05T21:16:19.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.736+0000 7fa4a272f700 1 -- 172.21.15.153:0/2834242823 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v31'52 uv38 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa494033040 con 0x55e9ca323540 2023-10-05T21:16:19.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.736+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca330240 con 0x55e9ca326df0 2023-10-05T21:16:19.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.737+0000 7fa4a3731700 1 -- 172.21.15.153:0/2834242823 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v31'67 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca326df0 2023-10-05T21:16:19.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.737+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca330240 con 0x55e9ca323540 2023-10-05T21:16:19.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.737+0000 7fa4a272f700 1 -- 172.21.15.153:0/2834242823 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v31'54 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa494033040 con 0x55e9ca323540 2023-10-05T21:16:19.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.737+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca330240 con 0x55e9ca32adb0 2023-10-05T21:16:19.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.738+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2834242823 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v31'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca32adb0 2023-10-05T21:16:19.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.739+0000 7fa3e2ffd700 20 reqs_thread_entry: start 2023-10-05T21:16:19.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.739+0000 7fa3e0ff9700 20 reqs_thread_entry: start 2023-10-05T21:16:19.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.739+0000 7fa4afe58680 20 init_complete bucket index max shards: 11 2023-10-05T21:16:19.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.739+0000 7fa4afe58680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:16:19.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.739+0000 7fa3d2ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:16:50 2023 2023-10-05T21:16:19.768 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:16:19.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.739+0000 7fa3d27fc700 20 reqs_thread_entry: start 2023-10-05T21:16:19.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.739+0000 7fa4afe58680 20 get_system_obj_state: rctx=0x7fff7030cf58 obj=default.rgw.meta:users.uid:fud state=0x55e9ca16f240 s->prefetch_data=0 2023-10-05T21:16:19.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.739+0000 7fa4afe58680 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2023-10-05T21:16:19.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.740+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca38b4d0 con 0x55e9ca2c07c0 2023-10-05T21:16:19.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.740+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(102 fud [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv8 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.740+0000 7fa4afe58680 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x16 2023-10-05T21:16:19.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.740+0000 7fa4afe58680 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T21:16:19.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.740+0000 7fa4afe58680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:16:19.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.740+0000 7fa4afe58680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:16:19.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.740+0000 7fa4afe58680 20 Read xattr: user.rgw.idtag 2023-10-05T21:16:19.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.740+0000 7fa4afe58680 10 cache get: name=default.rgw.meta+users.uid+fud : type miss (requested=0x13, cached=0x16) 2023-10-05T21:16:19.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.740+0000 7fa4afe58680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.740+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:103 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca38d760 con 0x55e9ca2c07c0 2023-10-05T21:16:19.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.741+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(103 fud [call,call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv8 ondisk = 0) v8 ==== 273+0+469 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.741+0000 7fa4afe58680 20 rados_obj.operate() r=0 bl.length=346 2023-10-05T21:16:19.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.741+0000 7fa4afe58680 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2023-10-05T21:16:19.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.741+0000 7fa4afe58680 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T21:16:19.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.741+0000 7fa4afe58680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:16:19.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.741+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:104 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca38d760 con 0x55e9ca2c07c0 2023-10-05T21:16:19.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.741+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(104 fud.buckets [call out=184b] v0'0 uv5 ondisk = 0) v8 ==== 155+0+184 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.741+0000 7fa4afe58680 20 get_system_obj_state: rctx=0x7fff7030cc10 obj=default.rgw.meta:root:.bucket.meta.myfoo7:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8 state=0x55e9ca16f240 s->prefetch_data=0 2023-10-05T21:16:19.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.741+0000 7fa4afe58680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8 : miss 2023-10-05T21:16:19.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.741+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:105 8.1a 8:5d95907c:root::.bucket.meta.myfoo7%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca38d390 con 0x55e9ca2c07c0 2023-10-05T21:16:19.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.741+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(105 .bucket.meta.myfoo7:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 291+0+282 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.741+0000 7fa4afe58680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8 info.flags=0x16 2023-10-05T21:16:19.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.741+0000 7fa4afe58680 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8 to cache LRU end 2023-10-05T21:16:19.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.741+0000 7fa4afe58680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:16:19.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.741+0000 7fa4afe58680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:16:19.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.741+0000 7fa4afe58680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:16:19.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.741+0000 7fa4afe58680 20 Read xattr: user.rgw.acl 2023-10-05T21:16:19.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.741+0000 7fa4afe58680 20 Read xattr: user.rgw.idtag 2023-10-05T21:16:19.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.741+0000 7fa4afe58680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8 : type miss (requested=0x13, cached=0x16) 2023-10-05T21:16:19.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.741+0000 7fa4afe58680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.741+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:106 8.1a 8:5d95907c:root::.bucket.meta.myfoo7%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca38feb0 con 0x55e9ca2c07c0 2023-10-05T21:16:19.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.742+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 31 ==== osd_op_reply(106 .bucket.meta.myfoo7:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8 [call,call out=48b,read 0~353 out=353b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 333+0+619 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.742+0000 7fa4afe58680 20 rados_obj.operate() r=0 bl.length=353 2023-10-05T21:16:19.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.742+0000 7fa4afe58680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8 info.flags=0x13 2023-10-05T21:16:19.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.742+0000 7fa4afe58680 10 moving default.rgw.meta+root+.bucket.meta.myfoo7:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8 to cache LRU end 2023-10-05T21:16:19.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.742+0000 7fa4afe58680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:16:19.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.742+0000 7fa4afe58680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:16:19.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.742+0000 7fa4afe58680 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8 2023-10-05T21:16:19.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.742+0000 7fa4afe58680 10 int RGWRados::cls_bucket_list_unordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, uint32_t, bool, std::vector&, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter) :myfoo7[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8]) start_after="", prefix="", shard_id=-1", num_entries=1100, list_versions=1, force_check_filter is unset 2023-10-05T21:16:19.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.742+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 4.3a 4:5c23e9ef:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca40b180 con 0x55e9ca2f3470 2023-10-05T21:16:19.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.742+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(107 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca2f3470 2023-10-05T21:16:19.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.742+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:108 4.18 4:1b763f53:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca40b180 con 0x7fa49801a070 2023-10-05T21:16:19.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.743+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(108 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.1 [call out=85b] v0'0 uv11 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa494033040 con 0x7fa49801a070 2023-10-05T21:16:19.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.743+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:109 4.1a 4:58356eac:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca40b180 con 0x7fa49801a070 2023-10-05T21:16:19.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.743+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(109 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.2 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa494033040 con 0x7fa49801a070 2023-10-05T21:16:19.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.743+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:110 4.e 4:727a9952:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca40b180 con 0x7fa49801a070 2023-10-05T21:16:19.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.743+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(110 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa494033040 con 0x7fa49801a070 2023-10-05T21:16:19.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.743+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:111 4.12 4:49d5061a:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca40b100 con 0x55e9ca2eeba0 2023-10-05T21:16:19.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.744+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(111 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.744+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:112 4.35 4:af81314e:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca40b100 con 0x55e9ca2eeba0 2023-10-05T21:16:19.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.744+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(112 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.5 [call out=377b] v0'0 uv11 ondisk = 0) v8 ==== 194+0+377 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.744+0000 7fa4afe58680 10 cls_bucket_list_unordered: got fourteen 2023-10-05T21:16:19.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.744+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:113 4.28 4:153fe8b6:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca40b180 con 0x55e9ca2eeba0 2023-10-05T21:16:19.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.744+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(113 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.6 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.744+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:114 4.23 4:c4e26ab7:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca40b180 con 0x55e9ca2c07c0 2023-10-05T21:16:19.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.745+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 32 ==== osd_op_reply(114 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.745+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:115 4.8 4:13b6590a:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca40b180 con 0x55e9ca2f3470 2023-10-05T21:16:19.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.745+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(115 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca2f3470 2023-10-05T21:16:19.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.745+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:116 4.17 4:e84ee416:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca40b180 con 0x55e9ca2c07c0 2023-10-05T21:16:19.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.746+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 33 ==== osd_op_reply(116 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.746+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:117 4.3 4:c1b73e7b:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca40b180 con 0x55e9ca2eeba0 2023-10-05T21:16:19.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.746+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(117 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.746+0000 7fa4afe58680 20 get_obj_state: rctx=0x7fff7030cc20 obj=myfoo7:fourteen state=0x55e9ca408d18 s->prefetch_data=0 2023-10-05T21:16:19.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.746+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:118 3.22 3:464e953a:::193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca409b70 con 0x55e9ca2f3470 2023-10-05T21:16:19.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.747+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(118 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8_fourteen [getxattrs out=854b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 238+0+870 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca2f3470 2023-10-05T21:16:19.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.747+0000 7fa4afe58680 10 manifest: total_size = 8 2023-10-05T21:16:19.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.747+0000 7fa4afe58680 20 get_obj_state: setting s->obj_tag to 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4220.8899995403473587128 2023-10-05T21:16:19.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.747+0000 7fa4afe58680 20 get_obj_state: rctx=0x7fff7030cc20 obj=myfoo7:fourteen state=0x55e9ca408d18 s->prefetch_data=0 2023-10-05T21:16:19.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.747+0000 7fa4afe58680 20 prepare_atomic_modification: state is not atomic. state=0x55e9ca408d18 2023-10-05T21:16:19.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.747+0000 7fa4afe58680 20 bucket index object: default.rgw.buckets.index:.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.5 2023-10-05T21:16:19.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.747+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:119 4.35 4:af81314e:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3913f0 con 0x55e9ca2eeba0 2023-10-05T21:16:19.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.748+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(119 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.5 [stat,call,call] v31'12 uv12 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.748+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:120 3.22 3:464e953a:::193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca38f3d0 con 0x55e9ca2f3470 2023-10-05T21:16:19.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.748+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== osd_op_reply(120 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8_fourteen [call] v31'2 uv2 ondisk = 0) v8 ==== 196+0+0 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca2f3470 2023-10-05T21:16:19.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.748+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:121 4.35 4:af81314e:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca38f2d0 con 0x55e9ca2eeba0 2023-10-05T21:16:19.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.748+0000 7fa4afe58680 10 cache get: name=default.rgw.log++bucket.sync-source-hints.myfoo7 : miss 2023-10-05T21:16:19.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.748+0000 7fa4afe58680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.748+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:122 6.11 6:8826b99d:::bucket.sync-source-hints.myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca38f2d0 con 0x55e9ca2f3470 2023-10-05T21:16:19.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.749+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(122 bucket.sync-source-hints.myfoo7 [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 217+0+0 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca2f3470 2023-10-05T21:16:19.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.749+0000 7fa4afe58680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.749+0000 7fa4afe58680 10 cache put: name=default.rgw.log++bucket.sync-source-hints.myfoo7 info.flags=0x0 2023-10-05T21:16:19.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.749+0000 7fa4afe58680 10 adding default.rgw.log++bucket.sync-source-hints.myfoo7 to cache LRU end 2023-10-05T21:16:19.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.749+0000 7fa4afe58680 10 cache get: name=default.rgw.log++bucket.sync-target-hints.myfoo7 : miss 2023-10-05T21:16:19.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.749+0000 7fa4afe58680 20 rados->read ofs=0 len=0 2023-10-05T21:16:19.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.749+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:123 6.17 6:e82d5341:::bucket.sync-target-hints.myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca394320 con 0x55e9ca2eeba0 2023-10-05T21:16:19.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.749+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(123 bucket.sync-target-hints.myfoo7 [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 217+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.749+0000 7fa4afe58680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:19.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.749+0000 7fa4afe58680 10 cache put: name=default.rgw.log++bucket.sync-target-hints.myfoo7 info.flags=0x0 2023-10-05T21:16:19.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.749+0000 7fa4afe58680 10 adding default.rgw.log++bucket.sync-target-hints.myfoo7 to cache LRU end 2023-10-05T21:16:19.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.749+0000 7fa4afe58680 10 chain_cache_entry: cache_locator= 2023-10-05T21:16:19.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.749+0000 7fa4afe58680 20 chain_cache_entry: couldn't find cache locator 2023-10-05T21:16:19.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.749+0000 7fa4afe58680 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2023-10-05T21:16:19.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.749+0000 7fa4afe58680 20 int RGWRados::Bucket::List::list_objects_ordered(const DoutPrefixProvider*, int64_t, std::vector*, std::map, bool>*, bool*, optional_yield): starting attempt 1 2023-10-05T21:16:19.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.749+0000 7fa4afe58680 10 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): :myfoo7[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8]) start_after="_multipart_", prefix="_multipart_, delimiter="", shard_id=-1", num_entries=1001, list_versions=0, expansion_factor=1, force_check_filter is unset 2023-10-05T21:16:19.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.749+0000 7fa4afe58680 10 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-10-05T21:16:19.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.749+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:124 4.3a 4:5c23e9ef:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca393ee0 con 0x55e9ca2f3470 2023-10-05T21:16:19.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.749+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:125 4.18 4:1b763f53:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca408fe0 con 0x7fa49801a070 2023-10-05T21:16:19.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.749+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:126 4.1a 4:58356eac:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca399a30 con 0x7fa49801a070 2023-10-05T21:16:19.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.749+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:127 4.e 4:727a9952:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca393ee0 con 0x7fa49801a070 2023-10-05T21:16:19.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.749+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:128 4.12 4:49d5061a:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca408fe0 con 0x55e9ca2eeba0 2023-10-05T21:16:19.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.749+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:129 4.35 4:af81314e:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca393ee0 con 0x55e9ca2eeba0 2023-10-05T21:16:19.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.749+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:130 4.28 4:153fe8b6:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3a3850 con 0x55e9ca2eeba0 2023-10-05T21:16:19.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.749+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:131 4.23 4:c4e26ab7:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3a63b0 con 0x55e9ca2c07c0 2023-10-05T21:16:19.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.749+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:132 4.8 4:13b6590a:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3a8cf0 con 0x55e9ca2f3470 2023-10-05T21:16:19.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.749+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:133 4.17 4:e84ee416:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3a63b0 con 0x55e9ca2c07c0 2023-10-05T21:16:19.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.749+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:134 4.3 4:c1b73e7b:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3ae2c0 con 0x55e9ca2eeba0 2023-10-05T21:16:19.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.749+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== osd_op_reply(121 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.5 [stat,call,call] v31'13 uv13 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.749+0000 7fa4a0f2c700 20 handle_completion(): completion ok for obj=fourteen 2023-10-05T21:16:19.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.750+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 34 ==== osd_op_reply(131 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.750+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 42 ==== osd_op_reply(129 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.5 [call out=124b] v0'0 uv13 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.750+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(125 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.1 [call out=85b] v0'0 uv11 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa494033040 con 0x7fa49801a070 2023-10-05T21:16:19.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.750+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 43 ==== osd_op_reply(128 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.750+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== osd_op_reply(127 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa494033040 con 0x7fa49801a070 2023-10-05T21:16:19.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.750+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 22 ==== osd_op_reply(126 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.2 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa494033040 con 0x7fa49801a070 2023-10-05T21:16:19.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.750+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 31 ==== osd_op_reply(124 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca2f3470 2023-10-05T21:16:19.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.750+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 44 ==== osd_op_reply(130 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.6 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.750+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 35 ==== osd_op_reply(133 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.750+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 45 ==== osd_op_reply(134 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.750+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 32 ==== osd_op_reply(132 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca2f3470 2023-10-05T21:16:19.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.750+0000 7fa4afe58680 20 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): returning, count=0, is_truncated=0 2023-10-05T21:16:19.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.750+0000 7fa4afe58680 20 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): returning, last_entry NOT SET 2023-10-05T21:16:19.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.750+0000 7fa4afe58680 10 int RGWRados::Bucket::List::list_objects_ordered(const DoutPrefixProvider*, int64_t, std::vector*, std::map, bool>*, bool*, optional_yield): end of outer loop, truncated=0, count=0, attempt=1 2023-10-05T21:16:19.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.750+0000 7fa4afe58680 10 int RGWRados::Bucket::List::list_objects_ordered(const DoutPrefixProvider*, int64_t, std::vector*, std::map, bool>*, bool*, optional_yield): exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-10-05T21:16:19.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.750+0000 7fa4afe58680 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8])"; uploads.size()=0; is_truncated=0 2023-10-05T21:16:19.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.750+0000 7fa4afe58680 10 lifecycle: RGWRados::convert_old_bucket_info(): bucket=:myfoo7[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8]) 2023-10-05T21:16:19.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.750+0000 7fa4afe58680 20 lifecycle: get_system_obj_state: rctx=0x7fff7030c6e8 obj=default.rgw.meta:root:myfoo7 state=0x55e9ca16f240 s->prefetch_data=0 2023-10-05T21:16:19.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.750+0000 7fa4afe58680 10 lifecycle: cache get: name=default.rgw.meta+root+myfoo7 : miss 2023-10-05T21:16:19.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.750+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3ae2c0 con 0x7fa49801a070 2023-10-05T21:16:19.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.750+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 23 ==== osd_op_reply(135 myfoo7 [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv42 ondisk = 0) v8 ==== 234+0+139 (crc 0 0 0) 0x7fa494033040 con 0x7fa49801a070 2023-10-05T21:16:19.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.750+0000 7fa4afe58680 10 lifecycle: cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x16 2023-10-05T21:16:19.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.750+0000 7fa4afe58680 10 lifecycle: adding default.rgw.meta+root+myfoo7 to cache LRU end 2023-10-05T21:16:19.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.750+0000 7fa4afe58680 10 lifecycle: updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:16:19.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.750+0000 7fa4afe58680 20 lifecycle: get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:16:19.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.750+0000 7fa4afe58680 20 lifecycle: Read xattr: user.rgw.idtag 2023-10-05T21:16:19.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.750+0000 7fa4afe58680 10 lifecycle: cache get: name=default.rgw.meta+root+myfoo7 : type miss (requested=0x13, cached=0x16) 2023-10-05T21:16:19.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.751+0000 7fa4afe58680 20 lifecycle: rados->read ofs=0 len=0 2023-10-05T21:16:19.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.751+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3ae2c0 con 0x7fa49801a070 2023-10-05T21:16:19.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.751+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 24 ==== osd_op_reply(136 myfoo7 [call,call out=48b,read 0~166 out=166b,getxattrs out=75b] v0'0 uv42 ondisk = 0) v8 ==== 276+0+289 (crc 0 0 0) 0x7fa494033040 con 0x7fa49801a070 2023-10-05T21:16:19.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.751+0000 7fa4afe58680 20 lifecycle: rados_obj.operate() r=0 bl.length=166 2023-10-05T21:16:19.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.751+0000 7fa4afe58680 10 lifecycle: cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x13 2023-10-05T21:16:19.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.751+0000 7fa4afe58680 10 lifecycle: moving default.rgw.meta+root+myfoo7 to cache LRU end 2023-10-05T21:16:19.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.751+0000 7fa4afe58680 10 lifecycle: updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:16:19.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.751+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:137 8.1a 8:5d95907c:root::.bucket.meta.myfoo7%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~353 in=353b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3a3320 con 0x55e9ca2c07c0 2023-10-05T21:16:19.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.752+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 36 ==== osd_op_reply(137 .bucket.meta.myfoo7:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8 [delete,create,call,call,writefull 0~353,setxattr (123)] v31'4 uv4 ondisk = 0) v8 ==== 417+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.752+0000 7fa4afe58680 10 lifecycle: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8 info.flags=0x17 2023-10-05T21:16:19.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.752+0000 7fa4afe58680 10 lifecycle: moving default.rgw.meta+root+.bucket.meta.myfoo7:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8 to cache LRU end 2023-10-05T21:16:19.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.752+0000 7fa4afe58680 10 lifecycle: updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:16:19.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.752+0000 7fa4afe58680 10 lifecycle: distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo7:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8, ofs0, ns] 2023-10-05T21:16:19.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.752+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:138 7.3 7:c609908c:::notify.5:head [notify cookie 94462608480816 in=739b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca38d9a0 con 0x55e9ca2c07c0 2023-10-05T21:16:19.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.752+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 37 ==== watch-notify(notify (1) cookie 94462607880288 notify 133143986214 ret 0) v3 ==== 769+0+0 (crc 0 0 0) 0x7fa49c029040 con 0x55e9ca2c07c0 2023-10-05T21:16:19.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.752+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 38 ==== osd_op_reply(138 notify.5 [notify cookie 94462608480816 out=8b] v0'0 uv255 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.752+0000 7fa493fff700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986214 cookie 94462607880288 notifier 4736 bl.length()=727 2023-10-05T21:16:19.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.752+0000 7fa493fff700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8 info.flags=0x17 2023-10-05T21:16:19.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.752+0000 7fa493fff700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo7:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8 to cache LRU end 2023-10-05T21:16:19.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.752+0000 7fa493fff700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:16:19.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.752+0000 7fa493fff700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:139 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa3f00034e0 con 0x55e9ca2c07c0 2023-10-05T21:16:19.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.752+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 39 ==== osd_op_reply(139 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.752+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 40 ==== watch-notify(notify_complete (2) cookie 94462608480816 notify 133143986214 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fa49c067000 con 0x55e9ca2c07c0 2023-10-05T21:16:19.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.753+0000 7fa4afe58680 20 lifecycle: handle_bi_update(): bucket=:myfoo7[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8]): orig_sources= new_sources= 2023-10-05T21:16:19.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.753+0000 7fa4afe58680 20 lifecycle: handle_bi_update(): bucket=:myfoo7[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8]): potential sources added=[] removed=[] 2023-10-05T21:16:19.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.753+0000 7fa4afe58680 20 lifecycle: handle_bi_update(): bucket=:myfoo7[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8]): orig_dests= new_dests= 2023-10-05T21:16:19.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.753+0000 7fa4afe58680 20 lifecycle: handle_bi_update(): bucket=:myfoo7[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8]): potential dests added=[] removed=[] 2023-10-05T21:16:19.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.753+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:33 6.7 6:e31d3d5f:lc::lc.28:head [call lock.lock in=65b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3a3320 con 0x55e9ca326df0 2023-10-05T21:16:19.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.753+0000 7fa4a3731700 1 -- 172.21.15.153:0/2834242823 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(33 lc.28 [call] v31'68 uv68 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca326df0 2023-10-05T21:16:19.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.753+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 6.7 6:e31d3d5f:lc::lc.28:head [call rgw.lc_rm_entry in=93b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3a3320 con 0x55e9ca326df0 2023-10-05T21:16:19.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.754+0000 7fa4a3731700 1 -- 172.21.15.153:0/2834242823 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(34 lc.28 [call] v31'69 uv69 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca326df0 2023-10-05T21:16:19.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.754+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:35 6.7 6:e31d3d5f:lc::lc.28:head [call lock.unlock in=49b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3a3320 con 0x55e9ca326df0 2023-10-05T21:16:19.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.755+0000 7fa4a3731700 1 -- 172.21.15.153:0/2834242823 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(35 lc.28 [call] v31'70 uv70 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca326df0 2023-10-05T21:16:19.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.755+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:140 4.3a 4:5c23e9ef:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3a3320 con 0x55e9ca2f3470 2023-10-05T21:16:19.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.755+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:141 4.18 4:1b763f53:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca391f70 con 0x7fa49801a070 2023-10-05T21:16:19.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.755+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:142 4.1a 4:58356eac:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3aca40 con 0x7fa49801a070 2023-10-05T21:16:19.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.755+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:143 4.e 4:727a9952:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3a3320 con 0x7fa49801a070 2023-10-05T21:16:19.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.755+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:144 4.12 4:49d5061a:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca391f70 con 0x55e9ca2eeba0 2023-10-05T21:16:19.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.755+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:145 4.35 4:af81314e:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3aca40 con 0x55e9ca2eeba0 2023-10-05T21:16:19.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.755+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:146 4.28 4:153fe8b6:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3a83d0 con 0x55e9ca2eeba0 2023-10-05T21:16:19.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.755+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:147 4.23 4:c4e26ab7:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3a3320 con 0x55e9ca2c07c0 2023-10-05T21:16:19.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.755+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:148 4.8 4:13b6590a:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca391f70 con 0x55e9ca2f3470 2023-10-05T21:16:19.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.755+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:149 4.17 4:e84ee416:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3a8d70 con 0x55e9ca2c07c0 2023-10-05T21:16:19.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.755+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:150 4.3 4:c1b73e7b:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3a3320 con 0x55e9ca2eeba0 2023-10-05T21:16:19.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.755+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 33 ==== osd_op_reply(140 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca2f3470 2023-10-05T21:16:19.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.756+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 25 ==== osd_op_reply(141 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.1 [call out=85b] v0'0 uv11 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa494033040 con 0x7fa49801a070 2023-10-05T21:16:19.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.756+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 26 ==== osd_op_reply(143 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa494033040 con 0x7fa49801a070 2023-10-05T21:16:19.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.756+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 27 ==== osd_op_reply(142 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.2 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa494033040 con 0x7fa49801a070 2023-10-05T21:16:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.756+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 46 ==== osd_op_reply(144 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.756+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 34 ==== osd_op_reply(148 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca2f3470 2023-10-05T21:16:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.756+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 47 ==== osd_op_reply(146 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.6 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.756+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 41 ==== osd_op_reply(147 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.756+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 48 ==== osd_op_reply(145 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.5 [call out=124b] v0'0 uv13 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.756+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 42 ==== osd_op_reply(149 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.756+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 49 ==== osd_op_reply(150 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.756+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:151 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca391f70 con 0x55e9ca2c07c0 2023-10-05T21:16:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.757+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 43 ==== osd_op_reply(151 fud.buckets [call] v31'6 uv6 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.757+0000 7fa4afe58680 20 get_system_obj_state: rctx=0x7fff7030c148 obj=default.rgw.meta:root:myfoo7 state=0x55e9ca16f240 s->prefetch_data=0 2023-10-05T21:16:19.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.757+0000 7fa4afe58680 10 cache get: name=default.rgw.meta+root+myfoo7 : type miss (requested=0x16, cached=0x13) 2023-10-05T21:16:19.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.757+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:152 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3a3320 con 0x7fa49801a070 2023-10-05T21:16:19.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.757+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 28 ==== osd_op_reply(152 myfoo7 [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv42 ondisk = 0) v8 ==== 234+0+139 (crc 0 0 0) 0x7fa494033040 con 0x7fa49801a070 2023-10-05T21:16:19.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.757+0000 7fa4afe58680 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x16 2023-10-05T21:16:19.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.757+0000 7fa4afe58680 10 moving default.rgw.meta+root+myfoo7 to cache LRU end 2023-10-05T21:16:19.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.757+0000 7fa4afe58680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:16:19.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.757+0000 7fa4afe58680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:16:19.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.757+0000 7fa4afe58680 10 cache get: name=default.rgw.meta+root+myfoo7 : hit (requested=0x11, cached=0x17) 2023-10-05T21:16:19.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.757+0000 7fa4afe58680 10 removing default.rgw.meta+root+myfoo7 from cache 2023-10-05T21:16:19.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.757+0000 7fa4afe58680 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2023-10-05T21:16:19.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.757+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:153 7.e 7:7759931f:::notify.3:head [notify cookie 94462608480816 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca391f70 con 0x7fa49801a070 2023-10-05T21:16:19.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.758+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 29 ==== watch-notify(notify (1) cookie 94462607876048 notify 133143986195 ret 0) v3 ==== 192+0+0 (crc 0 0 0) 0x7fa49405f040 con 0x7fa49801a070 2023-10-05T21:16:19.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.758+0000 7fa493fff700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986195 cookie 94462607876048 notifier 4736 bl.length()=150 2023-10-05T21:16:19.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.758+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 30 ==== osd_op_reply(153 notify.3 [notify cookie 94462608480816 out=8b] v0'0 uv255 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa494033040 con 0x7fa49801a070 2023-10-05T21:16:19.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.758+0000 7fa493fff700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:154 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa3f00034c0 con 0x7fa49801a070 2023-10-05T21:16:19.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.758+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 31 ==== watch-notify(notify_complete (2) cookie 94462608480816 notify 133143986195 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55e9ca315a20 con 0x7fa49801a070 2023-10-05T21:16:19.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.758+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 32 ==== osd_op_reply(154 notify.3 [notify-ack] v0'0 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa494033040 con 0x7fa49801a070 2023-10-05T21:16:19.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.758+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:155 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3a3320 con 0x7fa49801a070 2023-10-05T21:16:19.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.759+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 33 ==== osd_op_reply(155 myfoo7 [call,call,delete] v31'43 uv43 ondisk = 0) v8 ==== 234+0+0 (crc 0 0 0) 0x7fa494033040 con 0x7fa49801a070 2023-10-05T21:16:19.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.759+0000 7fa4afe58680 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8 from cache 2023-10-05T21:16:19.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.759+0000 7fa4afe58680 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8, ofs0, ns] 2023-10-05T21:16:19.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.759+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:156 7.3 7:c609908c:::notify.5:head [notify cookie 94462608480816 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca391f70 con 0x55e9ca2c07c0 2023-10-05T21:16:19.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.759+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 44 ==== watch-notify(notify (1) cookie 94462607880288 notify 133143986215 ret 0) v3 ==== 249+0+0 (crc 0 0 0) 0x7fa49c07d040 con 0x55e9ca2c07c0 2023-10-05T21:16:19.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.759+0000 7fa493fff700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986215 cookie 94462607880288 notifier 4736 bl.length()=207 2023-10-05T21:16:19.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.759+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 45 ==== osd_op_reply(156 notify.5 [notify cookie 94462608480816 out=8b] v0'0 uv255 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.759+0000 7fa493fff700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa3f00034c0 con 0x55e9ca2c07c0 2023-10-05T21:16:19.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.759+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 46 ==== watch-notify(notify_complete (2) cookie 94462608480816 notify 133143986215 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fa49c067000 con 0x55e9ca2c07c0 2023-10-05T21:16:19.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.759+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 47 ==== osd_op_reply(157 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.760+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:158 8.1a 8:5d95907c:root::.bucket.meta.myfoo7%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca391f70 con 0x55e9ca2c07c0 2023-10-05T21:16:19.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.760+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 48 ==== osd_op_reply(158 .bucket.meta.myfoo7:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8 [call,call,delete] v31'5 uv5 ondisk = 0) v8 ==== 291+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.760+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:159 4.3a 4:5c23e9ef:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca391f70 con 0x55e9ca2f3470 2023-10-05T21:16:19.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.760+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:160 4.18 4:1b763f53:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3a8880 con 0x7fa49801a070 2023-10-05T21:16:19.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.760+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:161 4.1a 4:58356eac:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3a8c70 con 0x7fa49801a070 2023-10-05T21:16:19.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.760+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:162 4.e 4:727a9952:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca391f70 con 0x7fa49801a070 2023-10-05T21:16:19.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.760+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:163 4.12 4:49d5061a:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3a8880 con 0x55e9ca2eeba0 2023-10-05T21:16:19.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.760+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:164 4.35 4:af81314e:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3a8c70 con 0x55e9ca2eeba0 2023-10-05T21:16:19.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.760+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:165 4.28 4:153fe8b6:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca391f70 con 0x55e9ca2eeba0 2023-10-05T21:16:19.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.760+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:166 4.23 4:c4e26ab7:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3a8880 con 0x55e9ca2c07c0 2023-10-05T21:16:19.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.760+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:167 4.8 4:13b6590a:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3a8c70 con 0x55e9ca2f3470 2023-10-05T21:16:19.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.761+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:168 4.17 4:e84ee416:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca391f70 con 0x55e9ca2c07c0 2023-10-05T21:16:19.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.761+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:169 4.3 4:c1b73e7b:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3a8880 con 0x55e9ca2eeba0 2023-10-05T21:16:19.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.762+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 35 ==== osd_op_reply(159 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.0 [delete] v31'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca2f3470 2023-10-05T21:16:19.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.762+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 49 ==== osd_op_reply(166 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.7 [delete] v31'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.762+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 50 ==== osd_op_reply(168 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.9 [delete] v31'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.762+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 50 ==== osd_op_reply(169 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.10 [delete] v31'2 uv2 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.762+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 51 ==== osd_op_reply(164 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.5 [delete] v31'14 uv14 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.762+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 34 ==== osd_op_reply(162 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.3 [delete] v31'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fa494033040 con 0x7fa49801a070 2023-10-05T21:16:19.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.762+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 35 ==== osd_op_reply(160 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.1 [delete] v31'13 uv13 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fa494033040 con 0x7fa49801a070 2023-10-05T21:16:19.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.762+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 52 ==== osd_op_reply(165 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.6 [delete] v31'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.762+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 36 ==== osd_op_reply(161 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.2 [delete] v31'10 uv10 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fa494033040 con 0x7fa49801a070 2023-10-05T21:16:19.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.762+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 36 ==== osd_op_reply(167 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.8 [delete] v31'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca2f3470 2023-10-05T21:16:19.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.762+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 53 ==== osd_op_reply(163 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8.4 [delete] v31'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.763+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:170 6.3 6:c4b3f8d5:::pubsub..bucket.myfoo7%2f193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca391f70 con 0x7fa49801a070 2023-10-05T21:16:19.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.763+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 37 ==== osd_op_reply(170 pubsub..bucket.myfoo7/193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8 [getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 251+0+0 (crc 0 0 0) 0x7fa494033040 con 0x7fa49801a070 2023-10-05T21:16:19.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.763+0000 7fa4afe58680 10 removing default.rgw.log++pubsub..bucket.myfoo7/193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8 from cache 2023-10-05T21:16:19.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.763+0000 7fa4afe58680 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo7/193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8, ofs0, ns] 2023-10-05T21:16:19.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.763+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:171 7.d 7:b4812045:::notify.4:head [notify cookie 94462608480816 in=216b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca391f70 con 0x55e9ca2eeba0 2023-10-05T21:16:19.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.763+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 54 ==== watch-notify(notify (1) cookie 94462607867296 notify 133143986202 ret 0) v3 ==== 246+0+0 (crc 0 0 0) 0x7fa49c067000 con 0x55e9ca2eeba0 2023-10-05T21:16:19.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.763+0000 7fa493fff700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986202 cookie 94462607867296 notifier 4736 bl.length()=204 2023-10-05T21:16:19.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.763+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 55 ==== osd_op_reply(171 notify.4 [notify cookie 94462608480816 out=8b] v0'0 uv255 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.763+0000 7fa493fff700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:172 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa3f00034c0 con 0x55e9ca2eeba0 2023-10-05T21:16:19.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.763+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 56 ==== osd_op_reply(172 notify.4 [notify-ack] v0'0 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.763+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 57 ==== watch-notify(notify_complete (2) cookie 94462608480816 notify 133143986202 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fa49c02d040 con 0x55e9ca2eeba0 2023-10-05T21:16:19.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.763+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:173 6.3 6:c4b3f8d5:::pubsub..bucket.myfoo7%2f193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3adc80 con 0x7fa49801a070 2023-10-05T21:16:19.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.764+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 38 ==== osd_op_reply(173 pubsub..bucket.myfoo7/193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.8 [delete] v31'79 uv60 ondisk = -2 ((2) No such file or directory)) v8 ==== 209+0+0 (crc 0 0 0) 0x7fa494033040 con 0x7fa49801a070 2023-10-05T21:16:19.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.764+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:174 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=59b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3adc80 con 0x55e9ca2c07c0 2023-10-05T21:16:19.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.765+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 51 ==== osd_op_reply(174 fud.buckets [call] v31'7 uv7 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.765+0000 7fa4afe58680 10 removing key index: p5YnriCv1nAtykxBrupQ 2023-10-05T21:16:19.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.765+0000 7fa4afe58680 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2023-10-05T21:16:19.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.765+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:175 7.15 7:a93a5511:::notify.2:head [notify cookie 94462608480816 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca391f70 con 0x55e9ca2f3470 2023-10-05T21:16:19.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.765+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 37 ==== watch-notify(notify (1) cookie 94462607870144 notify 133143986196 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x7fa49806b040 con 0x55e9ca2f3470 2023-10-05T21:16:19.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.765+0000 7fa4a0f2c700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986196 cookie 94462607870144 notifier 4736 bl.length()=170 2023-10-05T21:16:19.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.765+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 38 ==== osd_op_reply(175 notify.2 [notify cookie 94462608480816 out=8b] v0'0 uv255 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca2f3470 2023-10-05T21:16:19.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.765+0000 7fa4a0f2c700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:176 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa480003c50 con 0x55e9ca2f3470 2023-10-05T21:16:19.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.766+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 39 ==== watch-notify(notify_complete (2) cookie 94462608480816 notify 133143986196 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fa498066040 con 0x55e9ca2f3470 2023-10-05T21:16:19.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.766+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 40 ==== osd_op_reply(176 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca2f3470 2023-10-05T21:16:19.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.766+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:177 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3adc80 con 0x55e9ca2c07c0 2023-10-05T21:16:19.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.766+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 52 ==== osd_op_reply(177 p5YnriCv1nAtykxBrupQ [delete] v31'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.766+0000 7fa4afe58680 10 removing email index: 2023-10-05T21:16:19.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.766+0000 7fa4afe58680 10 removing user buckets index 2023-10-05T21:16:19.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.766+0000 7fa4afe58680 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2023-10-05T21:16:19.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.766+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:178 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94462608480816 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca391f70 con 0x55e9ca2c07c0 2023-10-05T21:16:19.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.767+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 53 ==== watch-notify(notify (1) cookie 94462607884528 notify 133143986216 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x7fa49c02d040 con 0x55e9ca2c07c0 2023-10-05T21:16:19.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.767+0000 7fa493fff700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986216 cookie 94462607884528 notifier 4736 bl.length()=160 2023-10-05T21:16:19.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.767+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 54 ==== osd_op_reply(178 notify.6 [notify cookie 94462608480816 out=8b] v0'0 uv255 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.767+0000 7fa493fff700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:179 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa3f00034c0 con 0x55e9ca2c07c0 2023-10-05T21:16:19.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.767+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 55 ==== watch-notify(notify_complete (2) cookie 94462608480816 notify 133143986216 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fa49c05f600 con 0x55e9ca2c07c0 2023-10-05T21:16:19.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.767+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 56 ==== osd_op_reply(179 notify.6 [notify-ack] v0'0 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.767+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:180 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3adc80 con 0x55e9ca2c07c0 2023-10-05T21:16:19.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.768+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 57 ==== osd_op_reply(180 fud.buckets [delete] v31'8 uv8 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.768+0000 7fa4afe58680 10 removing user index: fud 2023-10-05T21:16:19.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.768+0000 7fa4afe58680 10 removing default.rgw.meta+users.uid+fud from cache 2023-10-05T21:16:19.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.768+0000 7fa4afe58680 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2023-10-05T21:16:19.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.768+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:181 7.3 7:c609908c:::notify.5:head [notify cookie 94462608480816 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca391f70 con 0x55e9ca2c07c0 2023-10-05T21:16:19.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.768+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 58 ==== watch-notify(notify (1) cookie 94462607880288 notify 133143986217 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x7fa49c05f600 con 0x55e9ca2c07c0 2023-10-05T21:16:19.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.768+0000 7fa493fff700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986217 cookie 94462607880288 notifier 4736 bl.length()=152 2023-10-05T21:16:19.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.768+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 59 ==== osd_op_reply(181 notify.5 [notify cookie 94462608480816 out=8b] v0'0 uv255 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.768+0000 7fa493fff700 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:182 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa3f00034c0 con 0x55e9ca2c07c0 2023-10-05T21:16:19.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.768+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 60 ==== watch-notify(notify_complete (2) cookie 94462608480816 notify 133143986217 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fa49c05f830 con 0x55e9ca2c07c0 2023-10-05T21:16:19.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.768+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 61 ==== osd_op_reply(182 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.768+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:183 8.e 8:75f48285:users.uid::fud:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca3adc80 con 0x55e9ca2c07c0 2023-10-05T21:16:19.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.769+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 62 ==== osd_op_reply(183 fud [call,delete] v31'10 uv10 ondisk = 0) v8 ==== 189+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.769+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:184 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94462607862800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca391a30 con 0x7fa49801a070 2023-10-05T21:16:19.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.770+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 39 ==== osd_op_reply(184 notify.0 [watch unwatch cookie 94462607862800] v31'257 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa494033040 con 0x7fa49801a070 2023-10-05T21:16:19.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.770+0000 7fa4afe58680 20 remove_watcher() i=0 2023-10-05T21:16:19.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.770+0000 7fa4afe58680 2 removed watcher, disabling cache 2023-10-05T21:16:19.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.770+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:185 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94462607865088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2fac10 con 0x55e9ca2eeba0 2023-10-05T21:16:19.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.771+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 58 ==== osd_op_reply(185 notify.1 [watch unwatch cookie 94462607865088] v31'257 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.771+0000 7fa4afe58680 20 remove_watcher() i=1 2023-10-05T21:16:19.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.771+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:186 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94462607870144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2fac10 con 0x55e9ca2f3470 2023-10-05T21:16:19.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.772+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2509179171 <== osd.3 v2:172.21.15.153:6800/140455 41 ==== osd_op_reply(186 notify.2 [watch unwatch cookie 94462607870144] v31'257 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa498038040 con 0x55e9ca2f3470 2023-10-05T21:16:19.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.772+0000 7fa4afe58680 20 remove_watcher() i=2 2023-10-05T21:16:19.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.772+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:187 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94462607876048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2fc8c0 con 0x7fa49801a070 2023-10-05T21:16:19.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.773+0000 7fa4a272f700 1 -- 172.21.15.153:0/2509179171 <== osd.2 v2:172.21.15.153:6807/140454 40 ==== osd_op_reply(187 notify.3 [watch unwatch cookie 94462607876048] v31'257 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa494033040 con 0x7fa49801a070 2023-10-05T21:16:19.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.773+0000 7fa4afe58680 20 remove_watcher() i=3 2023-10-05T21:16:19.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.773+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:188 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94462607867296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2fac10 con 0x55e9ca2eeba0 2023-10-05T21:16:19.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.774+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 59 ==== osd_op_reply(188 notify.4 [watch unwatch cookie 94462607867296] v31'257 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.774+0000 7fa4afe58680 20 remove_watcher() i=4 2023-10-05T21:16:19.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.774+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:189 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94462607880288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2fdfd0 con 0x55e9ca2c07c0 2023-10-05T21:16:19.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.775+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 63 ==== osd_op_reply(189 notify.5 [watch unwatch cookie 94462607880288] v31'257 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.775+0000 7fa4afe58680 20 remove_watcher() i=5 2023-10-05T21:16:19.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.775+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:190 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94462607884528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2fbda0 con 0x55e9ca2c07c0 2023-10-05T21:16:19.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.776+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 64 ==== osd_op_reply(190 notify.6 [watch unwatch cookie 94462607884528] v31'257 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.776+0000 7fa4afe58680 20 remove_watcher() i=6 2023-10-05T21:16:19.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.776+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:191 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94462607886912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca2fac10 con 0x55e9ca2c07c0 2023-10-05T21:16:19.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.777+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.0 v2:172.21.15.111:6800/111394 65 ==== osd_op_reply(191 notify.7 [watch unwatch cookie 94462607886912] v31'257 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2c07c0 2023-10-05T21:16:19.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.777+0000 7fa4afe58680 20 remove_watcher() i=7 2023-10-05T21:16:19.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.777+0000 7fa473fe7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:16:19.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.777+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:192 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94462607888464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e9ca34d7d0 con 0x55e9ca2eeba0 2023-10-05T21:16:19.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.778+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 <== osd.1 v2:172.21.15.153:6816/140456 60 ==== osd_op_reply(192 data_loggenerations_metadata [watch unwatch cookie 94462607888464] v31'248 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa49c00a570 con 0x55e9ca2eeba0 2023-10-05T21:16:19.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.778+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55e9ca2c07c0 msgr2=0x7fa49401d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.778+0000 7fa4afe58680 1 --2- 172.21.15.153:0/2509179171 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55e9ca2c07c0 0x7fa49401d420 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.778+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55e9ca2eeba0 msgr2=0x55e9ca2f1050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.778+0000 7fa4afe58680 1 --2- 172.21.15.153:0/2509179171 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55e9ca2eeba0 0x55e9ca2f1050 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.778+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fa49801a070 msgr2=0x7fa49803d990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.778+0000 7fa4afe58680 1 --2- 172.21.15.153:0/2509179171 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fa49801a070 0x7fa49803d990 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.778+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55e9ca2f3470 msgr2=0x55e9ca2f5850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.778+0000 7fa4afe58680 1 --2- 172.21.15.153:0/2509179171 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55e9ca2f3470 0x55e9ca2f5850 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.778+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa4880340f0 msgr2=0x7fa4880365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.778+0000 7fa4afe58680 1 --2- 172.21.15.153:0/2509179171 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa4880340f0 0x7fa4880365a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x55e9ca22f8d0 tx=0x7fa494015000 comp rx=0 tx=0).stop 2023-10-05T21:16:19.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.778+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca2300b0 msgr2=0x55e9ca2bca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.778+0000 7fa4afe58680 1 --2- 172.21.15.153:0/2509179171 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca2300b0 0x55e9ca2bca20 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fa498000c00 tx=0x7fa498016000 comp rx=0 tx=0).stop 2023-10-05T21:16:19.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.778+0000 7fa4a3731700 1 -- 172.21.15.153:0/2509179171 reap_dead start 2023-10-05T21:16:19.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.778+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 shutdown_connections 2023-10-05T21:16:19.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.778+0000 7fa4afe58680 1 --2- 172.21.15.153:0/2509179171 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca2300b0 0x55e9ca2bca20 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.778+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 >> 172.21.15.153:0/2509179171 conn(0x55e9ca2b6b90 msgr2=0x55e9ca2d5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:19.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.778+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 shutdown_connections 2023-10-05T21:16:19.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.778+0000 7fa4afe58680 1 -- 172.21.15.153:0/2509179171 wait complete. 2023-10-05T21:16:19.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.779+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55e9ca323540 msgr2=0x55e9ca325920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.779+0000 7fa4afe58680 1 --2- 172.21.15.153:0/2834242823 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x55e9ca323540 0x55e9ca325920 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.779+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55e9ca31fc50 msgr2=0x55e9ca322100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.779+0000 7fa4afe58680 1 --2- 172.21.15.153:0/2834242823 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55e9ca31fc50 0x55e9ca322100 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.779+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55e9ca32adb0 msgr2=0x55e9ca32d240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.779+0000 7fa4afe58680 1 --2- 172.21.15.153:0/2834242823 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x55e9ca32adb0 0x55e9ca32d240 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.779+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55e9ca326df0 msgr2=0x55e9ca329270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.779+0000 7fa4afe58680 1 --2- 172.21.15.153:0/2834242823 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55e9ca326df0 0x55e9ca329270 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.779+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa3e8034190 msgr2=0x7fa3e8036640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.779+0000 7fa4afe58680 1 --2- 172.21.15.153:0/2834242823 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa3e8034190 0x7fa3e8036640 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55e9ca3008e0 tx=0x7fa49c037450 comp rx=0 tx=0).stop 2023-10-05T21:16:19.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.779+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca30e130 msgr2=0x55e9ca314e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:19.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.779+0000 7fa4a2f30700 1 -- 172.21.15.153:0/2834242823 reap_dead start 2023-10-05T21:16:19.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.779+0000 7fa4afe58680 1 --2- 172.21.15.153:0/2834242823 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca30e130 0x55e9ca314e30 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fa494012fd0 tx=0x7fa494030000 comp rx=0 tx=0).stop 2023-10-05T21:16:19.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.779+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 shutdown_connections 2023-10-05T21:16:19.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.779+0000 7fa4afe58680 1 --2- 172.21.15.153:0/2834242823 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9ca30e130 0x55e9ca314e30 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:19.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.779+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 >> 172.21.15.153:0/2834242823 conn(0x55e9ca30a430 msgr2=0x55e9ca308500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:19.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.779+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 shutdown_connections 2023-10-05T21:16:19.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:19.779+0000 7fa4afe58680 1 -- 172.21.15.153:0/2834242823 wait complete. 2023-10-05T21:16:59.812 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2023-10-05T21:16:59.813 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2023-10-05T21:16:59.813 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2023-10-05T21:16:59.865 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:16:59.866 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:16:59.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.865+0000 7f9109b80680 1 Processor -- start 2023-10-05T21:16:59.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.865+0000 7f9109b80680 1 -- start start 2023-10-05T21:16:59.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.865+0000 7f9109b80680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5576f4c8fbe0 0x5576f4c91fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:59.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.865+0000 7f9109b80680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5576f4bd8990 con 0x5576f4c897b0 2023-10-05T21:16:59.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.865+0000 7f9109b80680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x5576f4b98db0 con 0x5576f4c8fbe0 2023-10-05T21:16:59.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.865+0000 7f90f7fff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5576f4c8fbe0 0x5576f4c91fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:59.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.865+0000 7f90fcc58700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x5576f4c897b0 0x5576f4c89bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:57206/0 (socket says 172.21.15.153:57206) 2023-10-05T21:16:59.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.865+0000 7f90fcc58700 1 -- 172.21.15.153:0/2524991551 learned_addr learned my addr 172.21.15.153:0/2524991551 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:16:59.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.866+0000 7f90f7fff700 1 -- 172.21.15.153:0/2524991551 >> v1:172.21.15.111:6789/0 conn(0x5576f4c897b0 legacy=0x5576f4c89bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:59.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.866+0000 7f90f77fe700 1 -- 172.21.15.153:0/2524991551 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2473612200 0 0) 0x5576f4bd8990 con 0x5576f4c897b0 2023-10-05T21:16:59.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.866+0000 7f90f7fff700 1 -- 172.21.15.153:0/2524991551 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576f4c93510 con 0x5576f4c8fbe0 2023-10-05T21:16:59.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.866+0000 7f90f7fff700 1 --2- 172.21.15.153:0/2524991551 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4c8fbe0 0x5576f4c91fc0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f90e800a5d0 tx=0x7f90e8005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8181dd5a63d15a66 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:59.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.866+0000 7f90f77fe700 1 -- 172.21.15.153:0/2524991551 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90e80086a0 con 0x5576f4c8fbe0 2023-10-05T21:16:59.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.866+0000 7f90f77fe700 1 -- 172.21.15.153:0/2524991551 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e8008800 con 0x5576f4c8fbe0 2023-10-05T21:16:59.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.866+0000 7f90f77fe700 1 -- 172.21.15.153:0/2524991551 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90e8008ad0 con 0x5576f4c8fbe0 2023-10-05T21:16:59.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.867+0000 7f9109b80680 1 -- 172.21.15.153:0/2524991551 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4c8fbe0 msgr2=0x5576f4c91fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:59.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.867+0000 7f9109b80680 1 --2- 172.21.15.153:0/2524991551 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4c8fbe0 0x5576f4c91fc0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f90e800a5d0 tx=0x7f90e8005a50 comp rx=0 tx=0).stop 2023-10-05T21:16:59.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.867+0000 7f9109b80680 1 -- 172.21.15.153:0/2524991551 shutdown_connections 2023-10-05T21:16:59.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.867+0000 7f9109b80680 1 --2- 172.21.15.153:0/2524991551 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4c8fbe0 0x5576f4c91fc0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:59.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.867+0000 7f9109b80680 1 -- 172.21.15.153:0/2524991551 >> 172.21.15.153:0/2524991551 conn(0x5576f4c85300 msgr2=0x5576f4c87710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:59.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.867+0000 7f9109b80680 1 -- 172.21.15.153:0/2524991551 shutdown_connections 2023-10-05T21:16:59.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.867+0000 7f9109b80680 1 -- 172.21.15.153:0/2524991551 wait complete. 2023-10-05T21:16:59.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.868+0000 7f9109b80680 1 Processor -- start 2023-10-05T21:16:59.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.868+0000 7f9109b80680 1 -- start start 2023-10-05T21:16:59.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.868+0000 7f9109b80680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4c897b0 0x5576f4c8c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:59.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.868+0000 7f9109b80680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576f4b38ea0 con 0x5576f4c897b0 2023-10-05T21:16:59.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.868+0000 7f90fcc58700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4c897b0 0x5576f4c8c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:59.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.868+0000 7f90fcc58700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4c897b0 0x5576f4c8c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60466/0 (socket says 172.21.15.153:60466) 2023-10-05T21:16:59.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.868+0000 7f90fcc58700 1 -- 172.21.15.153:0/1979724435 learned_addr learned my addr 172.21.15.153:0/1979724435 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:59.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.868+0000 7f90fcc58700 1 -- 172.21.15.153:0/1979724435 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e8005cf0 con 0x5576f4c897b0 2023-10-05T21:16:59.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.869+0000 7f90fcc58700 1 --2- 172.21.15.153:0/1979724435 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4c897b0 0x5576f4c8c200 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f90f0001dc0 tx=0x7f90f0001790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f8c75c2bede9e72 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:59.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.869+0000 7f90f67fc700 1 -- 172.21.15.153:0/1979724435 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90f000bce0 con 0x5576f4c897b0 2023-10-05T21:16:59.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.869+0000 7f90f67fc700 1 -- 172.21.15.153:0/1979724435 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f000be40 con 0x5576f4c897b0 2023-10-05T21:16:59.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.869+0000 7f90f67fc700 1 -- 172.21.15.153:0/1979724435 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90f000e5d0 con 0x5576f4c897b0 2023-10-05T21:16:59.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.869+0000 7f9109b80680 1 -- 172.21.15.153:0/1979724435 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4c897b0 msgr2=0x5576f4c8c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:59.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.869+0000 7f9109b80680 1 --2- 172.21.15.153:0/1979724435 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4c897b0 0x5576f4c8c200 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f90f0001dc0 tx=0x7f90f0001790 comp rx=0 tx=0).stop 2023-10-05T21:16:59.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.869+0000 7f9109b80680 1 -- 172.21.15.153:0/1979724435 shutdown_connections 2023-10-05T21:16:59.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.869+0000 7f9109b80680 1 --2- 172.21.15.153:0/1979724435 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4c897b0 0x5576f4c8c200 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:59.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.869+0000 7f9109b80680 1 -- 172.21.15.153:0/1979724435 >> 172.21.15.153:0/1979724435 conn(0x5576f4c85300 msgr2=0x5576f4ca6400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:59.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.869+0000 7f9109b80680 1 -- 172.21.15.153:0/1979724435 shutdown_connections 2023-10-05T21:16:59.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.869+0000 7f9109b80680 1 -- 172.21.15.153:0/1979724435 wait complete. 2023-10-05T21:16:59.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.870+0000 7f9109b80680 1 Processor -- start 2023-10-05T21:16:59.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.870+0000 7f9109b80680 1 -- start start 2023-10-05T21:16:59.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.870+0000 7f9109b80680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4c897b0 0x5576f4cb4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:59.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.870+0000 7f9109b80680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576f4b2fc80 con 0x5576f4c897b0 2023-10-05T21:16:59.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.870+0000 7f90fcc58700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4c897b0 0x5576f4cb4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:59.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.870+0000 7f90fcc58700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4c897b0 0x5576f4cb4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60478/0 (socket says 172.21.15.153:60478) 2023-10-05T21:16:59.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.870+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 learned_addr learned my addr 172.21.15.153:0/14566596 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:59.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.870+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f0001a70 con 0x5576f4c897b0 2023-10-05T21:16:59.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.871+0000 7f90fcc58700 1 --2- 172.21.15.153:0/14566596 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4c897b0 0x5576f4cb4000 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f90f00017d0 tx=0x7f90f0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:59.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.871+0000 7f90f4ff9700 1 -- 172.21.15.153:0/14566596 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90f001f070 con 0x5576f4c897b0 2023-10-05T21:16:59.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.871+0000 7f90f4ff9700 1 -- 172.21.15.153:0/14566596 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f001a4d0 con 0x5576f4c897b0 2023-10-05T21:16:59.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.871+0000 7f90f4ff9700 1 -- 172.21.15.153:0/14566596 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90f001a7a0 con 0x5576f4c897b0 2023-10-05T21:16:59.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.871+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5576f4cb4540 con 0x5576f4c897b0 2023-10-05T21:16:59.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.871+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5576f4cb4990 con 0x5576f4c897b0 2023-10-05T21:16:59.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.872+0000 7f90f4ff9700 1 -- 172.21.15.153:0/14566596 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f90f001a900 con 0x5576f4c897b0 2023-10-05T21:16:59.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.872+0000 7f90f4ff9700 1 --2- 172.21.15.153:0/14566596 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f90e0034140 0x7f90e00365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:59.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.872+0000 7f9109b80680 20 rados->read ofs=0 len=0 2023-10-05T21:16:59.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.872+0000 7f90f4ff9700 1 -- 172.21.15.153:0/14566596 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f90f0048fb0 con 0x5576f4c897b0 2023-10-05T21:16:59.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.872+0000 7f90f7fff700 1 --2- 172.21.15.153:0/14566596 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f90e0034140 0x7f90e00365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:59.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.872+0000 7f9109b80680 1 --2- 172.21.15.153:0/14566596 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5576f4c8fbe0 0x5576f4cbfd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:59.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.872+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc04e0 con 0x5576f4c8fbe0 2023-10-05T21:16:59.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.872+0000 7f90fd459700 1 --2- 172.21.15.153:0/14566596 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5576f4c8fbe0 0x5576f4cbfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:59.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.873+0000 7f90f7fff700 1 --2- 172.21.15.153:0/14566596 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f90e0034140 0x7f90e00365f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f90e8003080 tx=0x7f90e8015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:59.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.873+0000 7f90fd459700 1 --2- 172.21.15.153:0/14566596 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5576f4c8fbe0 0x5576f4cbfd50 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:59.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.873+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.873+0000 7f9109b80680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:59.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.873+0000 7f9109b80680 20 realm 2023-10-05T21:16:59.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.873+0000 7f9109b80680 20 rados->read ofs=0 len=0 2023-10-05T21:16:59.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.873+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cbd370 con 0x5576f4c8fbe0 2023-10-05T21:16:59.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.873+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.873+0000 7f9109b80680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:59.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.873+0000 7f9109b80680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:16:59.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.873+0000 7f9109b80680 20 rados->read ofs=0 len=0 2023-10-05T21:16:59.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.873+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc0fe0 con 0x5576f4c8fbe0 2023-10-05T21:16:59.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.874+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.874+0000 7f9109b80680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:59.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.874+0000 7f9109b80680 20 rados->read ofs=0 len=0 2023-10-05T21:16:59.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.874+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc1900 con 0x5576f4c8fbe0 2023-10-05T21:16:59.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.874+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.874+0000 7f9109b80680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:59.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.874+0000 7f9109b80680 20 rados->read ofs=0 len=0 2023-10-05T21:16:59.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.874+0000 7f9109b80680 1 --2- 172.21.15.153:0/14566596 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5576f4cc21c0 0x5576f4cc45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:59.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.874+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc4bf0 con 0x5576f4cc21c0 2023-10-05T21:16:59.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.874+0000 7f90fcc58700 1 --2- 172.21.15.153:0/14566596 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5576f4cc21c0 0x5576f4cc45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:59.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.874+0000 7f90fcc58700 1 --2- 172.21.15.153:0/14566596 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5576f4cc21c0 0x5576f4cc45a0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:59.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.875+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f90f0014070 con 0x5576f4cc21c0 2023-10-05T21:16:59.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.875+0000 7f9109b80680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:16:59.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.875+0000 7f9109b80680 20 searching for the correct realm 2023-10-05T21:16:59.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.875+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x5576f4cc21c0 2023-10-05T21:16:59.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.875+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f0014070 con 0x5576f4cc21c0 2023-10-05T21:16:59.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.875+0000 7f90fcc58700 1 --2- 172.21.15.153:0/14566596 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f90f002d020 0x7f90f002c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:59.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.875+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x7f90f002d020 2023-10-05T21:16:59.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.875+0000 7f90f7fff700 1 --2- 172.21.15.153:0/14566596 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f90f002d020 0x7f90f002c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:59.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.875+0000 7f90f7fff700 1 --2- 172.21.15.153:0/14566596 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f90f002d020 0x7f90f002c5d0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:59.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.876+0000 7f90f7fff700 1 -- 172.21.15.153:0/14566596 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90e8019040 con 0x7f90f002d020 2023-10-05T21:16:59.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.876+0000 7f90f7fff700 1 --2- 172.21.15.153:0/14566596 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f90e8007030 0x7f90e801d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:59.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.876+0000 7f90f7fff700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x7f90e8007030 2023-10-05T21:16:59.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.876+0000 7f90fd459700 1 --2- 172.21.15.153:0/14566596 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f90e8007030 0x7f90e801d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:59.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.876+0000 7f90fd459700 1 --2- 172.21.15.153:0/14566596 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f90e8007030 0x7f90e801d420 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:59.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.877+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f800a570 con 0x7f90e8007030 2023-10-05T21:16:59.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.877+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x5576f4c8fbe0 2023-10-05T21:16:59.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.877+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.877+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x5576f4c8fbe0 2023-10-05T21:16:59.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.877+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.877+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x7f90e8007030 2023-10-05T21:16:59.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.877+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f800a570 con 0x7f90e8007030 2023-10-05T21:16:59.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.877+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x7f90e8007030 2023-10-05T21:16:59.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.878+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f800a570 con 0x7f90e8007030 2023-10-05T21:16:59.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.878+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x7f90f002d020 2023-10-05T21:16:59.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.878+0000 7f90f7fff700 1 -- 172.21.15.153:0/14566596 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90e8019040 con 0x7f90f002d020 2023-10-05T21:16:59.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.878+0000 7f90f7fff700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x5576f4cc21c0 2023-10-05T21:16:59.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.878+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f90f0014070 con 0x5576f4cc21c0 2023-10-05T21:16:59.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.878+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x5576f4c8fbe0 2023-10-05T21:16:59.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.878+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.878+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x7f90e8007030 2023-10-05T21:16:59.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.879+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f800a570 con 0x7f90e8007030 2023-10-05T21:16:59.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.879+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x5576f4c8fbe0 2023-10-05T21:16:59.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.879+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.879+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x7f90f002d020 2023-10-05T21:16:59.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.879+0000 7f90f7fff700 1 -- 172.21.15.153:0/14566596 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90e8019040 con 0x7f90f002d020 2023-10-05T21:16:59.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.879+0000 7f90f7fff700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x5576f4cc21c0 2023-10-05T21:16:59.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.879+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f0014070 con 0x5576f4cc21c0 2023-10-05T21:16:59.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.879+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x5576f4cc21c0 2023-10-05T21:16:59.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.880+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f0014070 con 0x5576f4cc21c0 2023-10-05T21:16:59.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.880+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x7f90e8007030 2023-10-05T21:16:59.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.880+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f800a570 con 0x7f90e8007030 2023-10-05T21:16:59.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.880+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x5576f4cc21c0 2023-10-05T21:16:59.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.880+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f0014070 con 0x5576f4cc21c0 2023-10-05T21:16:59.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.880+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x5576f4cc21c0 2023-10-05T21:16:59.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.881+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f0014070 con 0x5576f4cc21c0 2023-10-05T21:16:59.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.881+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x5576f4c8fbe0 2023-10-05T21:16:59.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.881+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.881+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x5576f4c8fbe0 2023-10-05T21:16:59.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.881+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.881+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x7f90e8007030 2023-10-05T21:16:59.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.881+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f800a570 con 0x7f90e8007030 2023-10-05T21:16:59.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.881+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x5576f4cc21c0 2023-10-05T21:16:59.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.882+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f0014070 con 0x5576f4cc21c0 2023-10-05T21:16:59.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.882+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x7f90f002d020 2023-10-05T21:16:59.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.882+0000 7f90f7fff700 1 -- 172.21.15.153:0/14566596 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90e8019040 con 0x7f90f002d020 2023-10-05T21:16:59.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.882+0000 7f90f7fff700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x5576f4c8fbe0 2023-10-05T21:16:59.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.882+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.882+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x7f90e8007030 2023-10-05T21:16:59.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.882+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f800a570 con 0x7f90e8007030 2023-10-05T21:16:59.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.882+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x5576f4cc21c0 2023-10-05T21:16:59.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.883+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f0014070 con 0x5576f4cc21c0 2023-10-05T21:16:59.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.883+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x7f90e8007030 2023-10-05T21:16:59.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.883+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f800a570 con 0x7f90e8007030 2023-10-05T21:16:59.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.883+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x7f90f002d020 2023-10-05T21:16:59.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.883+0000 7f90f7fff700 1 -- 172.21.15.153:0/14566596 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90e8019040 con 0x7f90f002d020 2023-10-05T21:16:59.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.883+0000 7f90f7fff700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x5576f4cc21c0 2023-10-05T21:16:59.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.883+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f0014070 con 0x5576f4cc21c0 2023-10-05T21:16:59.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.883+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x7f90e8007030 2023-10-05T21:16:59.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.884+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f800a570 con 0x7f90e8007030 2023-10-05T21:16:59.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.884+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x5576f4c8fbe0 2023-10-05T21:16:59.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.884+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.884+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6760 con 0x7f90f002d020 2023-10-05T21:16:59.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.884+0000 7f90f7fff700 1 -- 172.21.15.153:0/14566596 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90e8019040 con 0x7f90f002d020 2023-10-05T21:16:59.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.884+0000 7f9109b80680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:16:59.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.884+0000 7f9109b80680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:16:59.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.884+0000 7f9109b80680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:16:59.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.884+0000 7f9109b80680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:16:59.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.884+0000 7f9109b80680 20 rados->read ofs=0 len=0 2023-10-05T21:16:59.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.884+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc56b0 con 0x5576f4c8fbe0 2023-10-05T21:16:59.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.884+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.884+0000 7f9109b80680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:59.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.884+0000 7f9109b80680 20 rados->read ofs=0 len=0 2023-10-05T21:16:59.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.884+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc5ab0 con 0x5576f4c8fbe0 2023-10-05T21:16:59.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.885+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.885+0000 7f9109b80680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:59.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.885+0000 7f9109b80680 20 rados->read ofs=0 len=0 2023-10-05T21:16:59.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.885+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6bf0 con 0x5576f4c8fbe0 2023-10-05T21:16:59.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.885+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.885+0000 7f9109b80680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:16:59.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.885+0000 7f9109b80680 20 rados->read ofs=0 len=0 2023-10-05T21:16:59.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.885+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6fa0 con 0x5576f4cc21c0 2023-10-05T21:16:59.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.885+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f90f0014070 con 0x5576f4cc21c0 2023-10-05T21:16:59.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.885+0000 7f9109b80680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:59.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.885+0000 7f9109b80680 20 rados->read ofs=0 len=0 2023-10-05T21:16:59.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.885+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc7350 con 0x5576f4c8fbe0 2023-10-05T21:16:59.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.885+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.885+0000 7f9109b80680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:59.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.885+0000 7f9109b80680 20 rados->read ofs=0 len=0 2023-10-05T21:16:59.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.886+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc7350 con 0x5576f4c8fbe0 2023-10-05T21:16:59.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.886+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.886+0000 7f9109b80680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:59.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.886+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc8360 con 0x5576f4cc21c0 2023-10-05T21:16:59.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.886+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f0014070 con 0x5576f4cc21c0 2023-10-05T21:16:59.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.886+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc8360 con 0x7f90f002d020 2023-10-05T21:16:59.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.886+0000 7f90f7fff700 1 -- 172.21.15.153:0/14566596 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90e8019040 con 0x7f90f002d020 2023-10-05T21:16:59.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.886+0000 7f90f7fff700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc8360 con 0x7f90e8007030 2023-10-05T21:16:59.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.887+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f800a570 con 0x7f90e8007030 2023-10-05T21:16:59.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.887+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6bf0 con 0x5576f4c8fbe0 2023-10-05T21:16:59.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.887+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.887+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6bf0 con 0x5576f4c8fbe0 2023-10-05T21:16:59.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.887+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.887+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6bf0 con 0x7f90e8007030 2023-10-05T21:16:59.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.887+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f800a570 con 0x7f90e8007030 2023-10-05T21:16:59.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.887+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6bf0 con 0x7f90e8007030 2023-10-05T21:16:59.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.888+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f800a570 con 0x7f90e8007030 2023-10-05T21:16:59.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.888+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6bf0 con 0x7f90f002d020 2023-10-05T21:16:59.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.888+0000 7f90f7fff700 1 -- 172.21.15.153:0/14566596 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90e8019040 con 0x7f90f002d020 2023-10-05T21:16:59.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.888+0000 7f90f7fff700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6bf0 con 0x5576f4cc21c0 2023-10-05T21:16:59.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.888+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f90f0014070 con 0x5576f4cc21c0 2023-10-05T21:16:59.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.888+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6bf0 con 0x5576f4c8fbe0 2023-10-05T21:16:59.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.888+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.888+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6bf0 con 0x7f90e8007030 2023-10-05T21:16:59.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.889+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f800a570 con 0x7f90e8007030 2023-10-05T21:16:59.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.889+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6bf0 con 0x5576f4c8fbe0 2023-10-05T21:16:59.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.889+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.889+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6bf0 con 0x7f90f002d020 2023-10-05T21:16:59.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.889+0000 7f90f7fff700 1 -- 172.21.15.153:0/14566596 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90e8019040 con 0x7f90f002d020 2023-10-05T21:16:59.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.889+0000 7f90f7fff700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6bf0 con 0x5576f4cc21c0 2023-10-05T21:16:59.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.889+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f0014070 con 0x5576f4cc21c0 2023-10-05T21:16:59.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.889+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6bf0 con 0x5576f4cc21c0 2023-10-05T21:16:59.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.890+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f0014070 con 0x5576f4cc21c0 2023-10-05T21:16:59.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.890+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6bf0 con 0x7f90e8007030 2023-10-05T21:16:59.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.890+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f800a570 con 0x7f90e8007030 2023-10-05T21:16:59.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.890+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6bf0 con 0x5576f4cc21c0 2023-10-05T21:16:59.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.890+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f0014070 con 0x5576f4cc21c0 2023-10-05T21:16:59.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.890+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6bf0 con 0x5576f4cc21c0 2023-10-05T21:16:59.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.891+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f0014070 con 0x5576f4cc21c0 2023-10-05T21:16:59.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.891+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6bf0 con 0x5576f4c8fbe0 2023-10-05T21:16:59.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.891+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.891+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6bf0 con 0x5576f4c8fbe0 2023-10-05T21:16:59.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.891+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.891+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6bf0 con 0x7f90e8007030 2023-10-05T21:16:59.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.891+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f800a570 con 0x7f90e8007030 2023-10-05T21:16:59.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.891+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6bf0 con 0x5576f4cc21c0 2023-10-05T21:16:59.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.892+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f0014070 con 0x5576f4cc21c0 2023-10-05T21:16:59.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.892+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6bf0 con 0x7f90f002d020 2023-10-05T21:16:59.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.892+0000 7f90f7fff700 1 -- 172.21.15.153:0/14566596 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90e8019040 con 0x7f90f002d020 2023-10-05T21:16:59.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.892+0000 7f90f7fff700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6bf0 con 0x5576f4c8fbe0 2023-10-05T21:16:59.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.892+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.892+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6bf0 con 0x7f90e8007030 2023-10-05T21:16:59.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.892+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f800a570 con 0x7f90e8007030 2023-10-05T21:16:59.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.892+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6bf0 con 0x5576f4cc21c0 2023-10-05T21:16:59.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.893+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f0014070 con 0x5576f4cc21c0 2023-10-05T21:16:59.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.893+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6bf0 con 0x7f90e8007030 2023-10-05T21:16:59.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.893+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f800a570 con 0x7f90e8007030 2023-10-05T21:16:59.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.893+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6bf0 con 0x7f90f002d020 2023-10-05T21:16:59.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.893+0000 7f90f7fff700 1 -- 172.21.15.153:0/14566596 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90e8019040 con 0x7f90f002d020 2023-10-05T21:16:59.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.893+0000 7f90f7fff700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6bf0 con 0x5576f4cc21c0 2023-10-05T21:16:59.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.894+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f0014070 con 0x5576f4cc21c0 2023-10-05T21:16:59.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.894+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6bf0 con 0x7f90e8007030 2023-10-05T21:16:59.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.894+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90f800a570 con 0x7f90e8007030 2023-10-05T21:16:59.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.894+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6bf0 con 0x5576f4c8fbe0 2023-10-05T21:16:59.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.894+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.894+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc6bf0 con 0x7f90f002d020 2023-10-05T21:16:59.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.895+0000 7f90f7fff700 1 -- 172.21.15.153:0/14566596 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90e8019040 con 0x7f90f002d020 2023-10-05T21:16:59.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.895+0000 7f9109b80680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:16:59.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.895+0000 7f9109b80680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:16:59.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.895+0000 7f9109b80680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:16:59.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.895+0000 7f9109b80680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:16:59.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.895+0000 7f9109b80680 20 rados->read ofs=0 len=0 2023-10-05T21:16:59.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.895+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc7350 con 0x5576f4c8fbe0 2023-10-05T21:16:59.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.895+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.895+0000 7f9109b80680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:59.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.895+0000 7f9109b80680 20 rados->read ofs=0 len=0 2023-10-05T21:16:59.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.895+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc7700 con 0x5576f4cc21c0 2023-10-05T21:16:59.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.895+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f90f0014070 con 0x5576f4cc21c0 2023-10-05T21:16:59.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.895+0000 7f9109b80680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:16:59.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.895+0000 7f9109b80680 20 rados->read ofs=0 len=0 2023-10-05T21:16:59.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.895+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc7fa0 con 0x5576f4c8fbe0 2023-10-05T21:16:59.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.896+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.896+0000 7f9109b80680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:16:59.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.896+0000 7f9109b80680 20 rados->read ofs=0 len=0 2023-10-05T21:16:59.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.896+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc7fa0 con 0x5576f4c8fbe0 2023-10-05T21:16:59.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.896+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.896+0000 7f9109b80680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:16:59.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.896+0000 7f9109b80680 20 rados->read ofs=0 len=0 2023-10-05T21:16:59.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.896+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc80a0 con 0x7f90e8007030 2023-10-05T21:16:59.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.896+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f90f800a570 con 0x7f90e8007030 2023-10-05T21:16:59.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.896+0000 7f9109b80680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:59.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.896+0000 7f9109b80680 20 zone default found 2023-10-05T21:16:59.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.896+0000 7f9109b80680 4 Realm: () 2023-10-05T21:16:59.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.896+0000 7f9109b80680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:16:59.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.896+0000 7f9109b80680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:16:59.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.896+0000 7f9109b80680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:16:59.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.896+0000 7f9109b80680 20 zonegroup default 2023-10-05T21:16:59.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.896+0000 7f9109b80680 20 rados->read ofs=0 len=0 2023-10-05T21:16:59.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.896+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc80a0 con 0x7f90e8007030 2023-10-05T21:16:59.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.896+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f90f800a570 con 0x7f90e8007030 2023-10-05T21:16:59.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.896+0000 7f9109b80680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:59.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.896+0000 7f9109b80680 20 rados->read ofs=0 len=0 2023-10-05T21:16:59.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.896+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc9a20 con 0x5576f4cc21c0 2023-10-05T21:16:59.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.897+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f90f0014070 con 0x5576f4cc21c0 2023-10-05T21:16:59.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.897+0000 7f9109b80680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:59.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.897+0000 7f9109b80680 20 rados->read ofs=0 len=0 2023-10-05T21:16:59.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.897+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc9dd0 con 0x5576f4cc21c0 2023-10-05T21:16:59.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.897+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f90f0014070 con 0x5576f4cc21c0 2023-10-05T21:16:59.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.897+0000 7f9109b80680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:16:59.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.897+0000 7f9109b80680 20 started sync module instance, tier type = 2023-10-05T21:16:59.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.897+0000 7f9109b80680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:16:59.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.897+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc90e0 con 0x7f90f002d020 2023-10-05T21:16:59.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.898+0000 7f90f7fff700 1 -- 172.21.15.153:0/14566596 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v31'258 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90e8019040 con 0x7f90f002d020 2023-10-05T21:16:59.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.898+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93969401550048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cca670 con 0x7f90f002d020 2023-10-05T21:16:59.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.898+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4ccaf10 con 0x5576f4c8fbe0 2023-10-05T21:16:59.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.899+0000 7f90f7fff700 1 -- 172.21.15.153:0/14566596 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 93969401550048] v31'259 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90e8019040 con 0x7f90f002d020 2023-10-05T21:16:59.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.899+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v31'258 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.899+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93969401553280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4ccaf70 con 0x5576f4c8fbe0 2023-10-05T21:16:59.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.899+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4ccbb70 con 0x5576f4cc21c0 2023-10-05T21:16:59.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.900+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 93969401553280] v31'259 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.900+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v31'258 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90f0014070 con 0x5576f4cc21c0 2023-10-05T21:16:59.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.900+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93969401558528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4ccbf70 con 0x5576f4cc21c0 2023-10-05T21:16:59.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.900+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4ccc980 con 0x7f90f002d020 2023-10-05T21:16:59.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.901+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 93969401558528] v31'259 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90f0014070 con 0x5576f4cc21c0 2023-10-05T21:16:59.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.901+0000 7f90f7fff700 1 -- 172.21.15.153:0/14566596 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v31'258 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90e8019040 con 0x7f90f002d020 2023-10-05T21:16:59.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.901+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 93969401555488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4ccc5b0 con 0x7f90f002d020 2023-10-05T21:16:59.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.901+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4ccd9b0 con 0x5576f4c8fbe0 2023-10-05T21:16:59.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.902+0000 7f90f7fff700 1 -- 172.21.15.153:0/14566596 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 93969401555488] v31'259 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90e8019040 con 0x7f90f002d020 2023-10-05T21:16:59.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.902+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v31'258 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.902+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 93969401566368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4ccddb0 con 0x5576f4c8fbe0 2023-10-05T21:16:59.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.902+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cce8a0 con 0x7f90e8007030 2023-10-05T21:16:59.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.903+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 93969401566368] v31'259 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.903+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v31'258 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90f800a570 con 0x7f90e8007030 2023-10-05T21:16:59.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.903+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 93969401570096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cce860 con 0x7f90e8007030 2023-10-05T21:16:59.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.903+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4ccf300 con 0x7f90e8007030 2023-10-05T21:16:59.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.904+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 93969401570096] v31'259 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90f800a570 con 0x7f90e8007030 2023-10-05T21:16:59.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.904+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v31'258 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90f800a570 con 0x7f90e8007030 2023-10-05T21:16:59.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.904+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93969401564464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4ccf300 con 0x7f90e8007030 2023-10-05T21:16:59.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.904+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4ccfd50 con 0x7f90e8007030 2023-10-05T21:16:59.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.905+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(98 notify.7 [create] v31'258 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90f800a570 con 0x7f90e8007030 2023-10-05T21:16:59.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.905+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(97 notify.6 [watch watch cookie 93969401564464] v31'259 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90f800a570 con 0x7f90e8007030 2023-10-05T21:16:59.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.905+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93969401575456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cd01c0 con 0x7f90e8007030 2023-10-05T21:16:59.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.905+0000 7f9109b80680 20 add_watcher() i=0 2023-10-05T21:16:59.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.905+0000 7f9109b80680 20 add_watcher() i=1 2023-10-05T21:16:59.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.905+0000 7f9109b80680 20 add_watcher() i=2 2023-10-05T21:16:59.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.905+0000 7f9109b80680 20 add_watcher() i=3 2023-10-05T21:16:59.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.905+0000 7f9109b80680 20 add_watcher() i=4 2023-10-05T21:16:59.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.905+0000 7f9109b80680 20 add_watcher() i=5 2023-10-05T21:16:59.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.905+0000 7f9109b80680 20 add_watcher() i=6 2023-10-05T21:16:59.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.906+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 93969401575456] v31'259 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90f800a570 con 0x7f90e8007030 2023-10-05T21:16:59.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.906+0000 7f9109b80680 20 add_watcher() i=7 2023-10-05T21:16:59.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.906+0000 7f9109b80680 2 all 8 watchers are set, enabling cache 2023-10-05T21:16:59.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.906+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4ccee70 con 0x5576f4c8fbe0 2023-10-05T21:16:59.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.906+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.906+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93969401576560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4ccee70 con 0x5576f4c8fbe0 2023-10-05T21:16:59.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.907+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 93969401576560] v31'249 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.907+0000 7f90cdfe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:16:59.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.907+0000 7f9109b80680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:16:59.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.907+0000 7f9109b80680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:16:59.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.907+0000 7f9109b80680 1 Processor -- start 2023-10-05T21:16:59.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.907+0000 7f9109b80680 1 -- start start 2023-10-05T21:16:59.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.907+0000 7f9109b80680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4cdcdb0 0x5576f4cdd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:59.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.907+0000 7f9109b80680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576f4cdd7d0 con 0x5576f4cdcdb0 2023-10-05T21:16:59.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.908+0000 7f90f7fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4cdcdb0 0x5576f4cdd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:59.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.908+0000 7f90f7fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4cdcdb0 0x5576f4cdd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60486/0 (socket says 172.21.15.153:60486) 2023-10-05T21:16:59.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.908+0000 7f90f7fff700 1 -- 172.21.15.153:0/3620310130 learned_addr learned my addr 172.21.15.153:0/3620310130 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:59.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.908+0000 7f90f7fff700 1 -- 172.21.15.153:0/3620310130 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576f4cddcb0 con 0x5576f4cdcdb0 2023-10-05T21:16:59.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.908+0000 7f90f7fff700 1 --2- 172.21.15.153:0/3620310130 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4cdcdb0 0x5576f4cdd1c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x5576f4c8a480 tx=0x7f90e8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a82e7e806841417 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:59.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.908+0000 7f90cd7e2700 1 -- 172.21.15.153:0/3620310130 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90e801de90 con 0x5576f4cdcdb0 2023-10-05T21:16:59.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.909+0000 7f90cd7e2700 1 -- 172.21.15.153:0/3620310130 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e802b440 con 0x5576f4cdcdb0 2023-10-05T21:16:59.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.909+0000 7f90cd7e2700 1 -- 172.21.15.153:0/3620310130 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90e802b630 con 0x5576f4cdcdb0 2023-10-05T21:16:59.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.909+0000 7f9109b80680 1 -- 172.21.15.153:0/3620310130 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4cdcdb0 msgr2=0x5576f4cdd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:59.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.909+0000 7f9109b80680 1 --2- 172.21.15.153:0/3620310130 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4cdcdb0 0x5576f4cdd1c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x5576f4c8a480 tx=0x7f90e8012000 comp rx=0 tx=0).stop 2023-10-05T21:16:59.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.909+0000 7f9109b80680 1 -- 172.21.15.153:0/3620310130 shutdown_connections 2023-10-05T21:16:59.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.909+0000 7f9109b80680 1 --2- 172.21.15.153:0/3620310130 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4cdcdb0 0x5576f4cdd1c0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:59.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.909+0000 7f9109b80680 1 -- 172.21.15.153:0/3620310130 >> 172.21.15.153:0/3620310130 conn(0x5576f4cd90b0 msgr2=0x5576f4cd71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:59.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.909+0000 7f9109b80680 1 -- 172.21.15.153:0/3620310130 shutdown_connections 2023-10-05T21:16:59.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.909+0000 7f9109b80680 1 -- 172.21.15.153:0/3620310130 wait complete. 2023-10-05T21:16:59.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.910+0000 7f9109b80680 1 Processor -- start 2023-10-05T21:16:59.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.910+0000 7f9109b80680 1 -- start start 2023-10-05T21:16:59.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.910+0000 7f9109b80680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4cdcdb0 0x5576f4ce39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:59.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.910+0000 7f9109b80680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576f4ce3f30 con 0x5576f4cdcdb0 2023-10-05T21:16:59.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.910+0000 7f90f7fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4cdcdb0 0x5576f4ce39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:59.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.910+0000 7f90f7fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4cdcdb0 0x5576f4ce39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60502/0 (socket says 172.21.15.153:60502) 2023-10-05T21:16:59.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.910+0000 7f90f7fff700 1 -- 172.21.15.153:0/4107994674 learned_addr learned my addr 172.21.15.153:0/4107994674 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:16:59.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.910+0000 7f90f7fff700 1 -- 172.21.15.153:0/4107994674 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576f4c93510 con 0x5576f4cdcdb0 2023-10-05T21:16:59.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.911+0000 7f90f7fff700 1 --2- 172.21.15.153:0/4107994674 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4cdcdb0 0x5576f4ce39f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f90e8038040 tx=0x7f90e8030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:59.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.911+0000 7f90477fe700 1 -- 172.21.15.153:0/4107994674 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90e803f740 con 0x5576f4cdcdb0 2023-10-05T21:16:59.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.911+0000 7f90477fe700 1 -- 172.21.15.153:0/4107994674 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e803f8a0 con 0x5576f4cdcdb0 2023-10-05T21:16:59.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.911+0000 7f9109b80680 1 -- 172.21.15.153:0/4107994674 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5576f4ce4130 con 0x5576f4cdcdb0 2023-10-05T21:16:59.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.911+0000 7f90477fe700 1 -- 172.21.15.153:0/4107994674 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90e803fa50 con 0x5576f4cdcdb0 2023-10-05T21:16:59.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.911+0000 7f9109b80680 1 -- 172.21.15.153:0/4107994674 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5576f4ce4520 con 0x5576f4cdcdb0 2023-10-05T21:16:59.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.912+0000 7f90477fe700 1 -- 172.21.15.153:0/4107994674 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f90e8047070 con 0x5576f4cdcdb0 2023-10-05T21:16:59.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.912+0000 7f90477fe700 1 --2- 172.21.15.153:0/4107994674 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f903c0340a0 0x7f903c036550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:59.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.912+0000 7f90477fe700 1 -- 172.21.15.153:0/4107994674 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f90e8030070 con 0x5576f4cdcdb0 2023-10-05T21:16:59.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.912+0000 7f90fd459700 1 --2- 172.21.15.153:0/4107994674 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f903c0340a0 0x7f903c036550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:59.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.912+0000 7f9109b80680 5 note: GC not initialized 2023-10-05T21:16:59.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.912+0000 7f90fd459700 1 --2- 172.21.15.153:0/4107994674 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f903c0340a0 0x7f903c036550 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x5576f4cd03f0 tx=0x7f90f8037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:59.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.913+0000 7f9044ff9700 20 reqs_thread_entry: start 2023-10-05T21:16:59.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.913+0000 7f903a7fc700 20 reqs_thread_entry: start 2023-10-05T21:16:59.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.913+0000 7f9109b80680 20 init_complete bucket index max shards: 11 2023-10-05T21:16:59.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.913+0000 7f9109b80680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:16:59.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.913+0000 7f9038ff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:17:30 2023 2023-10-05T21:16:59.939 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:16:59.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.913+0000 7f901ffff700 20 reqs_thread_entry: start 2023-10-05T21:16:59.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.913+0000 7f9109b80680 20 get_system_obj_state: rctx=0x7ffe29812858 obj=default.rgw.meta:users.uid:foo state=0x5576f4bfe330 s->prefetch_data=0 2023-10-05T21:16:59.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.913+0000 7f9109b80680 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T21:16:59.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.913+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4d493d0 con 0x5576f4c8fbe0 2023-10-05T21:16:59.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.914+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.914+0000 7f9109b80680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T21:16:59.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.914+0000 7f9109b80680 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:16:59.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.914+0000 7f9109b80680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:16:59.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.914+0000 7f9109b80680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:16:59.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.914+0000 7f9109b80680 20 Read xattr: user.rgw.idtag 2023-10-05T21:16:59.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.914+0000 7f9109b80680 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T21:16:59.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.914+0000 7f9109b80680 20 rados->read ofs=0 len=0 2023-10-05T21:16:59.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.914+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4d4b660 con 0x5576f4c8fbe0 2023-10-05T21:16:59.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.914+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.914+0000 7f9109b80680 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T21:16:59.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.914+0000 7f9109b80680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T21:16:59.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.914+0000 7f9109b80680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:16:59.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.914+0000 7f9109b80680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:16:59.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.914+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:104 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4d4bca0 con 0x7f90e8007030 2023-10-05T21:16:59.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.915+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(104 usage.10 [call] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90f800a570 con 0x7f90e8007030 2023-10-05T21:16:59.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.915+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:105 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4d4bca0 con 0x7f90e8007030 2023-10-05T21:16:59.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.916+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(105 usage.10 [call] v31'37 uv36 ondisk = -61 ((61) No data available)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90f800a570 con 0x7f90e8007030 2023-10-05T21:16:59.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.916+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93969401550048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4d07a60 con 0x7f90f002d020 2023-10-05T21:16:59.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.917+0000 7f90f7fff700 1 -- 172.21.15.153:0/14566596 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 93969401550048] v31'260 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90e8033040 con 0x7f90f002d020 2023-10-05T21:16:59.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.917+0000 7f9109b80680 20 remove_watcher() i=0 2023-10-05T21:16:59.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.917+0000 7f9109b80680 2 removed watcher, disabling cache 2023-10-05T21:16:59.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.917+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93969401553280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cc94e0 con 0x5576f4c8fbe0 2023-10-05T21:16:59.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.918+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 93969401553280] v31'260 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.918+0000 7f9109b80680 20 remove_watcher() i=1 2023-10-05T21:16:59.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.918+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93969401558528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cca180 con 0x5576f4cc21c0 2023-10-05T21:16:59.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.919+0000 7f90fcc58700 1 -- 172.21.15.153:0/14566596 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 93969401558528] v31'260 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90f0014070 con 0x5576f4cc21c0 2023-10-05T21:16:59.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.919+0000 7f9109b80680 20 remove_watcher() i=2 2023-10-05T21:16:59.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.919+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93969401555488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4ccb600 con 0x7f90f002d020 2023-10-05T21:16:59.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.920+0000 7f90f7fff700 1 -- 172.21.15.153:0/14566596 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 93969401555488] v31'260 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90e8033040 con 0x7f90f002d020 2023-10-05T21:16:59.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.920+0000 7f9109b80680 20 remove_watcher() i=3 2023-10-05T21:16:59.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.920+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93969401566368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4ccaa20 con 0x5576f4c8fbe0 2023-10-05T21:16:59.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.921+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 93969401566368] v31'260 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.921+0000 7f9109b80680 20 remove_watcher() i=4 2023-10-05T21:16:59.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.921+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93969401570096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4ccaa20 con 0x7f90e8007030 2023-10-05T21:16:59.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.922+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 93969401570096] v31'260 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90f800a570 con 0x7f90e8007030 2023-10-05T21:16:59.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.922+0000 7f9109b80680 20 remove_watcher() i=5 2023-10-05T21:16:59.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.922+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93969401564464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4ccaa20 con 0x7f90e8007030 2023-10-05T21:16:59.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.923+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 93969401564464] v31'260 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90f800a570 con 0x7f90e8007030 2023-10-05T21:16:59.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.923+0000 7f9109b80680 20 remove_watcher() i=6 2023-10-05T21:16:59.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.923+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93969401575456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4cccd30 con 0x7f90e8007030 2023-10-05T21:16:59.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.923+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.0 v2:172.21.15.111:6800/111394 31 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 93969401575456] v31'260 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90f800a570 con 0x7f90e8007030 2023-10-05T21:16:59.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.923+0000 7f9109b80680 20 remove_watcher() i=7 2023-10-05T21:16:59.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.924+0000 7f90cdfe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:16:59.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.924+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:114 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93969401576560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576f4ccaa20 con 0x5576f4c8fbe0 2023-10-05T21:16:59.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.925+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(114 data_loggenerations_metadata [watch unwatch cookie 93969401576560] v31'250 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f90f800a570 con 0x5576f4c8fbe0 2023-10-05T21:16:59.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.925+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f90e8007030 msgr2=0x7f90e801d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:59.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.925+0000 7f9109b80680 1 --2- 172.21.15.153:0/14566596 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f90e8007030 0x7f90e801d420 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:59.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.925+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5576f4c8fbe0 msgr2=0x5576f4cbfd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:59.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.925+0000 7f9109b80680 1 --2- 172.21.15.153:0/14566596 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5576f4c8fbe0 0x5576f4cbfd50 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:59.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.925+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f90f002d020 msgr2=0x7f90f002c5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:59.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.925+0000 7f9109b80680 1 --2- 172.21.15.153:0/14566596 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f90f002d020 0x7f90f002c5d0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:59.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.925+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5576f4cc21c0 msgr2=0x5576f4cc45a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:59.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.925+0000 7f9109b80680 1 --2- 172.21.15.153:0/14566596 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5576f4cc21c0 0x5576f4cc45a0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:59.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.925+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f90e0034140 msgr2=0x7f90e00365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:59.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.925+0000 7f9109b80680 1 --2- 172.21.15.153:0/14566596 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f90e0034140 0x7f90e00365f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f90e8003080 tx=0x7f90e8015000 comp rx=0 tx=0).stop 2023-10-05T21:16:59.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.925+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4c897b0 msgr2=0x5576f4cb4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:59.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.925+0000 7f90fd459700 1 -- 172.21.15.153:0/14566596 reap_dead start 2023-10-05T21:16:59.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.925+0000 7f9109b80680 1 --2- 172.21.15.153:0/14566596 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4c897b0 0x5576f4cb4000 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f90f00017d0 tx=0x7f90f0016000 comp rx=0 tx=0).stop 2023-10-05T21:16:59.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.925+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 shutdown_connections 2023-10-05T21:16:59.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.925+0000 7f9109b80680 1 --2- 172.21.15.153:0/14566596 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4c897b0 0x5576f4cb4000 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:59.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.925+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 >> 172.21.15.153:0/14566596 conn(0x5576f4c85300 msgr2=0x5576f4ca5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:59.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.925+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 shutdown_connections 2023-10-05T21:16:59.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.925+0000 7f9109b80680 1 -- 172.21.15.153:0/14566596 wait complete. 2023-10-05T21:16:59.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.926+0000 7f9109b80680 1 -- 172.21.15.153:0/4107994674 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f903c0340a0 msgr2=0x7f903c036550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:59.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.926+0000 7f9109b80680 1 --2- 172.21.15.153:0/4107994674 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f903c0340a0 0x7f903c036550 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x5576f4cd03f0 tx=0x7f90f8037450 comp rx=0 tx=0).stop 2023-10-05T21:16:59.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.926+0000 7f9109b80680 1 -- 172.21.15.153:0/4107994674 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4cdcdb0 msgr2=0x5576f4ce39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:59.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.926+0000 7f9109b80680 1 --2- 172.21.15.153:0/4107994674 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4cdcdb0 0x5576f4ce39f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f90e8038040 tx=0x7f90e8030000 comp rx=0 tx=0).stop 2023-10-05T21:16:59.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.926+0000 7f9109b80680 1 -- 172.21.15.153:0/4107994674 shutdown_connections 2023-10-05T21:16:59.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.926+0000 7f9109b80680 1 --2- 172.21.15.153:0/4107994674 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f903c0340a0 0x7f903c036550 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:59.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.926+0000 7f9109b80680 1 --2- 172.21.15.153:0/4107994674 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576f4cdcdb0 0x5576f4ce39f0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:59.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.926+0000 7f9109b80680 1 -- 172.21.15.153:0/4107994674 >> 172.21.15.153:0/4107994674 conn(0x5576f4cd90b0 msgr2=0x5576f4cd7180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:59.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.926+0000 7f9109b80680 1 -- 172.21.15.153:0/4107994674 shutdown_connections 2023-10-05T21:16:59.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.926+0000 7f9109b80680 1 -- 172.21.15.153:0/4107994674 wait complete. 2023-10-05T21:16:59.947 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2023-10-05T21:16:59.947 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2023-10-05T21:16:59.947 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2023-10-05T21:16:59.991 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:16:59.992 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:16:59.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.991+0000 7f86e4893680 1 Processor -- start 2023-10-05T21:16:59.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.991+0000 7f86e4893680 1 -- start start 2023-10-05T21:16:59.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.991+0000 7f86e4893680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5635a1f41bb0 0x5635a1f43f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:59.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.991+0000 7f86e4893680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5635a1e88990 con 0x5635a1eaf0a0 2023-10-05T21:16:59.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.991+0000 7f86e4893680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x5635a1e48db0 con 0x5635a1f41bb0 2023-10-05T21:16:59.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.991+0000 7f86d716a700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5635a1f41bb0 0x5635a1f43f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:16:59.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.991+0000 7f86d796b700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x5635a1eaf0a0 0x5635a1f40490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:57222/0 (socket says 172.21.15.153:57222) 2023-10-05T21:16:59.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.991+0000 7f86d796b700 1 -- 172.21.15.153:0/3131082824 learned_addr learned my addr 172.21.15.153:0/3131082824 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:16:59.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.992+0000 7f86d716a700 1 -- 172.21.15.153:0/3131082824 >> v1:172.21.15.111:6789/0 conn(0x5635a1eaf0a0 legacy=0x5635a1f40490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:59.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.992+0000 7f86d6969700 1 -- 172.21.15.153:0/3131082824 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3806887960 0 0) 0x5635a1e88990 con 0x5635a1eaf0a0 2023-10-05T21:16:59.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.992+0000 7f86d716a700 1 -- 172.21.15.153:0/3131082824 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635a1f454e0 con 0x5635a1f41bb0 2023-10-05T21:16:59.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.992+0000 7f86d716a700 1 --2- 172.21.15.153:0/3131082824 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1f41bb0 0x5635a1f43f90 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f86c400a5d0 tx=0x7f86c4005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3894133220a1216f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:16:59.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.992+0000 7f86d6969700 1 -- 172.21.15.153:0/3131082824 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86c40086a0 con 0x5635a1f41bb0 2023-10-05T21:16:59.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.992+0000 7f86d6969700 1 -- 172.21.15.153:0/3131082824 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c4008800 con 0x5635a1f41bb0 2023-10-05T21:16:59.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.992+0000 7f86d6969700 1 -- 172.21.15.153:0/3131082824 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86c4008ad0 con 0x5635a1f41bb0 2023-10-05T21:16:59.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.993+0000 7f86e4893680 1 -- 172.21.15.153:0/3131082824 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1f41bb0 msgr2=0x5635a1f43f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:16:59.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.993+0000 7f86e4893680 1 --2- 172.21.15.153:0/3131082824 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1f41bb0 0x5635a1f43f90 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f86c400a5d0 tx=0x7f86c4005a50 comp rx=0 tx=0).stop 2023-10-05T21:16:59.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.993+0000 7f86e4893680 1 -- 172.21.15.153:0/3131082824 shutdown_connections 2023-10-05T21:16:59.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.993+0000 7f86e4893680 1 --2- 172.21.15.153:0/3131082824 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1f41bb0 0x5635a1f43f90 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:16:59.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.993+0000 7f86e4893680 1 -- 172.21.15.153:0/3131082824 >> 172.21.15.153:0/3131082824 conn(0x5635a1f35b80 msgr2=0x5635a1f37f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:16:59.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.993+0000 7f86e4893680 1 -- 172.21.15.153:0/3131082824 shutdown_connections 2023-10-05T21:16:59.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.993+0000 7f86e4893680 1 -- 172.21.15.153:0/3131082824 wait complete. 2023-10-05T21:16:59.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.993+0000 7f86e4893680 1 Processor -- start 2023-10-05T21:16:59.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.993+0000 7f86e4893680 1 -- start start 2023-10-05T21:16:59.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.993+0000 7f86e4893680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1eaf0a0 0x5635a1f5c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:16:59.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.993+0000 7f86e4893680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635a1de8ea0 con 0x5635a1eaf0a0 2023-10-05T21:17:00.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.994+0000 7f86d796b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1eaf0a0 0x5635a1f5c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.994+0000 7f86d796b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1eaf0a0 0x5635a1f5c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60508/0 (socket says 172.21.15.153:60508) 2023-10-05T21:17:00.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.994+0000 7f86d796b700 1 -- 172.21.15.153:0/1580968821 learned_addr learned my addr 172.21.15.153:0/1580968821 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.994+0000 7f86d796b700 1 -- 172.21.15.153:0/1580968821 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c4005cf0 con 0x5635a1eaf0a0 2023-10-05T21:17:00.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.994+0000 7f86d796b700 1 --2- 172.21.15.153:0/1580968821 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1eaf0a0 0x5635a1f5c920 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f86c8001d70 tx=0x7f86c8001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb3025371ef9aa47 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.994+0000 7f86d5967700 1 -- 172.21.15.153:0/1580968821 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86c800bcc0 con 0x5635a1eaf0a0 2023-10-05T21:17:00.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.994+0000 7f86d5967700 1 -- 172.21.15.153:0/1580968821 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c800be20 con 0x5635a1eaf0a0 2023-10-05T21:17:00.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.994+0000 7f86d5967700 1 -- 172.21.15.153:0/1580968821 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86c800e5f0 con 0x5635a1eaf0a0 2023-10-05T21:17:00.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.995+0000 7f86e4893680 1 -- 172.21.15.153:0/1580968821 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1eaf0a0 msgr2=0x5635a1f5c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.995+0000 7f86e4893680 1 --2- 172.21.15.153:0/1580968821 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1eaf0a0 0x5635a1f5c920 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f86c8001d70 tx=0x7f86c8001770 comp rx=0 tx=0).stop 2023-10-05T21:17:00.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.995+0000 7f86e4893680 1 -- 172.21.15.153:0/1580968821 shutdown_connections 2023-10-05T21:17:00.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.995+0000 7f86e4893680 1 --2- 172.21.15.153:0/1580968821 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1eaf0a0 0x5635a1f5c920 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.995+0000 7f86e4893680 1 -- 172.21.15.153:0/1580968821 >> 172.21.15.153:0/1580968821 conn(0x5635a1f35b80 msgr2=0x5635a1f583f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.995+0000 7f86e4893680 1 -- 172.21.15.153:0/1580968821 shutdown_connections 2023-10-05T21:17:00.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.995+0000 7f86e4893680 1 -- 172.21.15.153:0/1580968821 wait complete. 2023-10-05T21:17:00.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.995+0000 7f86e4893680 1 Processor -- start 2023-10-05T21:17:00.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.995+0000 7f86e4893680 1 -- start start 2023-10-05T21:17:00.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.995+0000 7f86e4893680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1eaf0a0 0x5635a1f63dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.995+0000 7f86e4893680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635a1ddfc80 con 0x5635a1eaf0a0 2023-10-05T21:17:00.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.996+0000 7f86d796b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1eaf0a0 0x5635a1f63dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.996+0000 7f86d796b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1eaf0a0 0x5635a1f63dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60514/0 (socket says 172.21.15.153:60514) 2023-10-05T21:17:00.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.996+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 learned_addr learned my addr 172.21.15.153:0/129596926 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.996+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c8001a50 con 0x5635a1eaf0a0 2023-10-05T21:17:00.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.996+0000 7f86d796b700 1 --2- 172.21.15.153:0/129596926 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1eaf0a0 0x5635a1f63dc0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f86c800c010 tx=0x7f86c8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.996+0000 7f86cffff700 1 -- 172.21.15.153:0/129596926 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86c801f070 con 0x5635a1eaf0a0 2023-10-05T21:17:00.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.996+0000 7f86cffff700 1 -- 172.21.15.153:0/129596926 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c801a550 con 0x5635a1eaf0a0 2023-10-05T21:17:00.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.996+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5635a1f64300 con 0x5635a1eaf0a0 2023-10-05T21:17:00.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.996+0000 7f86cffff700 1 -- 172.21.15.153:0/129596926 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86c801a840 con 0x5635a1eaf0a0 2023-10-05T21:17:00.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.996+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5635a1f646f0 con 0x5635a1eaf0a0 2023-10-05T21:17:00.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.997+0000 7f86cffff700 1 -- 172.21.15.153:0/129596926 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f86c801a9a0 con 0x5635a1eaf0a0 2023-10-05T21:17:00.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.997+0000 7f86e4893680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.997+0000 7f86cffff700 1 --2- 172.21.15.153:0/129596926 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f86c0034140 0x7f86c00365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.997+0000 7f86cffff700 1 -- 172.21.15.153:0/129596926 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f86c8048bb0 con 0x5635a1eaf0a0 2023-10-05T21:17:00.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.997+0000 7f86d716a700 1 --2- 172.21.15.153:0/129596926 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f86c0034140 0x7f86c00365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.998+0000 7f86e4893680 1 --2- 172.21.15.153:0/129596926 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5635a1f41bb0 0x5635a1f6fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.998+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f702d0 con 0x5635a1f41bb0 2023-10-05T21:17:00.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.998+0000 7f86d816c700 1 --2- 172.21.15.153:0/129596926 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5635a1f41bb0 0x5635a1f6fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.998+0000 7f86d716a700 1 --2- 172.21.15.153:0/129596926 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f86c0034140 0x7f86c00365f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f86c4003080 tx=0x7f86c4015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.998+0000 7f86d816c700 1 --2- 172.21.15.153:0/129596926 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5635a1f41bb0 0x5635a1f6fb40 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.998+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.998+0000 7f86e4893680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.998+0000 7f86e4893680 20 realm 2023-10-05T21:17:00.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.998+0000 7f86e4893680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.998+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f6d100 con 0x5635a1f41bb0 2023-10-05T21:17:00.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.998+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.998+0000 7f86e4893680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.998+0000 7f86e4893680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:17:00.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.998+0000 7f86e4893680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.998+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f70dd0 con 0x5635a1f41bb0 2023-10-05T21:17:00.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.999+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.999+0000 7f86e4893680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.999+0000 7f86e4893680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.999+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f716f0 con 0x5635a1f41bb0 2023-10-05T21:17:00.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.999+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.999+0000 7f86e4893680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:17:00.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.999+0000 7f86e4893680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.999+0000 7f86e4893680 1 --2- 172.21.15.153:0/129596926 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5635a1f71fb0 0x5635a1f74390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.999+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f74960 con 0x5635a1f71fb0 2023-10-05T21:17:00.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.999+0000 7f86d796b700 1 --2- 172.21.15.153:0/129596926 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5635a1f71fb0 0x5635a1f74390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:16:59.999+0000 7f86d796b700 1 --2- 172.21.15.153:0/129596926 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5635a1f71fb0 0x5635a1f74390 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.000+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f86c8014070 con 0x5635a1f71fb0 2023-10-05T21:17:00.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.000+0000 7f86e4893680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:17:00.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.000+0000 7f86e4893680 20 searching for the correct realm 2023-10-05T21:17:00.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.000+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x5635a1f71fb0 2023-10-05T21:17:00.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.000+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86c8014070 con 0x5635a1f71fb0 2023-10-05T21:17:00.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.000+0000 7f86d796b700 1 --2- 172.21.15.153:0/129596926 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f86c8046130 0x7f86c80466e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.000+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x7f86c8046130 2023-10-05T21:17:00.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.000+0000 7f86d716a700 1 --2- 172.21.15.153:0/129596926 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f86c8046130 0x7f86c80466e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.000+0000 7f86d716a700 1 --2- 172.21.15.153:0/129596926 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f86c8046130 0x7f86c80466e0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.001+0000 7f86d716a700 1 -- 172.21.15.153:0/129596926 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86c4019040 con 0x7f86c8046130 2023-10-05T21:17:00.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.001+0000 7f86d716a700 1 --2- 172.21.15.153:0/129596926 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f86c4007030 0x7f86c401d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.001+0000 7f86d716a700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x7f86c4007030 2023-10-05T21:17:00.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.001+0000 7f86d816c700 1 --2- 172.21.15.153:0/129596926 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f86c4007030 0x7f86c401d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.001+0000 7f86d816c700 1 --2- 172.21.15.153:0/129596926 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f86c4007030 0x7f86c401d420 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.001+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86d000a570 con 0x7f86c4007030 2023-10-05T21:17:00.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.001+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x5635a1f41bb0 2023-10-05T21:17:00.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.002+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.002+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x5635a1f41bb0 2023-10-05T21:17:00.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.002+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.002+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x7f86c4007030 2023-10-05T21:17:00.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.002+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86d000a570 con 0x7f86c4007030 2023-10-05T21:17:00.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.002+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x7f86c4007030 2023-10-05T21:17:00.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.002+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86d000a570 con 0x7f86c4007030 2023-10-05T21:17:00.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.002+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x7f86c8046130 2023-10-05T21:17:00.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.002+0000 7f86d716a700 1 -- 172.21.15.153:0/129596926 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86c4019040 con 0x7f86c8046130 2023-10-05T21:17:00.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.003+0000 7f86d716a700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x5635a1f71fb0 2023-10-05T21:17:00.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.003+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f86c8014070 con 0x5635a1f71fb0 2023-10-05T21:17:00.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.003+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x5635a1f41bb0 2023-10-05T21:17:00.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.003+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.003+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x7f86c4007030 2023-10-05T21:17:00.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.003+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86d000a570 con 0x7f86c4007030 2023-10-05T21:17:00.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.003+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x5635a1f41bb0 2023-10-05T21:17:00.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.003+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.003+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x7f86c8046130 2023-10-05T21:17:00.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.004+0000 7f86d716a700 1 -- 172.21.15.153:0/129596926 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86c4019040 con 0x7f86c8046130 2023-10-05T21:17:00.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.004+0000 7f86d716a700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x5635a1f71fb0 2023-10-05T21:17:00.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.004+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86c8014070 con 0x5635a1f71fb0 2023-10-05T21:17:00.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.004+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x5635a1f71fb0 2023-10-05T21:17:00.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.004+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86c8014070 con 0x5635a1f71fb0 2023-10-05T21:17:00.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.004+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x7f86c4007030 2023-10-05T21:17:00.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.004+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86d000a570 con 0x7f86c4007030 2023-10-05T21:17:00.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.004+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x5635a1f71fb0 2023-10-05T21:17:00.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.005+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86c8014070 con 0x5635a1f71fb0 2023-10-05T21:17:00.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.005+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x5635a1f71fb0 2023-10-05T21:17:00.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.005+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86c8014070 con 0x5635a1f71fb0 2023-10-05T21:17:00.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.005+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x5635a1f41bb0 2023-10-05T21:17:00.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.005+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.005+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x5635a1f41bb0 2023-10-05T21:17:00.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.005+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.005+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x7f86c4007030 2023-10-05T21:17:00.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.006+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86d000a570 con 0x7f86c4007030 2023-10-05T21:17:00.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.006+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x5635a1f71fb0 2023-10-05T21:17:00.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.006+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86c8014070 con 0x5635a1f71fb0 2023-10-05T21:17:00.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.006+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x7f86c8046130 2023-10-05T21:17:00.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.006+0000 7f86d716a700 1 -- 172.21.15.153:0/129596926 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86c4019040 con 0x7f86c8046130 2023-10-05T21:17:00.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.006+0000 7f86d716a700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x5635a1f41bb0 2023-10-05T21:17:00.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.006+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.006+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x7f86c4007030 2023-10-05T21:17:00.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.007+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86d000a570 con 0x7f86c4007030 2023-10-05T21:17:00.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.007+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x5635a1f71fb0 2023-10-05T21:17:00.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.007+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86c8014070 con 0x5635a1f71fb0 2023-10-05T21:17:00.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.007+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x7f86c4007030 2023-10-05T21:17:00.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.008+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86d000a570 con 0x7f86c4007030 2023-10-05T21:17:00.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.008+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x7f86c8046130 2023-10-05T21:17:00.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.008+0000 7f86d716a700 1 -- 172.21.15.153:0/129596926 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86c4019040 con 0x7f86c8046130 2023-10-05T21:17:00.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.008+0000 7f86d716a700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x5635a1f71fb0 2023-10-05T21:17:00.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.008+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86c8014070 con 0x5635a1f71fb0 2023-10-05T21:17:00.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.008+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x7f86c4007030 2023-10-05T21:17:00.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.008+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86d000a570 con 0x7f86c4007030 2023-10-05T21:17:00.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.008+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x5635a1f41bb0 2023-10-05T21:17:00.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.008+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.008+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76280 con 0x7f86c8046130 2023-10-05T21:17:00.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.009+0000 7f86d716a700 1 -- 172.21.15.153:0/129596926 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86c4019040 con 0x7f86c8046130 2023-10-05T21:17:00.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.009+0000 7f86e4893680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:17:00.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.009+0000 7f86e4893680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:17:00.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.009+0000 7f86e4893680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:17:00.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.009+0000 7f86e4893680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:17:00.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.009+0000 7f86e4893680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.009+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f754a0 con 0x5635a1f41bb0 2023-10-05T21:17:00.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.009+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.009+0000 7f86e4893680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.009+0000 7f86e4893680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.009+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f758d0 con 0x5635a1f41bb0 2023-10-05T21:17:00.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.009+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.009+0000 7f86e4893680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:17:00.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.009+0000 7f86e4893680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.009+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f75d00 con 0x5635a1f41bb0 2023-10-05T21:17:00.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.009+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.009+0000 7f86e4893680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:17:00.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.009+0000 7f86e4893680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.009+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f75000 con 0x5635a1f71fb0 2023-10-05T21:17:00.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.010+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f86c8014070 con 0x5635a1f71fb0 2023-10-05T21:17:00.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.010+0000 7f86e4893680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.010+0000 7f86e4893680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.010+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76b20 con 0x5635a1f41bb0 2023-10-05T21:17:00.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.010+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.010+0000 7f86e4893680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.010+0000 7f86e4893680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.010+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76be0 con 0x5635a1f41bb0 2023-10-05T21:17:00.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.010+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.010+0000 7f86e4893680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:17:00.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.010+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76bb0 con 0x5635a1f71fb0 2023-10-05T21:17:00.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.010+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86c8014070 con 0x5635a1f71fb0 2023-10-05T21:17:00.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.010+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76bb0 con 0x7f86c8046130 2023-10-05T21:17:00.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.010+0000 7f86d716a700 1 -- 172.21.15.153:0/129596926 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86c4019040 con 0x7f86c8046130 2023-10-05T21:17:00.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.010+0000 7f86d716a700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76bb0 con 0x7f86c4007030 2023-10-05T21:17:00.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.011+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86d000a570 con 0x7f86c4007030 2023-10-05T21:17:00.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.011+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f75d00 con 0x5635a1f41bb0 2023-10-05T21:17:00.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.011+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.011+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f75d00 con 0x5635a1f41bb0 2023-10-05T21:17:00.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.011+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.011+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f75d00 con 0x7f86c4007030 2023-10-05T21:17:00.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.012+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86d000a570 con 0x7f86c4007030 2023-10-05T21:17:00.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.012+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f75d00 con 0x7f86c4007030 2023-10-05T21:17:00.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.012+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86d000a570 con 0x7f86c4007030 2023-10-05T21:17:00.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.012+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f75d00 con 0x7f86c8046130 2023-10-05T21:17:00.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.012+0000 7f86d716a700 1 -- 172.21.15.153:0/129596926 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86c4019040 con 0x7f86c8046130 2023-10-05T21:17:00.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.012+0000 7f86d716a700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f75d00 con 0x5635a1f71fb0 2023-10-05T21:17:00.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.013+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f86c8014070 con 0x5635a1f71fb0 2023-10-05T21:17:00.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.013+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f75d00 con 0x5635a1f41bb0 2023-10-05T21:17:00.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.013+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.013+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f75d00 con 0x7f86c4007030 2023-10-05T21:17:00.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.013+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86d000a570 con 0x7f86c4007030 2023-10-05T21:17:00.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.013+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f75d00 con 0x5635a1f41bb0 2023-10-05T21:17:00.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.013+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.013+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f75d00 con 0x7f86c8046130 2023-10-05T21:17:00.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.013+0000 7f86d716a700 1 -- 172.21.15.153:0/129596926 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86c4019040 con 0x7f86c8046130 2023-10-05T21:17:00.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.013+0000 7f86d716a700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f75d00 con 0x5635a1f71fb0 2023-10-05T21:17:00.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.014+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86c8014070 con 0x5635a1f71fb0 2023-10-05T21:17:00.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.014+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f75d00 con 0x5635a1f71fb0 2023-10-05T21:17:00.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.014+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86c8014070 con 0x5635a1f71fb0 2023-10-05T21:17:00.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.014+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f75d00 con 0x7f86c4007030 2023-10-05T21:17:00.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.014+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86d000a570 con 0x7f86c4007030 2023-10-05T21:17:00.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.014+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f75d00 con 0x5635a1f71fb0 2023-10-05T21:17:00.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.014+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86c8014070 con 0x5635a1f71fb0 2023-10-05T21:17:00.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.014+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f75d00 con 0x5635a1f71fb0 2023-10-05T21:17:00.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.014+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86c8050040 con 0x5635a1f71fb0 2023-10-05T21:17:00.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.014+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f75d00 con 0x5635a1f41bb0 2023-10-05T21:17:00.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.015+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.015+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f75d00 con 0x5635a1f41bb0 2023-10-05T21:17:00.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.015+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.015+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f75d00 con 0x7f86c4007030 2023-10-05T21:17:00.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.015+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86d000a570 con 0x7f86c4007030 2023-10-05T21:17:00.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.015+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f75d00 con 0x5635a1f71fb0 2023-10-05T21:17:00.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.015+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86c8050040 con 0x5635a1f71fb0 2023-10-05T21:17:00.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.015+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f75d00 con 0x7f86c8046130 2023-10-05T21:17:00.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.016+0000 7f86d716a700 1 -- 172.21.15.153:0/129596926 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86c4019040 con 0x7f86c8046130 2023-10-05T21:17:00.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.016+0000 7f86d716a700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f75d00 con 0x5635a1f41bb0 2023-10-05T21:17:00.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.016+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.016+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f75d00 con 0x7f86c4007030 2023-10-05T21:17:00.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.016+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86d000a570 con 0x7f86c4007030 2023-10-05T21:17:00.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.016+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f75d00 con 0x5635a1f71fb0 2023-10-05T21:17:00.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.016+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86c8050040 con 0x5635a1f71fb0 2023-10-05T21:17:00.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.016+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f75d00 con 0x7f86c4007030 2023-10-05T21:17:00.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.017+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86d000a570 con 0x7f86c4007030 2023-10-05T21:17:00.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.017+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f75d00 con 0x7f86c8046130 2023-10-05T21:17:00.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.017+0000 7f86d716a700 1 -- 172.21.15.153:0/129596926 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86c4019040 con 0x7f86c8046130 2023-10-05T21:17:00.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.017+0000 7f86d716a700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f75d00 con 0x5635a1f71fb0 2023-10-05T21:17:00.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.017+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86c8050040 con 0x5635a1f71fb0 2023-10-05T21:17:00.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.017+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f75d00 con 0x7f86c4007030 2023-10-05T21:17:00.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.017+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86d000a570 con 0x7f86c4007030 2023-10-05T21:17:00.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.017+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f75d00 con 0x5635a1f41bb0 2023-10-05T21:17:00.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.017+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.017+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f75d00 con 0x7f86c8046130 2023-10-05T21:17:00.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.018+0000 7f86d716a700 1 -- 172.21.15.153:0/129596926 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86c4019040 con 0x7f86c8046130 2023-10-05T21:17:00.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.018+0000 7f86e4893680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:17:00.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.018+0000 7f86e4893680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:17:00.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.018+0000 7f86e4893680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:17:00.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.018+0000 7f86e4893680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:17:00.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.018+0000 7f86e4893680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.018+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76bb0 con 0x5635a1f41bb0 2023-10-05T21:17:00.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.018+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.018+0000 7f86e4893680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:17:00.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.018+0000 7f86e4893680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.018+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f77010 con 0x5635a1f71fb0 2023-10-05T21:17:00.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.018+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f86c8050040 con 0x5635a1f71fb0 2023-10-05T21:17:00.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.018+0000 7f86e4893680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:17:00.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.018+0000 7f86e4893680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.018+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76780 con 0x5635a1f41bb0 2023-10-05T21:17:00.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.018+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.018+0000 7f86e4893680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:17:00.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.018+0000 7f86e4893680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.018+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f76790 con 0x5635a1f41bb0 2023-10-05T21:17:00.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.019+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.019+0000 7f86e4893680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:17:00.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.019+0000 7f86e4893680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.019+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f77990 con 0x7f86c4007030 2023-10-05T21:17:00.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.019+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f86d000a570 con 0x7f86c4007030 2023-10-05T21:17:00.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.019+0000 7f86e4893680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.019+0000 7f86e4893680 20 zone default found 2023-10-05T21:17:00.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.019+0000 7f86e4893680 4 Realm: () 2023-10-05T21:17:00.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.019+0000 7f86e4893680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:17:00.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.019+0000 7f86e4893680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:17:00.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.019+0000 7f86e4893680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:17:00.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.019+0000 7f86e4893680 20 zonegroup default 2023-10-05T21:17:00.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.019+0000 7f86e4893680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.019+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f77990 con 0x7f86c4007030 2023-10-05T21:17:00.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.019+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f86d000a570 con 0x7f86c4007030 2023-10-05T21:17:00.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.019+0000 7f86e4893680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.019+0000 7f86e4893680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.019+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f77900 con 0x5635a1f71fb0 2023-10-05T21:17:00.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.019+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f86c8050040 con 0x5635a1f71fb0 2023-10-05T21:17:00.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.019+0000 7f86e4893680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.019+0000 7f86e4893680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.019+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f799f0 con 0x5635a1f71fb0 2023-10-05T21:17:00.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.020+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f86c8050040 con 0x5635a1f71fb0 2023-10-05T21:17:00.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.020+0000 7f86e4893680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.020+0000 7f86e4893680 20 started sync module instance, tier type = 2023-10-05T21:17:00.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.020+0000 7f86e4893680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:17:00.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.020+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f790b0 con 0x7f86c8046130 2023-10-05T21:17:00.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.021+0000 7f86d716a700 1 -- 172.21.15.153:0/129596926 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v31'261 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86c4019040 con 0x7f86c8046130 2023-10-05T21:17:00.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.021+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94788350604304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f79da0 con 0x7f86c8046130 2023-10-05T21:17:00.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.021+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f7a640 con 0x5635a1f41bb0 2023-10-05T21:17:00.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.021+0000 7f86d716a700 1 -- 172.21.15.153:0/129596926 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94788350604304] v31'262 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86c4019040 con 0x7f86c8046130 2023-10-05T21:17:00.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.021+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v31'261 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.021+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94788350615888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f7aa90 con 0x5635a1f41bb0 2023-10-05T21:17:00.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.021+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f7b4a0 con 0x5635a1f71fb0 2023-10-05T21:17:00.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.022+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94788350615888] v31'262 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.022+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v31'261 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86c8050040 con 0x5635a1f71fb0 2023-10-05T21:17:00.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.022+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94788350616992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f7a9f0 con 0x5635a1f71fb0 2023-10-05T21:17:00.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.022+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f7c230 con 0x7f86c8046130 2023-10-05T21:17:00.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.023+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94788350616992] v31'262 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86c8050040 con 0x5635a1f71fb0 2023-10-05T21:17:00.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.023+0000 7f86d716a700 1 -- 172.21.15.153:0/129596926 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v31'261 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86c4019040 con 0x7f86c8046130 2023-10-05T21:17:00.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.023+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94788350622128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f7be60 con 0x7f86c8046130 2023-10-05T21:17:00.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.023+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f7d2f0 con 0x5635a1f41bb0 2023-10-05T21:17:00.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.024+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v31'261 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.024+0000 7f86d716a700 1 -- 172.21.15.153:0/129596926 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94788350622128] v31'262 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86c4019040 con 0x7f86c8046130 2023-10-05T21:17:00.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.024+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94788350627200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f7dbe0 con 0x5635a1f41bb0 2023-10-05T21:17:00.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.024+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f7e510 con 0x7f86c4007030 2023-10-05T21:17:00.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.025+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94788350627200] v31'262 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.025+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v31'261 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86d000a570 con 0x7f86c4007030 2023-10-05T21:17:00.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.025+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94788350629472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f7e020 con 0x7f86c4007030 2023-10-05T21:17:00.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.025+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f7eb90 con 0x7f86c4007030 2023-10-05T21:17:00.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.026+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94788350629472] v31'262 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86d000a570 con 0x7f86c4007030 2023-10-05T21:17:00.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.026+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v31'261 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86d000a570 con 0x7f86c4007030 2023-10-05T21:17:00.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.026+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94788350633472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f7eb50 con 0x7f86c4007030 2023-10-05T21:17:00.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.026+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f7f5f0 con 0x7f86c4007030 2023-10-05T21:17:00.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.026+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(98 notify.7 [create] v31'261 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86d000a570 con 0x7f86c4007030 2023-10-05T21:17:00.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.026+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94788350636192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f7faa0 con 0x7f86c4007030 2023-10-05T21:17:00.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.026+0000 7f86e4893680 20 add_watcher() i=0 2023-10-05T21:17:00.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.026+0000 7f86e4893680 20 add_watcher() i=1 2023-10-05T21:17:00.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.026+0000 7f86e4893680 20 add_watcher() i=2 2023-10-05T21:17:00.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.026+0000 7f86e4893680 20 add_watcher() i=3 2023-10-05T21:17:00.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.026+0000 7f86e4893680 20 add_watcher() i=4 2023-10-05T21:17:00.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.026+0000 7f86e4893680 20 add_watcher() i=5 2023-10-05T21:17:00.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.026+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(97 notify.6 [watch watch cookie 94788350633472] v31'262 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86d000a570 con 0x7f86c4007030 2023-10-05T21:17:00.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.026+0000 7f86e4893680 20 add_watcher() i=6 2023-10-05T21:17:00.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.027+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94788350636192] v31'262 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86d000a570 con 0x7f86c4007030 2023-10-05T21:17:00.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.027+0000 7f86e4893680 20 add_watcher() i=7 2023-10-05T21:17:00.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.027+0000 7f86e4893680 2 all 8 watchers are set, enabling cache 2023-10-05T21:17:00.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.027+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f7faa0 con 0x5635a1f41bb0 2023-10-05T21:17:00.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.027+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.027+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94788350637488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f7fa00 con 0x5635a1f41bb0 2023-10-05T21:17:00.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.028+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94788350637488] v31'251 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.028+0000 7f86a8fe9700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:17:00.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.028+0000 7f86e4893680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:17:00.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.028+0000 7f86e4893680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:17:00.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.028+0000 7f86e4893680 1 Processor -- start 2023-10-05T21:17:00.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.029+0000 7f86e4893680 1 -- start start 2023-10-05T21:17:00.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.029+0000 7f86e4893680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1f8d3e0 0x5635a1f8d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.029+0000 7f86e4893680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635a1f8ddc0 con 0x5635a1f8d3e0 2023-10-05T21:17:00.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.029+0000 7f86d716a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1f8d3e0 0x5635a1f8d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.029+0000 7f86d716a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1f8d3e0 0x5635a1f8d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60524/0 (socket says 172.21.15.153:60524) 2023-10-05T21:17:00.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.029+0000 7f86d716a700 1 -- 172.21.15.153:0/531908662 learned_addr learned my addr 172.21.15.153:0/531908662 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.029+0000 7f86d716a700 1 -- 172.21.15.153:0/531908662 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635a1f8df00 con 0x5635a1f8d3e0 2023-10-05T21:17:00.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.029+0000 7f86d716a700 1 --2- 172.21.15.153:0/531908662 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1f8d3e0 0x5635a1f8d7f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x5635a1f3bf50 tx=0x7f86c4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da14711b7fe3841 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.030+0000 7f8623fff700 1 -- 172.21.15.153:0/531908662 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86c401dd40 con 0x5635a1f8d3e0 2023-10-05T21:17:00.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.030+0000 7f8623fff700 1 -- 172.21.15.153:0/531908662 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c402b450 con 0x5635a1f8d3e0 2023-10-05T21:17:00.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.030+0000 7f8623fff700 1 -- 172.21.15.153:0/531908662 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86c401dea0 con 0x5635a1f8d3e0 2023-10-05T21:17:00.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.030+0000 7f86e4893680 1 -- 172.21.15.153:0/531908662 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1f8d3e0 msgr2=0x5635a1f8d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.030+0000 7f86e4893680 1 --2- 172.21.15.153:0/531908662 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1f8d3e0 0x5635a1f8d7f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x5635a1f3bf50 tx=0x7f86c4012000 comp rx=0 tx=0).stop 2023-10-05T21:17:00.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.030+0000 7f86e4893680 1 -- 172.21.15.153:0/531908662 shutdown_connections 2023-10-05T21:17:00.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.030+0000 7f86e4893680 1 --2- 172.21.15.153:0/531908662 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1f8d3e0 0x5635a1f8d7f0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.030+0000 7f86e4893680 1 -- 172.21.15.153:0/531908662 >> 172.21.15.153:0/531908662 conn(0x5635a1f885e0 msgr2=0x5635a1f86740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.030+0000 7f86e4893680 1 -- 172.21.15.153:0/531908662 shutdown_connections 2023-10-05T21:17:00.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.030+0000 7f86e4893680 1 -- 172.21.15.153:0/531908662 wait complete. 2023-10-05T21:17:00.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.031+0000 7f86e4893680 1 Processor -- start 2023-10-05T21:17:00.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.031+0000 7f86e4893680 1 -- start start 2023-10-05T21:17:00.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.031+0000 7f86e4893680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1f8d3e0 0x5635a1f92f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.031+0000 7f86e4893680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635a1f934b0 con 0x5635a1f8d3e0 2023-10-05T21:17:00.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.031+0000 7f86d716a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1f8d3e0 0x5635a1f92f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.031+0000 7f86d716a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1f8d3e0 0x5635a1f92f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60532/0 (socket says 172.21.15.153:60532) 2023-10-05T21:17:00.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.031+0000 7f86d716a700 1 -- 172.21.15.153:0/800551423 learned_addr learned my addr 172.21.15.153:0/800551423 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.031+0000 7f86d716a700 1 -- 172.21.15.153:0/800551423 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635a1f454e0 con 0x5635a1f8d3e0 2023-10-05T21:17:00.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.032+0000 7f86d716a700 1 --2- 172.21.15.153:0/800551423 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1f8d3e0 0x5635a1f92f70 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x5635a1f87b50 tx=0x7f86c4031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.032+0000 7f86227fc700 1 -- 172.21.15.153:0/800551423 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86c402be50 con 0x5635a1f8d3e0 2023-10-05T21:17:00.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.032+0000 7f86227fc700 1 -- 172.21.15.153:0/800551423 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c4040650 con 0x5635a1f8d3e0 2023-10-05T21:17:00.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.032+0000 7f86e4893680 1 -- 172.21.15.153:0/800551423 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5635a1f936b0 con 0x5635a1f8d3e0 2023-10-05T21:17:00.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.032+0000 7f86227fc700 1 -- 172.21.15.153:0/800551423 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86c4040820 con 0x5635a1f8d3e0 2023-10-05T21:17:00.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.032+0000 7f86e4893680 1 -- 172.21.15.153:0/800551423 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5635a1f93b00 con 0x5635a1f8d3e0 2023-10-05T21:17:00.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.032+0000 7f86227fc700 1 -- 172.21.15.153:0/800551423 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f86c4026040 con 0x5635a1f8d3e0 2023-10-05T21:17:00.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.033+0000 7f86227fc700 1 --2- 172.21.15.153:0/800551423 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8618034140 0x7f86180365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.033+0000 7f86227fc700 1 -- 172.21.15.153:0/800551423 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f86c4031070 con 0x5635a1f8d3e0 2023-10-05T21:17:00.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.033+0000 7f86d816c700 1 --2- 172.21.15.153:0/800551423 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8618034140 0x7f86180365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.033+0000 7f86e4893680 5 note: GC not initialized 2023-10-05T21:17:00.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.033+0000 7f86d816c700 1 --2- 172.21.15.153:0/800551423 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8618034140 0x7f86180365f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x5635a1f7dcc0 tx=0x7f86d000aee0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.034+0000 7f86177fe700 20 reqs_thread_entry: start 2023-10-05T21:17:00.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.034+0000 7f86157fa700 20 reqs_thread_entry: start 2023-10-05T21:17:00.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.034+0000 7f86e4893680 20 init_complete bucket index max shards: 11 2023-10-05T21:17:00.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.034+0000 7f86e4893680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:17:00.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.034+0000 7f86037fe700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:17:30 2023 2023-10-05T21:17:00.063 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:17:00.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.034+0000 7f8602ffd700 20 reqs_thread_entry: start 2023-10-05T21:17:00.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.034+0000 7f86e4893680 20 get_system_obj_state: rctx=0x7fff9a805c38 obj=default.rgw.meta:users.uid:foo state=0x5635a1dee240 s->prefetch_data=0 2023-10-05T21:17:00.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.034+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1ff8930 con 0x5635a1f41bb0 2023-10-05T21:17:00.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.035+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.035+0000 7f86e4893680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:17:00.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.035+0000 7f86e4893680 20 Read xattr: user.rgw.idtag 2023-10-05T21:17:00.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.035+0000 7f86e4893680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.035+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1ffabc0 con 0x5635a1f41bb0 2023-10-05T21:17:00.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.035+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.035+0000 7f86e4893680 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T21:17:00.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.035+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:104 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1ffabc0 con 0x7f86c4007030 2023-10-05T21:17:00.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.036+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(104 usage.10 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 152+0+15 (crc 0 0 0) 0x7f86d000a570 con 0x7f86c4007030 2023-10-05T21:17:00.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.036+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:105 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94788350604304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1ffabc0 con 0x7f86c8046130 2023-10-05T21:17:00.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.037+0000 7f86d716a700 1 -- 172.21.15.153:0/129596926 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(105 notify.0 [watch unwatch cookie 94788350604304] v31'263 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86c4034040 con 0x7f86c8046130 2023-10-05T21:17:00.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.037+0000 7f86e4893680 20 remove_watcher() i=0 2023-10-05T21:17:00.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.037+0000 7f86e4893680 2 removed watcher, disabling cache 2023-10-05T21:17:00.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.037+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94788350615888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1ffabc0 con 0x5635a1f41bb0 2023-10-05T21:17:00.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.038+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(106 notify.1 [watch unwatch cookie 94788350615888] v31'263 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.038+0000 7f86e4893680 20 remove_watcher() i=1 2023-10-05T21:17:00.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.038+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94788350616992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1ffabc0 con 0x5635a1f71fb0 2023-10-05T21:17:00.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.039+0000 7f86d796b700 1 -- 172.21.15.153:0/129596926 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(107 notify.2 [watch unwatch cookie 94788350616992] v31'263 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86c8050040 con 0x5635a1f71fb0 2023-10-05T21:17:00.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.039+0000 7f86e4893680 20 remove_watcher() i=2 2023-10-05T21:17:00.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.039+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94788350622128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1ffabc0 con 0x7f86c8046130 2023-10-05T21:17:00.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.040+0000 7f86d716a700 1 -- 172.21.15.153:0/129596926 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(108 notify.3 [watch unwatch cookie 94788350622128] v31'263 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86c4034040 con 0x7f86c8046130 2023-10-05T21:17:00.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.040+0000 7f86e4893680 20 remove_watcher() i=3 2023-10-05T21:17:00.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.040+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94788350627200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1ffabc0 con 0x5635a1f41bb0 2023-10-05T21:17:00.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.040+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(109 notify.4 [watch unwatch cookie 94788350627200] v31'263 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.041+0000 7f86e4893680 20 remove_watcher() i=4 2023-10-05T21:17:00.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.041+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94788350629472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1ffabc0 con 0x7f86c4007030 2023-10-05T21:17:00.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.041+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(110 notify.5 [watch unwatch cookie 94788350629472] v31'263 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86d000a570 con 0x7f86c4007030 2023-10-05T21:17:00.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.041+0000 7f86e4893680 20 remove_watcher() i=5 2023-10-05T21:17:00.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.041+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:111 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94788350633472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1ffabc0 con 0x7f86c4007030 2023-10-05T21:17:00.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.042+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(111 notify.6 [watch unwatch cookie 94788350633472] v31'263 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86d000a570 con 0x7f86c4007030 2023-10-05T21:17:00.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.042+0000 7f86e4893680 20 remove_watcher() i=6 2023-10-05T21:17:00.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.042+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94788350636192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1ffabc0 con 0x7f86c4007030 2023-10-05T21:17:00.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.043+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(112 notify.7 [watch unwatch cookie 94788350636192] v31'263 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86d000a570 con 0x7f86c4007030 2023-10-05T21:17:00.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.043+0000 7f86e4893680 20 remove_watcher() i=7 2023-10-05T21:17:00.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.044+0000 7f86a8fe9700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:17:00.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.044+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:113 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94788350637488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5635a1f7d660 con 0x5635a1f41bb0 2023-10-05T21:17:00.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.045+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(113 data_loggenerations_metadata [watch unwatch cookie 94788350637488] v31'252 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f86d000a570 con 0x5635a1f41bb0 2023-10-05T21:17:00.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.045+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f86c4007030 msgr2=0x7f86c401d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.045+0000 7f86e4893680 1 --2- 172.21.15.153:0/129596926 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f86c4007030 0x7f86c401d420 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.045+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5635a1f41bb0 msgr2=0x5635a1f6fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.045+0000 7f86e4893680 1 --2- 172.21.15.153:0/129596926 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5635a1f41bb0 0x5635a1f6fb40 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.045+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f86c8046130 msgr2=0x7f86c80466e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.045+0000 7f86e4893680 1 --2- 172.21.15.153:0/129596926 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f86c8046130 0x7f86c80466e0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.045+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5635a1f71fb0 msgr2=0x5635a1f74390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.045+0000 7f86e4893680 1 --2- 172.21.15.153:0/129596926 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5635a1f71fb0 0x5635a1f74390 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.045+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f86c0034140 msgr2=0x7f86c00365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.045+0000 7f86e4893680 1 --2- 172.21.15.153:0/129596926 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f86c0034140 0x7f86c00365f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f86c4003080 tx=0x7f86c4015000 comp rx=0 tx=0).stop 2023-10-05T21:17:00.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.045+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1eaf0a0 msgr2=0x5635a1f63dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.045+0000 7f86e4893680 1 --2- 172.21.15.153:0/129596926 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1eaf0a0 0x5635a1f63dc0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f86c800c010 tx=0x7f86c8016000 comp rx=0 tx=0).stop 2023-10-05T21:17:00.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.045+0000 7f86d816c700 1 -- 172.21.15.153:0/129596926 reap_dead start 2023-10-05T21:17:00.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.045+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 shutdown_connections 2023-10-05T21:17:00.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.045+0000 7f86e4893680 1 --2- 172.21.15.153:0/129596926 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1eaf0a0 0x5635a1f63dc0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.045+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 >> 172.21.15.153:0/129596926 conn(0x5635a1f35b80 msgr2=0x5635a1f56c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.045+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 shutdown_connections 2023-10-05T21:17:00.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.045+0000 7f86e4893680 1 -- 172.21.15.153:0/129596926 wait complete. 2023-10-05T21:17:00.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.046+0000 7f86e4893680 1 -- 172.21.15.153:0/800551423 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8618034140 msgr2=0x7f86180365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.046+0000 7f86e4893680 1 --2- 172.21.15.153:0/800551423 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8618034140 0x7f86180365f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x5635a1f7dcc0 tx=0x7f86d000aee0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.046+0000 7f86e4893680 1 -- 172.21.15.153:0/800551423 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1f8d3e0 msgr2=0x5635a1f92f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.046+0000 7f86e4893680 1 --2- 172.21.15.153:0/800551423 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1f8d3e0 0x5635a1f92f70 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x5635a1f87b50 tx=0x7f86c4031000 comp rx=0 tx=0).stop 2023-10-05T21:17:00.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.046+0000 7f86e4893680 1 -- 172.21.15.153:0/800551423 shutdown_connections 2023-10-05T21:17:00.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.046+0000 7f86e4893680 1 --2- 172.21.15.153:0/800551423 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f8618034140 0x7f86180365f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.046+0000 7f86e4893680 1 --2- 172.21.15.153:0/800551423 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635a1f8d3e0 0x5635a1f92f70 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.046+0000 7f86e4893680 1 -- 172.21.15.153:0/800551423 >> 172.21.15.153:0/800551423 conn(0x5635a1f885e0 msgr2=0x5635a1f86710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.046+0000 7f86e4893680 1 -- 172.21.15.153:0/800551423 shutdown_connections 2023-10-05T21:17:00.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.046+0000 7f86e4893680 1 -- 172.21.15.153:0/800551423 wait complete. 2023-10-05T21:17:00.070 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:17:00.070 INFO:teuthology.orchestra.run.smithi153.stdout: "entries": [], 2023-10-05T21:17:00.070 INFO:teuthology.orchestra.run.smithi153.stdout: "summary": [] 2023-10-05T21:17:00.070 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:17:00.070 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2023-10-05T21:17:00.071 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2023-10-05T21:17:00.071 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2023-10-05T21:17:00.071 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2023-10-05T21:17:00.116 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:17:00.116 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:17:00.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.115+0000 7f42d57c1680 1 Processor -- start 2023-10-05T21:17:00.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.115+0000 7f42d57c1680 1 -- start start 2023-10-05T21:17:00.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.116+0000 7f42d57c1680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x556e3ed796b0 0x556e3ee0d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.116+0000 7f42d57c1680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556e3ed51930 con 0x556e3ed7aa40 2023-10-05T21:17:00.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.116+0000 7f42d57c1680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x556e3ed11db0 con 0x556e3ed796b0 2023-10-05T21:17:00.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.116+0000 7f42c3fff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x556e3ed796b0 0x556e3ee0d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.116+0000 7f42c8899700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x556e3ed7aa40 0x556e3ed78fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:57238/0 (socket says 172.21.15.153:57238) 2023-10-05T21:17:00.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.116+0000 7f42c8899700 1 -- 172.21.15.153:0/4103941158 learned_addr learned my addr 172.21.15.153:0/4103941158 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:17:00.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.116+0000 7f42c37fe700 1 -- 172.21.15.153:0/4103941158 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 626438680 0 0) 0x556e3ed51930 con 0x556e3ed7aa40 2023-10-05T21:17:00.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.116+0000 7f42c37fe700 1 -- 172.21.15.153:0/4103941158 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42b8001e10 con 0x556e3ed7aa40 2023-10-05T21:17:00.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.116+0000 7f42c3fff700 1 -- 172.21.15.153:0/4103941158 >> v1:172.21.15.111:6789/0 conn(0x556e3ed7aa40 legacy=0x556e3ed78fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.116+0000 7f42c3fff700 1 -- 172.21.15.153:0/4103941158 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e3ed79b50 con 0x556e3ed796b0 2023-10-05T21:17:00.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.116+0000 7f42c3fff700 1 --2- 172.21.15.153:0/4103941158 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556e3ed796b0 0x556e3ee0d3e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00a5d0 tx=0x7f42bc005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45737dc5acbfb96d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.117+0000 7f42c37fe700 1 -- 172.21.15.153:0/4103941158 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42bc007610 con 0x556e3ed796b0 2023-10-05T21:17:00.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.117+0000 7f42c37fe700 1 -- 172.21.15.153:0/4103941158 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42bc007770 con 0x556e3ed796b0 2023-10-05T21:17:00.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.117+0000 7f42c37fe700 1 -- 172.21.15.153:0/4103941158 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42bc007a20 con 0x556e3ed796b0 2023-10-05T21:17:00.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.117+0000 7f42d57c1680 1 -- 172.21.15.153:0/4103941158 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556e3ed796b0 msgr2=0x556e3ee0d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.117+0000 7f42d57c1680 1 --2- 172.21.15.153:0/4103941158 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556e3ed796b0 0x556e3ee0d3e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00a5d0 tx=0x7f42bc005a50 comp rx=0 tx=0).stop 2023-10-05T21:17:00.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.117+0000 7f42d57c1680 1 -- 172.21.15.153:0/4103941158 shutdown_connections 2023-10-05T21:17:00.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.117+0000 7f42d57c1680 1 --2- 172.21.15.153:0/4103941158 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556e3ed796b0 0x556e3ee0d3e0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.117+0000 7f42d57c1680 1 -- 172.21.15.153:0/4103941158 >> 172.21.15.153:0/4103941158 conn(0x556e3edffcb0 msgr2=0x556e3ee020c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.117+0000 7f42d57c1680 1 -- 172.21.15.153:0/4103941158 shutdown_connections 2023-10-05T21:17:00.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.117+0000 7f42d57c1680 1 -- 172.21.15.153:0/4103941158 wait complete. 2023-10-05T21:17:00.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.118+0000 7f42d57c1680 1 Processor -- start 2023-10-05T21:17:00.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.118+0000 7f42d57c1680 1 -- start start 2023-10-05T21:17:00.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.118+0000 7f42d57c1680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556e3ed796b0 0x556e3ee258d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.118+0000 7f42d57c1680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e3ecb1ea0 con 0x556e3ed796b0 2023-10-05T21:17:00.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.118+0000 7f42c8899700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556e3ed796b0 0x556e3ee258d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.118+0000 7f42c8899700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556e3ed796b0 0x556e3ee258d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60542/0 (socket says 172.21.15.153:60542) 2023-10-05T21:17:00.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.118+0000 7f42c8899700 1 -- 172.21.15.153:0/4161021178 learned_addr learned my addr 172.21.15.153:0/4161021178 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.119+0000 7f42c8899700 1 -- 172.21.15.153:0/4161021178 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42bc005cf0 con 0x556e3ed796b0 2023-10-05T21:17:00.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.119+0000 7f42c8899700 1 --2- 172.21.15.153:0/4161021178 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556e3ed796b0 0x556e3ee258d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f42b4001c00 tx=0x7f42b40017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1677fd86e56bb6b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.119+0000 7f42c27fc700 1 -- 172.21.15.153:0/4161021178 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42b400bbf0 con 0x556e3ed796b0 2023-10-05T21:17:00.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.119+0000 7f42c27fc700 1 -- 172.21.15.153:0/4161021178 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b400bd50 con 0x556e3ed796b0 2023-10-05T21:17:00.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.119+0000 7f42c27fc700 1 -- 172.21.15.153:0/4161021178 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42b400e470 con 0x556e3ed796b0 2023-10-05T21:17:00.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.119+0000 7f42d57c1680 1 -- 172.21.15.153:0/4161021178 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556e3ed796b0 msgr2=0x556e3ee258d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.119+0000 7f42d57c1680 1 --2- 172.21.15.153:0/4161021178 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556e3ed796b0 0x556e3ee258d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f42b4001c00 tx=0x7f42b40017b0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.119+0000 7f42d57c1680 1 -- 172.21.15.153:0/4161021178 shutdown_connections 2023-10-05T21:17:00.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.119+0000 7f42d57c1680 1 --2- 172.21.15.153:0/4161021178 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556e3ed796b0 0x556e3ee258d0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.119+0000 7f42d57c1680 1 -- 172.21.15.153:0/4161021178 >> 172.21.15.153:0/4161021178 conn(0x556e3edffcb0 msgr2=0x556e3ee213a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.120+0000 7f42d57c1680 1 -- 172.21.15.153:0/4161021178 shutdown_connections 2023-10-05T21:17:00.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.120+0000 7f42d57c1680 1 -- 172.21.15.153:0/4161021178 wait complete. 2023-10-05T21:17:00.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.120+0000 7f42d57c1680 1 Processor -- start 2023-10-05T21:17:00.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.120+0000 7f42d57c1680 1 -- start start 2023-10-05T21:17:00.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.120+0000 7f42d57c1680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556e3ed796b0 0x556e3ee2cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.120+0000 7f42d57c1680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e3eca8c80 con 0x556e3ed796b0 2023-10-05T21:17:00.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.120+0000 7f42c8899700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556e3ed796b0 0x556e3ee2cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.120+0000 7f42c8899700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556e3ed796b0 0x556e3ee2cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60556/0 (socket says 172.21.15.153:60556) 2023-10-05T21:17:00.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.120+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 learned_addr learned my addr 172.21.15.153:0/3904563633 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.120+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b8001e10 con 0x556e3ed796b0 2023-10-05T21:17:00.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.121+0000 7f42c8899700 1 --2- 172.21.15.153:0/3904563633 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556e3ed796b0 0x556e3ee2cdb0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f42b4010000 tx=0x7f42b4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.121+0000 7f42c0ff9700 1 -- 172.21.15.153:0/3904563633 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42b401f070 con 0x556e3ed796b0 2023-10-05T21:17:00.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.121+0000 7f42c0ff9700 1 -- 172.21.15.153:0/3904563633 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b4018640 con 0x556e3ed796b0 2023-10-05T21:17:00.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.121+0000 7f42c0ff9700 1 -- 172.21.15.153:0/3904563633 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42b4018930 con 0x556e3ed796b0 2023-10-05T21:17:00.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.121+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556e3ee2d2f0 con 0x556e3ed796b0 2023-10-05T21:17:00.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.121+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556e3ee2d740 con 0x556e3ed796b0 2023-10-05T21:17:00.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.122+0000 7f42c0ff9700 1 -- 172.21.15.153:0/3904563633 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f42b4018a90 con 0x556e3ed796b0 2023-10-05T21:17:00.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.122+0000 7f42d57c1680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.122+0000 7f42c0ff9700 1 --2- 172.21.15.153:0/3904563633 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f42ac034130 0x7f42ac0365e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.122+0000 7f42c0ff9700 1 -- 172.21.15.153:0/3904563633 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f42b4048e10 con 0x556e3ed796b0 2023-10-05T21:17:00.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.122+0000 7f42c3fff700 1 --2- 172.21.15.153:0/3904563633 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f42ac034130 0x7f42ac0365e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.122+0000 7f42d57c1680 1 --2- 172.21.15.153:0/3904563633 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x556e3ed7aa40 0x556e3ee38b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.122+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee392c0 con 0x556e3ed7aa40 2023-10-05T21:17:00.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.122+0000 7f42c909a700 1 --2- 172.21.15.153:0/3904563633 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x556e3ed7aa40 0x556e3ee38b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.122+0000 7f42c3fff700 1 --2- 172.21.15.153:0/3904563633 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f42ac034130 0x7f42ac0365e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f42bc005a90 tx=0x7f42bc014000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.122+0000 7f42c909a700 1 --2- 172.21.15.153:0/3904563633 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x556e3ed7aa40 0x556e3ee38b30 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.123+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.123+0000 7f42d57c1680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.123+0000 7f42d57c1680 20 realm 2023-10-05T21:17:00.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.123+0000 7f42d57c1680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.123+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee36150 con 0x556e3ed7aa40 2023-10-05T21:17:00.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.123+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.123+0000 7f42d57c1680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.123+0000 7f42d57c1680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:17:00.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.123+0000 7f42d57c1680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.123+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee39dc0 con 0x556e3ed7aa40 2023-10-05T21:17:00.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.123+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.123+0000 7f42d57c1680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.123+0000 7f42d57c1680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.123+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3a6e0 con 0x556e3ed7aa40 2023-10-05T21:17:00.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.123+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.123+0000 7f42d57c1680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:17:00.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.123+0000 7f42d57c1680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.123+0000 7f42d57c1680 1 --2- 172.21.15.153:0/3904563633 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x556e3ee3afa0 0x556e3ee3d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.123+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3d9d0 con 0x556e3ee3afa0 2023-10-05T21:17:00.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.124+0000 7f42c8899700 1 --2- 172.21.15.153:0/3904563633 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x556e3ee3afa0 0x556e3ee3d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.124+0000 7f42c8899700 1 --2- 172.21.15.153:0/3904563633 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x556e3ee3afa0 0x556e3ee3d380 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.124+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f42b4014070 con 0x556e3ee3afa0 2023-10-05T21:17:00.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.124+0000 7f42d57c1680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:17:00.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.124+0000 7f42d57c1680 20 searching for the correct realm 2023-10-05T21:17:00.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.124+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x556e3ee3afa0 2023-10-05T21:17:00.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.124+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42b4014070 con 0x556e3ee3afa0 2023-10-05T21:17:00.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.124+0000 7f42c8899700 1 --2- 172.21.15.153:0/3904563633 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f42b4016730 0x7f42b4046130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.124+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x7f42b4016730 2023-10-05T21:17:00.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.124+0000 7f42c3fff700 1 --2- 172.21.15.153:0/3904563633 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f42b4016730 0x7f42b4046130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.125+0000 7f42c3fff700 1 --2- 172.21.15.153:0/3904563633 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f42b4016730 0x7f42b4046130 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.125+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42bc007cc0 con 0x7f42b4016730 2023-10-05T21:17:00.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.125+0000 7f42c3fff700 1 --2- 172.21.15.153:0/3904563633 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f42bc007030 0x7f42bc01d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.125+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x7f42bc007030 2023-10-05T21:17:00.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.125+0000 7f42c909a700 1 --2- 172.21.15.153:0/3904563633 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f42bc007030 0x7f42bc01d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.125+0000 7f42c909a700 1 --2- 172.21.15.153:0/3904563633 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f42bc007030 0x7f42bc01d430 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.126+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.126+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x556e3ed7aa40 2023-10-05T21:17:00.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.126+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.126+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x556e3ed7aa40 2023-10-05T21:17:00.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.126+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.126+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x7f42bc007030 2023-10-05T21:17:00.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.126+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.126+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x7f42bc007030 2023-10-05T21:17:00.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.127+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.127+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x7f42b4016730 2023-10-05T21:17:00.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.127+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.127+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x556e3ee3afa0 2023-10-05T21:17:00.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.127+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f42b4014070 con 0x556e3ee3afa0 2023-10-05T21:17:00.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.127+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x556e3ed7aa40 2023-10-05T21:17:00.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.127+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.127+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x7f42bc007030 2023-10-05T21:17:00.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.128+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.128+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x556e3ed7aa40 2023-10-05T21:17:00.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.128+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.128+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x7f42b4016730 2023-10-05T21:17:00.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.128+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.128+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x556e3ee3afa0 2023-10-05T21:17:00.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.128+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42b4014070 con 0x556e3ee3afa0 2023-10-05T21:17:00.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.128+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x556e3ee3afa0 2023-10-05T21:17:00.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.128+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42b4014070 con 0x556e3ee3afa0 2023-10-05T21:17:00.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.128+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x7f42bc007030 2023-10-05T21:17:00.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.129+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.129+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x556e3ee3afa0 2023-10-05T21:17:00.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.129+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42b4014070 con 0x556e3ee3afa0 2023-10-05T21:17:00.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.129+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x556e3ee3afa0 2023-10-05T21:17:00.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.129+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42b4014070 con 0x556e3ee3afa0 2023-10-05T21:17:00.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.129+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x556e3ed7aa40 2023-10-05T21:17:00.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.129+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.129+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x556e3ed7aa40 2023-10-05T21:17:00.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.129+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.129+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x7f42bc007030 2023-10-05T21:17:00.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.130+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.130+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x556e3ee3afa0 2023-10-05T21:17:00.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.130+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42b4014070 con 0x556e3ee3afa0 2023-10-05T21:17:00.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.130+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x7f42b4016730 2023-10-05T21:17:00.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.130+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.130+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x556e3ed7aa40 2023-10-05T21:17:00.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.130+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.131+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x7f42bc007030 2023-10-05T21:17:00.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.131+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.131+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x556e3ee3afa0 2023-10-05T21:17:00.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.131+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42b404b040 con 0x556e3ee3afa0 2023-10-05T21:17:00.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.131+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x7f42bc007030 2023-10-05T21:17:00.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.131+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.131+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x7f42b4016730 2023-10-05T21:17:00.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.131+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.131+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x556e3ee3afa0 2023-10-05T21:17:00.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.132+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42b404b040 con 0x556e3ee3afa0 2023-10-05T21:17:00.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.132+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x7f42bc007030 2023-10-05T21:17:00.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.132+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.132+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x556e3ed7aa40 2023-10-05T21:17:00.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.132+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.132+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f540 con 0x7f42b4016730 2023-10-05T21:17:00.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.132+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.132+0000 7f42d57c1680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:17:00.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.132+0000 7f42d57c1680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:17:00.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.132+0000 7f42d57c1680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:17:00.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.132+0000 7f42d57c1680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:17:00.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.132+0000 7f42d57c1680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.132+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3e490 con 0x556e3ed7aa40 2023-10-05T21:17:00.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.133+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.133+0000 7f42d57c1680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.133+0000 7f42d57c1680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.133+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3e890 con 0x556e3ed7aa40 2023-10-05T21:17:00.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.133+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.133+0000 7f42d57c1680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:17:00.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.133+0000 7f42d57c1680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.133+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f9d0 con 0x556e3ed7aa40 2023-10-05T21:17:00.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.133+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.133+0000 7f42d57c1680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:17:00.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.133+0000 7f42d57c1680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.133+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3fd80 con 0x556e3ee3afa0 2023-10-05T21:17:00.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.133+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f42b404b040 con 0x556e3ee3afa0 2023-10-05T21:17:00.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.133+0000 7f42d57c1680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.133+0000 7f42d57c1680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.133+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee40130 con 0x556e3ed7aa40 2023-10-05T21:17:00.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.134+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.134+0000 7f42d57c1680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.134+0000 7f42d57c1680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.134+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee40130 con 0x556e3ed7aa40 2023-10-05T21:17:00.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.134+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.134+0000 7f42d57c1680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:17:00.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.134+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee40130 con 0x556e3ee3afa0 2023-10-05T21:17:00.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.134+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42b404b040 con 0x556e3ee3afa0 2023-10-05T21:17:00.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.134+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee40130 con 0x7f42b4016730 2023-10-05T21:17:00.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.134+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.134+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee40130 con 0x7f42bc007030 2023-10-05T21:17:00.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.135+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.135+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f9d0 con 0x556e3ed7aa40 2023-10-05T21:17:00.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.135+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.135+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f9d0 con 0x556e3ed7aa40 2023-10-05T21:17:00.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.135+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.135+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f9d0 con 0x7f42bc007030 2023-10-05T21:17:00.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.136+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.136+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f9d0 con 0x7f42bc007030 2023-10-05T21:17:00.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.136+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.136+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f9d0 con 0x7f42b4016730 2023-10-05T21:17:00.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.136+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.136+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f9d0 con 0x556e3ee3afa0 2023-10-05T21:17:00.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.137+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f42b404b040 con 0x556e3ee3afa0 2023-10-05T21:17:00.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.137+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f9d0 con 0x556e3ed7aa40 2023-10-05T21:17:00.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.137+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.137+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f9d0 con 0x7f42bc007030 2023-10-05T21:17:00.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.137+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.137+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f9d0 con 0x556e3ed7aa40 2023-10-05T21:17:00.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.137+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.137+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f9d0 con 0x7f42b4016730 2023-10-05T21:17:00.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.137+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.137+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f9d0 con 0x556e3ee3afa0 2023-10-05T21:17:00.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.138+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42b404b040 con 0x556e3ee3afa0 2023-10-05T21:17:00.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.138+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f9d0 con 0x556e3ee3afa0 2023-10-05T21:17:00.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.138+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42b404b040 con 0x556e3ee3afa0 2023-10-05T21:17:00.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.138+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f9d0 con 0x7f42bc007030 2023-10-05T21:17:00.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.138+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.138+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f9d0 con 0x556e3ee3afa0 2023-10-05T21:17:00.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.138+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42b404b040 con 0x556e3ee3afa0 2023-10-05T21:17:00.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.138+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f9d0 con 0x556e3ee3afa0 2023-10-05T21:17:00.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.138+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42b404b040 con 0x556e3ee3afa0 2023-10-05T21:17:00.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.138+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f9d0 con 0x556e3ed7aa40 2023-10-05T21:17:00.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.139+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.139+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f9d0 con 0x556e3ed7aa40 2023-10-05T21:17:00.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.139+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.139+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f9d0 con 0x7f42bc007030 2023-10-05T21:17:00.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.139+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.139+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f9d0 con 0x556e3ee3afa0 2023-10-05T21:17:00.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.139+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42b404b040 con 0x556e3ee3afa0 2023-10-05T21:17:00.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.139+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f9d0 con 0x7f42b4016730 2023-10-05T21:17:00.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.140+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.140+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f9d0 con 0x556e3ed7aa40 2023-10-05T21:17:00.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.140+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.140+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f9d0 con 0x7f42bc007030 2023-10-05T21:17:00.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.140+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.140+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f9d0 con 0x556e3ee3afa0 2023-10-05T21:17:00.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.140+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42b404b040 con 0x556e3ee3afa0 2023-10-05T21:17:00.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.140+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f9d0 con 0x7f42bc007030 2023-10-05T21:17:00.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.141+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.141+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f9d0 con 0x7f42b4016730 2023-10-05T21:17:00.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.141+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.141+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f9d0 con 0x556e3ee3afa0 2023-10-05T21:17:00.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.141+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42b404b040 con 0x556e3ee3afa0 2023-10-05T21:17:00.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.141+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f9d0 con 0x7f42bc007030 2023-10-05T21:17:00.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.141+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.141+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f9d0 con 0x556e3ed7aa40 2023-10-05T21:17:00.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.141+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.141+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee3f9d0 con 0x7f42b4016730 2023-10-05T21:17:00.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.142+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.142+0000 7f42d57c1680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:17:00.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.142+0000 7f42d57c1680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:17:00.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.142+0000 7f42d57c1680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:17:00.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.142+0000 7f42d57c1680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:17:00.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.142+0000 7f42d57c1680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.142+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee40130 con 0x556e3ed7aa40 2023-10-05T21:17:00.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.142+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.142+0000 7f42d57c1680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:17:00.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.142+0000 7f42d57c1680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.142+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee40530 con 0x556e3ee3afa0 2023-10-05T21:17:00.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.142+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f42b404b040 con 0x556e3ee3afa0 2023-10-05T21:17:00.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.142+0000 7f42d57c1680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:17:00.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.142+0000 7f42d57c1680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.142+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee40e20 con 0x556e3ed7aa40 2023-10-05T21:17:00.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.142+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.142+0000 7f42d57c1680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:17:00.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.142+0000 7f42d57c1680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.143+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee40e20 con 0x556e3ed7aa40 2023-10-05T21:17:00.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.143+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.143+0000 7f42d57c1680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:17:00.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.143+0000 7f42d57c1680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.143+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee40e20 con 0x7f42bc007030 2023-10-05T21:17:00.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.143+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.143+0000 7f42d57c1680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.143+0000 7f42d57c1680 20 zone default found 2023-10-05T21:17:00.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.143+0000 7f42d57c1680 4 Realm: () 2023-10-05T21:17:00.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.143+0000 7f42d57c1680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:17:00.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.143+0000 7f42d57c1680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:17:00.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.143+0000 7f42d57c1680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:17:00.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.143+0000 7f42d57c1680 20 zonegroup default 2023-10-05T21:17:00.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.143+0000 7f42d57c1680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.143+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee40e20 con 0x7f42bc007030 2023-10-05T21:17:00.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.143+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.143+0000 7f42d57c1680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.143+0000 7f42d57c1680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.143+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee40e20 con 0x556e3ee3afa0 2023-10-05T21:17:00.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.144+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f42b404b040 con 0x556e3ee3afa0 2023-10-05T21:17:00.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.144+0000 7f42d57c1680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.144+0000 7f42d57c1680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.144+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee42c50 con 0x556e3ee3afa0 2023-10-05T21:17:00.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.144+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f42b404b040 con 0x556e3ee3afa0 2023-10-05T21:17:00.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.144+0000 7f42d57c1680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.144+0000 7f42d57c1680 20 started sync module instance, tier type = 2023-10-05T21:17:00.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.144+0000 7f42d57c1680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:17:00.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.144+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee42310 con 0x7f42b4016730 2023-10-05T21:17:00.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.145+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v31'264 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.145+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93931989903120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee434f0 con 0x7f42b4016730 2023-10-05T21:17:00.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.145+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee43d90 con 0x556e3ed7aa40 2023-10-05T21:17:00.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.145+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 93931989903120] v31'265 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.146+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v31'264 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.146+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93931989905408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee43d90 con 0x556e3ed7aa40 2023-10-05T21:17:00.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.146+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee448c0 con 0x556e3ee3afa0 2023-10-05T21:17:00.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.147+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v31'264 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42b404b040 con 0x556e3ee3afa0 2023-10-05T21:17:00.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.147+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 93931989905408] v31'265 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.147+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93931989910384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee451b0 con 0x556e3ee3afa0 2023-10-05T21:17:00.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.147+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee45a80 con 0x7f42b4016730 2023-10-05T21:17:00.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.147+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v31'264 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.147+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 93931989915024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee451b0 con 0x7f42b4016730 2023-10-05T21:17:00.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.147+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 93931989910384] v31'265 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42b404b040 con 0x556e3ee3afa0 2023-10-05T21:17:00.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.147+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee469c0 con 0x556e3ed7aa40 2023-10-05T21:17:00.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.148+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v31'264 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.148+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 93931989912768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee46c30 con 0x556e3ed7aa40 2023-10-05T21:17:00.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.148+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee477e0 con 0x7f42bc007030 2023-10-05T21:17:00.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.148+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 93931989915024] v31'265 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.149+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 93931989912768] v31'265 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.149+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v31'264 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.149+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 93931989919456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee477a0 con 0x7f42bc007030 2023-10-05T21:17:00.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.149+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee480d0 con 0x7f42bc007030 2023-10-05T21:17:00.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.150+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 93931989919456] v31'265 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.150+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v31'264 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.150+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93931989922416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee47c90 con 0x7f42bc007030 2023-10-05T21:17:00.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.150+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee48710 con 0x7f42bc007030 2023-10-05T21:17:00.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.150+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 93931989922416] v31'265 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.150+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v31'264 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.150+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93931989926368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee47c90 con 0x7f42bc007030 2023-10-05T21:17:00.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.150+0000 7f42d57c1680 20 add_watcher() i=0 2023-10-05T21:17:00.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.150+0000 7f42d57c1680 20 add_watcher() i=1 2023-10-05T21:17:00.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.150+0000 7f42d57c1680 20 add_watcher() i=2 2023-10-05T21:17:00.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.150+0000 7f42d57c1680 20 add_watcher() i=3 2023-10-05T21:17:00.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.150+0000 7f42d57c1680 20 add_watcher() i=4 2023-10-05T21:17:00.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.150+0000 7f42d57c1680 20 add_watcher() i=5 2023-10-05T21:17:00.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.150+0000 7f42d57c1680 20 add_watcher() i=6 2023-10-05T21:17:00.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.151+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 93931989926368] v31'265 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.151+0000 7f42d57c1680 20 add_watcher() i=7 2023-10-05T21:17:00.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.151+0000 7f42d57c1680 2 all 8 watchers are set, enabling cache 2023-10-05T21:17:00.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.151+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee4bb70 con 0x556e3ed7aa40 2023-10-05T21:17:00.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.152+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.152+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93931989924208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee49030 con 0x556e3ed7aa40 2023-10-05T21:17:00.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.153+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 93931989924208] v31'253 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.153+0000 7f4299fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:17:00.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.153+0000 7f42d57c1680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:17:00.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.153+0000 7f42d57c1680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:17:00.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.153+0000 7f42d57c1680 1 Processor -- start 2023-10-05T21:17:00.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.153+0000 7f42d57c1680 1 -- start start 2023-10-05T21:17:00.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.153+0000 7f42d57c1680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556e3ee55760 0x556e3ee55b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.153+0000 7f42d57c1680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e3ee56180 con 0x556e3ee55760 2023-10-05T21:17:00.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.153+0000 7f42c3fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556e3ee55760 0x556e3ee55b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.153+0000 7f42c3fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556e3ee55760 0x556e3ee55b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60572/0 (socket says 172.21.15.153:60572) 2023-10-05T21:17:00.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.153+0000 7f42c3fff700 1 -- 172.21.15.153:0/1454186820 learned_addr learned my addr 172.21.15.153:0/1454186820 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.154+0000 7f42c3fff700 1 -- 172.21.15.153:0/1454186820 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e3ee56660 con 0x556e3ee55760 2023-10-05T21:17:00.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.154+0000 7f42c3fff700 1 --2- 172.21.15.153:0/1454186820 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556e3ee55760 0x556e3ee55b70 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f42bc002000 tx=0x7f42bc030040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f38227d5fe0e483 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.154+0000 7f42997e2700 1 -- 172.21.15.153:0/1454186820 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42bc025040 con 0x556e3ee55760 2023-10-05T21:17:00.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.154+0000 7f42997e2700 1 -- 172.21.15.153:0/1454186820 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42bc034070 con 0x556e3ee55760 2023-10-05T21:17:00.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.154+0000 7f42997e2700 1 -- 172.21.15.153:0/1454186820 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42bc01de80 con 0x556e3ee55760 2023-10-05T21:17:00.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.155+0000 7f42d57c1680 1 -- 172.21.15.153:0/1454186820 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556e3ee55760 msgr2=0x556e3ee55b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.155+0000 7f42d57c1680 1 --2- 172.21.15.153:0/1454186820 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556e3ee55760 0x556e3ee55b70 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f42bc002000 tx=0x7f42bc030040 comp rx=0 tx=0).stop 2023-10-05T21:17:00.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.155+0000 7f42d57c1680 1 -- 172.21.15.153:0/1454186820 shutdown_connections 2023-10-05T21:17:00.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.155+0000 7f42d57c1680 1 --2- 172.21.15.153:0/1454186820 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556e3ee55760 0x556e3ee55b70 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.155+0000 7f42d57c1680 1 -- 172.21.15.153:0/1454186820 >> 172.21.15.153:0/1454186820 conn(0x556e3ee51a60 msgr2=0x556e3ee4fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.155+0000 7f42d57c1680 1 -- 172.21.15.153:0/1454186820 shutdown_connections 2023-10-05T21:17:00.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.155+0000 7f42d57c1680 1 -- 172.21.15.153:0/1454186820 wait complete. 2023-10-05T21:17:00.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.155+0000 7f42d57c1680 1 Processor -- start 2023-10-05T21:17:00.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.155+0000 7f42d57c1680 1 -- start start 2023-10-05T21:17:00.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.155+0000 7f42d57c1680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556e3ee55760 0x556e3ee5c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.155+0000 7f42d57c1680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e3ee5c9f0 con 0x556e3ee55760 2023-10-05T21:17:00.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.156+0000 7f42c3fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556e3ee55760 0x556e3ee5c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.156+0000 7f42c3fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556e3ee55760 0x556e3ee5c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60580/0 (socket says 172.21.15.153:60580) 2023-10-05T21:17:00.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.156+0000 7f42c3fff700 1 -- 172.21.15.153:0/1524563433 learned_addr learned my addr 172.21.15.153:0/1524563433 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.156+0000 7f42c3fff700 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e3ed79b50 con 0x556e3ee55760 2023-10-05T21:17:00.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.156+0000 7f42c3fff700 1 --2- 172.21.15.153:0/1524563433 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556e3ee55760 0x556e3ee5c4b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x556e3ee50fd0 tx=0x7f42bc034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.156+0000 7f42137fe700 1 -- 172.21.15.153:0/1524563433 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42bc025040 con 0x556e3ee55760 2023-10-05T21:17:00.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.156+0000 7f42137fe700 1 -- 172.21.15.153:0/1524563433 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42bc02d660 con 0x556e3ee55760 2023-10-05T21:17:00.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.156+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556e3ee5cbf0 con 0x556e3ee55760 2023-10-05T21:17:00.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.156+0000 7f42137fe700 1 -- 172.21.15.153:0/1524563433 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42bc02d7f0 con 0x556e3ee55760 2023-10-05T21:17:00.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.156+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556e3ee5d040 con 0x556e3ee55760 2023-10-05T21:17:00.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.157+0000 7f42137fe700 1 -- 172.21.15.153:0/1524563433 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f42bc041050 con 0x556e3ee55760 2023-10-05T21:17:00.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.157+0000 7f42137fe700 1 --2- 172.21.15.153:0/1524563433 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4208034140 0x7f42080365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.157+0000 7f42137fe700 1 -- 172.21.15.153:0/1524563433 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f42bc04ec20 con 0x556e3ee55760 2023-10-05T21:17:00.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.157+0000 7f42c909a700 1 --2- 172.21.15.153:0/1524563433 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4208034140 0x7f42080365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.157+0000 7f42d57c1680 1 --2- 172.21.15.153:0/1524563433 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x556e3ee67330 0x556e3ee697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.157+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee69ee0 con 0x556e3ee67330 2023-10-05T21:17:00.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.157+0000 7f42c8899700 1 --2- 172.21.15.153:0/1524563433 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x556e3ee67330 0x556e3ee697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.157+0000 7f42c909a700 1 --2- 172.21.15.153:0/1524563433 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4208034140 0x7f42080365f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x556e3ee47e00 tx=0x7f42c4037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.158+0000 7f42c8899700 1 --2- 172.21.15.153:0/1524563433 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x556e3ee67330 0x556e3ee697e0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.158+0000 7f42c8899700 1 -- 172.21.15.153:0/1524563433 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v31'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f42b404b040 con 0x556e3ee67330 2023-10-05T21:17:00.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.158+0000 7f42d57c1680 1 --2- 172.21.15.153:0/1524563433 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x556e3ee6ab80 0x556e3ee6cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.158+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee6d6f0 con 0x556e3ee6ab80 2023-10-05T21:17:00.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.159+0000 7f42c3fff700 1 --2- 172.21.15.153:0/1524563433 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x556e3ee6ab80 0x556e3ee6cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.159+0000 7f42c3fff700 1 --2- 172.21.15.153:0/1524563433 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x556e3ee6ab80 0x556e3ee6cfa0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.160+0000 7f42c3fff700 1 -- 172.21.15.153:0/1524563433 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v31'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f42bc029040 con 0x556e3ee6ab80 2023-10-05T21:17:00.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.160+0000 7f42d57c1680 1 --2- 172.21.15.153:0/1524563433 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x556e3ee64d70 0x556e3ee70e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.160+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee71410 con 0x556e3ee64d70 2023-10-05T21:17:00.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.160+0000 7f42c909a700 1 --2- 172.21.15.153:0/1524563433 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x556e3ee64d70 0x556e3ee70e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.160+0000 7f42c909a700 1 --2- 172.21.15.153:0/1524563433 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x556e3ee64d70 0x556e3ee70e40 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.161+0000 7f42c909a700 1 -- 172.21.15.153:0/1524563433 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v31'34 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ee64d70 2023-10-05T21:17:00.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.161+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee71b40 con 0x556e3ee67330 2023-10-05T21:17:00.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.162+0000 7f42c8899700 1 -- 172.21.15.153:0/1524563433 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(4 gc.3 [create,call,call,call] v31'254 uv186 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f42b404b040 con 0x556e3ee67330 2023-10-05T21:17:00.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.162+0000 7f42d57c1680 1 --2- 172.21.15.153:0/1524563433 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x556e3ee728c0 0x556e3ee74ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.162+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee75350 con 0x556e3ee728c0 2023-10-05T21:17:00.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.162+0000 7f42c8899700 1 --2- 172.21.15.153:0/1524563433 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x556e3ee728c0 0x556e3ee74ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.162+0000 7f42c8899700 1 --2- 172.21.15.153:0/1524563433 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x556e3ee728c0 0x556e3ee74ca0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.163+0000 7f42c8899700 1 -- 172.21.15.153:0/1524563433 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(5 gc.4 [create,call,call,call] v31'80 uv58 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee728c0 2023-10-05T21:17:00.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.163+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee75a80 con 0x556e3ee64d70 2023-10-05T21:17:00.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.164+0000 7f42c909a700 1 -- 172.21.15.153:0/1524563433 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v31'49 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ee64d70 2023-10-05T21:17:00.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.164+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee760e0 con 0x556e3ee67330 2023-10-05T21:17:00.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.164+0000 7f42c8899700 1 -- 172.21.15.153:0/1524563433 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v31'30 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee67330 2023-10-05T21:17:00.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.164+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee760e0 con 0x556e3ee6ab80 2023-10-05T21:17:00.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.165+0000 7f42c3fff700 1 -- 172.21.15.153:0/1524563433 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v31'53 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f42bc029040 con 0x556e3ee6ab80 2023-10-05T21:17:00.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.165+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee76700 con 0x556e3ee728c0 2023-10-05T21:17:00.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.166+0000 7f42c8899700 1 -- 172.21.15.153:0/1524563433 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(9 gc.8 [create,call,call,call] v31'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee728c0 2023-10-05T21:17:00.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.166+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee76790 con 0x556e3ee64d70 2023-10-05T21:17:00.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.167+0000 7f42c909a700 1 -- 172.21.15.153:0/1524563433 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(10 gc.9 [create,call,call,call] v31'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ee64d70 2023-10-05T21:17:00.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.167+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee76ec0 con 0x556e3ee728c0 2023-10-05T21:17:00.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.167+0000 7f42c8899700 1 -- 172.21.15.153:0/1524563433 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(11 gc.10 [create,call,call,call] v31'81 uv60 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee728c0 2023-10-05T21:17:00.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.167+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee76ec0 con 0x556e3ee6ab80 2023-10-05T21:17:00.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.168+0000 7f42c3fff700 1 -- 172.21.15.153:0/1524563433 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v31'38 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f42bc029040 con 0x556e3ee6ab80 2023-10-05T21:17:00.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.168+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee774e0 con 0x556e3ee728c0 2023-10-05T21:17:00.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.169+0000 7f42c8899700 1 -- 172.21.15.153:0/1524563433 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(13 gc.12 [create,call,call,call] v31'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee728c0 2023-10-05T21:17:00.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.169+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee774e0 con 0x556e3ee6ab80 2023-10-05T21:17:00.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.170+0000 7f42c3fff700 1 -- 172.21.15.153:0/1524563433 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(14 gc.13 [create,call,call,call] v31'55 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f42bc029040 con 0x556e3ee6ab80 2023-10-05T21:17:00.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.170+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee779d0 con 0x556e3ee67330 2023-10-05T21:17:00.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.170+0000 7f42c8899700 1 -- 172.21.15.153:0/1524563433 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v31'255 uv182 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee67330 2023-10-05T21:17:00.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.170+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee779d0 con 0x556e3ee64d70 2023-10-05T21:17:00.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.171+0000 7f42c909a700 1 -- 172.21.15.153:0/1524563433 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(16 gc.15 [create,call,call,call] v31'71 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ee64d70 2023-10-05T21:17:00.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.171+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee77a60 con 0x556e3ee728c0 2023-10-05T21:17:00.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.172+0000 7f42c8899700 1 -- 172.21.15.153:0/1524563433 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v31'82 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee728c0 2023-10-05T21:17:00.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.172+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee77a60 con 0x556e3ee64d70 2023-10-05T21:17:00.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.173+0000 7f42c909a700 1 -- 172.21.15.153:0/1524563433 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(18 gc.17 [create,call,call,call] v31'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ee64d70 2023-10-05T21:17:00.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.173+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee77af0 con 0x556e3ee67330 2023-10-05T21:17:00.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.173+0000 7f42c8899700 1 -- 172.21.15.153:0/1524563433 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(19 gc.18 [create,call,call,call] v31'40 uv32 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee67330 2023-10-05T21:17:00.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.173+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee77af0 con 0x556e3ee67330 2023-10-05T21:17:00.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.174+0000 7f42c8899700 1 -- 172.21.15.153:0/1524563433 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v31'256 uv184 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee67330 2023-10-05T21:17:00.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.174+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee77af0 con 0x556e3ee64d70 2023-10-05T21:17:00.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.175+0000 7f42c909a700 1 -- 172.21.15.153:0/1524563433 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(21 gc.20 [create,call,call,call] v31'72 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ee64d70 2023-10-05T21:17:00.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.175+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee77af0 con 0x556e3ee728c0 2023-10-05T21:17:00.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.175+0000 7f42c8899700 1 -- 172.21.15.153:0/1524563433 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(22 gc.21 [create,call,call,call] v31'55 uv37 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee728c0 2023-10-05T21:17:00.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.175+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee77af0 con 0x556e3ee64d70 2023-10-05T21:17:00.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.176+0000 7f42c909a700 1 -- 172.21.15.153:0/1524563433 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 gc.22 [create,call,call,call] v31'33 uv26 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ee64d70 2023-10-05T21:17:00.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.176+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee77af0 con 0x556e3ee64d70 2023-10-05T21:17:00.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.177+0000 7f42c909a700 1 -- 172.21.15.153:0/1524563433 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(24 gc.23 [create,call,call,call] v31'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ee64d70 2023-10-05T21:17:00.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.177+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee77af0 con 0x556e3ee64d70 2023-10-05T21:17:00.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.177+0000 7f42c909a700 1 -- 172.21.15.153:0/1524563433 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(25 gc.24 [create,call,call,call] v31'39 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ee64d70 2023-10-05T21:17:00.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.177+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee77af0 con 0x556e3ee64d70 2023-10-05T21:17:00.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.178+0000 7f42c909a700 1 -- 172.21.15.153:0/1524563433 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(26 gc.25 [create,call,call,call] v31'50 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ee64d70 2023-10-05T21:17:00.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.178+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee77af0 con 0x556e3ee6ab80 2023-10-05T21:17:00.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.179+0000 7f42c3fff700 1 -- 172.21.15.153:0/1524563433 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(27 gc.26 [create,call,call,call] v31'31 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f42bc029040 con 0x556e3ee6ab80 2023-10-05T21:17:00.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.179+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee77af0 con 0x556e3ee64d70 2023-10-05T21:17:00.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.179+0000 7f42c909a700 1 -- 172.21.15.153:0/1524563433 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v31'35 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ee64d70 2023-10-05T21:17:00.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.180+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee77af0 con 0x556e3ee6ab80 2023-10-05T21:17:00.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.180+0000 7f42c3fff700 1 -- 172.21.15.153:0/1524563433 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v31'54 uv38 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f42bc029040 con 0x556e3ee6ab80 2023-10-05T21:17:00.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.180+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee77af0 con 0x556e3ee64d70 2023-10-05T21:17:00.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.181+0000 7f42c909a700 1 -- 172.21.15.153:0/1524563433 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v31'73 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ee64d70 2023-10-05T21:17:00.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.181+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee77af0 con 0x556e3ee6ab80 2023-10-05T21:17:00.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.182+0000 7f42c3fff700 1 -- 172.21.15.153:0/1524563433 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v31'56 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f42bc029040 con 0x556e3ee6ab80 2023-10-05T21:17:00.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.182+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee77af0 con 0x556e3ee728c0 2023-10-05T21:17:00.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.183+0000 7f42c8899700 1 -- 172.21.15.153:0/1524563433 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(32 gc.31 [create,call,call,call] v31'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee728c0 2023-10-05T21:17:00.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.184+0000 7f4210ff9700 20 reqs_thread_entry: start 2023-10-05T21:17:00.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.185+0000 7f42067fc700 20 reqs_thread_entry: start 2023-10-05T21:17:00.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.185+0000 7f42d57c1680 20 init_complete bucket index max shards: 11 2023-10-05T21:17:00.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.185+0000 7f42d57c1680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:17:00.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.185+0000 7f4204ff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:17:30 2023 2023-10-05T21:17:00.300 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:17:00.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.185+0000 7f41ebfff700 20 reqs_thread_entry: start 2023-10-05T21:17:00.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.185+0000 7f42d57c1680 20 get_system_obj_state: rctx=0x7ffe74989018 obj=default.rgw.meta:users.uid:foo state=0x556e3ecb7240 s->prefetch_data=0 2023-10-05T21:17:00.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.185+0000 7f42d57c1680 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T21:17:00.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.185+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed3030 con 0x556e3ed7aa40 2023-10-05T21:17:00.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.185+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.185+0000 7f42d57c1680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T21:17:00.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.185+0000 7f42d57c1680 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:17:00.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.185+0000 7f42d57c1680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:17:00.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.185+0000 7f42d57c1680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:17:00.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.185+0000 7f42d57c1680 20 Read xattr: user.rgw.idtag 2023-10-05T21:17:00.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.185+0000 7f42d57c1680 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T21:17:00.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.185+0000 7f42d57c1680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.185+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed52c0 con 0x556e3ed7aa40 2023-10-05T21:17:00.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.186+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.186+0000 7f42d57c1680 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T21:17:00.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.186+0000 7f42d57c1680 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T21:17:00.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.186+0000 7f42d57c1680 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T21:17:00.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.186+0000 7f42d57c1680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:17:00.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.186+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:104 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed52c0 con 0x7f42b4016730 2023-10-05T21:17:00.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.186+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(104 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.186+0000 7f42d57c1680 20 get_system_obj_state: rctx=0x7ffe74988cd0 obj=default.rgw.meta:root:.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6 state=0x556e3ecb7240 s->prefetch_data=0 2023-10-05T21:17:00.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.186+0000 7f42d57c1680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6 : miss 2023-10-05T21:17:00.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.186+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:105 8.0 8:04666065:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed4dd0 con 0x556e3ee3afa0 2023-10-05T21:17:00.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.187+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(105 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee3afa0 2023-10-05T21:17:00.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.187+0000 7f42d57c1680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6 info.flags=0x16 2023-10-05T21:17:00.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.187+0000 7f42d57c1680 10 adding default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6 to cache LRU end 2023-10-05T21:17:00.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.187+0000 7f42d57c1680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:17:00.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.187+0000 7f42d57c1680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:17:00.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.187+0000 7f42d57c1680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:17:00.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.187+0000 7f42d57c1680 20 Read xattr: user.rgw.acl 2023-10-05T21:17:00.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.187+0000 7f42d57c1680 20 Read xattr: user.rgw.idtag 2023-10-05T21:17:00.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.187+0000 7f42d57c1680 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6 : type miss (requested=0x13, cached=0x16) 2023-10-05T21:17:00.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.187+0000 7f42d57c1680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.187+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:106 8.0 8:04666065:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed7880 con 0x556e3ee3afa0 2023-10-05T21:17:00.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.187+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(106 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee3afa0 2023-10-05T21:17:00.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.187+0000 7f42d57c1680 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T21:17:00.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.187+0000 7f42d57c1680 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6 info.flags=0x13 2023-10-05T21:17:00.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.187+0000 7f42d57c1680 10 moving default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6 to cache LRU end 2023-10-05T21:17:00.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.187+0000 7f42d57c1680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:17:00.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.187+0000 7f42d57c1680 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:17:00.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.187+0000 7f42d57c1680 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6 2023-10-05T21:17:00.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.187+0000 7f42d57c1680 10 int RGWRados::cls_bucket_list_unordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, uint32_t, bool, std::vector&, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter) :myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6]) start_after="", prefix="", shard_id=-1", num_entries=1100, list_versions=1, force_check_filter is unset 2023-10-05T21:17:00.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.187+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:107 4.13 4:c9e23c1c:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ef52cd0 con 0x7f42b4016730 2023-10-05T21:17:00.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.187+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(107 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.0 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.187+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:108 4.18 4:1958e93d:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ef52cd0 con 0x7f42b4016730 2023-10-05T21:17:00.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.188+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 19 ==== osd_op_reply(108 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.1 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.188+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:109 4.1 4:804ec093:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ef52cd0 con 0x7f42b4016730 2023-10-05T21:17:00.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.188+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 20 ==== osd_op_reply(109 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.2 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.188+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 4.4 4:20291982:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ef52cd0 con 0x7f42bc007030 2023-10-05T21:17:00.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.189+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(110 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.189+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:111 4.29 4:97e81541:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ef52cd0 con 0x556e3ee3afa0 2023-10-05T21:17:00.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.189+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== osd_op_reply(111 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.4 [call out=425b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+425 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee3afa0 2023-10-05T21:17:00.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.189+0000 7f42d57c1680 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2023-10-05T21:17:00.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.189+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:112 4.2d 4:b47b65ae:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ef52cd0 con 0x7f42bc007030 2023-10-05T21:17:00.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.190+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(112 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.190+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:113 4.1f 4:f85cbb60:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ef52cd0 con 0x556e3ee3afa0 2023-10-05T21:17:00.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.190+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== osd_op_reply(113 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee3afa0 2023-10-05T21:17:00.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.190+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:114 4.36 4:6dd5d4dd:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ef52cd0 con 0x556e3ed7aa40 2023-10-05T21:17:00.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.191+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(114 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.7 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.191+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:115 4.24 4:27836a22:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ef52cd0 con 0x7f42bc007030 2023-10-05T21:17:00.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.191+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(115 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.191+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:116 4.26 4:6786272a:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ef52cd0 con 0x7f42bc007030 2023-10-05T21:17:00.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.191+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(116 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.191+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:117 4.2f 4:f47de62c:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ef52cd0 con 0x556e3ed7aa40 2023-10-05T21:17:00.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.192+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(117 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.10 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.192+0000 7f42d57c1680 20 get_obj_state: rctx=0x7ffe74988ce0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x556e3eed6058 s->prefetch_data=0 2023-10-05T21:17:00.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.192+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:118 3.8 3:13b5618c:::193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed6eb0 con 0x556e3ee3afa0 2023-10-05T21:17:00.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.192+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(118 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee3afa0 2023-10-05T21:17:00.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.192+0000 7f42d57c1680 10 manifest: total_size = 6 2023-10-05T21:17:00.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.192+0000 7f42d57c1680 20 get_obj_state: setting s->obj_tag to 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4220.8141290249418643676 2023-10-05T21:17:00.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.192+0000 7f42d57c1680 20 get_obj_state: rctx=0x7ffe74988ce0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x556e3eed6058 s->prefetch_data=0 2023-10-05T21:17:00.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.192+0000 7f42d57c1680 20 prepare_atomic_modification: state is not atomic. state=0x556e3eed6058 2023-10-05T21:17:00.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.192+0000 7f42d57c1680 20 bucket index object: default.rgw.buckets.index:.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.4 2023-10-05T21:17:00.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.192+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:119 4.29 4:97e81541:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed79d0 con 0x556e3ee3afa0 2023-10-05T21:17:00.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.193+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 31 ==== osd_op_reply(119 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.4 [stat,call,call] v31'4 uv4 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee3afa0 2023-10-05T21:17:00.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.193+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:120 3.8 3:13b5618c:::193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed79d0 con 0x556e3ee3afa0 2023-10-05T21:17:00.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.194+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 32 ==== osd_op_reply(120 193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6_15f6f8dc036519d7fe15b39338f6e5db [call] v31'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee3afa0 2023-10-05T21:17:00.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.194+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:121 4.29 4:97e81541:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eedc6b0 con 0x556e3ee3afa0 2023-10-05T21:17:00.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.194+0000 7f42d57c1680 10 cache get: name=default.rgw.log++bucket.sync-source-hints.myfoo : miss 2023-10-05T21:17:00.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.194+0000 7f42d57c1680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.194+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:122 6.18 6:1df25bda:::bucket.sync-source-hints.myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eedee80 con 0x7f42bc007030 2023-10-05T21:17:00.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.194+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 31 ==== osd_op_reply(122 bucket.sync-source-hints.myfoo [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 216+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.194+0000 7f42d57c1680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.194+0000 7f42d57c1680 10 cache put: name=default.rgw.log++bucket.sync-source-hints.myfoo info.flags=0x0 2023-10-05T21:17:00.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.194+0000 7f42d57c1680 10 adding default.rgw.log++bucket.sync-source-hints.myfoo to cache LRU end 2023-10-05T21:17:00.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.194+0000 7f42d57c1680 10 cache get: name=default.rgw.log++bucket.sync-target-hints.myfoo : miss 2023-10-05T21:17:00.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.194+0000 7f42d57c1680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.194+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:123 6.4 6:26e4c4bc:::bucket.sync-target-hints.myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eedeec0 con 0x556e3ed7aa40 2023-10-05T21:17:00.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.194+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== osd_op_reply(123 bucket.sync-target-hints.myfoo [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 216+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42d57c1680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42d57c1680 10 cache put: name=default.rgw.log++bucket.sync-target-hints.myfoo info.flags=0x0 2023-10-05T21:17:00.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42d57c1680 10 adding default.rgw.log++bucket.sync-target-hints.myfoo to cache LRU end 2023-10-05T21:17:00.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42d57c1680 10 chain_cache_entry: cache_locator= 2023-10-05T21:17:00.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42d57c1680 20 chain_cache_entry: couldn't find cache locator 2023-10-05T21:17:00.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42d57c1680 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2023-10-05T21:17:00.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42d57c1680 20 int RGWRados::Bucket::List::list_objects_ordered(const DoutPrefixProvider*, int64_t, std::vector*, std::map, bool>*, bool*, optional_yield): starting attempt 1 2023-10-05T21:17:00.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42d57c1680 10 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): :myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6]) start_after="_multipart_", prefix="_multipart_, delimiter="", shard_id=-1", num_entries=1001, list_versions=0, expansion_factor=1, force_check_filter is unset 2023-10-05T21:17:00.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42d57c1680 10 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-10-05T21:17:00.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:124 4.13 4:c9e23c1c:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed5e30 con 0x7f42b4016730 2023-10-05T21:17:00.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 33 ==== osd_op_reply(121 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.4 [stat,call,call] v31'5 uv5 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee3afa0 2023-10-05T21:17:00.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:125 4.18 4:1958e93d:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eee1c40 con 0x7f42b4016730 2023-10-05T21:17:00.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42c27fc700 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2023-10-05T21:17:00.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:126 4.1 4:804ec093:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed9f50 con 0x7f42b4016730 2023-10-05T21:17:00.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:127 4.4 4:20291982:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed5e30 con 0x7f42bc007030 2023-10-05T21:17:00.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:128 4.29 4:97e81541:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eee1c40 con 0x556e3ee3afa0 2023-10-05T21:17:00.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:129 4.2d 4:b47b65ae:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed9f50 con 0x7f42bc007030 2023-10-05T21:17:00.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:130 4.1f 4:f85cbb60:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eee9ee0 con 0x556e3ee3afa0 2023-10-05T21:17:00.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:131 4.36 4:6dd5d4dd:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eeec930 con 0x556e3ed7aa40 2023-10-05T21:17:00.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:132 4.24 4:27836a22:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eeef7b0 con 0x7f42bc007030 2023-10-05T21:17:00.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:133 4.26 4:6786272a:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eef2590 con 0x7f42bc007030 2023-10-05T21:17:00.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:134 4.2f 4:f47de62c:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eeef7b0 con 0x556e3ed7aa40 2023-10-05T21:17:00.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 21 ==== osd_op_reply(124 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.0 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 22 ==== osd_op_reply(125 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.1 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 32 ==== osd_op_reply(127 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 23 ==== osd_op_reply(126 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.2 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 33 ==== osd_op_reply(129 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 34 ==== osd_op_reply(132 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 35 ==== osd_op_reply(133 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 34 ==== osd_op_reply(128 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.4 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee3afa0 2023-10-05T21:17:00.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(131 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.7 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.195+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 35 ==== osd_op_reply(130 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee3afa0 2023-10-05T21:17:00.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.196+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== osd_op_reply(134 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.10 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.196+0000 7f42d57c1680 20 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): returning, count=0, is_truncated=0 2023-10-05T21:17:00.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.196+0000 7f42d57c1680 20 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): returning, last_entry NOT SET 2023-10-05T21:17:00.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.196+0000 7f42d57c1680 10 int RGWRados::Bucket::List::list_objects_ordered(const DoutPrefixProvider*, int64_t, std::vector*, std::map, bool>*, bool*, optional_yield): end of outer loop, truncated=0, count=0, attempt=1 2023-10-05T21:17:00.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.196+0000 7f42d57c1680 10 int RGWRados::Bucket::List::list_objects_ordered(const DoutPrefixProvider*, int64_t, std::vector*, std::map, bool>*, bool*, optional_yield): exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-10-05T21:17:00.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.196+0000 7f42d57c1680 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6])"; uploads.size()=0; is_truncated=0 2023-10-05T21:17:00.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.196+0000 7f42d57c1680 10 lifecycle: RGWRados::convert_old_bucket_info(): bucket=:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6]) 2023-10-05T21:17:00.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.196+0000 7f42d57c1680 20 lifecycle: get_system_obj_state: rctx=0x7ffe749887a8 obj=default.rgw.meta:root:myfoo state=0x556e3ecb7240 s->prefetch_data=0 2023-10-05T21:17:00.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.196+0000 7f42d57c1680 10 lifecycle: cache get: name=default.rgw.meta+root+myfoo : miss 2023-10-05T21:17:00.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.196+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eeef7b0 con 0x7f42b4016730 2023-10-05T21:17:00.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.196+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 24 ==== osd_op_reply(135 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv39 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.196+0000 7f42d57c1680 10 lifecycle: cache put: name=default.rgw.meta+root+myfoo info.flags=0x16 2023-10-05T21:17:00.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.196+0000 7f42d57c1680 10 lifecycle: adding default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:17:00.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.196+0000 7f42d57c1680 10 lifecycle: updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:17:00.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.196+0000 7f42d57c1680 20 lifecycle: get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:17:00.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.196+0000 7f42d57c1680 20 lifecycle: Read xattr: user.rgw.idtag 2023-10-05T21:17:00.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.196+0000 7f42d57c1680 10 lifecycle: cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x16) 2023-10-05T21:17:00.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.196+0000 7f42d57c1680 20 lifecycle: rados->read ofs=0 len=0 2023-10-05T21:17:00.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.196+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eedd1f0 con 0x7f42b4016730 2023-10-05T21:17:00.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.196+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 25 ==== osd_op_reply(136 myfoo [call,call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv39 ondisk = 0) v8 ==== 275+0+288 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.196+0000 7f42d57c1680 20 lifecycle: rados_obj.operate() r=0 bl.length=165 2023-10-05T21:17:00.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.196+0000 7f42d57c1680 10 lifecycle: cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2023-10-05T21:17:00.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.196+0000 7f42d57c1680 10 lifecycle: moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:17:00.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.196+0000 7f42d57c1680 10 lifecycle: updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:17:00.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.196+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:137 8.0 8:04666065:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eee7210 con 0x556e3ee3afa0 2023-10-05T21:17:00.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.197+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 36 ==== osd_op_reply(137 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6 [delete,create,call,call,writefull 0~352,setxattr (123)] v31'2 uv2 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee3afa0 2023-10-05T21:17:00.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.197+0000 7f42d57c1680 10 lifecycle: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6 info.flags=0x17 2023-10-05T21:17:00.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.197+0000 7f42d57c1680 10 lifecycle: moving default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6 to cache LRU end 2023-10-05T21:17:00.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.197+0000 7f42d57c1680 10 lifecycle: updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:17:00.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.197+0000 7f42d57c1680 10 lifecycle: distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6, ofs0, ns] 2023-10-05T21:17:00.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.197+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:138 7.15 7:a93a5511:::notify.2:head [notify cookie 93931990504304 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eedd1f0 con 0x556e3ee3afa0 2023-10-05T21:17:00.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.197+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 37 ==== watch-notify(notify (1) cookie 93931989910384 notify 133143986197 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x556e3ee2d740 con 0x556e3ee3afa0 2023-10-05T21:17:00.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.197+0000 7f42c1ffb700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986197 cookie 93931989910384 notifier 4754 bl.length()=725 2023-10-05T21:17:00.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.197+0000 7f42c1ffb700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6 info.flags=0x17 2023-10-05T21:17:00.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.197+0000 7f42c1ffb700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6 to cache LRU end 2023-10-05T21:17:00.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.197+0000 7f42c1ffb700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T21:17:00.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.197+0000 7f42c1ffb700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:139 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f4218003480 con 0x556e3ee3afa0 2023-10-05T21:17:00.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.198+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 38 ==== osd_op_reply(138 notify.2 [notify cookie 93931990504304 out=8b] v0'0 uv264 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee3afa0 2023-10-05T21:17:00.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.198+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 39 ==== osd_op_reply(139 notify.2 [notify-ack] v0'0 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee3afa0 2023-10-05T21:17:00.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.198+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 40 ==== watch-notify(notify_complete (2) cookie 93931990504304 notify 133143986197 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x556e3ee2d2f0 con 0x556e3ee3afa0 2023-10-05T21:17:00.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.198+0000 7f42d57c1680 20 lifecycle: handle_bi_update(): bucket=:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6]): orig_sources= new_sources= 2023-10-05T21:17:00.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.198+0000 7f42d57c1680 20 lifecycle: handle_bi_update(): bucket=:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6]): potential sources added=[] removed=[] 2023-10-05T21:17:00.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.198+0000 7f42d57c1680 20 lifecycle: handle_bi_update(): bucket=:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6]): orig_dests= new_dests= 2023-10-05T21:17:00.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.198+0000 7f42d57c1680 20 lifecycle: handle_bi_update(): bucket=:myfoo[193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6]): potential dests added=[] removed=[] 2023-10-05T21:17:00.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.198+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:33 6.e 6:71a6e5bc:lc::lc.2:head [call lock.lock in=65b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eedd1f0 con 0x556e3ee67330 2023-10-05T21:17:00.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.199+0000 7f42c8899700 1 -- 172.21.15.153:0/1524563433 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(33 lc.2 [call] v31'31 uv31 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee67330 2023-10-05T21:17:00.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.199+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:34 6.e 6:71a6e5bc:lc::lc.2:head [call rgw.lc_rm_entry in=92b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eedd1f0 con 0x556e3ee67330 2023-10-05T21:17:00.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.200+0000 7f42c8899700 1 -- 172.21.15.153:0/1524563433 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(34 lc.2 [call] v31'32 uv32 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee67330 2023-10-05T21:17:00.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.200+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:35 6.e 6:71a6e5bc:lc::lc.2:head [call lock.unlock in=49b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eedd1f0 con 0x556e3ee67330 2023-10-05T21:17:00.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.201+0000 7f42c8899700 1 -- 172.21.15.153:0/1524563433 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(35 lc.2 [call] v31'33 uv33 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee67330 2023-10-05T21:17:00.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.201+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:140 4.13 4:c9e23c1c:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eedd1f0 con 0x7f42b4016730 2023-10-05T21:17:00.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.201+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:141 4.18 4:1958e93d:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eee7210 con 0x7f42b4016730 2023-10-05T21:17:00.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.201+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:142 4.1 4:804ec093:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eedb100 con 0x7f42b4016730 2023-10-05T21:17:00.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.201+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:143 4.4 4:20291982:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eef3b70 con 0x7f42bc007030 2023-10-05T21:17:00.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.201+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:144 4.29 4:97e81541:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eedd1f0 con 0x556e3ee3afa0 2023-10-05T21:17:00.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.201+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:145 4.2d 4:b47b65ae:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eee15d0 con 0x7f42bc007030 2023-10-05T21:17:00.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.201+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:146 4.1f 4:f85cbb60:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eee7210 con 0x556e3ee3afa0 2023-10-05T21:17:00.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.201+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:147 4.36 4:6dd5d4dd:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eedb100 con 0x556e3ed7aa40 2023-10-05T21:17:00.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.201+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:148 4.24 4:27836a22:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eef3b70 con 0x7f42bc007030 2023-10-05T21:17:00.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.201+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:149 4.26 4:6786272a:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eedd1f0 con 0x7f42bc007030 2023-10-05T21:17:00.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.201+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:150 4.2f 4:f47de62c:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eee7210 con 0x556e3ed7aa40 2023-10-05T21:17:00.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.201+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 26 ==== osd_op_reply(140 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.0 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.201+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 27 ==== osd_op_reply(141 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.1 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.201+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 28 ==== osd_op_reply(142 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.2 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.201+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 41 ==== osd_op_reply(144 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.4 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee3afa0 2023-10-05T21:17:00.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.201+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 36 ==== osd_op_reply(143 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.201+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 42 ==== osd_op_reply(146 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee3afa0 2023-10-05T21:17:00.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.201+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 37 ==== osd_op_reply(145 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.201+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 38 ==== osd_op_reply(148 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.201+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 39 ==== osd_op_reply(149 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.201+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 42 ==== osd_op_reply(147 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.7 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.201+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 43 ==== osd_op_reply(150 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.10 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.201+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:151 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eee15d0 con 0x7f42b4016730 2023-10-05T21:17:00.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.202+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 29 ==== osd_op_reply(151 foo.buckets [call] v31'44 uv44 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.202+0000 7f42d57c1680 20 get_system_obj_state: rctx=0x7ffe74988208 obj=default.rgw.meta:root:myfoo state=0x556e3ecb7240 s->prefetch_data=0 2023-10-05T21:17:00.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.202+0000 7f42d57c1680 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x16, cached=0x13) 2023-10-05T21:17:00.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.202+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:152 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eedd1f0 con 0x7f42b4016730 2023-10-05T21:17:00.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.202+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 30 ==== osd_op_reply(152 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv39 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.202+0000 7f42d57c1680 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x16 2023-10-05T21:17:00.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.202+0000 7f42d57c1680 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T21:17:00.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.202+0000 7f42d57c1680 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T21:17:00.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.202+0000 7f42d57c1680 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T21:17:00.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.202+0000 7f42d57c1680 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x17) 2023-10-05T21:17:00.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.202+0000 7f42d57c1680 10 removing default.rgw.meta+root+myfoo from cache 2023-10-05T21:17:00.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.202+0000 7f42d57c1680 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2023-10-05T21:17:00.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.203+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:153 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93931990529488 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eee7210 con 0x7f42bc007030 2023-10-05T21:17:00.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.203+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 40 ==== watch-notify(notify (1) cookie 93931989922416 notify 133143986218 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x7f42c4066060 con 0x7f42bc007030 2023-10-05T21:17:00.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.203+0000 7f42c1ffb700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986218 cookie 93931989922416 notifier 4754 bl.length()=149 2023-10-05T21:17:00.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.203+0000 7f42c1ffb700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:154 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f4218003460 con 0x7f42bc007030 2023-10-05T21:17:00.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.203+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 41 ==== osd_op_reply(153 notify.6 [notify cookie 93931990529488 out=8b] v0'0 uv264 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.203+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 42 ==== osd_op_reply(154 notify.6 [notify-ack] v0'0 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.203+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 43 ==== watch-notify(notify_complete (2) cookie 93931990529488 notify 133143986218 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f42c4029060 con 0x7f42bc007030 2023-10-05T21:17:00.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.203+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:155 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed6590 con 0x7f42b4016730 2023-10-05T21:17:00.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.204+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 31 ==== osd_op_reply(155 myfoo [call,call,delete] v31'45 uv45 ondisk = 0) v8 ==== 233+0+0 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.204+0000 7f42d57c1680 10 removing default.rgw.meta+root+.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6 from cache 2023-10-05T21:17:00.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.204+0000 7f42d57c1680 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6, ofs0, ns] 2023-10-05T21:17:00.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.204+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:156 7.15 7:a93a5511:::notify.2:head [notify cookie 93931990529488 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eedb0e0 con 0x556e3ee3afa0 2023-10-05T21:17:00.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.204+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 43 ==== watch-notify(notify (1) cookie 93931989910384 notify 133143986198 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x556e3ee2d2f0 con 0x556e3ee3afa0 2023-10-05T21:17:00.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.204+0000 7f42c27fc700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986198 cookie 93931989910384 notifier 4754 bl.length()=206 2023-10-05T21:17:00.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.204+0000 7f42c27fc700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a8003c50 con 0x556e3ee3afa0 2023-10-05T21:17:00.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.204+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 44 ==== osd_op_reply(156 notify.2 [notify cookie 93931990529488 out=8b] v0'0 uv264 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee3afa0 2023-10-05T21:17:00.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.204+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 45 ==== osd_op_reply(157 notify.2 [notify-ack] v0'0 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee3afa0 2023-10-05T21:17:00.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.204+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 46 ==== watch-notify(notify_complete (2) cookie 93931990529488 notify 133143986198 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f42b8001e10 con 0x556e3ee3afa0 2023-10-05T21:17:00.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.205+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:158 8.0 8:04666065:root::.bucket.meta.myfoo%3a193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed5370 con 0x556e3ee3afa0 2023-10-05T21:17:00.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.205+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 47 ==== osd_op_reply(158 .bucket.meta.myfoo:193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6 [call,call,delete] v31'3 uv3 ondisk = 0) v8 ==== 290+0+0 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee3afa0 2023-10-05T21:17:00.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.205+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:159 4.13 4:c9e23c1c:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed5370 con 0x7f42b4016730 2023-10-05T21:17:00.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.205+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:160 4.18 4:1958e93d:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed5e90 con 0x7f42b4016730 2023-10-05T21:17:00.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.205+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:161 4.1 4:804ec093:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eeda5c0 con 0x7f42b4016730 2023-10-05T21:17:00.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.205+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:162 4.4 4:20291982:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed5370 con 0x7f42bc007030 2023-10-05T21:17:00.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.205+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:163 4.29 4:97e81541:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed33e0 con 0x556e3ee3afa0 2023-10-05T21:17:00.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.205+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:164 4.2d 4:b47b65ae:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eeda5c0 con 0x7f42bc007030 2023-10-05T21:17:00.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.205+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:165 4.1f 4:f85cbb60:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed5370 con 0x556e3ee3afa0 2023-10-05T21:17:00.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.205+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:166 4.36 4:6dd5d4dd:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eef0310 con 0x556e3ed7aa40 2023-10-05T21:17:00.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.206+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:167 4.24 4:27836a22:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eeda5c0 con 0x7f42bc007030 2023-10-05T21:17:00.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.206+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:168 4.26 4:6786272a:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eef1110 con 0x7f42bc007030 2023-10-05T21:17:00.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.206+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:169 4.2f 4:f47de62c:::.dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eef0310 con 0x556e3ed7aa40 2023-10-05T21:17:00.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.207+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 32 ==== osd_op_reply(160 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.1 [delete] v31'14 uv14 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.207+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 48 ==== osd_op_reply(163 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.4 [delete] v31'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee3afa0 2023-10-05T21:17:00.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.207+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 44 ==== osd_op_reply(166 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.7 [delete] v31'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.207+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 44 ==== osd_op_reply(167 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.8 [delete] v31'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.207+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 45 ==== osd_op_reply(164 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.5 [delete] v31'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.207+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 46 ==== osd_op_reply(168 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.9 [delete] v31'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.207+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 47 ==== osd_op_reply(162 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.3 [delete] v31'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.207+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 45 ==== osd_op_reply(169 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.10 [delete] v31'4 uv4 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.207+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 33 ==== osd_op_reply(159 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.0 [delete] v31'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.207+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 49 ==== osd_op_reply(165 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.6 [delete] v31'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee3afa0 2023-10-05T21:17:00.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.207+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 34 ==== osd_op_reply(161 .dir.193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6.2 [delete] v31'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.207+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:170 6.d 6:b27a2da6:::pubsub..bucket.myfoo%2f193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed33e0 con 0x556e3ed7aa40 2023-10-05T21:17:00.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.208+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 46 ==== osd_op_reply(170 pubsub..bucket.myfoo/193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6 [getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 250+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.208+0000 7f42d57c1680 10 removing default.rgw.log++pubsub..bucket.myfoo/193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6 from cache 2023-10-05T21:17:00.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.208+0000 7f42d57c1680 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo/193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6, ofs0, ns] 2023-10-05T21:17:00.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.208+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:171 7.0 7:05bf5b68:::notify.1:head [notify cookie 93931990524112 in=215b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eeda5c0 con 0x556e3ed7aa40 2023-10-05T21:17:00.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.208+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 47 ==== watch-notify(notify (1) cookie 93931989905408 notify 133143986203 ret 0) v3 ==== 245+0+0 (crc 0 0 0) 0x7f42c4029060 con 0x556e3ed7aa40 2023-10-05T21:17:00.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.208+0000 7f42c1ffb700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986203 cookie 93931989905408 notifier 4754 bl.length()=203 2023-10-05T21:17:00.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.208+0000 7f42c1ffb700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f4218003460 con 0x556e3ed7aa40 2023-10-05T21:17:00.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.208+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 48 ==== osd_op_reply(171 notify.1 [notify cookie 93931990524112 out=8b] v0'0 uv264 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.208+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 49 ==== osd_op_reply(172 notify.1 [notify-ack] v0'0 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.208+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 50 ==== watch-notify(notify_complete (2) cookie 93931990524112 notify 133143986203 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f42c402d040 con 0x556e3ed7aa40 2023-10-05T21:17:00.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.208+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:173 6.d 6:b27a2da6:::pubsub..bucket.myfoo%2f193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed5370 con 0x556e3ed7aa40 2023-10-05T21:17:00.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.209+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 51 ==== osd_op_reply(173 pubsub..bucket.myfoo/193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.6 [delete] v31'41 uv32 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.209+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:174 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed5370 con 0x7f42b4016730 2023-10-05T21:17:00.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.210+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 35 ==== osd_op_reply(174 foo.buckets [call] v31'46 uv46 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f42bc029040 con 0x7f42b4016730 2023-10-05T21:17:00.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.210+0000 7f42d57c1680 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2023-10-05T21:17:00.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.210+0000 7f42d57c1680 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2023-10-05T21:17:00.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.210+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:175 7.e 7:7759931f:::notify.3:head [notify cookie 93931990529376 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed5370 con 0x7f42b4016730 2023-10-05T21:17:00.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.210+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 36 ==== watch-notify(notify (1) cookie 93931989915024 notify 133143986196 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x7f42bc06a0a0 con 0x7f42b4016730 2023-10-05T21:17:00.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.210+0000 7f42c27fc700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986196 cookie 93931989915024 notifier 4754 bl.length()=170 2023-10-05T21:17:00.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.210+0000 7f42c27fc700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:176 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a8003c50 con 0x7f42b4016730 2023-10-05T21:17:00.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.210+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 37 ==== osd_op_reply(175 notify.3 [notify cookie 93931990529376 out=8b] v0'0 uv264 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f42bc072040 con 0x7f42b4016730 2023-10-05T21:17:00.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.210+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 38 ==== osd_op_reply(176 notify.3 [notify-ack] v0'0 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42bc072040 con 0x7f42b4016730 2023-10-05T21:17:00.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.210+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 39 ==== watch-notify(notify_complete (2) cookie 93931990529376 notify 133143986196 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x556e3ee5d040 con 0x7f42b4016730 2023-10-05T21:17:00.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.210+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:177 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed5370 con 0x7f42bc007030 2023-10-05T21:17:00.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.211+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 48 ==== osd_op_reply(177 9te6NH5mcdcq0Tc5i8i1 [delete] v31'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.211+0000 7f42d57c1680 10 removing email index: foo@foo.com 2023-10-05T21:17:00.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.211+0000 7f42d57c1680 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2023-10-05T21:17:00.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.211+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:178 7.e 7:7759931f:::notify.3:head [notify cookie 93931990529376 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed5370 con 0x7f42b4016730 2023-10-05T21:17:00.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.211+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 40 ==== watch-notify(notify (1) cookie 93931989915024 notify 133143986197 ret 0) v3 ==== 204+0+0 (crc 0 0 0) 0x556e3ee5d040 con 0x7f42b4016730 2023-10-05T21:17:00.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.211+0000 7f42c1ffb700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986197 cookie 93931989915024 notifier 4754 bl.length()=162 2023-10-05T21:17:00.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.211+0000 7f42c1ffb700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:179 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f4218003460 con 0x7f42b4016730 2023-10-05T21:17:00.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.211+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 41 ==== osd_op_reply(178 notify.3 [notify cookie 93931990529376 out=8b] v0'0 uv264 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f42bc072040 con 0x7f42b4016730 2023-10-05T21:17:00.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.212+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 42 ==== osd_op_reply(179 notify.3 [notify-ack] v0'0 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42bc072040 con 0x7f42b4016730 2023-10-05T21:17:00.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.212+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 43 ==== watch-notify(notify_complete (2) cookie 93931990529376 notify 133143986197 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x556e3ee5cbf0 con 0x7f42b4016730 2023-10-05T21:17:00.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.212+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:180 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed5370 con 0x556e3ed7aa40 2023-10-05T21:17:00.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.212+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 52 ==== osd_op_reply(180 foo@foo.com [delete] v31'2 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.212+0000 7f42d57c1680 10 removing user buckets index 2023-10-05T21:17:00.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.212+0000 7f42d57c1680 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2023-10-05T21:17:00.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.212+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:181 7.3 7:c609908c:::notify.5:head [notify cookie 93931990496096 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed5370 con 0x7f42bc007030 2023-10-05T21:17:00.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.213+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 49 ==== watch-notify(notify (1) cookie 93931989919456 notify 133143986219 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x7f42c402d040 con 0x7f42bc007030 2023-10-05T21:17:00.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.213+0000 7f42c27fc700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986219 cookie 93931989919456 notifier 4754 bl.length()=160 2023-10-05T21:17:00.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.213+0000 7f42c27fc700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:182 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a8003c50 con 0x7f42bc007030 2023-10-05T21:17:00.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.213+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 50 ==== osd_op_reply(181 notify.5 [notify cookie 93931990496096 out=8b] v0'0 uv264 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.213+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 51 ==== osd_op_reply(182 notify.5 [notify-ack] v0'0 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.213+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 52 ==== watch-notify(notify_complete (2) cookie 93931990496096 notify 133143986219 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f42c4060580 con 0x7f42bc007030 2023-10-05T21:17:00.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.213+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:183 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed5370 con 0x7f42b4016730 2023-10-05T21:17:00.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.214+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 44 ==== osd_op_reply(183 foo.buckets [delete] v31'47 uv47 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f42bc072040 con 0x7f42b4016730 2023-10-05T21:17:00.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.214+0000 7f42d57c1680 10 removing user index: foo 2023-10-05T21:17:00.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.214+0000 7f42d57c1680 10 removing default.rgw.meta+users.uid+foo from cache 2023-10-05T21:17:00.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.214+0000 7f42d57c1680 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T21:17:00.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.214+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:184 7.d 7:b4812045:::notify.4:head [notify cookie 93931990496096 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed5370 con 0x556e3ed7aa40 2023-10-05T21:17:00.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.214+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 53 ==== watch-notify(notify (1) cookie 93931989912768 notify 133143986204 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x7f42c4060580 con 0x556e3ed7aa40 2023-10-05T21:17:00.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.214+0000 7f42c1ffb700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986204 cookie 93931989912768 notifier 4754 bl.length()=152 2023-10-05T21:17:00.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.214+0000 7f42c1ffb700 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:185 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f4218003460 con 0x556e3ed7aa40 2023-10-05T21:17:00.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.214+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 54 ==== osd_op_reply(184 notify.4 [notify cookie 93931990496096 out=8b] v0'0 uv264 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.214+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 55 ==== osd_op_reply(185 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.214+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 56 ==== watch-notify(notify_complete (2) cookie 93931990496096 notify 133143986204 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f42c40607b0 con 0x556e3ed7aa40 2023-10-05T21:17:00.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.214+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:186 8.18 8:1e6ca5ed:users.uid::foo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed5370 con 0x556e3ed7aa40 2023-10-05T21:17:00.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.215+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 57 ==== osd_op_reply(186 foo [call,delete] v31'20 uv20 ondisk = 0) v8 ==== 189+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.215+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:187 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93931989903120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed5370 con 0x7f42b4016730 2023-10-05T21:17:00.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.216+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 45 ==== osd_op_reply(187 notify.0 [watch unwatch cookie 93931989903120] v31'266 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42bc072040 con 0x7f42b4016730 2023-10-05T21:17:00.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.216+0000 7f42d57c1680 20 remove_watcher() i=0 2023-10-05T21:17:00.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.216+0000 7f42d57c1680 2 removed watcher, disabling cache 2023-10-05T21:17:00.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.216+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:188 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93931989905408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed5370 con 0x556e3ed7aa40 2023-10-05T21:17:00.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.217+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 58 ==== osd_op_reply(188 notify.1 [watch unwatch cookie 93931989905408] v31'266 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.217+0000 7f42d57c1680 20 remove_watcher() i=1 2023-10-05T21:17:00.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.217+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:189 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93931989910384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed5370 con 0x556e3ee3afa0 2023-10-05T21:17:00.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.218+0000 7f42c8899700 1 -- 172.21.15.153:0/3904563633 <== osd.3 v2:172.21.15.153:6800/140455 50 ==== osd_op_reply(189 notify.2 [watch unwatch cookie 93931989910384] v31'266 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42b4060040 con 0x556e3ee3afa0 2023-10-05T21:17:00.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.218+0000 7f42d57c1680 20 remove_watcher() i=2 2023-10-05T21:17:00.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.218+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:190 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93931989915024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed5370 con 0x7f42b4016730 2023-10-05T21:17:00.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.218+0000 7f42c3fff700 1 -- 172.21.15.153:0/3904563633 <== osd.2 v2:172.21.15.153:6807/140454 46 ==== osd_op_reply(190 notify.3 [watch unwatch cookie 93931989915024] v31'266 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42bc072040 con 0x7f42b4016730 2023-10-05T21:17:00.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.218+0000 7f42d57c1680 20 remove_watcher() i=3 2023-10-05T21:17:00.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.218+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:191 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93931989912768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed5370 con 0x556e3ed7aa40 2023-10-05T21:17:00.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.219+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 59 ==== osd_op_reply(191 notify.4 [watch unwatch cookie 93931989912768] v31'266 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.220+0000 7f42d57c1680 20 remove_watcher() i=4 2023-10-05T21:17:00.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.220+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:192 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93931989919456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed5370 con 0x7f42bc007030 2023-10-05T21:17:00.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.220+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 53 ==== osd_op_reply(192 notify.5 [watch unwatch cookie 93931989919456] v31'266 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.220+0000 7f42d57c1680 20 remove_watcher() i=5 2023-10-05T21:17:00.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.220+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:193 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93931989922416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed5370 con 0x7f42bc007030 2023-10-05T21:17:00.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.221+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 54 ==== osd_op_reply(193 notify.6 [watch unwatch cookie 93931989922416] v31'266 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.221+0000 7f42d57c1680 20 remove_watcher() i=6 2023-10-05T21:17:00.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.221+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:194 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93931989926368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3eed5370 con 0x7f42bc007030 2023-10-05T21:17:00.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.222+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.0 v2:172.21.15.111:6800/111394 55 ==== osd_op_reply(194 notify.7 [watch unwatch cookie 93931989926368] v31'266 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x7f42bc007030 2023-10-05T21:17:00.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.222+0000 7f42d57c1680 20 remove_watcher() i=7 2023-10-05T21:17:00.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.222+0000 7f4299fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:17:00.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.222+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:195 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93931989924208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556e3ee95330 con 0x556e3ed7aa40 2023-10-05T21:17:00.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.223+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 <== osd.1 v2:172.21.15.153:6816/140456 60 ==== osd_op_reply(195 data_loggenerations_metadata [watch unwatch cookie 93931989924208] v31'257 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f42c400a570 con 0x556e3ed7aa40 2023-10-05T21:17:00.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.223+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f42bc007030 msgr2=0x7f42bc01d430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.223+0000 7f42d57c1680 1 --2- 172.21.15.153:0/3904563633 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f42bc007030 0x7f42bc01d430 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.223+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x556e3ed7aa40 msgr2=0x556e3ee38b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.223+0000 7f42d57c1680 1 --2- 172.21.15.153:0/3904563633 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x556e3ed7aa40 0x556e3ee38b30 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.223+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f42b4016730 msgr2=0x7f42b4046130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.223+0000 7f42d57c1680 1 --2- 172.21.15.153:0/3904563633 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f42b4016730 0x7f42b4046130 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.223+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x556e3ee3afa0 msgr2=0x556e3ee3d380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.223+0000 7f42d57c1680 1 --2- 172.21.15.153:0/3904563633 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x556e3ee3afa0 0x556e3ee3d380 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.223+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f42ac034130 msgr2=0x7f42ac0365e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.223+0000 7f42d57c1680 1 --2- 172.21.15.153:0/3904563633 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f42ac034130 0x7f42ac0365e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f42bc005a90 tx=0x7f42bc014000 comp rx=0 tx=0).stop 2023-10-05T21:17:00.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.223+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556e3ed796b0 msgr2=0x556e3ee2cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.223+0000 7f42c909a700 1 -- 172.21.15.153:0/3904563633 reap_dead start 2023-10-05T21:17:00.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.223+0000 7f42d57c1680 1 --2- 172.21.15.153:0/3904563633 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556e3ed796b0 0x556e3ee2cdb0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f42b4010000 tx=0x7f42b4014000 comp rx=0 tx=0).stop 2023-10-05T21:17:00.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.223+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 shutdown_connections 2023-10-05T21:17:00.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.223+0000 7f42d57c1680 1 --2- 172.21.15.153:0/3904563633 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556e3ed796b0 0x556e3ee2cdb0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.223+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 >> 172.21.15.153:0/3904563633 conn(0x556e3edffcb0 msgr2=0x556e3ee1fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.223+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 shutdown_connections 2023-10-05T21:17:00.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.224+0000 7f42d57c1680 1 -- 172.21.15.153:0/3904563633 wait complete. 2023-10-05T21:17:00.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.224+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x556e3ee6ab80 msgr2=0x556e3ee6cfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.224+0000 7f42d57c1680 1 --2- 172.21.15.153:0/1524563433 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x556e3ee6ab80 0x556e3ee6cfa0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.224+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x556e3ee67330 msgr2=0x556e3ee697e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.224+0000 7f42d57c1680 1 --2- 172.21.15.153:0/1524563433 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x556e3ee67330 0x556e3ee697e0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.224+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x556e3ee728c0 msgr2=0x556e3ee74ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.224+0000 7f42d57c1680 1 --2- 172.21.15.153:0/1524563433 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x556e3ee728c0 0x556e3ee74ca0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.224+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x556e3ee64d70 msgr2=0x556e3ee70e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.224+0000 7f42d57c1680 1 --2- 172.21.15.153:0/1524563433 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x556e3ee64d70 0x556e3ee70e40 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.224+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4208034140 msgr2=0x7f42080365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.224+0000 7f42d57c1680 1 --2- 172.21.15.153:0/1524563433 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4208034140 0x7f42080365f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x556e3ee47e00 tx=0x7f42c4037450 comp rx=0 tx=0).stop 2023-10-05T21:17:00.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.224+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556e3ee55760 msgr2=0x556e3ee5c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.224+0000 7f42d57c1680 1 --2- 172.21.15.153:0/1524563433 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x556e3ee55760 0x556e3ee5c4b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x556e3ee50fd0 tx=0x7f42bc034000 comp rx=0 tx=0).stop 2023-10-05T21:17:00.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.224+0000 7f42c8899700 1 -- 172.21.15.153:0/1524563433 reap_dead start 2023-10-05T21:17:00.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.224+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 shutdown_connections 2023-10-05T21:17:00.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.224+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 >> 172.21.15.153:0/1524563433 conn(0x556e3ee51a60 msgr2=0x556e3ee4fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.224+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 shutdown_connections 2023-10-05T21:17:00.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.224+0000 7f42d57c1680 1 -- 172.21.15.153:0/1524563433 wait complete. 2023-10-05T21:17:00.333 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2023-10-05T21:17:00.333 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2023-10-05T21:17:00.334 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2023-10-05T21:17:00.380 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:17:00.380 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:17:00.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.379+0000 7fa52e56e680 1 Processor -- start 2023-10-05T21:17:00.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.379+0000 7fa52e56e680 1 -- start start 2023-10-05T21:17:00.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.379+0000 7fa52e56e680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5576d845ca30 0x5576d845ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.379+0000 7fa52e56e680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5576d83ab990 con 0x5576d845d380 2023-10-05T21:17:00.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.379+0000 7fa52e56e680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x5576d836bdb0 con 0x5576d845ca30 2023-10-05T21:17:00.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.380+0000 7fa521646700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5576d845ca30 0x5576d845ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.380+0000 7fa520e45700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x5576d845d380 0x5576d845dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:57244/0 (socket says 172.21.15.153:57244) 2023-10-05T21:17:00.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.380+0000 7fa520e45700 1 -- 172.21.15.153:0/369899386 learned_addr learned my addr 172.21.15.153:0/369899386 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:17:00.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.380+0000 7fa513fff700 1 -- 172.21.15.153:0/369899386 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1332450692 0 0) 0x5576d83ab990 con 0x5576d845d380 2023-10-05T21:17:00.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.380+0000 7fa513fff700 1 -- 172.21.15.153:0/369899386 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa50c001e10 con 0x5576d845d380 2023-10-05T21:17:00.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.380+0000 7fa521646700 1 -- 172.21.15.153:0/369899386 >> v1:172.21.15.111:6789/0 conn(0x5576d845d380 legacy=0x5576d845dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.380+0000 7fa521646700 1 -- 172.21.15.153:0/369899386 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576d845e620 con 0x5576d845ca30 2023-10-05T21:17:00.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.380+0000 7fa521646700 1 --2- 172.21.15.153:0/369899386 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d845ca30 0x5576d845ce40 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fa51400a5d0 tx=0x7fa514005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9322c17d5111060 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.380+0000 7fa513fff700 1 -- 172.21.15.153:0/369899386 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa514007610 con 0x5576d845ca30 2023-10-05T21:17:00.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.380+0000 7fa513fff700 1 -- 172.21.15.153:0/369899386 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa514007770 con 0x5576d845ca30 2023-10-05T21:17:00.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.380+0000 7fa513fff700 1 -- 172.21.15.153:0/369899386 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa514007a40 con 0x5576d845ca30 2023-10-05T21:17:00.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.381+0000 7fa52e56e680 1 -- 172.21.15.153:0/369899386 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d845ca30 msgr2=0x5576d845ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.381+0000 7fa52e56e680 1 --2- 172.21.15.153:0/369899386 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d845ca30 0x5576d845ce40 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fa51400a5d0 tx=0x7fa514005a50 comp rx=0 tx=0).stop 2023-10-05T21:17:00.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.381+0000 7fa52e56e680 1 -- 172.21.15.153:0/369899386 shutdown_connections 2023-10-05T21:17:00.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.381+0000 7fa52e56e680 1 --2- 172.21.15.153:0/369899386 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d845ca30 0x5576d845ce40 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.381+0000 7fa52e56e680 1 -- 172.21.15.153:0/369899386 >> 172.21.15.153:0/369899386 conn(0x5576d8458300 msgr2=0x5576d845a710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.381+0000 7fa52e56e680 1 -- 172.21.15.153:0/369899386 shutdown_connections 2023-10-05T21:17:00.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.381+0000 7fa52e56e680 1 -- 172.21.15.153:0/369899386 wait complete. 2023-10-05T21:17:00.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.382+0000 7fa52e56e680 1 Processor -- start 2023-10-05T21:17:00.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.382+0000 7fa52e56e680 1 -- start start 2023-10-05T21:17:00.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.382+0000 7fa52e56e680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d845ca30 0x5576d847cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.382+0000 7fa52e56e680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576d830bea0 con 0x5576d845ca30 2023-10-05T21:17:00.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.382+0000 7fa521646700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d845ca30 0x5576d847cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.382+0000 7fa521646700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d845ca30 0x5576d847cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60608/0 (socket says 172.21.15.153:60608) 2023-10-05T21:17:00.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.382+0000 7fa521646700 1 -- 172.21.15.153:0/4281479896 learned_addr learned my addr 172.21.15.153:0/4281479896 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.382+0000 7fa521646700 1 -- 172.21.15.153:0/4281479896 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa514005cf0 con 0x5576d845ca30 2023-10-05T21:17:00.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.382+0000 7fa521646700 1 --2- 172.21.15.153:0/4281479896 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d845ca30 0x5576d847cbd0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fa514005a90 tx=0x7fa514014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93525a723a191f42 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.383+0000 7fa512ffd700 1 -- 172.21.15.153:0/4281479896 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5140078e0 con 0x5576d845ca30 2023-10-05T21:17:00.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.383+0000 7fa512ffd700 1 -- 172.21.15.153:0/4281479896 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa514007a40 con 0x5576d845ca30 2023-10-05T21:17:00.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.383+0000 7fa512ffd700 1 -- 172.21.15.153:0/4281479896 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa514007bb0 con 0x5576d845ca30 2023-10-05T21:17:00.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.383+0000 7fa52e56e680 1 -- 172.21.15.153:0/4281479896 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d845ca30 msgr2=0x5576d847cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.383+0000 7fa52e56e680 1 --2- 172.21.15.153:0/4281479896 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d845ca30 0x5576d847cbd0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fa514005a90 tx=0x7fa514014000 comp rx=0 tx=0).stop 2023-10-05T21:17:00.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.383+0000 7fa52e56e680 1 -- 172.21.15.153:0/4281479896 shutdown_connections 2023-10-05T21:17:00.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.383+0000 7fa52e56e680 1 --2- 172.21.15.153:0/4281479896 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d845ca30 0x5576d847cbd0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.383+0000 7fa52e56e680 1 -- 172.21.15.153:0/4281479896 >> 172.21.15.153:0/4281479896 conn(0x5576d8458300 msgr2=0x5576d8476f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.383+0000 7fa52e56e680 1 -- 172.21.15.153:0/4281479896 shutdown_connections 2023-10-05T21:17:00.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.383+0000 7fa52e56e680 1 -- 172.21.15.153:0/4281479896 wait complete. 2023-10-05T21:17:00.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.383+0000 7fa52e56e680 1 Processor -- start 2023-10-05T21:17:00.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.383+0000 7fa52e56e680 1 -- start start 2023-10-05T21:17:00.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.384+0000 7fa52e56e680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d845ca30 0x5576d8486ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.384+0000 7fa52e56e680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576d8302c80 con 0x5576d845ca30 2023-10-05T21:17:00.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.384+0000 7fa521646700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d845ca30 0x5576d8486ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.384+0000 7fa521646700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d845ca30 0x5576d8486ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60622/0 (socket says 172.21.15.153:60622) 2023-10-05T21:17:00.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.384+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 learned_addr learned my addr 172.21.15.153:0/475395956 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.384+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576d845e620 con 0x5576d845ca30 2023-10-05T21:17:00.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.384+0000 7fa521646700 1 --2- 172.21.15.153:0/475395956 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d845ca30 0x5576d8486ce0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fa514005a90 tx=0x7fa51401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.384+0000 7fa5117fa700 1 -- 172.21.15.153:0/475395956 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa514026440 con 0x5576d845ca30 2023-10-05T21:17:00.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.384+0000 7fa5117fa700 1 -- 172.21.15.153:0/475395956 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5140265a0 con 0x5576d845ca30 2023-10-05T21:17:00.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.384+0000 7fa5117fa700 1 -- 172.21.15.153:0/475395956 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa514026750 con 0x5576d845ca30 2023-10-05T21:17:00.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.384+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5576d8487220 con 0x5576d845ca30 2023-10-05T21:17:00.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.385+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5576d8487670 con 0x5576d845ca30 2023-10-05T21:17:00.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.385+0000 7fa5117fa700 1 -- 172.21.15.153:0/475395956 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fa5140268b0 con 0x5576d845ca30 2023-10-05T21:17:00.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.386+0000 7fa52e56e680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.386+0000 7fa5117fa700 1 --2- 172.21.15.153:0/475395956 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa504034140 0x7fa5040365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.386+0000 7fa5117fa700 1 -- 172.21.15.153:0/475395956 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fa51404a520 con 0x5576d845ca30 2023-10-05T21:17:00.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.386+0000 7fa520e45700 1 --2- 172.21.15.153:0/475395956 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa504034140 0x7fa5040365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.386+0000 7fa52e56e680 1 --2- 172.21.15.153:0/475395956 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5576d84909b0 0x5576d8492dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.386+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8493560 con 0x5576d84909b0 2023-10-05T21:17:00.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.386+0000 7fa521e47700 1 --2- 172.21.15.153:0/475395956 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5576d84909b0 0x5576d8492dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.386+0000 7fa520e45700 1 --2- 172.21.15.153:0/475395956 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa504034140 0x7fa5040365f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa518004170 tx=0x7fa518001360 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.386+0000 7fa521e47700 1 --2- 172.21.15.153:0/475395956 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5576d84909b0 0x5576d8492dd0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.387+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.387+0000 7fa52e56e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.387+0000 7fa52e56e680 20 realm 2023-10-05T21:17:00.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.387+0000 7fa52e56e680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.387+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8490020 con 0x5576d84909b0 2023-10-05T21:17:00.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.387+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.387+0000 7fa52e56e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.387+0000 7fa52e56e680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:17:00.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.387+0000 7fa52e56e680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.387+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8494060 con 0x5576d84909b0 2023-10-05T21:17:00.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.387+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.387+0000 7fa52e56e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.387+0000 7fa52e56e680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.387+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8494980 con 0x5576d84909b0 2023-10-05T21:17:00.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.387+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.387+0000 7fa52e56e680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:17:00.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.387+0000 7fa52e56e680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.387+0000 7fa52e56e680 1 --2- 172.21.15.153:0/475395956 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5576d8495240 0x5576d8497620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.387+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8497bf0 con 0x5576d8495240 2023-10-05T21:17:00.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.388+0000 7fa521646700 1 --2- 172.21.15.153:0/475395956 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5576d8495240 0x5576d8497620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.388+0000 7fa521646700 1 --2- 172.21.15.153:0/475395956 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5576d8495240 0x5576d8497620 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.388+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa514025cd0 con 0x5576d8495240 2023-10-05T21:17:00.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.388+0000 7fa52e56e680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:17:00.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.388+0000 7fa52e56e680 20 searching for the correct realm 2023-10-05T21:17:00.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.388+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x5576d8495240 2023-10-05T21:17:00.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.388+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa514025cd0 con 0x5576d8495240 2023-10-05T21:17:00.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.388+0000 7fa521646700 1 --2- 172.21.15.153:0/475395956 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fa514007030 0x7fa5140373f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.388+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x7fa514007030 2023-10-05T21:17:00.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.389+0000 7fa520e45700 1 --2- 172.21.15.153:0/475395956 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fa514007030 0x7fa5140373f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.389+0000 7fa520e45700 1 --2- 172.21.15.153:0/475395956 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fa514007030 0x7fa5140373f0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.389+0000 7fa520e45700 1 -- 172.21.15.153:0/475395956 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa518006070 con 0x7fa514007030 2023-10-05T21:17:00.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.389+0000 7fa520e45700 1 --2- 172.21.15.153:0/475395956 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fa51800ebe0 0x7fa51800d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.389+0000 7fa520e45700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x7fa51800ebe0 2023-10-05T21:17:00.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.389+0000 7fa521e47700 1 --2- 172.21.15.153:0/475395956 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fa51800ebe0 0x7fa51800d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.390+0000 7fa521e47700 1 --2- 172.21.15.153:0/475395956 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fa51800ebe0 0x7fa51800d8e0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.390+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa51c00a570 con 0x7fa51800ebe0 2023-10-05T21:17:00.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.390+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x5576d84909b0 2023-10-05T21:17:00.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.390+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.390+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x5576d84909b0 2023-10-05T21:17:00.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.390+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.390+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x7fa51800ebe0 2023-10-05T21:17:00.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.391+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa51c00a570 con 0x7fa51800ebe0 2023-10-05T21:17:00.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.391+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x7fa51800ebe0 2023-10-05T21:17:00.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.391+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa51c00a570 con 0x7fa51800ebe0 2023-10-05T21:17:00.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.391+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x7fa514007030 2023-10-05T21:17:00.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.391+0000 7fa520e45700 1 -- 172.21.15.153:0/475395956 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa518006070 con 0x7fa514007030 2023-10-05T21:17:00.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.391+0000 7fa520e45700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x5576d8495240 2023-10-05T21:17:00.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.391+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa514025cd0 con 0x5576d8495240 2023-10-05T21:17:00.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.391+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x5576d84909b0 2023-10-05T21:17:00.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.392+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.392+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x7fa51800ebe0 2023-10-05T21:17:00.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.392+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa51c00a570 con 0x7fa51800ebe0 2023-10-05T21:17:00.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.392+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x5576d84909b0 2023-10-05T21:17:00.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.392+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.392+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x7fa514007030 2023-10-05T21:17:00.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.392+0000 7fa520e45700 1 -- 172.21.15.153:0/475395956 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa518006070 con 0x7fa514007030 2023-10-05T21:17:00.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.392+0000 7fa520e45700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x5576d8495240 2023-10-05T21:17:00.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.392+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa514025cd0 con 0x5576d8495240 2023-10-05T21:17:00.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.393+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x5576d8495240 2023-10-05T21:17:00.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.393+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa514025cd0 con 0x5576d8495240 2023-10-05T21:17:00.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.393+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x7fa51800ebe0 2023-10-05T21:17:00.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.393+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa51c00a570 con 0x7fa51800ebe0 2023-10-05T21:17:00.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.393+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x5576d8495240 2023-10-05T21:17:00.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.393+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa514025cd0 con 0x5576d8495240 2023-10-05T21:17:00.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.393+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x5576d8495240 2023-10-05T21:17:00.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.393+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa514025cd0 con 0x5576d8495240 2023-10-05T21:17:00.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.393+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x5576d84909b0 2023-10-05T21:17:00.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.394+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.394+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x5576d84909b0 2023-10-05T21:17:00.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.394+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.394+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x7fa51800ebe0 2023-10-05T21:17:00.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.394+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa51c00a570 con 0x7fa51800ebe0 2023-10-05T21:17:00.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.394+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x5576d8495240 2023-10-05T21:17:00.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.394+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa514025cd0 con 0x5576d8495240 2023-10-05T21:17:00.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.394+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x7fa514007030 2023-10-05T21:17:00.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.395+0000 7fa520e45700 1 -- 172.21.15.153:0/475395956 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa518006070 con 0x7fa514007030 2023-10-05T21:17:00.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.395+0000 7fa520e45700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x5576d84909b0 2023-10-05T21:17:00.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.395+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.395+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x7fa51800ebe0 2023-10-05T21:17:00.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.395+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa51c00a570 con 0x7fa51800ebe0 2023-10-05T21:17:00.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.395+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x5576d8495240 2023-10-05T21:17:00.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.395+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa514025cd0 con 0x5576d8495240 2023-10-05T21:17:00.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.395+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x7fa51800ebe0 2023-10-05T21:17:00.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.396+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa51c00a570 con 0x7fa51800ebe0 2023-10-05T21:17:00.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.396+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x7fa514007030 2023-10-05T21:17:00.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.396+0000 7fa520e45700 1 -- 172.21.15.153:0/475395956 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa518006070 con 0x7fa514007030 2023-10-05T21:17:00.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.396+0000 7fa520e45700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x5576d8495240 2023-10-05T21:17:00.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.396+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa514025cd0 con 0x5576d8495240 2023-10-05T21:17:00.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.396+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x7fa51800ebe0 2023-10-05T21:17:00.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.396+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa51c00a570 con 0x7fa51800ebe0 2023-10-05T21:17:00.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.396+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x5576d84909b0 2023-10-05T21:17:00.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.397+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.397+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499510 con 0x7fa514007030 2023-10-05T21:17:00.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.397+0000 7fa520e45700 1 -- 172.21.15.153:0/475395956 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa518006070 con 0x7fa514007030 2023-10-05T21:17:00.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.397+0000 7fa52e56e680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:17:00.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.397+0000 7fa52e56e680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:17:00.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.397+0000 7fa52e56e680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:17:00.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.397+0000 7fa52e56e680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:17:00.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.397+0000 7fa52e56e680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.397+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498730 con 0x5576d84909b0 2023-10-05T21:17:00.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.397+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.397+0000 7fa52e56e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.397+0000 7fa52e56e680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.397+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498bc0 con 0x5576d84909b0 2023-10-05T21:17:00.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.397+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.397+0000 7fa52e56e680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:17:00.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.397+0000 7fa52e56e680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.397+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498ff0 con 0x5576d84909b0 2023-10-05T21:17:00.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.398+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.398+0000 7fa52e56e680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:17:00.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.398+0000 7fa52e56e680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.398+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8499db0 con 0x5576d8495240 2023-10-05T21:17:00.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.398+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fa514025cd0 con 0x5576d8495240 2023-10-05T21:17:00.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.398+0000 7fa52e56e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.398+0000 7fa52e56e680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.398+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d849a160 con 0x5576d84909b0 2023-10-05T21:17:00.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.398+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.398+0000 7fa52e56e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.398+0000 7fa52e56e680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.398+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d849a160 con 0x5576d84909b0 2023-10-05T21:17:00.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.398+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.398+0000 7fa52e56e680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:17:00.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.398+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d849b170 con 0x5576d8495240 2023-10-05T21:17:00.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.399+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa514025cd0 con 0x5576d8495240 2023-10-05T21:17:00.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.399+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d849b170 con 0x7fa514007030 2023-10-05T21:17:00.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.399+0000 7fa520e45700 1 -- 172.21.15.153:0/475395956 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa518006070 con 0x7fa514007030 2023-10-05T21:17:00.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.399+0000 7fa520e45700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d849b170 con 0x7fa51800ebe0 2023-10-05T21:17:00.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.399+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa51c00a570 con 0x7fa51800ebe0 2023-10-05T21:17:00.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.399+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498ff0 con 0x5576d84909b0 2023-10-05T21:17:00.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.399+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.399+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498ff0 con 0x5576d84909b0 2023-10-05T21:17:00.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.400+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.400+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498ff0 con 0x7fa51800ebe0 2023-10-05T21:17:00.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.400+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa51c00a570 con 0x7fa51800ebe0 2023-10-05T21:17:00.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.400+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498ff0 con 0x7fa51800ebe0 2023-10-05T21:17:00.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.400+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa51c00a570 con 0x7fa51800ebe0 2023-10-05T21:17:00.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.400+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498ff0 con 0x7fa514007030 2023-10-05T21:17:00.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.401+0000 7fa520e45700 1 -- 172.21.15.153:0/475395956 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa518006070 con 0x7fa514007030 2023-10-05T21:17:00.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.401+0000 7fa520e45700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498ff0 con 0x5576d8495240 2023-10-05T21:17:00.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.401+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa514025cd0 con 0x5576d8495240 2023-10-05T21:17:00.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.401+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498ff0 con 0x5576d84909b0 2023-10-05T21:17:00.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.401+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.401+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498ff0 con 0x7fa51800ebe0 2023-10-05T21:17:00.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.401+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa51c00a570 con 0x7fa51800ebe0 2023-10-05T21:17:00.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.401+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498ff0 con 0x5576d84909b0 2023-10-05T21:17:00.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.401+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.402+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498ff0 con 0x7fa514007030 2023-10-05T21:17:00.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.402+0000 7fa520e45700 1 -- 172.21.15.153:0/475395956 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa518006070 con 0x7fa514007030 2023-10-05T21:17:00.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.402+0000 7fa520e45700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498ff0 con 0x5576d8495240 2023-10-05T21:17:00.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.402+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa514025cd0 con 0x5576d8495240 2023-10-05T21:17:00.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.402+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498ff0 con 0x5576d8495240 2023-10-05T21:17:00.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.402+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa514025cd0 con 0x5576d8495240 2023-10-05T21:17:00.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.402+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498ff0 con 0x7fa51800ebe0 2023-10-05T21:17:00.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.402+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa51c00a570 con 0x7fa51800ebe0 2023-10-05T21:17:00.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.402+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498ff0 con 0x5576d8495240 2023-10-05T21:17:00.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.403+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa514025cd0 con 0x5576d8495240 2023-10-05T21:17:00.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.403+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498ff0 con 0x5576d8495240 2023-10-05T21:17:00.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.403+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa514025cd0 con 0x5576d8495240 2023-10-05T21:17:00.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.403+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498ff0 con 0x5576d84909b0 2023-10-05T21:17:00.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.403+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.403+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498ff0 con 0x5576d84909b0 2023-10-05T21:17:00.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.403+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.403+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498ff0 con 0x7fa51800ebe0 2023-10-05T21:17:00.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.404+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa51c00a570 con 0x7fa51800ebe0 2023-10-05T21:17:00.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.404+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498ff0 con 0x5576d8495240 2023-10-05T21:17:00.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.404+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa514025cd0 con 0x5576d8495240 2023-10-05T21:17:00.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.404+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498ff0 con 0x7fa514007030 2023-10-05T21:17:00.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.404+0000 7fa520e45700 1 -- 172.21.15.153:0/475395956 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa518006070 con 0x7fa514007030 2023-10-05T21:17:00.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.404+0000 7fa520e45700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498ff0 con 0x5576d84909b0 2023-10-05T21:17:00.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.404+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.404+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498ff0 con 0x7fa51800ebe0 2023-10-05T21:17:00.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.405+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa51c00a570 con 0x7fa51800ebe0 2023-10-05T21:17:00.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.405+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498ff0 con 0x5576d8495240 2023-10-05T21:17:00.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.405+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa514025cd0 con 0x5576d8495240 2023-10-05T21:17:00.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.405+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498ff0 con 0x7fa51800ebe0 2023-10-05T21:17:00.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.405+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa51c00a570 con 0x7fa51800ebe0 2023-10-05T21:17:00.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.405+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498ff0 con 0x7fa514007030 2023-10-05T21:17:00.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.405+0000 7fa520e45700 1 -- 172.21.15.153:0/475395956 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa518006070 con 0x7fa514007030 2023-10-05T21:17:00.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.405+0000 7fa520e45700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498ff0 con 0x5576d8495240 2023-10-05T21:17:00.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.405+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa514025cd0 con 0x5576d8495240 2023-10-05T21:17:00.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.405+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498ff0 con 0x7fa51800ebe0 2023-10-05T21:17:00.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.406+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa51c00a570 con 0x7fa51800ebe0 2023-10-05T21:17:00.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.406+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498ff0 con 0x5576d84909b0 2023-10-05T21:17:00.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.406+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.406+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d8498ff0 con 0x7fa514007030 2023-10-05T21:17:00.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.406+0000 7fa520e45700 1 -- 172.21.15.153:0/475395956 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa518006070 con 0x7fa514007030 2023-10-05T21:17:00.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.406+0000 7fa52e56e680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:17:00.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.406+0000 7fa52e56e680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:17:00.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.406+0000 7fa52e56e680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:17:00.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.406+0000 7fa52e56e680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:17:00.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.406+0000 7fa52e56e680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.406+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d849a160 con 0x5576d84909b0 2023-10-05T21:17:00.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.406+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.406+0000 7fa52e56e680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:17:00.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.406+0000 7fa52e56e680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.406+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d849a510 con 0x5576d8495240 2023-10-05T21:17:00.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.407+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa514025cd0 con 0x5576d8495240 2023-10-05T21:17:00.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.407+0000 7fa52e56e680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:17:00.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.407+0000 7fa52e56e680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.407+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d849adb0 con 0x5576d84909b0 2023-10-05T21:17:00.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.407+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.407+0000 7fa52e56e680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:17:00.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.407+0000 7fa52e56e680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.407+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d849adb0 con 0x5576d84909b0 2023-10-05T21:17:00.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.407+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.407+0000 7fa52e56e680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:17:00.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.407+0000 7fa52e56e680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.407+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d849adb0 con 0x7fa51800ebe0 2023-10-05T21:17:00.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.408+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa51c00a570 con 0x7fa51800ebe0 2023-10-05T21:17:00.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.408+0000 7fa52e56e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.408+0000 7fa52e56e680 20 zone default found 2023-10-05T21:17:00.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.408+0000 7fa52e56e680 4 Realm: () 2023-10-05T21:17:00.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.408+0000 7fa52e56e680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:17:00.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.408+0000 7fa52e56e680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:17:00.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.408+0000 7fa52e56e680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:17:00.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.408+0000 7fa52e56e680 20 zonegroup default 2023-10-05T21:17:00.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.408+0000 7fa52e56e680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.408+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d849adb0 con 0x7fa51800ebe0 2023-10-05T21:17:00.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.408+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa51c00a570 con 0x7fa51800ebe0 2023-10-05T21:17:00.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.408+0000 7fa52e56e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.408+0000 7fa52e56e680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.408+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d849c730 con 0x5576d8495240 2023-10-05T21:17:00.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.408+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa514025cd0 con 0x5576d8495240 2023-10-05T21:17:00.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.408+0000 7fa52e56e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.408+0000 7fa52e56e680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.408+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d849cae0 con 0x5576d8495240 2023-10-05T21:17:00.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.408+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa514025cd0 con 0x5576d8495240 2023-10-05T21:17:00.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.408+0000 7fa52e56e680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.408+0000 7fa52e56e680 20 started sync module instance, tier type = 2023-10-05T21:17:00.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.408+0000 7fa52e56e680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:17:00.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.408+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d849be40 con 0x7fa514007030 2023-10-05T21:17:00.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.409+0000 7fa520e45700 1 -- 172.21.15.153:0/475395956 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v31'267 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa518006070 con 0x7fa514007030 2023-10-05T21:17:00.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.409+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93968923214400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d849d380 con 0x7fa514007030 2023-10-05T21:17:00.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.409+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d849dc20 con 0x5576d84909b0 2023-10-05T21:17:00.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.410+0000 7fa520e45700 1 -- 172.21.15.153:0/475395956 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 93968923214400] v31'268 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa518006070 con 0x7fa514007030 2023-10-05T21:17:00.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.410+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v31'267 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.410+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93968923217552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d849dc60 con 0x5576d84909b0 2023-10-05T21:17:00.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.410+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d849e840 con 0x5576d8495240 2023-10-05T21:17:00.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.411+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 93968923217552] v31'268 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.411+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v31'267 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa514025cd0 con 0x5576d8495240 2023-10-05T21:17:00.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.411+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93968923222768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d849ec40 con 0x5576d8495240 2023-10-05T21:17:00.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.411+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d849f650 con 0x7fa514007030 2023-10-05T21:17:00.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.412+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 93968923222768] v31'268 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa514025cd0 con 0x5576d8495240 2023-10-05T21:17:00.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.412+0000 7fa520e45700 1 -- 172.21.15.153:0/475395956 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v31'267 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa518006070 con 0x7fa514007030 2023-10-05T21:17:00.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.412+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 93968923219760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d849fef0 con 0x7fa514007030 2023-10-05T21:17:00.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.412+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d84a0790 con 0x5576d84909b0 2023-10-05T21:17:00.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.412+0000 7fa520e45700 1 -- 172.21.15.153:0/475395956 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 93968923219760] v31'268 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa518006070 con 0x7fa514007030 2023-10-05T21:17:00.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.413+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v31'267 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.413+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 93968923230880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d84a0be0 con 0x5576d84909b0 2023-10-05T21:17:00.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.413+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d84a14c0 con 0x7fa51800ebe0 2023-10-05T21:17:00.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.413+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 93968923230880] v31'268 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.414+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v31'267 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa51c00a570 con 0x7fa51800ebe0 2023-10-05T21:17:00.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.414+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 93968923232544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d84a1380 con 0x7fa51800ebe0 2023-10-05T21:17:00.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.414+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d84a1f80 con 0x7fa51800ebe0 2023-10-05T21:17:00.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.414+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 93968923232544] v31'268 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa51c00a570 con 0x7fa51800ebe0 2023-10-05T21:17:00.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.414+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v31'267 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa51c00a570 con 0x7fa51800ebe0 2023-10-05T21:17:00.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.414+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93968923236880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d84a1f40 con 0x7fa51800ebe0 2023-10-05T21:17:00.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.414+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d84a2a30 con 0x7fa51800ebe0 2023-10-05T21:17:00.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.415+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 93968923236880] v31'268 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa51c00a570 con 0x7fa51800ebe0 2023-10-05T21:17:00.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.415+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v31'267 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa51c00a570 con 0x7fa51800ebe0 2023-10-05T21:17:00.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.415+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93968923239712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d84a2a30 con 0x7fa51800ebe0 2023-10-05T21:17:00.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.415+0000 7fa52e56e680 20 add_watcher() i=0 2023-10-05T21:17:00.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.415+0000 7fa52e56e680 20 add_watcher() i=1 2023-10-05T21:17:00.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.415+0000 7fa52e56e680 20 add_watcher() i=2 2023-10-05T21:17:00.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.415+0000 7fa52e56e680 20 add_watcher() i=3 2023-10-05T21:17:00.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.415+0000 7fa52e56e680 20 add_watcher() i=4 2023-10-05T21:17:00.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.415+0000 7fa52e56e680 20 add_watcher() i=5 2023-10-05T21:17:00.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.415+0000 7fa52e56e680 20 add_watcher() i=6 2023-10-05T21:17:00.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.416+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 93968923239712] v31'268 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa51c00a570 con 0x7fa51800ebe0 2023-10-05T21:17:00.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.416+0000 7fa52e56e680 20 add_watcher() i=7 2023-10-05T21:17:00.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.416+0000 7fa52e56e680 2 all 8 watchers are set, enabling cache 2023-10-05T21:17:00.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.416+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d84a5e70 con 0x5576d84909b0 2023-10-05T21:17:00.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.416+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.416+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93968923233712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d84a3330 con 0x5576d84909b0 2023-10-05T21:17:00.447 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-10-05T21:17:00.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.417+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 93968923233712] v31'258 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.417+0000 7fa4f27e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:17:00.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.417+0000 7fa52e56e680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:17:00.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.417+0000 7fa52e56e680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:17:00.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.417+0000 7fa52e56e680 1 Processor -- start 2023-10-05T21:17:00.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.418+0000 7fa52e56e680 1 -- start start 2023-10-05T21:17:00.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.418+0000 7fa52e56e680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d84b0830 0x5576d84b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.418+0000 7fa52e56e680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576d84b1210 con 0x5576d84b0830 2023-10-05T21:17:00.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.418+0000 7fa520e45700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d84b0830 0x5576d84b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.418+0000 7fa520e45700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d84b0830 0x5576d84b0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60630/0 (socket says 172.21.15.153:60630) 2023-10-05T21:17:00.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.418+0000 7fa520e45700 1 -- 172.21.15.153:0/1478239113 learned_addr learned my addr 172.21.15.153:0/1478239113 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.418+0000 7fa520e45700 1 -- 172.21.15.153:0/1478239113 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576d84b1350 con 0x5576d84b0830 2023-10-05T21:17:00.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.418+0000 7fa520e45700 1 --2- 172.21.15.153:0/1478239113 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d84b0830 0x5576d84b0c40 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa51800c010 tx=0x7fa518006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ee679fbff13dd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.419+0000 7fa4f1fe3700 1 -- 172.21.15.153:0/1478239113 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa518023040 con 0x5576d84b0830 2023-10-05T21:17:00.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.419+0000 7fa4f1fe3700 1 -- 172.21.15.153:0/1478239113 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa518024040 con 0x5576d84b0830 2023-10-05T21:17:00.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.419+0000 7fa4f1fe3700 1 -- 172.21.15.153:0/1478239113 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa518013040 con 0x5576d84b0830 2023-10-05T21:17:00.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.419+0000 7fa52e56e680 1 -- 172.21.15.153:0/1478239113 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d84b0830 msgr2=0x5576d84b0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.419+0000 7fa52e56e680 1 --2- 172.21.15.153:0/1478239113 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d84b0830 0x5576d84b0c40 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa51800c010 tx=0x7fa518006000 comp rx=0 tx=0).stop 2023-10-05T21:17:00.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.419+0000 7fa52e56e680 1 -- 172.21.15.153:0/1478239113 shutdown_connections 2023-10-05T21:17:00.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.419+0000 7fa52e56e680 1 --2- 172.21.15.153:0/1478239113 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d84b0830 0x5576d84b0c40 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.419+0000 7fa52e56e680 1 -- 172.21.15.153:0/1478239113 >> 172.21.15.153:0/1478239113 conn(0x5576d84aba30 msgr2=0x5576d84a9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.419+0000 7fa52e56e680 1 -- 172.21.15.153:0/1478239113 shutdown_connections 2023-10-05T21:17:00.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.419+0000 7fa52e56e680 1 -- 172.21.15.153:0/1478239113 wait complete. 2023-10-05T21:17:00.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.420+0000 7fa52e56e680 1 Processor -- start 2023-10-05T21:17:00.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.420+0000 7fa52e56e680 1 -- start start 2023-10-05T21:17:00.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.420+0000 7fa52e56e680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d84b0830 0x5576d84b6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.420+0000 7fa52e56e680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576d84b68b0 con 0x5576d84b0830 2023-10-05T21:17:00.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.420+0000 7fa520e45700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d84b0830 0x5576d84b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.420+0000 7fa520e45700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d84b0830 0x5576d84b6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60642/0 (socket says 172.21.15.153:60642) 2023-10-05T21:17:00.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.420+0000 7fa520e45700 1 -- 172.21.15.153:0/1462845722 learned_addr learned my addr 172.21.15.153:0/1462845722 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.420+0000 7fa520e45700 1 -- 172.21.15.153:0/1462845722 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50c001e10 con 0x5576d84b0830 2023-10-05T21:17:00.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.421+0000 7fa520e45700 1 --2- 172.21.15.153:0/1462845722 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d84b0830 0x5576d84b6370 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x5576d84aafa0 tx=0x7fa51802f030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.421+0000 7fa463fff700 1 -- 172.21.15.153:0/1462845722 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa518023040 con 0x5576d84b0830 2023-10-05T21:17:00.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.421+0000 7fa463fff700 1 -- 172.21.15.153:0/1462845722 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51801e6b0 con 0x5576d84b0830 2023-10-05T21:17:00.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.421+0000 7fa52e56e680 1 -- 172.21.15.153:0/1462845722 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5576d84b6ab0 con 0x5576d84b0830 2023-10-05T21:17:00.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.421+0000 7fa463fff700 1 -- 172.21.15.153:0/1462845722 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa51801e860 con 0x5576d84b0830 2023-10-05T21:17:00.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.421+0000 7fa52e56e680 1 -- 172.21.15.153:0/1462845722 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5576d84b6f60 con 0x5576d84b0830 2023-10-05T21:17:00.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.422+0000 7fa463fff700 1 -- 172.21.15.153:0/1462845722 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fa51801e9c0 con 0x5576d84b0830 2023-10-05T21:17:00.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.422+0000 7fa463fff700 1 --2- 172.21.15.153:0/1462845722 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa4680340a0 0x7fa468036550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.422+0000 7fa463fff700 1 -- 172.21.15.153:0/1462845722 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fa518043bc0 con 0x5576d84b0830 2023-10-05T21:17:00.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.422+0000 7fa521e47700 1 --2- 172.21.15.153:0/1462845722 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa4680340a0 0x7fa468036550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.422+0000 7fa52e56e680 5 note: GC not initialized 2023-10-05T21:17:00.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.422+0000 7fa521e47700 1 --2- 172.21.15.153:0/1462845722 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa4680340a0 0x7fa468036550 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x5576d84a1230 tx=0x7fa51c00af80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.423+0000 7fa4617fa700 20 reqs_thread_entry: start 2023-10-05T21:17:00.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.423+0000 7fa45affd700 20 reqs_thread_entry: start 2023-10-05T21:17:00.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.423+0000 7fa52e56e680 20 init_complete bucket index max shards: 11 2023-10-05T21:17:00.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.423+0000 7fa52e56e680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:17:00.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.423+0000 7fa4597fa700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:17:30 2023 2023-10-05T21:17:00.452 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:17:00.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.423+0000 7fa458ff9700 20 reqs_thread_entry: start 2023-10-05T21:17:00.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.423+0000 7fa52e56e680 20 get_system_obj_state: rctx=0x7fff21fa0848 obj=default.rgw.meta:users.uid:foo state=0x5576d8311240 s->prefetch_data=0 2023-10-05T21:17:00.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.423+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d851be50 con 0x5576d84909b0 2023-10-05T21:17:00.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.424+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(102 foo [call,getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.452 INFO:teuthology.orchestra.run.smithi153.stderr:could not fetch user info: no user info saved 2023-10-05T21:17:00.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.424+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:103 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93968923214400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d84da9d0 con 0x7fa514007030 2023-10-05T21:17:00.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.425+0000 7fa520e45700 1 -- 172.21.15.153:0/475395956 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(103 notify.0 [watch unwatch cookie 93968923214400] v31'269 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa51803f040 con 0x7fa514007030 2023-10-05T21:17:00.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.425+0000 7fa52e56e680 20 remove_watcher() i=0 2023-10-05T21:17:00.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.425+0000 7fa52e56e680 2 removed watcher, disabling cache 2023-10-05T21:17:00.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.425+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:104 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93968923217552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d849c240 con 0x5576d84909b0 2023-10-05T21:17:00.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.426+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== osd_op_reply(104 notify.1 [watch unwatch cookie 93968923217552] v31'269 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.426+0000 7fa52e56e680 20 remove_watcher() i=1 2023-10-05T21:17:00.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.426+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:105 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93968923222768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d849c240 con 0x5576d8495240 2023-10-05T21:17:00.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.426+0000 7fa521646700 1 -- 172.21.15.153:0/475395956 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== osd_op_reply(105 notify.2 [watch unwatch cookie 93968923222768] v31'269 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa514025cd0 con 0x5576d8495240 2023-10-05T21:17:00.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.426+0000 7fa52e56e680 20 remove_watcher() i=2 2023-10-05T21:17:00.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.426+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:106 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93968923219760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d849e2f0 con 0x7fa514007030 2023-10-05T21:17:00.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.427+0000 7fa520e45700 1 -- 172.21.15.153:0/475395956 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(106 notify.3 [watch unwatch cookie 93968923219760] v31'269 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa51803f040 con 0x7fa514007030 2023-10-05T21:17:00.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.427+0000 7fa52e56e680 20 remove_watcher() i=3 2023-10-05T21:17:00.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.427+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93968923230880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d849c240 con 0x5576d84909b0 2023-10-05T21:17:00.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.428+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(107 notify.4 [watch unwatch cookie 93968923230880] v31'269 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.428+0000 7fa52e56e680 20 remove_watcher() i=4 2023-10-05T21:17:00.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.428+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:108 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93968923232544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d84a02a0 con 0x7fa51800ebe0 2023-10-05T21:17:00.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.429+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(108 notify.5 [watch unwatch cookie 93968923232544] v31'269 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa51c00a570 con 0x7fa51800ebe0 2023-10-05T21:17:00.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.429+0000 7fa52e56e680 20 remove_watcher() i=5 2023-10-05T21:17:00.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.429+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:109 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93968923236880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d849c240 con 0x7fa51800ebe0 2023-10-05T21:17:00.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.429+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(109 notify.6 [watch unwatch cookie 93968923236880] v31'269 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa51c00a570 con 0x7fa51800ebe0 2023-10-05T21:17:00.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.430+0000 7fa52e56e680 20 remove_watcher() i=6 2023-10-05T21:17:00.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.430+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:110 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93968923239712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d84a02a0 con 0x7fa51800ebe0 2023-10-05T21:17:00.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.430+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(110 notify.7 [watch unwatch cookie 93968923239712] v31'269 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa51c00a570 con 0x7fa51800ebe0 2023-10-05T21:17:00.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.430+0000 7fa52e56e680 20 remove_watcher() i=7 2023-10-05T21:17:00.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.431+0000 7fa4f27e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:17:00.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.431+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:111 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93968923233712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5576d849c240 con 0x5576d84909b0 2023-10-05T21:17:00.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.432+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(111 data_loggenerations_metadata [watch unwatch cookie 93968923233712] v31'259 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa51c00a570 con 0x5576d84909b0 2023-10-05T21:17:00.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.432+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fa51800ebe0 msgr2=0x7fa51800d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.432+0000 7fa52e56e680 1 --2- 172.21.15.153:0/475395956 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fa51800ebe0 0x7fa51800d8e0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.432+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5576d84909b0 msgr2=0x5576d8492dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.432+0000 7fa52e56e680 1 --2- 172.21.15.153:0/475395956 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5576d84909b0 0x5576d8492dd0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.432+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fa514007030 msgr2=0x7fa5140373f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.432+0000 7fa52e56e680 1 --2- 172.21.15.153:0/475395956 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fa514007030 0x7fa5140373f0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.432+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5576d8495240 msgr2=0x5576d8497620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.432+0000 7fa52e56e680 1 --2- 172.21.15.153:0/475395956 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5576d8495240 0x5576d8497620 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.432+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa504034140 msgr2=0x7fa5040365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.432+0000 7fa52e56e680 1 --2- 172.21.15.153:0/475395956 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa504034140 0x7fa5040365f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa518004170 tx=0x7fa518001360 comp rx=0 tx=0).stop 2023-10-05T21:17:00.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.432+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d845ca30 msgr2=0x5576d8486ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.432+0000 7fa521e47700 1 -- 172.21.15.153:0/475395956 reap_dead start 2023-10-05T21:17:00.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.432+0000 7fa52e56e680 1 --2- 172.21.15.153:0/475395956 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d845ca30 0x5576d8486ce0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fa514005a90 tx=0x7fa51401c000 comp rx=0 tx=0).stop 2023-10-05T21:17:00.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.432+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 shutdown_connections 2023-10-05T21:17:00.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.432+0000 7fa52e56e680 1 --2- 172.21.15.153:0/475395956 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d845ca30 0x5576d8486ce0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.432+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 >> 172.21.15.153:0/475395956 conn(0x5576d8458300 msgr2=0x5576d847b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.432+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 shutdown_connections 2023-10-05T21:17:00.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.432+0000 7fa52e56e680 1 -- 172.21.15.153:0/475395956 wait complete. 2023-10-05T21:17:00.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.432+0000 7fa52e56e680 1 -- 172.21.15.153:0/1462845722 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa4680340a0 msgr2=0x7fa468036550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.432+0000 7fa52e56e680 1 --2- 172.21.15.153:0/1462845722 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa4680340a0 0x7fa468036550 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x5576d84a1230 tx=0x7fa51c00af80 comp rx=0 tx=0).stop 2023-10-05T21:17:00.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.432+0000 7fa52e56e680 1 -- 172.21.15.153:0/1462845722 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d84b0830 msgr2=0x5576d84b6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.432+0000 7fa52e56e680 1 --2- 172.21.15.153:0/1462845722 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d84b0830 0x5576d84b6370 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x5576d84aafa0 tx=0x7fa51802f030 comp rx=0 tx=0).stop 2023-10-05T21:17:00.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.432+0000 7fa52e56e680 1 -- 172.21.15.153:0/1462845722 shutdown_connections 2023-10-05T21:17:00.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.433+0000 7fa52e56e680 1 --2- 172.21.15.153:0/1462845722 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fa4680340a0 0x7fa468036550 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.433+0000 7fa52e56e680 1 --2- 172.21.15.153:0/1462845722 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5576d84b0830 0x5576d84b6370 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.433+0000 7fa52e56e680 1 -- 172.21.15.153:0/1462845722 >> 172.21.15.153:0/1462845722 conn(0x5576d84aba30 msgr2=0x5576d84a9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.433+0000 7fa52e56e680 1 -- 172.21.15.153:0/1462845722 shutdown_connections 2023-10-05T21:17:00.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.433+0000 7fa52e56e680 1 -- 172.21.15.153:0/1462845722 wait complete. 2023-10-05T21:17:00.457 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2023-10-05T21:17:00.457 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2023-10-05T21:17:00.457 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2023-10-05T21:17:00.500 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:17:00.500 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:17:00.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.500+0000 7ff43f0dd680 1 Processor -- start 2023-10-05T21:17:00.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.500+0000 7ff43f0dd680 1 -- start start 2023-10-05T21:17:00.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.500+0000 7ff43f0dd680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x561538139e10 0x56153813c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.500+0000 7ff43f0dd680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x561538080990 con 0x561538133b20 2023-10-05T21:17:00.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.500+0000 7ff43f0dd680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x561538040db0 con 0x561538139e10 2023-10-05T21:17:00.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.500+0000 7ff4319b4700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x561538139e10 0x56153813c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.500+0000 7ff4321b5700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x561538133b20 0x561538133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:57260/0 (socket says 172.21.15.153:57260) 2023-10-05T21:17:00.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.500+0000 7ff4321b5700 1 -- 172.21.15.153:0/3366776809 learned_addr learned my addr 172.21.15.153:0/3366776809 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:17:00.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.500+0000 7ff4319b4700 1 -- 172.21.15.153:0/3366776809 >> v1:172.21.15.111:6789/0 conn(0x561538133b20 legacy=0x561538133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.500+0000 7ff4319b4700 1 -- 172.21.15.153:0/3366776809 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5615381346f0 con 0x561538139e10 2023-10-05T21:17:00.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.500+0000 7ff4311b3700 1 -- 172.21.15.153:0/3366776809 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 652602814 0 0) 0x561538080990 con 0x561538133b20 2023-10-05T21:17:00.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.501+0000 7ff4319b4700 1 --2- 172.21.15.153:0/3366776809 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561538139e10 0x56153813c1f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff42800a5d0 tx=0x7ff428005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3847406cbac366b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.501+0000 7ff4311b3700 1 -- 172.21.15.153:0/3366776809 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4280086a0 con 0x561538139e10 2023-10-05T21:17:00.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.501+0000 7ff4311b3700 1 -- 172.21.15.153:0/3366776809 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff428008800 con 0x561538139e10 2023-10-05T21:17:00.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.501+0000 7ff4311b3700 1 -- 172.21.15.153:0/3366776809 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff428008ad0 con 0x561538139e10 2023-10-05T21:17:00.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.501+0000 7ff43f0dd680 1 -- 172.21.15.153:0/3366776809 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561538139e10 msgr2=0x56153813c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.501+0000 7ff43f0dd680 1 --2- 172.21.15.153:0/3366776809 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561538139e10 0x56153813c1f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff42800a5d0 tx=0x7ff428005a50 comp rx=0 tx=0).stop 2023-10-05T21:17:00.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.501+0000 7ff43f0dd680 1 -- 172.21.15.153:0/3366776809 shutdown_connections 2023-10-05T21:17:00.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.501+0000 7ff43f0dd680 1 --2- 172.21.15.153:0/3366776809 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561538139e10 0x56153813c1f0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.501+0000 7ff43f0dd680 1 -- 172.21.15.153:0/3366776809 >> 172.21.15.153:0/3366776809 conn(0x56153812d3e0 msgr2=0x56153812f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.501+0000 7ff43f0dd680 1 -- 172.21.15.153:0/3366776809 shutdown_connections 2023-10-05T21:17:00.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.501+0000 7ff43f0dd680 1 -- 172.21.15.153:0/3366776809 wait complete. 2023-10-05T21:17:00.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.502+0000 7ff43f0dd680 1 Processor -- start 2023-10-05T21:17:00.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.502+0000 7ff43f0dd680 1 -- start start 2023-10-05T21:17:00.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.502+0000 7ff43f0dd680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561538133b20 0x5615381549a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.502+0000 7ff43f0dd680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x561537fe0ea0 con 0x561538133b20 2023-10-05T21:17:00.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.502+0000 7ff4321b5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561538133b20 0x5615381549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.502+0000 7ff4321b5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561538133b20 0x5615381549a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60654/0 (socket says 172.21.15.153:60654) 2023-10-05T21:17:00.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.502+0000 7ff4321b5700 1 -- 172.21.15.153:0/2578295999 learned_addr learned my addr 172.21.15.153:0/2578295999 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.503+0000 7ff4321b5700 1 -- 172.21.15.153:0/2578295999 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff428005cf0 con 0x561538133b20 2023-10-05T21:17:00.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.503+0000 7ff4321b5700 1 --2- 172.21.15.153:0/2578295999 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561538133b20 0x5615381549a0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff424001dc0 tx=0x7ff424001790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf488d4e6b4ad597 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.503+0000 7ff423fff700 1 -- 172.21.15.153:0/2578295999 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff42400bce0 con 0x561538133b20 2023-10-05T21:17:00.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.503+0000 7ff423fff700 1 -- 172.21.15.153:0/2578295999 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42400be40 con 0x561538133b20 2023-10-05T21:17:00.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.503+0000 7ff423fff700 1 -- 172.21.15.153:0/2578295999 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff42400e5d0 con 0x561538133b20 2023-10-05T21:17:00.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.503+0000 7ff43f0dd680 1 -- 172.21.15.153:0/2578295999 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561538133b20 msgr2=0x5615381549a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.503+0000 7ff43f0dd680 1 --2- 172.21.15.153:0/2578295999 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561538133b20 0x5615381549a0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff424001dc0 tx=0x7ff424001790 comp rx=0 tx=0).stop 2023-10-05T21:17:00.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.503+0000 7ff43f0dd680 1 -- 172.21.15.153:0/2578295999 shutdown_connections 2023-10-05T21:17:00.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.503+0000 7ff43f0dd680 1 --2- 172.21.15.153:0/2578295999 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561538133b20 0x5615381549a0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.503+0000 7ff43f0dd680 1 -- 172.21.15.153:0/2578295999 >> 172.21.15.153:0/2578295999 conn(0x56153812d3e0 msgr2=0x561538150470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.503+0000 7ff43f0dd680 1 -- 172.21.15.153:0/2578295999 shutdown_connections 2023-10-05T21:17:00.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.504+0000 7ff43f0dd680 1 -- 172.21.15.153:0/2578295999 wait complete. 2023-10-05T21:17:00.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.504+0000 7ff43f0dd680 1 Processor -- start 2023-10-05T21:17:00.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.504+0000 7ff43f0dd680 1 -- start start 2023-10-05T21:17:00.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.504+0000 7ff43f0dd680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561538133b20 0x56153815be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.504+0000 7ff43f0dd680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x561537fd7c80 con 0x561538133b20 2023-10-05T21:17:00.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.504+0000 7ff4321b5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561538133b20 0x56153815be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.504+0000 7ff4321b5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561538133b20 0x56153815be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60666/0 (socket says 172.21.15.153:60666) 2023-10-05T21:17:00.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.504+0000 7ff4321b5700 1 -- 172.21.15.153:0/3231808568 learned_addr learned my addr 172.21.15.153:0/3231808568 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.505+0000 7ff4321b5700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff424001a70 con 0x561538133b20 2023-10-05T21:17:00.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.505+0000 7ff4321b5700 1 --2- 172.21.15.153:0/3231808568 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561538133b20 0x56153815be60 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff4240017d0 tx=0x7ff424016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.505+0000 7ff4227fc700 1 -- 172.21.15.153:0/3231808568 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff42401f070 con 0x561538133b20 2023-10-05T21:17:00.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.505+0000 7ff4227fc700 1 -- 172.21.15.153:0/3231808568 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42401a4d0 con 0x561538133b20 2023-10-05T21:17:00.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.505+0000 7ff43f0dd680 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56153815c3a0 con 0x561538133b20 2023-10-05T21:17:00.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.505+0000 7ff4227fc700 1 -- 172.21.15.153:0/3231808568 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff42401a7a0 con 0x561538133b20 2023-10-05T21:17:00.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.505+0000 7ff43f0dd680 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56153815c7f0 con 0x561538133b20 2023-10-05T21:17:00.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.506+0000 7ff4227fc700 1 -- 172.21.15.153:0/3231808568 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7ff42401a900 con 0x561538133b20 2023-10-05T21:17:00.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.506+0000 7ff4227fc700 1 --2- 172.21.15.153:0/3231808568 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff414034140 0x7ff4140365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.506+0000 7ff4227fc700 1 -- 172.21.15.153:0/3231808568 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7ff424048f90 con 0x561538133b20 2023-10-05T21:17:00.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.506+0000 7ff4319b4700 1 --2- 172.21.15.153:0/3231808568 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff414034140 0x7ff4140365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.506+0000 7ff43f0dd680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:17:00.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.506+0000 7ff43f0dd680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:17:00.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.506+0000 7ff43f0dd680 1 Processor -- start 2023-10-05T21:17:00.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.506+0000 7ff4319b4700 1 --2- 172.21.15.153:0/3231808568 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff414034140 0x7ff4140365f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff428003080 tx=0x7ff428015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.506+0000 7ff43f0dd680 1 -- start start 2023-10-05T21:17:00.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.507+0000 7ff43f0dd680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56153816dd00 0x56153816e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.507+0000 7ff43f0dd680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x56153816e650 con 0x56153816dd00 2023-10-05T21:17:00.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.507+0000 7ff4321b5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56153816dd00 0x56153816e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.507+0000 7ff4321b5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56153816dd00 0x56153816e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60676/0 (socket says 172.21.15.153:60676) 2023-10-05T21:17:00.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.507+0000 7ff4321b5700 1 -- 172.21.15.153:0/3737170735 learned_addr learned my addr 172.21.15.153:0/3737170735 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.507+0000 7ff4321b5700 1 -- 172.21.15.153:0/3737170735 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56153816e790 con 0x56153816dd00 2023-10-05T21:17:00.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.507+0000 7ff4321b5700 1 --2- 172.21.15.153:0/3737170735 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56153816dd00 0x56153816e110 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff42401a0a0 tx=0x7ff4240473b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fef6f96c150e90f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.507+0000 7ff403fdf700 1 -- 172.21.15.153:0/3737170735 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff424046070 con 0x56153816dd00 2023-10-05T21:17:00.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.507+0000 7ff403fdf700 1 -- 172.21.15.153:0/3737170735 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4240163b0 con 0x56153816dd00 2023-10-05T21:17:00.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.507+0000 7ff403fdf700 1 -- 172.21.15.153:0/3737170735 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff424017c50 con 0x56153816dd00 2023-10-05T21:17:00.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.508+0000 7ff43f0dd680 1 -- 172.21.15.153:0/3737170735 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56153816dd00 msgr2=0x56153816e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.508+0000 7ff43f0dd680 1 --2- 172.21.15.153:0/3737170735 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56153816dd00 0x56153816e110 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff42401a0a0 tx=0x7ff4240473b0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.508+0000 7ff43f0dd680 1 -- 172.21.15.153:0/3737170735 shutdown_connections 2023-10-05T21:17:00.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.508+0000 7ff43f0dd680 1 --2- 172.21.15.153:0/3737170735 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56153816dd00 0x56153816e110 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.508+0000 7ff43f0dd680 1 -- 172.21.15.153:0/3737170735 >> 172.21.15.153:0/3737170735 conn(0x561538139e10 msgr2=0x56153816a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.508+0000 7ff43f0dd680 1 -- 172.21.15.153:0/3737170735 shutdown_connections 2023-10-05T21:17:00.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.508+0000 7ff43f0dd680 1 -- 172.21.15.153:0/3737170735 wait complete. 2023-10-05T21:17:00.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.508+0000 7ff43f0dd680 1 Processor -- start 2023-10-05T21:17:00.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.508+0000 7ff43f0dd680 1 -- start start 2023-10-05T21:17:00.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.508+0000 7ff43f0dd680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56153816dd00 0x561538174f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.508+0000 7ff43f0dd680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x561538175490 con 0x56153816dd00 2023-10-05T21:17:00.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.509+0000 7ff4321b5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56153816dd00 0x561538174f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.509+0000 7ff4321b5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56153816dd00 0x561538174f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60678/0 (socket says 172.21.15.153:60678) 2023-10-05T21:17:00.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.509+0000 7ff4321b5700 1 -- 172.21.15.153:0/489280493 learned_addr learned my addr 172.21.15.153:0/489280493 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.509+0000 7ff4321b5700 1 -- 172.21.15.153:0/489280493 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56153815c7f0 con 0x56153816dd00 2023-10-05T21:17:00.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.509+0000 7ff4321b5700 1 --2- 172.21.15.153:0/489280493 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56153816dd00 0x561538174f50 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ff42401a1c0 tx=0x7ff424031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.509+0000 7ff4027dc700 1 -- 172.21.15.153:0/489280493 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff424018a30 con 0x56153816dd00 2023-10-05T21:17:00.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.509+0000 7ff4027dc700 1 -- 172.21.15.153:0/489280493 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff424023800 con 0x56153816dd00 2023-10-05T21:17:00.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.509+0000 7ff43f0dd680 1 -- 172.21.15.153:0/489280493 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561538175690 con 0x56153816dd00 2023-10-05T21:17:00.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.509+0000 7ff4027dc700 1 -- 172.21.15.153:0/489280493 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff424023970 con 0x56153816dd00 2023-10-05T21:17:00.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.509+0000 7ff43f0dd680 1 -- 172.21.15.153:0/489280493 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561538175b60 con 0x56153816dd00 2023-10-05T21:17:00.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.510+0000 7ff4027dc700 1 -- 172.21.15.153:0/489280493 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7ff424023ad0 con 0x56153816dd00 2023-10-05T21:17:00.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.510+0000 7ff37bfff700 20 reqs_thread_entry: start 2023-10-05T21:17:00.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.510+0000 7ff43f0dd680 20 try_to_resolve_local_entities(): before: realm_id= realm_name= zonegroup_id= zonegroup_name= zone_id= zone_name=default 2023-10-05T21:17:00.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.510+0000 7ff43f0dd680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.510+0000 7ff43f0dd680 1 --2- 172.21.15.153:0/3231808568 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x561538195890 0x5615381a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.510+0000 7ff43f0dd680 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561538195ce0 con 0x561538195890 2023-10-05T21:17:00.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.511+0000 7ff4027dc700 1 --2- 172.21.15.153:0/489280493 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff3800340f0 0x7ff3800365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.511+0000 7ff4319b4700 1 --2- 172.21.15.153:0/3231808568 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x561538195890 0x5615381a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.511+0000 7ff4027dc700 1 -- 172.21.15.153:0/489280493 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7ff42402f0b0 con 0x56153816dd00 2023-10-05T21:17:00.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.511+0000 7ff4329b6700 1 --2- 172.21.15.153:0/489280493 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff3800340f0 0x7ff3800365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.511+0000 7ff4319b4700 1 --2- 172.21.15.153:0/3231808568 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x561538195890 0x5615381a4fb0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.511+0000 7ff4329b6700 1 --2- 172.21.15.153:0/489280493 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff3800340f0 0x7ff3800365a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x5615381513c0 tx=0x7ff42c005880 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.511+0000 7ff4319b4700 1 -- 172.21.15.153:0/3231808568 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff428019040 con 0x561538195890 2023-10-05T21:17:00.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.511+0000 7ff43f0dd680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:17:00.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.511+0000 7ff43f0dd680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.511+0000 7ff43f0dd680 1 --2- 172.21.15.153:0/3231808568 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5615381a5a00 0x5615381a7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.511+0000 7ff43f0dd680 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:2 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a8320 con 0x5615381a5a00 2023-10-05T21:17:00.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.511+0000 7ff4321b5700 1 --2- 172.21.15.153:0/3231808568 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5615381a5a00 0x5615381a7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.512+0000 7ff4321b5700 1 --2- 172.21.15.153:0/3231808568 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5615381a5a00 0x5615381a7de0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.512+0000 7ff4321b5700 1 -- 172.21.15.153:0/3231808568 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(2 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff424014070 con 0x5615381a5a00 2023-10-05T21:17:00.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.512+0000 7ff43f0dd680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:17:00.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.512+0000 7ff43f0dd680 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:3 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x5615381a5a00 2023-10-05T21:17:00.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.512+0000 7ff4321b5700 1 -- 172.21.15.153:0/3231808568 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(3 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff424014070 con 0x5615381a5a00 2023-10-05T21:17:00.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.512+0000 7ff4321b5700 1 --2- 172.21.15.153:0/3231808568 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ff424039b90 0x7ff42401ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.512+0000 7ff4321b5700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:4 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x7ff424039b90 2023-10-05T21:17:00.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.512+0000 7ff4319b4700 1 --2- 172.21.15.153:0/3231808568 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ff424039b90 0x7ff42401ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.513+0000 7ff4319b4700 1 --2- 172.21.15.153:0/3231808568 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ff424039b90 0x7ff42401ca00 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.513+0000 7ff4319b4700 1 -- 172.21.15.153:0/3231808568 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(4 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff428019040 con 0x7ff424039b90 2023-10-05T21:17:00.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.513+0000 7ff4319b4700 1 --2- 172.21.15.153:0/3231808568 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ff428007030 0x7ff428029940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.513+0000 7ff4319b4700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:5 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x7ff428007030 2023-10-05T21:17:00.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.513+0000 7ff4329b6700 1 --2- 172.21.15.153:0/3231808568 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ff428007030 0x7ff428029940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.513+0000 7ff4329b6700 1 --2- 172.21.15.153:0/3231808568 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ff428007030 0x7ff428029940 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.514+0000 7ff4329b6700 1 -- 172.21.15.153:0/3231808568 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(5 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff42c012140 con 0x7ff428007030 2023-10-05T21:17:00.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.514+0000 7ff4329b6700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:6 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x561538195890 2023-10-05T21:17:00.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.514+0000 7ff4319b4700 1 -- 172.21.15.153:0/3231808568 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff428033040 con 0x561538195890 2023-10-05T21:17:00.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.514+0000 7ff4319b4700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:7 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x561538195890 2023-10-05T21:17:00.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.514+0000 7ff4319b4700 1 -- 172.21.15.153:0/3231808568 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff428033040 con 0x561538195890 2023-10-05T21:17:00.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.514+0000 7ff4319b4700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x7ff428007030 2023-10-05T21:17:00.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.514+0000 7ff4329b6700 1 -- 172.21.15.153:0/3231808568 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff42c012140 con 0x7ff428007030 2023-10-05T21:17:00.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.514+0000 7ff4329b6700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:9 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x7ff428007030 2023-10-05T21:17:00.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.515+0000 7ff4329b6700 1 -- 172.21.15.153:0/3231808568 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff42c012140 con 0x7ff428007030 2023-10-05T21:17:00.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.515+0000 7ff4329b6700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:10 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x7ff424039b90 2023-10-05T21:17:00.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.515+0000 7ff4319b4700 1 -- 172.21.15.153:0/3231808568 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff428033040 con 0x7ff424039b90 2023-10-05T21:17:00.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.515+0000 7ff4319b4700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:11 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x5615381a5a00 2023-10-05T21:17:00.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.515+0000 7ff4321b5700 1 -- 172.21.15.153:0/3231808568 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff424014070 con 0x5615381a5a00 2023-10-05T21:17:00.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.515+0000 7ff4321b5700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:12 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x561538195890 2023-10-05T21:17:00.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.515+0000 7ff4319b4700 1 -- 172.21.15.153:0/3231808568 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff428033040 con 0x561538195890 2023-10-05T21:17:00.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.515+0000 7ff4319b4700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:13 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x7ff428007030 2023-10-05T21:17:00.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.515+0000 7ff4329b6700 1 -- 172.21.15.153:0/3231808568 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff42c012140 con 0x7ff428007030 2023-10-05T21:17:00.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.515+0000 7ff4329b6700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:14 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x561538195890 2023-10-05T21:17:00.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.516+0000 7ff4319b4700 1 -- 172.21.15.153:0/3231808568 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff428033040 con 0x561538195890 2023-10-05T21:17:00.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.516+0000 7ff4319b4700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:15 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x7ff424039b90 2023-10-05T21:17:00.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.516+0000 7ff4319b4700 1 -- 172.21.15.153:0/3231808568 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff428033040 con 0x7ff424039b90 2023-10-05T21:17:00.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.516+0000 7ff4319b4700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:16 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x5615381a5a00 2023-10-05T21:17:00.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.516+0000 7ff4321b5700 1 -- 172.21.15.153:0/3231808568 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff424014070 con 0x5615381a5a00 2023-10-05T21:17:00.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.516+0000 7ff4321b5700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:17 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x5615381a5a00 2023-10-05T21:17:00.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.516+0000 7ff4321b5700 1 -- 172.21.15.153:0/3231808568 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff424014070 con 0x5615381a5a00 2023-10-05T21:17:00.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.516+0000 7ff4321b5700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:18 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x7ff428007030 2023-10-05T21:17:00.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.517+0000 7ff4329b6700 1 -- 172.21.15.153:0/3231808568 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(18 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff42c012140 con 0x7ff428007030 2023-10-05T21:17:00.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.517+0000 7ff4329b6700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x5615381a5a00 2023-10-05T21:17:00.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.517+0000 7ff4321b5700 1 -- 172.21.15.153:0/3231808568 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff424014070 con 0x5615381a5a00 2023-10-05T21:17:00.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.517+0000 7ff4321b5700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x5615381a5a00 2023-10-05T21:17:00.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.517+0000 7ff4321b5700 1 -- 172.21.15.153:0/3231808568 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff424014070 con 0x5615381a5a00 2023-10-05T21:17:00.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.517+0000 7ff4321b5700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:21 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x561538195890 2023-10-05T21:17:00.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.517+0000 7ff4319b4700 1 -- 172.21.15.153:0/3231808568 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff428033040 con 0x561538195890 2023-10-05T21:17:00.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.517+0000 7ff4319b4700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:22 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x561538195890 2023-10-05T21:17:00.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.518+0000 7ff4319b4700 1 -- 172.21.15.153:0/3231808568 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff428033040 con 0x561538195890 2023-10-05T21:17:00.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.518+0000 7ff4319b4700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:23 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x7ff428007030 2023-10-05T21:17:00.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.518+0000 7ff4329b6700 1 -- 172.21.15.153:0/3231808568 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff42c012140 con 0x7ff428007030 2023-10-05T21:17:00.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.518+0000 7ff4329b6700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:24 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x5615381a5a00 2023-10-05T21:17:00.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.518+0000 7ff4321b5700 1 -- 172.21.15.153:0/3231808568 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff424014070 con 0x5615381a5a00 2023-10-05T21:17:00.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.518+0000 7ff4321b5700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:25 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x7ff424039b90 2023-10-05T21:17:00.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.518+0000 7ff4319b4700 1 -- 172.21.15.153:0/3231808568 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(25 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff428033040 con 0x7ff424039b90 2023-10-05T21:17:00.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.518+0000 7ff4319b4700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:26 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x561538195890 2023-10-05T21:17:00.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.519+0000 7ff4319b4700 1 -- 172.21.15.153:0/3231808568 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff428033040 con 0x561538195890 2023-10-05T21:17:00.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.519+0000 7ff4319b4700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:27 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x7ff428007030 2023-10-05T21:17:00.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.519+0000 7ff4329b6700 1 -- 172.21.15.153:0/3231808568 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff42c012140 con 0x7ff428007030 2023-10-05T21:17:00.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.519+0000 7ff4329b6700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:28 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x5615381a5a00 2023-10-05T21:17:00.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.519+0000 7ff4321b5700 1 -- 172.21.15.153:0/3231808568 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff424014070 con 0x5615381a5a00 2023-10-05T21:17:00.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.519+0000 7ff4321b5700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:29 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x7ff428007030 2023-10-05T21:17:00.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.520+0000 7ff4329b6700 1 -- 172.21.15.153:0/3231808568 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff42c012140 con 0x7ff428007030 2023-10-05T21:17:00.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.520+0000 7ff4329b6700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:30 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x7ff424039b90 2023-10-05T21:17:00.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.520+0000 7ff4319b4700 1 -- 172.21.15.153:0/3231808568 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff428033040 con 0x7ff424039b90 2023-10-05T21:17:00.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.520+0000 7ff4319b4700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x5615381a5a00 2023-10-05T21:17:00.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.520+0000 7ff4321b5700 1 -- 172.21.15.153:0/3231808568 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff424014070 con 0x5615381a5a00 2023-10-05T21:17:00.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.520+0000 7ff4321b5700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x7ff428007030 2023-10-05T21:17:00.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.520+0000 7ff4329b6700 1 -- 172.21.15.153:0/3231808568 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff42c012140 con 0x7ff428007030 2023-10-05T21:17:00.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.520+0000 7ff4329b6700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:33 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x561538195890 2023-10-05T21:17:00.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.521+0000 7ff4319b4700 1 -- 172.21.15.153:0/3231808568 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(33 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff428033040 con 0x561538195890 2023-10-05T21:17:00.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.521+0000 7ff4319b4700 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:34 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a96e0 con 0x7ff424039b90 2023-10-05T21:17:00.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.521+0000 7ff4319b4700 1 -- 172.21.15.153:0/3231808568 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff428033040 con 0x7ff424039b90 2023-10-05T21:17:00.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.521+0000 7ff43f0dd680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:17:00.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.521+0000 7ff43f0dd680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:17:00.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.521+0000 7ff43f0dd680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:17:00.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.521+0000 7ff43f0dd680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:17:00.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.521+0000 7ff43f0dd680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.521+0000 7ff43f0dd680 1 -- 172.21.15.153:0/3231808568 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:35 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5615381a86d0 con 0x5615381a5a00 2023-10-05T21:17:00.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.521+0000 7ff4321b5700 1 -- 172.21.15.153:0/3231808568 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(35 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff424014070 con 0x5615381a5a00 2023-10-05T21:17:00.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.521+0000 7ff43f0dd680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:17:00.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.522+0000 7ff43f0dd680 1 -- 172.21.15.153:0/3231808568 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ff428007030 msgr2=0x7ff428029940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.522+0000 7ff43f0dd680 1 --2- 172.21.15.153:0/3231808568 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7ff428007030 0x7ff428029940 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.522+0000 7ff43f0dd680 1 -- 172.21.15.153:0/3231808568 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x561538195890 msgr2=0x5615381a4fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.522+0000 7ff43f0dd680 1 --2- 172.21.15.153:0/3231808568 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x561538195890 0x5615381a4fb0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.522+0000 7ff43f0dd680 1 -- 172.21.15.153:0/3231808568 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ff424039b90 msgr2=0x7ff42401ca00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.522+0000 7ff43f0dd680 1 --2- 172.21.15.153:0/3231808568 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7ff424039b90 0x7ff42401ca00 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.522+0000 7ff43f0dd680 1 -- 172.21.15.153:0/3231808568 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5615381a5a00 msgr2=0x5615381a7de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.522+0000 7ff43f0dd680 1 --2- 172.21.15.153:0/3231808568 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5615381a5a00 0x5615381a7de0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.522+0000 7ff43f0dd680 1 -- 172.21.15.153:0/3231808568 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff414034140 msgr2=0x7ff4140365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.522+0000 7ff43f0dd680 1 --2- 172.21.15.153:0/3231808568 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff414034140 0x7ff4140365f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff428003080 tx=0x7ff428015000 comp rx=0 tx=0).stop 2023-10-05T21:17:00.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.522+0000 7ff4329b6700 1 -- 172.21.15.153:0/3231808568 reap_dead start 2023-10-05T21:17:00.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.522+0000 7ff43f0dd680 1 -- 172.21.15.153:0/3231808568 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561538133b20 msgr2=0x56153815be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.522+0000 7ff43f0dd680 1 --2- 172.21.15.153:0/3231808568 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561538133b20 0x56153815be60 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff4240017d0 tx=0x7ff424016000 comp rx=0 tx=0).stop 2023-10-05T21:17:00.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.522+0000 7ff43f0dd680 1 -- 172.21.15.153:0/3231808568 shutdown_connections 2023-10-05T21:17:00.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.522+0000 7ff43f0dd680 1 --2- 172.21.15.153:0/3231808568 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561538133b20 0x56153815be60 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.522+0000 7ff43f0dd680 1 -- 172.21.15.153:0/3231808568 >> 172.21.15.153:0/3231808568 conn(0x56153812d3e0 msgr2=0x56153814ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.522+0000 7ff43f0dd680 1 -- 172.21.15.153:0/3231808568 shutdown_connections 2023-10-05T21:17:00.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.522+0000 7ff43f0dd680 1 -- 172.21.15.153:0/3231808568 wait complete. 2023-10-05T21:17:00.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.522+0000 7ff43f0dd680 1 -- 172.21.15.153:0/489280493 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff3800340f0 msgr2=0x7ff3800365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.522+0000 7ff43f0dd680 1 --2- 172.21.15.153:0/489280493 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff3800340f0 0x7ff3800365a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x5615381513c0 tx=0x7ff42c005880 comp rx=0 tx=0).stop 2023-10-05T21:17:00.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.522+0000 7ff43f0dd680 1 -- 172.21.15.153:0/489280493 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56153816dd00 msgr2=0x561538174f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.522+0000 7ff43f0dd680 1 --2- 172.21.15.153:0/489280493 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56153816dd00 0x561538174f50 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ff42401a1c0 tx=0x7ff424031000 comp rx=0 tx=0).stop 2023-10-05T21:17:00.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.522+0000 7ff43f0dd680 1 -- 172.21.15.153:0/489280493 shutdown_connections 2023-10-05T21:17:00.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.522+0000 7ff43f0dd680 1 --2- 172.21.15.153:0/489280493 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7ff3800340f0 0x7ff3800365a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.522+0000 7ff43f0dd680 1 --2- 172.21.15.153:0/489280493 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56153816dd00 0x561538174f50 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.522+0000 7ff43f0dd680 1 -- 172.21.15.153:0/489280493 >> 172.21.15.153:0/489280493 conn(0x561538139e10 msgr2=0x56153816a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.522+0000 7ff43f0dd680 1 -- 172.21.15.153:0/489280493 shutdown_connections 2023-10-05T21:17:00.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.523+0000 7ff43f0dd680 1 -- 172.21.15.153:0/489280493 wait complete. 2023-10-05T21:17:00.540 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:17:00.540 INFO:teuthology.orchestra.run.smithi153.stdout: "id": "193cdd3f-16f8-4551-b3a7-d103e6acfa54", 2023-10-05T21:17:00.540 INFO:teuthology.orchestra.run.smithi153.stdout: "name": "default", 2023-10-05T21:17:00.540 INFO:teuthology.orchestra.run.smithi153.stdout: "domain_root": "default.rgw.meta:root", 2023-10-05T21:17:00.541 INFO:teuthology.orchestra.run.smithi153.stdout: "control_pool": "default.rgw.control", 2023-10-05T21:17:00.541 INFO:teuthology.orchestra.run.smithi153.stdout: "gc_pool": "default.rgw.log:gc", 2023-10-05T21:17:00.541 INFO:teuthology.orchestra.run.smithi153.stdout: "lc_pool": "default.rgw.log:lc", 2023-10-05T21:17:00.541 INFO:teuthology.orchestra.run.smithi153.stdout: "log_pool": "default.rgw.log", 2023-10-05T21:17:00.541 INFO:teuthology.orchestra.run.smithi153.stdout: "intent_log_pool": "default.rgw.log:intent", 2023-10-05T21:17:00.541 INFO:teuthology.orchestra.run.smithi153.stdout: "usage_log_pool": "default.rgw.log:usage", 2023-10-05T21:17:00.541 INFO:teuthology.orchestra.run.smithi153.stdout: "roles_pool": "default.rgw.meta:roles", 2023-10-05T21:17:00.541 INFO:teuthology.orchestra.run.smithi153.stdout: "reshard_pool": "default.rgw.log:reshard", 2023-10-05T21:17:00.541 INFO:teuthology.orchestra.run.smithi153.stdout: "user_keys_pool": "default.rgw.meta:users.keys", 2023-10-05T21:17:00.541 INFO:teuthology.orchestra.run.smithi153.stdout: "user_email_pool": "default.rgw.meta:users.email", 2023-10-05T21:17:00.541 INFO:teuthology.orchestra.run.smithi153.stdout: "user_swift_pool": "default.rgw.meta:users.swift", 2023-10-05T21:17:00.542 INFO:teuthology.orchestra.run.smithi153.stdout: "user_uid_pool": "default.rgw.meta:users.uid", 2023-10-05T21:17:00.542 INFO:teuthology.orchestra.run.smithi153.stdout: "otp_pool": "default.rgw.otp", 2023-10-05T21:17:00.542 INFO:teuthology.orchestra.run.smithi153.stdout: "system_key": { 2023-10-05T21:17:00.542 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "", 2023-10-05T21:17:00.542 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "" 2023-10-05T21:17:00.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:17:00.542 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_pools": [ 2023-10-05T21:17:00.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:17:00.542 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "default-placement", 2023-10-05T21:17:00.542 INFO:teuthology.orchestra.run.smithi153.stdout: "val": { 2023-10-05T21:17:00.542 INFO:teuthology.orchestra.run.smithi153.stdout: "index_pool": "default.rgw.buckets.index", 2023-10-05T21:17:00.543 INFO:teuthology.orchestra.run.smithi153.stdout: "storage_classes": { 2023-10-05T21:17:00.543 INFO:teuthology.orchestra.run.smithi153.stdout: "STANDARD": { 2023-10-05T21:17:00.543 INFO:teuthology.orchestra.run.smithi153.stdout: "data_pool": "default.rgw.buckets.data" 2023-10-05T21:17:00.543 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:17:00.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:17:00.543 INFO:teuthology.orchestra.run.smithi153.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2023-10-05T21:17:00.543 INFO:teuthology.orchestra.run.smithi153.stdout: "index_type": 0, 2023-10-05T21:17:00.543 INFO:teuthology.orchestra.run.smithi153.stdout: "inline_data": "true" 2023-10-05T21:17:00.543 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:17:00.543 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:17:00.543 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:17:00.543 INFO:teuthology.orchestra.run.smithi153.stdout: "realm_id": "", 2023-10-05T21:17:00.544 INFO:teuthology.orchestra.run.smithi153.stdout: "notif_pool": "default.rgw.log:notif" 2023-10-05T21:17:00.544 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:17:00.544 DEBUG:tasks.util.rgw: json result: {'id': '193cdd3f-16f8-4551-b3a7-d103e6acfa54', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': 'true'}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-10-05T21:17:00.545 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2023-10-05T21:17:00.545 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2023-10-05T21:17:00.545 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2023-10-05T21:17:00.623 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:17:00.623 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:17:00.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.622+0000 7fdefa4de680 1 Processor -- start 2023-10-05T21:17:00.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.623+0000 7fdefa4de680 1 -- start start 2023-10-05T21:17:00.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.623+0000 7fdefa4de680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x562b0bb82a20 0x562b0bb82e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.623+0000 7fdefa4de680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562b0bacf970 con 0x562b0bb83370 2023-10-05T21:17:00.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.623+0000 7fdefa4de680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x562b0ba8fdb0 con 0x562b0bb82a20 2023-10-05T21:17:00.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.623+0000 7fdeed5b6700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x562b0bb82a20 0x562b0bb82e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.623+0000 7fdeecdb5700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x562b0bb83370 0x562b0bb89d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:57262/0 (socket says 172.21.15.153:57262) 2023-10-05T21:17:00.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.623+0000 7fdeecdb5700 1 -- 172.21.15.153:0/1078223353 learned_addr learned my addr 172.21.15.153:0/1078223353 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:17:00.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.623+0000 7fdedffff700 1 -- 172.21.15.153:0/1078223353 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4206627344 0 0) 0x562b0bacf970 con 0x562b0bb83370 2023-10-05T21:17:00.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.623+0000 7fdedffff700 1 -- 172.21.15.153:0/1078223353 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fded8001e10 con 0x562b0bb83370 2023-10-05T21:17:00.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.623+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1078223353 >> v1:172.21.15.111:6789/0 conn(0x562b0bb83370 legacy=0x562b0bb89d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.623+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1078223353 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b0bb8c440 con 0x562b0bb82a20 2023-10-05T21:17:00.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.624+0000 7fdeed5b6700 1 --2- 172.21.15.153:0/1078223353 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562b0bb82a20 0x562b0bb82e30 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fdee000a5d0 tx=0x7fdee0005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8bf8981aabeb466 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.624+0000 7fdedffff700 1 -- 172.21.15.153:0/1078223353 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdee0007610 con 0x562b0bb82a20 2023-10-05T21:17:00.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.624+0000 7fdedffff700 1 -- 172.21.15.153:0/1078223353 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee0007770 con 0x562b0bb82a20 2023-10-05T21:17:00.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.624+0000 7fdedffff700 1 -- 172.21.15.153:0/1078223353 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdee0007a40 con 0x562b0bb82a20 2023-10-05T21:17:00.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.624+0000 7fdefa4de680 1 -- 172.21.15.153:0/1078223353 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562b0bb82a20 msgr2=0x562b0bb82e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.624+0000 7fdefa4de680 1 --2- 172.21.15.153:0/1078223353 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562b0bb82a20 0x562b0bb82e30 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fdee000a5d0 tx=0x7fdee0005a50 comp rx=0 tx=0).stop 2023-10-05T21:17:00.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.624+0000 7fdefa4de680 1 -- 172.21.15.153:0/1078223353 shutdown_connections 2023-10-05T21:17:00.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.624+0000 7fdefa4de680 1 --2- 172.21.15.153:0/1078223353 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562b0bb82a20 0x562b0bb82e30 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.624+0000 7fdefa4de680 1 -- 172.21.15.153:0/1078223353 >> 172.21.15.153:0/1078223353 conn(0x562b0bb7c2e0 msgr2=0x562b0bb7e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.624+0000 7fdefa4de680 1 -- 172.21.15.153:0/1078223353 shutdown_connections 2023-10-05T21:17:00.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.624+0000 7fdefa4de680 1 -- 172.21.15.153:0/1078223353 wait complete. 2023-10-05T21:17:00.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.625+0000 7fdefa4de680 1 Processor -- start 2023-10-05T21:17:00.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.625+0000 7fdefa4de680 1 -- start start 2023-10-05T21:17:00.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.625+0000 7fdefa4de680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562b0bb82a20 0x562b0bba3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.625+0000 7fdefa4de680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b0ba2fea0 con 0x562b0bb82a20 2023-10-05T21:17:00.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.625+0000 7fdeed5b6700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562b0bb82a20 0x562b0bba3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.625+0000 7fdeed5b6700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562b0bb82a20 0x562b0bba3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60684/0 (socket says 172.21.15.153:60684) 2023-10-05T21:17:00.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.625+0000 7fdeed5b6700 1 -- 172.21.15.153:0/3763544114 learned_addr learned my addr 172.21.15.153:0/3763544114 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.626+0000 7fdeed5b6700 1 -- 172.21.15.153:0/3763544114 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee0005cf0 con 0x562b0bb82a20 2023-10-05T21:17:00.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.626+0000 7fdeed5b6700 1 --2- 172.21.15.153:0/3763544114 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562b0bb82a20 0x562b0bba3800 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fdee0000c00 tx=0x7fdee0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d64823f6ddaba5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.626+0000 7fdedeffd700 1 -- 172.21.15.153:0/3763544114 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdee00078e0 con 0x562b0bb82a20 2023-10-05T21:17:00.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.626+0000 7fdedeffd700 1 -- 172.21.15.153:0/3763544114 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee0007a40 con 0x562b0bb82a20 2023-10-05T21:17:00.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.626+0000 7fdedeffd700 1 -- 172.21.15.153:0/3763544114 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdee0007bf0 con 0x562b0bb82a20 2023-10-05T21:17:00.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.626+0000 7fdefa4de680 1 -- 172.21.15.153:0/3763544114 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562b0bb82a20 msgr2=0x562b0bba3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.626+0000 7fdefa4de680 1 --2- 172.21.15.153:0/3763544114 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562b0bb82a20 0x562b0bba3800 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fdee0000c00 tx=0x7fdee0014000 comp rx=0 tx=0).stop 2023-10-05T21:17:00.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.626+0000 7fdefa4de680 1 -- 172.21.15.153:0/3763544114 shutdown_connections 2023-10-05T21:17:00.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.626+0000 7fdefa4de680 1 --2- 172.21.15.153:0/3763544114 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562b0bb82a20 0x562b0bba3800 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.626+0000 7fdefa4de680 1 -- 172.21.15.153:0/3763544114 >> 172.21.15.153:0/3763544114 conn(0x562b0bb7c2e0 msgr2=0x562b0bb9f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.626+0000 7fdefa4de680 1 -- 172.21.15.153:0/3763544114 shutdown_connections 2023-10-05T21:17:00.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.626+0000 7fdefa4de680 1 -- 172.21.15.153:0/3763544114 wait complete. 2023-10-05T21:17:00.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.627+0000 7fdefa4de680 1 Processor -- start 2023-10-05T21:17:00.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.627+0000 7fdefa4de680 1 -- start start 2023-10-05T21:17:00.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.627+0000 7fdefa4de680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562b0bb82a20 0x562b0bbaac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.627+0000 7fdefa4de680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b0ba26c80 con 0x562b0bb82a20 2023-10-05T21:17:00.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.627+0000 7fdeed5b6700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562b0bb82a20 0x562b0bbaac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.627+0000 7fdeed5b6700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562b0bb82a20 0x562b0bbaac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60686/0 (socket says 172.21.15.153:60686) 2023-10-05T21:17:00.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.627+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 learned_addr learned my addr 172.21.15.153:0/1116929937 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.628+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b0bb8c440 con 0x562b0bb82a20 2023-10-05T21:17:00.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.628+0000 7fdeed5b6700 1 --2- 172.21.15.153:0/1116929937 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562b0bb82a20 0x562b0bbaac10 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fdee000a520 tx=0x7fdee001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.628+0000 7fdedd7fa700 1 -- 172.21.15.153:0/1116929937 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdee0007c80 con 0x562b0bb82a20 2023-10-05T21:17:00.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.628+0000 7fdedd7fa700 1 -- 172.21.15.153:0/1116929937 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee0026640 con 0x562b0bb82a20 2023-10-05T21:17:00.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.628+0000 7fdefa4de680 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562b0bbab150 con 0x562b0bb82a20 2023-10-05T21:17:00.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.628+0000 7fdedd7fa700 1 -- 172.21.15.153:0/1116929937 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdee00267d0 con 0x562b0bb82a20 2023-10-05T21:17:00.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.628+0000 7fdefa4de680 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562b0bbab600 con 0x562b0bb82a20 2023-10-05T21:17:00.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.629+0000 7fdedd7fa700 1 -- 172.21.15.153:0/1116929937 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fdee0026930 con 0x562b0bb82a20 2023-10-05T21:17:00.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.629+0000 7fdefa4de680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:17:00.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.629+0000 7fdefa4de680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:17:00.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.629+0000 7fdefa4de680 1 Processor -- start 2023-10-05T21:17:00.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.629+0000 7fdedd7fa700 1 --2- 172.21.15.153:0/1116929937 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fded0034140 0x7fded00365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.629+0000 7fdedd7fa700 1 -- 172.21.15.153:0/1116929937 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fdee000ae40 con 0x562b0bb82a20 2023-10-05T21:17:00.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.629+0000 7fdefa4de680 1 -- start start 2023-10-05T21:17:00.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.629+0000 7fdeeddb7700 1 --2- 172.21.15.153:0/1116929937 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fded0034140 0x7fded00365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.629+0000 7fdefa4de680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562b0bbbcc20 0x562b0bbbd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.629+0000 7fdefa4de680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b0bbbd550 con 0x562b0bbbcc20 2023-10-05T21:17:00.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.630+0000 7fdeeddb7700 1 --2- 172.21.15.153:0/1116929937 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fded0034140 0x7fded00365f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x562b0bba0220 tx=0x7fdee8005880 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.630+0000 7fdeed5b6700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562b0bbbcc20 0x562b0bbbd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.630+0000 7fdeed5b6700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562b0bbbcc20 0x562b0bbbd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60702/0 (socket says 172.21.15.153:60702) 2023-10-05T21:17:00.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.630+0000 7fdeed5b6700 1 -- 172.21.15.153:0/3493796792 learned_addr learned my addr 172.21.15.153:0/3493796792 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.630+0000 7fdeed5b6700 1 -- 172.21.15.153:0/3493796792 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b0bbbd690 con 0x562b0bbbcc20 2023-10-05T21:17:00.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.630+0000 7fdeed5b6700 1 --2- 172.21.15.153:0/3493796792 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562b0bbbcc20 0x562b0bbbd010 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fdee0048f30 tx=0x7fdee0048e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6dc68718532af2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.630+0000 7fdebe7e4700 1 -- 172.21.15.153:0/3493796792 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdee0048210 con 0x562b0bbbcc20 2023-10-05T21:17:00.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.630+0000 7fdebe7e4700 1 -- 172.21.15.153:0/3493796792 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee0038c80 con 0x562b0bbbcc20 2023-10-05T21:17:00.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.630+0000 7fdebe7e4700 1 -- 172.21.15.153:0/3493796792 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdee002f5e0 con 0x562b0bbbcc20 2023-10-05T21:17:00.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.631+0000 7fdefa4de680 1 -- 172.21.15.153:0/3493796792 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562b0bbbcc20 msgr2=0x562b0bbbd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.631+0000 7fdefa4de680 1 --2- 172.21.15.153:0/3493796792 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562b0bbbcc20 0x562b0bbbd010 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fdee0048f30 tx=0x7fdee0048e90 comp rx=0 tx=0).stop 2023-10-05T21:17:00.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.631+0000 7fdefa4de680 1 -- 172.21.15.153:0/3493796792 shutdown_connections 2023-10-05T21:17:00.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.631+0000 7fdefa4de680 1 --2- 172.21.15.153:0/3493796792 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562b0bbbcc20 0x562b0bbbd010 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.631+0000 7fdefa4de680 1 -- 172.21.15.153:0/3493796792 >> 172.21.15.153:0/3493796792 conn(0x562b0bb83370 msgr2=0x562b0bbb9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.631+0000 7fdefa4de680 1 -- 172.21.15.153:0/3493796792 shutdown_connections 2023-10-05T21:17:00.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.631+0000 7fdefa4de680 1 -- 172.21.15.153:0/3493796792 wait complete. 2023-10-05T21:17:00.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.631+0000 7fdefa4de680 1 Processor -- start 2023-10-05T21:17:00.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.631+0000 7fdefa4de680 1 -- start start 2023-10-05T21:17:00.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.631+0000 7fdefa4de680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562b0bbbcc20 0x562b0bbc3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.631+0000 7fdefa4de680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b0bbc42e0 con 0x562b0bbbcc20 2023-10-05T21:17:00.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.631+0000 7fdeed5b6700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562b0bbbcc20 0x562b0bbc3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.631+0000 7fdeed5b6700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562b0bbbcc20 0x562b0bbc3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60710/0 (socket says 172.21.15.153:60710) 2023-10-05T21:17:00.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.631+0000 7fdeed5b6700 1 -- 172.21.15.153:0/3631827162 learned_addr learned my addr 172.21.15.153:0/3631827162 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.632+0000 7fdeed5b6700 1 -- 172.21.15.153:0/3631827162 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b0bbab600 con 0x562b0bbbcc20 2023-10-05T21:17:00.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.632+0000 7fdeed5b6700 1 --2- 172.21.15.153:0/3631827162 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562b0bbbcc20 0x562b0bbc3da0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fdee00484d0 tx=0x7fdee0046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.632+0000 7fdebcfe1700 1 -- 172.21.15.153:0/3631827162 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdee0026e80 con 0x562b0bbbcc20 2023-10-05T21:17:00.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.632+0000 7fdebcfe1700 1 -- 172.21.15.153:0/3631827162 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee001c960 con 0x562b0bbbcc20 2023-10-05T21:17:00.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.632+0000 7fdefa4de680 1 -- 172.21.15.153:0/3631827162 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562b0bbc44e0 con 0x562b0bbbcc20 2023-10-05T21:17:00.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.632+0000 7fdebcfe1700 1 -- 172.21.15.153:0/3631827162 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdee004a500 con 0x562b0bbbcc20 2023-10-05T21:17:00.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.632+0000 7fdefa4de680 1 -- 172.21.15.153:0/3631827162 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562b0bbc48f0 con 0x562b0bbbcc20 2023-10-05T21:17:00.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.633+0000 7fdebcfe1700 1 -- 172.21.15.153:0/3631827162 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fdee004a660 con 0x562b0bbbcc20 2023-10-05T21:17:00.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.633+0000 7fdebcfe1700 1 --2- 172.21.15.153:0/3631827162 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fde3c0340f0 0x7fde3c0365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.633+0000 7fdebcfe1700 1 -- 172.21.15.153:0/3631827162 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fdee0054bb0 con 0x562b0bbbcc20 2023-10-05T21:17:00.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.633+0000 7fdeecdb5700 1 --2- 172.21.15.153:0/3631827162 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fde3c0340f0 0x7fde3c0365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.633+0000 7fde367fc700 20 reqs_thread_entry: start 2023-10-05T21:17:00.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.633+0000 7fdefa4de680 20 try_to_resolve_local_entities(): before: realm_id= realm_name= zonegroup_id= zonegroup_name= zone_id= zone_name= 2023-10-05T21:17:00.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.633+0000 7fdefa4de680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.633+0000 7fdefa4de680 1 --2- 172.21.15.153:0/1116929937 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x562b0bbe4600 0x562b0bbf3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.633+0000 7fdefa4de680 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbe49d0 con 0x562b0bbe4600 2023-10-05T21:17:00.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.633+0000 7fdeeddb7700 1 --2- 172.21.15.153:0/1116929937 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x562b0bbe4600 0x562b0bbf3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.633+0000 7fdeecdb5700 1 --2- 172.21.15.153:0/3631827162 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fde3c0340f0 0x7fde3c0365a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdee4004170 tx=0x7fdee40012d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.634+0000 7fdeeddb7700 1 --2- 172.21.15.153:0/1116929937 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x562b0bbe4600 0x562b0bbf3d20 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.634+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdee8012040 con 0x562b0bbe4600 2023-10-05T21:17:00.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.634+0000 7fdefa4de680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.634+0000 7fdefa4de680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.634+0000 7fdefa4de680 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf4260 con 0x562b0bbe4600 2023-10-05T21:17:00.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.634+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fdee8012040 con 0x562b0bbe4600 2023-10-05T21:17:00.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.634+0000 7fdefa4de680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:17:00.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.634+0000 7fdefa4de680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.634+0000 7fdefa4de680 1 --2- 172.21.15.153:0/1116929937 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x562b0bbf4b20 0x562b0bbf6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.634+0000 7fdefa4de680 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:3 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf7440 con 0x562b0bbf4b20 2023-10-05T21:17:00.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.634+0000 7fdeed5b6700 1 --2- 172.21.15.153:0/1116929937 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x562b0bbf4b20 0x562b0bbf6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.635+0000 7fdeed5b6700 1 --2- 172.21.15.153:0/1116929937 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x562b0bbf4b20 0x562b0bbf6f00 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.635+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(3 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fdee0059070 con 0x562b0bbf4b20 2023-10-05T21:17:00.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.635+0000 7fdefa4de680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:17:00.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.635+0000 7fdefa4de680 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:4 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x562b0bbf4b20 2023-10-05T21:17:00.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.635+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(4 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee0059070 con 0x562b0bbf4b20 2023-10-05T21:17:00.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.635+0000 7fdeed5b6700 1 --2- 172.21.15.153:0/1116929937 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fdee0043070 0x7fdee00485a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.635+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:5 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x7fdee0043070 2023-10-05T21:17:00.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.635+0000 7fdeecdb5700 1 --2- 172.21.15.153:0/1116929937 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fdee0043070 0x7fdee00485a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.635+0000 7fdeecdb5700 1 --2- 172.21.15.153:0/1116929937 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fdee0043070 0x7fdee00485a0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.636+0000 7fdeecdb5700 1 -- 172.21.15.153:0/1116929937 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(5 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee4006070 con 0x7fdee0043070 2023-10-05T21:17:00.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.636+0000 7fdeecdb5700 1 --2- 172.21.15.153:0/1116929937 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fdee400ebd0 0x7fdee400d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.636+0000 7fdeecdb5700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:6 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x7fdee400ebd0 2023-10-05T21:17:00.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.636+0000 7fdeeddb7700 1 --2- 172.21.15.153:0/1116929937 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fdee400ebd0 0x7fdee400d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.636+0000 7fdeeddb7700 1 --2- 172.21.15.153:0/1116929937 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fdee400ebd0 0x7fdee400d8e0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.636+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee8012040 con 0x7fdee400ebd0 2023-10-05T21:17:00.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.637+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:7 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x562b0bbe4600 2023-10-05T21:17:00.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.637+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee8012040 con 0x562b0bbe4600 2023-10-05T21:17:00.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.637+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:8 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x562b0bbe4600 2023-10-05T21:17:00.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.637+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee8012040 con 0x562b0bbe4600 2023-10-05T21:17:00.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.637+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:9 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x7fdee400ebd0 2023-10-05T21:17:00.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.637+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee8012040 con 0x7fdee400ebd0 2023-10-05T21:17:00.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.637+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:10 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x7fdee400ebd0 2023-10-05T21:17:00.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.637+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee8012040 con 0x7fdee400ebd0 2023-10-05T21:17:00.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.637+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:11 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x7fdee0043070 2023-10-05T21:17:00.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.638+0000 7fdeecdb5700 1 -- 172.21.15.153:0/1116929937 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee4006070 con 0x7fdee0043070 2023-10-05T21:17:00.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.638+0000 7fdeecdb5700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:12 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x562b0bbf4b20 2023-10-05T21:17:00.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.638+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fdee0059070 con 0x562b0bbf4b20 2023-10-05T21:17:00.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.638+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:13 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x562b0bbe4600 2023-10-05T21:17:00.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.638+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee8012040 con 0x562b0bbe4600 2023-10-05T21:17:00.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.638+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:14 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x7fdee400ebd0 2023-10-05T21:17:00.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.638+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee8012040 con 0x7fdee400ebd0 2023-10-05T21:17:00.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.638+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x562b0bbe4600 2023-10-05T21:17:00.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.639+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee8012040 con 0x562b0bbe4600 2023-10-05T21:17:00.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.639+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:16 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x7fdee0043070 2023-10-05T21:17:00.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.639+0000 7fdeecdb5700 1 -- 172.21.15.153:0/1116929937 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee4006070 con 0x7fdee0043070 2023-10-05T21:17:00.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.639+0000 7fdeecdb5700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:17 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x562b0bbf4b20 2023-10-05T21:17:00.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.639+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee0059070 con 0x562b0bbf4b20 2023-10-05T21:17:00.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.639+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:18 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x562b0bbf4b20 2023-10-05T21:17:00.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.639+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(18 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee0059070 con 0x562b0bbf4b20 2023-10-05T21:17:00.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.639+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:19 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x7fdee400ebd0 2023-10-05T21:17:00.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.640+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee802a040 con 0x7fdee400ebd0 2023-10-05T21:17:00.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.640+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x562b0bbf4b20 2023-10-05T21:17:00.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.640+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee0059070 con 0x562b0bbf4b20 2023-10-05T21:17:00.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.640+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:21 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x562b0bbf4b20 2023-10-05T21:17:00.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.640+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee0059070 con 0x562b0bbf4b20 2023-10-05T21:17:00.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.640+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:22 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x562b0bbe4600 2023-10-05T21:17:00.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.640+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee802a040 con 0x562b0bbe4600 2023-10-05T21:17:00.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.640+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:23 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x562b0bbe4600 2023-10-05T21:17:00.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.641+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(23 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fdee802a040 con 0x562b0bbe4600 2023-10-05T21:17:00.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.641+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:24 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x7fdee400ebd0 2023-10-05T21:17:00.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.641+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee802a040 con 0x7fdee400ebd0 2023-10-05T21:17:00.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.641+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:25 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x562b0bbf4b20 2023-10-05T21:17:00.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.642+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(25 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee0059070 con 0x562b0bbf4b20 2023-10-05T21:17:00.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.642+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:26 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x7fdee0043070 2023-10-05T21:17:00.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.642+0000 7fdeecdb5700 1 -- 172.21.15.153:0/1116929937 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee4006070 con 0x7fdee0043070 2023-10-05T21:17:00.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.642+0000 7fdeecdb5700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:27 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x562b0bbe4600 2023-10-05T21:17:00.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.642+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee802a040 con 0x562b0bbe4600 2023-10-05T21:17:00.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.642+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:28 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x7fdee400ebd0 2023-10-05T21:17:00.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.642+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee802a040 con 0x7fdee400ebd0 2023-10-05T21:17:00.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.642+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:29 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x562b0bbf4b20 2023-10-05T21:17:00.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.643+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee0059070 con 0x562b0bbf4b20 2023-10-05T21:17:00.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.643+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x7fdee400ebd0 2023-10-05T21:17:00.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.643+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee802a040 con 0x7fdee400ebd0 2023-10-05T21:17:00.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.643+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:31 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x7fdee0043070 2023-10-05T21:17:00.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.643+0000 7fdeecdb5700 1 -- 172.21.15.153:0/1116929937 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee4006070 con 0x7fdee0043070 2023-10-05T21:17:00.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.643+0000 7fdeecdb5700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:32 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x562b0bbf4b20 2023-10-05T21:17:00.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.643+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee0059070 con 0x562b0bbf4b20 2023-10-05T21:17:00.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.643+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:33 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x7fdee400ebd0 2023-10-05T21:17:00.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.644+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee802a040 con 0x7fdee400ebd0 2023-10-05T21:17:00.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.644+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:34 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x562b0bbe4600 2023-10-05T21:17:00.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.644+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fdee802a040 con 0x562b0bbe4600 2023-10-05T21:17:00.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.644+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:35 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf8800 con 0x7fdee0043070 2023-10-05T21:17:00.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.644+0000 7fdeecdb5700 1 -- 172.21.15.153:0/1116929937 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee4006070 con 0x7fdee0043070 2023-10-05T21:17:00.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.644+0000 7fdefa4de680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:17:00.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.644+0000 7fdefa4de680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:17:00.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.644+0000 7fdefa4de680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:17:00.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.644+0000 7fdefa4de680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:17:00.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.644+0000 7fdefa4de680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.644+0000 7fdefa4de680 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf77f0 con 0x562b0bbe4600 2023-10-05T21:17:00.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.644+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(36 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fdee802a040 con 0x562b0bbe4600 2023-10-05T21:17:00.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.644+0000 7fdefa4de680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:17:00.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.644+0000 7fdefa4de680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.644+0000 7fdefa4de680 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:37 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbf7ba0 con 0x562b0bbf4b20 2023-10-05T21:17:00.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.645+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(37 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fdee0059070 con 0x562b0bbf4b20 2023-10-05T21:17:00.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.645+0000 7fdefa4de680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:17:00.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.645+0000 7fdefa4de680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.645+0000 7fdefa4de680 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbe3d10 con 0x562b0bbe4600 2023-10-05T21:17:00.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.645+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdee802a040 con 0x562b0bbe4600 2023-10-05T21:17:00.668 INFO:teuthology.orchestra.run.smithi153.stderr:zone id 193cdd3f-16f8-4551-b3a7-d103e6acfa542023-10-05T21:17:00.645+0000 7fdefa4de680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.645+0000 7fdefa4de680 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:39 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x562b0bbf4b20 2023-10-05T21:17:00.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.645+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(39 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee0059070 con 0x562b0bbf4b20 2023-10-05T21:17:00.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.645+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:40 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x7fdee0043070 2023-10-05T21:17:00.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.646+0000 7fdeecdb5700 1 -- 172.21.15.153:0/1116929937 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(40 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee4006070 con 0x7fdee0043070 2023-10-05T21:17:00.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.646+0000 7fdeecdb5700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:41 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x7fdee400ebd0 2023-10-05T21:17:00.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.646+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(41 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee802a040 con 0x7fdee400ebd0 2023-10-05T21:17:00.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.646+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x562b0bbe4600 2023-10-05T21:17:00.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.646+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(42 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee802a040 con 0x562b0bbe4600 2023-10-05T21:17:00.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.646+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x562b0bbe4600 2023-10-05T21:17:00.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.647+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(43 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee802a040 con 0x562b0bbe4600 2023-10-05T21:17:00.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.647+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:44 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x7fdee400ebd0 2023-10-05T21:17:00.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.647+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(44 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee802a040 con 0x7fdee400ebd0 2023-10-05T21:17:00.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.647+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:45 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x7fdee400ebd0 2023-10-05T21:17:00.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.647+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(45 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee802a040 con 0x7fdee400ebd0 2023-10-05T21:17:00.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.647+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:46 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x7fdee0043070 2023-10-05T21:17:00.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.647+0000 7fdeecdb5700 1 -- 172.21.15.153:0/1116929937 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(46 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee4006070 con 0x7fdee0043070 2023-10-05T21:17:00.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.647+0000 7fdeecdb5700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:47 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x562b0bbf4b20 2023-10-05T21:17:00.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.648+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(47 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fdee0059070 con 0x562b0bbf4b20 2023-10-05T21:17:00.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.648+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x562b0bbe4600 2023-10-05T21:17:00.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.648+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(48 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee802a040 con 0x562b0bbe4600 2023-10-05T21:17:00.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.648+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x7fdee400ebd0 2023-10-05T21:17:00.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.648+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(49 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee802a040 con 0x7fdee400ebd0 2023-10-05T21:17:00.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.648+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:50 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x562b0bbe4600 2023-10-05T21:17:00.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.648+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(50 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee802a040 con 0x562b0bbe4600 2023-10-05T21:17:00.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.648+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x7fdee0043070 2023-10-05T21:17:00.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.648+0000 7fdeecdb5700 1 -- 172.21.15.153:0/1116929937 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(51 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee4006070 con 0x7fdee0043070 2023-10-05T21:17:00.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.648+0000 7fdeecdb5700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x562b0bbf4b20 2023-10-05T21:17:00.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.649+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(52 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee0059070 con 0x562b0bbf4b20 2023-10-05T21:17:00.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.649+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:53 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x562b0bbf4b20 2023-10-05T21:17:00.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.649+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(53 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee0059070 con 0x562b0bbf4b20 2023-10-05T21:17:00.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.649+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x7fdee400ebd0 2023-10-05T21:17:00.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.649+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(54 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee802a040 con 0x7fdee400ebd0 2023-10-05T21:17:00.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.649+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:55 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x562b0bbf4b20 2023-10-05T21:17:00.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.649+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(55 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee0059070 con 0x562b0bbf4b20 2023-10-05T21:17:00.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.649+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:56 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x562b0bbf4b20 2023-10-05T21:17:00.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.650+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(56 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee0059070 con 0x562b0bbf4b20 2023-10-05T21:17:00.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.650+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:57 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x562b0bbe4600 2023-10-05T21:17:00.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.650+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(57 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee802a040 con 0x562b0bbe4600 2023-10-05T21:17:00.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.650+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:58 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x562b0bbe4600 2023-10-05T21:17:00.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.650+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(58 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fdee802a040 con 0x562b0bbe4600 2023-10-05T21:17:00.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.650+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x7fdee400ebd0 2023-10-05T21:17:00.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.650+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(59 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee802a040 con 0x7fdee400ebd0 2023-10-05T21:17:00.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.650+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x562b0bbf4b20 2023-10-05T21:17:00.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.650+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(60 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee0059070 con 0x562b0bbf4b20 2023-10-05T21:17:00.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.650+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:61 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x7fdee0043070 2023-10-05T21:17:00.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.651+0000 7fdeecdb5700 1 -- 172.21.15.153:0/1116929937 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(61 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee4006070 con 0x7fdee0043070 2023-10-05T21:17:00.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.651+0000 7fdeecdb5700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x562b0bbe4600 2023-10-05T21:17:00.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.651+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee802a040 con 0x562b0bbe4600 2023-10-05T21:17:00.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.651+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:63 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x7fdee400ebd0 2023-10-05T21:17:00.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.651+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(63 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee802a040 con 0x7fdee400ebd0 2023-10-05T21:17:00.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.651+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:64 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x562b0bbf4b20 2023-10-05T21:17:00.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.651+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee0059070 con 0x562b0bbf4b20 2023-10-05T21:17:00.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.651+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:65 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x7fdee400ebd0 2023-10-05T21:17:00.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.652+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee802a040 con 0x7fdee400ebd0 2023-10-05T21:17:00.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.652+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x7fdee0043070 2023-10-05T21:17:00.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.652+0000 7fdeecdb5700 1 -- 172.21.15.153:0/1116929937 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee4006070 con 0x7fdee0043070 2023-10-05T21:17:00.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.652+0000 7fdeecdb5700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:67 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x562b0bbf4b20 2023-10-05T21:17:00.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.652+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee0059070 con 0x562b0bbf4b20 2023-10-05T21:17:00.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.652+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x7fdee400ebd0 2023-10-05T21:17:00.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.652+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee802a040 con 0x7fdee400ebd0 2023-10-05T21:17:00.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.652+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:69 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x562b0bbe4600 2023-10-05T21:17:00.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.652+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(69 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fdee802a040 con 0x562b0bbe4600 2023-10-05T21:17:00.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.652+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:70 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbffd50 con 0x7fdee0043070 2023-10-05T21:17:00.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.653+0000 7fdeecdb5700 1 -- 172.21.15.153:0/1116929937 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdee4006070 con 0x7fdee0043070 2023-10-05T21:17:00.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.653+0000 7fdefa4de680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:17:00.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.653+0000 7fdefa4de680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:17:00.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.653+0000 7fdefa4de680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:17:00.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.653+0000 7fdefa4de680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:17:00.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.653+0000 7fdefa4de680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.653+0000 7fdefa4de680 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:71 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbfe890 con 0x562b0bbe4600 2023-10-05T21:17:00.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.653+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(71 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fdee802a040 con 0x562b0bbe4600 2023-10-05T21:17:00.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.653+0000 7fdefa4de680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:17:00.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.653+0000 7fdefa4de680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.653+0000 7fdefa4de680 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbff360 con 0x562b0bbf4b20 2023-10-05T21:17:00.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.653+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(72 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fdee0059070 con 0x562b0bbf4b20 2023-10-05T21:17:00.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.653+0000 7fdefa4de680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:17:00.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.653+0000 7fdefa4de680 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:73 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [delete,create,writefull 0~1036 in=1036b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bbfdf30 con 0x562b0bbf4b20 2023-10-05T21:17:00.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.654+0000 7fdeed5b6700 1 -- 172.21.15.153:0/1116929937 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(73 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [delete,create,writefull 0~1036] v31'3 uv3 ondisk = 0) v8 ==== 274+0+0 (crc 0 0 0) 0x7fdee0059070 con 0x562b0bbf4b20 2023-10-05T21:17:00.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.654+0000 7fdefa4de680 1 -- 172.21.15.153:0/1116929937 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f43b6ece:::zone_names.default:head [delete,create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562b0bc01380 con 0x562b0bbe4600 2023-10-05T21:17:00.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.655+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(74 zone_names.default [delete,create,writefull 0~46] v31'3 uv3 ondisk = 0) v8 ==== 246+0+0 (crc 0 0 0) 0x7fdee802a040 con 0x562b0bbe4600 2023-10-05T21:17:00.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.655+0000 7fdefa4de680 1 -- 172.21.15.153:0/1116929937 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fdee400ebd0 msgr2=0x7fdee400d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.655+0000 7fdefa4de680 1 --2- 172.21.15.153:0/1116929937 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fdee400ebd0 0x7fdee400d8e0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.656+0000 7fdefa4de680 1 -- 172.21.15.153:0/1116929937 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x562b0bbe4600 msgr2=0x562b0bbf3d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.656+0000 7fdefa4de680 1 --2- 172.21.15.153:0/1116929937 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x562b0bbe4600 0x562b0bbf3d20 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.656+0000 7fdefa4de680 1 -- 172.21.15.153:0/1116929937 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fdee0043070 msgr2=0x7fdee00485a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.656+0000 7fdefa4de680 1 --2- 172.21.15.153:0/1116929937 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fdee0043070 0x7fdee00485a0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.656+0000 7fdefa4de680 1 -- 172.21.15.153:0/1116929937 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x562b0bbf4b20 msgr2=0x562b0bbf6f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.656+0000 7fdefa4de680 1 --2- 172.21.15.153:0/1116929937 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x562b0bbf4b20 0x562b0bbf6f00 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.656+0000 7fdefa4de680 1 -- 172.21.15.153:0/1116929937 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fded0034140 msgr2=0x7fded00365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.656+0000 7fdefa4de680 1 --2- 172.21.15.153:0/1116929937 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fded0034140 0x7fded00365f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x562b0bba0220 tx=0x7fdee8005880 comp rx=0 tx=0).stop 2023-10-05T21:17:00.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.656+0000 7fdefa4de680 1 -- 172.21.15.153:0/1116929937 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562b0bb82a20 msgr2=0x562b0bbaac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.656+0000 7fdefa4de680 1 --2- 172.21.15.153:0/1116929937 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562b0bb82a20 0x562b0bbaac10 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fdee000a520 tx=0x7fdee001c000 comp rx=0 tx=0).stop 2023-10-05T21:17:00.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.656+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 reap_dead start 2023-10-05T21:17:00.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.656+0000 7fdeeddb7700 1 -- 172.21.15.153:0/1116929937 reap_dead start 2023-10-05T21:17:00.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.656+0000 7fdefa4de680 1 -- 172.21.15.153:0/1116929937 shutdown_connections 2023-10-05T21:17:00.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.656+0000 7fdefa4de680 1 -- 172.21.15.153:0/1116929937 >> 172.21.15.153:0/1116929937 conn(0x562b0bb7c2e0 msgr2=0x562b0bb9db10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.656+0000 7fdefa4de680 1 -- 172.21.15.153:0/1116929937 shutdown_connections 2023-10-05T21:17:00.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.656+0000 7fdefa4de680 1 -- 172.21.15.153:0/1116929937 wait complete. 2023-10-05T21:17:00.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.656+0000 7fdefa4de680 1 -- 172.21.15.153:0/3631827162 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fde3c0340f0 msgr2=0x7fde3c0365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.656+0000 7fdefa4de680 1 --2- 172.21.15.153:0/3631827162 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fde3c0340f0 0x7fde3c0365a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdee4004170 tx=0x7fdee40012d0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.656+0000 7fdefa4de680 1 -- 172.21.15.153:0/3631827162 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562b0bbbcc20 msgr2=0x562b0bbc3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.656+0000 7fdefa4de680 1 --2- 172.21.15.153:0/3631827162 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562b0bbbcc20 0x562b0bbc3da0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fdee00484d0 tx=0x7fdee0046000 comp rx=0 tx=0).stop 2023-10-05T21:17:00.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.656+0000 7fdefa4de680 1 -- 172.21.15.153:0/3631827162 shutdown_connections 2023-10-05T21:17:00.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.656+0000 7fdefa4de680 1 --2- 172.21.15.153:0/3631827162 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fde3c0340f0 0x7fde3c0365a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.656+0000 7fdefa4de680 1 --2- 172.21.15.153:0/3631827162 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562b0bbbcc20 0x562b0bbc3da0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.656+0000 7fdefa4de680 1 -- 172.21.15.153:0/3631827162 >> 172.21.15.153:0/3631827162 conn(0x562b0bb83370 msgr2=0x562b0bbb9340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.656+0000 7fdefa4de680 1 -- 172.21.15.153:0/3631827162 shutdown_connections 2023-10-05T21:17:00.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.656+0000 7fdefa4de680 1 -- 172.21.15.153:0/3631827162 wait complete. 2023-10-05T21:17:00.679 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:17:00.679 INFO:teuthology.orchestra.run.smithi153.stdout: "id": "193cdd3f-16f8-4551-b3a7-d103e6acfa54", 2023-10-05T21:17:00.679 INFO:teuthology.orchestra.run.smithi153.stdout: "name": "default", 2023-10-05T21:17:00.679 INFO:teuthology.orchestra.run.smithi153.stdout: "domain_root": "default.rgw.meta:root", 2023-10-05T21:17:00.679 INFO:teuthology.orchestra.run.smithi153.stdout: "control_pool": "default.rgw.control", 2023-10-05T21:17:00.679 INFO:teuthology.orchestra.run.smithi153.stdout: "gc_pool": "default.rgw.log:gc", 2023-10-05T21:17:00.679 INFO:teuthology.orchestra.run.smithi153.stdout: "lc_pool": "default.rgw.log:lc", 2023-10-05T21:17:00.679 INFO:teuthology.orchestra.run.smithi153.stdout: "log_pool": "default.rgw.log", 2023-10-05T21:17:00.680 INFO:teuthology.orchestra.run.smithi153.stdout: "intent_log_pool": "default.rgw.log:intent", 2023-10-05T21:17:00.680 INFO:teuthology.orchestra.run.smithi153.stdout: "usage_log_pool": "default.rgw.log:usage", 2023-10-05T21:17:00.680 INFO:teuthology.orchestra.run.smithi153.stdout: "roles_pool": "default.rgw.meta:roles", 2023-10-05T21:17:00.680 INFO:teuthology.orchestra.run.smithi153.stdout: "reshard_pool": "default.rgw.log:reshard", 2023-10-05T21:17:00.680 INFO:teuthology.orchestra.run.smithi153.stdout: "user_keys_pool": "default.rgw.meta:users.keys", 2023-10-05T21:17:00.680 INFO:teuthology.orchestra.run.smithi153.stdout: "user_email_pool": "default.rgw.meta:users.email", 2023-10-05T21:17:00.680 INFO:teuthology.orchestra.run.smithi153.stdout: "user_swift_pool": "default.rgw.meta:users.swift", 2023-10-05T21:17:00.680 INFO:teuthology.orchestra.run.smithi153.stdout: "user_uid_pool": "default.rgw.meta:users.uid", 2023-10-05T21:17:00.680 INFO:teuthology.orchestra.run.smithi153.stdout: "otp_pool": "default.rgw.otp", 2023-10-05T21:17:00.680 INFO:teuthology.orchestra.run.smithi153.stdout: "system_key": { 2023-10-05T21:17:00.680 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "", 2023-10-05T21:17:00.680 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "" 2023-10-05T21:17:00.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:17:00.681 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_pools": [ 2023-10-05T21:17:00.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:17:00.681 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "default-placement", 2023-10-05T21:17:00.681 INFO:teuthology.orchestra.run.smithi153.stdout: "val": { 2023-10-05T21:17:00.681 INFO:teuthology.orchestra.run.smithi153.stdout: "index_pool": "default.rgw.buckets.index", 2023-10-05T21:17:00.681 INFO:teuthology.orchestra.run.smithi153.stdout: "storage_classes": { 2023-10-05T21:17:00.681 INFO:teuthology.orchestra.run.smithi153.stdout: "STANDARD": { 2023-10-05T21:17:00.681 INFO:teuthology.orchestra.run.smithi153.stdout: "data_pool": "default.rgw.buckets.data" 2023-10-05T21:17:00.681 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:17:00.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:17:00.681 INFO:teuthology.orchestra.run.smithi153.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2023-10-05T21:17:00.682 INFO:teuthology.orchestra.run.smithi153.stdout: "index_type": 0, 2023-10-05T21:17:00.682 INFO:teuthology.orchestra.run.smithi153.stdout: "inline_data": "true" 2023-10-05T21:17:00.682 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:17:00.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:17:00.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:17:00.682 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "new-placement", 2023-10-05T21:17:00.682 INFO:teuthology.orchestra.run.smithi153.stdout: "val": { 2023-10-05T21:17:00.682 INFO:teuthology.orchestra.run.smithi153.stdout: "index_pool": ".rgw.buckets.index.2", 2023-10-05T21:17:00.682 INFO:teuthology.orchestra.run.smithi153.stdout: "storage_classes": { 2023-10-05T21:17:00.682 INFO:teuthology.orchestra.run.smithi153.stdout: "STANDARD": { 2023-10-05T21:17:00.682 INFO:teuthology.orchestra.run.smithi153.stdout: "data_pool": ".rgw.buckets.2" 2023-10-05T21:17:00.682 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:17:00.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:17:00.683 INFO:teuthology.orchestra.run.smithi153.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2023-10-05T21:17:00.683 INFO:teuthology.orchestra.run.smithi153.stdout: "index_type": 0, 2023-10-05T21:17:00.683 INFO:teuthology.orchestra.run.smithi153.stdout: "inline_data": "false" 2023-10-05T21:17:00.683 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:17:00.683 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:17:00.683 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:17:00.683 INFO:teuthology.orchestra.run.smithi153.stdout: "realm_id": "", 2023-10-05T21:17:00.683 INFO:teuthology.orchestra.run.smithi153.stdout: "notif_pool": "default.rgw.log:notif" 2023-10-05T21:17:00.683 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:17:00.683 DEBUG:tasks.util.rgw: json result: {'id': '193cdd3f-16f8-4551-b3a7-d103e6acfa54', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': 'true'}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': 'false'}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-10-05T21:17:00.684 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2023-10-05T21:17:00.684 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2023-10-05T21:17:00.684 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2023-10-05T21:17:00.761 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:17:00.761 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:17:00.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.760+0000 7fd439dda680 1 Processor -- start 2023-10-05T21:17:00.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.760+0000 7fd439dda680 1 -- start start 2023-10-05T21:17:00.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.760+0000 7fd439dda680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x560b5c70c790 0x560b5c70eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.760+0000 7fd439dda680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560b5c655970 con 0x560b5c67c080 2023-10-05T21:17:00.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.760+0000 7fd439dda680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x560b5c615db0 con 0x560b5c70c790 2023-10-05T21:17:00.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.761+0000 7fd427fff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x560b5c70c790 0x560b5c70eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.761+0000 7fd42ceb2700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x560b5c67c080 0x560b5c70b070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:57264/0 (socket says 172.21.15.153:57264) 2023-10-05T21:17:00.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.761+0000 7fd42ceb2700 1 -- 172.21.15.153:0/1857604919 learned_addr learned my addr 172.21.15.153:0/1857604919 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:17:00.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.761+0000 7fd427fff700 1 -- 172.21.15.153:0/1857604919 >> v1:172.21.15.111:6789/0 conn(0x560b5c67c080 legacy=0x560b5c70b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.761+0000 7fd4277fe700 1 -- 172.21.15.153:0/1857604919 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1515631124 0 0) 0x560b5c655970 con 0x560b5c67c080 2023-10-05T21:17:00.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.761+0000 7fd427fff700 1 -- 172.21.15.153:0/1857604919 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b5c7101c0 con 0x560b5c70c790 2023-10-05T21:17:00.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.761+0000 7fd427fff700 1 --2- 172.21.15.153:0/1857604919 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560b5c70c790 0x560b5c70eb70 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fd41800a5d0 tx=0x7fd418005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3ed0ef8d144b9d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.762+0000 7fd4277fe700 1 -- 172.21.15.153:0/1857604919 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4180086a0 con 0x560b5c70c790 2023-10-05T21:17:00.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.762+0000 7fd4277fe700 1 -- 172.21.15.153:0/1857604919 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd418008800 con 0x560b5c70c790 2023-10-05T21:17:00.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.762+0000 7fd4277fe700 1 -- 172.21.15.153:0/1857604919 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd418008ad0 con 0x560b5c70c790 2023-10-05T21:17:00.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.762+0000 7fd439dda680 1 -- 172.21.15.153:0/1857604919 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560b5c70c790 msgr2=0x560b5c70eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.762+0000 7fd439dda680 1 --2- 172.21.15.153:0/1857604919 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560b5c70c790 0x560b5c70eb70 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fd41800a5d0 tx=0x7fd418005a50 comp rx=0 tx=0).stop 2023-10-05T21:17:00.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.762+0000 7fd439dda680 1 -- 172.21.15.153:0/1857604919 shutdown_connections 2023-10-05T21:17:00.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.762+0000 7fd439dda680 1 --2- 172.21.15.153:0/1857604919 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560b5c70c790 0x560b5c70eb70 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.762+0000 7fd439dda680 1 -- 172.21.15.153:0/1857604919 >> 172.21.15.153:0/1857604919 conn(0x560b5c702b60 msgr2=0x560b5c704f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.762+0000 7fd439dda680 1 -- 172.21.15.153:0/1857604919 shutdown_connections 2023-10-05T21:17:00.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.762+0000 7fd439dda680 1 -- 172.21.15.153:0/1857604919 wait complete. 2023-10-05T21:17:00.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.763+0000 7fd439dda680 1 Processor -- start 2023-10-05T21:17:00.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.763+0000 7fd439dda680 1 -- start start 2023-10-05T21:17:00.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.763+0000 7fd439dda680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560b5c67c080 0x560b5c708990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.763+0000 7fd439dda680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b5c5b5ea0 con 0x560b5c67c080 2023-10-05T21:17:00.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.763+0000 7fd42ceb2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560b5c67c080 0x560b5c708990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.763+0000 7fd42ceb2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560b5c67c080 0x560b5c708990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60732/0 (socket says 172.21.15.153:60732) 2023-10-05T21:17:00.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.763+0000 7fd42ceb2700 1 -- 172.21.15.153:0/91990364 learned_addr learned my addr 172.21.15.153:0/91990364 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.763+0000 7fd42ceb2700 1 -- 172.21.15.153:0/91990364 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd418005cf0 con 0x560b5c67c080 2023-10-05T21:17:00.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.764+0000 7fd42ceb2700 1 --2- 172.21.15.153:0/91990364 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560b5c67c080 0x560b5c708990 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd420001d70 tx=0x7fd420001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6585e1d9db4745c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.764+0000 7fd4267fc700 1 -- 172.21.15.153:0/91990364 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd42000bcc0 con 0x560b5c67c080 2023-10-05T21:17:00.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.764+0000 7fd4267fc700 1 -- 172.21.15.153:0/91990364 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42000be20 con 0x560b5c67c080 2023-10-05T21:17:00.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.764+0000 7fd4267fc700 1 -- 172.21.15.153:0/91990364 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd42000e5f0 con 0x560b5c67c080 2023-10-05T21:17:00.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.764+0000 7fd439dda680 1 -- 172.21.15.153:0/91990364 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560b5c67c080 msgr2=0x560b5c708990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.764+0000 7fd439dda680 1 --2- 172.21.15.153:0/91990364 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560b5c67c080 0x560b5c708990 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd420001d70 tx=0x7fd420001770 comp rx=0 tx=0).stop 2023-10-05T21:17:00.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.764+0000 7fd439dda680 1 -- 172.21.15.153:0/91990364 shutdown_connections 2023-10-05T21:17:00.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.764+0000 7fd439dda680 1 --2- 172.21.15.153:0/91990364 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560b5c67c080 0x560b5c708990 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.764+0000 7fd439dda680 1 -- 172.21.15.153:0/91990364 >> 172.21.15.153:0/91990364 conn(0x560b5c702b60 msgr2=0x560b5c7231c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.764+0000 7fd439dda680 1 -- 172.21.15.153:0/91990364 shutdown_connections 2023-10-05T21:17:00.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.764+0000 7fd439dda680 1 -- 172.21.15.153:0/91990364 wait complete. 2023-10-05T21:17:00.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.765+0000 7fd439dda680 1 Processor -- start 2023-10-05T21:17:00.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.765+0000 7fd439dda680 1 -- start start 2023-10-05T21:17:00.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.765+0000 7fd439dda680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560b5c67c080 0x560b5c730d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.765+0000 7fd439dda680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b5c5acc80 con 0x560b5c67c080 2023-10-05T21:17:00.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.765+0000 7fd42ceb2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560b5c67c080 0x560b5c730d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.765+0000 7fd42ceb2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560b5c67c080 0x560b5c730d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60740/0 (socket says 172.21.15.153:60740) 2023-10-05T21:17:00.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.765+0000 7fd42ceb2700 1 -- 172.21.15.153:0/2256111698 learned_addr learned my addr 172.21.15.153:0/2256111698 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.765+0000 7fd42ceb2700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd420001a50 con 0x560b5c67c080 2023-10-05T21:17:00.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.766+0000 7fd42ceb2700 1 --2- 172.21.15.153:0/2256111698 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560b5c67c080 0x560b5c730d70 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fd42000c010 tx=0x7fd420016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.766+0000 7fd424ff9700 1 -- 172.21.15.153:0/2256111698 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd42001f070 con 0x560b5c67c080 2023-10-05T21:17:00.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.766+0000 7fd424ff9700 1 -- 172.21.15.153:0/2256111698 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42001a550 con 0x560b5c67c080 2023-10-05T21:17:00.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.766+0000 7fd439dda680 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560b5c7312b0 con 0x560b5c67c080 2023-10-05T21:17:00.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.766+0000 7fd424ff9700 1 -- 172.21.15.153:0/2256111698 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd42001a840 con 0x560b5c67c080 2023-10-05T21:17:00.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.766+0000 7fd439dda680 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560b5c7316a0 con 0x560b5c67c080 2023-10-05T21:17:00.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.767+0000 7fd424ff9700 1 -- 172.21.15.153:0/2256111698 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fd42001a9a0 con 0x560b5c67c080 2023-10-05T21:17:00.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.767+0000 7fd439dda680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:17:00.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.767+0000 7fd439dda680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:17:00.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.767+0000 7fd439dda680 1 Processor -- start 2023-10-05T21:17:00.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.767+0000 7fd424ff9700 1 --2- 172.21.15.153:0/2256111698 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd410034140 0x7fd4100365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.767+0000 7fd424ff9700 1 -- 172.21.15.153:0/2256111698 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fd420048bb0 con 0x560b5c67c080 2023-10-05T21:17:00.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.767+0000 7fd439dda680 1 -- start start 2023-10-05T21:17:00.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.767+0000 7fd42d6b3700 1 --2- 172.21.15.153:0/2256111698 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd410034140 0x7fd4100365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.767+0000 7fd439dda680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560b5c742d50 0x560b5c743160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.767+0000 7fd439dda680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b5c7436a0 con 0x560b5c742d50 2023-10-05T21:17:00.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.768+0000 7fd42ceb2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560b5c742d50 0x560b5c743160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.768+0000 7fd42ceb2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560b5c742d50 0x560b5c743160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60750/0 (socket says 172.21.15.153:60750) 2023-10-05T21:17:00.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.768+0000 7fd42ceb2700 1 -- 172.21.15.153:0/399509798 learned_addr learned my addr 172.21.15.153:0/399509798 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.768+0000 7fd42d6b3700 1 --2- 172.21.15.153:0/2256111698 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd410034140 0x7fd4100365f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x560b5c724110 tx=0x7fd428005880 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.768+0000 7fd42ceb2700 1 -- 172.21.15.153:0/399509798 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b5c7437e0 con 0x560b5c742d50 2023-10-05T21:17:00.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.768+0000 7fd42ceb2700 1 --2- 172.21.15.153:0/399509798 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560b5c742d50 0x560b5c743160 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fd420001ed0 tx=0x7fd420046fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f74c55f40c108455 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.768+0000 7fd3fdfe3700 1 -- 172.21.15.153:0/399509798 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4200410c0 con 0x560b5c742d50 2023-10-05T21:17:00.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.768+0000 7fd3fdfe3700 1 -- 172.21.15.153:0/399509798 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd420041220 con 0x560b5c742d50 2023-10-05T21:17:00.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.768+0000 7fd3fdfe3700 1 -- 172.21.15.153:0/399509798 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd42000d510 con 0x560b5c742d50 2023-10-05T21:17:00.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.769+0000 7fd439dda680 1 -- 172.21.15.153:0/399509798 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560b5c742d50 msgr2=0x560b5c743160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.769+0000 7fd439dda680 1 --2- 172.21.15.153:0/399509798 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560b5c742d50 0x560b5c743160 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fd420001ed0 tx=0x7fd420046fd0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.769+0000 7fd439dda680 1 -- 172.21.15.153:0/399509798 shutdown_connections 2023-10-05T21:17:00.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.769+0000 7fd439dda680 1 --2- 172.21.15.153:0/399509798 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560b5c742d50 0x560b5c743160 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.769+0000 7fd439dda680 1 -- 172.21.15.153:0/399509798 >> 172.21.15.153:0/399509798 conn(0x560b5c70c790 msgr2=0x560b5c73f870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.769+0000 7fd439dda680 1 -- 172.21.15.153:0/399509798 shutdown_connections 2023-10-05T21:17:00.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.769+0000 7fd439dda680 1 -- 172.21.15.153:0/399509798 wait complete. 2023-10-05T21:17:00.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.769+0000 7fd439dda680 1 Processor -- start 2023-10-05T21:17:00.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.769+0000 7fd439dda680 1 -- start start 2023-10-05T21:17:00.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.769+0000 7fd439dda680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560b5c742d50 0x560b5c749e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.769+0000 7fd439dda680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b5c74a390 con 0x560b5c742d50 2023-10-05T21:17:00.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.770+0000 7fd42ceb2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560b5c742d50 0x560b5c749e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.770+0000 7fd42ceb2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560b5c742d50 0x560b5c749e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60752/0 (socket says 172.21.15.153:60752) 2023-10-05T21:17:00.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.770+0000 7fd42ceb2700 1 -- 172.21.15.153:0/2204923782 learned_addr learned my addr 172.21.15.153:0/2204923782 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.770+0000 7fd42ceb2700 1 -- 172.21.15.153:0/2204923782 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b5c7316a0 con 0x560b5c742d50 2023-10-05T21:17:00.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.770+0000 7fd42ceb2700 1 --2- 172.21.15.153:0/2204923782 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560b5c742d50 0x560b5c749e50 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fd420001ed0 tx=0x7fd42003f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.770+0000 7fd377fff700 1 -- 172.21.15.153:0/2204923782 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd42001aea0 con 0x560b5c742d50 2023-10-05T21:17:00.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.770+0000 7fd377fff700 1 -- 172.21.15.153:0/2204923782 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd420032050 con 0x560b5c742d50 2023-10-05T21:17:00.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.770+0000 7fd439dda680 1 -- 172.21.15.153:0/2204923782 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560b5c74a590 con 0x560b5c742d50 2023-10-05T21:17:00.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.770+0000 7fd377fff700 1 -- 172.21.15.153:0/2204923782 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd420046340 con 0x560b5c742d50 2023-10-05T21:17:00.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.770+0000 7fd439dda680 1 -- 172.21.15.153:0/2204923782 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560b5c74aa00 con 0x560b5c742d50 2023-10-05T21:17:00.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.771+0000 7fd377fff700 1 -- 172.21.15.153:0/2204923782 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7fd42000d750 con 0x560b5c742d50 2023-10-05T21:17:00.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.771+0000 7fd377fff700 1 --2- 172.21.15.153:0/2204923782 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd37c0340f0 0x7fd37c0365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.771+0000 7fd377fff700 1 -- 172.21.15.153:0/2204923782 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fd420038bd0 con 0x560b5c742d50 2023-10-05T21:17:00.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.771+0000 7fd375ffb700 20 reqs_thread_entry: start 2023-10-05T21:17:00.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.771+0000 7fd439dda680 20 try_to_resolve_local_entities(): before: realm_id= realm_name= zonegroup_id= zonegroup_name= zone_id= zone_name= 2023-10-05T21:17:00.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.771+0000 7fd439dda680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.771+0000 7fd427fff700 1 --2- 172.21.15.153:0/2204923782 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd37c0340f0 0x7fd37c0365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.772+0000 7fd439dda680 1 --2- 172.21.15.153:0/2256111698 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x560b5c76a7d0 0x560b5c779ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.772+0000 7fd439dda680 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c76abc0 con 0x560b5c76a7d0 2023-10-05T21:17:00.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.772+0000 7fd42d6b3700 1 --2- 172.21.15.153:0/2256111698 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x560b5c76a7d0 0x560b5c779ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.772+0000 7fd427fff700 1 --2- 172.21.15.153:0/2204923782 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd37c0340f0 0x7fd37c0365a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x560b5c73edf0 tx=0x7fd418015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.772+0000 7fd42d6b3700 1 --2- 172.21.15.153:0/2256111698 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x560b5c76a7d0 0x560b5c779ef0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.772+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd428012040 con 0x560b5c76a7d0 2023-10-05T21:17:00.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.772+0000 7fd439dda680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:00.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.772+0000 7fd439dda680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.772+0000 7fd439dda680 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77a430 con 0x560b5c76a7d0 2023-10-05T21:17:00.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.772+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd428012040 con 0x560b5c76a7d0 2023-10-05T21:17:00.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.772+0000 7fd439dda680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:17:00.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.772+0000 7fd439dda680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.773+0000 7fd439dda680 1 --2- 172.21.15.153:0/2256111698 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x560b5c77acf0 0x560b5c77d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.773+0000 7fd439dda680 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:3 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77d610 con 0x560b5c77acf0 2023-10-05T21:17:00.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.773+0000 7fd42ceb2700 1 --2- 172.21.15.153:0/2256111698 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x560b5c77acf0 0x560b5c77d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.773+0000 7fd42ceb2700 1 --2- 172.21.15.153:0/2256111698 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x560b5c77acf0 0x560b5c77d0d0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.773+0000 7fd42ceb2700 1 -- 172.21.15.153:0/2256111698 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(3 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~1036 out=1036b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+1036 (crc 0 0 0) 0x7fd420014070 con 0x560b5c77acf0 2023-10-05T21:17:00.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.773+0000 7fd439dda680 20 rados_obj.operate() r=0 bl.length=1036 2023-10-05T21:17:00.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.773+0000 7fd439dda680 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:4 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x560b5c77acf0 2023-10-05T21:17:00.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.773+0000 7fd42ceb2700 1 -- 172.21.15.153:0/2256111698 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(4 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd420014070 con 0x560b5c77acf0 2023-10-05T21:17:00.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.773+0000 7fd42ceb2700 1 --2- 172.21.15.153:0/2256111698 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fd42003f7b0 0x7fd420023410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.773+0000 7fd42ceb2700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:5 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x7fd42003f7b0 2023-10-05T21:17:00.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.774+0000 7fd427fff700 1 --2- 172.21.15.153:0/2256111698 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fd42003f7b0 0x7fd420023410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.774+0000 7fd427fff700 1 --2- 172.21.15.153:0/2256111698 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fd42003f7b0 0x7fd420023410 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.774+0000 7fd427fff700 1 -- 172.21.15.153:0/2256111698 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(5 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd418019040 con 0x7fd42003f7b0 2023-10-05T21:17:00.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.774+0000 7fd427fff700 1 --2- 172.21.15.153:0/2256111698 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fd418007030 0x7fd41801d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.774+0000 7fd427fff700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:6 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x7fd418007030 2023-10-05T21:17:00.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.774+0000 7fd42d6b3700 1 --2- 172.21.15.153:0/2256111698 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fd418007030 0x7fd41801d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.775+0000 7fd42d6b3700 1 --2- 172.21.15.153:0/2256111698 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fd418007030 0x7fd41801d420 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.775+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd428012040 con 0x7fd418007030 2023-10-05T21:17:00.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.775+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:7 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x560b5c76a7d0 2023-10-05T21:17:00.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.775+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd428012040 con 0x560b5c76a7d0 2023-10-05T21:17:00.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.775+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:8 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x560b5c76a7d0 2023-10-05T21:17:00.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.775+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd428012040 con 0x560b5c76a7d0 2023-10-05T21:17:00.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.775+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:9 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x7fd418007030 2023-10-05T21:17:00.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.775+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd428012040 con 0x7fd418007030 2023-10-05T21:17:00.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.775+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:10 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x7fd418007030 2023-10-05T21:17:00.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.776+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd428012040 con 0x7fd418007030 2023-10-05T21:17:00.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.776+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:11 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x7fd42003f7b0 2023-10-05T21:17:00.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.776+0000 7fd427fff700 1 -- 172.21.15.153:0/2256111698 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd418019040 con 0x7fd42003f7b0 2023-10-05T21:17:00.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.776+0000 7fd427fff700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:12 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x560b5c77acf0 2023-10-05T21:17:00.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.776+0000 7fd42ceb2700 1 -- 172.21.15.153:0/2256111698 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=107b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fd420014070 con 0x560b5c77acf0 2023-10-05T21:17:00.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.776+0000 7fd42ceb2700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:13 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x560b5c76a7d0 2023-10-05T21:17:00.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.776+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd428012040 con 0x560b5c76a7d0 2023-10-05T21:17:00.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.776+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:14 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x7fd418007030 2023-10-05T21:17:00.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.777+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd428012040 con 0x7fd418007030 2023-10-05T21:17:00.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.777+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x560b5c76a7d0 2023-10-05T21:17:00.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.777+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd428012040 con 0x560b5c76a7d0 2023-10-05T21:17:00.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.777+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:16 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x7fd42003f7b0 2023-10-05T21:17:00.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.777+0000 7fd427fff700 1 -- 172.21.15.153:0/2256111698 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd418019040 con 0x7fd42003f7b0 2023-10-05T21:17:00.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.777+0000 7fd427fff700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:17 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x560b5c77acf0 2023-10-05T21:17:00.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.777+0000 7fd42ceb2700 1 -- 172.21.15.153:0/2256111698 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd420014070 con 0x560b5c77acf0 2023-10-05T21:17:00.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.777+0000 7fd42ceb2700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:18 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x560b5c77acf0 2023-10-05T21:17:00.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.778+0000 7fd42ceb2700 1 -- 172.21.15.153:0/2256111698 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(18 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd420014070 con 0x560b5c77acf0 2023-10-05T21:17:00.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.778+0000 7fd42ceb2700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:19 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x7fd418007030 2023-10-05T21:17:00.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.778+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd428012040 con 0x7fd418007030 2023-10-05T21:17:00.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.778+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x560b5c77acf0 2023-10-05T21:17:00.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.778+0000 7fd42ceb2700 1 -- 172.21.15.153:0/2256111698 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd420014070 con 0x560b5c77acf0 2023-10-05T21:17:00.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.778+0000 7fd42ceb2700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:21 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x560b5c77acf0 2023-10-05T21:17:00.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.778+0000 7fd42ceb2700 1 -- 172.21.15.153:0/2256111698 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd420014070 con 0x560b5c77acf0 2023-10-05T21:17:00.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.778+0000 7fd42ceb2700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:22 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x560b5c76a7d0 2023-10-05T21:17:00.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.778+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd428012040 con 0x560b5c76a7d0 2023-10-05T21:17:00.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.778+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:23 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x560b5c76a7d0 2023-10-05T21:17:00.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.779+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(23 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fd428012040 con 0x560b5c76a7d0 2023-10-05T21:17:00.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.779+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:24 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x7fd418007030 2023-10-05T21:17:00.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.779+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd428012040 con 0x7fd418007030 2023-10-05T21:17:00.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.779+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:25 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x560b5c77acf0 2023-10-05T21:17:00.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.779+0000 7fd42ceb2700 1 -- 172.21.15.153:0/2256111698 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(25 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd420014070 con 0x560b5c77acf0 2023-10-05T21:17:00.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.779+0000 7fd42ceb2700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:26 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x7fd42003f7b0 2023-10-05T21:17:00.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.779+0000 7fd427fff700 1 -- 172.21.15.153:0/2256111698 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd418019040 con 0x7fd42003f7b0 2023-10-05T21:17:00.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.779+0000 7fd427fff700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:27 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x560b5c76a7d0 2023-10-05T21:17:00.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.780+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd428012040 con 0x560b5c76a7d0 2023-10-05T21:17:00.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.780+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:28 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x7fd418007030 2023-10-05T21:17:00.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.780+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd428012040 con 0x7fd418007030 2023-10-05T21:17:00.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.780+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:29 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x560b5c77acf0 2023-10-05T21:17:00.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.780+0000 7fd42ceb2700 1 -- 172.21.15.153:0/2256111698 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd420014070 con 0x560b5c77acf0 2023-10-05T21:17:00.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.780+0000 7fd42ceb2700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x7fd418007030 2023-10-05T21:17:00.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.780+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd428012040 con 0x7fd418007030 2023-10-05T21:17:00.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.780+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:31 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x7fd42003f7b0 2023-10-05T21:17:00.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.781+0000 7fd427fff700 1 -- 172.21.15.153:0/2256111698 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd418019040 con 0x7fd42003f7b0 2023-10-05T21:17:00.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.781+0000 7fd427fff700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:32 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x560b5c77acf0 2023-10-05T21:17:00.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.781+0000 7fd42ceb2700 1 -- 172.21.15.153:0/2256111698 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd420014070 con 0x560b5c77acf0 2023-10-05T21:17:00.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.781+0000 7fd42ceb2700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:33 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x7fd418007030 2023-10-05T21:17:00.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.781+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd428012040 con 0x7fd418007030 2023-10-05T21:17:00.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.781+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:34 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x560b5c76a7d0 2023-10-05T21:17:00.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.781+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fd428012040 con 0x560b5c76a7d0 2023-10-05T21:17:00.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.781+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:35 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77e9d0 con 0x7fd42003f7b0 2023-10-05T21:17:00.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.782+0000 7fd427fff700 1 -- 172.21.15.153:0/2256111698 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd418019040 con 0x7fd42003f7b0 2023-10-05T21:17:00.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.782+0000 7fd439dda680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:17:00.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.782+0000 7fd439dda680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:17:00.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.782+0000 7fd439dda680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:17:00.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.782+0000 7fd439dda680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:17:00.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.782+0000 7fd439dda680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.782+0000 7fd439dda680 1 -- 172.21.15.153:0/2256111698 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:36 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560b5c77d9c0 con 0x560b5c77acf0 2023-10-05T21:17:00.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.782+0000 7fd42ceb2700 1 -- 172.21.15.153:0/2256111698 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(36 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~1036 out=1036b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+1036 (crc 0 0 0) 0x7fd420014070 con 0x560b5c77acf0 2023-10-05T21:17:00.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.782+0000 7fd439dda680 20 rados_obj.operate() r=0 bl.length=1036 2023-10-05T21:17:00.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.782+0000 7fd439dda680 1 -- 172.21.15.153:0/2256111698 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fd418007030 msgr2=0x7fd41801d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.782+0000 7fd439dda680 1 --2- 172.21.15.153:0/2256111698 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7fd418007030 0x7fd41801d420 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.782+0000 7fd439dda680 1 -- 172.21.15.153:0/2256111698 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x560b5c76a7d0 msgr2=0x560b5c779ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.782+0000 7fd439dda680 1 --2- 172.21.15.153:0/2256111698 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x560b5c76a7d0 0x560b5c779ef0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.783+0000 7fd439dda680 1 -- 172.21.15.153:0/2256111698 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fd42003f7b0 msgr2=0x7fd420023410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.783+0000 7fd439dda680 1 --2- 172.21.15.153:0/2256111698 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7fd42003f7b0 0x7fd420023410 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.783+0000 7fd439dda680 1 -- 172.21.15.153:0/2256111698 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x560b5c77acf0 msgr2=0x560b5c77d0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.783+0000 7fd439dda680 1 --2- 172.21.15.153:0/2256111698 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x560b5c77acf0 0x560b5c77d0d0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.783+0000 7fd439dda680 1 -- 172.21.15.153:0/2256111698 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd410034140 msgr2=0x7fd4100365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.783+0000 7fd439dda680 1 --2- 172.21.15.153:0/2256111698 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd410034140 0x7fd4100365f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x560b5c724110 tx=0x7fd428005880 comp rx=0 tx=0).stop 2023-10-05T21:17:00.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.783+0000 7fd439dda680 1 -- 172.21.15.153:0/2256111698 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560b5c67c080 msgr2=0x560b5c730d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.783+0000 7fd439dda680 1 --2- 172.21.15.153:0/2256111698 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560b5c67c080 0x560b5c730d70 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fd42000c010 tx=0x7fd420016000 comp rx=0 tx=0).stop 2023-10-05T21:17:00.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.783+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 reap_dead start 2023-10-05T21:17:00.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.783+0000 7fd42d6b3700 1 -- 172.21.15.153:0/2256111698 reap_dead start 2023-10-05T21:17:00.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.783+0000 7fd439dda680 1 -- 172.21.15.153:0/2256111698 shutdown_connections 2023-10-05T21:17:00.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.783+0000 7fd439dda680 1 -- 172.21.15.153:0/2256111698 >> 172.21.15.153:0/2256111698 conn(0x560b5c702b60 msgr2=0x560b5c722d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.783+0000 7fd439dda680 1 -- 172.21.15.153:0/2256111698 shutdown_connections 2023-10-05T21:17:00.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.783+0000 7fd439dda680 1 -- 172.21.15.153:0/2256111698 wait complete. 2023-10-05T21:17:00.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.783+0000 7fd439dda680 1 -- 172.21.15.153:0/2204923782 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd37c0340f0 msgr2=0x7fd37c0365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.783+0000 7fd439dda680 1 --2- 172.21.15.153:0/2204923782 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd37c0340f0 0x7fd37c0365a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x560b5c73edf0 tx=0x7fd418015000 comp rx=0 tx=0).stop 2023-10-05T21:17:00.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.783+0000 7fd439dda680 1 -- 172.21.15.153:0/2204923782 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560b5c742d50 msgr2=0x560b5c749e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.783+0000 7fd439dda680 1 --2- 172.21.15.153:0/2204923782 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560b5c742d50 0x560b5c749e50 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fd420001ed0 tx=0x7fd42003f000 comp rx=0 tx=0).stop 2023-10-05T21:17:00.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.783+0000 7fd439dda680 1 -- 172.21.15.153:0/2204923782 shutdown_connections 2023-10-05T21:17:00.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.783+0000 7fd439dda680 1 --2- 172.21.15.153:0/2204923782 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7fd37c0340f0 0x7fd37c0365a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.783+0000 7fd439dda680 1 --2- 172.21.15.153:0/2204923782 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560b5c742d50 0x560b5c749e50 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.783+0000 7fd439dda680 1 -- 172.21.15.153:0/2204923782 >> 172.21.15.153:0/2204923782 conn(0x560b5c70c790 msgr2=0x560b5c73f440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.783+0000 7fd439dda680 1 -- 172.21.15.153:0/2204923782 shutdown_connections 2023-10-05T21:17:00.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.783+0000 7fd439dda680 1 -- 172.21.15.153:0/2204923782 wait complete. 2023-10-05T21:17:00.801 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:17:00.801 INFO:teuthology.orchestra.run.smithi153.stdout: "id": "193cdd3f-16f8-4551-b3a7-d103e6acfa54", 2023-10-05T21:17:00.801 INFO:teuthology.orchestra.run.smithi153.stdout: "name": "default", 2023-10-05T21:17:00.801 INFO:teuthology.orchestra.run.smithi153.stdout: "domain_root": "default.rgw.meta:root", 2023-10-05T21:17:00.801 INFO:teuthology.orchestra.run.smithi153.stdout: "control_pool": "default.rgw.control", 2023-10-05T21:17:00.802 INFO:teuthology.orchestra.run.smithi153.stdout: "gc_pool": "default.rgw.log:gc", 2023-10-05T21:17:00.802 INFO:teuthology.orchestra.run.smithi153.stdout: "lc_pool": "default.rgw.log:lc", 2023-10-05T21:17:00.802 INFO:teuthology.orchestra.run.smithi153.stdout: "log_pool": "default.rgw.log", 2023-10-05T21:17:00.802 INFO:teuthology.orchestra.run.smithi153.stdout: "intent_log_pool": "default.rgw.log:intent", 2023-10-05T21:17:00.802 INFO:teuthology.orchestra.run.smithi153.stdout: "usage_log_pool": "default.rgw.log:usage", 2023-10-05T21:17:00.802 INFO:teuthology.orchestra.run.smithi153.stdout: "roles_pool": "default.rgw.meta:roles", 2023-10-05T21:17:00.802 INFO:teuthology.orchestra.run.smithi153.stdout: "reshard_pool": "default.rgw.log:reshard", 2023-10-05T21:17:00.802 INFO:teuthology.orchestra.run.smithi153.stdout: "user_keys_pool": "default.rgw.meta:users.keys", 2023-10-05T21:17:00.802 INFO:teuthology.orchestra.run.smithi153.stdout: "user_email_pool": "default.rgw.meta:users.email", 2023-10-05T21:17:00.802 INFO:teuthology.orchestra.run.smithi153.stdout: "user_swift_pool": "default.rgw.meta:users.swift", 2023-10-05T21:17:00.802 INFO:teuthology.orchestra.run.smithi153.stdout: "user_uid_pool": "default.rgw.meta:users.uid", 2023-10-05T21:17:00.803 INFO:teuthology.orchestra.run.smithi153.stdout: "otp_pool": "default.rgw.otp", 2023-10-05T21:17:00.803 INFO:teuthology.orchestra.run.smithi153.stdout: "system_key": { 2023-10-05T21:17:00.803 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "", 2023-10-05T21:17:00.803 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "" 2023-10-05T21:17:00.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:17:00.803 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_pools": [ 2023-10-05T21:17:00.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:17:00.803 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "default-placement", 2023-10-05T21:17:00.803 INFO:teuthology.orchestra.run.smithi153.stdout: "val": { 2023-10-05T21:17:00.803 INFO:teuthology.orchestra.run.smithi153.stdout: "index_pool": "default.rgw.buckets.index", 2023-10-05T21:17:00.803 INFO:teuthology.orchestra.run.smithi153.stdout: "storage_classes": { 2023-10-05T21:17:00.804 INFO:teuthology.orchestra.run.smithi153.stdout: "STANDARD": { 2023-10-05T21:17:00.804 INFO:teuthology.orchestra.run.smithi153.stdout: "data_pool": "default.rgw.buckets.data" 2023-10-05T21:17:00.804 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:17:00.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:17:00.804 INFO:teuthology.orchestra.run.smithi153.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2023-10-05T21:17:00.804 INFO:teuthology.orchestra.run.smithi153.stdout: "index_type": 0, 2023-10-05T21:17:00.804 INFO:teuthology.orchestra.run.smithi153.stdout: "inline_data": "true" 2023-10-05T21:17:00.804 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:17:00.804 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:17:00.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:17:00.804 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "new-placement", 2023-10-05T21:17:00.804 INFO:teuthology.orchestra.run.smithi153.stdout: "val": { 2023-10-05T21:17:00.805 INFO:teuthology.orchestra.run.smithi153.stdout: "index_pool": ".rgw.buckets.index.2", 2023-10-05T21:17:00.805 INFO:teuthology.orchestra.run.smithi153.stdout: "storage_classes": { 2023-10-05T21:17:00.805 INFO:teuthology.orchestra.run.smithi153.stdout: "STANDARD": { 2023-10-05T21:17:00.805 INFO:teuthology.orchestra.run.smithi153.stdout: "data_pool": ".rgw.buckets.2" 2023-10-05T21:17:00.805 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:17:00.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:17:00.805 INFO:teuthology.orchestra.run.smithi153.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2023-10-05T21:17:00.805 INFO:teuthology.orchestra.run.smithi153.stdout: "index_type": 0, 2023-10-05T21:17:00.805 INFO:teuthology.orchestra.run.smithi153.stdout: "inline_data": "false" 2023-10-05T21:17:00.805 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:17:00.805 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:17:00.805 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:17:00.806 INFO:teuthology.orchestra.run.smithi153.stdout: "realm_id": "", 2023-10-05T21:17:00.806 INFO:teuthology.orchestra.run.smithi153.stdout: "notif_pool": "default.rgw.log:notif" 2023-10-05T21:17:00.806 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:17:00.806 DEBUG:tasks.util.rgw: json result: {'id': '193cdd3f-16f8-4551-b3a7-d103e6acfa54', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': 'true'}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': 'false'}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-10-05T21:17:00.806 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2023-10-05T21:17:00.806 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2023-10-05T21:17:00.806 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2023-10-05T21:17:00.887 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:17:00.887 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:17:00.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.886+0000 7f1f9a130680 1 Processor -- start 2023-10-05T21:17:00.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.886+0000 7f1f9a130680 1 -- start start 2023-10-05T21:17:00.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.887+0000 7f1f9a130680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x563070fb79f0 0x563070fb9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.887+0000 7f1f9a130680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563070f00930 con 0x563070fb1870 2023-10-05T21:17:00.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.887+0000 7f1f9a130680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x563070ec0db0 con 0x563070fb79f0 2023-10-05T21:17:00.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.887+0000 7f1f8ca07700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x563070fb79f0 0x563070fb9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.887+0000 7f1f8d208700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x563070fb1870 0x563070fb1c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:57270/0 (socket says 172.21.15.153:57270) 2023-10-05T21:17:00.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.887+0000 7f1f8d208700 1 -- 172.21.15.153:0/2482234629 learned_addr learned my addr 172.21.15.153:0/2482234629 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:17:00.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.887+0000 7f1f7ffff700 1 -- 172.21.15.153:0/2482234629 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 522521048 0 0) 0x563070f00930 con 0x563070fb1870 2023-10-05T21:17:00.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.887+0000 7f1f7ffff700 1 -- 172.21.15.153:0/2482234629 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f78001e10 con 0x563070fb1870 2023-10-05T21:17:00.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.887+0000 7f1f8ca07700 1 -- 172.21.15.153:0/2482234629 >> v1:172.21.15.111:6789/0 conn(0x563070fb1870 legacy=0x563070fb1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.887+0000 7f1f8ca07700 1 -- 172.21.15.153:0/2482234629 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563070fbb320 con 0x563070fb79f0 2023-10-05T21:17:00.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.888+0000 7f1f8ca07700 1 --2- 172.21.15.153:0/2482234629 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563070fb79f0 0x563070fb9dd0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1f8400a5d0 tx=0x7f1f84005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47581344b17bb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.888+0000 7f1f7ffff700 1 -- 172.21.15.153:0/2482234629 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f84007610 con 0x563070fb79f0 2023-10-05T21:17:00.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.888+0000 7f1f7ffff700 1 -- 172.21.15.153:0/2482234629 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f84007770 con 0x563070fb79f0 2023-10-05T21:17:00.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.888+0000 7f1f7ffff700 1 -- 172.21.15.153:0/2482234629 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f84007a40 con 0x563070fb79f0 2023-10-05T21:17:00.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.888+0000 7f1f9a130680 1 -- 172.21.15.153:0/2482234629 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563070fb79f0 msgr2=0x563070fb9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.888+0000 7f1f9a130680 1 --2- 172.21.15.153:0/2482234629 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563070fb79f0 0x563070fb9dd0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1f8400a5d0 tx=0x7f1f84005a50 comp rx=0 tx=0).stop 2023-10-05T21:17:00.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.888+0000 7f1f9a130680 1 -- 172.21.15.153:0/2482234629 shutdown_connections 2023-10-05T21:17:00.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.888+0000 7f1f9a130680 1 --2- 172.21.15.153:0/2482234629 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563070fb79f0 0x563070fb9dd0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.888+0000 7f1f9a130680 1 -- 172.21.15.153:0/2482234629 >> 172.21.15.153:0/2482234629 conn(0x563070fad380 msgr2=0x563070faf790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.888+0000 7f1f9a130680 1 -- 172.21.15.153:0/2482234629 shutdown_connections 2023-10-05T21:17:00.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.888+0000 7f1f9a130680 1 -- 172.21.15.153:0/2482234629 wait complete. 2023-10-05T21:17:00.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.889+0000 7f1f9a130680 1 Processor -- start 2023-10-05T21:17:00.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.889+0000 7f1f9a130680 1 -- start start 2023-10-05T21:17:00.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.889+0000 7f1f9a130680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563070fb1870 0x563070fb42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.889+0000 7f1f9a130680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x563070e60ea0 con 0x563070fb1870 2023-10-05T21:17:00.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.890+0000 7f1f8d208700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563070fb1870 0x563070fb42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.890+0000 7f1f8d208700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563070fb1870 0x563070fb42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60772/0 (socket says 172.21.15.153:60772) 2023-10-05T21:17:00.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.890+0000 7f1f8d208700 1 -- 172.21.15.153:0/3359461554 learned_addr learned my addr 172.21.15.153:0/3359461554 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.890+0000 7f1f8d208700 1 -- 172.21.15.153:0/3359461554 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f84005cf0 con 0x563070fb1870 2023-10-05T21:17:00.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.890+0000 7f1f8d208700 1 --2- 172.21.15.153:0/3359461554 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563070fb1870 0x563070fb42c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1f88006e70 tx=0x7f1f88006a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a710ef847578c25c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.890+0000 7f1f7effd700 1 -- 172.21.15.153:0/3359461554 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f88006110 con 0x563070fb1870 2023-10-05T21:17:00.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.890+0000 7f1f7effd700 1 -- 172.21.15.153:0/3359461554 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f88006290 con 0x563070fb1870 2023-10-05T21:17:00.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.890+0000 7f1f7effd700 1 -- 172.21.15.153:0/3359461554 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f88004520 con 0x563070fb1870 2023-10-05T21:17:00.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.891+0000 7f1f9a130680 1 -- 172.21.15.153:0/3359461554 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563070fb1870 msgr2=0x563070fb42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.891+0000 7f1f9a130680 1 --2- 172.21.15.153:0/3359461554 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563070fb1870 0x563070fb42c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1f88006e70 tx=0x7f1f88006a20 comp rx=0 tx=0).stop 2023-10-05T21:17:00.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.891+0000 7f1f9a130680 1 -- 172.21.15.153:0/3359461554 shutdown_connections 2023-10-05T21:17:00.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.891+0000 7f1f9a130680 1 --2- 172.21.15.153:0/3359461554 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563070fb1870 0x563070fb42c0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.891+0000 7f1f9a130680 1 -- 172.21.15.153:0/3359461554 >> 172.21.15.153:0/3359461554 conn(0x563070fad380 msgr2=0x563070fce200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.891+0000 7f1f9a130680 1 -- 172.21.15.153:0/3359461554 shutdown_connections 2023-10-05T21:17:00.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.891+0000 7f1f9a130680 1 -- 172.21.15.153:0/3359461554 wait complete. 2023-10-05T21:17:00.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.891+0000 7f1f9a130680 1 Processor -- start 2023-10-05T21:17:00.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.891+0000 7f1f9a130680 1 -- start start 2023-10-05T21:17:00.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.891+0000 7f1f9a130680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563070fb1870 0x563070fdbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.891+0000 7f1f9a130680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x563070e57c80 con 0x563070fb1870 2023-10-05T21:17:00.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.891+0000 7f1f8d208700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563070fb1870 0x563070fdbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.891+0000 7f1f8d208700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563070fb1870 0x563070fdbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60786/0 (socket says 172.21.15.153:60786) 2023-10-05T21:17:00.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.891+0000 7f1f8d208700 1 -- 172.21.15.153:0/1910349334 learned_addr learned my addr 172.21.15.153:0/1910349334 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.892+0000 7f1f8d208700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f78001e10 con 0x563070fb1870 2023-10-05T21:17:00.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.892+0000 7f1f8d208700 1 --2- 172.21.15.153:0/1910349334 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563070fb1870 0x563070fdbe00 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f1f8800f000 tx=0x7f1f88014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.892+0000 7f1f7d7fa700 1 -- 172.21.15.153:0/1910349334 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f88004e70 con 0x563070fb1870 2023-10-05T21:17:00.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.892+0000 7f1f7d7fa700 1 -- 172.21.15.153:0/1910349334 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f88006400 con 0x563070fb1870 2023-10-05T21:17:00.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.892+0000 7f1f7d7fa700 1 -- 172.21.15.153:0/1910349334 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f88013af0 con 0x563070fb1870 2023-10-05T21:17:00.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.892+0000 7f1f9a130680 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563070fdc340 con 0x563070fb1870 2023-10-05T21:17:00.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.892+0000 7f1f9a130680 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563070fdc810 con 0x563070fb1870 2023-10-05T21:17:00.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.893+0000 7f1f7d7fa700 1 -- 172.21.15.153:0/1910349334 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f1f8801a070 con 0x563070fb1870 2023-10-05T21:17:00.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.893+0000 7f1f9a130680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:17:00.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.893+0000 7f1f9a130680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:17:00.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.893+0000 7f1f7d7fa700 1 --2- 172.21.15.153:0/1910349334 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1f70034130 0x7f1f700365e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.893+0000 7f1f9a130680 1 Processor -- start 2023-10-05T21:17:00.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.893+0000 7f1f7d7fa700 1 -- 172.21.15.153:0/1910349334 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f1f88048c20 con 0x563070fb1870 2023-10-05T21:17:00.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.893+0000 7f1f8ca07700 1 --2- 172.21.15.153:0/1910349334 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1f70034130 0x7f1f700365e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.893+0000 7f1f9a130680 1 -- start start 2023-10-05T21:17:00.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.893+0000 7f1f9a130680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563070feddf0 0x563070fee200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.893+0000 7f1f9a130680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x563070fee740 con 0x563070feddf0 2023-10-05T21:17:00.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.894+0000 7f1f8ca07700 1 --2- 172.21.15.153:0/1910349334 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1f70034130 0x7f1f700365e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x563070f25f30 tx=0x7f1f84014000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.894+0000 7f1f8d208700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563070feddf0 0x563070fee200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.894+0000 7f1f8d208700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563070feddf0 0x563070fee200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60796/0 (socket says 172.21.15.153:60796) 2023-10-05T21:17:00.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.894+0000 7f1f8d208700 1 -- 172.21.15.153:0/3196540608 learned_addr learned my addr 172.21.15.153:0/3196540608 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.894+0000 7f1f8d208700 1 -- 172.21.15.153:0/3196540608 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563070fee880 con 0x563070feddf0 2023-10-05T21:17:00.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.894+0000 7f1f8d208700 1 --2- 172.21.15.153:0/3196540608 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563070feddf0 0x563070fee200 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f1f8801e420 tx=0x7f1f88046f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36943ed122ffd6b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.894+0000 7f1f5e7e4700 1 -- 172.21.15.153:0/3196540608 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f88011c70 con 0x563070feddf0 2023-10-05T21:17:00.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.894+0000 7f1f5e7e4700 1 -- 172.21.15.153:0/3196540608 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f88029460 con 0x563070feddf0 2023-10-05T21:17:00.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.894+0000 7f1f5e7e4700 1 -- 172.21.15.153:0/3196540608 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f88010360 con 0x563070feddf0 2023-10-05T21:17:00.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.895+0000 7f1f9a130680 1 -- 172.21.15.153:0/3196540608 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563070feddf0 msgr2=0x563070fee200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.895+0000 7f1f9a130680 1 --2- 172.21.15.153:0/3196540608 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563070feddf0 0x563070fee200 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f1f8801e420 tx=0x7f1f88046f80 comp rx=0 tx=0).stop 2023-10-05T21:17:00.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.895+0000 7f1f9a130680 1 -- 172.21.15.153:0/3196540608 shutdown_connections 2023-10-05T21:17:00.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.895+0000 7f1f9a130680 1 --2- 172.21.15.153:0/3196540608 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563070feddf0 0x563070fee200 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.895+0000 7f1f9a130680 1 -- 172.21.15.153:0/3196540608 >> 172.21.15.153:0/3196540608 conn(0x563070fb79f0 msgr2=0x563070fea8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.895+0000 7f1f9a130680 1 -- 172.21.15.153:0/3196540608 shutdown_connections 2023-10-05T21:17:00.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.895+0000 7f1f9a130680 1 -- 172.21.15.153:0/3196540608 wait complete. 2023-10-05T21:17:00.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.895+0000 7f1f9a130680 1 Processor -- start 2023-10-05T21:17:00.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.895+0000 7f1f9a130680 1 -- start start 2023-10-05T21:17:00.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.895+0000 7f1f9a130680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563070feddf0 0x563070ff4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.895+0000 7f1f9a130680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x563070ff5520 con 0x563070feddf0 2023-10-05T21:17:00.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.895+0000 7f1f8d208700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563070feddf0 0x563070ff4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.896+0000 7f1f8d208700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563070feddf0 0x563070ff4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60810/0 (socket says 172.21.15.153:60810) 2023-10-05T21:17:00.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.896+0000 7f1f8d208700 1 -- 172.21.15.153:0/3138105367 learned_addr learned my addr 172.21.15.153:0/3138105367 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.896+0000 7f1f8d208700 1 -- 172.21.15.153:0/3138105367 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563070fdc810 con 0x563070feddf0 2023-10-05T21:17:00.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.896+0000 7f1f8d208700 1 --2- 172.21.15.153:0/3138105367 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563070feddf0 0x563070ff4fe0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f1f88029c90 tx=0x7f1f88034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.896+0000 7f1f5cfe1700 1 -- 172.21.15.153:0/3138105367 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f88010530 con 0x563070feddf0 2023-10-05T21:17:00.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.896+0000 7f1f5cfe1700 1 -- 172.21.15.153:0/3138105367 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f880108f0 con 0x563070feddf0 2023-10-05T21:17:00.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.896+0000 7f1f9a130680 1 -- 172.21.15.153:0/3138105367 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563070ff5720 con 0x563070feddf0 2023-10-05T21:17:00.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.896+0000 7f1f5cfe1700 1 -- 172.21.15.153:0/3138105367 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f88046220 con 0x563070feddf0 2023-10-05T21:17:00.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.896+0000 7f1f9a130680 1 -- 172.21.15.153:0/3138105367 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563070ff5720 con 0x563070feddf0 2023-10-05T21:17:00.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.897+0000 7f1f5cfe1700 1 -- 172.21.15.153:0/3138105367 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f1f8801d040 con 0x563070feddf0 2023-10-05T21:17:00.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.897+0000 7f1f5cfe1700 1 --2- 172.21.15.153:0/3138105367 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1edc0340a0 0x7f1edc036550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.897+0000 7f1f5cfe1700 1 -- 172.21.15.153:0/3138105367 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f1f88054110 con 0x563070feddf0 2023-10-05T21:17:00.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.897+0000 7f1ed67fc700 20 reqs_thread_entry: start 2023-10-05T21:17:00.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.897+0000 7f1f9a130680 20 try_to_resolve_local_entities(): before: realm_id= realm_name= zonegroup_id= zonegroup_name= zone_id= zone_name=default 2023-10-05T21:17:00.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.897+0000 7f1f9a130680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.897+0000 7f1f8ca07700 1 --2- 172.21.15.153:0/3138105367 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1edc0340a0 0x7f1edc036550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.897+0000 7f1f9a130680 1 --2- 172.21.15.153:0/1910349334 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5630710155a0 0x563071024cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.898+0000 7f1f9a130680 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710159f0 con 0x5630710155a0 2023-10-05T21:17:00.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.898+0000 7f1f8da09700 1 --2- 172.21.15.153:0/1910349334 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5630710155a0 0x563071024cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.898+0000 7f1f8ca07700 1 --2- 172.21.15.153:0/3138105367 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1edc0340a0 0x7f1edc036550 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1f84005cc0 tx=0x7f1f8401c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.898+0000 7f1f8da09700 1 --2- 172.21.15.153:0/1910349334 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5630710155a0 0x563071024cc0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.898+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1f8000a480 con 0x5630710155a0 2023-10-05T21:17:00.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.898+0000 7f1f9a130680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:17:00.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.898+0000 7f1f9a130680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.898+0000 7f1f9a130680 1 --2- 172.21.15.153:0/1910349334 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x563071025710 0x563071027af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.898+0000 7f1f9a130680 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:2 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563071028030 con 0x563071025710 2023-10-05T21:17:00.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.898+0000 7f1f8d208700 1 --2- 172.21.15.153:0/1910349334 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x563071025710 0x563071027af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.899+0000 7f1f8d208700 1 --2- 172.21.15.153:0/1910349334 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x563071025710 0x563071027af0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.899+0000 7f1f8d208700 1 -- 172.21.15.153:0/1910349334 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(2 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~1036 out=1036b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+1036 (crc 0 0 0) 0x7f1f8804e020 con 0x563071025710 2023-10-05T21:17:00.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.899+0000 7f1f9a130680 20 rados_obj.operate() r=0 bl.length=1036 2023-10-05T21:17:00.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.899+0000 7f1f9a130680 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:3 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x563071025710 2023-10-05T21:17:00.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.899+0000 7f1f8d208700 1 -- 172.21.15.153:0/1910349334 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(3 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f8804e020 con 0x563071025710 2023-10-05T21:17:00.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.899+0000 7f1f8d208700 1 --2- 172.21.15.153:0/1910349334 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f1f8803d070 0x7f1f88041160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.899+0000 7f1f8d208700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:4 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x7f1f8803d070 2023-10-05T21:17:00.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.899+0000 7f1f8ca07700 1 --2- 172.21.15.153:0/1910349334 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f1f8803d070 0x7f1f88041160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.900+0000 7f1f8ca07700 1 --2- 172.21.15.153:0/1910349334 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f1f8803d070 0x7f1f88041160 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.900+0000 7f1f8ca07700 1 -- 172.21.15.153:0/1910349334 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(4 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f84020820 con 0x7f1f8803d070 2023-10-05T21:17:00.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.900+0000 7f1f8ca07700 1 --2- 172.21.15.153:0/1910349334 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f1f8402b040 0x7f1f8402b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.900+0000 7f1f8ca07700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:5 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x7f1f8402b040 2023-10-05T21:17:00.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.900+0000 7f1f8da09700 1 --2- 172.21.15.153:0/1910349334 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f1f8402b040 0x7f1f8402b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.900+0000 7f1f8da09700 1 --2- 172.21.15.153:0/1910349334 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f1f8402b040 0x7f1f8402b410 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.901+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(5 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f8000a480 con 0x7f1f8402b040 2023-10-05T21:17:00.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.901+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:6 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x5630710155a0 2023-10-05T21:17:00.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.901+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f8000a480 con 0x5630710155a0 2023-10-05T21:17:00.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.901+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:7 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x5630710155a0 2023-10-05T21:17:00.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.901+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f8000a480 con 0x5630710155a0 2023-10-05T21:17:00.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.901+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x7f1f8402b040 2023-10-05T21:17:00.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.901+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f8000a480 con 0x7f1f8402b040 2023-10-05T21:17:00.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.901+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:9 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x7f1f8402b040 2023-10-05T21:17:00.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.902+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f8000a480 con 0x7f1f8402b040 2023-10-05T21:17:00.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.902+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:10 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x7f1f8803d070 2023-10-05T21:17:00.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.902+0000 7f1f8ca07700 1 -- 172.21.15.153:0/1910349334 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f84035040 con 0x7f1f8803d070 2023-10-05T21:17:00.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.902+0000 7f1f8ca07700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:11 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x563071025710 2023-10-05T21:17:00.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.902+0000 7f1f8d208700 1 -- 172.21.15.153:0/1910349334 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=107b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1f8804e020 con 0x563071025710 2023-10-05T21:17:00.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.902+0000 7f1f8d208700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:12 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x5630710155a0 2023-10-05T21:17:00.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.902+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f8000a480 con 0x5630710155a0 2023-10-05T21:17:00.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.902+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:13 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x7f1f8402b040 2023-10-05T21:17:00.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.903+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f8000a480 con 0x7f1f8402b040 2023-10-05T21:17:00.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.903+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:14 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x5630710155a0 2023-10-05T21:17:00.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.903+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f8000a480 con 0x5630710155a0 2023-10-05T21:17:00.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.903+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:15 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x7f1f8803d070 2023-10-05T21:17:00.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.903+0000 7f1f8ca07700 1 -- 172.21.15.153:0/1910349334 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f84035040 con 0x7f1f8803d070 2023-10-05T21:17:00.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.903+0000 7f1f8ca07700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:16 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x563071025710 2023-10-05T21:17:00.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.903+0000 7f1f8d208700 1 -- 172.21.15.153:0/1910349334 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f8804e020 con 0x563071025710 2023-10-05T21:17:00.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.903+0000 7f1f8d208700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:17 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x563071025710 2023-10-05T21:17:00.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.904+0000 7f1f8d208700 1 -- 172.21.15.153:0/1910349334 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f8804e020 con 0x563071025710 2023-10-05T21:17:00.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.904+0000 7f1f8d208700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:18 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x7f1f8402b040 2023-10-05T21:17:00.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.904+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(18 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f8000a480 con 0x7f1f8402b040 2023-10-05T21:17:00.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.904+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x563071025710 2023-10-05T21:17:00.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.904+0000 7f1f8d208700 1 -- 172.21.15.153:0/1910349334 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f8804e020 con 0x563071025710 2023-10-05T21:17:00.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.904+0000 7f1f8d208700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x563071025710 2023-10-05T21:17:00.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.904+0000 7f1f8d208700 1 -- 172.21.15.153:0/1910349334 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f8804e020 con 0x563071025710 2023-10-05T21:17:00.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.904+0000 7f1f8d208700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:21 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x5630710155a0 2023-10-05T21:17:00.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.905+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f8000a480 con 0x5630710155a0 2023-10-05T21:17:00.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.905+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:22 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x5630710155a0 2023-10-05T21:17:00.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.905+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f1f8000a480 con 0x5630710155a0 2023-10-05T21:17:00.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.905+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:23 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x7f1f8402b040 2023-10-05T21:17:00.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.905+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f8000a480 con 0x7f1f8402b040 2023-10-05T21:17:00.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.905+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:24 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x563071025710 2023-10-05T21:17:00.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.905+0000 7f1f8d208700 1 -- 172.21.15.153:0/1910349334 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f8804e020 con 0x563071025710 2023-10-05T21:17:00.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.905+0000 7f1f8d208700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:25 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x7f1f8803d070 2023-10-05T21:17:00.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.906+0000 7f1f8ca07700 1 -- 172.21.15.153:0/1910349334 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(25 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f84035040 con 0x7f1f8803d070 2023-10-05T21:17:00.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.906+0000 7f1f8ca07700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:26 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x5630710155a0 2023-10-05T21:17:00.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.906+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f8000a480 con 0x5630710155a0 2023-10-05T21:17:00.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.906+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:27 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x7f1f8402b040 2023-10-05T21:17:00.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.906+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f80025040 con 0x7f1f8402b040 2023-10-05T21:17:00.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.906+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:28 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x563071025710 2023-10-05T21:17:00.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.906+0000 7f1f8d208700 1 -- 172.21.15.153:0/1910349334 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f8804e020 con 0x563071025710 2023-10-05T21:17:00.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.906+0000 7f1f8d208700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:29 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x7f1f8402b040 2023-10-05T21:17:00.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.907+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f80025040 con 0x7f1f8402b040 2023-10-05T21:17:00.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.907+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:30 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x7f1f8803d070 2023-10-05T21:17:00.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.907+0000 7f1f8ca07700 1 -- 172.21.15.153:0/1910349334 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f84035040 con 0x7f1f8803d070 2023-10-05T21:17:00.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.907+0000 7f1f8ca07700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x563071025710 2023-10-05T21:17:00.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.907+0000 7f1f8d208700 1 -- 172.21.15.153:0/1910349334 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f8804e020 con 0x563071025710 2023-10-05T21:17:00.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.907+0000 7f1f8d208700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x7f1f8402b040 2023-10-05T21:17:00.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.908+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f80025040 con 0x7f1f8402b040 2023-10-05T21:17:00.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.908+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:33 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x5630710155a0 2023-10-05T21:17:00.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.908+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(33 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f1f80025040 con 0x5630710155a0 2023-10-05T21:17:00.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.908+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:34 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710293f0 con 0x7f1f8803d070 2023-10-05T21:17:00.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.908+0000 7f1f8ca07700 1 -- 172.21.15.153:0/1910349334 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1f84035040 con 0x7f1f8803d070 2023-10-05T21:17:00.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.908+0000 7f1f9a130680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:17:00.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.908+0000 7f1f9a130680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:17:00.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.908+0000 7f1f9a130680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:17:00.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.908+0000 7f1f9a130680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:17:00.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.908+0000 7f1f9a130680 20 rados->read ofs=0 len=0 2023-10-05T21:17:00.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.908+0000 7f1f9a130680 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:35 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5630710283e0 con 0x563071025710 2023-10-05T21:17:00.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.908+0000 7f1f8d208700 1 -- 172.21.15.153:0/1910349334 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(35 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~1036 out=1036b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+1036 (crc 0 0 0) 0x7f1f8804e020 con 0x563071025710 2023-10-05T21:17:00.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.908+0000 7f1f9a130680 20 rados_obj.operate() r=0 bl.length=1036 2023-10-05T21:17:00.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.908+0000 7f1f9a130680 1 -- 172.21.15.153:0/1910349334 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:36 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [delete,create,writefull 0~874 in=874b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563071028cd0 con 0x563071025710 2023-10-05T21:17:00.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.909+0000 7f1f8d208700 1 -- 172.21.15.153:0/1910349334 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(36 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [delete,create,writefull 0~874] v31'4 uv4 ondisk = 0) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1f8804e020 con 0x563071025710 2023-10-05T21:17:00.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.910+0000 7f1f9a130680 1 -- 172.21.15.153:0/1910349334 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f1f8402b040 msgr2=0x7f1f8402b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.910+0000 7f1f9a130680 1 --2- 172.21.15.153:0/1910349334 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f1f8402b040 0x7f1f8402b410 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.910+0000 7f1f9a130680 1 -- 172.21.15.153:0/1910349334 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5630710155a0 msgr2=0x563071024cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.910+0000 7f1f9a130680 1 --2- 172.21.15.153:0/1910349334 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5630710155a0 0x563071024cc0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.910+0000 7f1f9a130680 1 -- 172.21.15.153:0/1910349334 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f1f8803d070 msgr2=0x7f1f88041160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.910+0000 7f1f9a130680 1 --2- 172.21.15.153:0/1910349334 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f1f8803d070 0x7f1f88041160 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.910+0000 7f1f9a130680 1 -- 172.21.15.153:0/1910349334 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x563071025710 msgr2=0x563071027af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.910+0000 7f1f9a130680 1 --2- 172.21.15.153:0/1910349334 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x563071025710 0x563071027af0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.910+0000 7f1f9a130680 1 -- 172.21.15.153:0/1910349334 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1f70034130 msgr2=0x7f1f700365e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.910+0000 7f1f9a130680 1 --2- 172.21.15.153:0/1910349334 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1f70034130 0x7f1f700365e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x563070f25f30 tx=0x7f1f84014000 comp rx=0 tx=0).stop 2023-10-05T21:17:00.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.910+0000 7f1f9a130680 1 -- 172.21.15.153:0/1910349334 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563070fb1870 msgr2=0x563070fdbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.910+0000 7f1f9a130680 1 --2- 172.21.15.153:0/1910349334 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563070fb1870 0x563070fdbe00 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f1f8800f000 tx=0x7f1f88014000 comp rx=0 tx=0).stop 2023-10-05T21:17:00.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.910+0000 7f1f8da09700 1 -- 172.21.15.153:0/1910349334 reap_dead start 2023-10-05T21:17:00.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.910+0000 7f1f9a130680 1 -- 172.21.15.153:0/1910349334 shutdown_connections 2023-10-05T21:17:00.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.910+0000 7f1f9a130680 1 -- 172.21.15.153:0/1910349334 >> 172.21.15.153:0/1910349334 conn(0x563070fad380 msgr2=0x563070fcdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.910+0000 7f1f9a130680 1 -- 172.21.15.153:0/1910349334 shutdown_connections 2023-10-05T21:17:00.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.910+0000 7f1f9a130680 1 -- 172.21.15.153:0/1910349334 wait complete. 2023-10-05T21:17:00.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.910+0000 7f1f9a130680 1 -- 172.21.15.153:0/3138105367 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1edc0340a0 msgr2=0x7f1edc036550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.910+0000 7f1f9a130680 1 --2- 172.21.15.153:0/3138105367 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1edc0340a0 0x7f1edc036550 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1f84005cc0 tx=0x7f1f8401c000 comp rx=0 tx=0).stop 2023-10-05T21:17:00.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.910+0000 7f1f9a130680 1 -- 172.21.15.153:0/3138105367 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563070feddf0 msgr2=0x563070ff4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.910+0000 7f1f9a130680 1 --2- 172.21.15.153:0/3138105367 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563070feddf0 0x563070ff4fe0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f1f88029c90 tx=0x7f1f88034000 comp rx=0 tx=0).stop 2023-10-05T21:17:00.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.910+0000 7f1f9a130680 1 -- 172.21.15.153:0/3138105367 shutdown_connections 2023-10-05T21:17:00.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.910+0000 7f1f9a130680 1 --2- 172.21.15.153:0/3138105367 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f1edc0340a0 0x7f1edc036550 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.910+0000 7f1f9a130680 1 --2- 172.21.15.153:0/3138105367 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563070feddf0 0x563070ff4fe0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.910+0000 7f1f9a130680 1 -- 172.21.15.153:0/3138105367 >> 172.21.15.153:0/3138105367 conn(0x563070fb79f0 msgr2=0x563070fea4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.910+0000 7f1f9a130680 1 -- 172.21.15.153:0/3138105367 shutdown_connections 2023-10-05T21:17:00.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.910+0000 7f1f9a130680 1 -- 172.21.15.153:0/3138105367 wait complete. 2023-10-05T21:17:00.927 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:17:00.927 INFO:teuthology.orchestra.run.smithi153.stdout: "id": "193cdd3f-16f8-4551-b3a7-d103e6acfa54", 2023-10-05T21:17:00.928 INFO:teuthology.orchestra.run.smithi153.stdout: "name": "default", 2023-10-05T21:17:00.928 INFO:teuthology.orchestra.run.smithi153.stdout: "domain_root": "default.rgw.meta:root", 2023-10-05T21:17:00.928 INFO:teuthology.orchestra.run.smithi153.stdout: "control_pool": "default.rgw.control", 2023-10-05T21:17:00.928 INFO:teuthology.orchestra.run.smithi153.stdout: "gc_pool": "default.rgw.log:gc", 2023-10-05T21:17:00.928 INFO:teuthology.orchestra.run.smithi153.stdout: "lc_pool": "default.rgw.log:lc", 2023-10-05T21:17:00.928 INFO:teuthology.orchestra.run.smithi153.stdout: "log_pool": "default.rgw.log", 2023-10-05T21:17:00.928 INFO:teuthology.orchestra.run.smithi153.stdout: "intent_log_pool": "default.rgw.log:intent", 2023-10-05T21:17:00.928 INFO:teuthology.orchestra.run.smithi153.stdout: "usage_log_pool": "default.rgw.log:usage", 2023-10-05T21:17:00.928 INFO:teuthology.orchestra.run.smithi153.stdout: "roles_pool": "default.rgw.meta:roles", 2023-10-05T21:17:00.928 INFO:teuthology.orchestra.run.smithi153.stdout: "reshard_pool": "default.rgw.log:reshard", 2023-10-05T21:17:00.928 INFO:teuthology.orchestra.run.smithi153.stdout: "user_keys_pool": "default.rgw.meta:users.keys", 2023-10-05T21:17:00.929 INFO:teuthology.orchestra.run.smithi153.stdout: "user_email_pool": "default.rgw.meta:users.email", 2023-10-05T21:17:00.929 INFO:teuthology.orchestra.run.smithi153.stdout: "user_swift_pool": "default.rgw.meta:users.swift", 2023-10-05T21:17:00.929 INFO:teuthology.orchestra.run.smithi153.stdout: "user_uid_pool": "default.rgw.meta:users.uid", 2023-10-05T21:17:00.929 INFO:teuthology.orchestra.run.smithi153.stdout: "otp_pool": "default.rgw.otp", 2023-10-05T21:17:00.929 INFO:teuthology.orchestra.run.smithi153.stdout: "system_key": { 2023-10-05T21:17:00.929 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "", 2023-10-05T21:17:00.929 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "" 2023-10-05T21:17:00.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:17:00.929 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_pools": [ 2023-10-05T21:17:00.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:17:00.929 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "default-placement", 2023-10-05T21:17:00.929 INFO:teuthology.orchestra.run.smithi153.stdout: "val": { 2023-10-05T21:17:00.930 INFO:teuthology.orchestra.run.smithi153.stdout: "index_pool": "default.rgw.buckets.index", 2023-10-05T21:17:00.930 INFO:teuthology.orchestra.run.smithi153.stdout: "storage_classes": { 2023-10-05T21:17:00.930 INFO:teuthology.orchestra.run.smithi153.stdout: "STANDARD": { 2023-10-05T21:17:00.930 INFO:teuthology.orchestra.run.smithi153.stdout: "data_pool": "default.rgw.buckets.data" 2023-10-05T21:17:00.930 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:17:00.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:17:00.930 INFO:teuthology.orchestra.run.smithi153.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2023-10-05T21:17:00.930 INFO:teuthology.orchestra.run.smithi153.stdout: "index_type": 0, 2023-10-05T21:17:00.930 INFO:teuthology.orchestra.run.smithi153.stdout: "inline_data": "true" 2023-10-05T21:17:00.930 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:17:00.930 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:17:00.930 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:17:00.931 INFO:teuthology.orchestra.run.smithi153.stdout: "realm_id": "", 2023-10-05T21:17:00.931 INFO:teuthology.orchestra.run.smithi153.stdout: "notif_pool": "default.rgw.log:notif" 2023-10-05T21:17:00.931 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:17:00.931 DEBUG:tasks.util.rgw: json result: {'id': '193cdd3f-16f8-4551-b3a7-d103e6acfa54', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': 'true'}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-10-05T21:17:00.931 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2023-10-05T21:17:00.931 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2023-10-05T21:17:00.931 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2023-10-05T21:17:00.974 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:17:00.974 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:17:00.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.973+0000 7f4bf58ab680 1 Processor -- start 2023-10-05T21:17:00.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.973+0000 7f4bf58ab680 1 -- start start 2023-10-05T21:17:00.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.973+0000 7f4bf58ab680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55d28f989b90 0x55d28f98bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.973+0000 7f4bf58ab680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d28f8d0970 con 0x55d28f8f7080 2023-10-05T21:17:00.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.973+0000 7f4bf58ab680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d28f890db0 con 0x55d28f989b90 2023-10-05T21:17:00.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.973+0000 7f4be3fff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x55d28f989b90 0x55d28f98bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.973+0000 7f4be8983700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x55d28f8f7080 0x55d28f988470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:57276/0 (socket says 172.21.15.153:57276) 2023-10-05T21:17:00.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.973+0000 7f4be8983700 1 -- 172.21.15.153:0/1217735248 learned_addr learned my addr 172.21.15.153:0/1217735248 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:17:00.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.974+0000 7f4be37fe700 1 -- 172.21.15.153:0/1217735248 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 439105590 0 0) 0x55d28f8d0970 con 0x55d28f8f7080 2023-10-05T21:17:00.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.974+0000 7f4be37fe700 1 -- 172.21.15.153:0/1217735248 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bd8001e10 con 0x55d28f8f7080 2023-10-05T21:17:00.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.974+0000 7f4be3fff700 1 -- 172.21.15.153:0/1217735248 >> v1:172.21.15.111:6789/0 conn(0x55d28f8f7080 legacy=0x55d28f988470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.974+0000 7f4be3fff700 1 -- 172.21.15.153:0/1217735248 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d28f98d4c0 con 0x55d28f989b90 2023-10-05T21:17:00.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.974+0000 7f4be3fff700 1 --2- 172.21.15.153:0/1217735248 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f989b90 0x55d28f98bf70 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400a5d0 tx=0x7f4bd4005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e291b3ae8d13f67b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.974+0000 7f4be37fe700 1 -- 172.21.15.153:0/1217735248 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4bd4007610 con 0x55d28f989b90 2023-10-05T21:17:00.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.974+0000 7f4be37fe700 1 -- 172.21.15.153:0/1217735248 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd4007770 con 0x55d28f989b90 2023-10-05T21:17:00.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.974+0000 7f4be37fe700 1 -- 172.21.15.153:0/1217735248 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4bd4007a20 con 0x55d28f989b90 2023-10-05T21:17:00.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.974+0000 7f4bf58ab680 1 -- 172.21.15.153:0/1217735248 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f989b90 msgr2=0x55d28f98bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.974+0000 7f4bf58ab680 1 --2- 172.21.15.153:0/1217735248 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f989b90 0x55d28f98bf70 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400a5d0 tx=0x7f4bd4005a50 comp rx=0 tx=0).stop 2023-10-05T21:17:00.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.975+0000 7f4bf58ab680 1 -- 172.21.15.153:0/1217735248 shutdown_connections 2023-10-05T21:17:00.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.975+0000 7f4bf58ab680 1 --2- 172.21.15.153:0/1217735248 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f989b90 0x55d28f98bf70 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.975+0000 7f4bf58ab680 1 -- 172.21.15.153:0/1217735248 >> 172.21.15.153:0/1217735248 conn(0x55d28f97db60 msgr2=0x55d28f97ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.975+0000 7f4bf58ab680 1 -- 172.21.15.153:0/1217735248 shutdown_connections 2023-10-05T21:17:00.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.975+0000 7f4bf58ab680 1 -- 172.21.15.153:0/1217735248 wait complete. 2023-10-05T21:17:00.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.975+0000 7f4bf58ab680 1 Processor -- start 2023-10-05T21:17:00.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.975+0000 7f4bf58ab680 1 -- start start 2023-10-05T21:17:00.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.975+0000 7f4bf58ab680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f8f7080 0x55d28f9a4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.975+0000 7f4bf58ab680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d28f830ea0 con 0x55d28f8f7080 2023-10-05T21:17:00.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.976+0000 7f4be8983700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f8f7080 0x55d28f9a4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.976+0000 7f4be8983700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f8f7080 0x55d28f9a4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60816/0 (socket says 172.21.15.153:60816) 2023-10-05T21:17:00.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.976+0000 7f4be8983700 1 -- 172.21.15.153:0/2317583390 learned_addr learned my addr 172.21.15.153:0/2317583390 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.976+0000 7f4be8983700 1 -- 172.21.15.153:0/2317583390 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd4005cf0 con 0x55d28f8f7080 2023-10-05T21:17:00.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.976+0000 7f4be8983700 1 --2- 172.21.15.153:0/2317583390 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f8f7080 0x55d28f9a4880 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc001c00 tx=0x7f4bdc0017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3499d0966a340842 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.976+0000 7f4be27fc700 1 -- 172.21.15.153:0/2317583390 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4bdc00bbf0 con 0x55d28f8f7080 2023-10-05T21:17:00.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.977+0000 7f4be27fc700 1 -- 172.21.15.153:0/2317583390 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bdc00bd50 con 0x55d28f8f7080 2023-10-05T21:17:00.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.977+0000 7f4be27fc700 1 -- 172.21.15.153:0/2317583390 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4bdc00e470 con 0x55d28f8f7080 2023-10-05T21:17:00.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.977+0000 7f4bf58ab680 1 -- 172.21.15.153:0/2317583390 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f8f7080 msgr2=0x55d28f9a4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.977+0000 7f4bf58ab680 1 --2- 172.21.15.153:0/2317583390 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f8f7080 0x55d28f9a4880 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc001c00 tx=0x7f4bdc0017b0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.977+0000 7f4bf58ab680 1 -- 172.21.15.153:0/2317583390 shutdown_connections 2023-10-05T21:17:00.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.977+0000 7f4bf58ab680 1 --2- 172.21.15.153:0/2317583390 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f8f7080 0x55d28f9a4880 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.977+0000 7f4bf58ab680 1 -- 172.21.15.153:0/2317583390 >> 172.21.15.153:0/2317583390 conn(0x55d28f97db60 msgr2=0x55d28f9a0350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.977+0000 7f4bf58ab680 1 -- 172.21.15.153:0/2317583390 shutdown_connections 2023-10-05T21:17:00.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.977+0000 7f4bf58ab680 1 -- 172.21.15.153:0/2317583390 wait complete. 2023-10-05T21:17:00.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.977+0000 7f4bf58ab680 1 Processor -- start 2023-10-05T21:17:00.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.977+0000 7f4bf58ab680 1 -- start start 2023-10-05T21:17:00.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.978+0000 7f4bf58ab680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f8f7080 0x55d28f9abd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.978+0000 7f4bf58ab680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d28f827c80 con 0x55d28f8f7080 2023-10-05T21:17:00.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.978+0000 7f4be8983700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f8f7080 0x55d28f9abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.978+0000 7f4be8983700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f8f7080 0x55d28f9abd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60818/0 (socket says 172.21.15.153:60818) 2023-10-05T21:17:00.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.978+0000 7f4be8983700 1 -- 172.21.15.153:0/367480431 learned_addr learned my addr 172.21.15.153:0/367480431 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.978+0000 7f4be8983700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd8001e10 con 0x55d28f8f7080 2023-10-05T21:17:00.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.978+0000 7f4be8983700 1 --2- 172.21.15.153:0/367480431 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f8f7080 0x55d28f9abd40 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc010000 tx=0x7f4bdc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.978+0000 7f4be0ff9700 1 -- 172.21.15.153:0/367480431 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4bdc01f070 con 0x55d28f8f7080 2023-10-05T21:17:00.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.979+0000 7f4be0ff9700 1 -- 172.21.15.153:0/367480431 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bdc018640 con 0x55d28f8f7080 2023-10-05T21:17:00.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.979+0000 7f4bf58ab680 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d28f9ac280 con 0x55d28f8f7080 2023-10-05T21:17:00.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.979+0000 7f4be0ff9700 1 -- 172.21.15.153:0/367480431 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4bdc018930 con 0x55d28f8f7080 2023-10-05T21:17:00.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.979+0000 7f4bf58ab680 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d28f9ac6d0 con 0x55d28f8f7080 2023-10-05T21:17:00.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.979+0000 7f4be0ff9700 1 -- 172.21.15.153:0/367480431 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f4bdc018a90 con 0x55d28f8f7080 2023-10-05T21:17:00.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.979+0000 7f4bf58ab680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:17:00.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.979+0000 7f4bf58ab680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:17:00.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.980+0000 7f4be0ff9700 1 --2- 172.21.15.153:0/367480431 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4bcc034130 0x7f4bcc0365e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.980+0000 7f4bf58ab680 1 Processor -- start 2023-10-05T21:17:00.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.980+0000 7f4be0ff9700 1 -- 172.21.15.153:0/367480431 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f4bdc048ed0 con 0x55d28f8f7080 2023-10-05T21:17:00.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.980+0000 7f4bf58ab680 1 -- start start 2023-10-05T21:17:00.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.980+0000 7f4be3fff700 1 --2- 172.21.15.153:0/367480431 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4bcc034130 0x7f4bcc0365e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.980+0000 7f4bf58ab680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f9bdd10 0x55d28f9be120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.980+0000 7f4bf58ab680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d28f9be660 con 0x55d28f9bdd10 2023-10-05T21:17:00.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.980+0000 7f4be3fff700 1 --2- 172.21.15.153:0/367480431 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4bcc034130 0x7f4bcc0365e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4005a90 tx=0x7f4bd4014000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.980+0000 7f4be8983700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f9bdd10 0x55d28f9be120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.980+0000 7f4be8983700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f9bdd10 0x55d28f9be120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60828/0 (socket says 172.21.15.153:60828) 2023-10-05T21:17:00.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.980+0000 7f4be8983700 1 -- 172.21.15.153:0/3625162997 learned_addr learned my addr 172.21.15.153:0/3625162997 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.980+0000 7f4be8983700 1 -- 172.21.15.153:0/3625162997 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d28f9be7a0 con 0x55d28f9bdd10 2023-10-05T21:17:00.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.980+0000 7f4be8983700 1 --2- 172.21.15.153:0/3625162997 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f9bdd10 0x55d28f9be120 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc016fd0 tx=0x7f4bdc047230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a756b7753ef49fa8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.981+0000 7f4bb9fe3700 1 -- 172.21.15.153:0/3625162997 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4bdc02da10 con 0x55d28f9bdd10 2023-10-05T21:17:00.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.981+0000 7f4bb9fe3700 1 -- 172.21.15.153:0/3625162997 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bdc02dc10 con 0x55d28f9bdd10 2023-10-05T21:17:00.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.981+0000 7f4bb9fe3700 1 -- 172.21.15.153:0/3625162997 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4bdc018d40 con 0x55d28f9bdd10 2023-10-05T21:17:00.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.981+0000 7f4bf58ab680 1 -- 172.21.15.153:0/3625162997 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f9bdd10 msgr2=0x55d28f9be120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:00.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.981+0000 7f4bf58ab680 1 --2- 172.21.15.153:0/3625162997 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f9bdd10 0x55d28f9be120 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc016fd0 tx=0x7f4bdc047230 comp rx=0 tx=0).stop 2023-10-05T21:17:00.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.981+0000 7f4bf58ab680 1 -- 172.21.15.153:0/3625162997 shutdown_connections 2023-10-05T21:17:00.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.981+0000 7f4bf58ab680 1 --2- 172.21.15.153:0/3625162997 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f9bdd10 0x55d28f9be120 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:00.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.981+0000 7f4bf58ab680 1 -- 172.21.15.153:0/3625162997 >> 172.21.15.153:0/3625162997 conn(0x55d28f989b90 msgr2=0x55d28f9ba870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:00.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.981+0000 7f4bf58ab680 1 -- 172.21.15.153:0/3625162997 shutdown_connections 2023-10-05T21:17:00.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.981+0000 7f4bf58ab680 1 -- 172.21.15.153:0/3625162997 wait complete. 2023-10-05T21:17:00.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.982+0000 7f4bf58ab680 1 Processor -- start 2023-10-05T21:17:00.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.982+0000 7f4bf58ab680 1 -- start start 2023-10-05T21:17:00.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.982+0000 7f4bf58ab680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f9bdd10 0x55d28f9c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:00.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.982+0000 7f4bf58ab680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d28f9c5390 con 0x55d28f9bdd10 2023-10-05T21:17:00.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.982+0000 7f4be8983700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f9bdd10 0x55d28f9c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:00.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.982+0000 7f4be8983700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f9bdd10 0x55d28f9c4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60838/0 (socket says 172.21.15.153:60838) 2023-10-05T21:17:00.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.982+0000 7f4be8983700 1 -- 172.21.15.153:0/2294500417 learned_addr learned my addr 172.21.15.153:0/2294500417 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:00.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.983+0000 7f4be8983700 1 -- 172.21.15.153:0/2294500417 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d28f9ac6d0 con 0x55d28f9bdd10 2023-10-05T21:17:00.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.983+0000 7f4be8983700 1 --2- 172.21.15.153:0/2294500417 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f9bdd10 0x55d28f9c4e50 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc016ef0 tx=0x7f4bdc033000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:00.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.983+0000 7f4b33fff700 1 -- 172.21.15.153:0/2294500417 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4bdc0245b0 con 0x55d28f9bdd10 2023-10-05T21:17:00.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.983+0000 7f4b33fff700 1 -- 172.21.15.153:0/2294500417 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bdc03a070 con 0x55d28f9bdd10 2023-10-05T21:17:00.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.983+0000 7f4b33fff700 1 -- 172.21.15.153:0/2294500417 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4bdc017c50 con 0x55d28f9bdd10 2023-10-05T21:17:00.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.983+0000 7f4bf58ab680 1 -- 172.21.15.153:0/2294500417 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d28f9c5590 con 0x55d28f9bdd10 2023-10-05T21:17:00.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.983+0000 7f4bf58ab680 1 -- 172.21.15.153:0/2294500417 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d28f9c83c0 con 0x55d28f9bdd10 2023-10-05T21:17:01.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.984+0000 7f4b33fff700 1 -- 172.21.15.153:0/2294500417 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f4bdc02d3f0 con 0x55d28f9bdd10 2023-10-05T21:17:01.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.984+0000 7f4b33fff700 1 --2- 172.21.15.153:0/2294500417 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4b380340f0 0x7f4b380365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:01.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.984+0000 7f4b33fff700 1 -- 172.21.15.153:0/2294500417 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f4bdc027120 con 0x55d28f9bdd10 2023-10-05T21:17:01.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.984+0000 7f4b31ffb700 20 reqs_thread_entry: start 2023-10-05T21:17:01.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.984+0000 7f4bf58ab680 20 try_to_resolve_local_entities(): before: realm_id= realm_name= zonegroup_id= zonegroup_name= zone_id= zone_name= 2023-10-05T21:17:01.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.984+0000 7f4bf58ab680 20 rados->read ofs=0 len=0 2023-10-05T21:17:01.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.984+0000 7f4bf58ab680 1 --2- 172.21.15.153:0/367480431 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d28f9e5800 0x55d28f9f4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:01.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.984+0000 7f4be3fff700 1 --2- 172.21.15.153:0/2294500417 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4b380340f0 0x7f4b380365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:01.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.984+0000 7f4bf58ab680 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9e5bf0 con 0x55d28f9e5800 2023-10-05T21:17:01.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.984+0000 7f4be9184700 1 --2- 172.21.15.153:0/367480431 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d28f9e5800 0x55d28f9f4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:01.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.984+0000 7f4be9184700 1 --2- 172.21.15.153:0/367480431 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d28f9e5800 0x55d28f9f4f20 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:01.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.984+0000 7f4be3fff700 1 --2- 172.21.15.153:0/2294500417 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4b380340f0 0x7f4b380365a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4003080 tx=0x7f4bd401c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:01.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.985+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4be400a4f0 con 0x55d28f9e5800 2023-10-05T21:17:01.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.985+0000 7f4bf58ab680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:01.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.985+0000 7f4bf58ab680 20 rados->read ofs=0 len=0 2023-10-05T21:17:01.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.985+0000 7f4bf58ab680 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f5460 con 0x55d28f9e5800 2023-10-05T21:17:01.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.985+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4be400a4f0 con 0x55d28f9e5800 2023-10-05T21:17:01.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.985+0000 7f4bf58ab680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:17:01.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.985+0000 7f4bf58ab680 20 rados->read ofs=0 len=0 2023-10-05T21:17:01.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.985+0000 7f4bf58ab680 1 --2- 172.21.15.153:0/367480431 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d28f9f5d20 0x55d28f9f8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:01.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.985+0000 7f4bf58ab680 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:3 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f8640 con 0x55d28f9f5d20 2023-10-05T21:17:01.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.985+0000 7f4be8983700 1 --2- 172.21.15.153:0/367480431 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d28f9f5d20 0x55d28f9f8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:01.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.985+0000 7f4be8983700 1 --2- 172.21.15.153:0/367480431 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d28f9f5d20 0x55d28f9f8100 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:01.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.986+0000 7f4be8983700 1 -- 172.21.15.153:0/367480431 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(3 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f4bdc014070 con 0x55d28f9f5d20 2023-10-05T21:17:01.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.986+0000 7f4bf58ab680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:17:01.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.986+0000 7f4bf58ab680 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:4 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x55d28f9f5d20 2023-10-05T21:17:01.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.986+0000 7f4be8983700 1 -- 172.21.15.153:0/367480431 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(4 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bdc014070 con 0x55d28f9f5d20 2023-10-05T21:17:01.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.986+0000 7f4be8983700 1 --2- 172.21.15.153:0/367480431 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4bdc04f070 0x7f4bdc0525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:01.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.986+0000 7f4be8983700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:5 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x7f4bdc04f070 2023-10-05T21:17:01.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.986+0000 7f4be3fff700 1 --2- 172.21.15.153:0/367480431 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4bdc04f070 0x7f4bdc0525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:01.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.986+0000 7f4be3fff700 1 --2- 172.21.15.153:0/367480431 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4bdc04f070 0x7f4bdc0525a0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:01.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.987+0000 7f4be3fff700 1 -- 172.21.15.153:0/367480431 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(5 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bd40208b0 con 0x7f4bdc04f070 2023-10-05T21:17:01.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.987+0000 7f4be3fff700 1 --2- 172.21.15.153:0/367480431 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4bd4007030 0x7f4bd401d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:01.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.987+0000 7f4be3fff700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:6 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x7f4bd4007030 2023-10-05T21:17:01.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.987+0000 7f4be9184700 1 --2- 172.21.15.153:0/367480431 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4bd4007030 0x7f4bd401d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:01.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.987+0000 7f4be9184700 1 --2- 172.21.15.153:0/367480431 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4bd4007030 0x7f4bd401d430 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:01.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.988+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a4f0 con 0x7f4bd4007030 2023-10-05T21:17:01.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.988+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:7 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x55d28f9e5800 2023-10-05T21:17:01.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.988+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a4f0 con 0x55d28f9e5800 2023-10-05T21:17:01.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.988+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:8 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x55d28f9e5800 2023-10-05T21:17:01.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.988+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a4f0 con 0x55d28f9e5800 2023-10-05T21:17:01.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.988+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:9 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x7f4bd4007030 2023-10-05T21:17:01.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.988+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a4f0 con 0x7f4bd4007030 2023-10-05T21:17:01.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.988+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:10 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x7f4bd4007030 2023-10-05T21:17:01.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.989+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a4f0 con 0x7f4bd4007030 2023-10-05T21:17:01.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.989+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:11 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x7f4bdc04f070 2023-10-05T21:17:01.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.989+0000 7f4be3fff700 1 -- 172.21.15.153:0/367480431 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bd40208b0 con 0x7f4bdc04f070 2023-10-05T21:17:01.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.989+0000 7f4be3fff700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:12 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x55d28f9f5d20 2023-10-05T21:17:01.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.989+0000 7f4be8983700 1 -- 172.21.15.153:0/367480431 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4bdc014070 con 0x55d28f9f5d20 2023-10-05T21:17:01.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.989+0000 7f4be8983700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:13 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x55d28f9e5800 2023-10-05T21:17:01.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.989+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a4f0 con 0x55d28f9e5800 2023-10-05T21:17:01.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.989+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:14 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x7f4bd4007030 2023-10-05T21:17:01.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.990+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a4f0 con 0x7f4bd4007030 2023-10-05T21:17:01.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.990+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x55d28f9e5800 2023-10-05T21:17:01.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.990+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a4f0 con 0x55d28f9e5800 2023-10-05T21:17:01.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.990+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:16 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x7f4bdc04f070 2023-10-05T21:17:01.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.990+0000 7f4be3fff700 1 -- 172.21.15.153:0/367480431 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bd40208b0 con 0x7f4bdc04f070 2023-10-05T21:17:01.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.990+0000 7f4be3fff700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:17 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x55d28f9f5d20 2023-10-05T21:17:01.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.990+0000 7f4be8983700 1 -- 172.21.15.153:0/367480431 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bdc014070 con 0x55d28f9f5d20 2023-10-05T21:17:01.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.990+0000 7f4be8983700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:18 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x55d28f9f5d20 2023-10-05T21:17:01.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.990+0000 7f4be8983700 1 -- 172.21.15.153:0/367480431 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(18 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bdc014070 con 0x55d28f9f5d20 2023-10-05T21:17:01.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.990+0000 7f4be8983700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:19 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x7f4bd4007030 2023-10-05T21:17:01.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.991+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a4f0 con 0x7f4bd4007030 2023-10-05T21:17:01.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.991+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x55d28f9f5d20 2023-10-05T21:17:01.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.991+0000 7f4be8983700 1 -- 172.21.15.153:0/367480431 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bdc014070 con 0x55d28f9f5d20 2023-10-05T21:17:01.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.991+0000 7f4be8983700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:21 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x55d28f9f5d20 2023-10-05T21:17:01.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.991+0000 7f4be8983700 1 -- 172.21.15.153:0/367480431 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bdc014070 con 0x55d28f9f5d20 2023-10-05T21:17:01.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.991+0000 7f4be8983700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:22 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x55d28f9e5800 2023-10-05T21:17:01.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.992+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a4f0 con 0x55d28f9e5800 2023-10-05T21:17:01.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.992+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:23 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x55d28f9e5800 2023-10-05T21:17:01.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.992+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(23 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4be400a4f0 con 0x55d28f9e5800 2023-10-05T21:17:01.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.992+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:24 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x7f4bd4007030 2023-10-05T21:17:01.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.992+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a4f0 con 0x7f4bd4007030 2023-10-05T21:17:01.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.992+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:25 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x55d28f9f5d20 2023-10-05T21:17:01.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.992+0000 7f4be8983700 1 -- 172.21.15.153:0/367480431 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(25 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bdc014070 con 0x55d28f9f5d20 2023-10-05T21:17:01.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.992+0000 7f4be8983700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:26 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x7f4bdc04f070 2023-10-05T21:17:01.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.993+0000 7f4be3fff700 1 -- 172.21.15.153:0/367480431 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bd40208b0 con 0x7f4bdc04f070 2023-10-05T21:17:01.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.993+0000 7f4be3fff700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:27 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x55d28f9e5800 2023-10-05T21:17:01.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.993+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a4f0 con 0x55d28f9e5800 2023-10-05T21:17:01.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.993+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:28 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x7f4bd4007030 2023-10-05T21:17:01.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.993+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a4f0 con 0x7f4bd4007030 2023-10-05T21:17:01.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.993+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:29 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x55d28f9f5d20 2023-10-05T21:17:01.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.993+0000 7f4be8983700 1 -- 172.21.15.153:0/367480431 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bdc014070 con 0x55d28f9f5d20 2023-10-05T21:17:01.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.993+0000 7f4be8983700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x7f4bd4007030 2023-10-05T21:17:01.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.994+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a4f0 con 0x7f4bd4007030 2023-10-05T21:17:01.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.994+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:31 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x7f4bdc04f070 2023-10-05T21:17:01.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.994+0000 7f4be3fff700 1 -- 172.21.15.153:0/367480431 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bd40208b0 con 0x7f4bdc04f070 2023-10-05T21:17:01.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.994+0000 7f4be3fff700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:32 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x55d28f9f5d20 2023-10-05T21:17:01.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.994+0000 7f4be8983700 1 -- 172.21.15.153:0/367480431 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bdc014070 con 0x55d28f9f5d20 2023-10-05T21:17:01.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.994+0000 7f4be8983700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:33 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x7f4bd4007030 2023-10-05T21:17:01.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.995+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4be400a4f0 con 0x7f4bd4007030 2023-10-05T21:17:01.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.995+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:34 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x55d28f9e5800 2023-10-05T21:17:01.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.995+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f4be400a4f0 con 0x55d28f9e5800 2023-10-05T21:17:01.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.995+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:35 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9a00 con 0x7f4bdc04f070 2023-10-05T21:17:01.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.995+0000 7f4be3fff700 1 -- 172.21.15.153:0/367480431 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4bd40208b0 con 0x7f4bdc04f070 2023-10-05T21:17:01.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.995+0000 7f4bf58ab680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:17:01.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.995+0000 7f4bf58ab680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:17:01.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.995+0000 7f4bf58ab680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:17:01.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.995+0000 7f4bf58ab680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:17:01.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.995+0000 7f4bf58ab680 20 rados->read ofs=0 len=0 2023-10-05T21:17:01.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.995+0000 7f4bf58ab680 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f89f0 con 0x55d28f9e5800 2023-10-05T21:17:01.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.995+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(36 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4be400a4f0 con 0x55d28f9e5800 2023-10-05T21:17:01.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.995+0000 7f4bf58ab680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:01.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.995+0000 7f4bf58ab680 20 rados->read ofs=0 len=0 2023-10-05T21:17:01.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.995+0000 7f4bf58ab680 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:37 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f8da0 con 0x55d28f9e5800 2023-10-05T21:17:01.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.996+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(37 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4be400a4f0 con 0x55d28f9e5800 2023-10-05T21:17:01.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.996+0000 7f4bf58ab680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:17:01.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.996+0000 7f4bf58ab680 20 rados->read ofs=0 len=0 2023-10-05T21:17:01.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.996+0000 7f4bf58ab680 1 -- 172.21.15.153:0/367480431 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d28f9f9200 con 0x55d28f9e5800 2023-10-05T21:17:01.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.996+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f4be400a4f0 con 0x55d28f9e5800 2023-10-05T21:17:01.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.996+0000 7f4bf58ab680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:17:01.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.996+0000 7f4bf58ab680 1 -- 172.21.15.153:0/367480431 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4bd4007030 msgr2=0x7f4bd401d430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:01.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.996+0000 7f4bf58ab680 1 --2- 172.21.15.153:0/367480431 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4bd4007030 0x7f4bd401d430 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:01.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.996+0000 7f4bf58ab680 1 -- 172.21.15.153:0/367480431 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d28f9e5800 msgr2=0x55d28f9f4f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:01.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.996+0000 7f4bf58ab680 1 --2- 172.21.15.153:0/367480431 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x55d28f9e5800 0x55d28f9f4f20 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:01.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.996+0000 7f4bf58ab680 1 -- 172.21.15.153:0/367480431 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4bdc04f070 msgr2=0x7f4bdc0525a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:01.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.996+0000 7f4bf58ab680 1 --2- 172.21.15.153:0/367480431 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4bdc04f070 0x7f4bdc0525a0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:01.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.996+0000 7f4bf58ab680 1 -- 172.21.15.153:0/367480431 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d28f9f5d20 msgr2=0x55d28f9f8100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:01.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.996+0000 7f4bf58ab680 1 --2- 172.21.15.153:0/367480431 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x55d28f9f5d20 0x55d28f9f8100 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:01.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.997+0000 7f4bf58ab680 1 -- 172.21.15.153:0/367480431 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4bcc034130 msgr2=0x7f4bcc0365e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:01.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.997+0000 7f4bf58ab680 1 --2- 172.21.15.153:0/367480431 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4bcc034130 0x7f4bcc0365e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4005a90 tx=0x7f4bd4014000 comp rx=0 tx=0).stop 2023-10-05T21:17:01.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.997+0000 7f4bf58ab680 1 -- 172.21.15.153:0/367480431 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f8f7080 msgr2=0x55d28f9abd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:01.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.997+0000 7f4be9184700 1 -- 172.21.15.153:0/367480431 reap_dead start 2023-10-05T21:17:01.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.997+0000 7f4bf58ab680 1 --2- 172.21.15.153:0/367480431 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f8f7080 0x55d28f9abd40 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc010000 tx=0x7f4bdc014000 comp rx=0 tx=0).stop 2023-10-05T21:17:01.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.997+0000 7f4bf58ab680 1 -- 172.21.15.153:0/367480431 shutdown_connections 2023-10-05T21:17:01.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.997+0000 7f4bf58ab680 1 --2- 172.21.15.153:0/367480431 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f8f7080 0x55d28f9abd40 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:01.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.997+0000 7f4bf58ab680 1 -- 172.21.15.153:0/367480431 >> 172.21.15.153:0/367480431 conn(0x55d28f97db60 msgr2=0x55d28f99ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:01.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.997+0000 7f4bf58ab680 1 -- 172.21.15.153:0/367480431 shutdown_connections 2023-10-05T21:17:01.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.997+0000 7f4bf58ab680 1 -- 172.21.15.153:0/367480431 wait complete. 2023-10-05T21:17:01.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.997+0000 7f4bf58ab680 1 -- 172.21.15.153:0/2294500417 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4b380340f0 msgr2=0x7f4b380365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:01.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.997+0000 7f4bf58ab680 1 --2- 172.21.15.153:0/2294500417 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4b380340f0 0x7f4b380365a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4003080 tx=0x7f4bd401c000 comp rx=0 tx=0).stop 2023-10-05T21:17:01.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.997+0000 7f4bf58ab680 1 -- 172.21.15.153:0/2294500417 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f9bdd10 msgr2=0x55d28f9c4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:01.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.997+0000 7f4bf58ab680 1 --2- 172.21.15.153:0/2294500417 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f9bdd10 0x55d28f9c4e50 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc016ef0 tx=0x7f4bdc033000 comp rx=0 tx=0).stop 2023-10-05T21:17:01.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.997+0000 7f4bf58ab680 1 -- 172.21.15.153:0/2294500417 shutdown_connections 2023-10-05T21:17:01.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.997+0000 7f4bf58ab680 1 --2- 172.21.15.153:0/2294500417 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4b380340f0 0x7f4b380365a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:01.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.997+0000 7f4bf58ab680 1 --2- 172.21.15.153:0/2294500417 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d28f9bdd10 0x55d28f9c4e50 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:01.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.997+0000 7f4bf58ab680 1 -- 172.21.15.153:0/2294500417 >> 172.21.15.153:0/2294500417 conn(0x55d28f989b90 msgr2=0x55d28f9ba3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:01.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.997+0000 7f4bf58ab680 1 -- 172.21.15.153:0/2294500417 shutdown_connections 2023-10-05T21:17:01.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:00.997+0000 7f4bf58ab680 1 -- 172.21.15.153:0/2294500417 wait complete. 2023-10-05T21:17:01.015 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:17:01.015 INFO:teuthology.orchestra.run.smithi153.stdout: "id": "371967c9-8a2e-480a-9a00-92e7f0730f89", 2023-10-05T21:17:01.015 INFO:teuthology.orchestra.run.smithi153.stdout: "name": "default", 2023-10-05T21:17:01.015 INFO:teuthology.orchestra.run.smithi153.stdout: "api_name": "default", 2023-10-05T21:17:01.015 INFO:teuthology.orchestra.run.smithi153.stdout: "is_master": "true", 2023-10-05T21:17:01.015 INFO:teuthology.orchestra.run.smithi153.stdout: "endpoints": [], 2023-10-05T21:17:01.015 INFO:teuthology.orchestra.run.smithi153.stdout: "hostnames": [], 2023-10-05T21:17:01.015 INFO:teuthology.orchestra.run.smithi153.stdout: "hostnames_s3website": [], 2023-10-05T21:17:01.016 INFO:teuthology.orchestra.run.smithi153.stdout: "master_zone": "193cdd3f-16f8-4551-b3a7-d103e6acfa54", 2023-10-05T21:17:01.016 INFO:teuthology.orchestra.run.smithi153.stdout: "zones": [ 2023-10-05T21:17:01.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:17:01.016 INFO:teuthology.orchestra.run.smithi153.stdout: "id": "193cdd3f-16f8-4551-b3a7-d103e6acfa54", 2023-10-05T21:17:01.016 INFO:teuthology.orchestra.run.smithi153.stdout: "name": "default", 2023-10-05T21:17:01.016 INFO:teuthology.orchestra.run.smithi153.stdout: "endpoints": [], 2023-10-05T21:17:01.016 INFO:teuthology.orchestra.run.smithi153.stdout: "log_meta": "false", 2023-10-05T21:17:01.016 INFO:teuthology.orchestra.run.smithi153.stdout: "log_data": "false", 2023-10-05T21:17:01.016 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_index_max_shards": 11, 2023-10-05T21:17:01.016 INFO:teuthology.orchestra.run.smithi153.stdout: "read_only": "false", 2023-10-05T21:17:01.016 INFO:teuthology.orchestra.run.smithi153.stdout: "tier_type": "", 2023-10-05T21:17:01.016 INFO:teuthology.orchestra.run.smithi153.stdout: "sync_from_all": "true", 2023-10-05T21:17:01.017 INFO:teuthology.orchestra.run.smithi153.stdout: "sync_from": [], 2023-10-05T21:17:01.017 INFO:teuthology.orchestra.run.smithi153.stdout: "redirect_zone": "" 2023-10-05T21:17:01.017 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:17:01.017 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:17:01.017 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_targets": [ 2023-10-05T21:17:01.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:17:01.017 INFO:teuthology.orchestra.run.smithi153.stdout: "name": "default-placement", 2023-10-05T21:17:01.017 INFO:teuthology.orchestra.run.smithi153.stdout: "tags": [], 2023-10-05T21:17:01.017 INFO:teuthology.orchestra.run.smithi153.stdout: "storage_classes": [ 2023-10-05T21:17:01.017 INFO:teuthology.orchestra.run.smithi153.stdout: "STANDARD" 2023-10-05T21:17:01.017 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-05T21:17:01.017 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:17:01.018 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:17:01.018 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "default-placement", 2023-10-05T21:17:01.018 INFO:teuthology.orchestra.run.smithi153.stdout: "realm_id": "", 2023-10-05T21:17:01.018 INFO:teuthology.orchestra.run.smithi153.stdout: "sync_policy": { 2023-10-05T21:17:01.018 INFO:teuthology.orchestra.run.smithi153.stdout: "groups": [] 2023-10-05T21:17:01.018 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:17:01.018 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:17:01.018 DEBUG:tasks.util.rgw: json result: {'id': '371967c9-8a2e-480a-9a00-92e7f0730f89', 'name': 'default', 'api_name': 'default', 'is_master': 'true', 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '193cdd3f-16f8-4551-b3a7-d103e6acfa54', 'zones': [{'id': '193cdd3f-16f8-4551-b3a7-d103e6acfa54', 'name': 'default', 'endpoints': [], 'log_meta': 'false', 'log_data': 'false', 'bucket_index_max_shards': 11, 'read_only': 'false', 'tier_type': '', 'sync_from_all': 'true', 'sync_from': [], 'redirect_zone': ''}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}} 2023-10-05T21:17:01.021 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2023-10-05T21:17:01.036 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2023-10-05T21:17:01.036 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2023-10-05T21:17:01.036 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2023-10-05T21:17:01.110 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2023-10-05T21:17:01.110 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T21:17:01.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.109+0000 7f4cdc493680 1 Processor -- start 2023-10-05T21:17:01.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.109+0000 7f4cdc493680 1 -- start start 2023-10-05T21:17:01.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.109+0000 7f4cdc493680 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5647f6896250 0x5647f6896660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:01.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.109+0000 7f4cdc493680 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5647f67e4930 con 0x5647f6896ba0 2023-10-05T21:17:01.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.109+0000 7f4cdc493680 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x5647f67a4db0 con 0x5647f6896250 2023-10-05T21:17:01.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.109+0000 7f4ccf56b700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x5647f6896250 0x5647f6896660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:01.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.109+0000 7f4cced6a700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x5647f6896ba0 0x5647f6897590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.153:57290/0 (socket says 172.21.15.153:57290) 2023-10-05T21:17:01.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.109+0000 7f4cced6a700 1 -- 172.21.15.153:0/536279410 learned_addr learned my addr 172.21.15.153:0/536279410 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-10-05T21:17:01.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.110+0000 7f4ccf56b700 1 -- 172.21.15.153:0/536279410 >> v1:172.21.15.111:6789/0 conn(0x5647f6896ba0 legacy=0x5647f6897590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:01.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.110+0000 7f4ccf56b700 1 -- 172.21.15.153:0/536279410 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647f6897e40 con 0x5647f6896250 2023-10-05T21:17:01.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.110+0000 7f4ccf56b700 1 --2- 172.21.15.153:0/536279410 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f6896250 0x5647f6896660 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000a5d0 tx=0x7f4cc0005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e43b20cc3e71b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:01.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.110+0000 7f4cce569700 1 -- 172.21.15.153:0/536279410 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cc00086a0 con 0x5647f6896250 2023-10-05T21:17:01.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.110+0000 7f4cce569700 1 -- 172.21.15.153:0/536279410 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc0008800 con 0x5647f6896250 2023-10-05T21:17:01.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.110+0000 7f4cce569700 1 -- 172.21.15.153:0/536279410 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cc0008ad0 con 0x5647f6896250 2023-10-05T21:17:01.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.110+0000 7f4cdc493680 1 -- 172.21.15.153:0/536279410 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f6896250 msgr2=0x5647f6896660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:01.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.110+0000 7f4cdc493680 1 --2- 172.21.15.153:0/536279410 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f6896250 0x5647f6896660 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000a5d0 tx=0x7f4cc0005a50 comp rx=0 tx=0).stop 2023-10-05T21:17:01.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.111+0000 7f4cdc493680 1 -- 172.21.15.153:0/536279410 shutdown_connections 2023-10-05T21:17:01.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.111+0000 7f4cdc493680 1 --2- 172.21.15.153:0/536279410 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f6896250 0x5647f6896660 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:01.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.111+0000 7f4cdc493680 1 -- 172.21.15.153:0/536279410 >> 172.21.15.153:0/536279410 conn(0x5647f6891b20 msgr2=0x5647f6893f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:01.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.111+0000 7f4cdc493680 1 -- 172.21.15.153:0/536279410 shutdown_connections 2023-10-05T21:17:01.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.111+0000 7f4cdc493680 1 -- 172.21.15.153:0/536279410 wait complete. 2023-10-05T21:17:01.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.111+0000 7f4cdc493680 1 Processor -- start 2023-10-05T21:17:01.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.111+0000 7f4cdc493680 1 -- start start 2023-10-05T21:17:01.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.111+0000 7f4cdc493680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f6896250 0x5647f68b5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:01.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.111+0000 7f4cdc493680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f6744ea0 con 0x5647f6896250 2023-10-05T21:17:01.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.112+0000 7f4ccf56b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f6896250 0x5647f68b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:01.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.112+0000 7f4ccf56b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f6896250 0x5647f68b5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60858/0 (socket says 172.21.15.153:60858) 2023-10-05T21:17:01.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.112+0000 7f4ccf56b700 1 -- 172.21.15.153:0/3916063363 learned_addr learned my addr 172.21.15.153:0/3916063363 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:01.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.112+0000 7f4ccf56b700 1 -- 172.21.15.153:0/3916063363 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc0005cf0 con 0x5647f6896250 2023-10-05T21:17:01.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.112+0000 7f4ccf56b700 1 --2- 172.21.15.153:0/3916063363 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f6896250 0x5647f68b5800 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0005a90 tx=0x7f4cc0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee30c74b501904c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:01.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.112+0000 7f4ccd567700 1 -- 172.21.15.153:0/3916063363 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cc0008970 con 0x5647f6896250 2023-10-05T21:17:01.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.112+0000 7f4ccd567700 1 -- 172.21.15.153:0/3916063363 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc0008ad0 con 0x5647f6896250 2023-10-05T21:17:01.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.112+0000 7f4ccd567700 1 -- 172.21.15.153:0/3916063363 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cc0008dc0 con 0x5647f6896250 2023-10-05T21:17:01.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.113+0000 7f4cdc493680 1 -- 172.21.15.153:0/3916063363 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f6896250 msgr2=0x5647f68b5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:01.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.113+0000 7f4cdc493680 1 --2- 172.21.15.153:0/3916063363 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f6896250 0x5647f68b5800 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0005a90 tx=0x7f4cc0015000 comp rx=0 tx=0).stop 2023-10-05T21:17:01.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.113+0000 7f4cdc493680 1 -- 172.21.15.153:0/3916063363 shutdown_connections 2023-10-05T21:17:01.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.113+0000 7f4cdc493680 1 --2- 172.21.15.153:0/3916063363 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f6896250 0x5647f68b5800 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:01.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.113+0000 7f4cdc493680 1 -- 172.21.15.153:0/3916063363 >> 172.21.15.153:0/3916063363 conn(0x5647f6891b20 msgr2=0x5647f68b12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:01.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.113+0000 7f4cdc493680 1 -- 172.21.15.153:0/3916063363 shutdown_connections 2023-10-05T21:17:01.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.113+0000 7f4cdc493680 1 -- 172.21.15.153:0/3916063363 wait complete. 2023-10-05T21:17:01.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.113+0000 7f4cdc493680 1 Processor -- start 2023-10-05T21:17:01.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.113+0000 7f4cdc493680 1 -- start start 2023-10-05T21:17:01.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.113+0000 7f4cdc493680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f6896250 0x5647f68bfe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:01.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.113+0000 7f4cdc493680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f673bc80 con 0x5647f6896250 2023-10-05T21:17:01.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.114+0000 7f4ccf56b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f6896250 0x5647f68bfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:01.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.114+0000 7f4ccf56b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f6896250 0x5647f68bfe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60870/0 (socket says 172.21.15.153:60870) 2023-10-05T21:17:01.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.114+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 learned_addr learned my addr 172.21.15.153:0/147138055 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:01.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.114+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647f6897e40 con 0x5647f6896250 2023-10-05T21:17:01.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.114+0000 7f4ccf56b700 1 --2- 172.21.15.153:0/147138055 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f6896250 0x5647f68bfe70 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0005a90 tx=0x7f4cc001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:01.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.114+0000 7f4cbf7fe700 1 -- 172.21.15.153:0/147138055 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cc0026420 con 0x5647f6896250 2023-10-05T21:17:01.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.114+0000 7f4cbf7fe700 1 -- 172.21.15.153:0/147138055 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc0026580 con 0x5647f6896250 2023-10-05T21:17:01.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.114+0000 7f4cbf7fe700 1 -- 172.21.15.153:0/147138055 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cc0026850 con 0x5647f6896250 2023-10-05T21:17:01.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.114+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5647f68c03b0 con 0x5647f6896250 2023-10-05T21:17:01.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.114+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5647f68c08e0 con 0x5647f6896250 2023-10-05T21:17:01.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.115+0000 7f4cdc493680 20 rados->read ofs=0 len=0 2023-10-05T21:17:01.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.115+0000 7f4cbf7fe700 1 -- 172.21.15.153:0/147138055 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f4cc0026a00 con 0x5647f6896250 2023-10-05T21:17:01.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.116+0000 7f4cbf7fe700 1 --2- 172.21.15.153:0/147138055 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4cb4034140 0x7f4cb40365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:01.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.116+0000 7f4cbf7fe700 1 -- 172.21.15.153:0/147138055 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f4cc004a4c0 con 0x5647f6896250 2023-10-05T21:17:01.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.116+0000 7f4cced6a700 1 --2- 172.21.15.153:0/147138055 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4cb4034140 0x7f4cb40365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:01.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.116+0000 7f4cdc493680 1 --2- 172.21.15.153:0/147138055 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5647f68c9c70 0x5647f68cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:01.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.116+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68cc840 con 0x5647f68c9c70 2023-10-05T21:17:01.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.116+0000 7f4ccfd6c700 1 --2- 172.21.15.153:0/147138055 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5647f68c9c70 0x5647f68cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:01.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.116+0000 7f4cced6a700 1 --2- 172.21.15.153:0/147138055 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4cb4034140 0x7f4cb40365f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4004170 tx=0x7f4cc40012e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:01.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.116+0000 7f4ccfd6c700 1 --2- 172.21.15.153:0/147138055 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5647f68c9c70 0x5647f68cc0b0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:01.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.116+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.116+0000 7f4cdc493680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:01.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.116+0000 7f4cdc493680 20 realm 2023-10-05T21:17:01.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.116+0000 7f4cdc493680 20 rados->read ofs=0 len=0 2023-10-05T21:17:01.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.116+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68c92e0 con 0x5647f68c9c70 2023-10-05T21:17:01.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.117+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.117+0000 7f4cdc493680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:01.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.117+0000 7f4cdc493680 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T21:17:01.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.117+0000 7f4cdc493680 20 rados->read ofs=0 len=0 2023-10-05T21:17:01.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.117+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68cd340 con 0x5647f68c9c70 2023-10-05T21:17:01.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.117+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.117+0000 7f4cdc493680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:01.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.117+0000 7f4cdc493680 20 rados->read ofs=0 len=0 2023-10-05T21:17:01.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.117+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68cdc60 con 0x5647f68c9c70 2023-10-05T21:17:01.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.117+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.117+0000 7f4cdc493680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:17:01.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.117+0000 7f4cdc493680 20 rados->read ofs=0 len=0 2023-10-05T21:17:01.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.117+0000 7f4cdc493680 1 --2- 172.21.15.153:0/147138055 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5647f68ce520 0x5647f68d0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:01.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.117+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:5 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d0f50 con 0x5647f68ce520 2023-10-05T21:17:01.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.117+0000 7f4ccf56b700 1 --2- 172.21.15.153:0/147138055 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5647f68ce520 0x5647f68d0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:01.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.118+0000 7f4ccf56b700 1 --2- 172.21.15.153:0/147138055 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5647f68ce520 0x5647f68d0900 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:01.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.118+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 <== osd.3 v2:172.21.15.153:6800/140455 1 ==== osd_op_reply(5 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f4cc0023070 con 0x5647f68ce520 2023-10-05T21:17:01.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.118+0000 7f4cdc493680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:17:01.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.118+0000 7f4cdc493680 20 searching for the correct realm 2023-10-05T21:17:01.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.118+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x5647f68ce520 2023-10-05T21:17:01.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.118+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 <== osd.3 v2:172.21.15.153:6800/140455 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc0023070 con 0x5647f68ce520 2023-10-05T21:17:01.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.118+0000 7f4ccf56b700 1 --2- 172.21.15.153:0/147138055 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4cc0039070 0x7f4cc00253b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:01.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.118+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x7f4cc0039070 2023-10-05T21:17:01.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.118+0000 7f4cced6a700 1 --2- 172.21.15.153:0/147138055 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4cc0039070 0x7f4cc00253b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:01.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.119+0000 7f4cced6a700 1 --2- 172.21.15.153:0/147138055 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4cc0039070 0x7f4cc00253b0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:01.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.119+0000 7f4cced6a700 1 -- 172.21.15.153:0/147138055 <== osd.2 v2:172.21.15.153:6807/140454 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc4006070 con 0x7f4cc0039070 2023-10-05T21:17:01.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.119+0000 7f4cced6a700 1 --2- 172.21.15.153:0/147138055 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4cc400d8e0 0x7f4cc400c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:01.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.119+0000 7f4cced6a700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x7f4cc400d8e0 2023-10-05T21:17:01.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.119+0000 7f4ccfd6c700 1 --2- 172.21.15.153:0/147138055 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4cc400d8e0 0x7f4cc400c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:01.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.119+0000 7f4ccfd6c700 1 --2- 172.21.15.153:0/147138055 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4cc400d8e0 0x7f4cc400c360 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:01.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.120+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.0 v2:172.21.15.111:6800/111394 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc800a570 con 0x7f4cc400d8e0 2023-10-05T21:17:01.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.120+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x5647f68c9c70 2023-10-05T21:17:01.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.120+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.120+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x5647f68c9c70 2023-10-05T21:17:01.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.120+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.120+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x7f4cc400d8e0 2023-10-05T21:17:01.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.120+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.0 v2:172.21.15.111:6800/111394 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc800a570 con 0x7f4cc400d8e0 2023-10-05T21:17:01.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.120+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x7f4cc400d8e0 2023-10-05T21:17:01.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.121+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.0 v2:172.21.15.111:6800/111394 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc800a570 con 0x7f4cc400d8e0 2023-10-05T21:17:01.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.121+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x7f4cc0039070 2023-10-05T21:17:01.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.121+0000 7f4cced6a700 1 -- 172.21.15.153:0/147138055 <== osd.2 v2:172.21.15.153:6807/140454 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc4006070 con 0x7f4cc0039070 2023-10-05T21:17:01.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.121+0000 7f4cced6a700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x5647f68ce520 2023-10-05T21:17:01.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.121+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 <== osd.3 v2:172.21.15.153:6800/140455 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4cc0023070 con 0x5647f68ce520 2023-10-05T21:17:01.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.121+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x5647f68c9c70 2023-10-05T21:17:01.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.121+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.122+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x7f4cc400d8e0 2023-10-05T21:17:01.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.122+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.0 v2:172.21.15.111:6800/111394 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc800a570 con 0x7f4cc400d8e0 2023-10-05T21:17:01.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.122+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x5647f68c9c70 2023-10-05T21:17:01.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.122+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.122+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x7f4cc0039070 2023-10-05T21:17:01.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.122+0000 7f4cced6a700 1 -- 172.21.15.153:0/147138055 <== osd.2 v2:172.21.15.153:6807/140454 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc4006070 con 0x7f4cc0039070 2023-10-05T21:17:01.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.122+0000 7f4cced6a700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x5647f68ce520 2023-10-05T21:17:01.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.122+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 <== osd.3 v2:172.21.15.153:6800/140455 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc0023070 con 0x5647f68ce520 2023-10-05T21:17:01.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.122+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x5647f68ce520 2023-10-05T21:17:01.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.123+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 <== osd.3 v2:172.21.15.153:6800/140455 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc0023070 con 0x5647f68ce520 2023-10-05T21:17:01.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.123+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x7f4cc400d8e0 2023-10-05T21:17:01.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.123+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.0 v2:172.21.15.111:6800/111394 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc800a570 con 0x7f4cc400d8e0 2023-10-05T21:17:01.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.123+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x5647f68ce520 2023-10-05T21:17:01.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.123+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 <== osd.3 v2:172.21.15.153:6800/140455 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc0023070 con 0x5647f68ce520 2023-10-05T21:17:01.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.123+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x5647f68ce520 2023-10-05T21:17:01.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.123+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 <== osd.3 v2:172.21.15.153:6800/140455 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc0023070 con 0x5647f68ce520 2023-10-05T21:17:01.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.123+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x5647f68c9c70 2023-10-05T21:17:01.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.124+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.124+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x5647f68c9c70 2023-10-05T21:17:01.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.124+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.124+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x7f4cc400d8e0 2023-10-05T21:17:01.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.124+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.0 v2:172.21.15.111:6800/111394 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc800a570 con 0x7f4cc400d8e0 2023-10-05T21:17:01.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.124+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x5647f68ce520 2023-10-05T21:17:01.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.124+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 <== osd.3 v2:172.21.15.153:6800/140455 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc0023070 con 0x5647f68ce520 2023-10-05T21:17:01.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.124+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x7f4cc0039070 2023-10-05T21:17:01.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.125+0000 7f4cced6a700 1 -- 172.21.15.153:0/147138055 <== osd.2 v2:172.21.15.153:6807/140454 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc4006070 con 0x7f4cc0039070 2023-10-05T21:17:01.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.125+0000 7f4cced6a700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x5647f68c9c70 2023-10-05T21:17:01.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.125+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.125+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x7f4cc400d8e0 2023-10-05T21:17:01.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.125+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.0 v2:172.21.15.111:6800/111394 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc800a570 con 0x7f4cc400d8e0 2023-10-05T21:17:01.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.125+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x5647f68ce520 2023-10-05T21:17:01.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.125+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 <== osd.3 v2:172.21.15.153:6800/140455 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc0023070 con 0x5647f68ce520 2023-10-05T21:17:01.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.125+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x7f4cc400d8e0 2023-10-05T21:17:01.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.126+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.0 v2:172.21.15.111:6800/111394 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc800a570 con 0x7f4cc400d8e0 2023-10-05T21:17:01.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.126+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x7f4cc0039070 2023-10-05T21:17:01.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.126+0000 7f4cced6a700 1 -- 172.21.15.153:0/147138055 <== osd.2 v2:172.21.15.153:6807/140454 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc4006070 con 0x7f4cc0039070 2023-10-05T21:17:01.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.126+0000 7f4cced6a700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x5647f68ce520 2023-10-05T21:17:01.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.126+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 <== osd.3 v2:172.21.15.153:6800/140455 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc0023070 con 0x5647f68ce520 2023-10-05T21:17:01.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.126+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x7f4cc400d8e0 2023-10-05T21:17:01.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.127+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.0 v2:172.21.15.111:6800/111394 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc800a570 con 0x7f4cc400d8e0 2023-10-05T21:17:01.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.127+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x5647f68c9c70 2023-10-05T21:17:01.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.127+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.127+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2800 con 0x7f4cc0039070 2023-10-05T21:17:01.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.127+0000 7f4cced6a700 1 -- 172.21.15.153:0/147138055 <== osd.2 v2:172.21.15.153:6807/140454 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc4006070 con 0x7f4cc0039070 2023-10-05T21:17:01.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.127+0000 7f4cdc493680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:17:01.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.127+0000 7f4cdc493680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:17:01.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.127+0000 7f4cdc493680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:17:01.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.127+0000 7f4cdc493680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:17:01.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.127+0000 7f4cdc493680 20 rados->read ofs=0 len=0 2023-10-05T21:17:01.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.127+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d1920 con 0x5647f68c9c70 2023-10-05T21:17:01.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.127+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.127+0000 7f4cdc493680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:01.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.127+0000 7f4cdc493680 20 rados->read ofs=0 len=0 2023-10-05T21:17:01.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.127+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2210 con 0x5647f68c9c70 2023-10-05T21:17:01.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.127+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.127+0000 7f4cdc493680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:17:01.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.128+0000 7f4cdc493680 20 rados->read ofs=0 len=0 2023-10-05T21:17:01.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.128+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:40 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2bb0 con 0x5647f68c9c70 2023-10-05T21:17:01.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.128+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 15 ==== osd_op_reply(40 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.128+0000 7f4cdc493680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:17:01.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.128+0000 7f4cdc493680 20 rados->read ofs=0 len=0 2023-10-05T21:17:01.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.128+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2f60 con 0x5647f68ce520 2023-10-05T21:17:01.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.128+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 <== osd.3 v2:172.21.15.153:6800/140455 11 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f4cc0023070 con 0x5647f68ce520 2023-10-05T21:17:01.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.128+0000 7f4cdc493680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:01.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.128+0000 7f4cdc493680 20 rados->read ofs=0 len=0 2023-10-05T21:17:01.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.128+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d3310 con 0x5647f68c9c70 2023-10-05T21:17:01.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.128+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.128+0000 7f4cdc493680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:01.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.128+0000 7f4cdc493680 20 rados->read ofs=0 len=0 2023-10-05T21:17:01.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.128+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d3310 con 0x5647f68c9c70 2023-10-05T21:17:01.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.129+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 17 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.129+0000 7f4cdc493680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:17:01.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.129+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d4320 con 0x5647f68ce520 2023-10-05T21:17:01.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.129+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 <== osd.3 v2:172.21.15.153:6800/140455 12 ==== osd_op_reply(44 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc0023070 con 0x5647f68ce520 2023-10-05T21:17:01.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.129+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d4320 con 0x7f4cc0039070 2023-10-05T21:17:01.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.129+0000 7f4cced6a700 1 -- 172.21.15.153:0/147138055 <== osd.2 v2:172.21.15.153:6807/140454 7 ==== osd_op_reply(45 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc4006070 con 0x7f4cc0039070 2023-10-05T21:17:01.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.129+0000 7f4cced6a700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d4320 con 0x7f4cc400d8e0 2023-10-05T21:17:01.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.129+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.0 v2:172.21.15.111:6800/111394 10 ==== osd_op_reply(46 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc800a570 con 0x7f4cc400d8e0 2023-10-05T21:17:01.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.129+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2bb0 con 0x5647f68c9c70 2023-10-05T21:17:01.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.129+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 18 ==== osd_op_reply(47 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.129+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2bb0 con 0x5647f68c9c70 2023-10-05T21:17:01.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.130+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 19 ==== osd_op_reply(48 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.130+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2bb0 con 0x7f4cc400d8e0 2023-10-05T21:17:01.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.130+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.0 v2:172.21.15.111:6800/111394 11 ==== osd_op_reply(49 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc800a570 con 0x7f4cc400d8e0 2023-10-05T21:17:01.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.130+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2bb0 con 0x7f4cc400d8e0 2023-10-05T21:17:01.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.130+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.0 v2:172.21.15.111:6800/111394 12 ==== osd_op_reply(50 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc800a570 con 0x7f4cc400d8e0 2023-10-05T21:17:01.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.130+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2bb0 con 0x7f4cc0039070 2023-10-05T21:17:01.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.130+0000 7f4cced6a700 1 -- 172.21.15.153:0/147138055 <== osd.2 v2:172.21.15.153:6807/140454 8 ==== osd_op_reply(51 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc4006070 con 0x7f4cc0039070 2023-10-05T21:17:01.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.131+0000 7f4cced6a700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2bb0 con 0x5647f68ce520 2023-10-05T21:17:01.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.131+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 <== osd.3 v2:172.21.15.153:6800/140455 13 ==== osd_op_reply(52 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4cc0023070 con 0x5647f68ce520 2023-10-05T21:17:01.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.131+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2bb0 con 0x5647f68c9c70 2023-10-05T21:17:01.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.131+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 20 ==== osd_op_reply(53 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.131+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2bb0 con 0x7f4cc400d8e0 2023-10-05T21:17:01.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.131+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.0 v2:172.21.15.111:6800/111394 13 ==== osd_op_reply(54 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc800a570 con 0x7f4cc400d8e0 2023-10-05T21:17:01.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.131+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2bb0 con 0x5647f68c9c70 2023-10-05T21:17:01.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.131+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 21 ==== osd_op_reply(55 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.131+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2bb0 con 0x7f4cc0039070 2023-10-05T21:17:01.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.132+0000 7f4cced6a700 1 -- 172.21.15.153:0/147138055 <== osd.2 v2:172.21.15.153:6807/140454 9 ==== osd_op_reply(56 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc4006070 con 0x7f4cc0039070 2023-10-05T21:17:01.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.132+0000 7f4cced6a700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2bb0 con 0x5647f68ce520 2023-10-05T21:17:01.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.132+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 <== osd.3 v2:172.21.15.153:6800/140455 14 ==== osd_op_reply(57 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc0023070 con 0x5647f68ce520 2023-10-05T21:17:01.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.132+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2bb0 con 0x5647f68ce520 2023-10-05T21:17:01.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.132+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 <== osd.3 v2:172.21.15.153:6800/140455 15 ==== osd_op_reply(58 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc0023070 con 0x5647f68ce520 2023-10-05T21:17:01.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.132+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2bb0 con 0x7f4cc400d8e0 2023-10-05T21:17:01.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.132+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.0 v2:172.21.15.111:6800/111394 14 ==== osd_op_reply(59 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc800a570 con 0x7f4cc400d8e0 2023-10-05T21:17:01.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.132+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2bb0 con 0x5647f68ce520 2023-10-05T21:17:01.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.132+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 <== osd.3 v2:172.21.15.153:6800/140455 16 ==== osd_op_reply(60 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc0023070 con 0x5647f68ce520 2023-10-05T21:17:01.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.132+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2bb0 con 0x5647f68ce520 2023-10-05T21:17:01.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.133+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 <== osd.3 v2:172.21.15.153:6800/140455 17 ==== osd_op_reply(61 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc0023070 con 0x5647f68ce520 2023-10-05T21:17:01.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.133+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2bb0 con 0x5647f68c9c70 2023-10-05T21:17:01.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.133+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 22 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.133+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2bb0 con 0x5647f68c9c70 2023-10-05T21:17:01.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.133+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 23 ==== osd_op_reply(63 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.133+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2bb0 con 0x7f4cc400d8e0 2023-10-05T21:17:01.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.133+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.0 v2:172.21.15.111:6800/111394 15 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc800a570 con 0x7f4cc400d8e0 2023-10-05T21:17:01.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.133+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2bb0 con 0x5647f68ce520 2023-10-05T21:17:01.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.134+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 <== osd.3 v2:172.21.15.153:6800/140455 18 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc0023070 con 0x5647f68ce520 2023-10-05T21:17:01.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.134+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2bb0 con 0x7f4cc0039070 2023-10-05T21:17:01.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.134+0000 7f4cced6a700 1 -- 172.21.15.153:0/147138055 <== osd.2 v2:172.21.15.153:6807/140454 10 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc4006070 con 0x7f4cc0039070 2023-10-05T21:17:01.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.134+0000 7f4cced6a700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2bb0 con 0x5647f68c9c70 2023-10-05T21:17:01.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.134+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 24 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.134+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2bb0 con 0x7f4cc400d8e0 2023-10-05T21:17:01.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.134+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.0 v2:172.21.15.111:6800/111394 16 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc800a570 con 0x7f4cc400d8e0 2023-10-05T21:17:01.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.134+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2bb0 con 0x5647f68ce520 2023-10-05T21:17:01.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.135+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 <== osd.3 v2:172.21.15.153:6800/140455 19 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc0023070 con 0x5647f68ce520 2023-10-05T21:17:01.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.135+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2bb0 con 0x7f4cc400d8e0 2023-10-05T21:17:01.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.135+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.0 v2:172.21.15.111:6800/111394 17 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc800a570 con 0x7f4cc400d8e0 2023-10-05T21:17:01.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.135+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2bb0 con 0x7f4cc0039070 2023-10-05T21:17:01.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.135+0000 7f4cced6a700 1 -- 172.21.15.153:0/147138055 <== osd.2 v2:172.21.15.153:6807/140454 11 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc4006070 con 0x7f4cc0039070 2023-10-05T21:17:01.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.135+0000 7f4cced6a700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2bb0 con 0x5647f68ce520 2023-10-05T21:17:01.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.135+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 <== osd.3 v2:172.21.15.153:6800/140455 20 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc0023070 con 0x5647f68ce520 2023-10-05T21:17:01.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.135+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2bb0 con 0x7f4cc400d8e0 2023-10-05T21:17:01.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.136+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.0 v2:172.21.15.111:6800/111394 18 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc800a570 con 0x7f4cc400d8e0 2023-10-05T21:17:01.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.136+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2bb0 con 0x5647f68c9c70 2023-10-05T21:17:01.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.136+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 25 ==== osd_op_reply(74 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.136+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d2bb0 con 0x7f4cc0039070 2023-10-05T21:17:01.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.136+0000 7f4cced6a700 1 -- 172.21.15.153:0/147138055 <== osd.2 v2:172.21.15.153:6807/140454 12 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cc4006070 con 0x7f4cc0039070 2023-10-05T21:17:01.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.136+0000 7f4cdc493680 20 RGWRados::pool_iterate: got zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 2023-10-05T21:17:01.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.136+0000 7f4cdc493680 20 RGWRados::pool_iterate: got zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 2023-10-05T21:17:01.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.136+0000 7f4cdc493680 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T21:17:01.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.136+0000 7f4cdc493680 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T21:17:01.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.136+0000 7f4cdc493680 20 rados->read ofs=0 len=0 2023-10-05T21:17:01.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.136+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d3310 con 0x5647f68c9c70 2023-10-05T21:17:01.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.136+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 26 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.136+0000 7f4cdc493680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:17:01.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.136+0000 7f4cdc493680 20 rados->read ofs=0 len=0 2023-10-05T21:17:01.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.136+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:77 5.2 5:417ec0d5:::zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d3710 con 0x5647f68ce520 2023-10-05T21:17:01.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.136+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 <== osd.3 v2:172.21.15.153:6800/140455 21 ==== osd_op_reply(77 zone_info.193cdd3f-16f8-4551-b3a7-d103e6acfa54 [read 0~874 out=874b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f4cc0023070 con 0x5647f68ce520 2023-10-05T21:17:01.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.136+0000 7f4cdc493680 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T21:17:01.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.137+0000 7f4cdc493680 20 rados->read ofs=0 len=0 2023-10-05T21:17:01.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.137+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d4000 con 0x5647f68c9c70 2023-10-05T21:17:01.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.137+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 27 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.137+0000 7f4cdc493680 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T21:17:01.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.137+0000 7f4cdc493680 20 rados->read ofs=0 len=0 2023-10-05T21:17:01.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.137+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:79 5.19 5:9f76b36a:::zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d4000 con 0x5647f68c9c70 2023-10-05T21:17:01.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.137+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 28 ==== osd_op_reply(79 zonegroup_info.371967c9-8a2e-480a-9a00-92e7f0730f89 [read 0~362 out=362b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.137+0000 7f4cdc493680 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T21:17:01.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.137+0000 7f4cdc493680 20 rados->read ofs=0 len=0 2023-10-05T21:17:01.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.137+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d4000 con 0x7f4cc400d8e0 2023-10-05T21:17:01.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.138+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.0 v2:172.21.15.111:6800/111394 19 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f4cc800a570 con 0x7f4cc400d8e0 2023-10-05T21:17:01.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.138+0000 7f4cdc493680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:01.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.138+0000 7f4cdc493680 20 zone default found 2023-10-05T21:17:01.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.138+0000 7f4cdc493680 4 Realm: () 2023-10-05T21:17:01.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.138+0000 7f4cdc493680 4 ZoneGroup: default (371967c9-8a2e-480a-9a00-92e7f0730f89) 2023-10-05T21:17:01.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.138+0000 7f4cdc493680 4 Zone: default (193cdd3f-16f8-4551-b3a7-d103e6acfa54) 2023-10-05T21:17:01.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.138+0000 7f4cdc493680 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T21:17:01.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.138+0000 7f4cdc493680 20 zonegroup default 2023-10-05T21:17:01.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.138+0000 7f4cdc493680 20 rados->read ofs=0 len=0 2023-10-05T21:17:01.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.138+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d4000 con 0x7f4cc400d8e0 2023-10-05T21:17:01.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.138+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.0 v2:172.21.15.111:6800/111394 20 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4cc800a570 con 0x7f4cc400d8e0 2023-10-05T21:17:01.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.138+0000 7f4cdc493680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:01.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.138+0000 7f4cdc493680 20 rados->read ofs=0 len=0 2023-10-05T21:17:01.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.138+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d4000 con 0x5647f68ce520 2023-10-05T21:17:01.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.138+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 <== osd.3 v2:172.21.15.153:6800/140455 22 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4cc0023070 con 0x5647f68ce520 2023-10-05T21:17:01.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.138+0000 7f4cdc493680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:01.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.138+0000 7f4cdc493680 20 rados->read ofs=0 len=0 2023-10-05T21:17:01.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.138+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d5e50 con 0x5647f68ce520 2023-10-05T21:17:01.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.138+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 <== osd.3 v2:172.21.15.153:6800/140455 23 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4cc0023070 con 0x5647f68ce520 2023-10-05T21:17:01.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.138+0000 7f4cdc493680 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T21:17:01.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.138+0000 7f4cdc493680 20 started sync module instance, tier type = 2023-10-05T21:17:01.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.138+0000 7f4cdc493680 20 started zone id=193cdd3f-16f8-4551-b3a7-d103e6acfa54 (name=default) with tier type = 2023-10-05T21:17:01.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.138+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d5510 con 0x7f4cc0039070 2023-10-05T21:17:01.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.139+0000 7f4cced6a700 1 -- 172.21.15.153:0/147138055 <== osd.2 v2:172.21.15.153:6807/140454 13 ==== osd_op_reply(84 notify.0 [create] v31'270 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cc4006070 con 0x7f4cc0039070 2023-10-05T21:17:01.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.139+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94867079125264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d66f0 con 0x7f4cc0039070 2023-10-05T21:17:01.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.139+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d6f90 con 0x5647f68c9c70 2023-10-05T21:17:01.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.140+0000 7f4cced6a700 1 -- 172.21.15.153:0/147138055 <== osd.2 v2:172.21.15.153:6807/140454 14 ==== osd_op_reply(85 notify.0 [watch watch cookie 94867079125264] v31'271 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cc4006070 con 0x7f4cc0039070 2023-10-05T21:17:01.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.140+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 29 ==== osd_op_reply(86 notify.1 [create] v31'270 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.140+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94867079127552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d6f90 con 0x5647f68c9c70 2023-10-05T21:17:01.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.140+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d7b30 con 0x5647f68ce520 2023-10-05T21:17:01.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.141+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 <== osd.3 v2:172.21.15.153:6800/140455 24 ==== osd_op_reply(88 notify.2 [create] v31'270 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cc0023070 con 0x5647f68ce520 2023-10-05T21:17:01.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.141+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94867079132608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d8420 con 0x5647f68ce520 2023-10-05T21:17:01.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.141+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 30 ==== osd_op_reply(87 notify.1 [watch watch cookie 94867079127552] v31'271 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.141+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d8e90 con 0x7f4cc0039070 2023-10-05T21:17:01.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.142+0000 7f4cced6a700 1 -- 172.21.15.153:0/147138055 <== osd.2 v2:172.21.15.153:6807/140454 15 ==== osd_op_reply(90 notify.3 [create] v31'270 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cc4006070 con 0x7f4cc0039070 2023-10-05T21:17:01.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.142+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94867079137600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d9240 con 0x7f4cc0039070 2023-10-05T21:17:01.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.142+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 <== osd.3 v2:172.21.15.153:6800/140455 25 ==== osd_op_reply(89 notify.2 [watch watch cookie 94867079132608] v31'271 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cc0023070 con 0x5647f68ce520 2023-10-05T21:17:01.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.142+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d9c50 con 0x5647f68c9c70 2023-10-05T21:17:01.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.143+0000 7f4cced6a700 1 -- 172.21.15.153:0/147138055 <== osd.2 v2:172.21.15.153:6807/140454 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94867079137600] v31'271 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cc4006070 con 0x7f4cc0039070 2023-10-05T21:17:01.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.143+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 31 ==== osd_op_reply(92 notify.4 [create] v31'270 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.143+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94867079135024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d9c50 con 0x5647f68c9c70 2023-10-05T21:17:01.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.143+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68da540 con 0x7f4cc400d8e0 2023-10-05T21:17:01.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.144+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 32 ==== osd_op_reply(93 notify.4 [watch watch cookie 94867079135024] v31'271 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.144+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.0 v2:172.21.15.111:6800/111394 21 ==== osd_op_reply(94 notify.5 [create] v31'270 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cc800a570 con 0x7f4cc400d8e0 2023-10-05T21:17:01.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.144+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94867079141776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68da3b0 con 0x7f4cc400d8e0 2023-10-05T21:17:01.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.144+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68daf30 con 0x7f4cc400d8e0 2023-10-05T21:17:01.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.145+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.0 v2:172.21.15.111:6800/111394 22 ==== osd_op_reply(95 notify.5 [watch watch cookie 94867079141776] v31'271 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cc800a570 con 0x7f4cc400d8e0 2023-10-05T21:17:01.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.145+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.0 v2:172.21.15.111:6800/111394 23 ==== osd_op_reply(96 notify.6 [create] v31'270 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cc800a570 con 0x7f4cc400d8e0 2023-10-05T21:17:01.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.145+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94867079145920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68daef0 con 0x7f4cc400d8e0 2023-10-05T21:17:01.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.145+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68db9b0 con 0x7f4cc400d8e0 2023-10-05T21:17:01.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.146+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.0 v2:172.21.15.111:6800/111394 24 ==== osd_op_reply(97 notify.6 [watch watch cookie 94867079145920] v31'271 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cc800a570 con 0x7f4cc400d8e0 2023-10-05T21:17:01.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.146+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.0 v2:172.21.15.111:6800/111394 25 ==== osd_op_reply(98 notify.7 [create] v31'270 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cc800a570 con 0x7f4cc400d8e0 2023-10-05T21:17:01.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.146+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94867079148704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68db9b0 con 0x7f4cc400d8e0 2023-10-05T21:17:01.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.146+0000 7f4cdc493680 20 add_watcher() i=0 2023-10-05T21:17:01.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.146+0000 7f4cdc493680 20 add_watcher() i=1 2023-10-05T21:17:01.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.146+0000 7f4cdc493680 20 add_watcher() i=2 2023-10-05T21:17:01.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.146+0000 7f4cdc493680 20 add_watcher() i=3 2023-10-05T21:17:01.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.146+0000 7f4cdc493680 20 add_watcher() i=4 2023-10-05T21:17:01.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.146+0000 7f4cdc493680 20 add_watcher() i=5 2023-10-05T21:17:01.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.146+0000 7f4cdc493680 20 add_watcher() i=6 2023-10-05T21:17:01.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.146+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.0 v2:172.21.15.111:6800/111394 26 ==== osd_op_reply(99 notify.7 [watch watch cookie 94867079148704] v31'271 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cc800a570 con 0x7f4cc400d8e0 2023-10-05T21:17:01.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.146+0000 7f4cdc493680 20 add_watcher() i=7 2023-10-05T21:17:01.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.146+0000 7f4cdc493680 2 all 8 watchers are set, enabling cache 2023-10-05T21:17:01.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.146+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68deed0 con 0x5647f68c9c70 2023-10-05T21:17:01.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.147+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 33 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.147+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94867079150000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68dc2f0 con 0x5647f68c9c70 2023-10-05T21:17:01.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.148+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94867079150000] v31'260 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.148+0000 7f4c1bfff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:17:01.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.148+0000 7f4cdc493680 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T21:17:01.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.148+0000 7f4cdc493680 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T21:17:01.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.148+0000 7f4cdc493680 1 Processor -- start 2023-10-05T21:17:01.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.148+0000 7f4cdc493680 1 -- start start 2023-10-05T21:17:01.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.148+0000 7f4cdc493680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f68e8970 0x5647f68e8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:01.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.148+0000 7f4cdc493680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f68e9390 con 0x5647f68e8970 2023-10-05T21:17:01.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.149+0000 7f4cced6a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f68e8970 0x5647f68e8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:01.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.149+0000 7f4cced6a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f68e8970 0x5647f68e8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60884/0 (socket says 172.21.15.153:60884) 2023-10-05T21:17:01.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.149+0000 7f4cced6a700 1 -- 172.21.15.153:0/4175169654 learned_addr learned my addr 172.21.15.153:0/4175169654 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:01.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.149+0000 7f4cced6a700 1 -- 172.21.15.153:0/4175169654 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647f68e9870 con 0x5647f68e8970 2023-10-05T21:17:01.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.149+0000 7f4cced6a700 1 --2- 172.21.15.153:0/4175169654 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f68e8970 0x5647f68e8d80 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f4cc001cae0 tx=0x7f4cc4006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a72c763c136e039 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:01.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.149+0000 7f4c1b7fe700 1 -- 172.21.15.153:0/4175169654 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cc4023040 con 0x5647f68e8970 2023-10-05T21:17:01.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.149+0000 7f4c1b7fe700 1 -- 172.21.15.153:0/4175169654 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc4024040 con 0x5647f68e8970 2023-10-05T21:17:01.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.149+0000 7f4c1b7fe700 1 -- 172.21.15.153:0/4175169654 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cc4013040 con 0x5647f68e8970 2023-10-05T21:17:01.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.150+0000 7f4cdc493680 1 -- 172.21.15.153:0/4175169654 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f68e8970 msgr2=0x5647f68e8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:01.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.150+0000 7f4cdc493680 1 --2- 172.21.15.153:0/4175169654 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f68e8970 0x5647f68e8d80 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f4cc001cae0 tx=0x7f4cc4006000 comp rx=0 tx=0).stop 2023-10-05T21:17:01.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.150+0000 7f4cdc493680 1 -- 172.21.15.153:0/4175169654 shutdown_connections 2023-10-05T21:17:01.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.150+0000 7f4cdc493680 1 --2- 172.21.15.153:0/4175169654 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f68e8970 0x5647f68e8d80 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:01.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.150+0000 7f4cdc493680 1 -- 172.21.15.153:0/4175169654 >> 172.21.15.153:0/4175169654 conn(0x5647f68e4c70 msgr2=0x5647f68e2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:01.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.150+0000 7f4cdc493680 1 -- 172.21.15.153:0/4175169654 shutdown_connections 2023-10-05T21:17:01.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.150+0000 7f4cdc493680 1 -- 172.21.15.153:0/4175169654 wait complete. 2023-10-05T21:17:01.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.150+0000 7f4cdc493680 1 Processor -- start 2023-10-05T21:17:01.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.150+0000 7f4cdc493680 1 -- start start 2023-10-05T21:17:01.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.151+0000 7f4cdc493680 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f68e8970 0x5647f68ef6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:01.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.151+0000 7f4cdc493680 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f68efbf0 con 0x5647f68e8970 2023-10-05T21:17:01.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.151+0000 7f4cced6a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f68e8970 0x5647f68ef6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:01.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.151+0000 7f4cced6a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f68e8970 0x5647f68ef6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.153:60898/0 (socket says 172.21.15.153:60898) 2023-10-05T21:17:01.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.151+0000 7f4cced6a700 1 -- 172.21.15.153:0/3630107893 learned_addr learned my addr 172.21.15.153:0/3630107893 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-05T21:17:01.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.151+0000 7f4cced6a700 1 -- 172.21.15.153:0/3630107893 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647f67e4930 con 0x5647f68e8970 2023-10-05T21:17:01.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.151+0000 7f4cced6a700 1 --2- 172.21.15.153:0/3630107893 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f68e8970 0x5647f68ef6b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x5647f68e41e0 tx=0x7f4cc4030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:01.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.151+0000 7f4c19ffb700 1 -- 172.21.15.153:0/3630107893 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cc4023040 con 0x5647f68e8970 2023-10-05T21:17:01.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.151+0000 7f4c19ffb700 1 -- 172.21.15.153:0/3630107893 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc401e420 con 0x5647f68e8970 2023-10-05T21:17:01.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.151+0000 7f4c19ffb700 1 -- 172.21.15.153:0/3630107893 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cc401e5b0 con 0x5647f68e8970 2023-10-05T21:17:01.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.151+0000 7f4cdc493680 1 -- 172.21.15.153:0/3630107893 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5647f68efdf0 con 0x5647f68e8970 2023-10-05T21:17:01.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.152+0000 7f4cdc493680 1 -- 172.21.15.153:0/3630107893 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5647f68f01e0 con 0x5647f68e8970 2023-10-05T21:17:01.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.152+0000 7f4c19ffb700 1 -- 172.21.15.153:0/3630107893 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f4cc401e830 con 0x5647f68e8970 2023-10-05T21:17:01.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.152+0000 7f4c19ffb700 1 --2- 172.21.15.153:0/3630107893 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4c0c0340f0 0x7f4c0c0365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:17:01.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.152+0000 7f4c19ffb700 1 -- 172.21.15.153:0/3630107893 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f4cc403bc40 con 0x5647f68e8970 2023-10-05T21:17:01.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.153+0000 7f4ccfd6c700 1 --2- 172.21.15.153:0/3630107893 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4c0c0340f0 0x7f4c0c0365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:17:01.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.153+0000 7f4cdc493680 5 note: GC not initialized 2023-10-05T21:17:01.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.153+0000 7f4ccfd6c700 1 --2- 172.21.15.153:0/3630107893 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4c0c0340f0 0x7f4c0c0365a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x5647f68da180 tx=0x7f4cc8037450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:17:01.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.154+0000 7f4c0affd700 20 reqs_thread_entry: start 2023-10-05T21:17:01.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.154+0000 7f4c08ff9700 20 reqs_thread_entry: start 2023-10-05T21:17:01.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.154+0000 7f4cdc493680 20 init_complete bucket index max shards: 11 2023-10-05T21:17:01.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.154+0000 7f4cdc493680 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T21:17:01.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.154+0000 7f4c02ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 21:17:31 2023 2023-10-05T21:17:01.182 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-05T21:17:01.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.154+0000 7f4c027fc700 20 reqs_thread_entry: start 2023-10-05T21:17:01.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.154+0000 7f4cdc493680 20 get_system_obj_state: rctx=0x7ffd6d90e108 obj=default.rgw.meta:users.uid:ada state=0x5647f674a240 s->prefetch_data=0 2023-10-05T21:17:01.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.154+0000 7f4cdc493680 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2023-10-05T21:17:01.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.154+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:102 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f6955090 con 0x7f4cc400d8e0 2023-10-05T21:17:01.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.155+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.0 v2:172.21.15.111:6800/111394 27 ==== osd_op_reply(102 ada [call,getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f4cc800a570 con 0x7f4cc400d8e0 2023-10-05T21:17:01.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.155+0000 7f4cdc493680 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2023-10-05T21:17:01.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.155+0000 7f4cdc493680 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2023-10-05T21:17:01.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.155+0000 7f4cdc493680 20 get_system_obj_state: rctx=0x7ffd6d90ddf8 obj=default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W state=0x5647f674a240 s->prefetch_data=0 2023-10-05T21:17:01.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.155+0000 7f4cdc493680 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2023-10-05T21:17:01.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.155+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:103 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f6954080 con 0x5647f68c9c70 2023-10-05T21:17:01.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.155+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 35 ==== osd_op_reply(103 MH1WC2XQ1S8UISFDZC8W [getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.155+0000 7f4cdc493680 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2023-10-05T21:17:01.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.155+0000 7f4cdc493680 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2023-10-05T21:17:01.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.155+0000 7f4cdc493680 20 get_system_obj_state: rctx=0x7ffd6d90d688 obj=default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W state=0x5647f674a240 s->prefetch_data=0 2023-10-05T21:17:01.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.155+0000 7f4cdc493680 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2023-10-05T21:17:01.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.155+0000 7f4cdc493680 20 get_system_obj_state: rctx=0x7ffd6d90dd38 obj=default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W state=0x5647f674a240 s->prefetch_data=0 2023-10-05T21:17:01.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.155+0000 7f4cdc493680 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2023-10-05T21:17:01.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.155+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:104 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~439 in=439b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f6957860 con 0x7f4cc400d8e0 2023-10-05T21:17:01.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.156+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.0 v2:172.21.15.111:6800/111394 28 ==== osd_op_reply(104 ada [delete,create,call,writefull 0~439] v31'3 uv3 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f4cc800a570 con 0x7f4cc400d8e0 2023-10-05T21:17:01.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.156+0000 7f4cdc493680 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2023-10-05T21:17:01.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.156+0000 7f4cdc493680 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2023-10-05T21:17:01.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.156+0000 7f4cdc493680 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2023-10-05T21:17:01.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.156+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [notify cookie 94867079656016 in=627b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f69584a0 con 0x5647f68c9c70 2023-10-05T21:17:01.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.156+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 36 ==== watch-notify(notify (1) cookie 94867079135024 notify 133143986205 ret 0) v3 ==== 657+0+0 (crc 0 0 0) 0x7f4cc802d040 con 0x5647f68c9c70 2023-10-05T21:17:01.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.156+0000 7f4ccd567700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986205 cookie 94867079135024 notifier 4796 bl.length()=615 2023-10-05T21:17:01.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.156+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 37 ==== osd_op_reply(105 notify.4 [notify cookie 94867079656016 out=8b] v0'0 uv270 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.156+0000 7f4ccd567700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2023-10-05T21:17:01.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.156+0000 7f4ccd567700 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2023-10-05T21:17:01.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.156+0000 7f4ccd567700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f4cac003d90 con 0x5647f68c9c70 2023-10-05T21:17:01.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.157+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 38 ==== osd_op_reply(106 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.157+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 39 ==== watch-notify(notify_complete (2) cookie 94867079656016 notify 133143986205 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f4cc8015430 con 0x5647f68c9c70 2023-10-05T21:17:01.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.157+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:107 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f6957250 con 0x5647f68c9c70 2023-10-05T21:17:01.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.158+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 40 ==== osd_op_reply(107 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v31'21 uv21 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.158+0000 7f4cdc493680 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2023-10-05T21:17:01.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.158+0000 7f4cdc493680 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2023-10-05T21:17:01.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.158+0000 7f4cdc493680 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2023-10-05T21:17:01.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.158+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [notify cookie 94867079656016 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f69588e0 con 0x5647f68ce520 2023-10-05T21:17:01.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.158+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 <== osd.3 v2:172.21.15.153:6800/140455 26 ==== watch-notify(notify (1) cookie 94867079132608 notify 133143986199 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x5647f68c08e0 con 0x5647f68ce520 2023-10-05T21:17:01.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.158+0000 7f4ccd567700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986199 cookie 94867079132608 notifier 4796 bl.length()=177 2023-10-05T21:17:01.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.158+0000 7f4ccd567700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2023-10-05T21:17:01.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.158+0000 7f4ccd567700 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2023-10-05T21:17:01.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.158+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 <== osd.3 v2:172.21.15.153:6800/140455 27 ==== osd_op_reply(108 notify.2 [notify cookie 94867079656016 out=8b] v0'0 uv270 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f4cc0023070 con 0x5647f68ce520 2023-10-05T21:17:01.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.158+0000 7f4ccd567700 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:109 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f4cac003d90 con 0x5647f68ce520 2023-10-05T21:17:01.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.158+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 <== osd.3 v2:172.21.15.153:6800/140455 28 ==== watch-notify(notify_complete (2) cookie 94867079656016 notify 133143986199 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5647f68c03b0 con 0x5647f68ce520 2023-10-05T21:17:01.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.158+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 <== osd.3 v2:172.21.15.153:6800/140455 29 ==== osd_op_reply(109 notify.2 [notify-ack] v0'0 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cc0023070 con 0x5647f68ce520 2023-10-05T21:17:01.186 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-05T21:17:01.186 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "ada", 2023-10-05T21:17:01.186 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Ms. Admin User", 2023-10-05T21:17:01.186 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "", 2023-10-05T21:17:01.187 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2023-10-05T21:17:01.187 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 0, 2023-10-05T21:17:01.187 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [], 2023-10-05T21:17:01.187 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2023-10-05T21:17:01.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:17:01.187 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "ada", 2023-10-05T21:17:01.187 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "MH1WC2XQ1S8UISFDZC8W", 2023-10-05T21:17:01.187 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG" 2023-10-05T21:17:01.187 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:17:01.187 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:17:01.187 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [], 2023-10-05T21:17:01.187 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [ 2023-10-05T21:17:01.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:17:01.188 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "buckets", 2023-10-05T21:17:01.188 INFO:teuthology.orchestra.run.smithi153.stdout: "perm": "*" 2023-10-05T21:17:01.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:17:01.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:17:01.188 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "info", 2023-10-05T21:17:01.188 INFO:teuthology.orchestra.run.smithi153.stdout: "perm": "read" 2023-10-05T21:17:01.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:17:01.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:17:01.188 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "ratelimit", 2023-10-05T21:17:01.188 INFO:teuthology.orchestra.run.smithi153.stdout: "perm": "*" 2023-10-05T21:17:01.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:17:01.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:17:01.188 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "usage", 2023-10-05T21:17:01.189 INFO:teuthology.orchestra.run.smithi153.stdout: "perm": "*" 2023-10-05T21:17:01.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:17:01.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:17:01.189 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "users", 2023-10-05T21:17:01.189 INFO:teuthology.orchestra.run.smithi153.stdout: "perm": "*" 2023-10-05T21:17:01.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:17:01.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-10-05T21:17:01.189 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "zone", 2023-10-05T21:17:01.189 INFO:teuthology.orchestra.run.smithi153.stdout: "perm": "*" 2023-10-05T21:17:01.189 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-05T21:17:01.189 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-10-05T21:17:01.189 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2023-10-05T21:17:01.189 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2023-10-05T21:17:01.190 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2023-10-05T21:17:01.190 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2023-10-05T21:17:01.190 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2023-10-05T21:17:01.190 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:17:01.190 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:17:01.190 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:17:01.190 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:17:01.190 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:17:01.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:17:01.190 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2023-10-05T21:17:01.191 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2023-10-05T21:17:01.191 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2023-10-05T21:17:01.191 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2023-10-05T21:17:01.191 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2023-10-05T21:17:01.191 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2023-10-05T21:17:01.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-05T21:17:01.191 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2023-10-05T21:17:01.191 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2023-10-05T21:17:01.191 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [] 2023-10-05T21:17:01.191 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-05T21:17:01.191 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-05T21:17:01.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.159+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:110 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94867079125264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f69566d0 con 0x7f4cc0039070 2023-10-05T21:17:01.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.159+0000 7f4cced6a700 1 -- 172.21.15.153:0/147138055 <== osd.2 v2:172.21.15.153:6807/140454 17 ==== osd_op_reply(110 notify.0 [watch unwatch cookie 94867079125264] v31'272 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cc404a070 con 0x7f4cc0039070 2023-10-05T21:17:01.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.159+0000 7f4cdc493680 20 remove_watcher() i=0 2023-10-05T21:17:01.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.159+0000 7f4cdc493680 2 removed watcher, disabling cache 2023-10-05T21:17:01.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.159+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:111 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94867079127552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d5910 con 0x5647f68c9c70 2023-10-05T21:17:01.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.160+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 41 ==== osd_op_reply(111 notify.1 [watch unwatch cookie 94867079127552] v31'272 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.160+0000 7f4cdc493680 20 remove_watcher() i=1 2023-10-05T21:17:01.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.160+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] -- osd_op(unknown.0.0:112 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94867079132608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d5910 con 0x5647f68ce520 2023-10-05T21:17:01.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.162+0000 7f4ccf56b700 1 -- 172.21.15.153:0/147138055 <== osd.3 v2:172.21.15.153:6800/140455 30 ==== osd_op_reply(112 notify.2 [watch unwatch cookie 94867079132608] v31'272 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cc0023070 con 0x5647f68ce520 2023-10-05T21:17:01.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.162+0000 7f4cdc493680 20 remove_watcher() i=2 2023-10-05T21:17:01.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.162+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] -- osd_op(unknown.0.0:113 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94867079137600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d75c0 con 0x7f4cc0039070 2023-10-05T21:17:01.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.162+0000 7f4cced6a700 1 -- 172.21.15.153:0/147138055 <== osd.2 v2:172.21.15.153:6807/140454 18 ==== osd_op_reply(113 notify.3 [watch unwatch cookie 94867079137600] v31'272 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cc404a070 con 0x7f4cc0039070 2023-10-05T21:17:01.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.162+0000 7f4cdc493680 20 remove_watcher() i=3 2023-10-05T21:17:01.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.162+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:114 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94867079135024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d75c0 con 0x5647f68c9c70 2023-10-05T21:17:01.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.163+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 42 ==== osd_op_reply(114 notify.4 [watch unwatch cookie 94867079135024] v31'272 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.163+0000 7f4cdc493680 20 remove_watcher() i=4 2023-10-05T21:17:01.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.163+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:115 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94867079141776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d75c0 con 0x7f4cc400d8e0 2023-10-05T21:17:01.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.164+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.0 v2:172.21.15.111:6800/111394 29 ==== osd_op_reply(115 notify.5 [watch unwatch cookie 94867079141776] v31'272 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cc800a570 con 0x7f4cc400d8e0 2023-10-05T21:17:01.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.164+0000 7f4cdc493680 20 remove_watcher() i=5 2023-10-05T21:17:01.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.164+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:116 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94867079145920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d9990 con 0x7f4cc400d8e0 2023-10-05T21:17:01.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.165+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.0 v2:172.21.15.111:6800/111394 30 ==== osd_op_reply(116 notify.6 [watch unwatch cookie 94867079145920] v31'272 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cc800a570 con 0x7f4cc400d8e0 2023-10-05T21:17:01.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.165+0000 7f4cdc493680 20 remove_watcher() i=6 2023-10-05T21:17:01.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.165+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] -- osd_op(unknown.0.0:117 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94867079148704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d75c0 con 0x7f4cc400d8e0 2023-10-05T21:17:01.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.166+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.0 v2:172.21.15.111:6800/111394 31 ==== osd_op_reply(117 notify.7 [watch unwatch cookie 94867079148704] v31'272 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cc800a570 con 0x7f4cc400d8e0 2023-10-05T21:17:01.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.166+0000 7f4cdc493680 20 remove_watcher() i=7 2023-10-05T21:17:01.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.166+0000 7f4c1bfff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T21:17:01.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.166+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 --> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] -- osd_op(unknown.0.0:118 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94867079150000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5647f68d9990 con 0x5647f68c9c70 2023-10-05T21:17:01.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.167+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 <== osd.1 v2:172.21.15.153:6816/140456 43 ==== osd_op_reply(118 data_loggenerations_metadata [watch unwatch cookie 94867079150000] v31'261 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4cc800a570 con 0x5647f68c9c70 2023-10-05T21:17:01.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.167+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4cc400d8e0 msgr2=0x7f4cc400c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:01.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.167+0000 7f4cdc493680 1 --2- 172.21.15.153:0/147138055 >> [v2:172.21.15.111:6800/111394,v1:172.21.15.111:6801/111394] conn(0x7f4cc400d8e0 0x7f4cc400c360 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:01.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.167+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5647f68c9c70 msgr2=0x5647f68cc0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:01.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.167+0000 7f4cdc493680 1 --2- 172.21.15.153:0/147138055 >> [v2:172.21.15.153:6816/140456,v1:172.21.15.153:6817/140456] conn(0x5647f68c9c70 0x5647f68cc0b0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:01.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.167+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4cc0039070 msgr2=0x7f4cc00253b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:01.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.167+0000 7f4cdc493680 1 --2- 172.21.15.153:0/147138055 >> [v2:172.21.15.153:6807/140454,v1:172.21.15.153:6809/140454] conn(0x7f4cc0039070 0x7f4cc00253b0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:01.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.167+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5647f68ce520 msgr2=0x5647f68d0900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:01.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.167+0000 7f4cdc493680 1 --2- 172.21.15.153:0/147138055 >> [v2:172.21.15.153:6800/140455,v1:172.21.15.153:6801/140455] conn(0x5647f68ce520 0x5647f68d0900 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:01.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.167+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4cb4034140 msgr2=0x7f4cb40365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:01.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.167+0000 7f4cdc493680 1 --2- 172.21.15.153:0/147138055 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4cb4034140 0x7f4cb40365f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4004170 tx=0x7f4cc40012e0 comp rx=0 tx=0).stop 2023-10-05T21:17:01.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.167+0000 7f4ccfd6c700 1 -- 172.21.15.153:0/147138055 reap_dead start 2023-10-05T21:17:01.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.167+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f6896250 msgr2=0x5647f68bfe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:01.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.167+0000 7f4cdc493680 1 --2- 172.21.15.153:0/147138055 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f6896250 0x5647f68bfe70 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0005a90 tx=0x7f4cc001d000 comp rx=0 tx=0).stop 2023-10-05T21:17:01.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.168+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 shutdown_connections 2023-10-05T21:17:01.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.168+0000 7f4cdc493680 1 --2- 172.21.15.153:0/147138055 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f6896250 0x5647f68bfe70 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:01.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.168+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 >> 172.21.15.153:0/147138055 conn(0x5647f6891b20 msgr2=0x5647f68afb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:01.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.168+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 shutdown_connections 2023-10-05T21:17:01.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.168+0000 7f4cdc493680 1 -- 172.21.15.153:0/147138055 wait complete. 2023-10-05T21:17:01.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.168+0000 7f4cdc493680 1 -- 172.21.15.153:0/3630107893 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4c0c0340f0 msgr2=0x7f4c0c0365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:01.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.168+0000 7f4cdc493680 1 --2- 172.21.15.153:0/3630107893 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4c0c0340f0 0x7f4c0c0365a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x5647f68da180 tx=0x7f4cc8037450 comp rx=0 tx=0).stop 2023-10-05T21:17:01.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.168+0000 7f4cdc493680 1 -- 172.21.15.153:0/3630107893 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f68e8970 msgr2=0x5647f68ef6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:17:01.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.168+0000 7f4cdc493680 1 --2- 172.21.15.153:0/3630107893 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f68e8970 0x5647f68ef6b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x5647f68e41e0 tx=0x7f4cc4030000 comp rx=0 tx=0).stop 2023-10-05T21:17:01.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.168+0000 7f4cdc493680 1 -- 172.21.15.153:0/3630107893 shutdown_connections 2023-10-05T21:17:01.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.168+0000 7f4cdc493680 1 --2- 172.21.15.153:0/3630107893 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f4c0c0340f0 0x7f4c0c0365a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:01.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.168+0000 7f4cdc493680 1 --2- 172.21.15.153:0/3630107893 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5647f68e8970 0x5647f68ef6b0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:17:01.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.168+0000 7f4cdc493680 1 -- 172.21.15.153:0/3630107893 >> 172.21.15.153:0/3630107893 conn(0x5647f68e4c70 msgr2=0x5647f68e2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:17:01.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.168+0000 7f4cdc493680 1 -- 172.21.15.153:0/3630107893 shutdown_connections 2023-10-05T21:17:01.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-05T21:17:01.168+0000 7f4cdc493680 1 -- 172.21.15.153:0/3630107893 wait complete. 2023-10-05T21:17:01.202 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:17:01.202 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:17:01.202 ERROR:root:0 2023-10-05T21:17:01.203 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2023-10-05T21:17:01.208 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'RequestId': 'tx000006fc0a58be2683957-00651f27cd-107c-default', 'HostId': '107c-default-default'} 2023-10-05T21:17:01.208 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2023-10-05T21:17:01.217 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:17:01.217 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2023-10-05T21:17:01.229 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2023-10-05T21:17:01.229 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2023-10-05T21:17:01.240 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2023-10-05T21:17:01.240 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2023-10-05T21:17:01.247 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2023-10-05T21:17:01.247 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2023-10-05T21:17:01.251 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:17:01.251 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2023-10-05T21:17:01.255 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:17:01.255 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2023-10-05T21:17:01.260 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:17:01.260 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2023-10-05T21:17:01.263 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:17:01.264 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2023-10-05T21:17:01.269 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:17:01.269 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2023-10-05T21:17:01.272 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:17:01.272 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2023-10-05T21:17:01.279 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}] 2023-10-05T21:17:01.279 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2023-10-05T21:17:01.283 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:17:01.283 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2023-10-05T21:17:01.289 INFO:tasks.radosgw_admin_rest: empty result 2023-10-05T21:17:01.289 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2023-10-05T21:17:01.293 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:17:01.293 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2023-10-05T21:17:01.299 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2023-10-05T21:17:01.299 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2023-10-05T21:17:01.302 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:17:01.303 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2023-10-05T21:17:01.309 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2023-10-05T21:17:01.309 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2023-10-05T21:17:01.313 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:17:01.313 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2023-10-05T21:17:01.319 INFO:tasks.radosgw_admin_rest: empty result 2023-10-05T21:17:01.319 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2023-10-05T21:17:01.322 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:17:01.323 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2023-10-05T21:17:01.327 INFO:tasks.radosgw_admin_rest: empty result 2023-10-05T21:17:01.327 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2023-10-05T21:17:01.331 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:17:01.331 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2023-10-05T21:17:01.337 INFO:tasks.radosgw_admin_rest: empty result 2023-10-05T21:17:01.337 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2023-10-05T21:17:01.340 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:17:01.340 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2023-10-05T21:17:01.345 INFO:tasks.radosgw_admin_rest: json result: [] 2023-10-05T21:17:01.346 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2023-10-05T21:17:01.350 INFO:tasks.radosgw_admin_rest: json result: [] 2023-10-05T21:17:01.359 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2023-10-05T21:17:01.363 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2023-10-05T21:17:01.363 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2023-10-05T21:17:01.368 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '371967c9-8a2e-480a-9a00-92e7f0730f89', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.9', 'marker': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.9', 'index_type': 'Normal', 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2023-10-05T21:17:01.355827Z', 'creation_time': '2023-10-05T21:17:01.353136Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2023-10-05T21:17:01.368 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2023-10-05T21:17:01.373 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '371967c9-8a2e-480a-9a00-92e7f0730f89', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.9', 'marker': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.9', 'index_type': 'Normal', 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2023-10-05T21:17:01.355827Z', 'creation_time': '2023-10-05T21:17:01.353136Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2023-10-05T21:17:01.377 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2023-10-05T21:17:01.381 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '371967c9-8a2e-480a-9a00-92e7f0730f89', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.9', 'marker': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.9', 'index_type': 'Normal', 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2023-10-05T21:17:01.355827Z', 'creation_time': '2023-10-05T21:17:01.353136Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2023-10-05T21:17:01.381 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2023-10-05T21:17:01.385 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'RequestId': 'tx000004783a7170a906199-00651f27cd-107c-default', 'HostId': '107c-default-default'} 2023-10-05T21:17:01.388 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2023-10-05T21:17:01.395 INFO:tasks.radosgw_admin_rest: empty result 2023-10-05T21:17:01.395 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2023-10-05T21:17:01.404 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:17:01.450 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.9'} 2023-10-05T21:17:01.459 INFO:tasks.radosgw_admin_rest: empty result 2023-10-05T21:17:01.461 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.9'} 2023-10-05T21:17:01.470 INFO:tasks.radosgw_admin_rest: empty result 2023-10-05T21:17:01.471 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2023-10-05T21:17:01.479 INFO:tasks.radosgw_admin_rest: empty result 2023-10-05T21:17:01.484 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2023-10-05T21:17:01.490 INFO:tasks.radosgw_admin_rest: empty result 2023-10-05T21:17:01.490 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2023-10-05T21:17:01.495 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '371967c9-8a2e-480a-9a00-92e7f0730f89', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.9', 'marker': '193cdd3f-16f8-4551-b3a7-d103e6acfa54.4222.9', 'index_type': 'Normal', 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2023-10-05T21:17:01.466153Z', 'creation_time': '2023-10-05T21:17:01.353136Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2023-10-05T21:18:01.536 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2023-10-05T21:18:01.553 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'anonymous', 'categories': []}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'bar', 'categories': []}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'bud', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'fud', 'categories': []}, {'bucket': 'myfoo7', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'fud', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}]} 2023-10-05T21:18:01.554 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2023-10-05T21:18:01.568 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 231, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 215, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}]}, {'bucket': 'myfoo7', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 231, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 231, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 215, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 223, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4}}]} 2023-10-05T21:18:01.568 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2023-10-05T21:18:01.575 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}]} 2023-10-05T21:18:01.575 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2023-10-05T21:18:01.580 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'useless-bucket', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}}]} 2023-10-05T21:18:01.580 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2023-10-05T21:18:01.584 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}}]} 2023-10-05T21:18:01.584 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2023-10-05T21:18:01.589 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}]} 2023-10-05T21:18:01.589 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2023-10-05T21:18:01.593 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': []}, {'bucket': 'useless-bucket', 'time': '2023-10-05T21:00:00.000000Z', 'epoch': 1696539600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}]} 2023-10-05T21:18:01.594 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2023-10-05T21:18:01.600 INFO:tasks.radosgw_admin_rest: empty result 2023-10-05T21:18:01.600 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2023-10-05T21:18:01.605 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2023-10-05T21:18:01.605 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2023-10-05T21:18:01.614 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:18:01.617 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2023-10-05T21:18:01.625 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:18:01.888 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2023-10-05T21:18:01.892 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'RequestId': 'tx00000823ff811e270fab3-00651f2809-107c-default', 'HostId': '107c-default-default'} 2023-10-05T21:18:01.986 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2023-10-05T21:18:01.991 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'email': '', 'permission': {'flags': 15}, 'name': 'Foo', 'group': 0, 'url_spec': ''}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2023-10-05T21:18:01.995 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2023-10-05T21:18:01.999 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'id': '', 'email': '', 'permission': {'flags': 1}, 'name': '', 'group': 1, 'url_spec': ''}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'email': '', 'permission': {'flags': 15}, 'name': 'Foo', 'group': 0, 'url_spec': ''}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2023-10-05T21:18:02.060 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2023-10-05T21:18:02.094 INFO:tasks.radosgw_admin_rest: empty result 2023-10-05T21:18:02.094 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2023-10-05T21:18:02.099 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2023-10-05T21:18:02.099 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2023-10-05T21:18:02.104 INFO:tasks.radosgw_admin_rest: json result: [] 2023-10-05T21:18:02.113 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2023-10-05T21:18:02.117 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'RequestId': 'tx0000054e79d7f908d230a-00651f280a-107c-default', 'HostId': '107c-default-default'} 2023-10-05T21:18:02.163 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2023-10-05T21:18:02.193 INFO:tasks.radosgw_admin_rest: empty result 2023-10-05T21:18:02.193 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2023-10-05T21:18:02.197 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'RequestId': 'tx0000011148449efa06e8f-00651f280a-107c-default', 'HostId': '107c-default-default'} 2023-10-05T21:18:02.198 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2023-10-05T21:18:02.201 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': 'eafdd85a-3bd2-413c-acb4-cdb3a151d4a9'}]}} 2023-10-05T21:18:02.201 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2023-10-05T21:18:02.210 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T21:18:02.210 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2023-10-05T21:18:02.214 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2023-10-05T21:18:02.214 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2023-10-05T21:18:02.218 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'RequestId': 'tx00000bba552afd71cc48a-00651f280a-107c-default', 'HostId': '107c-default-default'} 2023-10-05T21:18:02.218 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2023-10-05T21:18:02.222 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'RequestId': 'tx00000822e3516c6882d13-00651f280a-107c-default', 'HostId': '107c-default-default'} 2023-10-05T21:18:02.230 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2023-10-05T21:18:02.233 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2023-10-05T21:18:02.234 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2023-10-05T21:18:02.238 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'RequestId': 'tx00000cc50515328d85d0d-00651f280a-107c-default', 'HostId': '107c-default-default'} 2023-10-05T21:18:02.238 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2023-10-05T21:18:02.241 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'RequestId': 'tx00000fe876886dda5233d-00651f280a-107c-default', 'HostId': '107c-default-default'} 2023-10-05T21:18:02.242 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2023-10-05T21:18:02.246 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2023-10-05T21:18:02.246 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2023-10-05T21:18:02.249 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'RequestId': 'tx000009c8bdac1d160ee32-00651f280a-107c-default', 'HostId': '107c-default-default'} 2023-10-05T21:18:02.249 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2023-10-05T21:18:02.253 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'RequestId': 'tx000007e9b29a57f2b8472-00651f280a-107c-default', 'HostId': '107c-default-default'} 2023-10-05T21:18:02.253 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2023-10-05T21:18:02.256 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'RequestId': 'tx000006b3878fe643eeb4a-00651f280a-107c-default', 'HostId': '107c-default-default'} 2023-10-05T21:18:02.257 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2023-10-05T21:18:02.260 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'RequestId': 'tx00000964d19006616e15b-00651f280a-107c-default', 'HostId': '107c-default-default'} 2023-10-05T21:18:02.260 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2023-10-05T21:18:02.268 INFO:tasks.radosgw_admin_rest: empty result 2023-10-05T21:18:02.268 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2023-10-05T21:18:02.272 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2023-10-05T21:18:02.272 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2023-10-05T21:18:02.277 INFO:tasks.radosgw_admin_rest: empty result 2023-10-05T21:18:02.277 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2023-10-05T21:18:02.280 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2023-10-05T21:18:02.281 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2023-10-05T21:18:02.285 INFO:tasks.radosgw_admin_rest: empty result 2023-10-05T21:18:02.290 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2023-10-05T21:18:02.331 DEBUG:tasks.rgw.client.0:waiting for process to exit 2023-10-05T21:18:02.331 INFO:teuthology.orchestra.run:waiting for 300 2023-10-05T21:18:02.332 INFO:tasks.rgw.client.0.smithi153.stdout:2023-10-05T21:18:02.331+0000 7f9513cbe700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 141146) UID: 0 2023-10-05T21:18:02.332 INFO:tasks.rgw.client.0.smithi153.stdout:2023-10-05T21:18:02.331+0000 7f952404d740 -1 shutting down 2023-10-05T21:18:06.775 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2023-10-05T21:18:08.433 INFO:tasks.rgw.client.0:Stopped 2023-10-05T21:18:08.433 DEBUG:teuthology.orchestra.run.smithi153:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2023-10-05T21:18:08.456 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f /etc/ceph/vault-root-token 2023-10-05T21:18:08.530 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-05T21:18:08.571 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-05T21:18:08.571 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T21:18:08.701 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.698+0000 7f603619b700 1 Processor -- start 2023-10-05T21:18:08.701 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.698+0000 7f603619b700 1 -- start start 2023-10-05T21:18:08.702 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.699+0000 7f603619b700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f6030092550 0x7f603012e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:18:08.702 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.699+0000 7f603619b700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60300931b0 con 0x7f6030096ec0 2023-10-05T21:18:08.702 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.699+0000 7f603619b700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6030090810 con 0x7f6030092550 2023-10-05T21:18:08.702 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.699+0000 7f602effd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f6030092550 0x7f603012e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:18:08.702 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.699+0000 7f602f7fe700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f6030096ec0 0x7f6030097290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:48586/0 (socket says 172.21.15.111:48586) 2023-10-05T21:18:08.702 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.699+0000 7f602f7fe700 1 -- 172.21.15.111:0/594827581 learned_addr learned my addr 172.21.15.111:0/594827581 (peer_addr_for_me v1:172.21.15.111:0/0) 2023-10-05T21:18:08.702 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.699+0000 7f602effd700 1 -- 172.21.15.111:0/594827581 >> v1:172.21.15.111:6789/0 conn(0x7f6030096ec0 legacy=0x7f6030097290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:18:08.702 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.699+0000 7f602effd700 1 -- 172.21.15.111:0/594827581 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60300909d0 con 0x7f6030092550 2023-10-05T21:18:08.702 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.699+0000 7f602effd700 1 --2- 172.21.15.111:0/594827581 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6030092550 0x7f603012e6f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f6024009860 tx=0x7f60240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17f7b5e12fad51ec server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:18:08.702 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.700+0000 7f602e7fc700 1 -- 172.21.15.111:0/594827581 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f602400b680 con 0x7f6030092550 2023-10-05T21:18:08.702 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.700+0000 7f602e7fc700 1 -- 172.21.15.111:0/594827581 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602400b7e0 con 0x7f6030092550 2023-10-05T21:18:08.703 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.700+0000 7f602e7fc700 1 -- 172.21.15.111:0/594827581 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f602400bad0 con 0x7f6030092550 2023-10-05T21:18:08.705 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.700+0000 7f603619b700 1 -- 172.21.15.111:0/594827581 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6030092550 msgr2=0x7f603012e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:18:08.705 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.700+0000 7f603619b700 1 --2- 172.21.15.111:0/594827581 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6030092550 0x7f603012e6f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f6024009860 tx=0x7f60240091a0 comp rx=0 tx=0).stop 2023-10-05T21:18:08.705 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.700+0000 7f603619b700 1 -- 172.21.15.111:0/594827581 shutdown_connections 2023-10-05T21:18:08.705 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.700+0000 7f603619b700 1 --2- 172.21.15.111:0/594827581 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6030092550 0x7f603012e6f0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:18:08.705 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.700+0000 7f603619b700 1 -- 172.21.15.111:0/594827581 >> 172.21.15.111:0/594827581 conn(0x7f6030098d70 msgr2=0x7f6030099170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:18:08.706 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.700+0000 7f603619b700 1 -- 172.21.15.111:0/594827581 shutdown_connections 2023-10-05T21:18:08.706 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.700+0000 7f603619b700 1 -- 172.21.15.111:0/594827581 wait complete. 2023-10-05T21:18:08.706 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.701+0000 7f603619b700 1 Processor -- start 2023-10-05T21:18:08.706 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.701+0000 7f603619b700 1 -- start start 2023-10-05T21:18:08.706 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.701+0000 7f603619b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6030092550 0x7f60301385a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:18:08.706 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.701+0000 7f603619b700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603008d880 con 0x7f6030092550 2023-10-05T21:18:08.706 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.702+0000 7f602f7fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6030092550 0x7f60301385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:18:08.706 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.702+0000 7f602f7fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6030092550 0x7f60301385a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39152/0 (socket says 172.21.15.111:39152) 2023-10-05T21:18:08.706 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.702+0000 7f602f7fe700 1 -- 172.21.15.111:0/888033273 learned_addr learned my addr 172.21.15.111:0/888033273 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-10-05T21:18:08.706 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.702+0000 7f602f7fe700 1 -- 172.21.15.111:0/888033273 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6024009420 con 0x7f6030092550 2023-10-05T21:18:08.706 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.702+0000 7f602f7fe700 1 --2- 172.21.15.111:0/888033273 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6030092550 0x7f60301385a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f602000c6c0 tx=0x7f6020007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:18:08.707 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.702+0000 7f60177fe700 1 -- 172.21.15.111:0/888033273 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6020007440 con 0x7f6030092550 2023-10-05T21:18:08.707 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.702+0000 7f60177fe700 1 -- 172.21.15.111:0/888033273 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60200075a0 con 0x7f6030092550 2023-10-05T21:18:08.707 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.702+0000 7f603619b700 1 -- 172.21.15.111:0/888033273 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f603008f950 con 0x7f6030092550 2023-10-05T21:18:08.707 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.702+0000 7f60177fe700 1 -- 172.21.15.111:0/888033273 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6020005970 con 0x7f6030092550 2023-10-05T21:18:08.707 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.702+0000 7f603619b700 1 -- 172.21.15.111:0/888033273 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603008ea90 con 0x7f6030092550 2023-10-05T21:18:08.707 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.703+0000 7f60177fe700 1 -- 172.21.15.111:0/888033273 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f6020005ba0 con 0x7f6030092550 2023-10-05T21:18:08.707 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.703+0000 7f60177fe700 1 --2- 172.21.15.111:0/888033273 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f601c0358d0 0x7f601c037d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:18:08.707 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.703+0000 7f60177fe700 1 -- 172.21.15.111:0/888033273 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f60200480a0 con 0x7f6030092550 2023-10-05T21:18:08.707 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.703+0000 7f603619b700 1 -- 172.21.15.111:0/888033273 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60300647e0 con 0x7f6030092550 2023-10-05T21:18:08.707 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.703+0000 7f602effd700 1 --2- 172.21.15.111:0/888033273 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f601c0358d0 0x7f601c037d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:18:08.708 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.704+0000 7f602effd700 1 --2- 172.21.15.111:0/888033273 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f601c0358d0 0x7f601c037d80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f60240091e0 tx=0x7f6024016000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:18:08.709 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.708+0000 7f60177fe700 1 -- 172.21.15.111:0/888033273 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f6020014420 con 0x7f6030092550 2023-10-05T21:18:08.892 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.890+0000 7f603619b700 1 -- 172.21.15.111:0/888033273 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f603004bb40 con 0x7f6030092550 2023-10-05T21:18:08.893 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.891+0000 7f60177fe700 1 -- 172.21.15.111:0/888033273 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+18697 (secure 0 0 0) 0x7f60200102c0 con 0x7f6030092550 2023-10-05T21:18:08.893 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-10-05T21:18:08.893 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":31,"fsid":"eafdd85a-3bd2-413c-acb4-cdb3a151d4a9","created":"2023-10-05T21:14:36.058348+0000","modified":"2023-10-05T21:15:43.057658+0000","last_up_change":"2023-10-05T21:14:40.299737+0000","last_in_change":"2023-10-05T21:14:37.295251+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T21:14:41.505527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-05T21:14:45.184009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2023-10-05T21:14:52.329044+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2023-10-05T21:14:54.407038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":".rgw.root","create_time":"2023-10-05T21:14:56.273602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2023-10-05T21:14:58.156855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2023-10-05T21:15:00.151224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2023-10-05T21:15:02.181728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"5f41de27-2f93-4f50-94db-3104799b246b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":111394},{"type":"v1","addr":"172.21.15.111:6801","nonce":111394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":111394},{"type":"v1","addr":"172.21.15.111:6803","nonce":111394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":111394},{"type":"v1","addr":"172.21.15.111:6807","nonce":111394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":111394},{"type":"v1","addr":"172.21.15.111:6805","nonce":111394}]},"public_addr":"172.21.15.111:6801/111394","cluster_addr":"172.21.15.111:6803/111394","heartbeat_back_addr":"172.21.15.111:6807/111394","heartbeat_front_addr":"172.21.15.111:6805/111394","state":["exists","up"]},{"osd":1,"uuid":"96502bac-f68a-4b39-8f59-057a68c166c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":140456},{"type":"v1","addr":"172.21.15.153:6817","nonce":140456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":140456},{"type":"v1","addr":"172.21.15.153:6819","nonce":140456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":140456},{"type":"v1","addr":"172.21.15.153:6823","nonce":140456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":140456},{"type":"v1","addr":"172.21.15.153:6821","nonce":140456}]},"public_addr":"172.21.15.153:6817/140456","cluster_addr":"172.21.15.153:6819/140456","heartbeat_back_addr":"172.21.15.153:6823/140456","heartbeat_front_addr":"172.21.15.153:6821/140456","state":["exists","up"]},{"osd":2,"uuid":"cde70c28-f914-4707-aa7d-08e49fcf599c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":140454},{"type":"v1","addr":"172.21.15.153:6809","nonce":140454}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":140454},{"type":"v1","addr":"172.21.15.153:6811","nonce":140454}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":140454},{"type":"v1","addr":"172.21.15.153:6815","nonce":140454}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":140454},{"type":"v1","addr":"172.21.15.153:6813","nonce":140454}]},"public_addr":"172.21.15.153:6809/140454","cluster_addr":"172.21.15.153:6811/140454","heartbeat_back_addr":"172.21.15.153:6815/140454","heartbeat_front_addr":"172.21.15.153:6813/140454","state":["exists","up"]},{"osd":3,"uuid":"9095f398-15a3-40b2-9d98-d156bc343bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":140455},{"type":"v1","addr":"172.21.15.153:6801","nonce":140455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":140455},{"type":"v1","addr":"172.21.15.153:6803","nonce":140455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":140455},{"type":"v1","addr":"172.21.15.153:6808","nonce":140455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":140455},{"type":"v1","addr":"172.21.15.153:6805","nonce":140455}]},"public_addr":"172.21.15.153:6801/140455","cluster_addr":"172.21.15.153:6803/140455","heartbeat_back_addr":"172.21.15.153:6808/140455","heartbeat_front_addr":"172.21.15.153:6805/140455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T21:14:38.443329+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T21:14:38.471353+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T21:14:38.436233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T21:14:38.415988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":3,"to":0}]},{"pgid":"3.3f","mappings":[{"from":3,"to":1}]},{"pgid":"4.3","mappings":[{"from":3,"to":0}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.22","mappings":[{"from":3,"to":2}]},{"pgid":"4.2d","mappings":[{"from":3,"to":2}]},{"pgid":"5.1","mappings":[{"from":0,"to":2}]},{"pgid":"5.12","mappings":[{"from":0,"to":2}]},{"pgid":"5.1a","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T21:18:08.895 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.893+0000 7f603619b700 1 -- 172.21.15.111:0/888033273 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f601c0358d0 msgr2=0x7f601c037d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:18:08.895 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.893+0000 7f603619b700 1 --2- 172.21.15.111:0/888033273 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f601c0358d0 0x7f601c037d80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f60240091e0 tx=0x7f6024016000 comp rx=0 tx=0).stop 2023-10-05T21:18:08.896 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.893+0000 7f603619b700 1 -- 172.21.15.111:0/888033273 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6030092550 msgr2=0x7f60301385a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:18:08.896 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.893+0000 7f603619b700 1 --2- 172.21.15.111:0/888033273 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6030092550 0x7f60301385a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f602000c6c0 tx=0x7f6020007de0 comp rx=0 tx=0).stop 2023-10-05T21:18:08.896 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.893+0000 7f603619b700 1 -- 172.21.15.111:0/888033273 shutdown_connections 2023-10-05T21:18:08.896 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.893+0000 7f603619b700 1 --2- 172.21.15.111:0/888033273 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f601c0358d0 0x7f601c037d80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:18:08.896 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.893+0000 7f603619b700 1 --2- 172.21.15.111:0/888033273 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6030092550 0x7f60301385a0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:18:08.896 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.893+0000 7f603619b700 1 -- 172.21.15.111:0/888033273 >> 172.21.15.111:0/888033273 conn(0x7f6030098d70 msgr2=0x7f6030084ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:18:08.896 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.893+0000 7f603619b700 1 -- 172.21.15.111:0/888033273 shutdown_connections 2023-10-05T21:18:08.896 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:08.893+0000 7f603619b700 1 -- 172.21.15.111:0/888033273 wait complete. 2023-10-05T21:18:08.907 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-05T21:18:09.022 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.020+0000 7f87cb7af700 1 Processor -- start 2023-10-05T21:18:09.022 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.020+0000 7f87cb7af700 1 -- start start 2023-10-05T21:18:09.024 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.021+0000 7f87cb7af700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f87c406ba80 0x7f87c412e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:18:09.025 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.021+0000 7f87cb7af700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c406eeb0 con 0x7f87c406afa0 2023-10-05T21:18:09.025 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.021+0000 7f87cb7af700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c406c0c0 con 0x7f87c406ba80 2023-10-05T21:18:09.025 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.021+0000 7f87c8d4a700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f87c406ba80 0x7f87c412e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:18:09.025 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.021+0000 7f87c954b700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f87c406afa0 0x7f87c406b370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:48592/0 (socket says 172.21.15.111:48592) 2023-10-05T21:18:09.025 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.021+0000 7f87c8d4a700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f87c406ba80 0x7f87c412e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39156/0 (socket says 172.21.15.111:39156) 2023-10-05T21:18:09.025 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.021+0000 7f87c954b700 1 -- 172.21.15.111:0/275990317 learned_addr learned my addr 172.21.15.111:0/275990317 (peer_addr_for_me v1:172.21.15.111:0/0) 2023-10-05T21:18:09.025 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.021+0000 7f87c8d4a700 1 -- 172.21.15.111:0/275990317 >> v1:172.21.15.111:6789/0 conn(0x7f87c406afa0 legacy=0x7f87c406b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:18:09.025 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.021+0000 7f87c8d4a700 1 -- 172.21.15.111:0/275990317 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c406c9c0 con 0x7f87c406ba80 2023-10-05T21:18:09.025 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.021+0000 7f87c8d4a700 1 --2- 172.21.15.111:0/275990317 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87c406ba80 0x7f87c412e990 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f87c0009860 tx=0x7f87c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0fa233a2858a615 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:18:09.025 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.021+0000 7f87bbfff700 1 -- 172.21.15.111:0/275990317 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87c000b680 con 0x7f87c406ba80 2023-10-05T21:18:09.025 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.021+0000 7f87bbfff700 1 -- 172.21.15.111:0/275990317 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c000b7e0 con 0x7f87c406ba80 2023-10-05T21:18:09.026 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.021+0000 7f87bbfff700 1 -- 172.21.15.111:0/275990317 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87c000b990 con 0x7f87c406ba80 2023-10-05T21:18:09.026 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.022+0000 7f87cb7af700 1 -- 172.21.15.111:0/275990317 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87c406ba80 msgr2=0x7f87c412e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:18:09.026 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.022+0000 7f87cb7af700 1 --2- 172.21.15.111:0/275990317 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87c406ba80 0x7f87c412e990 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f87c0009860 tx=0x7f87c00091a0 comp rx=0 tx=0).stop 2023-10-05T21:18:09.026 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.022+0000 7f87cb7af700 1 -- 172.21.15.111:0/275990317 shutdown_connections 2023-10-05T21:18:09.026 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.022+0000 7f87cb7af700 1 --2- 172.21.15.111:0/275990317 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87c406ba80 0x7f87c412e990 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:18:09.026 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.022+0000 7f87cb7af700 1 -- 172.21.15.111:0/275990317 >> 172.21.15.111:0/275990317 conn(0x7f87c4098930 msgr2=0x7f87c4098d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:18:09.026 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.022+0000 7f87cb7af700 1 -- 172.21.15.111:0/275990317 shutdown_connections 2023-10-05T21:18:09.026 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.022+0000 7f87cb7af700 1 -- 172.21.15.111:0/275990317 wait complete. 2023-10-05T21:18:09.026 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.023+0000 7f87cb7af700 1 Processor -- start 2023-10-05T21:18:09.026 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.023+0000 7f87cb7af700 1 -- start start 2023-10-05T21:18:09.028 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.023+0000 7f87cb7af700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87c406afa0 0x7f87c411d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:18:09.028 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.023+0000 7f87cb7af700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c4091fb0 con 0x7f87c406afa0 2023-10-05T21:18:09.029 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.023+0000 7f87c954b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87c406afa0 0x7f87c411d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:18:09.029 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.023+0000 7f87c954b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87c406afa0 0x7f87c411d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39160/0 (socket says 172.21.15.111:39160) 2023-10-05T21:18:09.029 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.023+0000 7f87c954b700 1 -- 172.21.15.111:0/1382741181 learned_addr learned my addr 172.21.15.111:0/1382741181 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-10-05T21:18:09.029 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.024+0000 7f87c954b700 1 -- 172.21.15.111:0/1382741181 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c0009420 con 0x7f87c406afa0 2023-10-05T21:18:09.029 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.024+0000 7f87c954b700 1 --2- 172.21.15.111:0/1382741181 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87c406afa0 0x7f87c411d8a0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f87b400c6c0 tx=0x7f87b4007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:18:09.029 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.024+0000 7f87b97fa700 1 -- 172.21.15.111:0/1382741181 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87b4005b30 con 0x7f87c406afa0 2023-10-05T21:18:09.029 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.024+0000 7f87b97fa700 1 -- 172.21.15.111:0/1382741181 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b4005c90 con 0x7f87c406afa0 2023-10-05T21:18:09.029 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.024+0000 7f87cb7af700 1 -- 172.21.15.111:0/1382741181 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c4120a40 con 0x7f87c406afa0 2023-10-05T21:18:09.029 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.024+0000 7f87b97fa700 1 -- 172.21.15.111:0/1382741181 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87b4004830 con 0x7f87c406afa0 2023-10-05T21:18:09.029 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.024+0000 7f87cb7af700 1 -- 172.21.15.111:0/1382741181 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c411ec80 con 0x7f87c406afa0 2023-10-05T21:18:09.029 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.025+0000 7f87b97fa700 1 -- 172.21.15.111:0/1382741181 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42691+0+0 (secure 0 0 0) 0x7f87b4004990 con 0x7f87c406afa0 2023-10-05T21:18:09.029 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.025+0000 7f87b97fa700 1 --2- 172.21.15.111:0/1382741181 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f87a80358d0 0x7f87a8037d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T21:18:09.030 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.025+0000 7f87cb7af700 1 -- 172.21.15.111:0/1382741181 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c4096e70 con 0x7f87c406afa0 2023-10-05T21:18:09.030 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.025+0000 7f87b97fa700 1 -- 172.21.15.111:0/1382741181 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f87b40475f0 con 0x7f87c406afa0 2023-10-05T21:18:09.030 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.025+0000 7f87c8d4a700 1 --2- 172.21.15.111:0/1382741181 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f87a80358d0 0x7f87a8037d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T21:18:09.030 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.026+0000 7f87c8d4a700 1 --2- 172.21.15.111:0/1382741181 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f87a80358d0 0x7f87a8037d80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f87c00091e0 tx=0x7f87c0016000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T21:18:09.031 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.029+0000 7f87b97fa700 1 -- 172.21.15.111:0/1382741181 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f87b40106c0 con 0x7f87c406afa0 2023-10-05T21:18:09.213 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.211+0000 7f87cb7af700 1 -- 172.21.15.111:0/1382741181 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f87c40647e0 con 0x7f87c406afa0 2023-10-05T21:18:09.215 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.213+0000 7f87b97fa700 1 -- 172.21.15.111:0/1382741181 <== mon.0 v2:172.21.15.111:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f87b40106c0 con 0x7f87c406afa0 2023-10-05T21:18:09.215 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.214+0000 7f87b97fa700 1 -- 172.21.15.111:0/1382741181 <== mon.0 v2:172.21.15.111:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) v1 ==== 123+0+0 (secure 0 0 0) 0x7f87b4020e60 con 0x7f87c406afa0 2023-10-05T21:18:09.219 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.216+0000 7f87cb7af700 1 -- 172.21.15.111:0/1382741181 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f87a80358d0 msgr2=0x7f87a8037d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:18:09.219 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.216+0000 7f87cb7af700 1 --2- 172.21.15.111:0/1382741181 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f87a80358d0 0x7f87a8037d80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f87c00091e0 tx=0x7f87c0016000 comp rx=0 tx=0).stop 2023-10-05T21:18:09.219 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.216+0000 7f87cb7af700 1 -- 172.21.15.111:0/1382741181 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87c406afa0 msgr2=0x7f87c411d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T21:18:09.219 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.216+0000 7f87cb7af700 1 --2- 172.21.15.111:0/1382741181 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87c406afa0 0x7f87c411d8a0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f87b400c6c0 tx=0x7f87b4007f70 comp rx=0 tx=0).stop 2023-10-05T21:18:09.219 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.216+0000 7f87cb7af700 1 -- 172.21.15.111:0/1382741181 shutdown_connections 2023-10-05T21:18:09.219 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.216+0000 7f87cb7af700 1 --2- 172.21.15.111:0/1382741181 >> [v2:172.21.15.153:6824/140077,v1:172.21.15.153:6825/140077] conn(0x7f87a80358d0 0x7f87a8037d80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:18:09.220 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.216+0000 7f87cb7af700 1 --2- 172.21.15.111:0/1382741181 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87c406afa0 0x7f87c411d8a0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T21:18:09.220 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.216+0000 7f87cb7af700 1 -- 172.21.15.111:0/1382741181 >> 172.21.15.111:0/1382741181 conn(0x7f87c4098930 msgr2=0x7f87c408b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T21:18:09.220 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.216+0000 7f87cb7af700 1 -- 172.21.15.111:0/1382741181 shutdown_connections 2023-10-05T21:18:09.220 INFO:teuthology.orchestra.run.smithi111.stderr:2023-10-05T21:18:09.216+0000 7f87cb7af700 1 -- 172.21.15.111:0/1382741181 wait complete. 2023-10-05T21:18:09.229 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-05T21:18:09.229 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-05T21:18:09.230 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-05T21:18:09.230 INFO:teuthology.orchestra.run:waiting for 300 2023-10-05T21:18:09.241 INFO:tasks.ceph.osd.0:Stopped 2023-10-05T21:18:09.242 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-05T21:18:09.242 INFO:teuthology.orchestra.run:waiting for 300 2023-10-05T21:18:09.256 INFO:tasks.ceph.osd.1:Stopped 2023-10-05T21:18:09.256 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-05T21:18:09.256 INFO:teuthology.orchestra.run:waiting for 300 2023-10-05T21:18:09.310 INFO:tasks.ceph.osd.2:Stopped 2023-10-05T21:18:09.310 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-05T21:18:09.311 INFO:teuthology.orchestra.run:waiting for 300 2023-10-05T21:18:09.364 INFO:tasks.ceph.osd.3:Stopped 2023-10-05T21:18:09.364 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-05T21:18:09.365 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-05T21:18:09.365 INFO:teuthology.orchestra.run:waiting for 300 2023-10-05T21:18:09.430 INFO:tasks.ceph.mgr.x:Stopped 2023-10-05T21:18:09.430 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-05T21:18:09.430 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-05T21:18:09.430 INFO:teuthology.orchestra.run:waiting for 300 2023-10-05T21:18:09.440 INFO:tasks.ceph.mon.a:Stopped 2023-10-05T21:18:09.441 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-05T21:18:09.441 DEBUG:teuthology.orchestra.run.smithi111:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2023-10-05T21:18:09.510 INFO:teuthology.orchestra.run.smithi111.stdout:1696540482.469618 mon.a (mon.0) 69 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-05T21:18:09.510 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-05T21:18:09.510 DEBUG:teuthology.orchestra.run.smithi111:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2023-10-05T21:18:09.579 DEBUG:teuthology.orchestra.run.smithi111:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2023-10-05T21:18:09.648 DEBUG:teuthology.orchestra.run.smithi111:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2023-10-05T21:18:09.717 INFO:teuthology.orchestra.run.smithi111.stdout:1696540482.469618 mon.a (mon.0) 69 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-05T21:18:09.717 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi111.front.sepia.ceph.com 2023-10-05T21:18:09.717 DEBUG:teuthology.orchestra.run.smithi111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-05T21:18:09.938 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi153.front.sepia.ceph.com 2023-10-05T21:18:09.938 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-05T21:18:10.074 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi153.front.sepia.ceph.com 2023-10-05T21:18:10.074 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-05T21:18:10.152 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi153.front.sepia.ceph.com 2023-10-05T21:18:10.152 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-05T21:18:10.237 INFO:tasks.ceph:Archiving mon data... 2023-10-05T21:18:10.239 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7411776/data/mon.a.tgz 2023-10-05T21:18:10.240 DEBUG:teuthology.orchestra.run.smithi111:> mktemp 2023-10-05T21:18:10.258 INFO:teuthology.orchestra.run.smithi111.stdout:/tmp/tmp.Y7eOhu5X0X 2023-10-05T21:18:10.259 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Y7eOhu5X0X 2023-10-05T21:18:10.386 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0666 /tmp/tmp.Y7eOhu5X0X 2023-10-05T21:18:10.474 DEBUG:teuthology.orchestra.remote:smithi111:/tmp/tmp.Y7eOhu5X0X is 208KB 2023-10-05T21:18:10.567 DEBUG:teuthology.orchestra.run.smithi111:> rm -fr /tmp/tmp.Y7eOhu5X0X 2023-10-05T21:18:10.584 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-05T21:18:10.584 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-05T21:18:10.626 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-05T21:18:10.658 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-05T21:18:10.658 DEBUG:teuthology.orchestra.run.smithi111:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-05T21:18:10.693 DEBUG:teuthology.orchestra.run.smithi153:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-05T21:18:10.718 INFO:teuthology.orchestra.run.smithi111.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-05T21:18:10.732 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-05T21:18:10.738 INFO:tasks.ceph:Archiving crash dumps... 2023-10-05T21:18:10.740 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7411776/remote/smithi111/crash 2023-10-05T21:18:10.741 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-05T21:18:10.795 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7411776/remote/smithi153/crash 2023-10-05T21:18:10.796 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-05T21:18:10.845 INFO:tasks.ceph:Compressing logs... 2023-10-05T21:18:10.846 DEBUG:teuthology.orchestra.run.smithi111:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-05T21:18:10.848 DEBUG:teuthology.orchestra.run.smithi153:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-05T21:18:11.776 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2023-10-05T21:18:13.316 INFO:tasks.ceph:Archiving logs... 2023-10-05T21:18:13.316 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7411776/remote/smithi111/log 2023-10-05T21:18:13.317 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-05T21:18:13.494 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7411776/remote/smithi153/log 2023-10-05T21:18:13.495 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-05T21:18:13.902 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-05T21:18:13.911 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-05T21:18:13.911 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-05T21:18:13.914 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-05T21:18:13.995 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-05T21:18:14.004 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-05T21:18:14.004 DEBUG:teuthology.orchestra.run.smithi111:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-05T21:18:14.007 DEBUG:teuthology.orchestra.run.smithi153:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-05T21:18:14.024 INFO:teuthology.orchestra.run.smithi153.stderr:bash: ntpq: command not found 2023-10-05T21:18:14.024 INFO:teuthology.orchestra.run.smithi111.stderr:bash: ntpq: command not found 2023-10-05T21:18:14.028 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-05T21:18:14.028 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2023-10-05T21:18:14.028 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 122 -587us[ -579us] +/- 88ms 2023-10-05T21:18:14.028 INFO:teuthology.orchestra.run.smithi153.stdout:^* hv02.front.sepia.ceph.com 3 7 377 53 -744us[ -736us] +/- 65ms 2023-10-05T21:18:14.028 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 56 +1415us[+1423us] +/- 71ms 2023-10-05T21:18:14.028 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T21:18:14.030 INFO:teuthology.orchestra.run.smithi111.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-05T21:18:14.030 INFO:teuthology.orchestra.run.smithi111.stdout:=============================================================================== 2023-10-05T21:18:14.030 INFO:teuthology.orchestra.run.smithi111.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 122 -622us[ -622us] +/- 88ms 2023-10-05T21:18:14.030 INFO:teuthology.orchestra.run.smithi111.stdout:^* hv02.front.sepia.ceph.com 3 8 377 180 -771us[ -831us] +/- 63ms 2023-10-05T21:18:14.030 INFO:teuthology.orchestra.run.smithi111.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 55 +1364us[+1364us] +/- 71ms 2023-10-05T21:18:14.030 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T21:18:14.031 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-05T21:18:14.040 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-05T21:18:14.040 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-05T21:18:14.049 DEBUG:teuthology.orchestra.run.smithi111:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-05T21:18:14.163 DEBUG:teuthology.orchestra.run.smithi153:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-05T21:18:14.252 DEBUG:teuthology.orchestra.run.smithi111:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-05T21:18:14.285 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T21:18:14.285 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-05T21:18:14.316 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T21:18:14.317 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-05T21:18:14.327 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-05T21:18:14.337 INFO:teuthology.task.internal:Duration was 4365.660045 seconds 2023-10-05T21:18:14.337 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-05T21:18:14.346 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-05T21:18:14.347 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-05T21:18:14.349 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-05T21:18:14.393 INFO:teuthology.orchestra.run.smithi111.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-05T21:18:14.404 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-05T21:18:14.682 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-05T21:18:14.682 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi111.front.sepia.ceph.com 2023-10-05T21:18:14.682 DEBUG:teuthology.orchestra.run.smithi111:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-05T21:18:14.705 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi153.front.sepia.ceph.com 2023-10-05T21:18:14.705 DEBUG:teuthology.orchestra.run.smithi153:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-05T21:18:14.728 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-05T21:18:14.728 DEBUG:teuthology.orchestra.run.smithi111:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-05T21:18:14.747 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-05T21:18:14.806 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-05T21:18:14.807 DEBUG:teuthology.orchestra.run.smithi111:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-05T21:18:14.824 DEBUG:teuthology.orchestra.run.smithi153:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-05T21:18:14.912 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-05T21:18:14.928 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-05T21:18:14.929 DEBUG:teuthology.orchestra.run.smithi111:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-05T21:18:14.956 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-05T21:18:14.984 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-05T21:18:14.995 DEBUG:teuthology.orchestra.run.smithi111:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-05T21:18:15.000 DEBUG:teuthology.orchestra.run.smithi153:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-05T21:18:15.024 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern = core 2023-10-05T21:18:15.051 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = core 2023-10-05T21:18:15.072 DEBUG:teuthology.orchestra.run.smithi111:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-05T21:18:15.126 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T21:18:15.127 DEBUG:teuthology.orchestra.run.smithi153:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-05T21:18:15.144 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T21:18:15.144 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-05T21:18:15.155 INFO:teuthology.task.internal:Transferring archived files... 2023-10-05T21:18:15.155 DEBUG:teuthology.misc:Transferring archived files from smithi111:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7411776/remote/smithi111 2023-10-05T21:18:15.155 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-05T21:18:15.206 DEBUG:teuthology.misc:Transferring archived files from smithi153:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7411776/remote/smithi153 2023-10-05T21:18:15.206 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-05T21:18:15.243 INFO:teuthology.task.internal:Removing archive directory... 2023-10-05T21:18:15.244 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-05T21:18:15.246 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-05T21:18:15.295 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-05T21:18:15.307 INFO:teuthology.task.internal:Not uploading archives. 2023-10-05T21:18:15.307 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-05T21:18:15.318 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-05T21:18:15.319 DEBUG:teuthology.orchestra.run.smithi111:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-05T21:18:15.321 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-05T21:18:15.336 INFO:teuthology.orchestra.run.smithi111.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 5 21:18 /home/ubuntu/cephtest 2023-10-05T21:18:15.353 INFO:teuthology.orchestra.run.smithi153.stdout: 525952 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 5 21:18 /home/ubuntu/cephtest 2023-10-05T21:18:15.354 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-05T21:18:15.365 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-05T21:18:15.387 INFO:teuthology.nuke:Checking targets against current locks 2023-10-05T21:18:15.413 DEBUG:teuthology.nuke:shortname: smithi111 2023-10-05T21:18:15.414 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-05T21:18:15.437 DEBUG:teuthology.nuke:shortname: smithi153 2023-10-05T21:18:15.438 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-05T21:18:15.443 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7411776', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 19:44:18.903128', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFSIcFshv4j1ZisScgQRwmHjhU0nXdvB6X/4EWZBJ63wYe5v1IAyIirqOYDuvoklUas+azYMSnGMNJJHRWBKnM0='} 2023-10-05T21:18:15.455 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7411776', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 19:44:18.901177', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD0BPipO53WEzGHk5IOIh6A0KYrYFA87fnCNiqydHlHlKJmqH0xF8tus8gyFVv36MetERZX/Y4OIJm5+milrRSg='} 2023-10-05T21:18:15.497 INFO:teuthology.orchestra.console.smithi111:Power off 2023-10-05T21:18:15.497 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T21:18:15.512 INFO:teuthology.orchestra.console.smithi153:Power off 2023-10-05T21:18:15.513 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T21:18:15.522 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off 2023-10-05T21:18:15.522 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T21:18:15.532 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2023-10-05T21:18:15.532 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T21:18:15.544 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2023-10-05T21:18:15.556 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-10-05T21:18:19.545 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T21:18:19.557 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T21:18:19.655 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2023-10-05T21:18:19.667 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-10-05T21:18:23.658 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T21:18:23.667 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T21:18:23.769 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2023-10-05T21:18:23.776 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-10-05T21:18:23.870 INFO:teuthology.orchestra.console.smithi111:Power off completed 2023-10-05T21:18:27.778 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T21:18:27.888 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-10-05T21:18:27.988 INFO:teuthology.orchestra.console.smithi153:Power off completed 2023-10-05T21:18:28.092 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated supported-random-distro$/{centos_8}} duration: 4365.660044670105 failure_reason: '"1696540482.469618 mon.a (mon.0) 69 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-05T21:18:28.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T21:18:28.161 INFO:teuthology.run:FAIL